00000100:00100000:3.0:1777051125.528368:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d950265880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3680:1863365452418944:0@lo:400:kworker.0 00000100:00100000:3.0:1777051125.528439:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051125.528484:0:3680:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1777051125.528495:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d950267480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3680:1863365452418688:0@lo:400:kworker.0 00000100:00100000:3.0:1777051125.528545:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051125.528915:0:8628:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452418688 00000100:00100000:3.0:1777051125.528924:0:8628:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452418688 00000100:00100000:3.0:1777051125.529012:0:8628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10000 00000100:00100000:3.0:1777051125.529032:0:8628:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da45f75c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3680:x1863365452418688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051125.529119:0:8628:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da45f75c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3680:x1863365452418688:12345-0@lo:400:kworker.0 Request processed in 95us (577us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051125.529133:0:8628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10000 00000100:00100000:3.0:1777051125.529230:0:3676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051125.529280:0:3676:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d950267800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3676:1863365452418816:0@lo:38:kworker.0 00000100:00100000:3.0:1777051125.529331:0:3676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1777051125.529380:0:3676:0:(import.c:65:import_set_state_nolock()) ffff99da7dbeb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1777051125.529391:0:3676:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1777051125.529398:0:3676:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d9600bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3676:1863365452418176:0@lo:38:kworker.0 00000100:00080000:3.0:1777051125.529420:0:3676:0:(import.c:65:import_set_state_nolock()) ffff99da7fa93000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1777051125.529429:0:3676:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1777051125.529437:0:3676:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d9600ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3676:1863365452418304:0@lo:38:kworker.0 00000100:00080000:3.0:1777051125.529488:0:3676:0:(import.c:65:import_set_state_nolock()) ffff99d94183b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1777051125.529495:0:3676:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1777051125.529501:0:3676:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95fbafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3676:1863365452418432:0@lo:38:kworker.0 00000100:00080000:3.0:1777051125.529573:0:3676:0:(import.c:65:import_set_state_nolock()) ffff99da5f282000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1777051125.529581:0:3676:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1777051125.529588:0:3676:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d950267800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3676:1863365452418816:0@lo:38:kworker.0 00000100:00100000:3.0:1777051127.063922:0:8472:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452419328 00000100:00100000:3.0:1777051127.063936:0:8472:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452419328 00000100:00100000:3.0:1777051127.064069:0:8472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5435 00000100:00100000:3.0:1777051127.064087:0:8472:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d956128000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3679:x1863365452419328:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1777051127.064136:0:8472:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 440356800 pending 0 free 3862671360 avail 3631149056 00000100:00100000:3.0:1777051127.064234:0:8472:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d956128000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3679:x1863365452419328:12345-0@lo:13:osp-pre-0-1.0 Request processed in 152us (519us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051127.064245:0:8472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5435 00000100:00100000:3.0:1777051127.715959:0:6579:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425805696 00000100:00100000:3.0:1777051127.715968:0:6579:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425805696 00000100:00100000:3.0:1777051127.716017:0:6579:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425806208 00000100:00100000:3.0:1777051127.716023:0:6579:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425806208 00000100:00100000:3.0:1777051127.716058:0:6579:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425805824 00000100:00100000:3.0:1777051127.716063:0:6579:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425805824 00000100:00100000:3.0:1777051127.716117:0:6579:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425806336 00000100:00100000:3.0:1777051127.716125:0:6579:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425806336 00000100:00100000:3.0:1777051127.716266:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 12934 00000100:00100000:3.0:1777051127.716281:0:6579:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d956129500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+6:2437:x1863365425805824:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:3.0:1777051127.716341:0:6579:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d956129500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+6:2437:x1863365425805824:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 62us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051127.716359:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 12934 00000100:00100000:3.0:1777051127.716393:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 12935 00000100:00100000:3.0:1777051127.716412:0:6579:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d956129180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+48:2437:x1863365425806336:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:3.0:1777051127.716589:0:6579:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d956129180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+48:2437:x1863365425806336:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 175us (490us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051127.716615:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 12935 00000100:00100000:3.0:1777051130.646637:0:3676:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1777051120/real 1777051120] req@ffff99d9418f4000 x1863365452416768/t0(0) o250->MGC192.168.201.146@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1777051130 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777051130.646706:0:3676:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff99d9418f4000 x1863365452416768/t0(0) o250->MGC192.168.201.146@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1777051130 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1777051130.646781:0:3676:0:(import.c:65:import_set_state_nolock()) ffff99da48759800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1777051130.646823:0:3676:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:3.0:1777051130.646850:0:3676:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d9418f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3676:1863365452416768:0@lo:250:kworker.0 00000100:00100000:3.0:1777051130.647191:0:3676:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d956129c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3676:1863365452419456:0@lo:38:kworker.0 00000100:00100000:3.0:1777051130.647380:0:3676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051130.647508:0:3676:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95612b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3676:1863365452419584:0@lo:38:kworker.0 00000100:00100000:3.0:1777051130.647586:0:3676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051130.647662:0:3676:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d956128700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3676:1863365452419712:0@lo:38:kworker.0 00000100:00100000:3.0:1777051130.647792:0:3676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051130.647874:0:3676:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f9b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3676:1863365452420096:0@lo:38:kworker.0 00000100:00100000:3.0:1777051130.647970:0:3676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00020000:3.0:1777051130.648352:0:3676:0:(client.c:1390:ptlrpc_import_delay_req()) @@@ invalidate in flight req@ffff99da5f9b8380 x1863365452420480/t0(0) o250->MGC192.168.201.146@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl Rpc:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1777051130.691405:0:3676:0:(import.c:65:import_set_state_nolock()) ffff99da48759800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1777051130.691447:0:3676:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-5) 00000100:00100000:3.0:1777051130.691459:0:3676:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f9b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f9351a01-5b0e-4470-97fd-58b9b4b312a2:0:1863365452420480:0@lo:250:kworker.0 00000100:00080000:3.0:1777051130.691597:0:3676:0:(import.c:65:import_set_state_nolock()) ffff99da7dbeb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1777051130.691608:0:3676:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1777051130.691614:0:3676:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d956129c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3676:1863365452419456:0@lo:38:kworker.0 00000100:00080000:3.0:1777051130.691637:0:3676:0:(import.c:65:import_set_state_nolock()) ffff99da7fa93000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1777051130.691649:0:3676:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1777051130.692103:0:3676:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95612b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3676:1863365452419584:0@lo:38:kworker.0 00000100:00080000:3.0:1777051130.692466:0:3676:0:(import.c:65:import_set_state_nolock()) ffff99d94183b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1777051130.692474:0:3676:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1777051130.692480:0:3676:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d956128700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3676:1863365452419712:0@lo:38:kworker.0 00000100:00100000:3.0:1777051130.692549:0:3676:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f9bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3676:1863365452420608:0@lo:250:kworker.0 00000100:00100000:3.0:1777051130.692648:0:3676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1777051130.692775:0:3676:0:(import.c:65:import_set_state_nolock()) ffff99da5f282000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1777051130.692791:0:3676:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1777051130.692802:0:3676:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f9b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3676:1863365452420096:0@lo:38:kworker.0 00000100:00100000:3.0:1777051130.694058:0:3676:0:(client.c:3101:ptlrpc_free_committed()) MGC192.168.201.146@tcp: committing for last_committed 0 gen 4 00000100:00080000:3.0:1777051130.694072:0:3676:0:(import.c:1130:ptlrpc_connect_interpret()) MGC192.168.201.146@tcp: connect to target with instance 0 00000100:00080000:3.0:1777051130.694084:0:3676:0:(import.c:958:ptlrpc_connect_set_flags()) MGC192.168.201.146@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1777051130.694091:0:3676:0:(mgc_request.c:1166:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1777051130.694097:0:3676:0:(import.c:65:import_set_state_nolock()) ffff99da48759800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1777051130.694101:0:3676:0:(mgc_request.c:1166:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1777051130.694156:0:3676:0:(pinger.c:185:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1777051130.694186:0:3676:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f9bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3676:1863365452420608:0@lo:250:kworker.0 00000100:00100000:3.0:1777051130.694991:0:3679:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1777051130.695018:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d950266680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3679:1863365452420736:0@lo:253:kworker.0 00000100:00100000:3.0:1777051130.695109:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051130.695339:0:98559:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452420736 00000100:00100000:3.0:1777051130.695349:0:98559:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452420736 00000100:00100000:3.0:1777051130.695422:0:98559:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452421120 00000100:00100000:3.0:1777051130.695431:0:98559:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452421120 00000100:00100000:3.0:1777051130.695499:0:98559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1777051130.695514:0:98559:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d9434ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9351a01-5b0e-4470-97fd-58b9b4b312a2+7:3679:x1863365452420736:12345-0@lo:253:kworker.0 20000000:01000000:3.0:1777051130.695546:0:98559:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1777051130.695580:0:98559:0:(mgs_nids.c:461:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1777051130.698983:0:98567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1777051130.699008:0:98567:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d9434c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f9351a01-5b0e-4470-97fd-58b9b4b312a2+7:3677:x1863365452420992:12345-0@lo:253:kworker.0 20000000:01000000:3.0:1777051130.699309:0:98567:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1777051130.704445:0:98559:0:(mgs_nids.c:813:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1777051130.704483:0:98559:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:3.0:1777051130.705475:0:98559:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d9434ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9351a01-5b0e-4470-97fd-58b9b4b312a2+7:3679:x1863365452420736:12345-0@lo:253:kworker.0 Request processed in 9959us (10370us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051130.705500:0:98559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1777051130.705566:0:98559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1777051130.705584:0:98559:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d9434cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9351a01-5b0e-4470-97fd-58b9b4b312a2+6:98554:x1863365452421248:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1777051130.705600:0:98559:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777051130.705625:0:98559:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d94e48b400/0x85f51a6b96713bb1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x85f51a6b96713ba3 expref: -99 pid: 98559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051130.705659:0:98559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d94e48b400/0x85f51a6b96713bb1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x85f51a6b96713ba3 expref: 7 pid: 98559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051130.705679:0:98559:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d94e48b400/0x85f51a6b96713bb1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b96713ba3 expref: 7 pid: 98559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051130.705696:0:98559:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d94e48b400, rc 0) 00000100:00100000:3.0:1777051130.705786:0:98559:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d9434cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9351a01-5b0e-4470-97fd-58b9b4b312a2+7:98554:x1863365452421248:12345-0@lo:101:mount.lustre.0 Request processed in 204us (8299us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051130.705799:0:98559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1777051130.713313:0:98554:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f9bb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9351a01-5b0e-4470-97fd-58b9b4b312a2:98554:1863365452421888:0@lo:503:mount.lustre.0 20000000:01000000:3.0:1777051130.715666:0:98567:0:(mgs_nids.c:461:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1777051130.722738:0:98567:0:(mgs_nids.c:813:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1777051130.722793:0:98567:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1777051130.723664:0:98567:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d9434c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f9351a01-5b0e-4470-97fd-58b9b4b312a2+7:3677:x1863365452420992:12345-0@lo:253:kworker.0 Request processed in 24656us (28489us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051130.723681:0:98567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000020:00000080:3.0:1777051130.824439:0:98568:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1777051130.832553:0:98568:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1777051130.832583:0:98568:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1777051130.832595:0:98568:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1777051130.832599:0:98568:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1777051130.832607:0:98568:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1777051130.832611:0:98568:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #9 00000020:01000000:3.0:1777051130.832614:0:98568:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1777051130.832617:0:98568:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1777051130.832620:0:98568:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1777051130.832627:0:98568:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1777051130.832630:0:98568:0:(obd_config.c:1561:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:3.0:1777051130.832635:0:98568:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1777051130.832645:0:98568:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1777051130.832957:0:98568:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1777051130.832972:0:98568:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1777051130.833482:0:98568:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1777051130.833524:0:98568:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1777051130.833532:0:98568:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1777051130.833535:0:98568:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1777051130.833540:0:98568:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1777051130.833546:0:98568:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1777051130.833549:0:98568:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:3.0:1777051130.833555:0:98568:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1777051130.833565:0:98568:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.201.146@tcp to nid 0x20000c0a8c992 (192.168.201.146@tcp) 00000020:00000080:3.0:1777051130.833608:0:98568:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1777051130.833632:0:98568:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff99d941e699c0) 00000020:00000080:3.0:1777051130.833662:0:98568:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:3.0:1777051130.833673:0:98568:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1777051130.834132:0:98568:0:(osp_dev.c:1199:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:3.0:1777051130.834140:0:98568:0:(osd_handler.c:8912:osd_obd_connect()) connect #5 00000020:00000080:3.0:1777051130.834150:0:98568:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x85f51a6b96713c36 00010000:00080000:3.0:1777051130.834322:0:98568:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99da44f8c800@lustre-MDT0001-osp-MDT0000: add connection 192.168.201.146@tcp at head 00010000:00010000:3.0:1777051130.838091:0:98568:0:(ldlm_pool.c:924:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-9 is initialized 00000020:00000080:3.0:1777051130.840046:0:98568:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1777051130.840064:0:98568:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1777051130.840119:0:98568:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:3.0:1777051130.840165:0:98568:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x85f51a6b96713c3d 00000100:00080000:3.0:1777051130.840180:0:98568:0:(import.c:509:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1777051130.840189:0:98568:0:(import.c:623:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff99da44f8c800 using connection 192.168.201.146@tcp/0@lo 00000100:00100000:3.0:1777051130.840273:0:98568:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d9418f4000 x1863365452422144/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1777051130.840325:0:98568:0:(pinger.c:371:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:3.0:1777051130.840424:0:98568:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1777051130.840430:0:98568:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1777051130.840433:0:98568:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:3.0:1777051130.840440:0:98568:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1777051130.840448:0:98568:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #20 00000020:01000000:3.0:1777051130.840454:0:98568:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1777051130.840456:0:98568:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1777051130.840458:0:98568:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1777051130.840464:0:98568:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1777051130.840466:0:98568:0:(obd_config.c:1561:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:3.0:1777051130.840471:0:98568:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1777051130.840477:0:98568:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1777051130.840486:0:98568:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1777051130.840490:0:98568:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1777051130.840520:0:98568:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1777051130.840548:0:98568:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.201.146@tcp to nid 0x20000c0a8c992 (192.168.201.146@tcp) 00000020:01000000:3.0:1777051130.840593:0:98568:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1777051130.840605:0:98568:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1777051130.840631:0:98568:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff99d941e6b380) 00000020:00000080:3.0:1777051130.840666:0:98568:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osp with refcount 2 00000020:00000080:3.0:1777051130.840687:0:98568:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1777051130.840855:0:98568:0:(osp_dev.c:1199:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1777051130.840869:0:98568:0:(osd_handler.c:8912:osd_obd_connect()) connect #6 00000020:00000080:3.0:1777051130.840888:0:98568:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x85f51a6b96713c4b 00010000:00080000:3.0:1777051130.840964:0:98568:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99da44f18800@lustre-OST0000-osc-MDT0000: add connection 192.168.201.146@tcp at head 00010000:00010000:3.0:1777051130.841499:0:98568:0:(ldlm_pool.c:924:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-10 is initialized 00000100:00100000:3.0:1777051130.842031:0:8628:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452423296 00000100:00100000:3.0:1777051130.842044:0:8628:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452423296 00000100:00100000:3.0:1777051130.842110:0:8628:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452422912 00000100:00100000:3.0:1777051130.842121:0:8628:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452422912 00000100:00100000:3.0:1777051130.842235:0:8628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10007 00000100:00100000:3.0:1777051130.842257:0:8628:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d950267480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3680:x1863365452423296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051130.842351:0:8628:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d950267480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3680:x1863365452423296:12345-0@lo:400:kworker.0 Request processed in 99us (1108us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051130.842385:0:8628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10007 00000100:00100000:3.0:1777051130.851534:0:3678:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1777051130.851566:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d9418f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3678:1863365452423680:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1777051130.851658:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1777051130.851980:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1777051130.852276:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d9418f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3678:1863365452423680:0@lo:13:osp-pre-0-0.0 00000020:00000080:3.0:1777051130.858689:0:98568:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1777051130.858706:0:98568:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1777051130.858798:0:98568:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1777051130.858834:0:98568:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x85f51a6b96713c75 00000100:00080000:3.0:1777051130.858848:0:98568:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1777051130.858856:0:98568:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff99da5f27f000 using connection 192.168.201.146@tcp/0@lo 00000100:00100000:3.0:1777051130.858895:0:98568:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d9418f5880 x1863365452423808/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1777051130.858929:0:98568:0:(pinger.c:371:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1777051130.859022:0:98568:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1777051130.859031:0:98568:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1777051130.859034:0:98568:0:(obd_config.c:1561:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1777051130.859040:0:98568:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1777051130.859049:0:98568:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1777051130.859051:0:98568:0:(obd_config.c:1561:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:3.0:1777051130.859059:0:98568:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1777051130.859063:0:98568:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1777051130.859068:0:98568:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1777051130.859073:0:98568:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1777051130.859075:0:98568:0:(obd_config.c:1561:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:3.0:1777051130.859078:0:98568:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1777051130.859082:0:98568:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1777051130.859084:0:98568:0:(obd_config.c:1561:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1777051130.859089:0:98568:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1777051130.859096:0:98568:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1777051130.859100:0:98568:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1777051130.859101:0:98568:0:(obd_config.c:1561:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000020:01000000:3.0:1777051130.859105:0:98568:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1777051130.859110:0:98568:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #44 00000020:01000000:3.0:1777051130.859112:0:98568:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1777051130.859117:0:98568:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000100:00100000:3.0:1777051130.859162:0:98568:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94e627480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f9351a01-5b0e-4470-97fd-58b9b4b312a2:98568:1863365452423936:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1777051130.859303:0:98568:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051130.859344:0:98568:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d95a09a480 going to sleep for 11 seconds 00000100:00100000:3.0:1777051130.860098:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95f864000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3678:1863365452424064:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1777051130.860150:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1777051130.860306:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1777051130.860517:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95f864000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3678:1863365452424064:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1777051130.861274:0:98559:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452424192 00000100:00100000:3.0:1777051130.861281:0:98559:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452424192 00000100:00100000:3.0:1777051130.861337:0:98559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1777051130.861350:0:98559:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f3ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9351a01-5b0e-4470-97fd-58b9b4b312a2+7:98568:x1863365452424192:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1777051130.861532:0:98559:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f3ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9351a01-5b0e-4470-97fd-58b9b4b312a2+7:98568:x1863365452424192:12345-0@lo:502:llog_process_th.0 Request processed in 182us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051130.861557:0:98559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000020:01000000:3.0:1777051130.861896:0:98554:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-58 (rc=0) 10000000:01000000:3.0:1777051130.861949:0:98554:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.201.146@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1777051130.861983:0:98554:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff99d955a99400/0x85f51a6b96713bb8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b96713bbf expref: -99 pid: 98554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051130.862004:0:98554:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.146@tcp lock: ffff99d955a99400/0x85f51a6b96713bb8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b96713bbf expref: -99 pid: 98554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1777051130.862020:0:98554:0:(mgc_request.c:1799:mgc_process_log()) Process log lustre-mdtir-ffff99da48b2a000 from 1 10000000:01000000:3.0:1777051130.862026:0:98554:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1777051130.862101:0:98554:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.146@tcp lock: ffff99d94e48ba00/0x85f51a6b96713c83 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 98554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051130.862115:0:98554:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.146@tcp lock: ffff99d94e48ba00/0x85f51a6b96713c83 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 98554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051130.862131:0:98554:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.146@tcp lock: ffff99d94e48ba00/0x85f51a6b96713c83 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 98554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051130.862162:0:98554:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94e624700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9351a01-5b0e-4470-97fd-58b9b4b312a2:98554:1863365452424320:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1777051130.862283:0:98554:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051130.862367:0:98554:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d95a09acc0 going to sleep for 11 seconds 00000100:00100000:3.0:1777051130.862760:0:98554:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94e624700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9351a01-5b0e-4470-97fd-58b9b4b312a2:98554:1863365452424320:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1777051130.862783:0:98554:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.146@tcp lock: ffff99d94e48ba00/0x85f51a6b96713c83 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b96713c8a expref: -99 pid: 98554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051130.862800:0:98554:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.146@tcp lock: ffff99d94e48ba00/0x85f51a6b96713c83 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x85f51a6b96713c8a expref: -99 pid: 98554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051130.863796:0:98554:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94e624700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9351a01-5b0e-4470-97fd-58b9b4b312a2:98554:1863365452424448:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1777051130.863849:0:98554:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051130.863898:0:98554:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d95a09acc0 going to sleep for 11 seconds 00000100:00100000:3.0:1777051130.864270:0:98554:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94e624700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9351a01-5b0e-4470-97fd-58b9b4b312a2:98554:1863365452424448:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1777051130.865149:0:98554:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.201.146@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1777051130.865177:0:98554:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff99d94e48ba00/0x85f51a6b96713c83 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b96713c8a expref: -99 pid: 98554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051130.865193:0:98554:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.146@tcp lock: ffff99d94e48ba00/0x85f51a6b96713c83 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b96713c8a expref: -99 pid: 98554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1777051130.865245:0:98554:0:(mgc_request.c:1799:mgc_process_log()) Process log params-ffff99da48b2a000 from 1 10000000:01000000:3.0:1777051130.865251:0:98554:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1777051130.865285:0:98554:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.146@tcp lock: ffff99d94e48b600/0x85f51a6b96713c91 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 98554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051130.865307:0:98554:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.146@tcp lock: ffff99d94e48b600/0x85f51a6b96713c91 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 98554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051130.865322:0:98554:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.146@tcp lock: ffff99d94e48b600/0x85f51a6b96713c91 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 98554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051130.865343:0:98554:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94e624700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9351a01-5b0e-4470-97fd-58b9b4b312a2:98554:1863365452424576:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1777051130.865385:0:98554:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051130.865426:0:98554:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d95a09acc0 going to sleep for 11 seconds 00000100:00100000:3.0:1777051130.866064:0:98554:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94e624700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9351a01-5b0e-4470-97fd-58b9b4b312a2:98554:1863365452424576:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1777051130.866451:0:98554:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.146@tcp lock: ffff99d94e48b600/0x85f51a6b96713c91 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b96713c98 expref: -99 pid: 98554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051130.866469:0:98554:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.146@tcp lock: ffff99d94e48b600/0x85f51a6b96713c91 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x85f51a6b96713c98 expref: -99 pid: 98554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051130.866546:0:98554:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94e624700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9351a01-5b0e-4470-97fd-58b9b4b312a2:98554:1863365452424704:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1777051130.866584:0:98554:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051130.866631:0:98554:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d95a09acc0 going to sleep for 11 seconds 00000100:00100000:3.0:1777051130.867507:0:98554:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94e624700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9351a01-5b0e-4470-97fd-58b9b4b312a2:98554:1863365452424704:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1777051130.867549:0:98554:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94e624700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9351a01-5b0e-4470-97fd-58b9b4b312a2:98554:1863365452424832:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1777051130.867614:0:98554:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051130.867652:0:98554:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d95a09acc0 going to sleep for 11 seconds 00000100:00100000:3.0:1777051130.868267:0:98554:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94e624700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9351a01-5b0e-4470-97fd-58b9b4b312a2:98554:1863365452424832:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1777051130.869001:0:98578:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94e624700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f9351a01-5b0e-4470-97fd-58b9b4b312a2:98578:1863365452424960:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1777051130.869060:0:98578:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051130.869101:0:98578:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d95a09a600 going to sleep for 11 seconds 00000100:00100000:3.0:1777051130.871469:0:98578:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94e624700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f9351a01-5b0e-4470-97fd-58b9b4b312a2:98578:1863365452424960:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1777051130.871513:0:98578:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1777051130.871527:0:98578:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1777051130.871531:0:98578:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1777051130.871543:0:98578:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff99da48b2a000 00000020:00000080:3.0:1777051130.871547:0:98578:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1777051130.871576:0:98578:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1777051130.871586:0:98578:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1777051130.871588:0:98578:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1777051130.871593:0:98578:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1777051130.871597:0:98578:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1777051130.871600:0:98578:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1777051130.871605:0:98578:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff99da48b2a000 00000020:00000080:3.0:1777051130.871609:0:98578:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1777051130.872028:0:98578:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1777051130.872035:0:98578:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1777051130.872037:0:98578:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1777051130.872041:0:98578:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1777051130.872045:0:98578:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #4 00000020:01000000:3.0:1777051130.872047:0:98578:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1777051130.872050:0:98578:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1777051130.872052:0:98578:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1777051130.872055:0:98578:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1777051130.872057:0:98578:0:(obd_config.c:1561:class_process_config()) marker 4 (0x6) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1777051130.872060:0:98578:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1777051130.872062:0:98578:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #5 00000020:01000000:3.0:1777051130.872065:0:98578:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1777051130.872067:0:98578:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1777051130.872069:0:98578:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1777051130.872072:0:98578:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1777051130.872074:0:98578:0:(obd_config.c:1561:class_process_config()) marker 5 (0x6) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1777051130.872079:0:98578:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1777051130.872082:0:98578:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #6 00000020:01000000:3.0:1777051130.872084:0:98578:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1777051130.872086:0:98578:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1777051130.872088:0:98578:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1777051130.872092:0:98578:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1777051130.872094:0:98578:0:(obd_config.c:1561:class_process_config()) marker 6 (0x6) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1777051130.872097:0:98578:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1777051130.872100:0:98578:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #7 00000020:01000000:3.0:1777051130.872102:0:98578:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1777051130.872104:0:98578:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1777051130.872106:0:98578:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1777051130.872110:0:98578:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1777051130.872112:0:98578:0:(obd_config.c:1561:class_process_config()) marker 7 (0x6) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1777051130.872115:0:98578:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1777051130.872117:0:98578:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #2 00000020:01000000:3.0:1777051130.872118:0:98578:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1777051130.872120:0:98578:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1777051130.872122:0:98578:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1777051130.872123:0:98578:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1777051130.872125:0:98578:0:(obd_config.c:1561:class_process_config()) marker 2 (0x6) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1777051130.872127:0:98578:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1777051130.872128:0:98578:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #3 00000020:01000000:3.0:1777051130.872129:0:98578:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1777051130.872130:0:98578:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000100:00100000:3.0:1777051130.872157:0:98578:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94e624700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f9351a01-5b0e-4470-97fd-58b9b4b312a2:98578:1863365452425088:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1777051130.872264:0:98578:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051130.872305:0:98578:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d95a09a600 going to sleep for 11 seconds 00000100:00100000:3.0:1777051130.873962:0:98578:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94e624700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f9351a01-5b0e-4470-97fd-58b9b4b312a2:98578:1863365452425088:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1777051130.874029:0:98578:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1777051130.874046:0:98578:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1777051130.874050:0:98578:0:(obd_config.c:1561:class_process_config()) marker 3 (0x6) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1777051130.874060:0:98578:0:(llog.c:858:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000100:00100000:3.0:1777051130.874846:0:98559:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452425216 00000100:00100000:3.0:1777051130.874857:0:98559:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452425216 00000100:00100000:3.0:1777051130.874942:0:98559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1777051130.874994:0:98559:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f3dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9351a01-5b0e-4470-97fd-58b9b4b312a2+9:98554:x1863365452425216:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1777051130.875014:0:98559:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777051130.875036:0:98559:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d94e48b800/0x85f51a6b96713ca6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x85f51a6b96713c9f expref: -99 pid: 98559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051130.875073:0:98559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d94e48b800/0x85f51a6b96713ca6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x85f51a6b96713c9f expref: 10 pid: 98559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051130.875090:0:98559:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d94e48b800/0x85f51a6b96713ca6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b96713c9f expref: 10 pid: 98559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051130.875103:0:98559:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d94e48b800, rc 0) 00000100:00100000:3.0:1777051130.875211:0:98559:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f3dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9351a01-5b0e-4470-97fd-58b9b4b312a2+10:98554:x1863365452425216:12345-0@lo:101:mount.lustre.0 Request processed in 242us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051130.875226:0:98559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1777051130.875793:0:98567:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452425344 00000100:00100000:3.0:1777051130.875803:0:98567:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452425344 00000100:00100000:3.0:1777051130.875863:0:98567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1777051130.875878:0:98567:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94b76c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f9351a01-5b0e-4470-97fd-58b9b4b312a2+10:98554:x1863365452425344:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1777051130.876072:0:98567:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94b76c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f9351a01-5b0e-4470-97fd-58b9b4b312a2+10:98554:x1863365452425344:12345-0@lo:501:mount.lustre.0 Request processed in 196us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051130.876087:0:98567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1777051130.878339:0:98561:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452425600 00000100:00100000:3.0:1777051130.878350:0:98561:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452425600 00000100:00100000:3.0:1777051130.878426:0:98561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1777051130.878441:0:98561:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94b76f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9351a01-5b0e-4470-97fd-58b9b4b312a2+10:98580:x1863365452425600:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1777051130.878633:0:98561:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94b76f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9351a01-5b0e-4470-97fd-58b9b4b312a2+10:98580:x1863365452425600:12345-0@lo:502:llog_process_th.0 Request processed in 192us (664us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051130.878650:0:98561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1777051130.886437:0:98559:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452425856 00000100:00100000:3.0:1777051130.886449:0:98559:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452425856 00000100:00100000:3.0:1777051130.886528:0:98559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1777051130.886545:0:98559:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94b76fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9351a01-5b0e-4470-97fd-58b9b4b312a2+10:98580:x1863365452425856:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1777051130.886725:0:98559:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94b76fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9351a01-5b0e-4470-97fd-58b9b4b312a2+10:98580:x1863365452425856:12345-0@lo:502:llog_process_th.0 Request processed in 183us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051130.887009:0:98559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000020:01000000:3.0:1777051130.887810:0:98554:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-63 (rc=0) 10000000:01000000:3.0:1777051130.887859:0:98554:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.201.146@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1777051130.887885:0:98554:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff99d955a99600/0x85f51a6b96713c9f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b96713ca6 expref: -99 pid: 98554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051130.887904:0:98554:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.146@tcp lock: ffff99d955a99600/0x85f51a6b96713c9f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b96713ca6 expref: -99 pid: 98554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1777051130.887978:0:98554:0:(tgt_mount.c:1144:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1777051130.887982:0:98554:0:(tgt_mount.c:1145:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1777051130.887984:0:98554:0:(tgt_mount.c:1146:server_mti_print()) fs: lustre 00000020:01000004:3.0:1777051130.887986:0:98554:0:(tgt_mount.c:1147:server_mti_print()) uuid: 00000020:01000004:3.0:1777051130.887990:0:98554:0:(tgt_mount.c:1148:server_mti_print()) ver: 0 00000020:01000004:3.0:1777051130.887992:0:98554:0:(tgt_mount.c:1149:server_mti_print()) flags: 00000020:01000004:3.0:1777051130.887994:0:98554:0:(tgt_mount.c:1151:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1777051130.887996:0:98554:0:(tgt_mount.c:1155:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1777051130.887999:0:98554:0:(tgt_mount.c:1183:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1777051130.888001:0:98554:0:(tgt_mount.c:1189:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1777051130.888006:0:98554:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:3.0:1777051130.888009:0:98554:0:(tgt_mount.c:1144:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1777051130.888011:0:98554:0:(tgt_mount.c:1145:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1777051130.888014:0:98554:0:(tgt_mount.c:1146:server_mti_print()) fs: lustre 00000020:01000004:3.0:1777051130.888016:0:98554:0:(tgt_mount.c:1147:server_mti_print()) uuid: 00000020:01000004:3.0:1777051130.888018:0:98554:0:(tgt_mount.c:1148:server_mti_print()) ver: 0 00000020:01000004:3.0:1777051130.888020:0:98554:0:(tgt_mount.c:1149:server_mti_print()) flags: 00000020:01000004:3.0:1777051130.888021:0:98554:0:(tgt_mount.c:1151:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1777051130.888023:0:98554:0:(tgt_mount.c:1155:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1777051130.888024:0:98554:0:(tgt_mount.c:1183:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1777051130.888026:0:98554:0:(tgt_mount.c:1189:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1777051130.888047:0:98554:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1777051130.888064:0:98554:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94e624700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9351a01-5b0e-4470-97fd-58b9b4b312a2:98554:1863365452426112:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1777051130.888114:0:98554:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051130.888161:0:98554:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d95a09a240 going to sleep for 11 seconds 00000100:00100000:3.0:1777051130.924357:0:98588:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95f864a80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:98588:1863365452426880:0@lo:1000:lod0000_rec0001.0 00000040:00080000:3.0:1777051130.927530:0:98588:0:(llog.c:858:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1777051130.927652:0:98588:0:(lod_dev.c:520:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000100:00100000:3.0:1777051131.942668:0:98562:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425807104 00000100:00100000:3.0:1777051131.942682:0:98562:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425807104 00000100:00100000:3.0:1777051131.942783:0:98562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 49 00000100:00100000:3.0:1777051131.942799:0:98562:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94b76d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29c4352d-3260-4734-909d-9ea5de9e7fa4+11:6255:x1863365425807104:12345-192.168.201.46@tcp:256:ll_cfg_requeue.0 20000000:01000000:3.0:1777051131.942833:0:98562:0:(mgs_nids.c:912:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 16384. 20000000:01000000:3.0:1777051131.942857:0:98562:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1777051131.942863:0:98562:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:3.0:1777051131.942867:0:98562:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:3.0:1777051131.942871:0:98562:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:3.0:1777051131.942874:0:98562:0:(mgs_nids.c:316:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 18 00000100:00100000:3.0:1777051131.948714:0:98567:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425807360 00000100:00100000:3.0:1777051131.948749:0:98567:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425807360 00000100:00100000:3.0:1777051131.949121:0:98567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 50 00000100:00100000:3.0:1777051131.949134:0:98567:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94b76f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:29c4352d-3260-4734-909d-9ea5de9e7fa4+11:6255:x1863365425807360:12345-192.168.201.46@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1777051131.949150:0:98567:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777051131.949177:0:98567:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d94e48b200/0x85f51a6b96713cc9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b5e1c expref: -99 pid: 98567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051131.949243:0:98567:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d94e48b200/0x85f51a6b96713cc9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5e1c expref: 12 pid: 98567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051131.949263:0:98567:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d94e48b200/0x85f51a6b96713cc9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5e1c expref: 12 pid: 98567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051131.949278:0:98567:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d94e48b200, rc 0) 00000100:00100000:3.0:1777051131.949339:0:98567:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94b76f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:29c4352d-3260-4734-909d-9ea5de9e7fa4+12:6255:x1863365425807360:12345-192.168.201.46@tcp:101:ll_cfg_requeue.0 Request processed in 205us (766us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051131.949351:0:98567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 50 00000100:00100000:3.0:1777051131.956842:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051131.962578:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051132.001000:0:21368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111528 00000100:00100000:3.0:1777051132.001020:0:21368:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94ed2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+6:2435:x1863365425807872:12345-192.168.201.46@tcp:101:ldlm_lock_repla.0 00010000:00080000:3.0:1777051132.001057:0:21368:0:(ldlm_lib.c:3170:target_queue_recovery_request()) @@@ queue lock replay req req@ffff99d94ed2f800 x1863365425807872/t0(0) o101->c11b6966-0775-44d2-bdc6-c74c26eb2226@192.168.201.46@tcp:93/0 lens 328/0 e 0 to 0 dl 1777051143 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777051132.001094:0:21368:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94ed2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+7:2435:x1863365425807872:12345-192.168.201.46@tcp:101:ldlm_lock_repla.0 Request processed in 78us (572us total) trans 0 rc 0/-999 00000100:00100000:3.0:1777051132.001107:0:21368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111528 00000100:00100000:3.0:1777051132.001128:0:21368:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425808256 00000100:00100000:3.0:1777051132.001136:0:21368:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425808256 00000100:00100000:3.0:1777051132.001178:0:21368:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425808512 00000100:00100000:3.0:1777051132.001186:0:21368:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425808512 00000100:00100000:3.0:1777051132.001361:0:21368:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425809024 00000100:00100000:3.0:1777051132.001370:0:21368:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425809024 00000100:00100000:3.0:1777051132.001411:0:21368:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425809152 00000100:00100000:3.0:1777051132.001417:0:21368:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425809152 00000100:00100000:3.0:1777051132.001446:0:21368:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425809536 00000100:00100000:3.0:1777051132.001452:0:21368:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425809536 00000100:00100000:3.0:1777051132.001497:0:21368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111531 00000100:00100000:3.0:1777051132.001514:0:21368:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94ed2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+13:2435:x1863365425808256:12345-192.168.201.46@tcp:101:ldlm_lock_repla.0 00010000:00080000:3.0:1777051132.001535:0:21368:0:(ldlm_lib.c:3170:target_queue_recovery_request()) @@@ queue lock replay req req@ffff99d94ed2df80 x1863365425808256/t0(0) o101->2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp:93/0 lens 328/0 e 0 to 0 dl 1777051143 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777051132.001559:0:21368:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94ed2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+13:2435:x1863365425808256:12345-192.168.201.46@tcp:101:ldlm_lock_repla.0 Request processed in 47us (528us total) trans 0 rc 0/-999 00000100:00100000:3.0:1777051132.001568:0:21368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111531 00000100:00100000:3.0:1777051132.001611:0:21368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111533 00000100:00100000:3.0:1777051132.001642:0:21368:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7c9a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+13:2435:x1863365425808512:12345-192.168.201.46@tcp:101:ldlm_lock_repla.0 00010000:00080000:3.0:1777051132.001676:0:21368:0:(ldlm_lib.c:3170:target_queue_recovery_request()) @@@ queue lock replay req req@ffff99da7c9a2d80 x1863365425808512/t0(0) o101->2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp:93/0 lens 328/0 e 0 to 0 dl 1777051143 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777051132.001747:0:21368:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7c9a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+13:2435:x1863365425808512:12345-192.168.201.46@tcp:101:ldlm_lock_repla.0 Request processed in 96us (585us total) trans 0 rc 0/-999 00000100:00100000:3.0:1777051132.001797:0:21368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111533 00000100:00100000:3.0:1777051132.001825:0:21368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111536 00000100:00100000:3.0:1777051132.001855:0:21368:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7c9a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+12:2435:x1863365425808896:12345-192.168.201.46@tcp:101:ldlm_lock_repla.0 00010000:00080000:3.0:1777051132.001881:0:21368:0:(ldlm_lib.c:3170:target_queue_recovery_request()) @@@ queue lock replay req req@ffff99da7c9a2300 x1863365425808896/t0(0) o101->c11b6966-0775-44d2-bdc6-c74c26eb2226@192.168.201.46@tcp:93/0 lens 328/0 e 0 to 0 dl 1777051143 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777051132.001921:0:21368:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7c9a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+12:2435:x1863365425808896:12345-192.168.201.46@tcp:101:ldlm_lock_repla.0 Request processed in 77us (673us total) trans 0 rc 0/-999 00000100:00100000:3.0:1777051132.001953:0:21368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111536 00000100:00100000:3.0:1777051132.001987:0:21368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111539 00000100:00100000:3.0:1777051132.002005:0:21368:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7c9a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+12:2435:x1863365425809152:12345-192.168.201.46@tcp:101:ldlm_lock_repla.0 00010000:00080000:3.0:1777051132.002026:0:21368:0:(ldlm_lib.c:3170:target_queue_recovery_request()) @@@ queue lock replay req req@ffff99da7c9a3b80 x1863365425809152/t0(0) o101->c11b6966-0775-44d2-bdc6-c74c26eb2226@192.168.201.46@tcp:93/0 lens 328/0 e 0 to 0 dl 1777051143 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777051132.002061:0:21368:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7c9a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+12:2435:x1863365425809152:12345-192.168.201.46@tcp:101:ldlm_lock_repla.0 Request processed in 59us (734us total) trans 0 rc 0/-999 00000100:00100000:3.0:1777051132.002092:0:21368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111539 00000100:00100000:3.0:1777051132.183952:0:47388:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452427136 00000100:00100000:3.0:1777051132.183966:0:47388:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452427136 00000100:00100000:3.0:1777051132.184076:0:47388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5439 00000100:00100000:3.0:1777051132.184097:0:47388:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7c9a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3677:x1863365452427136:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1777051132.184134:0:47388:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 440356800 pending 0 free 3862671360 avail 3631149056 00000100:00100000:3.0:1777051132.184228:0:47388:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7c9a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3677:x1863365452427136:12345-0@lo:13:osp-pre-0-1.0 Request processed in 139us (656us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051132.184238:0:47388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5439 00000100:00100000:3.0:1777051132.566780:0:98561:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452427264 00000100:00100000:3.0:1777051132.566793:0:98561:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452427264 00000100:00100000:3.0:1777051132.567531:0:98562:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452427392 00000100:00100000:3.0:1777051132.567538:0:98562:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452427392 00000100:00100000:3.0:1777051132.567581:0:98562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1777051132.567605:0:98562:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94b76ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9351a01-5b0e-4470-97fd-58b9b4b312a2+10:6577:x1863365452427392:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1777051132.567630:0:98562:0:(mgs_nids.c:912:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1777051132.567659:0:98562:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1777051132.567664:0:98562:0:(mgs_nids.c:316:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 18 00000100:00100000:3.0:1777051132.567860:0:98562:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94b76ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9351a01-5b0e-4470-97fd-58b9b4b312a2+10:6577:x1863365452427392:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 256us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051132.567869:0:98562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1777051132.568228:0:98561:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452427520 00000100:00100000:3.0:1777051132.568237:0:98561:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452427520 00000100:00100000:3.0:1777051132.568281:0:98561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1777051132.568293:0:98561:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94b76d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9351a01-5b0e-4470-97fd-58b9b4b312a2+10:6577:x1863365452427520:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1777051132.568304:0:98561:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777051132.568330:0:98561:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d94e48b000/0x85f51a6b96713ce5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x85f51a6b96713cde expref: -99 pid: 98561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051132.568354:0:98561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d94e48b000/0x85f51a6b96713ce5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x85f51a6b96713cde expref: 11 pid: 98561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051132.568369:0:98561:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d94e48b000/0x85f51a6b96713ce5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b96713cde expref: 11 pid: 98561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051132.568380:0:98561:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d94e48b000, rc 0) 00000100:00100000:3.0:1777051132.568429:0:98561:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94b76d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9351a01-5b0e-4470-97fd-58b9b4b312a2+11:6577:x1863365452427520:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 138us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051132.568436:0:98561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000020:01000000:3.0:1777051132.571905:0:6577:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 64-63 (rc=0) 10000000:01000000:3.0:1777051132.571943:0:6577:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.201.146@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1777051132.571954:0:6577:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff99d955a99000/0x85f51a6b96713cde lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b96713ce5 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051132.571968:0:6577:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.146@tcp lock: ffff99d955a99000/0x85f51a6b96713cde lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b96713ce5 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1777051132.571988:0:6577:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:3.0:1777051132.571992:0:6577:0:(mgc_request.c:1799:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:3.0:1777051132.571996:0:6577:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1777051132.572022:0:6577:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.146@tcp lock: ffff99d94e48a000/0x85f51a6b96713cec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051132.572034:0:6577:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.146@tcp lock: ffff99d94e48a000/0x85f51a6b96713cec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051132.572045:0:6577:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.146@tcp lock: ffff99d94e48a000/0x85f51a6b96713cec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051132.572067:0:6577:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94e624a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452427904:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1777051132.572400:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051132.572453:0:6577:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d955a459c0 going to sleep for 11 seconds 00000100:00100000:3.0:1777051132.572817:0:6577:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94e624a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452427904:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1777051132.572838:0:6577:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.146@tcp lock: ffff99d94e48a000/0x85f51a6b96713cec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b96713cf3 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051132.572853:0:6577:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.146@tcp lock: ffff99d94e48a000/0x85f51a6b96713cec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x85f51a6b96713cf3 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051132.572921:0:6577:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94e624a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452428032:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1777051132.572962:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051132.572997:0:6577:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d955a459c0 going to sleep for 11 seconds 00000100:00100000:3.0:1777051132.573345:0:6577:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94e624a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452428032:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1777051132.573387:0:6577:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94e624a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452428160:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1777051132.573441:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051132.573471:0:6577:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d955a459c0 going to sleep for 11 seconds 00000100:00100000:3.0:1777051132.574663:0:6577:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94e624a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452428160:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1777051132.575970:0:98693:0:(llog.c:858:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 11 00000100:00100000:3.0:1777051132.576334:0:98567:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452428288 00000100:00100000:3.0:1777051132.576341:0:98567:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452428288 00000100:00100000:3.0:1777051132.576382:0:98567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1777051132.576392:0:98567:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95d709450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f9351a01-5b0e-4470-97fd-58b9b4b312a2+12:6577:x1863365452428288:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1777051132.576404:0:98567:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777051132.576421:0:98567:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d94e48ba00/0x85f51a6b96713d01 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x85f51a6b96713cfa expref: -99 pid: 98567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051132.576451:0:98567:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d94e48ba00/0x85f51a6b96713d01 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x85f51a6b96713cfa expref: 13 pid: 98567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051132.576467:0:98567:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d94e48ba00/0x85f51a6b96713d01 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b96713cfa expref: 13 pid: 98567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051132.576479:0:98567:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d94e48ba00, rc 0) 00000100:00100000:3.0:1777051132.576535:0:98567:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95d709450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f9351a01-5b0e-4470-97fd-58b9b4b312a2+13:6577:x1863365452428288:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 143us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051132.576545:0:98567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000020:01000000:3.0:1777051132.579976:0:6577:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 25-24 (rc=0) 10000000:01000000:3.0:1777051132.580003:0:6577:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.201.146@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1777051132.580013:0:6577:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff99d955a99800/0x85f51a6b96713cfa lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b96713d01 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051132.580026:0:6577:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.146@tcp lock: ffff99d955a99800/0x85f51a6b96713cfa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b96713d01 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1777051132.580041:0:6577:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1777051132.580044:0:6577:0:(mgc_request.c:1799:mgc_process_log()) Process log lustre-client-ffff99da44f8d000 from 64 10000000:01000000:3.0:1777051132.580048:0:6577:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1777051132.580077:0:6577:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.146@tcp lock: ffff99d94e48ac00/0x85f51a6b96713d08 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051132.580090:0:6577:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.146@tcp lock: ffff99d94e48ac00/0x85f51a6b96713d08 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051132.580396:0:6577:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.146@tcp lock: ffff99d94e48ac00/0x85f51a6b96713d08 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051132.580424:0:6577:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94e624a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452428672:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1777051132.580470:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051132.580515:0:6577:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d955a459c0 going to sleep for 11 seconds 00000100:00100000:3.0:1777051132.581313:0:6577:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94e624a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452428672:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1777051132.581334:0:6577:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.146@tcp lock: ffff99d94e48ac00/0x85f51a6b96713d08 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b96713d0f expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051132.581348:0:6577:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.146@tcp lock: ffff99d94e48ac00/0x85f51a6b96713d08 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x85f51a6b96713d0f expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051132.581422:0:6577:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94e624a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452428800:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1777051132.581462:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051132.581521:0:6577:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d955a459c0 going to sleep for 11 seconds 00000100:00100000:3.0:1777051132.582153:0:6577:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94e624a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452428800:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1777051132.582201:0:6577:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94e624a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452428928:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1777051132.582268:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051132.582348:0:6577:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d955a459c0 going to sleep for 11 seconds 00000100:00100000:3.0:1777051132.587292:0:98561:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452429056 00000100:00100000:3.0:1777051132.587305:0:98561:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452429056 00000100:00100000:3.0:1777051132.587378:0:98561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1777051132.587397:0:98561:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9351a01-5b0e-4470-97fd-58b9b4b312a2+14:6577:x1863365452429056:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1777051132.587416:0:98561:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777051132.587436:0:98561:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d94e48be00/0x85f51a6b96713d1d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x85f51a6b96713d16 expref: -99 pid: 98561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051132.587482:0:98561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d94e48be00/0x85f51a6b96713d1d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x85f51a6b96713d16 expref: 15 pid: 98561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051132.587500:0:98561:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d94e48be00/0x85f51a6b96713d1d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b96713d16 expref: 15 pid: 98561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051132.587510:0:98561:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d94e48be00, rc 0) 00000100:00100000:3.0:1777051132.587566:0:98561:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9351a01-5b0e-4470-97fd-58b9b4b312a2+15:6577:x1863365452429056:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 177us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051132.587574:0:98561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1777051132.587951:0:98562:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452429184 00000100:00100000:3.0:1777051132.587958:0:98562:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452429184 00000100:00100000:3.0:1777051132.588026:0:98562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1777051132.588039:0:98562:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9351a01-5b0e-4470-97fd-58b9b4b312a2+15:6577:x1863365452429184:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1777051132.588552:0:98562:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9351a01-5b0e-4470-97fd-58b9b4b312a2+15:6577:x1863365452429184:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 514us (675us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051132.588577:0:98562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1777051132.588918:0:98567:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452429312 00000100:00100000:3.0:1777051132.588927:0:98567:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452429312 00000100:00100000:3.0:1777051132.588983:0:98567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1777051132.589010:0:98567:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f9351a01-5b0e-4470-97fd-58b9b4b312a2+15:6577:x1863365452429312:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1777051132.590067:0:98567:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f9351a01-5b0e-4470-97fd-58b9b4b312a2+15:6577:x1863365452429312:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1071us (1387us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051132.590338:0:98567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1777051132.594426:0:98561:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452429568 00000100:00100000:3.0:1777051132.594433:0:98561:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452429568 00000100:00100000:3.0:1777051132.594499:0:98561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1777051132.594524:0:98561:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7d8fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9351a01-5b0e-4470-97fd-58b9b4b312a2+16:6577:x1863365452429568:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1777051132.594623:0:98561:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7d8fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9351a01-5b0e-4470-97fd-58b9b4b312a2+16:6577:x1863365452429568:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 104us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051132.594631:0:98561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1777051132.595537:0:98562:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452429696 00000100:00100000:3.0:1777051132.595545:0:98562:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452429696 00000100:00100000:3.0:1777051132.595584:0:98562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1777051132.595592:0:98562:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7d8fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9351a01-5b0e-4470-97fd-58b9b4b312a2+16:6577:x1863365452429696:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1777051132.595751:0:98562:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7d8fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9351a01-5b0e-4470-97fd-58b9b4b312a2+16:6577:x1863365452429696:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 156us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051132.595764:0:98562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1777051132.597448:0:98561:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452429824 00000100:00100000:3.0:1777051132.597457:0:98561:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452429824 00000100:00100000:3.0:1777051132.597505:0:98561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1777051132.597514:0:98561:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7d8fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9351a01-5b0e-4470-97fd-58b9b4b312a2+16:6577:x1863365452429824:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1777051132.597525:0:98561:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777051132.597537:0:98561:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d94e48a600/0x85f51a6b96713d39 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x85f51a6b96713d32 expref: -99 pid: 98561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051132.597575:0:98561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d94e48a600/0x85f51a6b96713d39 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x85f51a6b96713d32 expref: 17 pid: 98561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051132.597586:0:98561:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d94e48a600/0x85f51a6b96713d39 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b96713d32 expref: 17 pid: 98561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051132.597594:0:98561:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d94e48a600, rc 0) 00000100:00100000:3.0:1777051132.597636:0:98561:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7d8fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9351a01-5b0e-4470-97fd-58b9b4b312a2+17:6577:x1863365452429824:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 123us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051132.597643:0:98561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1777051132.598541:0:98567:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452430080 00000100:00100000:3.0:1777051132.598550:0:98567:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452430080 00000100:00100000:3.0:1777051132.598601:0:98567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1777051132.598614:0:98567:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7d8ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f9351a01-5b0e-4470-97fd-58b9b4b312a2+17:6577:x1863365452430080:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1777051132.598741:0:98567:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7d8ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f9351a01-5b0e-4470-97fd-58b9b4b312a2+17:6577:x1863365452430080:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 128us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051132.598754:0:98567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1777051132.600428:0:98562:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452430208 00000100:00100000:3.0:1777051132.600435:0:98562:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452430208 00000100:00100000:3.0:1777051132.600484:0:98562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1777051132.600494:0:98562:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7d8ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9351a01-5b0e-4470-97fd-58b9b4b312a2+17:6577:x1863365452430208:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1777051132.600506:0:98562:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777051132.600521:0:98562:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d94e48a400/0x85f51a6b96713d47 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x85f51a6b96713d40 expref: -99 pid: 98562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051132.600562:0:98562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d94e48a400/0x85f51a6b96713d47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x85f51a6b96713d40 expref: 18 pid: 98562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051132.600574:0:98562:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d94e48a400/0x85f51a6b96713d47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b96713d40 expref: 18 pid: 98562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051132.600582:0:98562:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d94e48a400, rc 0) 00000100:00100000:3.0:1777051132.600627:0:98562:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7d8ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9351a01-5b0e-4470-97fd-58b9b4b312a2+18:6577:x1863365452430208:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 133us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051132.600638:0:98562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1777051132.600984:0:98561:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452430336 00000100:00100000:3.0:1777051132.600994:0:98561:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452430336 00000100:00100000:3.0:1777051132.601046:0:98561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1777051132.601062:0:98561:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7d8fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9351a01-5b0e-4470-97fd-58b9b4b312a2+18:6577:x1863365452430336:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1777051132.601085:0:98561:0:(mgs_nids.c:912:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1777051132.601136:0:98561:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1777051132.601143:0:98561:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:3.0:1777051132.601148:0:98561:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:3.0:1777051132.601153:0:98561:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:3.0:1777051132.601158:0:98561:0:(mgs_nids.c:316:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 18 00000100:00100000:3.0:1777051132.601308:0:98561:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7d8fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9351a01-5b0e-4470-97fd-58b9b4b312a2+18:6577:x1863365452430336:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 248us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051132.601322:0:98561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1777051132.602201:0:98567:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452430592 00000100:00100000:3.0:1777051132.602210:0:98567:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452430592 00000100:00100000:3.0:1777051132.602265:0:98567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1777051132.602282:0:98567:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7d8ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f9351a01-5b0e-4470-97fd-58b9b4b312a2+19:6577:x1863365452430592:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1777051132.602487:0:98567:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7d8ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f9351a01-5b0e-4470-97fd-58b9b4b312a2+19:6577:x1863365452430592:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 208us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051132.602503:0:98567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1777051132.603046:0:98562:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452430720 00000100:00100000:3.0:1777051132.603053:0:98562:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452430720 00000100:00100000:3.0:1777051132.603106:0:98562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1777051132.603118:0:98562:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d9434cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9351a01-5b0e-4470-97fd-58b9b4b312a2+19:6577:x1863365452430720:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1777051132.603986:0:98562:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d9434cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9351a01-5b0e-4470-97fd-58b9b4b312a2+19:6577:x1863365452430720:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 867us (1034us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051132.603999:0:98562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1777051132.606071:0:98561:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452430848 00000100:00100000:3.0:1777051132.606082:0:98561:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452430848 00000100:00100000:3.0:1777051132.606187:0:98561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1777051132.606203:0:98561:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d9434c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9351a01-5b0e-4470-97fd-58b9b4b312a2+19:6577:x1863365452430848:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1777051132.606220:0:98561:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777051132.606238:0:98561:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d94e48a800/0x85f51a6b96713d63 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x85f51a6b96713d5c expref: -99 pid: 98561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051132.606268:0:98561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d94e48a800/0x85f51a6b96713d63 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x85f51a6b96713d5c expref: 20 pid: 98561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051132.606285:0:98561:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d94e48a800/0x85f51a6b96713d63 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b96713d5c expref: 20 pid: 98561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051132.606298:0:98561:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d94e48a800, rc 0) 00000100:00100000:3.0:1777051132.606362:0:98561:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d9434c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9351a01-5b0e-4470-97fd-58b9b4b312a2+20:6577:x1863365452430848:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 163us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051132.606373:0:98561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1777051132.607474:0:98562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1777051132.607494:0:98562:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d9434cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9351a01-5b0e-4470-97fd-58b9b4b312a2+21:6577:x1863365452431104:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1777051132.607509:0:98562:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777051132.607528:0:98562:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d955a90600/0x85f51a6b96713d7f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x85f51a6b96713d78 expref: -99 pid: 98562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051132.607556:0:98562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d955a90600/0x85f51a6b96713d7f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x85f51a6b96713d78 expref: 22 pid: 98562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051132.607572:0:98562:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d955a90600/0x85f51a6b96713d7f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b96713d78 expref: 22 pid: 98562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051132.607583:0:98562:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d955a90600, rc 0) 00000100:00100000:3.0:1777051132.607973:0:98562:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d9434cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9351a01-5b0e-4470-97fd-58b9b4b312a2+22:6577:x1863365452431104:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 485us (592us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051132.607986:0:98562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1777051132.609341:0:98562:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452431360 00000100:00100000:3.0:1777051132.609349:0:98562:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452431360 00000100:00100000:3.0:1777051132.609418:0:98562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1777051132.609426:0:98562:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d9434cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9351a01-5b0e-4470-97fd-58b9b4b312a2+22:6577:x1863365452431360:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1777051132.609573:0:98562:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d9434cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9351a01-5b0e-4470-97fd-58b9b4b312a2+22:6577:x1863365452431360:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 146us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051132.609582:0:98562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1777051132.835356:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10010 00000100:00100000:3.0:1777051132.835379:0:8468:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7c9a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+48:2437:x1863365425810048:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:3.0:1777051132.835576:0:8468:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7c9a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+48:2437:x1863365425810048:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 203us (571us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051132.835588:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10010 00000100:00100000:3.0:1777051136.278858:0:3676:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95f65b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3676:1863365452431872:0@lo:38:kworker.0 00000100:00100000:3.0:1777051136.278946:0:3676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051136.279011:0:3676:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95f658a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3676:1863365452432000:0@lo:38:kworker.0 00000100:00100000:3.0:1777051136.279379:0:3676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051136.279864:0:3676:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95f65ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3676:1863365452432128:0@lo:38:kworker.0 00000100:00100000:3.0:1777051136.279934:0:3676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051136.280276:0:3676:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95f65bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3676:1863365452432512:0@lo:38:kworker.0 00000100:00100000:3.0:1777051136.280331:0:3676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051136.280384:0:3676:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95f658700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3676:1863365452433408:0@lo:38:kworker.0 00000100:00100000:3.0:1777051136.280473:0:3676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051136.280586:0:98562:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452431744 00000100:00100000:3.0:1777051136.280595:0:98562:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452431744 00000100:00100000:3.0:1777051136.280703:0:98562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1777051136.280722:0:98562:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d9434cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9351a01-5b0e-4470-97fd-58b9b4b312a2+23:3677:x1863365452431744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051136.280816:0:98562:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d9434cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9351a01-5b0e-4470-97fd-58b9b4b312a2+23:3677:x1863365452431744:12345-0@lo:400:kworker.0 Request processed in 93us (1988us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051136.280842:0:98562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00010000:00080000:3.0:1777051136.280947:0:3676:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99d95f658a80 x1863365452432000/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1777051161 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1777051136.280985:0:3676:0:(import.c:1130:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 4 00000100:00080000:3.0:1777051136.282802:0:3676:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-MDT0001: lwp recover req@ffff99d95f658a80 x1863365452432000/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1777051161 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1777051136.282824:0:3676:0:(import.c:65:import_set_state_nolock()) ffff99da7fa93000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:3.0:1777051136.282838:0:3676:0:(import.c:65:import_set_state_nolock()) ffff99da7fa93000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:3.0:1777051136.282849:0:3676:0:(import.c:1737:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:3.0:1777051136.302564:0:3676:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95f658a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3676:1863365452432000:0@lo:38:kworker.0 00010000:00080000:3.0:1777051136.302972:0:3676:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99d95f65ad80 x1863365452432128/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1777051161 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1777051136.303007:0:3676:0:(import.c:1130:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 4 00000100:00080000:3.0:1777051136.305791:0:3676:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0000: lwp recover req@ffff99d95f65ad80 x1863365452432128/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1777051161 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1777051136.305810:0:3676:0:(import.c:65:import_set_state_nolock()) ffff99d94183b000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:3.0:1777051136.305818:0:3676:0:(import.c:65:import_set_state_nolock()) ffff99d94183b000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:3.0:1777051136.305825:0:3676:0:(import.c:1737:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0000: Connection restored to 0@lo (at 0@lo) 00000100:00100000:3.0:1777051136.305835:0:3676:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95f65ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3676:1863365452432128:0@lo:38:kworker.0 00000100:00080000:3.0:1777051136.305878:0:3676:0:(import.c:1130:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 4 00000100:00080000:3.0:1777051136.305891:0:3676:0:(import.c:65:import_set_state_nolock()) ffff99da7dbeb000 lustre-MDT0000_UUID: changing import state from CONNECTING to REPLAY 00000100:00080000:3.0:1777051136.305899:0:3676:0:(import.c:1694:ptlrpc_import_recovery_state_machine()) replay requested by lustre-MDT0000_UUID 00000100:00100000:3.0:1777051136.305904:0:3676:0:(client.c:3101:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 12884902301 gen 2 00000100:00080000:3.0:1777051136.305911:0:3676:0:(recover.c:53:ptlrpc_replay_next()) import ffff99da7dbeb000 from lustre-MDT0000_UUID committed 12884902301 last 0 00000100:00080000:3.0:1777051136.305916:0:3676:0:(import.c:65:import_set_state_nolock()) ffff99da7dbeb000 lustre-MDT0000_UUID: changing import state from REPLAY to REPLAY_LOCKS 00010000:00080000:3.0:1777051136.306851:0:98938:0:(ldlm_request.c:2960:ldlm_lock_replay_thread()) lock replay thread lustre-MDT0000-osp-MDT0001 to lustre-MDT0000_UUID@0@lo 00010000:00010000:3.0:1777051136.306862:0:98938:0:(ldlm_request.c:2876:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-MDT0000-osp-MDT0001 (0) 00010000:00010000:3.0:1777051136.306875:0:98938:0:(ldlm_request.c:2889:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-MDT0000-osp-MDT0001 00010000:00010000:3.0:1777051136.312721:0:98938:0:(ldlm_request.c:2848:replay_one_lock()) ### replaying lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d9418d3400/0x85f51a6b96149c5e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x85f51a6b967054aa expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:3.0:1777051136.312753:0:98938:0:(ldlm_request.c:2898:lock_can_replay()) check lock replay limit, inflights = 1(512) 00010000:00010000:3.0:1777051136.320689:0:3676:0:(ldlm_request.c:2765:replay_lock_interpret()) ### replayed lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d9418d3400/0x85f51a6b96149c5e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x85f51a6b96713e19 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1777051136.320713:0:3676:0:(import.c:65:import_set_state_nolock()) ffff99da7dbeb000 lustre-MDT0000_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000100:00100000:3.0:1777051136.320754:0:3676:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94e624380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3676:1863365452433536:0@lo:101:ldlm_lock_repla.0 00000100:00100000:3.0:1777051136.326243:0:6580:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425810816 00000100:00100000:3.0:1777051136.326254:0:6580:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425810816 00000100:00100000:3.0:1777051136.326488:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 12944 00000100:00100000:3.0:1777051136.326515:0:6580:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+13:2435:x1863365425810944:12345-192.168.201.46@tcp:400:ptlrpcd_rcv.0 00010000:00080000:3.0:1777051136.326559:0:6580:0:(ldlm_lib.c:3120:target_queue_recovery_request()) @@@ queue final req req@ffff99da5f9b9f80 x1863365425810944/t0(0) o400->c11b6966-0775-44d2-bdc6-c74c26eb2226@192.168.201.46@tcp:97/0 lens 224/0 e 0 to 0 dl 1777051147 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777051136.326622:0:6580:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+13:2435:x1863365425810944:12345-192.168.201.46@tcp:400:ptlrpcd_rcv.0 Request processed in 112us (521us total) trans 0 rc 0/-999 00000100:00100000:3.0:1777051136.327045:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 12944 00000100:00100000:3.0:1777051136.339765:0:3680:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1777051136.339787:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94e624380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3680:1863365452433792:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1777051136.340338:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051136.340416:0:6584:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452433792 00000100:00100000:3.0:1777051136.340427:0:6584:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452433792 00000100:00100000:3.0:1777051136.340504:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7910 00000100:00100000:3.0:1777051136.340521:0:6584:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94e627480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:3680:x1863365452433792:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1777051136.340562:0:6584:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4194304 pending 0 free 1441562624 avail 1295323136 00000100:00100000:3.0:1777051136.342495:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94e624380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3680:1863365452433792:0@lo:41:osp-pre-0-1.0 00000004:00080000:3.0:1777051136.395514:0:98575:0:(osp_precreate.c:877:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x15e:0x0] 00000100:00100000:3.0:1777051136.395603:0:98575:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94e624380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:98575:1863365452434048:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1777051136.395759:0:98575:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051136.395841:0:98575:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d95ca1f9c0 going to sleep for 11 seconds 00002000:00010000:3.0:1777051136.415629:0:24468:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x17d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777051136.415647:0:24468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000837b311d/0x85f51a6b96713e51 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x17d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.415761:0:24468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051136.415767:0:24468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051136.415779:0:24468:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000837b311d/0x85f51a6b96713e51 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.415806:0:24468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000837b311d/0x85f51a6b96713e51 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.415823:0:24468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000837b311d/0x85f51a6b96713e51 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.415838:0:24468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000837b311d/0x85f51a6b96713e51 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.415910:0:24468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1777051136.415984:0:24468:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x17c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777051136.415997:0:24468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002dda27db/0x85f51a6b96713e58 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x17c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.416026:0:24468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051136.416032:0:24468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051136.416040:0:24468:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002dda27db/0x85f51a6b96713e58 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.416086:0:24468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002dda27db/0x85f51a6b96713e58 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.416243:0:24468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002dda27db/0x85f51a6b96713e58 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.416259:0:24468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002dda27db/0x85f51a6b96713e58 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.416451:0:24468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1777051136.416533:0:24468:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x17b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777051136.416544:0:24468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000809b39cf/0x85f51a6b96713e5f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x17b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.416561:0:24468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051136.416565:0:24468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051136.416571:0:24468:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000809b39cf/0x85f51a6b96713e5f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.416603:0:24468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000809b39cf/0x85f51a6b96713e5f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.416633:0:24468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000809b39cf/0x85f51a6b96713e5f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.416716:0:24468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000809b39cf/0x85f51a6b96713e5f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.416825:0:24468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00002000:00010000:3.0:1777051136.416909:0:24468:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x17a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777051136.416930:0:24468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cd2a0381/0x85f51a6b96713e66 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x17a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.416973:0:24468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051136.416978:0:24468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051136.416985:0:24468:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cd2a0381/0x85f51a6b96713e66 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.417014:0:24468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cd2a0381/0x85f51a6b96713e66 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.417031:0:24468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cd2a0381/0x85f51a6b96713e66 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.417045:0:24468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cd2a0381/0x85f51a6b96713e66 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.417081:0:24468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1777051136.417158:0:24468:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x179:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777051136.417178:0:24468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000040ab6b91/0x85f51a6b96713e6d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x179:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.417232:0:24468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051136.417237:0:24468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051136.417245:0:24468:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000040ab6b91/0x85f51a6b96713e6d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x179:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.417276:0:24468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000040ab6b91/0x85f51a6b96713e6d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x179:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.417299:0:24468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000040ab6b91/0x85f51a6b96713e6d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x179:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.417332:0:24468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000040ab6b91/0x85f51a6b96713e6d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x179:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.417380:0:24468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00002000:00010000:3.0:1777051136.417459:0:24468:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x178:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777051136.417476:0:24468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ba6c3a04/0x85f51a6b96713e74 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x178:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.417551:0:24468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051136.417557:0:24468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051136.417567:0:24468:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ba6c3a04/0x85f51a6b96713e74 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x178:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.417588:0:24468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ba6c3a04/0x85f51a6b96713e74 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x178:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.417604:0:24468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ba6c3a04/0x85f51a6b96713e74 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x178:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.417615:0:24468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ba6c3a04/0x85f51a6b96713e74 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x178:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.417756:0:24468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1777051136.417830:0:24468:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x177:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777051136.417847:0:24468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c440dff5/0x85f51a6b96713e7b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x177:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.417890:0:24468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051136.417895:0:24468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051136.417901:0:24468:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c440dff5/0x85f51a6b96713e7b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x177:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.417943:0:24468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c440dff5/0x85f51a6b96713e7b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x177:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.417984:0:24468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c440dff5/0x85f51a6b96713e7b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x177:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.418029:0:24468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c440dff5/0x85f51a6b96713e7b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x177:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.418078:0:24468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00002000:00010000:3.0:1777051136.418151:0:24468:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x176:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777051136.418164:0:24468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007e199b5e/0x85f51a6b96713e82 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x176:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.418185:0:24468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051136.418188:0:24468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051136.418195:0:24468:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007e199b5e/0x85f51a6b96713e82 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x176:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.418249:0:24468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007e199b5e/0x85f51a6b96713e82 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x176:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.418270:0:24468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007e199b5e/0x85f51a6b96713e82 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x176:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.418324:0:24468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007e199b5e/0x85f51a6b96713e82 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x176:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.418397:0:24468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1777051136.418461:0:24468:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x175:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777051136.418470:0:24468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000053fabafd/0x85f51a6b96713e89 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x175:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.418485:0:24468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051136.418487:0:24468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051136.418493:0:24468:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000053fabafd/0x85f51a6b96713e89 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x175:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.418510:0:24468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000053fabafd/0x85f51a6b96713e89 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x175:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.418524:0:24468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000053fabafd/0x85f51a6b96713e89 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x175:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.418539:0:24468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000053fabafd/0x85f51a6b96713e89 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x175:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.418592:0:24468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000001:00100000:3.0:1777051136.419981:0:9540:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00002000:00010000:3.0:1777051136.420638:0:24468:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x174:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777051136.420978:0:24468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f65a0ad5/0x85f51a6b96713e90 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x174:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.420997:0:24468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051136.420999:0:24468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051136.421005:0:24468:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f65a0ad5/0x85f51a6b96713e90 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x174:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.421022:0:24468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f65a0ad5/0x85f51a6b96713e90 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x174:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.421037:0:24468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f65a0ad5/0x85f51a6b96713e90 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x174:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.421050:0:24468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f65a0ad5/0x85f51a6b96713e90 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x174:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.421168:0:24468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1777051136.421240:0:24468:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x173:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777051136.421251:0:24468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002d465bdc/0x85f51a6b96713e97 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x173:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.421297:0:24468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051136.421300:0:24468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051136.421306:0:24468:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002d465bdc/0x85f51a6b96713e97 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x173:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.421336:0:24468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002d465bdc/0x85f51a6b96713e97 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x173:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.421350:0:24468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002d465bdc/0x85f51a6b96713e97 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x173:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.421363:0:24468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002d465bdc/0x85f51a6b96713e97 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x173:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.422057:0:24468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1777051136.422067:0:24468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002d465bdc/0x85f51a6b96713e97 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x173:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1777051136.422163:0:24468:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x172:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777051136.422172:0:24468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fffca0fb/0x85f51a6b96713e9e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x172:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.422187:0:24468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051136.422191:0:24468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051136.422211:0:24468:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fffca0fb/0x85f51a6b96713e9e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x172:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.422227:0:24468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fffca0fb/0x85f51a6b96713e9e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x172:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.422242:0:24468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fffca0fb/0x85f51a6b96713e9e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x172:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.422255:0:24468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fffca0fb/0x85f51a6b96713e9e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x172:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.422288:0:24468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1777051136.422357:0:24468:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x171:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777051136.422380:0:24468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000112ac9a6/0x85f51a6b96713ea5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x171:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.422410:0:24468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051136.422417:0:24468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051136.422426:0:24468:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000112ac9a6/0x85f51a6b96713ea5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x171:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.422480:0:24468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000112ac9a6/0x85f51a6b96713ea5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x171:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.422522:0:24468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000112ac9a6/0x85f51a6b96713ea5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x171:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.422572:0:24468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000112ac9a6/0x85f51a6b96713ea5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x171:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.422611:0:24468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1777051136.422722:0:24468:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x170:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777051136.422738:0:24468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000051eb6e5f/0x85f51a6b96713eac lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x170:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.422769:0:24468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051136.422774:0:24468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051136.422784:0:24468:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000051eb6e5f/0x85f51a6b96713eac lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x170:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.422820:0:24468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000051eb6e5f/0x85f51a6b96713eac lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x170:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.422840:0:24468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000051eb6e5f/0x85f51a6b96713eac lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x170:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.422881:0:24468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000051eb6e5f/0x85f51a6b96713eac lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x170:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.422908:0:24468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1777051136.422962:0:24468:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x16f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777051136.422974:0:24468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e5a89e36/0x85f51a6b96713eb3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x16f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.422997:0:24468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051136.423001:0:24468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051136.423007:0:24468:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e5a89e36/0x85f51a6b96713eb3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.423057:0:24468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e5a89e36/0x85f51a6b96713eb3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.423118:0:24468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e5a89e36/0x85f51a6b96713eb3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.423159:0:24468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e5a89e36/0x85f51a6b96713eb3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.423235:0:24468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00002000:00010000:3.0:1777051136.423311:0:24468:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x16e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777051136.423328:0:24468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000098661a52/0x85f51a6b96713eba lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x16e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.423341:0:24468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051136.423344:0:24468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051136.423349:0:24468:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000098661a52/0x85f51a6b96713eba lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.423362:0:24468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000098661a52/0x85f51a6b96713eba lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.423372:0:24468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000098661a52/0x85f51a6b96713eba lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.423383:0:24468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000098661a52/0x85f51a6b96713eba lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.423419:0:24468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1777051136.423471:0:24468:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x16d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777051136.423480:0:24468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000afd84ae/0x85f51a6b96713ec1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x16d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.423492:0:24468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051136.423494:0:24468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051136.423498:0:24468:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000afd84ae/0x85f51a6b96713ec1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.423512:0:24468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000afd84ae/0x85f51a6b96713ec1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.423538:0:24468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000afd84ae/0x85f51a6b96713ec1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.423567:0:24468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000afd84ae/0x85f51a6b96713ec1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.423634:0:24468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1777051136.424019:0:24468:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x16c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777051136.424042:0:24468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000034a85079/0x85f51a6b96713ec8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x16c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.424076:0:24468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051136.424085:0:24468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051136.424094:0:24468:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000034a85079/0x85f51a6b96713ec8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.424137:0:24468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000034a85079/0x85f51a6b96713ec8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.424181:0:24468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000034a85079/0x85f51a6b96713ec8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.424249:0:24468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000034a85079/0x85f51a6b96713ec8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.424285:0:24468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1777051136.424349:0:24468:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x16b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777051136.424359:0:24468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003d3d28d3/0x85f51a6b96713ecf lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x16b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.424392:0:24468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051136.424398:0:24468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051136.424405:0:24468:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003d3d28d3/0x85f51a6b96713ecf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.424453:0:24468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003d3d28d3/0x85f51a6b96713ecf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.424499:0:24468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003d3d28d3/0x85f51a6b96713ecf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.424551:0:24468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003d3d28d3/0x85f51a6b96713ecf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.424580:0:24468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1777051136.424796:0:24468:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x16a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777051136.424806:0:24468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000075ed02f0/0x85f51a6b96713ed6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x16a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.424823:0:24468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051136.424826:0:24468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051136.424831:0:24468:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000075ed02f0/0x85f51a6b96713ed6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.424847:0:24468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000075ed02f0/0x85f51a6b96713ed6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.424862:0:24468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000075ed02f0/0x85f51a6b96713ed6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.424875:0:24468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000075ed02f0/0x85f51a6b96713ed6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.425539:0:24468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1777051136.425548:0:24468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000075ed02f0/0x85f51a6b96713ed6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x16a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1777051136.425638:0:24468:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x169:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777051136.426005:0:24468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000bda7984/0x85f51a6b96713edd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x169:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.426025:0:24468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051136.426028:0:24468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051136.426035:0:24468:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000bda7984/0x85f51a6b96713edd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x169:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.426053:0:24468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000bda7984/0x85f51a6b96713edd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x169:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.426069:0:24468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000bda7984/0x85f51a6b96713edd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x169:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.426083:0:24468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000bda7984/0x85f51a6b96713edd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x169:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.426563:0:24468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1777051136.426677:0:24468:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x168:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777051136.426687:0:24468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e959e0e6/0x85f51a6b96713ee4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x168:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.426702:0:24468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051136.426705:0:24468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051136.426711:0:24468:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e959e0e6/0x85f51a6b96713ee4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x168:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.426727:0:24468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e959e0e6/0x85f51a6b96713ee4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x168:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.426742:0:24468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e959e0e6/0x85f51a6b96713ee4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x168:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.426765:0:24468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e959e0e6/0x85f51a6b96713ee4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x168:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.427043:0:24468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1777051136.427057:0:24468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e959e0e6/0x85f51a6b96713ee4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x168:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1777051136.427158:0:24468:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x167:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777051136.427169:0:24468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008889c7d5/0x85f51a6b96713eeb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x167:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.427184:0:24468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051136.427187:0:24468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051136.427193:0:24468:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008889c7d5/0x85f51a6b96713eeb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x167:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.427228:0:24468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008889c7d5/0x85f51a6b96713eeb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x167:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.427244:0:24468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008889c7d5/0x85f51a6b96713eeb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x167:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.427259:0:24468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008889c7d5/0x85f51a6b96713eeb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x167:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.427297:0:24468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1777051136.427373:0:24468:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x166:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777051136.427392:0:24468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fd1cff08/0x85f51a6b96713ef2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x166:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.427457:0:24468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051136.427462:0:24468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051136.427473:0:24468:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fd1cff08/0x85f51a6b96713ef2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x166:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.427500:0:24468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fd1cff08/0x85f51a6b96713ef2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x166:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.427544:0:24468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fd1cff08/0x85f51a6b96713ef2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x166:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.427585:0:24468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fd1cff08/0x85f51a6b96713ef2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x166:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.427627:0:24468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00002000:00010000:3.0:1777051136.428022:0:24468:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x165:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777051136.428042:0:24468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000000156e0a/0x85f51a6b96713ef9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x165:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.428061:0:24468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051136.428068:0:24468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051136.428077:0:24468:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000000156e0a/0x85f51a6b96713ef9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x165:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.428098:0:24468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000000156e0a/0x85f51a6b96713ef9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x165:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.428114:0:24468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000000156e0a/0x85f51a6b96713ef9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x165:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.428126:0:24468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000000156e0a/0x85f51a6b96713ef9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x165:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.428160:0:24468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1777051136.428266:0:24468:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x164:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777051136.428277:0:24468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aec60412/0x85f51a6b96713f00 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x164:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.428292:0:24468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051136.428295:0:24468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051136.428300:0:24468:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aec60412/0x85f51a6b96713f00 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x164:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.428317:0:24468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aec60412/0x85f51a6b96713f00 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x164:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.428331:0:24468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aec60412/0x85f51a6b96713f00 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x164:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.428344:0:24468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000aec60412/0x85f51a6b96713f00 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x164:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.428371:0:24468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1777051136.428433:0:24468:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x163:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777051136.428442:0:24468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b57fa0e9/0x85f51a6b96713f07 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x163:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.428456:0:24468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051136.428459:0:24468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051136.428465:0:24468:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b57fa0e9/0x85f51a6b96713f07 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x163:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.428485:0:24468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b57fa0e9/0x85f51a6b96713f07 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x163:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.428500:0:24468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b57fa0e9/0x85f51a6b96713f07 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x163:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.428526:0:24468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b57fa0e9/0x85f51a6b96713f07 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x163:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.428598:0:24468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1777051136.429027:0:24468:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x162:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777051136.429051:0:24468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aa6fe782/0x85f51a6b96713f0e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x162:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.429105:0:24468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051136.429111:0:24468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051136.429120:0:24468:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aa6fe782/0x85f51a6b96713f0e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x162:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.429155:0:24468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aa6fe782/0x85f51a6b96713f0e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x162:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.429194:0:24468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aa6fe782/0x85f51a6b96713f0e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x162:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.429254:0:24468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000aa6fe782/0x85f51a6b96713f0e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x162:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.429282:0:24468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1777051136.429351:0:24468:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x161:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777051136.429360:0:24468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000efd61c8/0x85f51a6b96713f15 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x161:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.429376:0:24468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051136.429380:0:24468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051136.429386:0:24468:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000efd61c8/0x85f51a6b96713f15 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x161:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.429403:0:24468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000efd61c8/0x85f51a6b96713f15 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x161:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.429431:0:24468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000efd61c8/0x85f51a6b96713f15 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x161:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.429462:0:24468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000efd61c8/0x85f51a6b96713f15 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x161:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.429498:0:24468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1777051136.429576:0:24468:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x160:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777051136.429599:0:24468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c98c2e90/0x85f51a6b96713f1c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x160:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.429648:0:24468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051136.429683:0:24468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051136.429693:0:24468:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c98c2e90/0x85f51a6b96713f1c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x160:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.429719:0:24468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c98c2e90/0x85f51a6b96713f1c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x160:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.429757:0:24468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c98c2e90/0x85f51a6b96713f1c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x160:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.429788:0:24468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c98c2e90/0x85f51a6b96713f1c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x160:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.429834:0:24468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1777051136.429928:0:24468:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x15f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777051136.429952:0:24468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003a6ac3f9/0x85f51a6b96713f23 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x15f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.429980:0:24468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051136.429983:0:24468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051136.429988:0:24468:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003a6ac3f9/0x85f51a6b96713f23 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.430012:0:24468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003a6ac3f9/0x85f51a6b96713f23 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.430032:0:24468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003a6ac3f9/0x85f51a6b96713f23 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.430046:0:24468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003a6ac3f9/0x85f51a6b96713f23 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.430075:0:24468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:3.0:1777051136.430123:0:24468:0:(ofd_dev.c:1515:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:350 00000100:00100000:3.0:1777051136.430579:0:24468:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f867480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:98577:x1863365452433920:12345-0@lo:5:osp-pre-1-0.0 Request processed in 34492us (34675us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051136.430608:0:24468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7927 00000100:00100000:3.0:1777051136.434340:0:55805:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452434304 00000100:00100000:3.0:1777051136.434354:0:55805:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452434304 00000100:00100000:3.0:1777051136.434438:0:55805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7928 00000100:00100000:3.0:1777051136.434456:0:55805:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95612b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:98577:x1863365452434304:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1777051136.434514:0:55805:0:(ofd_dev.c:1745:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 386 00000100:00100000:3.0:1777051136.440441:0:55805:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95612b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:98577:x1863365452434304:12345-0@lo:5:osp-pre-1-0.0 Request processed in 5986us (6459us total) trans 4294968348 rc 0/0 00000100:00100000:3.0:1777051136.440459:0:55805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7928 00010000:00010000:3.0:1777051136.447196:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051136.448863:0:13753:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777051136.448881:0:13753:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000032fa23f/0x85f51a6b96713f62 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x179:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 27884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.448932:0:13753:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da7d785800 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:3.0:1777051136.448947:0:13753:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000032fa23f/0x85f51a6b96713f62 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x179:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 27884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.448997:0:13753:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000032fa23f/0x85f51a6b96713f62 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x179:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 27884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.449089:0:13753:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000032fa23f/0x85f51a6b96713f62 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x179:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 27884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.449125:0:13753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000032fa23f/0x85f51a6b96713f62 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x179:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 27884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.449167:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051136.449175:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051136.449184:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051136.450461:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051136.451389:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051136.451455:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051136.451463:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051136.451473:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051136.451505:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051136.451511:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051136.451519:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051136.451711:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051136.451881:0:38719:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777051136.451893:0:38719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000513568eb/0x85f51a6b96713f9a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x171:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 27884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.451918:0:38719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da7d784c00 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:3.0:1777051136.451931:0:38719:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000513568eb/0x85f51a6b96713f9a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x171:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 27884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.451957:0:38719:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000513568eb/0x85f51a6b96713f9a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x171:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 27884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.452284:0:38719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000513568eb/0x85f51a6b96713f9a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x171:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 27884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.452301:0:38719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000513568eb/0x85f51a6b96713f9a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x171:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 27884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.452427:0:38719:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777051136.452437:0:38719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c299d683/0x85f51a6b96713fa1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x170:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 27884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.452452:0:38719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da7d784e00 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:3.0:1777051136.452460:0:38719:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c299d683/0x85f51a6b96713fa1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x170:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 27884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.452476:0:38719:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c299d683/0x85f51a6b96713fa1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x170:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 27884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.452536:0:38719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c299d683/0x85f51a6b96713fa1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x170:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 27884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.452563:0:38719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c299d683/0x85f51a6b96713fa1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x170:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 27884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.452640:0:38719:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777051136.452675:0:38719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b2388768/0x85f51a6b96713fa8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 27884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.452690:0:38719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da7d784a00 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:3.0:1777051136.452698:0:38719:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2388768/0x85f51a6b96713fa8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 27884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.452715:0:38719:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2388768/0x85f51a6b96713fa8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x16f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 27884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.452743:0:38719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b2388768/0x85f51a6b96713fa8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x16f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 27884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.452769:0:38719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b2388768/0x85f51a6b96713fa8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x16f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 27884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.452812:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051136.452819:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051136.452825:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1777051136.453015:0:8464:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:3.0:1777051136.453626:0:38719:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777051136.453638:0:38719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007b859ac7/0x85f51a6b96713fbd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 27884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.453697:0:38719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d9442ea000 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:3.0:1777051136.453705:0:38719:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007b859ac7/0x85f51a6b96713fbd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 27884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.453720:0:38719:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007b859ac7/0x85f51a6b96713fbd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x16c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 27884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.453743:0:38719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007b859ac7/0x85f51a6b96713fbd lrc: 1/0,0 mode: --/PW res: [0x280000401:0x16c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 27884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.453768:0:38719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007b859ac7/0x85f51a6b96713fbd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x16c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 27884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.453810:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051136.453817:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051136.453825:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051136.453860:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051136.453866:0:13753:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777051136.453873:0:13753:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c454c4cc/0x85f51a6b96713fc4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x16b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 27884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.453894:0:13753:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d9442eba00 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:3.0:1777051136.453901:0:13753:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c454c4cc/0x85f51a6b96713fc4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 27884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.453930:0:13753:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c454c4cc/0x85f51a6b96713fc4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x16b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 27884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.453954:0:13753:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c454c4cc/0x85f51a6b96713fc4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x16b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 27884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.453971:0:13753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c454c4cc/0x85f51a6b96713fc4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x16b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 27884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.454012:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051136.454016:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051136.454019:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051136.454470:0:38719:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777051136.454485:0:38719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d1127f8c/0x85f51a6b96713fd2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x169:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 27884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.454530:0:38719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d9442ea400 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:3.0:1777051136.454545:0:38719:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d1127f8c/0x85f51a6b96713fd2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x169:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 27884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.454592:0:38719:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d1127f8c/0x85f51a6b96713fd2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x169:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 27884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.454687:0:38719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d1127f8c/0x85f51a6b96713fd2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x169:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 27884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.454726:0:38719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d1127f8c/0x85f51a6b96713fd2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x169:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 27884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.455124:0:38719:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777051136.455134:0:38719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002da22fbd/0x85f51a6b96713fd9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x168:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 27884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.455152:0:38719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d9442eb600 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:3.0:1777051136.455160:0:38719:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002da22fbd/0x85f51a6b96713fd9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x168:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 27884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.455178:0:38719:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002da22fbd/0x85f51a6b96713fd9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x168:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 27884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.455204:0:38719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002da22fbd/0x85f51a6b96713fd9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x168:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 27884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.455246:0:38719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002da22fbd/0x85f51a6b96713fd9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x168:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 27884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.455276:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051136.455282:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051136.455288:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051136.456508:0:13753:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1777051136.456522:0:13753:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000039d760f0/0x85f51a6b96713fe0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x167:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 27884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.456566:0:13753:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d9442eb200 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:3.0:1777051136.456577:0:13753:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000039d760f0/0x85f51a6b96713fe0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x167:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 27884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.456609:0:13753:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000039d760f0/0x85f51a6b96713fe0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x167:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 27884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.456681:0:13753:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000039d760f0/0x85f51a6b96713fe0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x167:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 27884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.456711:0:13753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000039d760f0/0x85f51a6b96713fe0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x167:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 27884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.457103:0:13753:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1777051136.457113:0:13753:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d7a33e2b/0x85f51a6b96713fe7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x166:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 27884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.457130:0:13753:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d9442eae00 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:3.0:1777051136.457137:0:13753:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d7a33e2b/0x85f51a6b96713fe7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x166:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 27884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.457155:0:13753:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d7a33e2b/0x85f51a6b96713fe7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x166:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 27884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.457245:0:13753:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d7a33e2b/0x85f51a6b96713fe7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x166:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 27884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.457297:0:13753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d7a33e2b/0x85f51a6b96713fe7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x166:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 27884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.457346:0:13753:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777051136.457360:0:13753:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007cef667b/0x85f51a6b96713ff5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x164:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 27884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.457410:0:13753:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d9442eb000 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:3.0:1777051136.457424:0:13753:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007cef667b/0x85f51a6b96713ff5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x164:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 27884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.457470:0:13753:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007cef667b/0x85f51a6b96713ff5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x164:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 27884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.457516:0:13753:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007cef667b/0x85f51a6b96713ff5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x164:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 27884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.457536:0:13753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007cef667b/0x85f51a6b96713ff5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x164:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 27884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051136.457600:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051136.457607:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051136.457616:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051136.457634:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051136.458721:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051136.458735:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777051136.459481:0:98575:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94e624380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:98575:1863365452434048:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1777051136.459513:0:98575:0:(osp_precreate.c:955:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x181:0x0] from OST, last_created [0x280000401:0x181:0x0]last_used is [0x280000401:0x15e:0x0] 00000100:00100000:3.0:1777051136.459688:0:98575:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7fdf3100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:98575:1863365452434560:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1777051136.865699:0:27887:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425811584 00000100:00100000:3.0:1777051136.865898:0:27887:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425811584 00000100:00100000:3.0:1777051136.866203:0:27887:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425812096 00000100:00100000:3.0:1777051136.866213:0:27887:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425812096 00000100:00100000:3.0:1777051136.866297:0:27887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10018 00000100:00100000:3.0:1777051136.866315:0:27887:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f864a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+47:2437:x1863365425812096:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:3.0:1777051136.866435:0:27887:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f864a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+47:2437:x1863365425812096:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 121us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051136.866452:0:27887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10018 00000100:00100000:3.0:1777051136.866816:0:55805:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425811712 00000100:00100000:3.0:1777051136.866823:0:55805:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425811712 00000100:00100000:3.0:1777051136.970948:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051137.006926:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00010000:00010000:3.0:1777051137.111253:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777051141.399543:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d944e11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3677:1863365452435072:0@lo:400:kworker.0 00000100:00100000:3.0:1777051141.400399:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051141.400488:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d944e11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452435584:0@lo:400:kworker.0 00000100:00100000:3.0:1777051141.400599:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051141.400652:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d944e10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3677:1863365452436096:0@lo:400:kworker.0 00000100:00100000:3.0:1777051141.400712:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051141.400783:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7fd60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3677:1863365452436608:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1777051141.400853:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051141.400956:0:46498:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452436096 00000100:00100000:3.0:1777051141.400970:0:46498:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452436096 00000100:00100000:3.0:1777051141.401043:0:46498:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452436608 00000100:00100000:3.0:1777051141.401052:0:46498:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452436608 00000100:00100000:3.0:1777051141.401430:0:46498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7913 00000100:00100000:3.0:1777051141.401458:0:46498:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fdf1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+6:3677:x1863365452436096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051141.401555:0:46498:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fdf1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+6:3677:x1863365452436096:12345-0@lo:400:kworker.0 Request processed in 105us (840us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051141.401615:0:46498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7913 00000100:00100000:3.0:1777051141.401665:0:46498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7914 00000100:00100000:3.0:1777051141.401688:0:46498:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fdf2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3677:x1863365452436608:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1777051141.401735:0:46498:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4243456 pending 0 free 1446064128 avail 1299824640 00000100:00100000:3.0:1777051141.401822:0:46498:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fdf2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3677:x1863365452436608:12345-0@lo:41:osp-pre-1-0.0 Request processed in 137us (968us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051141.401840:0:46498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7914 00000100:00100000:3.0:1777051141.401940:0:6579:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452435200 00000100:00100000:3.0:1777051141.401953:0:6579:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452435200 00000100:00100000:3.0:1777051141.402029:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12948 00000100:00100000:3.0:1777051141.402047:0:6579:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f65bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3678:x1863365452435200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051141.402527:0:6579:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f65bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3678:x1863365452435200:12345-0@lo:400:kworker.0 Request processed in 476us (2019us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051141.402548:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12948 00000100:00100000:3.0:1777051141.402624:0:6579:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452435456 00000100:00100000:3.0:1777051141.402635:0:6579:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452435456 00000100:00100000:3.0:1777051141.402752:0:6579:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452436480 00000100:00100000:3.0:1777051141.402765:0:6579:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452436480 00000100:00100000:3.0:1777051141.402848:0:6579:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452435328 00000100:00100000:3.0:1777051141.402858:0:6579:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452435328 00000100:00100000:3.0:1777051141.402918:0:6579:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452435840 00000100:00100000:3.0:1777051141.402927:0:6579:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452435840 00000100:00100000:3.0:1777051141.403008:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12949 00000100:00100000:3.0:1777051141.403027:0:6579:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fd60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3680:x1863365452435456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051141.403503:0:6579:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fd60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3680:x1863365452435456:12345-0@lo:400:kworker.0 Request processed in 478us (1233us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051141.403520:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12949 00000100:00100000:3.0:1777051141.403565:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12950 00000100:00100000:3.0:1777051141.403629:0:6579:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fd61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3680:x1863365452436480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051141.404052:0:6579:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fd61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3680:x1863365452436480:12345-0@lo:400:kworker.0 Request processed in 426us (1528us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051141.404072:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12950 00000100:00100000:3.0:1777051141.404121:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12951 00000100:00100000:3.0:1777051141.404151:0:6579:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fd62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3680:x1863365452435328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051141.404297:0:6579:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fd62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3680:x1863365452435328:12345-0@lo:400:kworker.0 Request processed in 154us (1607us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051141.404314:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12951 00000100:00100000:3.0:1777051141.404364:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12952 00000100:00100000:3.0:1777051141.404385:0:6579:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fd61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3680:x1863365452435840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051141.404473:0:6579:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fd61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3680:x1863365452435840:12345-0@lo:400:kworker.0 Request processed in 93us (1686us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051141.404490:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12952 00000100:00080000:3.0:1777051141.404636:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1777051141.404645:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1777051141.404652:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1777051141.405668:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1777051141.405704:0:6579:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452435712 00000100:00100000:3.0:1777051141.405714:0:6579:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452435712 00000100:00100000:3.0:1777051141.405818:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12953 00000100:00100000:3.0:1777051141.405835:0:6579:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f65b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3678:x1863365452435712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051141.405926:0:6579:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f65b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3678:x1863365452435712:12345-0@lo:400:kworker.0 Request processed in 95us (658us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051141.405939:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12953 00000001:00080000:3.0:1777051141.927663:0:8464:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0000: transno 4294968345 is committed 00000100:00100000:3.0:1777051142.051789:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051142.051833:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051142.051869:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051142.051904:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051142.051987:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051142.052051:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051142.052445:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051142.052555:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051142.053113:0:27885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 12955 00000100:00100000:3.0:1777051142.053144:0:27885:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fdf0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c11b6966-0775-44d2-bdc6-c74c26eb2226+6:2436:x1863365425813120:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:3.0:1777051142.053411:0:27885:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fdf0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c11b6966-0775-44d2-bdc6-c74c26eb2226+6:2436:x1863365425813120:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 281us (1505us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051142.053426:0:27885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 12955 00000100:00100000:3.0:1777051143.481897:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051143.485342:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051143.488977:0:8472:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425814272 00000100:00100000:3.0:1777051143.488988:0:8472:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425814272 00000100:00100000:3.0:1777051143.489056:0:8472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 5450 00000100:00100000:3.0:1777051143.489071:0:8472:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da57e94c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+50:128327:x1863365425814272:12345-192.168.201.46@tcp:13:lfs.0 00002000:00000024:3.0:1777051143.489100:0:8472:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 440355904 pending 0 free 3862671360 avail 3631149056 00000100:00100000:3.0:1777051143.489183:0:8472:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da57e94c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+50:128327:x1863365425814272:12345-192.168.201.46@tcp:13:lfs.0 Request processed in 113us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051143.489195:0:8472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 5450 00000100:00100000:3.0:1777051143.490959:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051145.751533:0:6563:0:(service.c:3441:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:3.0:1777051145.751554:0:6563:0:(service.c:3500:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00000100:00100000:3.0:1777051145.751639:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7fd61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3678:1863365452437888:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1777051145.752635:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051145.753788:0:99218:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95f658e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:99218:1863365452437376:0@lo:104: 00000100:00100000:3.0:1777051145.753851:0:99218:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95f659880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:99218:1863365452437504:0@lo:104: 00000100:00100000:3.0:1777051145.753875:0:99218:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95f65aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:99218:1863365452437632:0@lo:104: 00000100:00100000:3.0:1777051145.753988:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95f658700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3679:1863365452438144:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1777051145.754056:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051145.756461:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051145.756663:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00010000:00010000:3.0:1777051146.327476:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777051146.518424:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7fd62680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3678:1863365452438528:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1777051146.518529:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94f42f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452438656:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1777051146.518635:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051146.518737:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94f42c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3679:1863365452439168:0@lo:400:kworker.0 00000100:00100000:3.0:1777051146.518816:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051146.518857:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94f42ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3679:1863365452439680:0@lo:400:kworker.0 00000100:00100000:3.0:1777051146.518899:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051146.518938:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94f42e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452440192:0@lo:400:kworker.0 00000100:00100000:3.0:1777051146.518993:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051146.519847:0:11727:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452438656 00000100:00100000:3.0:1777051146.519855:0:11727:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452438656 00000100:00100000:3.0:1777051146.519915:0:11727:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452439936 00000100:00100000:3.0:1777051146.519922:0:11727:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452439936 00000100:00100000:3.0:1777051146.519978:0:11727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7916 00000100:00100000:3.0:1777051146.519998:0:11727:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d950889500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:3677:x1863365452438912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051146.520071:0:11727:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d950889500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:3677:x1863365452438912:12345-0@lo:400:kworker.0 Request processed in 76us (1220us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051146.520082:0:11727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7916 00000100:00100000:3.0:1777051146.520115:0:11727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7917 00000100:00100000:3.0:1777051146.520134:0:11727:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95088b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3677:x1863365452439936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051146.520205:0:11727:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95088b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3677:x1863365452439936:12345-0@lo:400:kworker.0 Request processed in 59us (617us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051146.520258:0:11727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7917 00000100:00100000:3.0:1777051146.520309:0:6581:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452439168 00000100:00100000:3.0:1777051146.520317:0:6581:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452439168 00000100:00100000:3.0:1777051146.520389:0:6581:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452439040 00000100:00100000:3.0:1777051146.520397:0:6581:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452439040 00000100:00100000:3.0:1777051146.520458:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12958 00000100:00100000:3.0:1777051146.520476:0:6581:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f97d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3679:x1863365452439168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051146.520571:0:6581:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f97d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3679:x1863365452439168:12345-0@lo:400:kworker.0 Request processed in 101us (1755us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051146.520587:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12958 00000100:00100000:3.0:1777051146.520620:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12960 00000100:00100000:3.0:1777051146.520638:0:6581:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d950889880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3677:x1863365452439040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051146.520928:0:6581:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d950889880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3677:x1863365452439040:12345-0@lo:400:kworker.0 Request processed in 293us (1000us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051146.520949:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12960 00000100:00100000:3.0:1777051146.521110:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051146.521183:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051146.521270:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94f42fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3680:1863365452439808:0@lo:400:kworker.0 00000100:00100000:3.0:1777051146.521339:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051146.521380:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95088bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3680:1863365452440320:0@lo:400:kworker.0 00000100:00100000:3.0:1777051146.521421:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051146.521465:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94f42ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3680:1863365452438784:0@lo:400:kworker.0 00000100:00100000:3.0:1777051146.521547:0:21368:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452439296 00000100:00100000:3.0:1777051146.521553:0:21368:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452439296 00000100:00100000:3.0:1777051146.521600:0:21368:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452440320 00000100:00100000:3.0:1777051146.521604:0:21368:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452440320 00000100:00100000:3.0:1777051146.521640:0:21368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12962 00000100:00100000:3.0:1777051146.521653:0:21368:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f97ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3680:x1863365452439296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051146.521705:0:21368:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f97ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3680:x1863365452439296:12345-0@lo:400:kworker.0 Request processed in 54us (526us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051146.521969:0:21368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12962 00000100:00100000:3.0:1777051146.522043:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94f42c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3679:1863365452439168:0@lo:400:kworker.0 00000100:00100000:3.0:1777051146.522368:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94f42ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3679:1863365452439680:0@lo:400:kworker.0 00000100:00100000:3.0:1777051146.522392:0:3679:0:(client.c:3101:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968348 gen 2 00000100:00100000:3.0:1777051146.522417:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94f42e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452440192:0@lo:400:kworker.0 00000100:00100000:3.0:1777051146.522453:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94f42f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452438656:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1777051146.917570:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051146.921396:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051146.935995:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051146.939702:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051146.948360:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051146.962419:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051147.170087:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051147.170584:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051147.170671:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051147.170784:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051147.171070:0:13320:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425816448 00000100:00100000:3.0:1777051147.171082:0:13320:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425816448 00000100:00100000:3.0:1777051147.171387:0:13320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10034 00000100:00100000:3.0:1777051147.171685:0:13320:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f97ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+50:2436:x1863365425816448:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:3.0:1777051147.171793:0:13320:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f97ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+50:2436:x1863365425816448:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 114us (1015us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051147.171814:0:13320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10034 00000100:00100000:3.0:1777051147.171867:0:13320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10035 00000100:00100000:3.0:1777051147.171890:0:13320:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d950265f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+50:2436:x1863365425816960:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:3.0:1777051147.171978:0:13320:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d950265f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+50:2436:x1863365425816960:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 92us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051147.171995:0:13320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10035 00000100:00100000:3.0:1777051147.500732:0:6577:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95088bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452442112:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1777051147.500756:0:6577:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.146@tcp lock: ffff99d955a8e200/0x85f51a6b96714065 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b9671406c expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051147.500785:0:6577:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.146@tcp lock: ffff99d955a8e200/0x85f51a6b96714065 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x85f51a6b9671406c expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051147.500881:0:6577:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95f97e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452442240:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1777051147.500942:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051147.500997:0:6577:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d9591d5f00 going to sleep for 11 seconds 00000100:00100000:3.0:1777051147.501710:0:6577:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95f97e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452442240:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1777051147.501775:0:6577:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95f97e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452442368:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1777051147.501850:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051147.501895:0:6577:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d9591d5f00 going to sleep for 11 seconds 00000100:00100000:3.0:1777051147.502453:0:6577:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95f97e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452442368:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1777051147.506016:0:99284:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d950888a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f9351a01-5b0e-4470-97fd-58b9b4b312a2:99284:1863365452442624:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1777051147.506055:0:99284:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1777051147.506064:0:99284:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1777051147.506068:0:99284:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1777051147.506074:0:99284:0:(llog.c:858:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 31 count 31 00000100:00100000:3.0:1777051147.508630:0:98567:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452443008 00000100:00100000:3.0:1777051147.508639:0:98567:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452443008 00000100:00100000:3.0:1777051147.508703:0:98567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1777051147.508719:0:98567:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fd3b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f9351a01-5b0e-4470-97fd-58b9b4b312a2+23:6577:x1863365452443008:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1777051147.508863:0:98567:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fd3b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f9351a01-5b0e-4470-97fd-58b9b4b312a2+23:6577:x1863365452443008:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 147us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051147.508876:0:98567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000020:01000000:3.0:1777051147.514538:0:6577:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 25-30 (rc=0) 10000000:01000000:3.0:1777051147.514575:0:6577:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.201.146@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1777051147.514605:0:6577:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff99d955a8e800/0x85f51a6b96714073 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b9671407a expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051147.514623:0:6577:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.146@tcp lock: ffff99d955a8e800/0x85f51a6b96714073 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b9671407a expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1777051148.566588:0:99287:0:(llog.c:801:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:3.0:1777051148.566885:0:99287:0:(llog_cat.c:158:llog_cat_process_common()) processing log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1777051148.567837:0:99287:0:(llog.c:858:llog_process_thread()) stop processing plain [0x1:0x15:0x0] index 243 count 1 00000040:00080000:3.0:1777051148.567902:0:99287:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x15:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1777051148.568293:0:99287:0:(llog.c:858:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 5 count 1 00010000:00010000:3.0:1777051150.425529:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777051151.639008:0:6585:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452443520 00000100:00100000:3.0:1777051151.639021:0:6585:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452443520 00000100:00100000:3.0:1777051151.639108:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7919 00000100:00100000:3.0:1777051151.639127:0:6585:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95088ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3680:x1863365452443520:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1777051151.639176:0:6585:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4194304 pending 0 free 1441603584 avail 1295364096 00000100:00100000:3.0:1777051151.639299:0:6585:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95088ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3680:x1863365452443520:12345-0@lo:41:osp-pre-0-1.0 Request processed in 176us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051151.639315:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7919 00000100:00100000:3.0:1777051151.639363:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95f97e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3677:1863365452443648:0@lo:400:kworker.0 00000100:00100000:3.0:1777051151.639470:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051151.639535:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d944071180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3677:1863365452444160:0@lo:400:kworker.0 00000100:00100000:3.0:1777051151.640508:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051151.641588:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7fdf2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452444672:0@lo:400:kworker.0 00000100:00100000:3.0:1777051151.641655:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051151.641704:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d944d29180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3677:1863365452445184:0@lo:400:kworker.0 00000100:00100000:3.0:1777051151.641802:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051151.641885:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95f97e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3677:1863365452443648:0@lo:400:kworker.0 00000100:00100000:3.0:1777051151.641941:0:6584:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452443776 00000100:00100000:3.0:1777051151.641950:0:6584:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452443776 00000100:00100000:3.0:1777051151.642003:0:6584:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452444800 00000100:00100000:3.0:1777051151.642010:0:6584:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452444800 00000100:00100000:3.0:1777051151.642369:0:6584:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452445312 00000100:00100000:3.0:1777051151.642378:0:6584:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452445312 00000100:00100000:3.0:1777051151.642450:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7921 00000100:00100000:3.0:1777051151.642467:0:6584:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fd61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3678:x1863365452444800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051151.642546:0:6584:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fd61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3678:x1863365452444800:12345-0@lo:400:kworker.0 Request processed in 82us (1050us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051151.642570:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7921 00000100:00100000:3.0:1777051151.643044:0:6581:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452445184 00000100:00100000:3.0:1777051151.643051:0:6581:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452445184 00000100:00100000:3.0:1777051151.643708:0:6581:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452444416 00000100:00100000:3.0:1777051151.643718:0:6581:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452444416 00000100:00080000:3.0:1777051151.643933:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1777051151.643941:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1777051151.643950:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1777051151.643957:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1777051151.643966:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1777051151.644015:0:13320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10037 00000100:00100000:3.0:1777051151.644038:0:13320:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95088bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3680:x1863365452445056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051151.644447:0:13320:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95088bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3680:x1863365452445056:12345-0@lo:400:kworker.0 Request processed in 417us (5119us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051151.644462:0:13320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10037 00000100:00100000:3.0:1777051151.644505:0:13320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10040 00000100:00100000:3.0:1777051151.644532:0:13320:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fd61180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3679:x1863365452444928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051151.644614:0:13320:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fd61180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3679:x1863365452444928:12345-0@lo:400:kworker.0 Request processed in 88us (982us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051151.644641:0:13320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10040 00000100:00080000:3.0:1777051151.644695:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1777051152.150862:0:3680:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1777051152.150901:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d950889c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3680:1863365452445440:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1777051152.151016:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051152.151602:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7fd60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3680:1863365452445568:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1777051152.151674:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051152.291675:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051152.291755:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051152.291827:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051152.291913:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051152.291986:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051152.292095:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00010000:00010000:3.0:1777051154.520650:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777051156.760161:0:8470:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452447488 00000100:00100000:3.0:1777051156.760175:0:8470:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452447488 00000100:00100000:3.0:1777051156.760350:0:8470:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452446720 00000100:00100000:3.0:1777051156.760360:0:8470:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452446720 00000100:00100000:3.0:1777051156.760419:0:8470:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452447104 00000100:00100000:3.0:1777051156.760430:0:8470:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452447104 00000100:00100000:3.0:1777051156.760503:0:8470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10045 00000100:00100000:3.0:1777051156.760529:0:8470:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f42ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3678:x1863365452447488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051156.760638:0:8470:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f42ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3678:x1863365452447488:12345-0@lo:400:kworker.0 Request processed in 112us (1175us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051156.760657:0:8470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10045 00000100:00100000:3.0:1777051156.761045:0:8470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10046 00000100:00100000:3.0:1777051156.761071:0:8470:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fdf3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3680:x1863365452446720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051156.761174:0:8470:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fdf3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3680:x1863365452446720:12345-0@lo:400:kworker.0 Request processed in 106us (1633us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051156.761248:0:8470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10046 00000100:00080000:3.0:1777051156.763685:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1777051156.763786:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7fd60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452447744:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1777051156.763819:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95088b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452446080:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1777051157.270625:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94f42e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3677:1863365452448000:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1777051157.271012:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051157.271134:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7fd60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452447872:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1777051157.271178:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051157.271306:0:3677:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1777051157.271355:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d951fa1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3677:1863365452448128:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1777051157.271407:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051157.271570:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94f42e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3677:1863365452448000:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1777051157.271634:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7fd60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452447872:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1777051157.272014:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d951fa1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3677:1863365452448128:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1777051157.412395:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051157.412480:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051157.412558:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051157.412652:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051157.413029:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051157.413088:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051157.413924:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051157.413976:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051157.414025:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051157.414065:0:8470:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425819264 00000100:00100000:3.0:1777051157.414236:0:8470:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425819264 00000100:00100000:3.0:1777051157.414296:0:8470:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425819392 00000100:00100000:3.0:1777051157.414303:0:8470:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425819392 00000100:00100000:3.0:1777051157.414426:0:8470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10050 00000100:00100000:3.0:1777051157.414451:0:8470:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f168700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+48:2439:x1863365425818880:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:3.0:1777051157.414541:0:8470:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f168700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+48:2439:x1863365425818880:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 96us (1447us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051157.414557:0:8470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10050 00000100:00100000:3.0:1777051157.414612:0:8470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10051 00000100:00100000:3.0:1777051157.414644:0:8470:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f169c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+50:2438:x1863365425819264:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:3.0:1777051157.414727:0:8470:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f169c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+50:2438:x1863365425819264:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 91us (799us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051157.415094:0:8470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10051 00000100:00100000:3.0:1777051157.415126:0:8470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10052 00000100:00100000:3.0:1777051157.415142:0:8470:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f169500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+47:2438:x1863365425819392:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:3.0:1777051157.415238:0:8470:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f169500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+47:2438:x1863365425819392:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 59us (1172us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051157.415265:0:8470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10052 00000100:00080000:3.0:1777051157.415347:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1777051157.415359:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1777051157.415369:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1777051157.415386:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1777051157.782680:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7fd60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452448256:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1777051157.782790:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051157.783276:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7fd60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452448256:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1777051158.614585:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777051161.879374:0:6584:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452448384 00000100:00100000:3.0:1777051161.879387:0:6584:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452448384 00000100:00100000:3.0:1777051161.879485:0:6584:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452448512 00000100:00100000:3.0:1777051161.879494:0:6584:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452448512 00000100:00100000:3.0:1777051161.879551:0:6584:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452448768 00000100:00100000:3.0:1777051161.879560:0:6584:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452448768 00000100:00100000:3.0:1777051161.879615:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7927 00000100:00100000:3.0:1777051161.879630:0:6584:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f42ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3679:x1863365452448384:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1777051161.879989:0:6584:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4243456 pending 0 free 1446064128 avail 1299824640 00000100:00100000:3.0:1777051161.880337:0:6584:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f42ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3679:x1863365452448384:12345-0@lo:41:osp-pre-1-0.0 Request processed in 703us (1199us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051161.880354:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7927 00000100:00100000:3.0:1777051161.880410:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7929 00000100:00100000:3.0:1777051161.880433:0:6584:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f42c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:3679:x1863365452448768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051161.880531:0:6584:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f42c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:3679:x1863365452448768:12345-0@lo:400:kworker.0 Request processed in 104us (1116us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051161.880560:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7929 00000100:00100000:3.0:1777051161.880630:0:55805:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452449280 00000100:00100000:3.0:1777051161.880639:0:55805:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452449280 00000100:00100000:3.0:1777051161.881065:0:55805:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452449920 00000100:00100000:3.0:1777051161.881076:0:55805:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452449920 00000100:00100000:3.0:1777051161.881143:0:55805:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452449664 00000100:00100000:3.0:1777051161.881154:0:55805:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452449664 00000100:00100000:3.0:1777051161.882551:0:55805:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452449792 00000100:00100000:3.0:1777051161.882562:0:55805:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452449792 00000100:00100000:3.0:1777051161.882628:0:55805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10053 00000100:00100000:3.0:1777051161.882660:0:55805:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f42d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3679:x1863365452449280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051161.884049:0:55805:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f42d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3679:x1863365452449280:12345-0@lo:400:kworker.0 Request processed in 456us (3548us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051161.884069:0:55805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10053 00000100:00100000:3.0:1777051162.391132:0:8473:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452450176 00000100:00100000:3.0:1777051162.391143:0:8473:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452450176 00000100:00100000:3.0:1777051162.391528:0:8473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5466 00000100:00100000:3.0:1777051162.391556:0:8473:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d951fa2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3680:x1863365452450304:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1777051162.391586:0:8473:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 430296128 pending 0 free 3645853696 avail 3414331392 00000100:00100000:3.0:1777051162.391685:0:8473:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d951fa2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3680:x1863365452450304:12345-0@lo:13:osp-pre-1-0.0 Request processed in 134us (580us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051162.391716:0:8473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5466 00000100:00100000:3.0:1777051162.531666:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051162.531756:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051162.531831:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051162.531905:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051162.531969:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051162.532428:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051162.532505:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051162.532695:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051162.532876:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051162.532954:0:8470:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425820416 00000100:00100000:3.0:1777051162.532963:0:8470:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425820416 00010000:00010000:3.0:1777051162.710626:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051166.807498:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777051166.999098:0:11727:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452450688 00000100:00100000:3.0:1777051166.999441:0:11727:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452450688 00000100:00100000:3.0:1777051166.999519:0:11727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7930 00000100:00100000:3.0:1777051166.999535:0:11727:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d951fa0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3677:x1863365452450688:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1777051166.999588:0:11727:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4243456 pending 0 free 1446064128 avail 1299824640 00000100:00100000:3.0:1777051166.999673:0:11727:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d951fa0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3677:x1863365452450688:12345-0@lo:41:osp-pre-1-0.0 Request processed in 138us (656us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051166.999695:0:11727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7930 00000100:00100000:3.0:1777051166.999778:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95f658a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3680:1863365452451072:0@lo:400:kworker.0 00000100:00100000:3.0:1777051166.999857:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051166.999911:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95f658380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3680:1863365452451584:0@lo:400:kworker.0 00000100:00100000:3.0:1777051166.999978:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95f659c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3678:1863365452451328:0@lo:400:kworker.0 00000100:00100000:3.0:1777051167.000034:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051167.000079:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955610e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452451840:0@lo:400:kworker.0 00000100:00100000:3.0:1777051167.000439:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051167.000486:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955613480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452452352:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1777051167.000538:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051167.000625:0:8470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10061 00000100:00100000:3.0:1777051167.000655:0:8470:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955610000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3679:x1863365452451456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051167.001095:0:8470:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955610000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3679:x1863365452451456:12345-0@lo:400:kworker.0 Request processed in 450us (1229us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051167.001115:0:8470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10061 00000100:00100000:3.0:1777051167.001191:0:8470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10063 00000100:00100000:3.0:1777051167.001259:0:8470:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da4384ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3678:x1863365452451840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051167.001337:0:8470:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da4384ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3678:x1863365452451840:12345-0@lo:400:kworker.0 Request processed in 87us (898us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051167.001357:0:8470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10063 00000100:00100000:3.0:1777051167.001408:0:6585:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452450944 00000100:00100000:3.0:1777051167.001417:0:6585:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452450944 00000100:00100000:3.0:1777051167.001485:0:6585:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452452352 00000100:00100000:3.0:1777051167.001494:0:6585:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452452352 00000100:00100000:3.0:1777051167.001560:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7931 00000100:00100000:3.0:1777051167.001580:0:6585:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955613800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:3679:x1863365452450944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051167.001663:0:6585:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955613800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:3679:x1863365452450944:12345-0@lo:400:kworker.0 Request processed in 89us (1922us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051167.001685:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7931 00000100:00100000:3.0:1777051167.001760:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955613480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452452352:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1777051167.001793:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95f659c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3678:1863365452451328:0@lo:400:kworker.0 00000100:00100000:3.0:1777051167.001829:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955610e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452451840:0@lo:400:kworker.0 00000100:00100000:3.0:1777051167.001947:0:55805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10064 00000100:00100000:3.0:1777051167.001973:0:55805:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d951fa3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3680:x1863365452452096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051167.002062:0:55805:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d951fa3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3680:x1863365452452096:12345-0@lo:400:kworker.0 Request processed in 98us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051167.002077:0:55805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10064 00000100:00100000:3.0:1777051167.510580:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94f42df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452452480:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1777051167.510680:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051167.511472:0:3679:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1777051167.511489:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d951fa1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452452608:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1777051167.511538:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051167.511618:0:8473:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452452608 00000100:00100000:3.0:1777051167.511626:0:8473:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452452608 00000100:00100000:3.0:1777051167.511694:0:8473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5469 00000100:00100000:3.0:1777051167.511712:0:8473:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da4384ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3679:x1863365452452608:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1777051167.511748:0:8473:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 430296128 pending 0 free 3645853696 avail 3414331392 00000100:00100000:3.0:1777051167.511820:0:8473:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da4384ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3679:x1863365452452608:12345-0@lo:13:osp-pre-1-1.0 Request processed in 114us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051167.511834:0:8473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5469 00000100:00100000:3.0:1777051167.511917:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d951fa1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452452608:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1777051167.512026:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d9418f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3677:1863365452452736:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1777051167.512081:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051167.512543:0:8473:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452452736 00000100:00100000:3.0:1777051167.512553:0:8473:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452452736 00000100:00100000:3.0:1777051167.512599:0:8473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5470 00000100:00100000:3.0:1777051167.512615:0:8473:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d9418f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3677:x1863365452452736:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1777051167.512637:0:8473:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 430296128 pending 0 free 3645853696 avail 3414331392 00000100:00100000:3.0:1777051167.512713:0:8473:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d9418f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3677:x1863365452452736:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (631us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051167.512727:0:8473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5470 00000100:00100000:3.0:1777051167.513077:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d9418f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3677:1863365452452736:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1777051167.655067:0:98567:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425820672 00000100:00100000:3.0:1777051167.655084:0:98567:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425820672 00000100:00100000:3.0:1777051167.655206:0:98567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 131 00000100:00100000:3.0:1777051167.655227:0:98567:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:29c4352d-3260-4734-909d-9ea5de9e7fa4+12:2437:x1863365425820672:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:3.0:1777051167.655342:0:98567:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:29c4352d-3260-4734-909d-9ea5de9e7fa4+12:2437:x1863365425820672:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 121us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051167.655381:0:98567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 131 00000100:00100000:3.0:1777051167.655491:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13005 00000100:00100000:3.0:1777051167.655512:0:6579:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f659880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+6:2437:x1863365425820928:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:3.0:1777051167.655591:0:6579:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f659880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+6:2437:x1863365425820928:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 82us (505us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051167.655607:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13005 00000100:00080000:3.0:1777051167.655810:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1777051167.655819:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1777051167.655836:0:8471:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425821056 00000100:00100000:3.0:1777051167.655843:0:8471:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425821056 00000100:00100000:3.0:1777051167.655915:0:8471:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425821184 00000100:00100000:3.0:1777051167.655922:0:8471:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425821184 00000100:00100000:3.0:1777051167.655982:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10066 00000100:00100000:3.0:1777051167.656008:0:8471:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f659500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+48:2437:x1863365425821184:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:3.0:1777051167.656076:0:8471:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f659500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+48:2437:x1863365425821184:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 74us (845us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051167.656094:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10066 00000100:00080000:3.0:1777051167.656187:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1777051167.656193:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1777051167.656241:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051167.656506:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051167.656562:0:8628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10067 00000100:00100000:3.0:1777051167.656582:0:8628:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d9418f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+50:2436:x1863365425821568:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:3.0:1777051167.657516:0:8628:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d9418f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+50:2436:x1863365425821568:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 940us (1276us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051167.657533:0:8628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10067 00000040:00080000:3.0:1777051168.028107:0:99287:0:(llog.c:858:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1777051170.427961:0:38719:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777051170.427979:0:38719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.146@tcp lock: ffff99d955a99600/0x85f51a6b96713c9f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x85f51a6b96713ca6 expref: -99 pid: 98554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051170.427998:0:38719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d955a99600 already unused, calling callback (ffffffffc1208c20) 10000000:00010000:3.0:1777051170.428013:0:38719:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.146@tcp lock: ffff99d955a99600/0x85f51a6b96713c9f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x85f51a6b96713ca6 expref: -99 pid: 98554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051170.428036:0:38719:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.146@tcp lock: ffff99d955a99600/0x85f51a6b96713c9f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x85f51a6b96713ca6 expref: -99 pid: 98554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1777051170.428052:0:38719:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.146@tcp lock: ffff99d955a99600/0x85f51a6b96713c9f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x85f51a6b96713ca6 expref: -99 pid: 98554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1777051170.428430:0:38719:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1777051170.428438:0:38719:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1777051170.428444:0:38719:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1777051170.428496:0:38719:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.146@tcp lock: ffff99d955a99600/0x85f51a6b96713c9f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x85f51a6b96713ca6 expref: -99 pid: 98554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051170.428511:0:38719:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1777051170.428560:0:38719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.146@tcp lock: ffff99d955a99600/0x85f51a6b96713c9f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x85f51a6b96713ca6 expref: -99 pid: 98554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051170.428577:0:38719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.146@tcp lock: ffff99d955a99600/0x85f51a6b96713c9f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x85f51a6b96713ca6 expref: -99 pid: 98554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051170.428605:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051170.428612:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051170.428617:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777051170.429730:0:46497:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452452992 00000100:00100000:3.0:1777051170.429741:0:46497:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452452992 00000100:00100000:3.0:1777051170.429816:0:46497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111554 00000100:00100000:3.0:1777051170.429833:0:46497:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f659c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:lustre-MDT0000-lwp-MDT0000_UUID+5:3676:x1863365452452992:12345-0@lo:39:umount.0 00000020:00000080:3.0:1777051170.429870:0:46497:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x85f51a6b96713da9 00000100:00080000:3.0:1777051170.429896:0:46497:0:(import.c:65:import_set_state_nolock()) ffff99d941e51000 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1777051170.430537:0:46497:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f659c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:lustre-MDT0000-lwp-MDT0000_UUID+1:3676:x1863365452452992:12345-0@lo:39:umount.0 Request processed in 704us (930us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051170.430555:0:46497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111554 00000020:00000080:3.0:1777051170.430571:0:46497:0:(genops.c:906:class_export_put()) final put ffff99d941e57000/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:3.0:1777051170.440537:0:38719:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777051170.440553:0:38719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.146@tcp lock: ffff99d95595aa00/0x85f51a6b96714049 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x85f51a6b96714050 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051170.440579:0:38719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d95595aa00 already unused, calling callback (ffffffffc1208c20) 10000000:00010000:3.0:1777051170.440591:0:38719:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.146@tcp lock: ffff99d95595aa00/0x85f51a6b96714049 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x85f51a6b96714050 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051170.440625:0:38719:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.146@tcp lock: ffff99d95595aa00/0x85f51a6b96714049 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x85f51a6b96714050 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1777051170.440976:0:38719:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.146@tcp lock: ffff99d95595aa00/0x85f51a6b96714049 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x85f51a6b96714050 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1777051170.441016:0:38719:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1777051170.441023:0:38719:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1777051170.441028:0:38719:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1777051170.441071:0:38719:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.146@tcp lock: ffff99d95595aa00/0x85f51a6b96714049 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x85f51a6b96714050 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051170.441094:0:38719:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1777051170.441171:0:38719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.146@tcp lock: ffff99d95595aa00/0x85f51a6b96714049 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x85f51a6b96714050 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051170.441265:0:38719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.146@tcp lock: ffff99d95595aa00/0x85f51a6b96714049 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x85f51a6b96714050 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051170.441313:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051170.441320:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051170.441329:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777051170.441363:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d9418f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3677:1863365452453504:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1777051170.441485:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051170.441575:0:3677:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1777051170.441594:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94f42c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3677:1863365452453248:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1777051170.441665:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051170.441772:0:47827:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452453504 00000100:00100000:3.0:1777051170.441785:0:47827:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452453504 00000100:00100000:3.0:1777051170.441870:0:47827:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452453248 00000100:00100000:3.0:1777051170.441880:0:47827:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452453248 00000100:00100000:3.0:1777051170.441933:0:47827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13654 00000100:00100000:3.0:1777051170.441953:0:47827:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d9418f4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:f9351a01-5b0e-4470-97fd-58b9b4b312a2+24:3677:x1863365452453504:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1777051170.441977:0:47827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777051170.442002:0:47827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d9442eb000/0x85f51a6b96714050 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x85f51a6b96714049 expref: 24 pid: 98561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051170.442031:0:47827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1777051170.442473:0:47827:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d9418f4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:f9351a01-5b0e-4470-97fd-58b9b4b312a2+23:3677:x1863365452453504:12345-0@lo:103:ldlm_bl.0 Request processed in 158us (630us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051170.442496:0:47827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13654 00000100:00100000:3.0:1777051170.442530:0:47827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13655 00000100:00100000:3.0:1777051170.442548:0:47827:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f42d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:f9351a01-5b0e-4470-97fd-58b9b4b312a2+22:3679:x1863365452453632:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1777051170.442569:0:47827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777051170.442591:0:47827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d94e48b400/0x85f51a6b96713bb1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x85f51a6b96713ba3 expref: 23 pid: 98559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051170.442612:0:47827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1777051170.442688:0:47827:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f42d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:f9351a01-5b0e-4470-97fd-58b9b4b312a2+22:3679:x1863365452453632:12345-0@lo:103:ldlm_bl.0 Request processed in 139us (1115us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051170.442718:0:47827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13655 00000100:00100000:3.0:1777051170.442762:0:47827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13657 00000100:00100000:3.0:1777051170.442779:0:47827:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f42df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:f9351a01-5b0e-4470-97fd-58b9b4b312a2+20:3679:x1863365452453376:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1777051170.442799:0:47827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777051170.442823:0:47827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99da429d7000/0x85f51a6b96713cd7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x85f51a6b96713cd0 expref: 20 pid: 98567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051170.442853:0:47827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1777051170.442924:0:47827:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f42df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:f9351a01-5b0e-4470-97fd-58b9b4b312a2+18:3679:x1863365452453376:12345-0@lo:103:ldlm_bl.0 Request processed in 147us (1202us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051170.442939:0:47827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13657 00000100:00100000:3.0:1777051170.443027:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94f42c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3677:1863365452453248:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1777051170.443049:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d9418f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3677:1863365452453504:0@lo:103:ldlm_bl.0 00000020:00080000:3.0:1777051170.458735:0:99500:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff99d9434a4800): rc 0 00000004:00000080:3.0:1777051170.458749:0:99500:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffb0894191fae0 00000100:00080000:3.0:1777051170.458782:0:99500:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1777051170.458790:0:99500:0:(client.c:3101:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1777051170.489056:0:99500:0:(pinger.c:396:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1777051170.489124:0:99500:0:(import.c:65:import_set_state_nolock()) ffff99da44f8c800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1777051170.489237:0:3676:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d9418f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3676:1863365452453760:0@lo:39:umount.0 00000100:00100000:3.0:1777051170.489329:0:3676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051170.489413:0:11727:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452453760 00000100:00100000:3.0:1777051170.489424:0:11727:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452453760 00000100:00100000:3.0:1777051170.489496:0:11727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7933 00000100:00100000:3.0:1777051170.489511:0:11727:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d9418f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3676:x1863365452453760:12345-0@lo:39:umount.0 00000020:00000080:3.0:1777051170.489554:0:11727:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x85f51a6b96713c52 00000100:00080000:3.0:1777051170.489565:0:11727:0:(import.c:65:import_set_state_nolock()) ffff99d941e67800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1777051170.489600:0:11727:0:(tgt_lastrcvd.c:732:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294970571 00000100:00100000:3.0:1777051170.490469:0:11727:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d9418f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+3:3676:x1863365452453760:12345-0@lo:39:umount.0 Request processed in 959us (1139us total) trans 4294970572 rc 0/0 00000100:00100000:3.0:1777051170.490484:0:11727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7933 00010000:00010000:3.0:1777051170.490526:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1777051170.490569:0:3676:0:(import.c:65:import_set_state_nolock()) ffff99da44f8c800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1777051170.490581:0:3676:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d9418f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3676:1863365452453760:0@lo:39:umount.0 00000100:00080000:3.0:1777051170.490820:0:99500:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1777051170.490826:0:99500:0:(client.c:3101:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968345 gen 3 00000004:00080000:3.0:1777051170.490848:0:99500:0:(osp_dev.c:1629:osp_import_event()) got inactive 00000100:00080000:3.0:1777051170.492913:0:99500:0:(pinger.c:396:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1777051170.492937:0:99500:0:(import.c:65:import_set_state_nolock()) ffff99da44f18800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1777051170.492958:0:99500:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1777051170.492962:0:99500:0:(client.c:3101:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968348 gen 3 00000004:00080000:3.0:1777051170.492975:0:99500:0:(osp_dev.c:1629:osp_import_event()) got inactive 00000100:00100000:3.0:1777051170.494619:0:3676:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d9418f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3676:1863365452453888:0@lo:9:umount.0 00000100:00100000:3.0:1777051170.494684:0:3676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051170.494753:0:55805:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452453888 00000100:00100000:3.0:1777051170.494761:0:55805:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452453888 00000100:00100000:3.0:1777051170.494830:0:55805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7930 00000100:00100000:3.0:1777051170.494845:0:55805:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d9418f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3676:x1863365452453888:12345-0@lo:9:umount.0 00000020:00000080:3.0:1777051170.494873:0:55805:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x85f51a6b96713c6e 00000100:00080000:3.0:1777051170.494884:0:55805:0:(import.c:65:import_set_state_nolock()) ffff99da42f4f800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1777051170.494942:0:55805:0:(tgt_lastrcvd.c:732:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294968345 00000100:00100000:3.0:1777051170.495151:0:55805:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d9418f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+2:3676:x1863365452453888:12345-0@lo:9:umount.0 Request processed in 308us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051170.495165:0:55805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7930 00000100:00080000:3.0:1777051170.495244:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1777051170.495264:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1777051170.495295:0:3676:0:(import.c:65:import_set_state_nolock()) ffff99da44f18800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1777051170.495308:0:3676:0:(osp_dev.c:1613:osp_import_event()) got disconnected 00000004:00080000:3.0:1777051170.495311:0:3676:0:(osp_dev.c:1629:osp_import_event()) got inactive 00000100:00100000:3.0:1777051170.495317:0:3676:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d9418f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3676:1863365452453888:0@lo:9:umount.0 00000100:00080000:3.0:1777051170.495353:0:99500:0:(pinger.c:396:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1777051170.495371:0:99500:0:(import.c:65:import_set_state_nolock()) ffff99da5f27f000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1777051170.495401:0:3676:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d9418f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3676:1863365452454016:0@lo:9:umount.0 00000100:00100000:3.0:1777051170.495447:0:3676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051170.495491:0:8471:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452454016 00000100:00100000:3.0:1777051170.495498:0:8471:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452454016 00000100:00100000:3.0:1777051170.495544:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7931 00000100:00100000:3.0:1777051170.495556:0:8471:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d9600b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3676:x1863365452454016:12345-0@lo:9:umount.0 00000020:00000080:3.0:1777051170.495578:0:8471:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x85f51a6b96713c7c 00000100:00080000:3.0:1777051170.495588:0:8471:0:(import.c:65:import_set_state_nolock()) ffff99da4622a800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1777051170.495627:0:8471:0:(tgt_lastrcvd.c:732:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294968348 00000100:00100000:3.0:1777051170.496424:0:8471:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d9600b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3676:x1863365452454016:12345-0@lo:9:umount.0 Request processed in 867us (974us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051170.496436:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7931 00000100:00080000:3.0:1777051170.496462:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1777051170.496474:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1777051170.496498:0:3676:0:(import.c:65:import_set_state_nolock()) ffff99da5f27f000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1777051170.496510:0:3676:0:(osp_dev.c:1613:osp_import_event()) got disconnected 00000004:00080000:3.0:1777051170.496513:0:3676:0:(osp_dev.c:1629:osp_import_event()) got inactive 00000100:00100000:3.0:1777051170.496519:0:3676:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d9418f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3676:1863365452454016:0@lo:9:umount.0 00000020:00080000:3.0:1777051170.496614:0:99500:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff99d94befcd40) has no exports 00000020:00000080:3.0:1777051170.758315:0:84827:0:(genops.c:865:class_export_destroy()) destroying export ffff99d9434a5000/c11b6966-0775-44d2-bdc6-c74c26eb2226 for lustre-MDT0000 00000020:00000080:3.0:1777051170.758408:0:84827:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99d9588e5000 for lustre-MDT0000 00010000:01000000:3.0:1777051170.958056:0:99500:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:3.0:1777051170.958063:0:99500:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1777051170.958067:0:99500:0:(client.c:3101:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1777051170.958075:0:99500:0:(import.c:321:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1777051170.958145:0:99500:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1777051170.958157:0:99500:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1777051170.958236:0:99500:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1777051170.958244:0:99500:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1777051170.958256:0:99500:0:(genops.c:906:class_export_put()) final put ffff99da7dbce800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1777051170.958261:0:99500:0:(genops.c:865:class_export_destroy()) destroying export ffff99da7dbce800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:3.0:1777051170.958275:0:99500:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1777051170.958400:0:99500:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x85f51a6b96713bf0 00000020:00000080:3.0:1777051170.958407:0:99500:0:(genops.c:906:class_export_put()) final put ffff99d9434a4000/lustre-MDD0000_UUID 00000020:01000000:3.0:1777051170.958425:0:99500:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:3.0:1777051170.958431:0:99500:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1777051170.958437:0:99500:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1777051170.958441:0:99500:0:(genops.c:1579:class_disconnect_exports()) OBD device 6 (ffff99d94bef8000) has no exports 00000020:00000080:3.0:1777051170.958471:0:99500:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1777051170.958477:0:99500:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:3.0:1777051170.958482:0:99500:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x85f51a6b96713bf7 00000020:00000080:3.0:1777051170.958489:0:99500:0:(genops.c:906:class_export_put()) final put ffff99d9434a2800/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1777051170.958529:0:99500:0:(tgt_mount.c:185:server_put_mount()) put mount ffff99da48b2a000 from lustre-MDT0000, refs=3 00000020:01000004:3.0:1777051170.958535:0:99500:0:(obd_mount.c:701:lustre_put_lsi()) put ffff99da48b2a000 3 00000020:01000004:3.0:1777051170.958540:0:99500:0:(tgt_mount.c:118:server_deregister_mount()) deregister mount ffff99da48b2a000 from lustre-MDT0000 00000020:00000080:3.0:1777051170.958574:0:99500:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1777051170.958581:0:99500:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:3.0:1777051170.958585:0:99500:0:(genops.c:906:class_export_put()) final put ffff99da5f282800/lustre-MDT0000_UUID 00000020:00000080:3.0:1777051170.958589:0:99500:0:(genops.c:865:class_export_destroy()) destroying export ffff99da5f282800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:3.0:1777051170.958601:0:99500:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:3.0:1777051170.958656:0:99500:0:(obd_mount.c:569:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:3.0:1777051170.958661:0:99500:0:(tgt_mount.c:253:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:3.0:1777051170.958665:0:99500:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:3.0:1777051170.958669:0:99500:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1777051170.958673:0:99500:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 2/5 00000020:00080000:3.0:1777051170.958973:0:99500:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff99da7dbcf800 f9351a01-5b0e-4470-97fd-58b9b4b312a2 0@lo 17 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1777051170.958985:0:99500:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff99da4875b800 29c4352d-3260-4734-909d-9ea5de9e7fa4 192.168.201.46@tcp 11 (0 0 7) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1777051170.958992:0:99500:0:(genops.c:1574:class_disconnect_exports()) OBD device 1 (ffff99da7ffccd40) has exports, disconnecting them 00000020:00080000:3.0:1777051170.958999:0:99500:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff99da7dbcf800), last request at 1777051130 00000020:00000080:3.0:1777051170.959022:0:99500:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x85f51a6b96713b9c 00000020:00010000:3.0:1777051170.959028:0:99500:0:(genops.c:1942:obd_stale_export_put()) Put export ffff99da7dbcf800: total 0 00000100:00080000:3.0:1777051170.959034:0:99500:0:(import.c:65:import_set_state_nolock()) ffff99da7dbcd000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1777051170.959084:0:99500:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff99da7dbcf800): rc 0 00000020:00080000:3.0:1777051170.959112:0:99500:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 192.168.201.46@tcp (ffff99da4875b800), last request at 1777051122 00000020:00000080:3.0:1777051170.965742:0:48457:0:(genops.c:865:class_export_destroy()) destroying export ffff99da48b2a800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1777051170.965983:0:48457:0:(genops.c:865:class_export_destroy()) destroying export ffff99d942dfa800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:3.0:1777051170.967356:0:99500:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:3.0:1777051170.967364:0:99500:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1777051170.967370:0:99500:0:(client.c:3101:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1777051170.967377:0:99500:0:(import.c:321:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1777051170.967662:0:99500:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1777051170.967690:0:99500:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:3.0:1777051170.967697:0:99500:0:(genops.c:906:class_export_put()) final put ffff99da57aea800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1777051170.967702:0:99500:0:(genops.c:865:class_export_destroy()) destroying export ffff99da57aea800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:3.0:1777051170.967710:0:99500:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:3.0:1777051170.967841:0:99500:0:(obd_mount.c:701:lustre_put_lsi()) put ffff99da48b2a000 1 00000020:00000080:3.0:1777051170.967848:0:99500:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x85f51a6b96713b4f 00000020:00000080:3.0:1777051170.967856:0:99500:0:(genops.c:906:class_export_put()) final put ffff99da4a59e000/lustre-MDT0000-osd_UUID 00000020:01000000:3.0:1777051170.967874:0:99500:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:3.0:1777051170.967881:0:99500:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1777051170.967889:0:99500:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1777051170.967894:0:99500:0:(genops.c:1579:class_disconnect_exports()) OBD device 0 (ffff99d941ce0000) has no exports 00000100:00100000:3.0:1777051172.122585:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d9600bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3680:1863365452454656:0@lo:400:kworker.0 00000100:00100000:3.0:1777051172.122878:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051172.122934:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d9418f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3680:1863365452455168:0@lo:400:kworker.0 00000100:00100000:3.0:1777051172.123329:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051172.123460:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d9600baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3677:1863365452454272:0@lo:400:kworker.0 00000400:00000100:3.0:1777051172.123514:0:3677:0:(lib-move.c:4517:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1863365452454272 offset 0 length 224: 4 00000100:00100000:3.0:1777051172.123569:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d9600b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3677:1863365452454784:0@lo:400:kworker.0 00000100:00100000:3.0:1777051172.123973:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051172.124037:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d9418f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452455296:0@lo:400:kworker.0 00000100:00100000:3.0:1777051172.125623:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051172.126299:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d9600b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3677:1863365452454784:0@lo:400:kworker.0 00000100:00100000:3.0:1777051172.126322:0:3677:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1777051172.126335:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d9600b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452454400:0@lo:400:kworker.0 00000100:00100000:3.0:1777051172.126374:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051172.126407:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d9600b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452454912:0@lo:400:kworker.0 00000100:00100000:3.0:1777051172.126446:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051172.126607:0:8470:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452455296 00000100:00100000:3.0:1777051172.126614:0:8470:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452455296 00000100:00100000:3.0:1777051172.126898:0:8470:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452454912 00000100:00100000:3.0:1777051172.126905:0:8470:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452454912 00000100:00100000:3.0:1777051172.126947:0:8470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10069 00000100:00100000:3.0:1777051172.126961:0:8470:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da44494380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3677:x1863365452455296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051172.127026:0:8470:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da44494380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3677:x1863365452455296:12345-0@lo:400:kworker.0 Request processed in 68us (1405us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051172.127039:0:8470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10069 00000100:00100000:3.0:1777051172.127060:0:8470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10070 00000100:00100000:3.0:1777051172.127401:0:8470:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da44497b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3677:x1863365452454912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051172.127456:0:8470:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da44497b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3677:x1863365452454912:12345-0@lo:400:kworker.0 Request processed in 387us (1009us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051172.127468:0:8470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10070 00000100:00080000:3.0:1777051172.127562:0:3679:0:(recover.c:203:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1777051172.127568:0:3679:0:(import.c:65:import_set_state_nolock()) ffff99da7fa93000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1777051172.127574:0:3679:0:(import.c:181:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1777051172.127581:0:3679:0:(import.c:65:import_set_state_nolock()) ffff99da7fa93000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1777051172.127586:0:3679:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 7765 00000100:00080000:3.0:1777051172.127593:0:3679:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff99da7fa93000 using connection 192.168.201.146@tcp/0@lo 00000100:00100000:3.0:1777051172.127619:0:3679:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99da44495f80 x1863365452455552/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1777051172.127662:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d9600b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3679:1863365452454528:0@lo:400:kworker.0 00000100:00080000:3.0:1777051172.128031:0:3679:0:(recover.c:203:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1777051172.128036:0:3679:0:(import.c:65:import_set_state_nolock()) ffff99da5f282000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1777051172.128415:0:3679:0:(import.c:181:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1777051172.128421:0:3679:0:(import.c:65:import_set_state_nolock()) ffff99da5f282000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1777051172.128427:0:3679:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 7765 00000100:00080000:3.0:1777051172.128434:0:3679:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff99da5f282000 using connection 192.168.201.146@tcp/0@lo 00000100:00100000:3.0:1777051172.128458:0:3679:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99da44496680 x1863365452455680/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1777051172.128478:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d9600b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3679:1863365452455040:0@lo:400:kworker.0 00000100:02020000:3.0:1777051172.128500:0:3679:0:(client.c:1490:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00080000:3.0:1777051172.128516:0:3679:0:(recover.c:203:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1777051172.128521:0:3679:0:(import.c:213:ptlrpc_set_import_discon()) osp: import ffff99da7dbeb000 already not connected (conn 30, was 29): CONNECTING 00000100:00080000:3.0:1777051172.129457:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1777051172.129465:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1777051172.129516:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d9600b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452454912:0@lo:400:kworker.0 00000100:00100000:3.0:1777051172.129539:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d9418f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452455296:0@lo:400:kworker.0 00000100:00100000:3.0:1777051172.129584:0:3676:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da44495f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3676:1863365452455552:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:3.0:1777051172.129628:0:3676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051172.129657:0:3676:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da44496680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3676:1863365452455680:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:3.0:1777051172.130153:0:3676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051172.130707:0:6579:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452455552 00000100:00100000:3.0:1777051172.130715:0:6579:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452455552 00000100:00100000:3.0:1777051172.130748:0:6579:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452455680 00000100:00100000:3.0:1777051172.130752:0:6579:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452455680 00000100:00100000:3.0:1777051172.130774:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111558 00000100:00100000:3.0:1777051172.130782:0:6579:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d9418f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3676:x1863365452455552:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:3.0:1777051172.130806:0:6579:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1777051172.130866:0:6579:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d9418f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3676:x1863365452455552:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 81us (1236us total) trans 0 rc -19/-19 00000100:00100000:3.0:1777051172.130879:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111558 00000100:00100000:3.0:1777051172.130900:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111559 00000100:00100000:3.0:1777051172.130907:0:6579:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d9600b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3676:x1863365452455680:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:3.0:1777051172.130924:0:6579:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1777051172.130957:0:6579:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d9600b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3676:x1863365452455680:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 48us (804us total) trans 0 rc -19/-19 00000100:00100000:3.0:1777051172.130967:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111559 00000100:00080000:3.0:1777051172.131003:0:3676:0:(import.c:65:import_set_state_nolock()) ffff99da7fa93000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1777051172.131011:0:3676:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1777051172.131016:0:3676:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da44495f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3676:1863365452455552:0@lo:38:ptlrpcd_00_02.0 00000100:00080000:3.0:1777051172.131377:0:3676:0:(import.c:65:import_set_state_nolock()) ffff99da5f282000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1777051172.131385:0:3676:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1777051172.131390:0:3676:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da44496680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3676:1863365452455680:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:3.0:1777051172.247145:0:10328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111560 00000100:00100000:3.0:1777051172.247171:0:10328:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f42e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3676:x1863365452455808:12345-0@lo:38:ptlrpcd_00_03.0 00010000:00020000:3.0:1777051172.247207:0:10328:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1777051172.247312:0:10328:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f42e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3676:x1863365452455808:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 138us (2130us total) trans 0 rc -19/-19 00000100:00100000:3.0:1777051172.247333:0:10328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111560 00000100:00100000:3.0:1777051172.632623:0:8473:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452455936 00000100:00100000:3.0:1777051172.632637:0:8473:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452455936 00000100:00100000:3.0:1777051172.632744:0:8473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5472 00000100:00100000:3.0:1777051172.632764:0:8473:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f42c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3678:x1863365452455936:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1777051172.632811:0:8473:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 430296128 pending 0 free 3645853696 avail 3414331392 00000100:00100000:3.0:1777051172.632886:0:8473:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f42c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3678:x1863365452455936:12345-0@lo:13:osp-pre-1-1.0 Request processed in 130us (780us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051172.632896:0:8473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5472 00000400:00000100:3.0:1777051172.770952:0:3672:0:(lib-move.c:4517:lnet_parse_put()) Dropping PUT from 12345-192.168.201.46@tcp portal 26 match 1863365425821824 offset 0 length 224: 4 00000100:00100000:3.0:1777051172.771473:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051172.775676:0:8628:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425822208 00000100:00100000:3.0:1777051172.775691:0:8628:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425822208 00000100:00100000:3.0:1777051172.775832:0:8628:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425822720 00000100:00100000:3.0:1777051172.775865:0:8628:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425822720 00000100:00100000:3.0:1777051172.775953:0:8628:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425822336 00000100:00100000:3.0:1777051172.775969:0:8628:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425822336 00000100:00100000:3.0:1777051172.776041:0:8628:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425822848 00000100:00100000:3.0:1777051172.776057:0:8628:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425822848 00000100:00080000:3.0:1777051172.776782:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1777051172.776793:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1777051172.776809:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1777051172.814453:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051173.142768:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955613480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452456064:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1777051173.142890:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051173.146003:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955613480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452456064:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1777051173.976259:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1777051175.709906:0:8464:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1777051175.709914:0:8464:0:(genops.c:906:class_export_put()) final put ffff99da42f48800/lustre-MDT0000-mdtlov_UUID 00010000:00010000:3.0:1777051177.046607:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777051177.246923:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955504000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3677:1863365452456704:0@lo:400:kworker.0 00000100:00100000:3.0:1777051177.248535:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051177.248701:0:6581:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452456704 00000100:00100000:3.0:1777051177.248716:0:6581:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452456704 00000100:00100000:3.0:1777051177.248822:0:6581:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452456448 00000100:00100000:3.0:1777051177.248833:0:6581:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452456448 00000100:00100000:3.0:1777051177.248881:0:6581:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452456576 00000100:00100000:3.0:1777051177.248893:0:6581:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452456576 00000100:00100000:3.0:1777051177.248936:0:6581:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452456960 00000100:00100000:3.0:1777051177.248943:0:6581:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452456960 00000100:00100000:3.0:1777051177.249046:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13013 00000100:00100000:3.0:1777051177.249068:0:6581:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955505c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3680:x1863365452457088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051177.251675:0:6581:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955505c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3680:x1863365452457088:12345-0@lo:400:kworker.0 Request processed in 2612us (2972us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051177.251693:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13013 00000100:00100000:3.0:1777051177.251733:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111566 00000100:00100000:3.0:1777051177.251750:0:6581:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da444a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3676:x1863365452456576:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1777051177.251775:0:6581:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1777051177.251866:0:6581:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da444a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3676:x1863365452456576:12345-0@lo:38:kworker.0 Request processed in 111us (3103us total) trans 0 rc -19/-19 00000100:00100000:3.0:1777051177.251890:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111566 00000100:00080000:3.0:1777051177.251941:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1777051177.251952:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1777051177.251957:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1777051177.252050:0:8628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10076 00000100:00100000:3.0:1777051177.252075:0:8628:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955613480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3678:x1863365452456832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051177.252163:0:8628:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955613480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3678:x1863365452456832:12345-0@lo:400:kworker.0 Request processed in 94us (3430us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051177.252177:0:8628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10076 00000100:00080000:3.0:1777051177.252646:0:3676:0:(import.c:65:import_set_state_nolock()) ffff99da7fa93000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1777051177.252659:0:3676:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1777051177.252670:0:3676:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d944d2a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3676:1863365452456448:0@lo:38:kworker.0 00000100:00080000:3.0:1777051177.252696:0:3676:0:(import.c:65:import_set_state_nolock()) ffff99d94183b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1777051177.252703:0:3676:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1777051177.252708:0:3676:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955505880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3676:1863365452456576:0@lo:38:kworker.0 00000100:00080000:3.0:1777051177.252719:0:3676:0:(import.c:65:import_set_state_nolock()) ffff99da5f282000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1777051177.252723:0:3676:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1777051177.252727:0:3676:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955507800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3676:1863365452456960:0@lo:38:kworker.0 00000100:00080000:3.0:1777051177.254619:0:3676:0:(import.c:65:import_set_state_nolock()) ffff99da7dbeb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1777051177.254631:0:3676:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1777051177.254640:0:3676:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d944d28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3676:1863365452456320:0@lo:38:kworker.0 00000100:00100000:3.0:1777051177.890299:0:27884:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425823616 00000100:00100000:3.0:1777051177.890319:0:27884:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425823616 00000100:00100000:3.0:1777051177.890433:0:27884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10077 00000100:00100000:3.0:1777051177.890461:0:27884:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da444a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+50:2439:x1863365425823616:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:3.0:1777051177.890624:0:27884:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da444a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+50:2439:x1863365425823616:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 163us (537us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051177.890655:0:27884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10077 00000100:00100000:3.0:1777051177.890701:0:27884:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425824256 00000100:00100000:3.0:1777051177.890711:0:27884:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425824256 00000100:00100000:3.0:1777051177.890769:0:27884:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425823744 00000100:00100000:3.0:1777051177.890777:0:27884:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425823744 00000100:00100000:3.0:1777051177.890804:0:27884:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425824128 00000100:00100000:3.0:1777051177.890811:0:27884:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425824128 00000100:00100000:3.0:1777051177.890876:0:27884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10078 00000100:00100000:3.0:1777051177.890905:0:27884:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da444a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+47:2439:x1863365425824256:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:3.0:1777051177.891035:0:27884:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da444a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+47:2439:x1863365425824256:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 135us (536us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051177.893155:0:27884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10078 00010000:00010000:3.0:1777051178.070540:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051181.142552:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777051182.362041:0:3676:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94f169180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3676:1863365452457728:0@lo:38:kworker.0 00000100:00100000:3.0:1777051182.362489:0:3676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051182.362534:0:3676:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f298380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3676:1863365452457856:0@lo:38:kworker.0 00000100:00100000:3.0:1777051182.362583:0:3676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051182.362622:0:3676:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f299880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3676:1863365452457984:0@lo:38:kworker.0 00000100:00100000:3.0:1777051182.362702:0:3676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051182.362739:0:3676:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f298a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3676:1863365452458368:0@lo:38:kworker.0 00000100:00100000:3.0:1777051182.363130:0:3676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051182.363254:0:46500:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452457728 00000100:00100000:3.0:1777051182.363263:0:46500:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452457728 00000100:00100000:3.0:1777051182.364418:0:46500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7938 00000100:00100000:3.0:1777051182.364429:0:46500:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d9600bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:0+-99:3676:x1863365452457728:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1777051182.364463:0:46500:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1777051182.364538:0:46500:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d9600bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:0+-99:3676:x1863365452457728:12345-0@lo:38:kworker.0 Request processed in 106us (2050us total) trans 0 rc -19/-19 00000100:00100000:3.0:1777051182.364552:0:46500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7938 00000100:00080000:3.0:1777051182.364612:0:3676:0:(import.c:65:import_set_state_nolock()) ffff99da7dbeb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1777051182.364622:0:3676:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1777051182.364629:0:3676:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94f169180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3676:1863365452457728:0@lo:38:kworker.0 00000100:00080000:3.0:1777051182.364680:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1777051182.368644:0:21368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111572 00000100:00100000:3.0:1777051182.368665:0:21368:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da44496680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3676:x1863365452458368:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1777051182.369022:0:21368:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1777051182.369093:0:21368:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da44496680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3676:x1863365452458368:12345-0@lo:38:kworker.0 Request processed in 430us (5960us total) trans 0 rc -19/-19 00000100:00100000:3.0:1777051182.369111:0:21368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111572 00000100:00080000:3.0:1777051182.369191:0:3676:0:(import.c:65:import_set_state_nolock()) ffff99da7fa93000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1777051182.369269:0:3676:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1777051182.369277:0:3676:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f298380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3676:1863365452457856:0@lo:38:kworker.0 00000100:00080000:3.0:1777051182.369301:0:3676:0:(import.c:65:import_set_state_nolock()) ffff99d94183b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1777051182.369309:0:3676:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1777051182.369315:0:3676:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f299880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3676:1863365452457984:0@lo:38:kworker.0 00000100:00080000:3.0:1777051182.369331:0:3676:0:(import.c:65:import_set_state_nolock()) ffff99da5f282000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1777051182.369337:0:3676:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1777051182.369343:0:3676:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f298a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3676:1863365452458368:0@lo:38:kworker.0 00000100:00100000:3.0:1777051183.019698:0:8468:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425825280 00000100:00100000:3.0:1777051183.019715:0:8468:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425825280 00000100:00100000:3.0:1777051183.020458:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10083 00000100:00100000:3.0:1777051183.020489:0:8468:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da444a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+50:2437:x1863365425825280:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:3.0:1777051183.020593:0:8468:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da444a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+50:2437:x1863365425825280:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 118us (2959us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051183.020634:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10083 00000100:00100000:3.0:1777051183.021629:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10086 00000100:00100000:3.0:1777051183.021664:0:8468:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95fae9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+47:2437:x1863365425825408:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:3.0:1777051183.021758:0:8468:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95fae9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+47:2437:x1863365425825408:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 106us (2807us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051183.021789:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10086 00000100:00080000:3.0:1777051183.021881:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1777051183.021927:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1777051183.021940:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1777051183.022035:0:27882:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425824512 00000100:00100000:3.0:1777051183.022047:0:27882:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425824512 00000100:00100000:3.0:1777051183.022551:0:27882:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425825024 00000100:00100000:3.0:1777051183.022566:0:27882:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425825024 00000100:00100000:3.0:1777051183.022630:0:27882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111573 00000100:00100000:3.0:1777051183.022653:0:27882:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94c128380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0+-99:2435:x1863365425824512:12345-192.168.201.46@tcp:38:kworker.0 00010000:00020000:3.0:1777051183.022705:0:27882:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.201.46@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1777051183.022796:0:27882:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94c128380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0+-99:2435:x1863365425824512:12345-192.168.201.46@tcp:38:kworker.0 Request processed in 154us (839us total) trans 0 rc -19/-19 00000100:00100000:3.0:1777051183.022831:0:27882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111573 00000100:00100000:3.0:1777051183.382683:0:8472:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452458880 00000100:00100000:3.0:1777051183.382696:0:8472:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452458880 00000100:00100000:3.0:1777051183.382796:0:8472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5477 00000100:00100000:3.0:1777051183.382817:0:8472:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f298a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3678:x1863365452458880:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1777051183.383342:0:8472:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 440355904 pending 0 free 3862671360 avail 3631149056 00000100:00100000:3.0:1777051183.383417:0:8472:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f298a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3678:x1863365452458880:12345-0@lo:13:osp-pre-0-1.0 Request processed in 605us (864us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051183.383432:0:8472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5477 00000100:00100000:3.0:1777051183.383681:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94c129c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452458880:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1777051186.271792:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777051187.479114:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955507480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3678:1863365452459008:0@lo:400:kworker.0 00000400:00000100:3.0:1777051187.479194:0:3678:0:(lib-move.c:4517:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1863365452459008 offset 0 length 224: 4 00000100:00100000:3.0:1777051187.482489:0:3676:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955504700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3676:1863365452459136:0@lo:38:kworker.0 00000100:00100000:3.0:1777051187.482575:0:3676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051187.482607:0:3676:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955506a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3676:1863365452459264:0@lo:38:kworker.0 00000100:00100000:3.0:1777051187.483044:0:3676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051187.483081:0:3676:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955505500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3676:1863365452459392:0@lo:38:kworker.0 00000100:00100000:3.0:1777051187.483127:0:3676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051187.483165:0:3676:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955505880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3676:1863365452459776:0@lo:38:kworker.0 00000100:00100000:3.0:1777051187.483254:0:3676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051187.483301:0:6579:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452459264 00000100:00100000:3.0:1777051187.483310:0:6579:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452459264 00000100:00100000:3.0:1777051187.483347:0:6579:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452459392 00000100:00100000:3.0:1777051187.483350:0:6579:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452459392 00000100:00100000:3.0:1777051187.483392:0:6579:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452459776 00000100:00100000:3.0:1777051187.483396:0:6579:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452459776 00000100:00100000:3.0:1777051187.483431:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111575 00000100:00100000:3.0:1777051187.483441:0:6579:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94c129c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3676:x1863365452459264:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1777051187.483475:0:6579:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1777051187.483553:0:6579:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94c129c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3676:x1863365452459264:12345-0@lo:38:kworker.0 Request processed in 109us (509us total) trans 0 rc -19/-19 00000100:00100000:3.0:1777051187.483567:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111575 00000100:00100000:3.0:1777051187.483621:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111576 00000100:00100000:3.0:1777051187.483627:0:6579:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f169180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3676:x1863365452459392:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1777051187.483644:0:6579:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1777051187.483699:0:6579:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f169180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3676:x1863365452459392:12345-0@lo:38:kworker.0 Request processed in 67us (570us total) trans 0 rc -19/-19 00000100:00100000:3.0:1777051187.483712:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111576 00000100:00100000:3.0:1777051187.484061:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111577 00000100:00100000:3.0:1777051187.484072:0:6579:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d960409c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3676:x1863365452459776:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1777051187.484094:0:6579:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1777051187.484147:0:6579:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d960409c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3676:x1863365452459776:12345-0@lo:38:kworker.0 Request processed in 73us (891us total) trans 0 rc -19/-19 00000100:00100000:3.0:1777051187.484159:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111577 00000100:00080000:3.0:1777051187.484288:0:3676:0:(import.c:65:import_set_state_nolock()) ffff99da7fa93000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1777051187.484297:0:3676:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1777051187.484304:0:3676:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955506a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3676:1863365452459264:0@lo:38:kworker.0 00000100:00080000:3.0:1777051187.484322:0:3676:0:(import.c:65:import_set_state_nolock()) ffff99d94183b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1777051187.484328:0:3676:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1777051187.484334:0:3676:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955505500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3676:1863365452459392:0@lo:38:kworker.0 00000100:00080000:3.0:1777051187.484347:0:3676:0:(import.c:65:import_set_state_nolock()) ffff99da5f282000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1777051187.484353:0:3676:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1777051187.484360:0:3676:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955505880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3676:1863365452459776:0@lo:38:kworker.0 00000100:00100000:3.0:1777051187.484416:0:3678:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1777051187.484433:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955506d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3678:1863365452459904:0@lo:400:kworker.0 00000100:00100000:3.0:1777051187.484483:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051187.484525:0:8492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452459904 00000100:00100000:3.0:1777051187.484531:0:8492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452459904 00000100:00100000:3.0:1777051187.484599:0:8492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13020 00000100:00100000:3.0:1777051187.484614:0:8492:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d960408e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3678:x1863365452459904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051187.486960:0:8492:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d960408e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3678:x1863365452459904:12345-0@lo:400:kworker.0 Request processed in 2348us (2474us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051187.486973:0:8492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13020 00000100:00080000:3.0:1777051187.487010:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1777051187.487018:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1777051187.487047:0:3676:0:(import.c:65:import_set_state_nolock()) ffff99da7dbeb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1777051187.487055:0:3676:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1777051187.487061:0:3676:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955504700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3676:1863365452459136:0@lo:38:kworker.0 00000100:00100000:3.0:1777051187.487101:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955506d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3678:1863365452459904:0@lo:400:kworker.0 00000100:00100000:3.0:1777051187.992266:0:8473:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452460160 00000100:00100000:3.0:1777051187.992281:0:8473:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452460160 00000100:00100000:3.0:1777051187.992366:0:8473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5478 00000100:00100000:3.0:1777051187.992384:0:8473:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f299880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3680:x1863365452460160:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1777051187.992429:0:8473:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 430296128 pending 0 free 3645853696 avail 3414331392 00000100:00100000:3.0:1777051187.992525:0:8473:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f299880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3680:x1863365452460160:12345-0@lo:13:osp-pre-1-1.0 Request processed in 144us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051187.992538:0:8473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5478 00000040:00080000:3.0:1777051188.503409:0:99289:0:(llog.c:801:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1777051188.503419:0:99289:0:(llog_cat.c:158:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1777051188.505297:0:99289:0:(llog.c:858:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:3.0:1777051188.505318:0:99289:0:(llog.c:858:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000020:01000004:3.0:1777051189.247919:0:99922:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:3.0:1777051189.247944:0:99922:0:(obd_mount.c:917:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:3.0:1777051189.247947:0:99922:0:(obd_mount.c:920:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1777051189.248168:0:99922:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff99d958727800 00000020:01000004:3.0:1777051189.248190:0:99922:0:(tgt_mount.c:2453:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:3.0:1777051189.248244:0:99922:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1777051189.248263:0:99922:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff99d941e68000) 00000020:00000080:3.0:1777051189.248288:0:99922:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1777051189.410622:0:99922:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:3.0:1777051189.411521:0:99922:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:3.0:1777051189.413321:0:99922:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:3.0:1777051189.419582:0:99922:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:3.0:1777051189.422544:0:99922:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:3.0:1777051189.423719:0:99922:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:3.0:1777051189.424884:0:99922:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:3.0:1777051189.425424:0:99922:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:3.0:1777051189.425958:0:99922:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:01000000:3.0:1777051189.427660:0:99922:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1777051189.428029:0:99922:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1777051189.428039:0:99922:0:(osd_handler.c:8912:osd_obd_connect()) connect #0 00000020:00000080:3.0:1777051189.428050:0:99922:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x85f51a6b96714088 00000020:01000004:3.0:1777051189.428057:0:99922:0:(tgt_mount.c:2538:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:3.0:1777051189.428075:0:99922:0:(tgt_mount.c:217:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1777051189.428083:0:99922:0:(tgt_mount.c:99:server_register_mount()) register mount ffff99d958727800 from MGS 00000020:01000004:3.0:1777051189.428090:0:99922:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1777051189.428106:0:99922:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff99d941e699c0) 00000020:00000080:3.0:1777051189.428130:0:99922:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1777051189.428246:0:99922:0:(tgt_mount.c:151:server_get_mount()) get mount ffff99d958727800 from MGS, refs=2 00080000:01000000:3.0:1777051189.428253:0:99922:0:(osd_handler.c:8912:osd_obd_connect()) connect #1 00000020:00000080:3.0:1777051189.428260:0:99922:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x85f51a6b96714096 00010000:00010000:3.0:1777051189.428421:0:99922:0:(ldlm_pool.c:924:ldlm_pool_init()) Lock pool ldlm-pool-MGS-3 is initialized 20000000:01000000:3.0:1777051189.442752:0:99922:0:(mgs_nids.c:664:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1777051189.442849:0:99922:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1777051189.443922:0:99922:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1777051189.446416:0:99922:0:(service.c:153:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1777051189.446750:0:99922:0:(service.c:3441:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1777051189.446764:0:99922:0:(service.c:3500:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1777051189.449084:0:99922:0:(service.c:3441:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1777051189.449099:0:99922:0:(service.c:3500:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00010000:00010000:3.0:1777051190.359047:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777051193.112917:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955504000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452461312:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1777051193.253080:0:8492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111584 00000100:00100000:3.0:1777051193.253092:0:8492:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d943d91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2435:x1863365425827328:12345-192.168.201.46@tcp:38:kworker.0 00010000:00020000:3.0:1777051193.253112:0:8492:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.201.46@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1777051193.253240:0:8492:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d943d91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2435:x1863365425827328:12345-192.168.201.46@tcp:38:kworker.0 Request processed in 104us (1615us total) trans 0 rc -19/-19 00000100:00100000:3.0:1777051193.253255:0:8492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111584 00000100:00080000:3.0:1777051193.254563:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1777051193.254577:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1777051193.254584:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1777051193.254887:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1777051193.254935:0:27887:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425827200 00000100:00100000:3.0:1777051193.254947:0:27887:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425827200 00000100:00100000:3.0:1777051193.255027:0:27887:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425827584 00000100:00100000:3.0:1777051193.255037:0:27887:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425827584 00000100:00100000:3.0:1777051193.255116:0:27887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10096 00000100:00100000:3.0:1777051193.255143:0:27887:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955506d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+50:2436:x1863365425827584:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:3.0:1777051193.255988:0:27887:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955506d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+50:2436:x1863365425827584:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 850us (1067us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051193.256005:0:27887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10096 00000100:00100000:3.0:1777051193.622663:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95f97c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3680:1863365452461440:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1777051193.622785:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1777051193.623423:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1777051193.623448:0:46500:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452461568 00000100:00100000:3.0:1777051193.623454:0:46500:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452461568 00000100:00100000:3.0:1777051193.623513:0:46500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7941 00000100:00100000:3.0:1777051193.623522:0:46500:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95fae9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:0+-99:3676:x1863365452461568:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1777051193.623548:0:46500:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1777051193.623812:0:46500:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95fae9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:0+-99:3676:x1863365452461568:12345-0@lo:38:kworker.0 Request processed in 286us (461us total) trans 0 rc -19/-19 00000100:00100000:3.0:1777051193.623829:0:46500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7941 00000100:00100000:3.0:1777051193.623934:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95f97c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3680:1863365452461440:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1777051193.623990:0:8492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452461696 00000100:00100000:3.0:1777051193.623998:0:8492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452461696 00000100:00100000:3.0:1777051193.624042:0:8492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452461952 00000100:00100000:3.0:1777051193.624050:0:8492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452461952 00000100:00100000:3.0:1777051193.624716:0:8492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13028 00000100:00100000:3.0:1777051193.624759:0:8492:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f51aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3677:x1863365452461952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051193.624983:0:8492:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f51aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3677:x1863365452461952:12345-0@lo:400:kworker.0 Request processed in 252us (1074us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051193.624997:0:8492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13028 00000100:00100000:3.0:1777051193.625040:0:8492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111586 00000100:00100000:3.0:1777051193.625058:0:8492:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95fae8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3676:x1863365452461824:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1777051193.625093:0:8492:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1777051193.625421:0:8492:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95fae8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3676:x1863365452461824:12345-0@lo:38:kworker.0 Request processed in 362us (1593us total) trans 0 rc -19/-19 00000100:00100000:3.0:1777051193.625553:0:8492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111586 00010000:00010000:3.0:1777051194.455581:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777051198.231696:0:8473:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452462336 00000100:00100000:3.0:1777051198.231709:0:8473:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452462336 00000100:00100000:3.0:1777051198.231807:0:8473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5482 00000100:00100000:3.0:1777051198.231825:0:8473:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f97ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3679:x1863365452462336:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1777051198.231866:0:8473:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 430296128 pending 0 free 3645853696 avail 3414331392 00000100:00100000:3.0:1777051198.231972:0:8473:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f97ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3679:x1863365452462336:12345-0@lo:13:osp-pre-1-1.0 Request processed in 149us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051198.231987:0:8473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5482 00000100:00100000:3.0:1777051198.372348:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051198.372438:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051198.372585:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051198.373020:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051198.375751:0:8468:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425828736 00000100:00100000:3.0:1777051198.375763:0:8468:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425828736 00000100:00100000:3.0:1777051198.377060:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10100 00000100:00100000:3.0:1777051198.377081:0:8468:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95088bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+47:2436:x1863365425828864:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:3.0:1777051198.377148:0:8468:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95088bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+47:2436:x1863365425828864:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 71us (1333us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051198.377168:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10100 00010000:00010000:3.0:1777051198.550488:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777051198.745266:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94f518700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3680:1863365452462848:0@lo:400:kworker.0 00000100:00100000:3.0:1777051198.745345:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051198.745465:0:8492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452462848 00000100:00100000:3.0:1777051198.745490:0:8492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452462848 00000100:00100000:3.0:1777051198.745606:0:8492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452462592 00000100:00100000:3.0:1777051198.745616:0:8492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452462592 00000100:00100000:3.0:1777051198.745694:0:8492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452462720 00000100:00100000:3.0:1777051198.745702:0:8492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452462720 00000100:00100000:3.0:1777051198.748000:0:8492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452463104 00000100:00100000:3.0:1777051198.748011:0:8492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452463104 00000100:00100000:3.0:1777051198.748071:0:8492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13032 00000100:00100000:3.0:1777051198.748088:0:8492:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da45f76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3680:x1863365452462848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051198.748194:0:8492:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da45f76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3680:x1863365452462848:12345-0@lo:400:kworker.0 Request processed in 105us (2844us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051198.748210:0:8492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13032 00000100:00100000:3.0:1777051198.748243:0:8492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111590 00000100:00100000:3.0:1777051198.748275:0:8492:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95faead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3676:x1863365452462592:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1777051198.748306:0:8492:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1777051198.748332:0:27887:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452462976 00000100:00100000:3.0:1777051198.748339:0:27887:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452462976 00000100:00100000:3.0:1777051198.748410:0:27887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10101 00000100:00100000:3.0:1777051198.748430:0:27887:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fdf1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3677:x1863365452462976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051198.748515:0:27887:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fdf1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3677:x1863365452462976:12345-0@lo:400:kworker.0 Request processed in 90us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051198.748531:0:27887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10101 00000100:00100000:3.0:1777051198.748574:0:27885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111592 00000100:00100000:3.0:1777051198.748583:0:27885:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95fae8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:0+-99:3676:x1863365452463104:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1777051198.748601:0:27885:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1777051198.748680:0:27885:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95fae8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:0+-99:3676:x1863365452463104:12345-0@lo:38:kworker.0 Request processed in 61us (2939us total) trans 0 rc -19/-19 00000100:00100000:3.0:1777051198.748691:0:27885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111592 00000100:00100000:3.0:1777051198.748766:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94f518700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3680:1863365452462848:0@lo:400:kworker.0 00000100:00100000:3.0:1777051198.748875:0:8492:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95faead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3676:x1863365452462592:12345-0@lo:38:kworker.0 Request processed in 599us (3394us total) trans 0 rc -19/-19 00000100:00100000:3.0:1777051198.748887:0:8492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111590 00000040:00080000:3.0:1777051198.749053:0:99289:0:(llog.c:801:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1777051198.749061:0:99289:0:(llog_cat.c:158:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1777051198.749934:0:99289:0:(llog.c:858:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:3.0:1777051198.749949:0:99289:0:(llog.c:858:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1777051198.750447:0:8472:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452463488 00000100:00100000:3.0:1777051198.750453:0:8472:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452463488 00000100:00100000:3.0:1777051198.750493:0:8472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5483 00000100:00100000:3.0:1777051198.750503:0:8472:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fd61180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3679:x1863365452463488:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1777051198.750532:0:8472:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 440355904 pending 0 free 3862671360 avail 3631149056 00000100:00100000:3.0:1777051198.750595:0:8472:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fd61180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3679:x1863365452463488:12345-0@lo:13:osp-pre-0-1.0 Request processed in 91us (2565us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051198.750607:0:8472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5483 00000100:00100000:3.0:1777051198.750732:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7fd62680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452463488:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1777051198.750794:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051198.750834:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94f518a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452462976:0@lo:400:kworker.0 00000100:00100000:3.0:1777051198.750867:0:27882:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452463232 00000100:00100000:3.0:1777051198.750873:0:27882:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452463232 00000100:00100000:3.0:1777051198.750927:0:27882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13033 00000100:00100000:3.0:1777051198.750937:0:27882:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da45f75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0001_UUID+5:3677:x1863365452463232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051198.751003:0:27882:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da45f75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0001_UUID+5:3677:x1863365452463232:12345-0@lo:400:kworker.0 Request processed in 66us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051198.751014:0:27882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13033 00000100:00100000:3.0:1777051198.751364:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94f51b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3677:1863365452463232:0@lo:400:kworker.0 00000100:00080000:3.0:1777051198.751407:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1777051198.766497:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7fdf2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3680:1863365452463616:0@lo:253:kworker.0 00000100:00100000:3.0:1777051198.766566:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051198.767060:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7fdf1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3677:1863365452463872:0@lo:253:kworker.0 00000100:00100000:3.0:1777051198.767130:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051198.767213:0:99928:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452464000 00000100:00100000:3.0:1777051198.767220:0:99928:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452464000 00000100:00100000:3.0:1777051198.767247:0:99928:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452463872 00000100:00100000:3.0:1777051198.767252:0:99928:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452463872 00000100:00100000:3.0:1777051198.767275:0:99928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1777051198.767287:0:99928:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fddac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9351a01-5b0e-4470-97fd-58b9b4b312a2+7:3680:x1863365452463616:12345-0@lo:253:kworker.0 20000000:01000000:3.0:1777051198.767367:0:99928:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 10000000:01000000:3.0:1777051198.768326:0:99933:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1777051198.777271:0:99929:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1777051198.777301:0:99929:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1777051198.777966:0:99929:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fdd9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9351a01-5b0e-4470-97fd-58b9b4b312a2+7:99922:x1863365452463744:12345-0@lo:253:mount.lustre.0 Request processed in 10852us (11418us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051198.777984:0:99929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1777051198.778374:0:99929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1777051198.778395:0:99929:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fdd9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9351a01-5b0e-4470-97fd-58b9b4b312a2+6:3678:x1863365452464000:12345-0@lo:253:kworker.0 20000000:01000000:3.0:1777051198.778441:0:99929:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1777051198.792903:0:99929:0:(mgs_nids.c:461:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1777051198.793547:0:99928:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fddac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9351a01-5b0e-4470-97fd-58b9b4b312a2+7:3680:x1863365452463616:12345-0@lo:253:kworker.0 Request processed in 26255us (26975us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051198.793565:0:99928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1777051198.793682:0:99928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1777051198.793702:0:99928:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fdd9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9351a01-5b0e-4470-97fd-58b9b4b312a2+6:99922:x1863365452464128:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1777051198.793721:0:99928:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777051198.793743:0:99928:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d953299000/0x85f51a6b967140b9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x85f51a6b967140ab expref: -99 pid: 99928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051198.793799:0:99928:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d953299000/0x85f51a6b967140b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x85f51a6b967140ab expref: 7 pid: 99928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051198.793815:0:99928:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d953299000/0x85f51a6b967140b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b967140ab expref: 7 pid: 99928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051198.793826:0:99928:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d953299000, rc 0) 00000100:00100000:3.0:1777051198.793881:0:99928:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fdd9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9351a01-5b0e-4470-97fd-58b9b4b312a2+7:99922:x1863365452464128:12345-0@lo:101:mount.lustre.0 Request processed in 186us (14702us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051198.793892:0:99928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 10000000:01000000:3.0:1777051198.794624:0:99922:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1777051198.794963:0:99922:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff99d958727800 10000000:01000000:3.0:1777051198.794972:0:99922:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1777051198.794978:0:99922:0:(mgc_request.c:1799:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1777051198.794983:0:99922:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1777051198.795024:0:99922:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.146@tcp lock: ffff99d953299a00/0x85f51a6b967140c0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 99922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051198.795038:0:99922:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.146@tcp lock: ffff99d953299a00/0x85f51a6b967140c0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 99922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051198.795459:0:99922:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.146@tcp lock: ffff99d953299a00/0x85f51a6b967140c0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 99922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051198.795493:0:99922:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da45f75880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9351a01-5b0e-4470-97fd-58b9b4b312a2:99922:1863365452464256:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1777051198.795569:0:99922:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051198.795626:0:99922:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d95ba62480 going to sleep for 11 seconds 00000100:00100000:3.0:1777051198.802804:0:99928:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452464640 00000100:00100000:3.0:1777051198.802815:0:99928:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452464640 00000100:00100000:3.0:1777051198.802881:0:99928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1777051198.802912:0:99928:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5faf2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9351a01-5b0e-4470-97fd-58b9b4b312a2+9:99936:x1863365452464640:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1777051198.806512:0:99928:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5faf2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9351a01-5b0e-4470-97fd-58b9b4b312a2+9:99936:x1863365452464640:12345-0@lo:502:llog_process_th.0 Request processed in 3614us (3907us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051198.806530:0:99928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 20000000:01000000:3.0:1777051198.807577:0:99929:0:(mgs_nids.c:813:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1777051198.807607:0:99929:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1777051198.808084:0:99929:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fdd9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9351a01-5b0e-4470-97fd-58b9b4b312a2+8:3678:x1863365452464000:12345-0@lo:253:kworker.0 Request processed in 29693us (41376us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051198.808100:0:99929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:3.0:1777051198.884546:0:99936:0:(ldlm_pool.c:924:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-4 is initialized 00000001:00080000:3.0:1777051198.885789:0:99936:0:(tgt_lastrcvd.c:1758:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0001-mdtlov_UUID idx: 0 lr: 12884902301 srv lr: 17179869184 lx: 0 gen 1 00000001:00080000:3.0:1777051198.885850:0:99936:0:(tgt_lastrcvd.c:1758:tgt_clients_data_init()) RCVRNG CLIENT uuid: 2dd4696c-edce-4cd1-86d2-dbd2ff957fa1 idx: 1 lr: 12884904249 srv lr: 17179869184 lx: 0 gen 9 00000001:00080000:3.0:1777051198.885889:0:99936:0:(tgt_lastrcvd.c:1758:tgt_clients_data_init()) RCVRNG CLIENT uuid: c11b6966-0775-44d2-bdc6-c74c26eb2226 idx: 3 lr: 12884904250 srv lr: 17179869184 lx: 0 gen 10 00000001:00000004:3.0:1777051198.885923:0:99936:0:(tgt_lastrcvd.c:732:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 5, last_transno is 17179869184 00000001:00080000:3.0:1777051198.886433:0:99936:0:(tgt_lastrcvd.c:223:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000001:00080000:3.0:1777051198.886503:0:99936:0:(tgt_lastrcvd.c:2296:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff99d95ba62480: xid 1863365425794688, transno 12884904250, client gen 10, slot idx 0 00000001:00080000:3.0:1777051198.886516:0:99936:0:(tgt_lastrcvd.c:2296:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff99d95ba62000: xid 1863365452132608, transno 12884902301, client gen 1, slot idx 1 00000001:00080000:3.0:1777051198.886523:0:99936:0:(tgt_lastrcvd.c:2296:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff99d95ba62c00: xid 1863365425793024, transno 12884904249, client gen 9, slot idx 2 00000001:00080000:3.0:1777051198.886530:0:99936:0:(tgt_lastrcvd.c:2296:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff99d94ecc3f00: xid 1863365425791872, transno 12884904246, client gen 9, slot idx 3 00000001:00080000:3.0:1777051198.886537:0:99936:0:(tgt_lastrcvd.c:2296:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff99d94ecc3240: xid 1863365425791104, transno 12884904237, client gen 10, slot idx 4 00000001:00080000:3.0:1777051198.886543:0:99936:0:(tgt_lastrcvd.c:2296:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff99d94ecc3000: xid 1863365425792128, transno 12884904242, client gen 10, slot idx 5 00000001:00080000:3.0:1777051198.886551:0:99936:0:(tgt_lastrcvd.c:2296:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff99d94ecc3900: xid 1863365425539328, transno 12884903901, client gen 10, slot idx 6 00000001:00080000:3.0:1777051198.886557:0:99936:0:(tgt_lastrcvd.c:2296:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff99d94ecc3300: xid 1863365425435392, transno 12884903784, client gen 10, slot idx 7 00000001:00080000:3.0:1777051198.886563:0:99936:0:(tgt_lastrcvd.c:2296:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff99d94ecc3780: xid 1863365425436032, transno 12884903788, client gen 10, slot idx 8 00000001:00080000:3.0:1777051198.886572:0:99936:0:(tgt_lastrcvd.c:2296:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff99d941c5b6c0: xid 1863365425435136, transno 12884903781, client gen 10, slot idx 9 00000001:00080000:3.0:1777051198.886579:0:99936:0:(tgt_lastrcvd.c:2296:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff99d941c5bf00: xid 1863365425430144, transno 12884903754, client gen 10, slot idx 10 00000001:00080000:3.0:1777051198.886585:0:99936:0:(tgt_lastrcvd.c:2296:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff99d95dc37540: xid 1863365425155200, transno 12884903075, client gen 9, slot idx 11 00000001:00080000:3.0:1777051198.886592:0:99936:0:(tgt_lastrcvd.c:2296:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff99d95dc37480: xid 1863365425418240, transno 12884903704, client gen 10, slot idx 12 00000020:00000080:3.0:1777051198.887441:0:99936:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff99d941e6b380) 00000020:00000080:3.0:1777051198.887467:0:99936:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1777051198.887554:0:99936:0:(osd_handler.c:8912:osd_obd_connect()) connect #4 00000020:00000080:3.0:1777051198.887563:0:99936:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x85f51a6b96714129 00000020:00000080:3.0:1777051198.898080:0:99936:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x85f51a6b96714130 00000020:00000080:3.0:1777051198.898507:0:99936:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1777051198.898524:0:99936:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1777051198.898533:0:99936:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1777051198.898537:0:99936:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1777051198.898542:0:99936:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1777051198.898546:0:99936:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #9 00000020:01000000:3.0:1777051198.898548:0:99936:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1777051198.898551:0:99936:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1777051198.898554:0:99936:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1777051198.898558:0:99936:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1777051198.898560:0:99936:0:(obd_config.c:1561:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:3.0:1777051198.898564:0:99936:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1777051198.898571:0:99936:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1777051198.898573:0:99936:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1777051198.898579:0:99936:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1777051198.898629:0:99936:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1777051198.898684:0:99936:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1777051198.898690:0:99936:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1777051198.898692:0:99936:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1777051198.898696:0:99936:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1777051198.898702:0:99936:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1777051198.898704:0:99936:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:3.0:1777051198.898708:0:99936:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1777051198.898716:0:99936:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.201.146@tcp to nid 0x20000c0a8c992 (192.168.201.146@tcp) 00000020:00000080:3.0:1777051198.898743:0:99936:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1777051198.898762:0:99936:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff99da7f994d40) 00000020:00000080:3.0:1777051198.898786:0:99936:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:3.0:1777051198.898793:0:99936:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1777051198.898864:0:99936:0:(osp_dev.c:1199:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:3.0:1777051198.898871:0:99936:0:(osd_handler.c:8912:osd_obd_connect()) connect #5 00000020:00000080:3.0:1777051198.898878:0:99936:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x85f51a6b9671413e 00010000:00080000:3.0:1777051198.898926:0:99936:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99da7b3ce000@lustre-MDT0001-osp-MDT0000: add connection 192.168.201.146@tcp at head 00010000:00010000:3.0:1777051198.901925:0:99936:0:(ldlm_pool.c:924:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-9 is initialized 00000020:00000080:3.0:1777051198.903596:0:99936:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1777051198.903611:0:99936:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1777051198.903682:0:99936:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:3.0:1777051198.903706:0:99936:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x85f51a6b96714145 00000100:00080000:3.0:1777051198.903998:0:99936:0:(import.c:509:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1777051198.904006:0:99936:0:(import.c:623:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff99da7b3ce000 using connection 192.168.201.146@tcp/0@lo 00000100:00100000:3.0:1777051198.904344:0:99936:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99da45f77b80 x1863365452464768/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1777051198.904384:0:99936:0:(pinger.c:371:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:3.0:1777051198.904467:0:99936:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1777051198.904473:0:99936:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1777051198.904476:0:99936:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:3.0:1777051198.904481:0:99936:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1777051198.904485:0:99936:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #20 00000020:01000000:3.0:1777051198.904487:0:99936:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1777051198.904490:0:99936:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1777051198.904492:0:99936:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1777051198.904497:0:99936:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1777051198.904498:0:99936:0:(obd_config.c:1561:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:3.0:1777051198.904502:0:99936:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1777051198.904509:0:99936:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1777051198.904514:0:99936:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1777051198.904516:0:99936:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1777051198.904521:0:99936:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1777051198.904527:0:99936:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.201.146@tcp to nid 0x20000c0a8c992 (192.168.201.146@tcp) 00000020:01000000:3.0:1777051198.904551:0:99936:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1777051198.904557:0:99936:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1777051198.904575:0:99936:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff99da7f990000) 00000020:00000080:3.0:1777051198.904602:0:99936:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osp with refcount 2 00000020:00000080:3.0:1777051198.904613:0:99936:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1777051198.904737:0:99936:0:(osp_dev.c:1199:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1777051198.904749:0:99936:0:(osd_handler.c:8912:osd_obd_connect()) connect #6 00000020:00000080:3.0:1777051198.904768:0:99936:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x85f51a6b96714153 00010000:00080000:3.0:1777051198.904827:0:99936:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99da454e2800@lustre-OST0000-osc-MDT0000: add connection 192.168.201.146@tcp at head 00010000:00010000:3.0:1777051198.905241:0:99936:0:(ldlm_pool.c:924:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-10 is initialized 00000100:00100000:3.0:1777051198.905560:0:46497:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452465408 00000100:00100000:3.0:1777051198.905569:0:46497:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452465408 00000100:00100000:3.0:1777051198.905629:0:46497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13034 00000100:00100000:3.0:1777051198.905675:0:46497:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f169c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:lustre-MDT0001-lwp-OST0000_UUID+5:3679:x1863365452465408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051198.905745:0:46497:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f169c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:lustre-MDT0001-lwp-OST0000_UUID+5:3679:x1863365452465408:12345-0@lo:400:kworker.0 Request processed in 102us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051198.905755:0:46497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13034 00000100:00100000:3.0:1777051198.906373:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d950264700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452465920:0@lo:400:kworker.0 00000040:01000000:3.0:1777051198.906580:0:99936:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1777051198.907039:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d950264380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452465536:0@lo:400:kworker.0 00000040:01000000:3.0:1777051198.907467:0:99936:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:3.0:1777051198.909796:0:10328:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452465152 00000100:00100000:3.0:1777051198.909807:0:10328:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452465152 00000100:00100000:3.0:1777051198.909848:0:10328:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452465280 00000100:00100000:3.0:1777051198.909855:0:10328:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452465280 00000100:00100000:3.0:1777051198.909888:0:10328:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452465664 00000100:00100000:3.0:1777051198.909896:0:10328:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452465664 00000100:00100000:3.0:1777051198.909937:0:10328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111593 00000100:00100000:3.0:1777051198.909947:0:10328:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f51b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3676:x1863365452465152:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1777051198.910318:0:10328:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f51b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3676:x1863365452465152:12345-0@lo:38:kworker.0 Request processed in 367us (2237us total) trans 0 rc -11/-11 00000100:00100000:3.0:1777051198.910339:0:10328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111593 00000100:00100000:3.0:1777051198.910372:0:10328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111594 00000100:00100000:3.0:1777051198.910382:0:10328:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f51bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3676:x1863365452465280:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1777051198.910444:0:10328:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f51bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3676:x1863365452465280:12345-0@lo:38:kworker.0 Request processed in 59us (2007us total) trans 0 rc -11/-11 00000100:00100000:3.0:1777051198.910456:0:10328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111594 00000100:00100000:3.0:1777051198.910481:0:10328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111595 00000100:00100000:3.0:1777051198.910491:0:10328:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f51b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3676:x1863365452465664:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1777051198.910547:0:10328:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f51b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3676:x1863365452465664:12345-0@lo:38:kworker.0 Request processed in 53us (2039us total) trans 0 rc -11/-11 00000100:00100000:3.0:1777051198.910569:0:10328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111595 00000100:00080000:3.0:1777051198.910667:0:3676:0:(import.c:65:import_set_state_nolock()) ffff99da7fa93000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1777051198.910681:0:3676:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1777051198.910688:0:3676:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7fdf1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3676:1863365452465152:0@lo:38:kworker.0 00000100:00080000:3.0:1777051198.910715:0:3676:0:(import.c:65:import_set_state_nolock()) ffff99d94183b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1777051198.910723:0:3676:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1777051198.910727:0:3676:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7fdf2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3676:1863365452465280:0@lo:38:kworker.0 00000100:00080000:3.0:1777051198.910744:0:3676:0:(import.c:65:import_set_state_nolock()) ffff99da5f282000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1777051198.910750:0:3676:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1777051198.910755:0:3676:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d950265f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3676:1863365452465664:0@lo:38:kworker.0 00000040:00080000:3.0:1777051198.913803:0:99936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].5, 64 off8512 00000040:00080000:3.0:1777051198.914366:0:99936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x1f:0x0].1, 64 off8256 00000020:00000080:3.0:1777051198.917158:0:99936:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1777051198.917175:0:99936:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1777051198.917264:0:99936:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1777051198.917290:0:99936:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x85f51a6b96714161 00000100:00080000:3.0:1777051198.917303:0:99936:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1777051198.917311:0:99936:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff99da454e2800 using connection 192.168.201.146@tcp/0@lo 00000100:00100000:3.0:1777051198.917349:0:99936:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99da45f75c00 x1863365452466176/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1777051198.917386:0:99936:0:(pinger.c:371:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1777051198.917487:0:99936:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1777051198.917497:0:99936:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1777051198.917501:0:99936:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1777051198.917508:0:99936:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1777051198.917513:0:99936:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #28 00000020:01000000:3.0:1777051198.917518:0:99936:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1777051198.917522:0:99936:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1777051198.917525:0:99936:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1777051198.917531:0:99936:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1777051198.917534:0:99936:0:(obd_config.c:1561:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:3.0:1777051198.917539:0:99936:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1777051198.917546:0:99936:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1777051198.917553:0:99936:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1777051198.917556:0:99936:0:(obd_config.c:1561:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1777051198.917563:0:99936:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1777051198.917574:0:99936:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.201.146@tcp to nid 0x20000c0a8c992 (192.168.201.146@tcp) 00000020:01000000:3.0:1777051198.917618:0:99936:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1777051198.917624:0:99936:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1777051198.917639:0:99936:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff99da7f993380) 00000020:00000080:3.0:1777051198.917689:0:99936:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:3.0:1777051198.917703:0:99936:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1777051198.917803:0:99936:0:(osp_dev.c:1199:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1777051198.917813:0:99936:0:(osd_handler.c:8912:osd_obd_connect()) connect #7 00000020:00000080:3.0:1777051198.917828:0:99936:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x85f51a6b96714176 00010000:00080000:3.0:1777051198.917886:0:99936:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99d941c45000@lustre-OST0001-osc-MDT0000: add connection 192.168.201.146@tcp at head 00010000:00010000:3.0:1777051198.918374:0:99936:0:(ldlm_pool.c:924:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-11 is initialized 00000040:01000000:3.0:1777051198.918453:0:99936:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1777051198.918469:0:99936:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:3.0:1777051198.919536:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95fae8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3677:1863365452466304:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1777051198.919604:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1777051198.920459:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:3.0:1777051198.924436:0:99936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].5, 64 off8512 00000040:00080000:3.0:1777051198.924616:0:99936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x21:0x0].1, 64 off8256 00000020:00000080:3.0:1777051198.926397:0:99936:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1777051198.926413:0:99936:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1777051198.926459:0:99936:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1777051198.926486:0:99936:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x85f51a6b9671417d 00000100:00080000:3.0:1777051198.926500:0:99936:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1777051198.926508:0:99936:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff99d941c45000 using connection 192.168.201.146@tcp/0@lo 00000100:00100000:3.0:1777051198.926548:0:99936:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99da45f77b80 x1863365452466432/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1777051198.926583:0:99936:0:(pinger.c:371:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1777051198.926763:0:99936:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1777051198.926771:0:99936:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1777051198.926775:0:99936:0:(obd_config.c:1561:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1777051198.926781:0:99936:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1777051198.926789:0:99936:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1777051198.926795:0:99936:0:(obd_config.c:1561:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:3.0:1777051198.926806:0:99936:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1777051198.926811:0:99936:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1777051198.926816:0:99936:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1777051198.926820:0:99936:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1777051198.926823:0:99936:0:(obd_config.c:1561:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:3.0:1777051198.926827:0:99936:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1777051198.926832:0:99936:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1777051198.926834:0:99936:0:(obd_config.c:1561:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1777051198.926842:0:99936:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1777051198.926850:0:99936:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1777051198.926855:0:99936:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1777051198.926858:0:99936:0:(obd_config.c:1561:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000020:01000000:3.0:1777051198.926864:0:99936:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1777051198.926870:0:99936:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #44 00000020:01000000:3.0:1777051198.926873:0:99936:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1777051198.926877:0:99936:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000100:00100000:3.0:1777051198.926918:0:99936:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da45f75880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f9351a01-5b0e-4470-97fd-58b9b4b312a2:99936:1863365452466560:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1777051198.926997:0:99936:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051198.927042:0:99929:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452466560 00000100:00100000:3.0:1777051198.927051:0:99929:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452466560 00000100:00100000:3.0:1777051198.927104:0:99929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1777051198.927118:0:99929:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5faf3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9351a01-5b0e-4470-97fd-58b9b4b312a2+7:99936:x1863365452466560:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1777051198.927287:0:99936:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d9588003c0 going to sleep for 11 seconds 00000100:00100000:3.0:1777051198.927605:0:8472:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452466688 00000100:00100000:3.0:1777051198.927615:0:8472:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452466688 00000100:00100000:3.0:1777051198.927765:0:8472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5485 00000100:00100000:3.0:1777051198.927782:0:8472:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f169500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3677:x1863365452466688:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1777051198.928131:0:8472:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 430296128 pending 0 free 3645853696 avail 3414331392 00000100:00100000:3.0:1777051198.928260:0:8472:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f169500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3677:x1863365452466688:12345-0@lo:13:osp-pre-1-0.0 Request processed in 479us (703us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051198.928282:0:8472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5485 00000100:00100000:3.0:1777051198.928637:0:99928:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452466816 00000100:00100000:3.0:1777051198.928673:0:99928:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452466816 00000100:00100000:3.0:1777051198.928723:0:99928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1777051198.928736:0:99928:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5faf1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9351a01-5b0e-4470-97fd-58b9b4b312a2+7:99936:x1863365452466816:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1777051198.928898:0:99928:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5faf1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9351a01-5b0e-4470-97fd-58b9b4b312a2+7:99936:x1863365452466816:12345-0@lo:502:llog_process_th.0 Request processed in 163us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051198.928911:0:99928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1777051198.930132:0:99922:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94f16bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9351a01-5b0e-4470-97fd-58b9b4b312a2:99922:1863365452466944:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1777051198.930155:0:99922:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.146@tcp lock: ffff99d94ffbda00/0x85f51a6b9671418b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b96714192 expref: -99 pid: 99922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051198.930173:0:99922:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.146@tcp lock: ffff99d94ffbda00/0x85f51a6b9671418b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x85f51a6b96714192 expref: -99 pid: 99922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051198.931329:0:99922:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da45f75880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9351a01-5b0e-4470-97fd-58b9b4b312a2:99922:1863365452467072:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1777051198.931382:0:99922:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051198.931422:0:99922:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d95a0e9780 going to sleep for 11 seconds 00000100:00100000:3.0:1777051198.931846:0:99922:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da45f75880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9351a01-5b0e-4470-97fd-58b9b4b312a2:99922:1863365452467072:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1777051198.932846:0:99922:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.201.146@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1777051198.932873:0:99922:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff99d94ffbda00/0x85f51a6b9671418b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b96714192 expref: -99 pid: 99922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051198.932888:0:99922:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.146@tcp lock: ffff99d94ffbda00/0x85f51a6b9671418b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b96714192 expref: -99 pid: 99922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1777051198.932900:0:99922:0:(mgc_request.c:1799:mgc_process_log()) Process log params-ffff99d958727800 from 1 10000000:01000000:3.0:1777051198.932904:0:99922:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1777051198.932934:0:99922:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.146@tcp lock: ffff99d953299600/0x85f51a6b96714199 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 99922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051198.932946:0:99922:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.146@tcp lock: ffff99d953299600/0x85f51a6b96714199 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 99922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051198.932959:0:99922:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.146@tcp lock: ffff99d953299600/0x85f51a6b96714199 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 99922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051198.932982:0:99922:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da45f75880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9351a01-5b0e-4470-97fd-58b9b4b312a2:99922:1863365452467200:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1777051198.933023:0:99922:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051198.933367:0:99922:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d95a0e9780 going to sleep for 11 seconds 00000100:00100000:3.0:1777051198.934022:0:99922:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da45f75880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9351a01-5b0e-4470-97fd-58b9b4b312a2:99922:1863365452467200:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1777051198.934043:0:99922:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.146@tcp lock: ffff99d953299600/0x85f51a6b96714199 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b967141a0 expref: -99 pid: 99922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051198.934058:0:99922:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.146@tcp lock: ffff99d953299600/0x85f51a6b96714199 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x85f51a6b967141a0 expref: -99 pid: 99922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051198.934135:0:99922:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da45f75880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9351a01-5b0e-4470-97fd-58b9b4b312a2:99922:1863365452467328:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1777051198.934175:0:99922:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051198.934236:0:99922:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d95a0e9780 going to sleep for 11 seconds 00000100:00100000:3.0:1777051198.938521:0:99922:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da45f75880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9351a01-5b0e-4470-97fd-58b9b4b312a2:99922:1863365452467328:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1777051198.938575:0:99922:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da45f75880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9351a01-5b0e-4470-97fd-58b9b4b312a2:99922:1863365452467456:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1777051198.938634:0:99922:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051198.938704:0:99922:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d95a0e9780 going to sleep for 11 seconds 00000100:00100000:3.0:1777051198.939118:0:99922:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da45f75880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9351a01-5b0e-4470-97fd-58b9b4b312a2:99922:1863365452467456:0@lo:503:mount.lustre.0 00000020:01000000:3.0:1777051198.944461:0:99922:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-30 (rc=0) 10000000:01000000:3.0:1777051198.944493:0:99922:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.201.146@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1777051198.944520:0:99922:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff99d953299600/0x85f51a6b96714199 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b967141a0 expref: -99 pid: 99922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051198.944538:0:99922:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.146@tcp lock: ffff99d953299600/0x85f51a6b96714199 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b967141a0 expref: -99 pid: 99922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1777051198.944618:0:99922:0:(mgc_request.c:1941:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1777051198.944624:0:99922:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff99d958727800 10000000:01000000:3.0:1777051198.944628:0:99922:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff99d958727800 10000000:01000000:3.0:1777051198.944636:0:99922:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1777051198.944674:0:99922:0:(mgc_request.c:1799:mgc_process_log()) Process log lustre-client-ffff99d958727800 from 1 10000000:01000000:3.0:1777051198.944678:0:99922:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1777051198.944712:0:99922:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.146@tcp lock: ffff99d953298e00/0x85f51a6b967141a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 99922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051198.944722:0:99922:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.146@tcp lock: ffff99d953298e00/0x85f51a6b967141a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 99922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051198.944733:0:99922:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.146@tcp lock: ffff99d953298e00/0x85f51a6b967141a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 99922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051198.944751:0:99922:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da45f75880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9351a01-5b0e-4470-97fd-58b9b4b312a2:99922:1863365452467840:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1777051198.944795:0:99922:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051198.944833:0:99922:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d95a0e9900 going to sleep for 11 seconds 00000100:00100000:3.0:1777051198.945245:0:99922:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da45f75880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9351a01-5b0e-4470-97fd-58b9b4b312a2:99922:1863365452467840:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1777051198.945267:0:99922:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.146@tcp lock: ffff99d953298e00/0x85f51a6b967141a7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b967141ae expref: -99 pid: 99922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051198.945284:0:99922:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.146@tcp lock: ffff99d953298e00/0x85f51a6b967141a7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x85f51a6b967141ae expref: -99 pid: 99922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051198.945355:0:99922:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da45f75880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9351a01-5b0e-4470-97fd-58b9b4b312a2:99922:1863365452467968:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1777051198.945395:0:99922:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051198.945432:0:99922:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d95a0e9900 going to sleep for 11 seconds 00000100:00100000:3.0:1777051198.945850:0:99922:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da45f75880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9351a01-5b0e-4470-97fd-58b9b4b312a2:99922:1863365452467968:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1777051198.945895:0:99922:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da45f75880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9351a01-5b0e-4470-97fd-58b9b4b312a2:99922:1863365452468096:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1777051198.945953:0:99922:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051198.945987:0:99922:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d95a0e9900 going to sleep for 11 seconds 00000100:00100000:3.0:1777051198.946639:0:99922:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da45f75880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9351a01-5b0e-4470-97fd-58b9b4b312a2:99922:1863365452468096:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1777051198.947489:0:99948:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da45f75880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f9351a01-5b0e-4470-97fd-58b9b4b312a2:99948:1863365452468224:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1777051198.947555:0:99948:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051198.947691:0:99948:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d95a0e9b40 going to sleep for 11 seconds 00000100:00100000:3.0:1777051198.948074:0:99948:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da45f75880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f9351a01-5b0e-4470-97fd-58b9b4b312a2:99948:1863365452468224:0@lo:502:llog_process_th.0 00000020:01000004:3.0:1777051198.948161:0:99948:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1777051198.948180:0:99948:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff99da7f9919c0) 00000020:00000080:3.0:1777051198.948486:0:99948:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:3.0:1777051198.948862:0:99948:0:(tgt_mount.c:151:server_get_mount()) get mount ffff99d958727800 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1777051198.948870:0:99948:0:(tgt_mount.c:185:server_put_mount()) put mount ffff99d958727800 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1777051198.948875:0:99948:0:(obd_mount.c:701:lustre_put_lsi()) put ffff99d958727800 4 00010000:00080000:3.0:1777051198.948939:0:99948:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99da48b2e800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.201.146@tcp at head 00010000:00010000:3.0:1777051198.955541:0:99948:0:(ldlm_pool.c:924:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-12 is initialized 00000020:00000080:3.0:1777051198.955750:0:99948:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1777051198.955820:0:99948:0:(lwp_dev.c:496:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1777051198.955838:0:99948:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x85f51a6b967141bc 00000100:00080000:3.0:1777051198.955854:0:99948:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1777051198.955862:0:99948:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff99da48b2e800 using connection 192.168.201.146@tcp/0@lo 00000100:00100000:3.0:1777051198.955909:0:99948:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99da45f75880 x1863365452468352/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1777051198.955950:0:99948:0:(pinger.c:371:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1777051198.956427:0:46497:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452468352 00000100:00100000:3.0:1777051198.956438:0:46497:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452468352 00000100:00100000:3.0:1777051198.956492:0:46497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111596 00000100:00100000:3.0:1777051198.956504:0:46497:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f51a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:0+-99:3676:x1863365452468352:12345-0@lo:38:llog_process_th.0 00000100:00100000:3.0:1777051198.956606:0:46497:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f51a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:0+-99:3676:x1863365452468352:12345-0@lo:38:llog_process_th.0 Request processed in 99us (534us total) trans 0 rc -11/-11 00000100:00100000:3.0:1777051198.956621:0:46497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111596 00000100:00100000:3.0:1777051198.957136:0:99948:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da45f77b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f9351a01-5b0e-4470-97fd-58b9b4b312a2:99948:1863365452468480:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1777051198.957245:0:99948:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051198.957285:0:99930:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452468480 00000100:00100000:3.0:1777051198.957292:0:99930:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452468480 00000100:00100000:3.0:1777051198.957345:0:99930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1777051198.957358:0:99930:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da70b23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9351a01-5b0e-4470-97fd-58b9b4b312a2+10:99948:x1863365452468480:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1777051198.957503:0:99930:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da70b23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9351a01-5b0e-4470-97fd-58b9b4b312a2+10:99948:x1863365452468480:12345-0@lo:502:llog_process_th.0 Request processed in 148us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051198.957512:0:99930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1777051198.957583:0:99948:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d95a0e9b40 going to sleep for 11 seconds 00000100:00100000:3.0:1777051198.957612:0:99948:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da45f77b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f9351a01-5b0e-4470-97fd-58b9b4b312a2:99948:1863365452468480:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1777051198.957708:0:99948:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da45f77b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f9351a01-5b0e-4470-97fd-58b9b4b312a2:99948:1863365452468608:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1777051198.957769:0:99948:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051198.957808:0:99929:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452468608 00000100:00100000:3.0:1777051198.957814:0:99929:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452468608 00000100:00100000:3.0:1777051198.957861:0:99929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1777051198.957873:0:99929:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da70b22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9351a01-5b0e-4470-97fd-58b9b4b312a2+10:99948:x1863365452468608:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1777051198.957977:0:99929:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da70b22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9351a01-5b0e-4470-97fd-58b9b4b312a2+10:99948:x1863365452468608:12345-0@lo:502:llog_process_th.0 Request processed in 106us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051198.957989:0:99929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1777051198.958045:0:99948:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d95a0e9b40 going to sleep for 11 seconds 00000100:00100000:3.0:1777051198.958388:0:99948:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da45f77b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f9351a01-5b0e-4470-97fd-58b9b4b312a2:99948:1863365452468608:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1777051198.958420:0:99948:0:(llog.c:858:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64 count 63 00000100:00100000:3.0:1777051198.959278:0:99930:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452468736 00000100:00100000:3.0:1777051198.959286:0:99930:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452468736 00000100:00100000:3.0:1777051198.959335:0:99930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1777051198.959350:0:99930:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da70b21050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9351a01-5b0e-4470-97fd-58b9b4b312a2+10:99922:x1863365452468736:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1777051198.959379:0:99930:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1777051198.959398:0:99930:0:(mgs_nids.c:461:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1777051198.968054:0:99930:0:(mgs_nids.c:813:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1777051198.968083:0:99930:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1777051198.969078:0:99922:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94f16bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9351a01-5b0e-4470-97fd-58b9b4b312a2:99922:1863365452468736:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1777051198.969100:0:99922:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1777051198.969107:0:99922:0:(tgt_mount.c:1144:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1777051198.969110:0:99922:0:(tgt_mount.c:1145:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1777051198.969113:0:99922:0:(tgt_mount.c:1146:server_mti_print()) fs: lustre 00000020:01000004:3.0:1777051198.969116:0:99922:0:(tgt_mount.c:1147:server_mti_print()) uuid: 00000020:01000004:3.0:1777051198.969118:0:99922:0:(tgt_mount.c:1148:server_mti_print()) ver: 0 00000020:01000004:3.0:1777051198.969121:0:99922:0:(tgt_mount.c:1149:server_mti_print()) flags: 00000020:01000004:3.0:1777051198.969124:0:99922:0:(tgt_mount.c:1151:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1777051198.969127:0:99922:0:(tgt_mount.c:1155:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1777051198.969130:0:99922:0:(tgt_mount.c:1183:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1777051198.969132:0:99922:0:(tgt_mount.c:1189:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1777051198.969158:0:99922:0:(tgt_mount.c:2642:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:0.0:1777051198.969746:0:47827:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99da7d784c00/0x85f51a6b96714192 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x85f51a6b9671418b expref: 10 pid: 99935 timeout: 7928 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051198.969790:0:47827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3808 00000100:00100000:0.0:1777051198.969801:0:47827:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da6fd45050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:f9351a01-5b0e-4470-97fd-58b9b4b312a2+10:3680:x1863365452468992:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1777051198.969816:0:47827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777051198.969824:0:47827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99da7d784c00/0x85f51a6b96714192 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x85f51a6b9671418b expref: 10 pid: 99935 timeout: 7928 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051198.969842:0:47827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99da7d784c00/0x85f51a6b96714192 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x85f51a6b9671418b expref: 10 pid: 99935 timeout: 7928 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051198.969863:0:47827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99da7d784c00/0x85f51a6b96714192 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x85f51a6b9671418b expref: 10 pid: 99935 timeout: 7928 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051198.969881:0:47827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99d94ffbd800/0x85f51a6b967141c3 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 99933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051198.969893:0:47827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d94ffbd800/0x85f51a6b967141c3 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 99933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1777051198.969910:0:47827:0:(mgs_nids.c:686:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001799648s 00010000:00010000:0.0:1777051198.969916:0:47827:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99d94ffbd800/0x85f51a6b967141c3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 99933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051198.969926:0:47827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99d94ffbd800/0x85f51a6b967141c3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 99933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051198.969937:0:47827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99d94ffbd800/0x85f51a6b967141c3 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 99933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051198.969946:0:47827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99d94ffbd800/0x85f51a6b967141c3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 99933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051198.969955:0:47827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94ffbd800 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:0.0:1777051198.969961:0:47827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99d94ffbd800/0x85f51a6b967141c3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 99933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051198.969972:0:47827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99d94ffbd800/0x85f51a6b967141c3 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 99933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051198.970002:0:47827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99d94ffbd800/0x85f51a6b967141c3 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 99933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051198.970016:0:47827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1777051198.970083:0:47827:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da6fd45050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:f9351a01-5b0e-4470-97fd-58b9b4b312a2+9:3680:x1863365452468992:12345-0@lo:103:ldlm_bl.0 Request processed in 282us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051198.970092:0:47827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3808 00000100:00100000:0.0:1777051199.009598:0:6585:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452469120 00000100:00100000:0.0:1777051199.009612:0:6585:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452469120 00000100:00100000:0.0:1777051199.009718:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7946 00000100:00100000:0.0:1777051199.009738:0:6585:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f519f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:99960:x1863365452469120:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1777051199.009888:0:6585:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f519f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:99960:x1863365452469120:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 142us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051199.009909:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7946 00000040:01000000:0.0:1777051199.010372:0:99960:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:0.0:1777051199.010434:0:99960:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95faea680 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:99960:1863365452469248:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1777051199.010490:0:99960:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051199.010523:0:99960:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da5f989e40 going to sleep for 11 seconds 00000100:00100000:0.0:1777051199.011958:0:99960:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95faea680 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:99960:1863365452469248:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1777051199.012514:0:99960:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95faea680 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:99960:1863365452469376:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1777051199.012559:0:99960:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051199.012597:0:99960:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da5f989e40 going to sleep for 11 seconds 00000004:00000080:3.0:1777051199.012911:0:99922:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000100:00100000:0.0:1777051199.012914:0:99960:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95faea680 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:99960:1863365452469376:0@lo:1000:lod0000_rec0001.0 00000040:01000000:3.0:1777051199.012927:0:99922:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000100:00100000:0.0:1777051199.013037:0:99960:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95faea680 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:99960:1863365452469504:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1777051199.013440:0:99960:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051199.013478:0:99960:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da5f989540 going to sleep for 11 seconds 00000100:00100000:0.0:1777051199.014479:0:99960:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95faea680 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:99960:1863365452469504:0@lo:1000:lod0000_rec0001.0 00000040:01000000:3.0:1777051199.061849:0:99922:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:0.0:1777051199.062032:0:99960:0:(llog.c:858:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1777051199.062111:0:99960:0:(lod_dev.c:520:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1777051199.062117:0:99960:0:(lod_dev.c:544:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00080000:10000000:3.0:1777051199.065971:0:99922:0:(osd_handler.c:5577:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3c:0x0] (8/32) registered 00000020:01000004:3.0:1777051199.076834:0:99922:0:(tgt_mount.c:296:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1777051199.076856:0:99922:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.146@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1777051199.076885:0:99922:0:(tgt_mount.c:2411:server_fill_super_common()) Server sb, dev=47 00000080:00000004:3.0:1777051199.076907:0:99922:0:(super25.c:187:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:3.0:1777051199.078638:0:99922:0:(tgt_mount.c:2297:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1777051199.079027:0:99922:0:(tgt_mount.c:2312:is_cmd_supported()) ioctl cmd=81009431 00000040:00080000:3.0:1777051200.024464:0:99954:0:(llog.c:858:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1777051200.035496:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051200.044784:0:99928:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425829120 00000100:00100000:3.0:1777051200.044799:0:99928:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425829120 00000100:00100000:3.0:1777051200.044945:0:99928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 29 00000100:00100000:3.0:1777051200.044967:0:99928:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da70b21c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29c4352d-3260-4734-909d-9ea5de9e7fa4+5:6255:x1863365425829120:12345-192.168.201.46@tcp:256:ll_cfg_requeue.0 20000000:01000000:3.0:1777051200.045005:0:99928:0:(mgs_nids.c:912:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 16384. 20000000:01000000:3.0:1777051200.045036:0:99928:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1777051200.045045:0:99928:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:3.0:1777051200.045051:0:99928:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:3.0:1777051200.045057:0:99928:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:3.0:1777051200.045370:0:99928:0:(mgs_nids.c:316:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 22 00000100:00100000:3.0:1777051200.057086:0:99935:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425829376 00000100:00100000:3.0:1777051200.057104:0:99935:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425829376 00000100:00100000:3.0:1777051200.057267:0:99935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 30 00000100:00100000:3.0:1777051200.057297:0:99935:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da70b22450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:29c4352d-3260-4734-909d-9ea5de9e7fa4+5:6255:x1863365425829376:12345-192.168.201.46@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1777051200.057325:0:99935:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777051200.057356:0:99935:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d953299400/0x85f51a6b967141d1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b5e3f expref: -99 pid: 99935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051200.057417:0:99935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d953299400/0x85f51a6b967141d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5e3f expref: 6 pid: 99935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051200.057440:0:99935:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d953299400/0x85f51a6b967141d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5e3f expref: 6 pid: 99935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051200.057472:0:99935:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d953299400, rc 0) 00000100:00100000:3.0:1777051200.057569:0:99935:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da70b22450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:29c4352d-3260-4734-909d-9ea5de9e7fa4+6:6255:x1863365425829376:12345-192.168.201.46@tcp:101:ll_cfg_requeue.0 Request processed in 278us (778us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051200.057584:0:99935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 30 00000100:00100000:0.0:1777051200.065181:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051200.067093:0:99930:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425829504 00000100:00100000:3.0:1777051200.067108:0:99930:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425829504 00000100:00100000:3.0:1777051200.067238:0:99930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 31 00000100:00100000:3.0:1777051200.067258:0:99930:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7d9dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29c4352d-3260-4734-909d-9ea5de9e7fa4+6:6255:x1863365425829504:12345-192.168.201.46@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1777051200.067467:0:99930:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7d9dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29c4352d-3260-4734-909d-9ea5de9e7fa4+7:6255:x1863365425829504:12345-192.168.201.46@tcp:501:ll_cfg_requeue.0 Request processed in 214us (2297us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051200.067480:0:99930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 31 00000100:00100000:0.0:1777051200.074715:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051200.076604:0:99929:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425829632 00000100:00100000:3.0:1777051200.076621:0:99929:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425829632 00000100:00100000:3.0:1777051200.076759:0:99929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 32 00000100:00100000:3.0:1777051200.076785:0:99929:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7d9df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29c4352d-3260-4734-909d-9ea5de9e7fa4+7:6255:x1863365425829632:12345-192.168.201.46@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1777051200.077080:0:99929:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7d9df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29c4352d-3260-4734-909d-9ea5de9e7fa4+7:6255:x1863365425829632:12345-192.168.201.46@tcp:503:ll_cfg_requeue.0 Request processed in 302us (2371us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051200.077098:0:99929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 32 00000100:00100000:0.0:1777051200.095462:0:99935:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425830144 00000100:00100000:0.0:1777051200.095476:0:99935:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425830144 00000100:00100000:0.0:1777051200.095572:0:99935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 34 00000100:00100000:0.0:1777051200.095594:0:99935:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7d9dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:29c4352d-3260-4734-909d-9ea5de9e7fa4+8:6255:x1863365425830144:12345-192.168.201.46@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1777051200.096576:0:99935:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7d9dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:29c4352d-3260-4734-909d-9ea5de9e7fa4+8:6255:x1863365425830144:12345-192.168.201.46@tcp:501:ll_cfg_requeue.0 Request processed in 983us (1289us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051200.096600:0:99935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 34 00000100:00100000:0.0:1777051200.096741:0:27882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111600 00000100:00100000:0.0:1777051200.096777:0:27882:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f51b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+11:2435:x1863365425830272:12345-192.168.201.46@tcp:101:ldlm_lock_repla.0 00010000:00080000:0.0:1777051200.096816:0:27882:0:(ldlm_lib.c:3170:target_queue_recovery_request()) @@@ queue lock replay req req@ffff99d94f51b800 x1863365425830272/t0(0) o101->2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp:161/0 lens 328/0 e 0 to 0 dl 1777051211 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1777051200.096861:0:27882:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f51b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+11:2435:x1863365425830272:12345-192.168.201.46@tcp:101:ldlm_lock_repla.0 Request processed in 95us (1472us total) trans 0 rc 0/-999 00000100:00100000:0.0:1777051200.096896:0:27882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111600 00000100:00100000:0.0:1777051200.096950:0:27882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111602 00000100:00100000:0.0:1777051200.096979:0:27882:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942d20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+11:2435:x1863365425830528:12345-192.168.201.46@tcp:101:ldlm_lock_repla.0 00010000:00080000:0.0:1777051200.097012:0:27882:0:(ldlm_lib.c:3170:target_queue_recovery_request()) @@@ queue lock replay req req@ffff99d942d20000 x1863365425830528/t0(0) o101->2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp:161/0 lens 328/0 e 0 to 0 dl 1777051211 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1777051200.097373:0:27882:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942d20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+11:2435:x1863365425830528:12345-192.168.201.46@tcp:101:ldlm_lock_repla.0 Request processed in 401us (1868us total) trans 0 rc 0/-999 00000100:00100000:0.0:1777051200.097403:0:27882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111602 00000100:00100000:0.0:1777051200.100961:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051200.101193:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051200.101293:0:21368:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425830784 00000100:00100000:0.0:1777051200.101303:0:21368:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425830784 00000100:00100000:0.0:1777051200.101367:0:21368:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425830912 00000100:00100000:0.0:1777051200.101372:0:21368:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425830912 00000100:00100000:0.0:1777051200.101436:0:21368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111604 00000100:00100000:0.0:1777051200.101457:0:21368:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95faea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+13:2435:x1863365425830784:12345-192.168.201.46@tcp:101:ldlm_lock_repla.0 00010000:00080000:0.0:1777051200.101482:0:21368:0:(ldlm_lib.c:3170:target_queue_recovery_request()) @@@ queue lock replay req req@ffff99d95faea680 x1863365425830784/t0(0) o101->2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp:161/0 lens 328/0 e 0 to 0 dl 1777051211 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1777051200.101518:0:21368:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95faea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+13:2435:x1863365425830784:12345-192.168.201.46@tcp:101:ldlm_lock_repla.0 Request processed in 67us (565us total) trans 0 rc 0/-999 00000100:00100000:0.0:1777051200.101532:0:21368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111604 00000100:00100000:0.0:1777051200.101557:0:21368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111605 00000100:00100000:0.0:1777051200.101573:0:21368:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955505500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+13:2435:x1863365425830912:12345-192.168.201.46@tcp:101:ldlm_lock_repla.0 00010000:00080000:0.0:1777051200.101596:0:21368:0:(ldlm_lib.c:3170:target_queue_recovery_request()) @@@ queue lock replay req req@ffff99d955505500 x1863365425830912/t0(0) o101->2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp:161/0 lens 328/0 e 0 to 0 dl 1777051211 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1777051200.101619:0:21368:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955505500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+13:2435:x1863365425830912:12345-192.168.201.46@tcp:101:ldlm_lock_repla.0 Request processed in 50us (433us total) trans 0 rc 0/-999 00000100:00100000:0.0:1777051200.101966:0:21368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111605 00010000:00080000:0.0:1777051200.102011:0:99961:0:(ldlm_lib.c:2531:check_for_recovery_ready()) connected 1 stale 0 max_recoverable_clients 3 abort 0 expired 0 00000100:00100000:3.0:1777051200.128003:0:99935:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425831168 00000100:00100000:3.0:1777051200.128025:0:99935:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425831168 00000100:00100000:3.0:1777051200.128833:0:99935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 36 00000100:00100000:3.0:1777051200.128858:0:99935:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7d9dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:29c4352d-3260-4734-909d-9ea5de9e7fa4+8:6255:x1863365425831168:12345-192.168.201.46@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1777051200.128888:0:99935:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777051200.128919:0:99935:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d953299200/0x85f51a6b967141df lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b5e4d expref: -99 pid: 99935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051200.128972:0:99935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d953299200/0x85f51a6b967141df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5e4d expref: 9 pid: 99935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051200.128995:0:99935:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d953299200/0x85f51a6b967141df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5e4d expref: 9 pid: 99935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051200.129014:0:99935:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d953299200, rc 0) 00000100:00100000:3.0:1777051200.129102:0:99935:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7d9dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:29c4352d-3260-4734-909d-9ea5de9e7fa4+9:6255:x1863365425831168:12345-192.168.201.46@tcp:101:ll_cfg_requeue.0 Request processed in 251us (1513us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051200.129118:0:99935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 36 00000100:00100000:3.0:1777051200.136448:0:99930:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425831296 00000100:00100000:3.0:1777051200.136463:0:99930:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425831296 00000100:00100000:3.0:1777051200.136558:0:99930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 37 00000100:00100000:3.0:1777051200.136582:0:99930:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7d9de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29c4352d-3260-4734-909d-9ea5de9e7fa4+9:6255:x1863365425831296:12345-192.168.201.46@tcp:256:ll_cfg_requeue.0 20000000:01000000:3.0:1777051200.136666:0:99930:0:(mgs_nids.c:912:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 16384. 20000000:01000000:3.0:1777051200.136711:0:99930:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1777051200.136720:0:99930:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:3.0:1777051200.136728:0:99930:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:3.0:1777051200.136736:0:99930:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:3.0:1777051200.136742:0:99930:0:(mgs_nids.c:316:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 22 00000100:00100000:0.0:1777051200.147790:0:99929:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425831552 00000100:00100000:0.0:1777051200.147807:0:99929:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425831552 00000100:00100000:3.0:1777051200.147867:0:46497:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425831424 00000100:00100000:3.0:1777051200.147879:0:46497:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425831424 00000100:00100000:0.0:1777051200.147941:0:99929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 38 00000100:00100000:3.0:1777051200.147953:0:46497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111606 00000100:00100000:0.0:1777051200.147969:0:99929:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7d9dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29c4352d-3260-4734-909d-9ea5de9e7fa4+9:6255:x1863365425831552:12345-192.168.201.46@tcp:101:ll_cfg_requeue.0 00000100:00100000:3.0:1777051200.147973:0:46497:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942d23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:0+-99:2435:x1863365425831424:12345-192.168.201.46@tcp:38:ll_cfg_requeue.0 00010000:00010000:0.0:1777051200.148002:0:99929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00080000:3.0:1777051200.148027:0:46497:0:(ldlm_lib.c:926:target_handle_reconnect()) connect export for UUID 'c11b6966-0775-44d2-bdc6-c74c26eb2226' at ffff99da71c68000, cookie 0x85f51a6b9671411b 00010000:00010000:0.0:1777051200.148035:0:99929:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99da7d785400/0x85f51a6b967141e6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b5e54 expref: -99 pid: 99929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:3.0:1777051200.148044:0:46497:0:(ldlm_lib.c:1431:target_handle_connect()) lustre-MDT0000: connection from c11b6966-0775-44d2-bdc6-c74c26eb2226@192.168.201.46@tcp recovering/t8590016948 exp ffff99da71c68000 cur 7829 last 1777051198 00000004:00100000:3.0:1777051200.148092:0:46497:0:(mdt_handler.c:7281:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type b7, return b7 00010000:00010000:0.0:1777051200.148098:0:99929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99da7d785400/0x85f51a6b967141e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5e54 expref: 10 pid: 99929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1777051200.148662:0:46497:0:(import.c:65:import_set_state_nolock()) ffff99da48b28000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1777051200.149059:0:46497:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942d23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:c11b6966-0775-44d2-bdc6-c74c26eb2226+6:2435:x1863365425831424:12345-192.168.201.46@tcp:38:ll_cfg_requeue.0 Request processed in 1087us (1339us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051200.149075:0:46497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111606 00010000:00010000:0.0:1777051200.149231:0:99929:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99da7d785400/0x85f51a6b967141e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5e54 expref: 10 pid: 99929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051200.149255:0:99929:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99da7d785400, rc 0) 00000100:00100000:0.0:1777051200.149353:0:99929:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7d9dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29c4352d-3260-4734-909d-9ea5de9e7fa4+10:6255:x1863365425831552:12345-192.168.201.46@tcp:101:ll_cfg_requeue.0 Request processed in 1395us (1758us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051200.149367:0:99929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 38 00000100:00100000:3.0:1777051200.156490:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051200.156559:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051200.156649:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051200.157005:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051200.157133:0:46494:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425831808 00000100:00100000:0.0:1777051200.157144:0:46494:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425831808 00000100:00100000:0.0:1777051200.157233:0:46494:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425831936 00000100:00100000:3.0:1777051200.157242:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051200.157245:0:46494:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425831936 00000100:00100000:0.0:1777051200.157347:0:46494:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425832064 00000100:00100000:0.0:1777051200.157354:0:46494:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425832064 00000100:00100000:3.0:1777051200.157405:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051200.157429:0:46494:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425832320 00000100:00100000:0.0:1777051200.157438:0:46494:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425832320 00000100:00100000:0.0:1777051200.157496:0:46494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111607 00000100:00100000:0.0:1777051200.157516:0:46494:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da45f77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c11b6966-0775-44d2-bdc6-c74c26eb2226+11:2435:x1863365425831808:12345-192.168.201.46@tcp:101:ldlm_lock_repla.0 00010000:00080000:0.0:1777051200.157557:0:46494:0:(ldlm_lib.c:3170:target_queue_recovery_request()) @@@ queue lock replay req req@ffff99da45f77b80 x1863365425831808/t0(0) o101->c11b6966-0775-44d2-bdc6-c74c26eb2226@192.168.201.46@tcp:161/0 lens 328/0 e 0 to 0 dl 1777051211 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1777051200.157587:0:46494:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da45f77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c11b6966-0775-44d2-bdc6-c74c26eb2226+11:2435:x1863365425831808:12345-192.168.201.46@tcp:101:ldlm_lock_repla.0 Request processed in 79us (1104us total) trans 0 rc 0/-999 00000100:00100000:3.0:1777051200.157597:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111608 00000100:00100000:3.0:1777051200.157655:0:6581:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da45f75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+11:2435:x1863365425831936:12345-192.168.201.46@tcp:101:ldlm_lock_repla.0 00010000:00080000:3.0:1777051200.157679:0:6581:0:(ldlm_lib.c:3170:target_queue_recovery_request()) @@@ queue lock replay req req@ffff99da45f75880 x1863365425831936/t0(0) o101->c11b6966-0775-44d2-bdc6-c74c26eb2226@192.168.201.46@tcp:161/0 lens 328/0 e 0 to 0 dl 1777051211 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1777051200.157682:0:46494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111607 00000100:00100000:3.0:1777051200.157710:0:6581:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da45f75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+11:2435:x1863365425831936:12345-192.168.201.46@tcp:101:ldlm_lock_repla.0 Request processed in 96us (1151us total) trans 0 rc 0/-999 00000100:00100000:0.0:1777051200.157720:0:46494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111609 00000100:00100000:3.0:1777051200.157735:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111608 00000100:00100000:0.0:1777051200.157749:0:46494:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f16bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c11b6966-0775-44d2-bdc6-c74c26eb2226+11:2435:x1863365425832064:12345-192.168.201.46@tcp:101:ldlm_lock_repla.0 00010000:00080000:0.0:1777051200.157773:0:46494:0:(ldlm_lib.c:3170:target_queue_recovery_request()) @@@ queue lock replay req req@ffff99d94f16bb80 x1863365425832064/t0(0) o101->c11b6966-0775-44d2-bdc6-c74c26eb2226@192.168.201.46@tcp:161/0 lens 328/0 e 0 to 0 dl 1777051211 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777051200.157780:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111610 00000100:00100000:0.0:1777051200.157803:0:46494:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f16bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c11b6966-0775-44d2-bdc6-c74c26eb2226+11:2435:x1863365425832064:12345-192.168.201.46@tcp:101:ldlm_lock_repla.0 Request processed in 65us (1178us total) trans 0 rc 0/-999 00000100:00100000:0.0:1777051200.158164:0:46494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111609 00000100:00100000:3.0:1777051200.158173:0:6581:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fd62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+11:2435:x1863365425832192:12345-192.168.201.46@tcp:101:ldlm_lock_repla.0 00010000:00080000:3.0:1777051200.158203:0:6581:0:(ldlm_lib.c:3170:target_queue_recovery_request()) @@@ queue lock replay req req@ffff99da7fd62680 x1863365425832192/t0(0) o101->c11b6966-0775-44d2-bdc6-c74c26eb2226@192.168.201.46@tcp:161/0 lens 328/0 e 0 to 0 dl 1777051211 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777051200.158237:0:6581:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fd62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+11:2435:x1863365425832192:12345-192.168.201.46@tcp:101:ldlm_lock_repla.0 Request processed in 80us (1233us total) trans 0 rc 0/-999 00000100:00100000:3.0:1777051200.158258:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111610 00010000:00080000:0.0:1777051200.158284:0:99961:0:(ldlm_lib.c:2531:check_for_recovery_ready()) connected 2 stale 0 max_recoverable_clients 3 abort 0 expired 0 00010000:00080000:0.0:1777051200.158358:0:99961:0:(ldlm_lib.c:2531:check_for_recovery_ready()) connected 2 stale 0 max_recoverable_clients 3 abort 0 expired 0 00000100:00100000:0.0:1777051200.160910:0:46494:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425832576 00000100:00100000:0.0:1777051200.160924:0:46494:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425832576 00000100:00100000:0.0:1777051200.160993:0:46494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111613 00000100:00100000:0.0:1777051200.161011:0:46494:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942d21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c11b6966-0775-44d2-bdc6-c74c26eb2226+12:2435:x1863365425832576:12345-192.168.201.46@tcp:101:ldlm_lock_repla.0 00010000:00080000:0.0:1777051200.161034:0:46494:0:(ldlm_lib.c:3170:target_queue_recovery_request()) @@@ queue lock replay req req@ffff99d942d21c00 x1863365425832576/t0(0) o101->c11b6966-0775-44d2-bdc6-c74c26eb2226@192.168.201.46@tcp:161/0 lens 328/0 e 0 to 0 dl 1777051211 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1777051200.161085:0:46494:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942d21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c11b6966-0775-44d2-bdc6-c74c26eb2226+12:2435:x1863365425832576:12345-192.168.201.46@tcp:101:ldlm_lock_repla.0 Request processed in 79us (315us total) trans 0 rc 0/-999 00000100:00100000:0.0:1777051200.161094:0:46494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111613 00000100:00100000:0.0:1777051200.170483:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051200.170855:0:99930:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425832832 00000100:00100000:3.0:1777051200.170868:0:99930:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425832832 00000100:00100000:3.0:1777051200.170944:0:99930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 41 00000100:00100000:3.0:1777051200.170963:0:99930:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942edfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29c4352d-3260-4734-909d-9ea5de9e7fa4+10:6255:x1863365425832832:12345-192.168.201.46@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1777051200.170988:0:99930:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777051200.171018:0:99930:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d953299e00/0x85f51a6b967141ed lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b5e5b expref: -99 pid: 99930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051200.171067:0:99930:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d953299e00/0x85f51a6b967141ed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5e5b expref: 11 pid: 99930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051200.171099:0:99930:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d953299e00/0x85f51a6b967141ed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5e5b expref: 11 pid: 99930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051200.171115:0:99930:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d953299e00, rc 0) 00000100:00100000:3.0:1777051200.171190:0:99930:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942edfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29c4352d-3260-4734-909d-9ea5de9e7fa4+11:6255:x1863365425832832:12345-192.168.201.46@tcp:101:ll_cfg_requeue.0 Request processed in 231us (714us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051200.171278:0:99930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 41 00000100:00100000:3.0:1777051200.176950:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051200.177147:0:99929:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425832960 00000100:00100000:0.0:1777051200.177169:0:99929:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425832960 00000100:00100000:0.0:1777051200.177491:0:99929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 42 00000100:00100000:0.0:1777051200.177529:0:99929:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942edd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29c4352d-3260-4734-909d-9ea5de9e7fa4+11:6255:x1863365425832960:12345-192.168.201.46@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1777051200.177744:0:99929:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942edd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29c4352d-3260-4734-909d-9ea5de9e7fa4+11:6255:x1863365425832960:12345-192.168.201.46@tcp:501:ll_cfg_requeue.0 Request processed in 217us (798us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051200.177761:0:99929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 42 00000100:00100000:0.0:1777051200.191344:0:99929:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425833216 00000100:00100000:0.0:1777051200.191357:0:99929:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425833216 00000100:00100000:0.0:1777051200.191441:0:99929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 44 00000100:00100000:0.0:1777051200.191458:0:99929:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942edf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29c4352d-3260-4734-909d-9ea5de9e7fa4+11:6255:x1863365425833216:12345-192.168.201.46@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1777051200.191481:0:99929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051200.191512:0:99929:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99da7d785e00/0x85f51a6b967141f4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b5e62 expref: -99 pid: 99929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051200.191560:0:99929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99da7d785e00/0x85f51a6b967141f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5e62 expref: 12 pid: 99929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051200.191582:0:99929:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99da7d785e00/0x85f51a6b967141f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5e62 expref: 12 pid: 99929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051200.191609:0:99929:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99da7d785e00, rc 0) 00000100:00100000:0.0:1777051200.191790:0:99929:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942edf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29c4352d-3260-4734-909d-9ea5de9e7fa4+12:6255:x1863365425833216:12345-192.168.201.46@tcp:101:ll_cfg_requeue.0 Request processed in 333us (756us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051200.191805:0:99929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 44 00000100:00100000:3.0:1777051200.194510:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051200.194615:0:99930:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425833344 00000100:00100000:0.0:1777051200.194657:0:99930:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425833344 00000100:00100000:0.0:1777051200.194722:0:99930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 45 00000100:00100000:0.0:1777051200.195398:0:99930:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942ede050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29c4352d-3260-4734-909d-9ea5de9e7fa4+12:6255:x1863365425833344:12345-192.168.201.46@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1777051200.195508:0:99930:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942ede050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29c4352d-3260-4734-909d-9ea5de9e7fa4+12:6255:x1863365425833344:12345-192.168.201.46@tcp:501:ll_cfg_requeue.0 Request processed in 760us (1002us total) trans 0 rc -2/-2 00000100:00100000:0.0:1777051200.195555:0:99930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 45 10000000:01000000:3.0:1777051200.534375:0:6577:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1777051200.534383:0:6577:0:(mgc_request.c:1799:mgc_process_log()) Process log lustre-mdtir-ffff99d958727800 from 22 10000000:01000000:3.0:1777051200.534394:0:6577:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1777051200.534454:0:6577:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.146@tcp lock: ffff99d953298400/0x85f51a6b967141fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051200.534473:0:6577:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.146@tcp lock: ffff99d953298400/0x85f51a6b967141fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051200.534491:0:6577:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.146@tcp lock: ffff99d953298400/0x85f51a6b967141fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051200.534527:0:6577:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955ebd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452469632:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1777051200.534612:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051200.534712:0:6577:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d95875da80 going to sleep for 11 seconds 00000100:00100000:3.0:1777051200.536084:0:6577:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955ebd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452469632:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1777051200.536428:0:6577:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.146@tcp lock: ffff99d953298400/0x85f51a6b967141fb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b96714202 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051200.536456:0:6577:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.146@tcp lock: ffff99d953298400/0x85f51a6b967141fb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x85f51a6b96714202 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051200.536538:0:6577:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955ebd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452469760:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1777051200.536594:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051200.536672:0:6577:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d95875da80 going to sleep for 11 seconds 00000100:00100000:0.0:1777051200.536710:0:99928:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452469760 00000100:00100000:0.0:1777051200.536721:0:99928:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452469760 00000100:00100000:0.0:1777051200.536782:0:99928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1777051200.536797:0:99928:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942edd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9351a01-5b0e-4470-97fd-58b9b4b312a2+10:6577:x1863365452469760:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1777051200.536820:0:99928:0:(mgs_nids.c:912:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1777051200.536845:0:99928:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1777051200.536850:0:99928:0:(mgs_nids.c:316:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 22 00000100:00100000:0.0:1777051200.537018:0:99928:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942edd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9351a01-5b0e-4470-97fd-58b9b4b312a2+10:6577:x1863365452469760:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 223us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051200.537274:0:99928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1777051200.537371:0:6577:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955ebd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452469760:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1777051200.537445:0:6577:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.201.146@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1777051200.537457:0:6577:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff99d953298400/0x85f51a6b967141fb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b96714202 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051200.537473:0:6577:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.146@tcp lock: ffff99d953298400/0x85f51a6b967141fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b96714202 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1777051200.537488:0:6577:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1777051200.537491:0:6577:0:(mgc_request.c:1799:mgc_process_log()) Process log lustre-client-ffff99d941839800 from 64 10000000:01000000:3.0:1777051200.537495:0:6577:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1777051200.537520:0:6577:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.146@tcp lock: ffff99d953298600/0x85f51a6b96714209 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051200.537529:0:6577:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.146@tcp lock: ffff99d953298600/0x85f51a6b96714209 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051200.537538:0:6577:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.146@tcp lock: ffff99d953298600/0x85f51a6b96714209 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051200.537553:0:6577:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955ebd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452469888:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1777051200.537589:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051200.537655:0:6577:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d95875da80 going to sleep for 11 seconds 00000100:00100000:3.0:1777051200.538313:0:6577:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955ebd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452469888:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1777051200.538339:0:6577:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.146@tcp lock: ffff99d953298600/0x85f51a6b96714209 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b96714210 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051200.538355:0:6577:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.146@tcp lock: ffff99d953298600/0x85f51a6b96714209 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x85f51a6b96714210 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051200.538449:0:6577:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955ebd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452470016:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1777051200.538564:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051200.538662:0:6577:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d95875da80 going to sleep for 11 seconds 00000100:00100000:0.0:1777051200.539128:0:99929:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452470016 00000100:00100000:0.0:1777051200.539136:0:99929:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452470016 00000100:00100000:0.0:1777051200.539243:0:99929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1777051200.539257:0:99929:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942edec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9351a01-5b0e-4470-97fd-58b9b4b312a2+11:6577:x1863365452470016:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1777051200.539422:0:99929:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942edec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9351a01-5b0e-4470-97fd-58b9b4b312a2+11:6577:x1863365452470016:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 166us (862us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051200.539430:0:99929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1777051200.539488:0:6577:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955ebd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452470016:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1777051200.539527:0:6577:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955507100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452470144:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1777051200.539582:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051200.539599:0:6577:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d9591d50c0 going to sleep for 11 seconds 00000100:00100000:0.0:1777051200.540806:0:6577:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955507100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452470144:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1777051200.542364:0:100032:0:(llog.c:858:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 63 00000100:00100000:0.0:1777051200.543445:0:6577:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d942d22d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452470272:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1777051200.543464:0:6577:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.146@tcp lock: ffff99d9442eb200/0x85f51a6b96714217 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b9671421e expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051200.543476:0:6577:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.146@tcp lock: ffff99d9442eb200/0x85f51a6b96714217 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x85f51a6b9671421e expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051200.543555:0:6577:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955507100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452470400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1777051200.543606:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051200.543686:0:6577:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da50d44240 going to sleep for 11 seconds 00000100:00100000:0.0:1777051200.546952:0:6577:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d950264000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452470528:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1777051200.548822:0:100034:0:(llog.c:858:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 11 00000020:01000000:0.0:1777051200.550710:0:6577:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:0.0:1777051200.551042:0:6577:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.201.146@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1777051200.551057:0:6577:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff99d9442eb200/0x85f51a6b96714217 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b9671421e expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051200.551075:0:6577:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.146@tcp lock: ffff99d9442eb200/0x85f51a6b96714217 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b9671421e expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1777051200.551091:0:6577:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1777051200.551095:0:6577:0:(mgc_request.c:1799:mgc_process_log()) Process log params-ffff99d941839800 from 31 10000000:01000000:0.0:1777051200.551100:0:6577:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1777051200.551139:0:6577:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.146@tcp lock: ffff99da7d785000/0x85f51a6b96714225 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051200.551154:0:6577:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.146@tcp lock: ffff99da7d785000/0x85f51a6b96714225 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051200.551169:0:6577:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.146@tcp lock: ffff99da7d785000/0x85f51a6b96714225 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051200.551237:0:6577:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955507800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452470656:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1777051200.551308:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051200.551360:0:6577:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da50d44240 going to sleep for 11 seconds 00000100:00100000:3.0:1777051200.551384:0:99929:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452470656 00000100:00100000:3.0:1777051200.551393:0:99929:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452470656 00000100:00100000:3.0:1777051200.551457:0:99929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1777051200.551471:0:99929:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94343fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9351a01-5b0e-4470-97fd-58b9b4b312a2+12:6577:x1863365452470656:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1777051200.551486:0:99929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777051200.551503:0:99929:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d953298000/0x85f51a6b9671422c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x85f51a6b96714225 expref: -99 pid: 99929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051200.551554:0:99929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d953298000/0x85f51a6b9671422c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x85f51a6b96714225 expref: 13 pid: 99929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051200.551572:0:99929:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d953298000/0x85f51a6b9671422c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b96714225 expref: 13 pid: 99929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051200.551596:0:99929:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d953298000, rc 0) 00000100:00100000:3.0:1777051200.551693:0:99929:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94343fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9351a01-5b0e-4470-97fd-58b9b4b312a2+13:6577:x1863365452470656:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 225us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051200.551705:0:99929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1777051200.551755:0:6577:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955507800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452470656:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1777051200.551776:0:6577:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.146@tcp lock: ffff99da7d785000/0x85f51a6b96714225 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b9671422c expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051200.551788:0:6577:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.146@tcp lock: ffff99da7d785000/0x85f51a6b96714225 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x85f51a6b9671422c expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051200.551849:0:6577:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955507800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452470784:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1777051200.551883:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051200.551920:0:6577:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da50d44240 going to sleep for 11 seconds 00000100:00100000:0.0:1777051200.552320:0:6577:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955507800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452470784:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1777051200.552378:0:6577:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955507800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452470912:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1777051200.552449:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051200.552502:0:6577:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da50d44240 going to sleep for 11 seconds 00000100:00100000:0.0:1777051200.552866:0:6577:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955507800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452470912:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1777051200.554432:0:100035:0:(llog.c:858:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 31 00000100:00100000:3.0:1777051200.555592:0:99935:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452471040 00000100:00100000:3.0:1777051200.555601:0:99935:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452471040 00000100:00100000:3.0:1777051200.555698:0:99935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1777051200.555714:0:99935:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94343c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f9351a01-5b0e-4470-97fd-58b9b4b312a2+13:6577:x1863365452471040:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1777051200.555729:0:99935:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777051200.555748:0:99935:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d953298800/0x85f51a6b9671423a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x85f51a6b96714233 expref: -99 pid: 99935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051200.555779:0:99935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d953298800/0x85f51a6b9671423a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x85f51a6b96714233 expref: 14 pid: 99935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051200.555796:0:99935:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d953298800/0x85f51a6b9671423a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b96714233 expref: 14 pid: 99935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051200.555820:0:99935:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d953298800, rc 0) 00000100:00100000:3.0:1777051200.555889:0:99935:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94343c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f9351a01-5b0e-4470-97fd-58b9b4b312a2+14:6577:x1863365452471040:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 178us (629us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051200.555902:0:99935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1777051200.556517:0:99929:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452471168 00000100:00100000:3.0:1777051200.556527:0:99929:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452471168 00000100:00100000:3.0:1777051200.556597:0:99929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1777051200.556639:0:99929:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94343d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9351a01-5b0e-4470-97fd-58b9b4b312a2+14:6577:x1863365452471168:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1777051200.556796:0:99929:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94343d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9351a01-5b0e-4470-97fd-58b9b4b312a2+14:6577:x1863365452471168:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 185us (681us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051200.556811:0:99929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1777051200.557121:0:99930:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452471296 00000100:00100000:0.0:1777051200.557130:0:99930:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452471296 00000100:00100000:0.0:1777051200.557466:0:99930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1777051200.557518:0:99930:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94343d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9351a01-5b0e-4470-97fd-58b9b4b312a2+14:6577:x1863365452471296:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1777051200.557682:0:99930:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94343d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9351a01-5b0e-4470-97fd-58b9b4b312a2+14:6577:x1863365452471296:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 202us (642us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051200.557695:0:99930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000020:01000000:0.0:1777051200.559437:0:6577:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 64-63 (rc=0) 10000000:01000000:0.0:1777051200.559493:0:6577:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.201.146@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1777051200.559520:0:6577:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff99d94ffbd800/0x85f51a6b96714233 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b9671423a expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051200.559536:0:6577:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.146@tcp lock: ffff99d94ffbd800/0x85f51a6b96714233 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b9671423a expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1777051200.559550:0:6577:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1777051200.559554:0:6577:0:(mgc_request.c:1799:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:0.0:1777051200.559558:0:6577:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1777051200.559589:0:6577:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.146@tcp lock: ffff99da7d784200/0x85f51a6b96714241 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051200.559597:0:6577:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.146@tcp lock: ffff99da7d784200/0x85f51a6b96714241 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051200.559613:0:6577:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.146@tcp lock: ffff99da7d784200/0x85f51a6b96714241 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051200.559671:0:6577:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955507800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452471424:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1777051200.559728:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051200.559780:0:6577:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da5833c480 going to sleep for 11 seconds 00000040:00080000:0.0:1777051200.567897:0:100038:0:(llog.c:858:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 14 00000100:00100000:0.0:1777051200.568790:0:99930:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452471808 00000100:00100000:0.0:1777051200.568799:0:99930:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452471808 00000100:00100000:0.0:1777051200.568861:0:99930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1777051200.568876:0:99930:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94343f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9351a01-5b0e-4470-97fd-58b9b4b312a2+15:6577:x1863365452471808:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1777051200.568893:0:99930:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051200.568913:0:99930:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99da7d785200/0x85f51a6b96714256 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x85f51a6b9671424f expref: -99 pid: 99930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051200.568950:0:99930:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99da7d785200/0x85f51a6b96714256 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x85f51a6b9671424f expref: 16 pid: 99930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051200.568969:0:99930:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99da7d785200/0x85f51a6b96714256 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b9671424f expref: 16 pid: 99930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051200.568985:0:99930:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99da7d785200, rc 0) 00000100:00100000:0.0:1777051200.569546:0:99930:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94343f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9351a01-5b0e-4470-97fd-58b9b4b312a2+16:6577:x1863365452471808:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 672us (963us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051200.569558:0:99930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1777051200.569963:0:99929:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452471936 00000100:00100000:0.0:1777051200.569970:0:99929:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452471936 00000100:00100000:0.0:1777051200.570021:0:99929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1777051200.570034:0:99929:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da48667c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9351a01-5b0e-4470-97fd-58b9b4b312a2+16:6577:x1863365452471936:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1777051200.570428:0:99929:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da48667c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9351a01-5b0e-4470-97fd-58b9b4b312a2+16:6577:x1863365452471936:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 393us (543us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051200.570484:0:99929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000040:00080000:0.0:1777051200.573747:0:100039:0:(llog.c:858:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 31 00000100:00100000:0.0:1777051200.574664:0:99929:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452472192 00000100:00100000:0.0:1777051200.574673:0:99929:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452472192 00000100:00100000:0.0:1777051200.574715:0:99929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1777051200.574727:0:99929:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fdd9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9351a01-5b0e-4470-97fd-58b9b4b312a2+16:6577:x1863365452472192:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1777051200.574739:0:99929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051200.574754:0:99929:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99da7d785800/0x85f51a6b96714264 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x85f51a6b9671425d expref: -99 pid: 99929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051200.574781:0:99929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99da7d785800/0x85f51a6b96714264 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x85f51a6b9671425d expref: 17 pid: 99929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051200.575506:0:99929:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99da7d785800/0x85f51a6b96714264 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b9671425d expref: 17 pid: 99929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051200.575523:0:99929:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99da7d785800, rc 0) 00000100:00100000:0.0:1777051200.575593:0:99929:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fdd9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9351a01-5b0e-4470-97fd-58b9b4b312a2+17:6577:x1863365452472192:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 867us (1205us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051200.575606:0:99929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1777051200.575956:0:99930:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452472320 00000100:00100000:0.0:1777051200.575966:0:99930:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452472320 00000100:00100000:0.0:1777051200.576322:0:99930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1777051200.576337:0:99930:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fddac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9351a01-5b0e-4470-97fd-58b9b4b312a2+17:6577:x1863365452472320:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1777051200.576505:0:99930:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fddac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9351a01-5b0e-4470-97fd-58b9b4b312a2+17:6577:x1863365452472320:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 171us (633us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051200.576516:0:99930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1777051200.577035:0:99928:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452472448 00000100:00100000:3.0:1777051200.577043:0:99928:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452472448 00000100:00100000:3.0:1777051200.577097:0:99928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1777051200.577108:0:99928:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fdd9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9351a01-5b0e-4470-97fd-58b9b4b312a2+17:6577:x1863365452472448:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1777051200.577507:0:99928:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fdd9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9351a01-5b0e-4470-97fd-58b9b4b312a2+17:6577:x1863365452472448:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 399us (540us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051200.577517:0:99928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000020:01000000:3.0:1777051200.579357:0:6577:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 64-63 (rc=0) 10000000:01000000:3.0:1777051200.579376:0:6577:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.201.146@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1777051200.579384:0:6577:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff99d94ffbd400/0x85f51a6b9671425d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b96714264 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051200.579395:0:6577:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.146@tcp lock: ffff99d94ffbd400/0x85f51a6b9671425d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b96714264 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1777051200.579412:0:6577:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1777051200.579416:0:6577:0:(mgc_request.c:1799:mgc_process_log()) Process log lustre-mdtir-ffff99da57ae9000 from 19 10000000:01000000:3.0:1777051200.579420:0:6577:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1777051200.579453:0:6577:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.146@tcp lock: ffff99d953298a00/0x85f51a6b9671426b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051200.579465:0:6577:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.146@tcp lock: ffff99d953298a00/0x85f51a6b9671426b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051200.579479:0:6577:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.146@tcp lock: ffff99d953298a00/0x85f51a6b9671426b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051200.579502:0:6577:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955ebf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452472576:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1777051200.579549:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051200.579940:0:6577:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d941b0f0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1777051200.580330:0:6577:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955ebf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452472576:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1777051200.580351:0:6577:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.146@tcp lock: ffff99d953298a00/0x85f51a6b9671426b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b96714272 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051200.580367:0:6577:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.146@tcp lock: ffff99d953298a00/0x85f51a6b9671426b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x85f51a6b96714272 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051200.580441:0:6577:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955ebf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452472704:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1777051200.580498:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051200.580548:0:6577:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d941b0f0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1777051200.580568:0:99929:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452472704 00000100:00100000:0.0:1777051200.580577:0:99929:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452472704 00000100:00100000:0.0:1777051200.580943:0:99929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1777051200.580957:0:99929:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5faf2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9351a01-5b0e-4470-97fd-58b9b4b312a2+18:6577:x1863365452472704:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1777051200.580977:0:99929:0:(mgs_nids.c:912:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1777051200.581001:0:99929:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1777051200.581006:0:99929:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:0.0:1777051200.581011:0:99929:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:0.0:1777051200.581015:0:99929:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:0.0:1777051200.581019:0:99929:0:(mgs_nids.c:316:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 22 00000100:00100000:0.0:1777051200.581189:0:99929:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5faf2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9351a01-5b0e-4470-97fd-58b9b4b312a2+18:6577:x1863365452472704:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 232us (687us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051200.581215:0:99929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1777051200.582118:0:99935:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452472832 00000100:00100000:3.0:1777051200.582128:0:99935:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452472832 00000100:00100000:3.0:1777051200.582184:0:99935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1777051200.582202:0:99935:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5faf0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f9351a01-5b0e-4470-97fd-58b9b4b312a2+18:6577:x1863365452472832:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1777051200.582215:0:99935:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777051200.582232:0:99935:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d953298c00/0x85f51a6b96714280 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x85f51a6b96714279 expref: -99 pid: 99935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051200.582261:0:99935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d953298c00/0x85f51a6b96714280 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x85f51a6b96714279 expref: 19 pid: 99935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051200.582278:0:99935:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d953298c00/0x85f51a6b96714280 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b96714279 expref: 19 pid: 99935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051200.582290:0:99935:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d953298c00, rc 0) 00000100:00100000:3.0:1777051200.582358:0:99935:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5faf0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f9351a01-5b0e-4470-97fd-58b9b4b312a2+19:6577:x1863365452472832:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 162us (648us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051200.582368:0:99935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1777051200.582922:0:99928:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452472960 00000100:00100000:3.0:1777051200.582931:0:99928:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452472960 00000100:00100000:3.0:1777051200.582992:0:99928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1777051200.583028:0:99928:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5faf2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9351a01-5b0e-4470-97fd-58b9b4b312a2+19:6577:x1863365452472960:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1777051200.583215:0:99928:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5faf2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9351a01-5b0e-4470-97fd-58b9b4b312a2+19:6577:x1863365452472960:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 195us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051200.583228:0:99928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1777051200.583523:0:99930:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452473088 00000100:00100000:0.0:1777051200.583547:0:99930:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452473088 00000100:00100000:0.0:1777051200.583643:0:99930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1777051200.583659:0:99930:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fdd9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9351a01-5b0e-4470-97fd-58b9b4b312a2+19:6577:x1863365452473088:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1777051200.584646:0:99930:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fdd9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9351a01-5b0e-4470-97fd-58b9b4b312a2+19:6577:x1863365452473088:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 962us (1192us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051200.584660:0:99930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000020:01000000:0.0:1777051200.586660:0:6577:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 59-58 (rc=0) 10000000:01000000:0.0:1777051200.586721:0:6577:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.201.146@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1777051200.586734:0:6577:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff99da40030000/0x85f51a6b96714279 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b96714280 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051200.586759:0:6577:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.146@tcp lock: ffff99da40030000/0x85f51a6b96714279 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b96714280 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1777051200.586772:0:6577:0:(mgc_request.c:611:do_requeue()) updating log lustre-barrier 10000000:01000000:0.0:1777051200.586777:0:6577:0:(mgc_request.c:1799:mgc_process_log()) Process log lustre-barrier-ffff99da57ae9000 from 1 10000000:01000000:0.0:1777051200.586781:0:6577:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1777051200.586820:0:6577:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.146@tcp lock: ffff99da7d784c00/0x85f51a6b96714287 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051200.586832:0:6577:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.146@tcp lock: ffff99da7d784c00/0x85f51a6b96714287 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051200.586847:0:6577:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.146@tcp lock: ffff99da7d784c00/0x85f51a6b96714287 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051200.586883:0:6577:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955505880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452473216:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1777051200.586931:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051200.587012:0:99929:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452473216 00000100:00100000:3.0:1777051200.587021:0:99929:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452473216 00000100:00100000:0.0:1777051200.587032:0:6577:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d9591d50c0 going to sleep for 11 seconds 00000100:00100000:3.0:1777051200.587106:0:99929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1777051200.587123:0:99929:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fddb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9351a01-5b0e-4470-97fd-58b9b4b312a2+19:6577:x1863365452473216:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1777051200.587137:0:99929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777051200.587155:0:99929:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d953298200/0x85f51a6b9671428e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x85f51a6b96714287 expref: -99 pid: 99929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051200.587185:0:99929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d953298200/0x85f51a6b9671428e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x85f51a6b96714287 expref: 20 pid: 99929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051200.587202:0:99929:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d953298200/0x85f51a6b9671428e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b96714287 expref: 20 pid: 99929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051200.587216:0:99929:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d953298200, rc 0) 00000100:00100000:3.0:1777051200.587292:0:99929:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fddb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9351a01-5b0e-4470-97fd-58b9b4b312a2+20:6577:x1863365452473216:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 172us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051200.587305:0:99929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1777051200.587487:0:6577:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955505880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452473216:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1777051200.587507:0:6577:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.146@tcp lock: ffff99da7d784c00/0x85f51a6b96714287 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b9671428e expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051200.587522:0:6577:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.146@tcp lock: ffff99da7d784c00/0x85f51a6b96714287 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x85f51a6b9671428e expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1777051200.587543:0:6577:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.201.146@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1777051200.587551:0:6577:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff99da7d784c00/0x85f51a6b96714287 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b9671428e expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051200.587569:0:6577:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.146@tcp lock: ffff99da7d784c00/0x85f51a6b96714287 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b9671428e expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1777051200.587580:0:6577:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1777051200.587583:0:6577:0:(mgc_request.c:1799:mgc_process_log()) Process log nodemap-ffff99da70a599c0 from 1 10000000:01000000:0.0:1777051200.587586:0:6577:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1777051200.587607:0:6577:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.146@tcp lock: ffff99da7d785600/0x85f51a6b96714295 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051200.587641:0:6577:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.146@tcp lock: ffff99da7d785600/0x85f51a6b96714295 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051200.587651:0:6577:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.146@tcp lock: ffff99da7d785600/0x85f51a6b96714295 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051200.587665:0:6577:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955505880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452473344:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1777051200.587717:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051200.587767:0:6577:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d9591d50c0 going to sleep for 11 seconds 00000100:00100000:0.0:1777051200.588396:0:6577:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955505880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452473344:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1777051200.588415:0:6577:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.146@tcp lock: ffff99da7d785600/0x85f51a6b96714295 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b9671429c expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051200.588430:0:6577:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.146@tcp lock: ffff99da7d785600/0x85f51a6b96714295 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x85f51a6b9671429c expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1777051200.588451:0:6577:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.201.146@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1777051200.588458:0:6577:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff99da7d785600/0x85f51a6b96714295 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b9671429c expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051200.588523:0:6577:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.146@tcp lock: ffff99da7d785600/0x85f51a6b96714295 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b9671429c expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1777051200.588554:0:6577:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1777051200.588557:0:6577:0:(mgc_request.c:1799:mgc_process_log()) Process log params-ffff99da57ae9000 from 31 10000000:01000000:0.0:1777051200.588561:0:6577:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1777051200.588582:0:6577:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.146@tcp lock: ffff99da7d784600/0x85f51a6b967142a3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051200.588593:0:6577:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.146@tcp lock: ffff99da7d784600/0x85f51a6b967142a3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051200.588604:0:6577:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.146@tcp lock: ffff99da7d784600/0x85f51a6b967142a3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051200.588656:0:6577:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955505880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452473472:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1777051200.588696:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051200.588734:0:6577:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d9591d50c0 going to sleep for 11 seconds 00000100:00100000:3.0:1777051200.588766:0:99929:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452473472 00000100:00100000:3.0:1777051200.588773:0:99929:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452473472 00000100:00100000:3.0:1777051200.588823:0:99929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1777051200.588834:0:99929:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5faf3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9351a01-5b0e-4470-97fd-58b9b4b312a2+21:6577:x1863365452473472:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1777051200.588846:0:99929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777051200.588860:0:99929:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d95595ba00/0x85f51a6b967142aa lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x85f51a6b967142a3 expref: -99 pid: 99929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051200.588882:0:99929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d95595ba00/0x85f51a6b967142aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x85f51a6b967142a3 expref: 22 pid: 99929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051200.588894:0:99929:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d95595ba00/0x85f51a6b967142aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b967142a3 expref: 22 pid: 99929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051200.588905:0:99929:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d95595ba00, rc 0) 00000100:00100000:3.0:1777051200.588971:0:99929:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5faf3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9351a01-5b0e-4470-97fd-58b9b4b312a2+22:6577:x1863365452473472:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 138us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051200.588981:0:99929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1777051200.589031:0:6577:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955505880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452473472:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1777051200.589053:0:6577:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.146@tcp lock: ffff99da7d784600/0x85f51a6b967142a3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b967142aa expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051200.589068:0:6577:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.146@tcp lock: ffff99da7d784600/0x85f51a6b967142a3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x85f51a6b967142aa expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051200.593729:0:99935:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452473600 00000100:00100000:0.0:1777051200.593741:0:99935:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452473600 00000100:00100000:0.0:1777051200.593800:0:99935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1777051200.593815:0:99935:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5faf1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f9351a01-5b0e-4470-97fd-58b9b4b312a2+22:6577:x1863365452473600:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1777051200.593984:0:99935:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5faf1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f9351a01-5b0e-4470-97fd-58b9b4b312a2+22:6577:x1863365452473600:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 171us (3663us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051200.593997:0:99935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1777051200.594069:0:6577:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d942d21180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452473600:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1777051200.594131:0:6577:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955505880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452473728:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1777051200.594498:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051200.594556:0:6577:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d95cf03600 going to sleep for 11 seconds 00000100:00100000:0.0:1777051200.595031:0:6577:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955505880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452473728:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1777051200.597533:0:100042:0:(llog.c:858:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 31 00000020:01000000:3.0:1777051200.597731:0:6577:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 31-30 (rc=0) 10000000:01000000:3.0:1777051200.597771:0:6577:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.201.146@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1777051200.597785:0:6577:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff99da7d784600/0x85f51a6b967142a3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b967142aa expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051200.597804:0:6577:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.146@tcp lock: ffff99da7d784600/0x85f51a6b967142a3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b967142aa expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1777051200.597819:0:6577:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1777051200.597823:0:6577:0:(mgc_request.c:1799:mgc_process_log()) Process log lustre-sptlrpc-ffff99da70a599c0 from 1 10000000:01000000:3.0:1777051200.597828:0:6577:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1777051200.597870:0:6577:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.146@tcp lock: ffff99d95595a200/0x85f51a6b967142b1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051200.597884:0:6577:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.146@tcp lock: ffff99d95595a200/0x85f51a6b967142b1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051200.597900:0:6577:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.146@tcp lock: ffff99d95595a200/0x85f51a6b967142b1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051200.597930:0:6577:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955ebe680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452473856:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1777051200.597995:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051200.598040:0:6577:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da7d50c000 going to sleep for 11 seconds 00000100:00100000:0.0:1777051200.598494:0:99935:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452473856 00000100:00100000:0.0:1777051200.598503:0:99935:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452473856 00000100:00100000:0.0:1777051200.598567:0:99935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1777051200.598586:0:99935:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5faf1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f9351a01-5b0e-4470-97fd-58b9b4b312a2+22:6577:x1863365452473856:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1777051200.598601:0:99935:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051200.599074:0:99935:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d94f683200/0x85f51a6b967142b8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x85f51a6b967142b1 expref: -99 pid: 99935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051200.599112:0:99935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d94f683200/0x85f51a6b967142b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x85f51a6b967142b1 expref: 23 pid: 99935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051200.599365:0:99935:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d94f683200/0x85f51a6b967142b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b967142b1 expref: 23 pid: 99935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051200.599381:0:99935:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d94f683200, rc 0) 00000100:00100000:0.0:1777051200.599498:0:99935:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5faf1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f9351a01-5b0e-4470-97fd-58b9b4b312a2+23:6577:x1863365452473856:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 917us (1502us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051200.599516:0:99935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00010000:00010000:0.0:1777051200.599674:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777051200.599835:0:6577:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955ebe680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452473856:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1777051200.599869:0:6577:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.146@tcp lock: ffff99d95595a200/0x85f51a6b967142b1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b967142b8 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051200.599880:0:6577:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.146@tcp lock: ffff99d95595a200/0x85f51a6b967142b1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x85f51a6b967142b8 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051200.599944:0:6577:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955ebe680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452473984:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1777051200.599979:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051200.600020:0:6577:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da7d50c000 going to sleep for 11 seconds 00000100:00100000:0.0:1777051200.600048:0:99929:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452473984 00000100:00100000:0.0:1777051200.600055:0:99929:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452473984 00000100:00100000:0.0:1777051200.600367:0:99929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1777051200.600384:0:99929:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5faf3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9351a01-5b0e-4470-97fd-58b9b4b312a2+23:6577:x1863365452473984:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1777051200.600534:0:99929:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5faf3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9351a01-5b0e-4470-97fd-58b9b4b312a2+23:6577:x1863365452473984:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 151us (548us total) trans 0 rc -2/-2 00000100:00100000:0.0:1777051200.600548:0:99929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1777051200.600593:0:6577:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955ebe680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452473984:0@lo:501:ll_cfg_requeue.0 10000000:01000000:3.0:1777051200.600659:0:6577:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.201.146@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1777051200.600667:0:6577:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff99d95595a200/0x85f51a6b967142b1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b967142b8 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051200.600676:0:6577:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.146@tcp lock: ffff99d95595a200/0x85f51a6b967142b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b967142b8 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1777051201.048641:0:99954:0:(llog.c:858:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1777051201.622542:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777051203.351638:0:3679:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1777051203.351672:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d942d22680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452474112:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1777051203.352630:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1777051203.354513:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000004:3.0:1777051203.437632:0:100247:0:(tgt_mount.c:2297:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1777051203.438632:0:100247:0:(tgt_mount.c:2312:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1777051203.493174:0:99935:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425833472 00000100:00100000:0.0:1777051203.493186:0:99935:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425833472 00000100:00100000:0.0:1777051203.493278:0:99935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 81 00000100:00100000:0.0:1777051203.493292:0:99935:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5faf0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:29c4352d-3260-4734-909d-9ea5de9e7fa4+12:2436:x1863365425833472:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:0.0:1777051203.493382:0:99935:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5faf0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:29c4352d-3260-4734-909d-9ea5de9e7fa4+12:2436:x1863365425833472:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 92us (557us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051203.493393:0:99935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 81 00000100:00100000:0.0:1777051203.493443:0:8470:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425833856 00000100:00100000:0.0:1777051203.493448:0:8470:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425833856 00000100:00100000:0.0:1777051203.493497:0:8470:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425834240 00000100:00100000:0.0:1777051203.493505:0:8470:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425834240 00000100:00100000:0.0:1777051203.493943:0:8470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10107 00000100:00100000:0.0:1777051203.493974:0:8470:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942d21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+47:2436:x1863365425834240:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:0.0:1777051203.494271:0:8470:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942d21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+47:2436:x1863365425834240:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 309us (954us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051203.494282:0:8470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10107 00000100:00100000:3.0:1777051203.862458:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d950266680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452474240:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1777051203.862602:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051203.862687:0:47388:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452474240 00000100:00100000:0.0:1777051203.862698:0:47388:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452474240 00000100:00080000:3.0:1777051203.862760:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1777051203.862788:0:47388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5487 00000100:00100000:0.0:1777051203.862807:0:47388:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955ebf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3677:x1863365452474240:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1777051203.862842:0:47388:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 440355904 pending 0 free 3862671360 avail 3631149056 00000100:00100000:0.0:1777051203.862912:0:47388:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955ebf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3677:x1863365452474240:12345-0@lo:13:osp-pre-0-1.0 Request processed in 112us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051203.862923:0:47388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5487 00000100:00100000:3.0:1777051203.863654:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d950266680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452474240:0@lo:13:osp-pre-0-1.0 00000020:00000004:3.0:1777051204.135231:0:100297:0:(tgt_mount.c:2297:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1777051204.135586:0:100297:0:(tgt_mount.c:2312:is_cmd_supported()) ioctl cmd=81009431 00000100:00080000:3.0:1777051204.374403:0:84827:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1777051204.374412:0:84827:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1777051204.374418:0:84827:0:(import.c:65:import_set_state_nolock()) ffff99da7dbeb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1777051204.374433:0:84827:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff99da7dbeb000 using connection 192.168.201.146@tcp/0@lo 00000100:00100000:3.0:1777051204.374472:0:84827:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d955ebf800 x1863365452474624/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1777051204.374487:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d942d22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3678:1863365452474368:0@lo:41:osp-pre-1-0.0 00000100:00080000:3.0:1777051204.374522:0:84827:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1777051204.374530:0:84827:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1777051204.374533:0:84827:0:(import.c:65:import_set_state_nolock()) ffff99da7fa93000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1777051204.374617:0:84827:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff99da7fa93000 using connection 192.168.201.146@tcp/0@lo 00000100:00100000:3.0:1777051204.374698:0:84827:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d955ebd880 x1863365452474752/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1777051204.374718:0:84827:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1777051204.374723:0:84827:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1777051204.374727:0:84827:0:(import.c:65:import_set_state_nolock()) ffff99d94183b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1777051204.374734:0:84827:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff99d94183b000 using connection 192.168.201.146@tcp/0@lo 00000100:00100000:0.0:1777051204.374947:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051204.374993:0:84827:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d94ed2ea00 x1863365452474880/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1777051204.375453:0:84827:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1777051204.375461:0:84827:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1777051204.375464:0:84827:0:(import.c:65:import_set_state_nolock()) ffff99da5f282000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1777051204.375473:0:84827:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff99da5f282000 using connection 192.168.201.146@tcp/0@lo 00000100:00100000:3.0:1777051204.375506:0:84827:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d94ed2d880 x1863365452475136/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1777051204.375647:0:84827:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1777051204.375652:0:84827:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1777051204.375655:0:84827:0:(import.c:65:import_set_state_nolock()) ffff99da48b2e800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1777051204.375663:0:84827:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff99da48b2e800 using connection 192.168.201.146@tcp/0@lo 00000100:00100000:3.0:1777051204.375681:0:84827:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99da7c9a1c00 x1863365452475904/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1777051204.376026:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94ed2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3680:1863365452475008:0@lo:400:kworker.0 00000100:00100000:0.0:1777051204.377662:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7951 00000100:00100000:0.0:1777051204.377684:0:6585:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d950266680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3679:x1863365452475520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777051204.377774:0:6585:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d950266680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3679:x1863365452475520:12345-0@lo:400:kworker.0 Request processed in 95us (914us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051204.377788:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7951 00000100:00100000:3.0:1777051204.379466:0:6580:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452474752 00000100:00100000:0.0:1777051204.379468:0:46497:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452474880 00000100:00100000:3.0:1777051204.379478:0:6580:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452474752 00000100:00100000:0.0:1777051204.379481:0:46497:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452474880 00000100:00100000:0.0:1777051204.379528:0:46497:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452475136 00000100:00100000:0.0:1777051204.379535:0:46497:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452475136 00000100:00100000:3.0:1777051204.379589:0:6580:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452475904 00000100:00100000:3.0:1777051204.379598:0:6580:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452475904 00000100:00100000:0.0:1777051204.379612:0:46497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111614 00000100:00100000:0.0:1777051204.379623:0:46497:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d956128700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:0+-99:3676:x1863365452474880:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1777051204.379652:0:46497:0:(ldlm_lib.c:1431:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 7833 last 0 00000100:00100000:3.0:1777051204.379662:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111615 00000100:00100000:3.0:1777051204.379676:0:6580:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95612aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3676:x1863365452474752:12345-0@lo:38:kworker.0 00000020:00000080:0.0:1777051204.379717:0:46497:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x85f51a6b967142bf 00010000:00080000:3.0:1777051204.379724:0:6580:0:(ldlm_lib.c:1431:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 7833 last 0 00000004:00100000:0.0:1777051204.379733:0:46497:0:(mdt_handler.c:7285:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1777051204.379772:0:46497:0:(import.c:65:import_set_state_nolock()) ffff99d94bba3800 : changing import state from RECOVER to FULL 00000020:00000080:3.0:1777051204.379785:0:6580:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x85f51a6b967142c6 00000004:00100000:3.0:1777051204.379806:0:6580:0:(mdt_handler.c:7285:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1777051204.379845:0:6580:0:(import.c:65:import_set_state_nolock()) ffff99da48b2f800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1777051204.379846:0:46497:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d956128700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:lustre-MDT0000-lwp-OST0000_UUID+5:3676:x1863365452474880:12345-0@lo:38:kworker.0 Request processed in 219us (2720us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051204.379871:0:46497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111614 00000100:00100000:0.0:1777051204.379901:0:46497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111616 00000100:00100000:0.0:1777051204.379911:0:46497:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d956128a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:0+-99:3676:x1863365452475136:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1777051204.379928:0:6580:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95612aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3676:x1863365452474752:12345-0@lo:38:kworker.0 Request processed in 248us (2913us total) trans 0 rc 0/0 00010000:00080000:0.0:1777051204.379936:0:46497:0:(ldlm_lib.c:1431:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 7833 last 0 00000100:00100000:3.0:1777051204.379949:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111615 00000100:00100000:3.0:1777051204.379986:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111617 00000020:00000080:0.0:1777051204.379989:0:46497:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x85f51a6b967142cd 00000100:00100000:3.0:1777051204.379999:0:6580:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d956128380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3676:x1863365452475904:12345-0@lo:38:kworker.0 00000004:00100000:0.0:1777051204.380005:0:46497:0:(mdt_handler.c:7285:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00010000:00080000:3.0:1777051204.380028:0:6580:0:(ldlm_lib.c:1431:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 7833 last 0 00000100:00080000:0.0:1777051204.380039:0:46497:0:(import.c:65:import_set_state_nolock()) ffff99d94bba5800 : changing import state from RECOVER to FULL 00000020:00000080:3.0:1777051204.380360:0:6580:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x85f51a6b967142d4 00000004:00100000:3.0:1777051204.380413:0:6580:0:(mdt_handler.c:7285:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:0.0:1777051204.380426:0:46497:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d956128a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:lustre-MDT0000-lwp-OST0001_UUID+5:3676:x1863365452475136:12345-0@lo:38:kworker.0 Request processed in 511us (3237us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051204.380441:0:46497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111616 00000100:00080000:3.0:1777051204.380447:0:6580:0:(import.c:65:import_set_state_nolock()) ffff99da5f3d2000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1777051204.380516:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94ed2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452475520:0@lo:400:kworker.0 00000100:00100000:3.0:1777051204.380525:0:6580:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d956128380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3676:x1863365452475904:12345-0@lo:38:kworker.0 Request processed in 524us (2714us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051204.380544:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111617 00000100:00100000:0.0:1777051204.380638:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d942d22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3678:1863365452474368:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1777051204.380665:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94ed2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452475392:0@lo:400:kworker.0 00000100:00100000:0.0:1777051204.380710:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051204.380755:0:3678:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1777051204.380770:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94ed2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3678:1863365452475264:0@lo:400:kworker.0 00000100:00100000:0.0:1777051204.380820:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051204.380884:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7c9a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3678:1863365452475776:0@lo:400:kworker.0 00000100:00100000:0.0:1777051204.380951:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051204.380969:0:6580:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452475264 00000100:00100000:3.0:1777051204.380980:0:6580:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452475264 00000100:00100000:0.0:1777051204.381038:0:24468:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452475776 00000100:00100000:0.0:1777051204.381047:0:24468:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452475776 00000100:00100000:3.0:1777051204.381058:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13038 00000100:00100000:3.0:1777051204.381077:0:6580:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955504700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3678:x1863365452475264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777051204.381411:0:24468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10109 00000100:00100000:0.0:1777051204.381435:0:24468:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955507800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3678:x1863365452475776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051204.381451:0:6580:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955504700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3678:x1863365452475264:12345-0@lo:400:kworker.0 Request processed in 371us (624us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051204.381470:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13038 00000100:00100000:0.0:1777051204.381518:0:24468:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955507800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3678:x1863365452475776:12345-0@lo:400:kworker.0 Request processed in 92us (576us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051204.381533:0:24468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10109 00000100:00100000:0.0:1777051204.381620:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94ed2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3678:1863365452475264:0@lo:400:kworker.0 00000100:00100000:0.0:1777051204.381640:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7c9a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3678:1863365452475776:0@lo:400:kworker.0 00000100:00100000:0.0:1777051204.381940:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94ed2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452475392:0@lo:400:kworker.0 00000100:00100000:0.0:1777051204.382133:0:27882:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452475008 00000100:00100000:0.0:1777051204.382142:0:27882:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452475008 00000100:00100000:0.0:1777051204.382237:0:27882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13039 00000100:00100000:0.0:1777051204.382264:0:27882:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d950264000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0000_UUID+5:3680:x1863365452475008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777051204.382355:0:27882:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d950264000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0000_UUID+5:3680:x1863365452475008:12345-0@lo:400:kworker.0 Request processed in 101us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051204.382403:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94ed2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3680:1863365452475008:0@lo:400:kworker.0 00000100:00080000:3.0:1777051204.382493:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1777051204.382502:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1777051204.382509:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1777051204.382601:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94ed2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3680:1863365452475648:0@lo:400:kworker.0 00000100:00100000:0.0:1777051204.383046:0:27882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13039 00010000:00080000:3.0:1777051204.383976:0:100309:0:(ldlm_request.c:2960:ldlm_lock_replay_thread()) lock replay thread lustre-MDT0000-osp-MDT0001 to lustre-MDT0000_UUID@0@lo 00010000:00010000:3.0:1777051204.383984:0:100309:0:(ldlm_request.c:2876:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-MDT0000-osp-MDT0001 (0) 00010000:00010000:3.0:1777051204.383993:0:100309:0:(ldlm_request.c:2889:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-MDT0000-osp-MDT0001 00000100:00100000:0.0:1777051204.398831:0:3676:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7fdf2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3676:1863365452476032:0@lo:101:ldlm_lock_repla.0 00000100:00100000:0.0:1777051204.398919:0:3676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1777051204.399001:0:3676:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99d94ed2ea00 x1863365452474880/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1777051229 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1777051204.399025:0:3676:0:(import.c:1130:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 5 00000100:00080000:0.0:1777051204.401018:0:3676:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0000: lwp recover req@ffff99d94ed2ea00 x1863365452474880/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1777051229 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1777051204.401034:0:3676:0:(import.c:65:import_set_state_nolock()) ffff99d94183b000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:0.0:1777051204.401043:0:3676:0:(import.c:65:import_set_state_nolock()) ffff99d94183b000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:0.0:1777051204.401050:0:3676:0:(import.c:1737:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0000: Connection restored to 0@lo (at 0@lo) 00000100:00100000:0.0:1777051204.401062:0:3676:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94ed2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3676:1863365452474880:0@lo:38:kworker.0 00010000:00080000:0.0:1777051204.401408:0:3676:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99d94ed2d880 x1863365452475136/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1777051229 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1777051204.401427:0:3676:0:(import.c:1130:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 5 00000100:00080000:0.0:1777051204.404321:0:3676:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0001: lwp recover req@ffff99d94ed2d880 x1863365452475136/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1777051229 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1777051204.404337:0:3676:0:(import.c:65:import_set_state_nolock()) ffff99da5f282000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:0.0:1777051204.404345:0:3676:0:(import.c:65:import_set_state_nolock()) ffff99da5f282000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:0.0:1777051204.404354:0:3676:0:(import.c:1737:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:0.0:1777051204.404362:0:3676:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94ed2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3676:1863365452475136:0@lo:38:kworker.0 00010000:00080000:0.0:1777051204.404400:0:3676:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99da7c9a1c00 x1863365452475904/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1777051214 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1777051204.404420:0:3676:0:(import.c:1130:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 5 00000100:00080000:0.0:1777051204.404428:0:3676:0:(import.c:958:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1777051204.404434:0:3676:0:(import.c:1211:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1777051204.404438:0:3676:0:(import.c:65:import_set_state_nolock()) ffff99da48b2e800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1777051204.404445:0:3676:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7c9a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3676:1863365452475904:0@lo:38:kworker.0 00000020:00080000:0.0:1777051204.404515:0:99961:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1777051204.404521:0:99961:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 3, connected: 3, completed: 3, queue_len: 0, req_transno: 0, next_transno: 17179869185 00010000:00080000:0.0:1777051204.404527:0:99961:0:(ldlm_lib.c:2248:check_for_next_transno()) waking for completed recovery 00000020:00080000:0.0:1777051204.404531:0:99961:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1777051204.404541:0:99961:0:(ldlm_lib.c:2438:target_next_replay_lock()) Waiting for lock 00010000:00080000:0.0:1777051204.404544:0:99961:0:(ldlm_lib.c:2268:check_for_next_lock()) waking for next lock 00010000:00080000:0.0:1777051204.404585:0:99961:0:(ldlm_lib.c:2871:target_recovery_thread()) @@@ processing lock from 192.168.201.46@tcp: req@ffff99d950264700 x1863365425829888/t0(0) o101->2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp:161/0 lens 328/0 e 0 to 0 dl 1777051211 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1777051204.404611:0:99961:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051204.404942:0:99961:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f682c00/0x85f51a6b967142db lrc: 2/0,0 mode: --/PR res: [0x200000bd3:0x9f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b50af expref: -99 pid: 99961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051204.404978:0:99961:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f682c00/0x85f51a6b967142db lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x9f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b50af expref: 14 pid: 99961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051204.405005:0:99961:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f682c00/0x85f51a6b967142db lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x9f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b50af expref: 14 pid: 99961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051204.405021:0:99961:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d94f682c00, rc 0) 00010000:00080000:0.0:1777051204.405118:0:99961:0:(ldlm_lib.c:2086:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 101 seconds 00010000:00080000:0.0:1777051204.405135:0:99961:0:(ldlm_lib.c:2438:target_next_replay_lock()) Waiting for lock 00010000:00080000:0.0:1777051204.405138:0:99961:0:(ldlm_lib.c:2268:check_for_next_lock()) waking for next lock 00010000:00080000:0.0:1777051204.405148:0:99961:0:(ldlm_lib.c:2871:target_recovery_thread()) @@@ processing lock from 192.168.201.46@tcp: req@ffff99d94f518700 x1863365425830016/t0(0) o101->2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp:161/0 lens 328/0 e 0 to 0 dl 1777051211 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1777051204.405168:0:99961:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051204.405188:0:99961:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f683e00/0x85f51a6b967142e2 lrc: 2/0,0 mode: --/PR res: [0x200000bd3:0x9d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b50a1 expref: -99 pid: 99961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051204.405254:0:99961:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f683e00/0x85f51a6b967142e2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x9d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b50a1 expref: 14 pid: 99961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051204.405273:0:99961:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f683e00/0x85f51a6b967142e2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x9d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b50a1 expref: 14 pid: 99961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051204.405287:0:99961:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d94f683e00, rc 0) 00010000:00080000:0.0:1777051204.405327:0:99961:0:(ldlm_lib.c:2086:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00010000:00080000:0.0:1777051204.405339:0:99961:0:(ldlm_lib.c:2438:target_next_replay_lock()) Waiting for lock 00010000:00080000:0.0:1777051204.405341:0:99961:0:(ldlm_lib.c:2268:check_for_next_lock()) waking for next lock 00010000:00080000:0.0:1777051204.405351:0:99961:0:(ldlm_lib.c:2871:target_recovery_thread()) @@@ processing lock from 192.168.201.46@tcp: req@ffff99d94f51b800 x1863365425830272/t0(0) o101->2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp:161/0 lens 328/0 e 0 to 0 dl 1777051211 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1777051204.405369:0:99961:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051204.405387:0:99961:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f683600/0x85f51a6b967142e9 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x57:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b0bdc expref: -99 pid: 99961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051204.405410:0:99961:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f683600/0x85f51a6b967142e9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x57:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b0bdc expref: 14 pid: 99961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051204.405427:0:99961:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f683600/0x85f51a6b967142e9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x57:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b0bdc expref: 14 pid: 99961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051204.405440:0:99961:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d94f683600, rc 0) 00010000:00080000:0.0:1777051204.405470:0:99961:0:(ldlm_lib.c:2086:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00010000:00080000:0.0:1777051204.405482:0:99961:0:(ldlm_lib.c:2438:target_next_replay_lock()) Waiting for lock 00010000:00080000:0.0:1777051204.405484:0:99961:0:(ldlm_lib.c:2268:check_for_next_lock()) waking for next lock 00010000:00080000:0.0:1777051204.405493:0:99961:0:(ldlm_lib.c:2871:target_recovery_thread()) @@@ processing lock from 192.168.201.46@tcp: req@ffff99d942d20a80 x1863365425830400/t0(0) o101->2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp:161/0 lens 328/0 e 0 to 0 dl 1777051211 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1777051204.405510:0:99961:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051204.405527:0:99961:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f682600/0x85f51a6b967142f0 lrc: 2/0,0 mode: --/PR res: [0x200000bd3:0xb5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b5731 expref: -99 pid: 99961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051204.405548:0:99961:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f682600/0x85f51a6b967142f0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0xb5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5731 expref: 14 pid: 99961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051204.405589:0:99961:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f682600/0x85f51a6b967142f0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0xb5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5731 expref: 14 pid: 99961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051204.405610:0:99961:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d94f682600, rc 0) 00010000:00080000:0.0:1777051204.405639:0:99961:0:(ldlm_lib.c:2086:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00010000:00080000:0.0:1777051204.405648:0:99961:0:(ldlm_lib.c:2438:target_next_replay_lock()) Waiting for lock 00010000:00080000:0.0:1777051204.405650:0:99961:0:(ldlm_lib.c:2268:check_for_next_lock()) waking for next lock 00010000:00080000:0.0:1777051204.405659:0:99961:0:(ldlm_lib.c:2871:target_recovery_thread()) @@@ processing lock from 192.168.201.46@tcp: req@ffff99d942d21500 x1863365425830656/t0(0) o101->2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp:161/0 lens 328/0 e 0 to 0 dl 1777051211 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1777051204.405675:0:99961:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051204.405693:0:99961:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f683400/0x85f51a6b967142f7 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x96:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b245c expref: -99 pid: 99961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051204.405714:0:99961:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f683400/0x85f51a6b967142f7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x96:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b245c expref: 14 pid: 99961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051204.405730:0:99961:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f683400/0x85f51a6b967142f7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x96:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b245c expref: 14 pid: 99961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051204.405741:0:99961:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d94f683400, rc 0) 00010000:00080000:0.0:1777051204.405763:0:99961:0:(ldlm_lib.c:2086:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00010000:00080000:0.0:1777051204.405773:0:99961:0:(ldlm_lib.c:2438:target_next_replay_lock()) Waiting for lock 00010000:00080000:0.0:1777051204.405776:0:99961:0:(ldlm_lib.c:2268:check_for_next_lock()) waking for next lock 00010000:00080000:0.0:1777051204.405783:0:99961:0:(ldlm_lib.c:2871:target_recovery_thread()) @@@ processing lock from 192.168.201.46@tcp: req@ffff99d942d20000 x1863365425830528/t0(0) o101->2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp:161/0 lens 328/0 e 0 to 0 dl 1777051211 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1777051204.405799:0:99961:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051204.405812:0:99961:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f682800/0x85f51a6b967142fe lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x96:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b41c1 expref: -99 pid: 99961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051204.405838:0:99961:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f682800/0x85f51a6b967142fe lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x96:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b41c1 expref: 14 pid: 99961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051204.405854:0:99961:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f682800/0x85f51a6b967142fe lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x96:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b41c1 expref: 14 pid: 99961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051204.405865:0:99961:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d94f682800, rc 0) 00010000:00080000:0.0:1777051204.405889:0:99961:0:(ldlm_lib.c:2086:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00010000:00080000:0.0:1777051204.405901:0:99961:0:(ldlm_lib.c:2438:target_next_replay_lock()) Waiting for lock 00010000:00080000:0.0:1777051204.405904:0:99961:0:(ldlm_lib.c:2268:check_for_next_lock()) waking for next lock 00010000:00080000:0.0:1777051204.405912:0:99961:0:(ldlm_lib.c:2871:target_recovery_thread()) @@@ processing lock from 192.168.201.46@tcp: req@ffff99d95faea680 x1863365425830784/t0(0) o101->2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp:161/0 lens 328/0 e 0 to 0 dl 1777051211 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1777051204.405929:0:99961:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051204.405946:0:99961:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f683000/0x85f51a6b96714305 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b5d12 expref: -99 pid: 99961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051204.405969:0:99961:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f683000/0x85f51a6b96714305 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5d12 expref: 14 pid: 99961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051204.405986:0:99961:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f683000/0x85f51a6b96714305 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5d12 expref: 14 pid: 99961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051204.405998:0:99961:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d94f683000, rc 0) 00010000:00080000:0.0:1777051204.406024:0:99961:0:(ldlm_lib.c:2086:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00010000:00080000:0.0:1777051204.406035:0:99961:0:(ldlm_lib.c:2438:target_next_replay_lock()) Waiting for lock 00010000:00080000:0.0:1777051204.406038:0:99961:0:(ldlm_lib.c:2268:check_for_next_lock()) waking for next lock 00010000:00080000:0.0:1777051204.406047:0:99961:0:(ldlm_lib.c:2871:target_recovery_thread()) @@@ processing lock from 192.168.201.46@tcp: req@ffff99d955505500 x1863365425830912/t0(0) o101->2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp:161/0 lens 328/0 e 0 to 0 dl 1777051211 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1777051204.406065:0:99961:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051204.406083:0:99961:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f682a00/0x85f51a6b9671430c lrc: 2/0,0 mode: --/PR res: [0x200000bd3:0xb2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b5715 expref: -99 pid: 99961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051204.406105:0:99961:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f682a00/0x85f51a6b9671430c lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0xb2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5715 expref: 14 pid: 99961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051204.406121:0:99961:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f682a00/0x85f51a6b9671430c lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0xb2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5715 expref: 14 pid: 99961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051204.406133:0:99961:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d94f682a00, rc 0) 00010000:00080000:0.0:1777051204.406158:0:99961:0:(ldlm_lib.c:2086:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00010000:00080000:0.0:1777051204.406168:0:99961:0:(ldlm_lib.c:2438:target_next_replay_lock()) Waiting for lock 00010000:00080000:0.0:1777051204.406171:0:99961:0:(ldlm_lib.c:2268:check_for_next_lock()) waking for next lock 00010000:00080000:0.0:1777051204.406180:0:99961:0:(ldlm_lib.c:2871:target_recovery_thread()) @@@ processing lock from 192.168.201.46@tcp: req@ffff99da45f77b80 x1863365425831808/t0(0) o101->c11b6966-0775-44d2-bdc6-c74c26eb2226@192.168.201.46@tcp:161/0 lens 328/0 e 0 to 0 dl 1777051211 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1777051204.406196:0:99961:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051204.406242:0:99961:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f683a00/0x85f51a6b96714313 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0xc6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b54f3 expref: -99 pid: 99961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051204.406264:0:99961:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f683a00/0x85f51a6b96714313 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xc6:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b54f3 expref: 13 pid: 99961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051204.406280:0:99961:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f683a00/0x85f51a6b96714313 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xc6:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b54f3 expref: 13 pid: 99961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051204.406300:0:99961:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d94f683a00, rc 0) 00010000:00080000:0.0:1777051204.406322:0:99961:0:(ldlm_lib.c:2086:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00010000:00080000:0.0:1777051204.406332:0:99961:0:(ldlm_lib.c:2438:target_next_replay_lock()) Waiting for lock 00010000:00080000:0.0:1777051204.406334:0:99961:0:(ldlm_lib.c:2268:check_for_next_lock()) waking for next lock 00010000:00080000:0.0:1777051204.406342:0:99961:0:(ldlm_lib.c:2871:target_recovery_thread()) @@@ processing lock from 192.168.201.46@tcp: req@ffff99da45f75880 x1863365425831936/t0(0) o101->c11b6966-0775-44d2-bdc6-c74c26eb2226@192.168.201.46@tcp:161/0 lens 328/0 e 0 to 0 dl 1777051211 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1777051204.406358:0:99961:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051204.406373:0:99961:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f682000/0x85f51a6b9671431a lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0xc4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b4e9b expref: -99 pid: 99961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051204.406391:0:99961:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f682000/0x85f51a6b9671431a lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xc4:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b4e9b expref: 13 pid: 99961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051204.406406:0:99961:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f682000/0x85f51a6b9671431a lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xc4:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b4e9b expref: 13 pid: 99961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051204.406418:0:99961:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d94f682000, rc 0) 00010000:00080000:0.0:1777051204.406440:0:99961:0:(ldlm_lib.c:2086:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00010000:00080000:0.0:1777051204.406449:0:99961:0:(ldlm_lib.c:2438:target_next_replay_lock()) Waiting for lock 00010000:00080000:0.0:1777051204.406451:0:99961:0:(ldlm_lib.c:2268:check_for_next_lock()) waking for next lock 00010000:00080000:0.0:1777051204.406459:0:99961:0:(ldlm_lib.c:2871:target_recovery_thread()) @@@ processing lock from 192.168.201.46@tcp: req@ffff99d94f16bb80 x1863365425832064/t0(0) o101->c11b6966-0775-44d2-bdc6-c74c26eb2226@192.168.201.46@tcp:161/0 lens 328/0 e 0 to 0 dl 1777051211 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1777051204.406476:0:99961:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051204.406491:0:99961:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d95d339a00/0x85f51a6b96714321 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0xc2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b4882 expref: -99 pid: 99961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051204.406512:0:99961:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d95d339a00/0x85f51a6b96714321 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xc2:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b4882 expref: 13 pid: 99961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051204.406522:0:99961:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d95d339a00/0x85f51a6b96714321 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xc2:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b4882 expref: 13 pid: 99961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051204.406529:0:99961:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d95d339a00, rc 0) 00010000:00080000:0.0:1777051204.406543:0:99961:0:(ldlm_lib.c:2086:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00010000:00080000:0.0:1777051204.406943:0:99961:0:(ldlm_lib.c:2438:target_next_replay_lock()) Waiting for lock 00010000:00080000:0.0:1777051204.406948:0:99961:0:(ldlm_lib.c:2268:check_for_next_lock()) waking for next lock 00010000:00080000:0.0:1777051204.406958:0:99961:0:(ldlm_lib.c:2871:target_recovery_thread()) @@@ processing lock from 192.168.201.46@tcp: req@ffff99da7fd62680 x1863365425832192/t0(0) o101->c11b6966-0775-44d2-bdc6-c74c26eb2226@192.168.201.46@tcp:161/0 lens 328/0 e 0 to 0 dl 1777051211 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1777051204.406977:0:99961:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051204.406996:0:99961:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d95d339600/0x85f51a6b96714328 lrc: 2/0,0 mode: --/PR res: [0x200000bd3:0x9e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b4ee8 expref: -99 pid: 99961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051204.407016:0:99961:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d95d339600/0x85f51a6b96714328 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x9e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b4ee8 expref: 13 pid: 99961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051204.407031:0:99961:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d95d339600/0x85f51a6b96714328 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x9e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b4ee8 expref: 13 pid: 99961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051204.407043:0:99961:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d95d339600, rc 0) 00010000:00080000:0.0:1777051204.407088:0:99961:0:(ldlm_lib.c:2086:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00010000:00080000:0.0:1777051204.407104:0:99961:0:(ldlm_lib.c:2438:target_next_replay_lock()) Waiting for lock 00010000:00080000:0.0:1777051204.407107:0:99961:0:(ldlm_lib.c:2268:check_for_next_lock()) waking for next lock 00010000:00080000:0.0:1777051204.407116:0:99961:0:(ldlm_lib.c:2871:target_recovery_thread()) @@@ processing lock from 192.168.201.46@tcp: req@ffff99d955ebce00 x1863365425832320/t0(0) o101->c11b6966-0775-44d2-bdc6-c74c26eb2226@192.168.201.46@tcp:161/0 lens 328/0 e 0 to 0 dl 1777051211 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1777051204.407134:0:99961:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051204.407147:0:99961:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d95d338800/0x85f51a6b9671432f lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x96:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b244e expref: -99 pid: 99961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051204.407170:0:99961:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d95d338800/0x85f51a6b9671432f lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x96:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b244e expref: 13 pid: 99961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051204.407187:0:99961:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d95d338800/0x85f51a6b9671432f lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x96:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b244e expref: 13 pid: 99961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051204.407198:0:99961:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d95d338800, rc 0) 00010000:00080000:0.0:1777051204.407234:0:99961:0:(ldlm_lib.c:2086:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00010000:00080000:0.0:1777051204.407246:0:99961:0:(ldlm_lib.c:2438:target_next_replay_lock()) Waiting for lock 00010000:00080000:0.0:1777051204.407249:0:99961:0:(ldlm_lib.c:2268:check_for_next_lock()) waking for next lock 00010000:00080000:0.0:1777051204.407258:0:99961:0:(ldlm_lib.c:2871:target_recovery_thread()) @@@ processing lock from 192.168.201.46@tcp: req@ffff99d955ebdc00 x1863365425832448/t0(0) o101->c11b6966-0775-44d2-bdc6-c74c26eb2226@192.168.201.46@tcp:161/0 lens 328/0 e 0 to 0 dl 1777051211 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1777051204.407275:0:99961:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051204.407293:0:99961:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d95d339e00/0x85f51a6b96714336 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b0fbe expref: -99 pid: 99961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051204.407313:0:99961:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d95d339e00/0x85f51a6b96714336 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b0fbe expref: 13 pid: 99961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051204.407328:0:99961:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d95d339e00/0x85f51a6b96714336 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b0fbe expref: 13 pid: 99961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051204.407348:0:99961:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d95d339e00, rc 0) 00010000:00080000:0.0:1777051204.407384:0:99961:0:(ldlm_lib.c:2086:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00010000:00080000:0.0:1777051204.407393:0:99961:0:(ldlm_lib.c:2438:target_next_replay_lock()) Waiting for lock 00010000:00080000:0.0:1777051204.407395:0:99961:0:(ldlm_lib.c:2268:check_for_next_lock()) waking for next lock 00010000:00080000:0.0:1777051204.407402:0:99961:0:(ldlm_lib.c:2871:target_recovery_thread()) @@@ processing lock from 192.168.201.46@tcp: req@ffff99d942d21c00 x1863365425832576/t0(0) o101->c11b6966-0775-44d2-bdc6-c74c26eb2226@192.168.201.46@tcp:161/0 lens 328/0 e 0 to 0 dl 1777051211 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1777051204.407418:0:99961:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051204.407433:0:99961:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d95d338e00/0x85f51a6b9671433d lrc: 2/0,0 mode: --/PR res: [0x200000bd3:0xb0:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b555c expref: -99 pid: 99961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051204.407454:0:99961:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d95d338e00/0x85f51a6b9671433d lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0xb0:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b555c expref: 13 pid: 99961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051204.407471:0:99961:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d95d338e00/0x85f51a6b9671433d lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0xb0:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b555c expref: 13 pid: 99961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051204.407484:0:99961:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d95d338e00, rc 0) 00010000:00080000:0.0:1777051204.407517:0:99961:0:(ldlm_lib.c:2086:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00010000:00080000:0.0:1777051204.407528:0:99961:0:(ldlm_lib.c:2438:target_next_replay_lock()) Waiting for lock 00010000:00080000:0.0:1777051204.407531:0:99961:0:(ldlm_lib.c:2268:check_for_next_lock()) waking for next lock 00010000:00080000:0.0:1777051204.407539:0:99961:0:(ldlm_lib.c:2871:target_recovery_thread()) @@@ processing lock from 0@lo: req@ffff99d955507100 x1863365452476032/t0(0) o101->lustre-MDT0001-mdtlov_UUID@0@lo:165/0 lens 328/0 e 0 to 0 dl 1777051215 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1777051204.407617:0:99961:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051204.407634:0:99961:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d95d338c00/0x85f51a6b96714344 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x85f51a6b96149c5e expref: -99 pid: 99961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051204.407931:0:99961:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d95d338c00/0x85f51a6b96714344 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x85f51a6b96149c5e expref: 7 pid: 99961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051204.407946:0:99961:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d95d338c00/0x85f51a6b96714344 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b96149c5e expref: 7 pid: 99961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051204.407957:0:99961:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d95d338c00, rc 0) 00010000:00080000:0.0:1777051204.408017:0:99961:0:(ldlm_lib.c:2086:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00010000:00080000:0.0:1777051204.408028:0:99961:0:(ldlm_lib.c:2438:target_next_replay_lock()) Waiting for lock 00000100:00100000:0.0:1777051204.408594:0:3676:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d956128000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3676:1863365452476160:0@lo:400:ptlrpcd_rcv.0 00000100:00100000:0.0:1777051204.408993:0:3676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051204.413741:0:6579:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425834496 00000100:00100000:0.0:1777051204.413772:0:6579:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425834496 00000100:00100000:0.0:1777051204.413823:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111619 00000100:00100000:0.0:1777051204.413834:0:6579:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d956128e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+15:2435:x1863365425834496:12345-192.168.201.46@tcp:101:ldlm_lock_repla.0 00010000:00080000:0.0:1777051204.413851:0:6579:0:(ldlm_lib.c:3170:target_queue_recovery_request()) @@@ queue lock replay req req@ffff99d956128e00 x1863365425834496/t0(0) o101->2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp:165/0 lens 328/0 e 0 to 0 dl 1777051215 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1777051204.413881:0:6579:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d956128e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+15:2435:x1863365425834496:12345-192.168.201.46@tcp:101:ldlm_lock_repla.0 Request processed in 48us (276us total) trans 0 rc 0/-999 00000100:00100000:0.0:1777051204.413892:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111619 00010000:00080000:0.0:1777051204.414172:0:99961:0:(ldlm_lib.c:2268:check_for_next_lock()) waking for next lock 00010000:00080000:0.0:1777051204.414186:0:99961:0:(ldlm_lib.c:2871:target_recovery_thread()) @@@ processing lock from 192.168.201.46@tcp: req@ffff99d956128e00 x1863365425834496/t0(0) o101->2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp:165/0 lens 328/0 e 0 to 0 dl 1777051215 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1777051204.414211:0:99961:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051204.414239:0:99961:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d95d339800/0x85f51a6b9671434b lrc: 2/0,0 mode: --/PR res: [0x200000bd3:0x51:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b445a expref: -99 pid: 99961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051204.414270:0:99961:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d95d339800/0x85f51a6b9671434b lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x51:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b445a expref: 16 pid: 99961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051204.414290:0:99961:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d95d339800/0x85f51a6b9671434b lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x51:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b445a expref: 16 pid: 99961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051204.414305:0:99961:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d95d339800, rc 0) 00010000:00080000:0.0:1777051204.414372:0:99961:0:(ldlm_lib.c:2086:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00010000:00080000:0.0:1777051204.414387:0:99961:0:(ldlm_lib.c:2438:target_next_replay_lock()) Waiting for lock 00010000:00080000:0.0:1777051204.414391:0:99961:0:(ldlm_lib.c:2268:check_for_next_lock()) waking for next lock 00010000:00080000:0.0:1777051204.414397:0:99961:0:(ldlm_lib.c:2871:target_recovery_thread()) @@@ processing lock from 192.168.201.46@tcp: req@ffff99d95612b480 x1863365425834368/t0(0) o101->2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp:165/0 lens 328/0 e 0 to 0 dl 1777051215 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1777051204.414413:0:99961:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051204.414428:0:99961:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d95d339000/0x85f51a6b96714352 lrc: 2/0,0 mode: --/PR res: [0x200000bd3:0xb1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b570e expref: -99 pid: 99961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051204.414500:0:99961:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d95d339000/0x85f51a6b96714352 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0xb1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b570e expref: 16 pid: 99961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051204.414517:0:99961:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d95d339000/0x85f51a6b96714352 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0xb1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b570e expref: 16 pid: 99961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051204.414530:0:99961:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d95d339000, rc 0) 00010000:00080000:0.0:1777051204.414601:0:99961:0:(ldlm_lib.c:2086:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00010000:00080000:0.0:1777051204.414617:0:99961:0:(ldlm_lib.c:2438:target_next_replay_lock()) Waiting for lock 00000100:00100000:3.0:1777051204.415861:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111620 00000100:00100000:3.0:1777051204.415893:0:6581:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95612b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+16:2435:x1863365425834624:12345-192.168.201.46@tcp:101:ldlm_lock_repla.0 00010000:00080000:3.0:1777051204.415920:0:6581:0:(ldlm_lib.c:3170:target_queue_recovery_request()) @@@ queue lock replay req req@ffff99d95612b100 x1863365425834624/t0(0) o101->2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp:165/0 lens 328/0 e 0 to 0 dl 1777051215 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777051204.415976:0:6581:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95612b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+16:2435:x1863365425834624:12345-192.168.201.46@tcp:101:ldlm_lock_repla.0 Request processed in 95us (332us total) trans 0 rc 0/-999 00000100:00100000:3.0:1777051204.415992:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111620 00010000:00080000:3.0:1777051204.416025:0:99961:0:(ldlm_lib.c:2268:check_for_next_lock()) waking for next lock 00010000:00080000:3.0:1777051204.416043:0:99961:0:(ldlm_lib.c:2871:target_recovery_thread()) @@@ processing lock from 192.168.201.46@tcp: req@ffff99d95612b100 x1863365425834624/t0(0) o101->2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp:165/0 lens 328/0 e 0 to 0 dl 1777051215 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1777051204.416066:0:99961:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777051204.416092:0:99961:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d95595b200/0x85f51a6b96714359 lrc: 2/0,0 mode: --/PR res: [0x200000bd3:0xb0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b5707 expref: -99 pid: 99961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.416123:0:99961:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d95595b200/0x85f51a6b96714359 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0xb0:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5707 expref: 17 pid: 99961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.416146:0:99961:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d95595b200/0x85f51a6b96714359 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0xb0:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5707 expref: 17 pid: 99961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.416162:0:99961:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d95595b200, rc 0) 00010000:00080000:3.0:1777051204.416420:0:99961:0:(ldlm_lib.c:2086:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00010000:00080000:3.0:1777051204.416434:0:99961:0:(ldlm_lib.c:2438:target_next_replay_lock()) Waiting for lock 00000100:00100000:0.0:1777051204.419529:0:46497:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425834880 00000100:00100000:0.0:1777051204.419537:0:46497:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425834880 00000100:00100000:0.0:1777051204.419894:0:46497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13041 00000100:00100000:0.0:1777051204.419910:0:46497:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d956129880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+17:2435:x1863365425834880:12345-192.168.201.46@tcp:400:ptlrpcd_rcv.0 00010000:00080000:0.0:1777051204.419936:0:46497:0:(ldlm_lib.c:3120:target_queue_recovery_request()) @@@ queue final req req@ffff99d956129880 x1863365425834880/t0(0) o400->2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp:165/0 lens 224/0 e 0 to 0 dl 1777051215 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1777051204.419976:0:46497:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d956129880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+17:2435:x1863365425834880:12345-192.168.201.46@tcp:400:ptlrpcd_rcv.0 Request processed in 70us (558us total) trans 0 rc 0/-999 00000100:00100000:0.0:1777051204.419994:0:46497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13041 00000001:00100000:0.0:1777051204.424886:0:99923:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 2dd4696c-edce-4cd1-86d2-dbd2ff957fa1 00000001:00100000:0.0:1777051204.424899:0:99923:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of c11b6966-0775-44d2-bdc6-c74c26eb2226 00000001:00100000:0.0:1777051204.424904:0:99923:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00080000:0.0:1777051204.439459:0:3676:0:(import.c:65:import_set_state_nolock()) ffff99da7dbeb000 lustre-MDT0000_UUID: changing import state from REPLAY_WAIT to RECOVER 00000100:00080000:0.0:1777051204.439474:0:3676:0:(client.c:3223:ptlrpc_resend_req()) @@@ going to resend req@ffff99d956128000 x1863365452476160/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1777051220 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1777051204.439492:0:3676:0:(client.c:3232:ptlrpc_resend_req()) @@@ it has reply, so skip it req@ffff99d956128000 x1863365452476160/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1777051220 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1777051204.439505:0:3676:0:(import.c:65:import_set_state_nolock()) ffff99da7dbeb000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:0.0:1777051204.441337:0:3676:0:(import.c:1737:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-osp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00080000:0.0:1777051204.441347:0:3676:0:(recover.c:189:ptlrpc_wake_delayed()) @@@ waking (set 00000000e832489d): req@ffff99d955612300 x1863365452454144/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1777051188 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1777051204.441385:0:3676:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d956128000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3676:1863365452476160:0@lo:400:ptlrpcd_rcv.0 00000100:00100000:0.0:1777051204.441655:0:11727:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452454144 00000100:00100000:0.0:1777051204.441681:0:11727:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452454144 00000100:00100000:0.0:1777051204.441757:0:11727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7955 00000100:00100000:0.0:1777051204.441772:0:11727:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95612b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:3679:x1863365452454144:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1777051204.441814:0:11727:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4194304 pending 0 free 1441603584 avail 1295364096 00000100:00100000:0.0:1777051204.441902:0:11727:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95612b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:3679:x1863365452454144:12345-0@lo:41:osp-pre-0-1.0 Request processed in 131us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051204.441915:0:11727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7955 00000100:00100000:0.0:1777051204.442350:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7c9a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452476288:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1777051204.442400:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051204.443954:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7c9a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452476288:0@lo:41:osp-pre-0-1.0 00000004:00080000:3.0:1777051204.493233:0:99945:0:(osp_precreate.c:877:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x15e:0x0] 00000004:00080000:0.0:1777051204.493246:0:99943:0:(osp_precreate.c:877:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x15e:0x0] 00000100:00100000:0.0:1777051204.493300:0:99943:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94ed2ea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:99943:1863365452476544:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1777051204.493300:0:99945:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7c9a0a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:99945:1863365452476416:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1777051204.493415:0:99945:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051204.493479:0:8468:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452476416 00000100:00100000:0.0:1777051204.493491:0:8468:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452476416 00000100:00100000:3.0:1777051204.493494:0:99945:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d958800f00 going to sleep for 11 seconds 00000100:00100000:0.0:1777051204.493606:0:8468:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452476544 00000100:00100000:0.0:1777051204.493614:0:8468:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452476544 00000100:00100000:0.0:1777051204.493693:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7935 00000100:00100000:0.0:1777051204.493724:0:8468:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d956128000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:99943:x1863365452476544:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1777051204.493779:0:8468:0:(ofd_dev.c:1637:ofd_create_hdl()) ofd_last_id() = 417 -> diff = -67 00002000:02000040:0.0:1777051204.493787:0:8468:0:(ofd_dev.c:1488:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:351 to 0x280000401:417) 00000100:00100000:3.0:1777051204.514598:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00002000:00010000:1.0:1777051204.516184:0:8470:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x1a0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777051204.516221:0:8470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000044456dcf/0x85f51a6b96714367 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.516236:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051204.516239:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051204.516245:0:8470:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000044456dcf/0x85f51a6b96714367 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.516262:0:8470:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000044456dcf/0x85f51a6b96714367 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.516275:0:8470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000044456dcf/0x85f51a6b96714367 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.516287:0:8470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000044456dcf/0x85f51a6b96714367 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.516308:0:8470:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1777051204.516369:0:8470:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x19f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777051204.516378:0:8470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007cef667b/0x85f51a6b9671436e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.516390:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051204.516392:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051204.516396:0:8470:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007cef667b/0x85f51a6b9671436e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.516410:0:8470:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007cef667b/0x85f51a6b9671436e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.516421:0:8470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007cef667b/0x85f51a6b9671436e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.516432:0:8470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007cef667b/0x85f51a6b9671436e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.516452:0:8470:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1777051204.516507:0:8470:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x19e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777051204.516516:0:8470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fe12e804/0x85f51a6b96714375 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.516529:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051204.516532:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051204.516537:0:8470:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fe12e804/0x85f51a6b96714375 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.516576:0:8470:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fe12e804/0x85f51a6b96714375 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.516590:0:8470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fe12e804/0x85f51a6b96714375 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.516602:0:8470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fe12e804/0x85f51a6b96714375 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.516622:0:8470:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:1.0:1777051204.516679:0:8470:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x19d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777051204.516687:0:8470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007b859ac7/0x85f51a6b9671437c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.516700:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051204.516702:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051204.516707:0:8470:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007b859ac7/0x85f51a6b9671437c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.516721:0:8470:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007b859ac7/0x85f51a6b9671437c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.516733:0:8470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007b859ac7/0x85f51a6b9671437c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.516741:0:8470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007b859ac7/0x85f51a6b9671437c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.516757:0:8470:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:1.0:1777051204.516767:0:6567:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1777051204.516773:0:6567:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000044456dcf/0x85f51a6b96714367 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.516784:0:6567:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d9442ea600 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:1.0:1777051204.516790:0:6567:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000044456dcf/0x85f51a6b96714367 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.516801:0:6567:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000044456dcf/0x85f51a6b96714367 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.516818:0:6567:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000044456dcf/0x85f51a6b96714367 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.516829:0:6567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000044456dcf/0x85f51a6b96714367 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.516865:0:6567:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1777051204.516871:0:6567:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007cef667b/0x85f51a6b9671436e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.516882:0:6567:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d9442eb000 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:1.0:1777051204.516887:0:6567:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007cef667b/0x85f51a6b9671436e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.516899:0:6567:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007cef667b/0x85f51a6b9671436e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.516915:0:6567:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007cef667b/0x85f51a6b9671436e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.516926:0:6567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007cef667b/0x85f51a6b9671436e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.516945:0:6567:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1777051204.516949:0:6567:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fe12e804/0x85f51a6b96714375 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.516959:0:6567:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d9442eb800 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:1.0:1777051204.516963:0:6567:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fe12e804/0x85f51a6b96714375 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.516974:0:6567:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fe12e804/0x85f51a6b96714375 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.516989:0:6567:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fe12e804/0x85f51a6b96714375 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.517000:0:6567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fe12e804/0x85f51a6b96714375 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.517018:0:6567:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777051204.517024:0:6567:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007b859ac7/0x85f51a6b9671437c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.517035:0:6567:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d9442ea000 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:1.0:1777051204.517039:0:6567:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007b859ac7/0x85f51a6b9671437c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.517052:0:6567:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007b859ac7/0x85f51a6b9671437c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.517067:0:6567:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007b859ac7/0x85f51a6b9671437c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.517079:0:6567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007b859ac7/0x85f51a6b9671437c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.517096:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051204.517099:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051204.517102:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1777051204.517176:0:8470:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x19c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777051204.517185:0:8470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006e16e75b/0x85f51a6b96714383 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.517199:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051204.517202:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051204.517207:0:8470:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006e16e75b/0x85f51a6b96714383 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.517249:0:8470:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006e16e75b/0x85f51a6b96714383 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.517262:0:8470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006e16e75b/0x85f51a6b96714383 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.517274:0:8470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006e16e75b/0x85f51a6b96714383 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.517298:0:8470:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1777051204.517309:0:6567:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777051204.517316:0:6567:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006e16e75b/0x85f51a6b96714383 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.517329:0:6567:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d9442ea200 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:1.0:1777051204.517334:0:6567:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006e16e75b/0x85f51a6b96714383 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.517348:0:6567:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006e16e75b/0x85f51a6b96714383 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.517365:0:6567:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006e16e75b/0x85f51a6b96714383 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.517378:0:6567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006e16e75b/0x85f51a6b96714383 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.517401:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051204.517403:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051204.517405:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1777051204.517468:0:8470:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x19b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777051204.517478:0:8470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b7f160cd/0x85f51a6b9671438a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.517492:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051204.517495:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051204.517500:0:8470:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b7f160cd/0x85f51a6b9671438a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.517524:0:8470:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b7f160cd/0x85f51a6b9671438a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.517537:0:8470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b7f160cd/0x85f51a6b9671438a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.517984:0:8470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b7f160cd/0x85f51a6b9671438a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.518014:0:8470:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1777051204.518026:0:6567:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777051204.518032:0:6567:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b7f160cd/0x85f51a6b9671438a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.518043:0:6567:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d9442ea800 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:1.0:1777051204.518047:0:6567:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b7f160cd/0x85f51a6b9671438a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.518060:0:6567:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b7f160cd/0x85f51a6b9671438a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.518078:0:6567:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b7f160cd/0x85f51a6b9671438a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.518090:0:6567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b7f160cd/0x85f51a6b9671438a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.518113:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051204.518116:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051204.518119:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1777051204.518182:0:8470:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x19a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777051204.518191:0:8470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000086c63cdc/0x85f51a6b96714391 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.518204:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051204.518207:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051204.518212:0:8470:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000086c63cdc/0x85f51a6b96714391 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.518225:0:8470:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000086c63cdc/0x85f51a6b96714391 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.518234:0:8470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000086c63cdc/0x85f51a6b96714391 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.518241:0:8470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000086c63cdc/0x85f51a6b96714391 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.518258:0:8470:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1777051204.518268:0:6567:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777051204.518273:0:6567:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000086c63cdc/0x85f51a6b96714391 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.518292:0:6567:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d9442eac00 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:1.0:1777051204.518297:0:6567:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000086c63cdc/0x85f51a6b96714391 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.518310:0:6567:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000086c63cdc/0x85f51a6b96714391 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.518328:0:6567:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000086c63cdc/0x85f51a6b96714391 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.518340:0:6567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000086c63cdc/0x85f51a6b96714391 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.518362:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051204.518365:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051204.518368:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1777051204.518469:0:8470:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x199:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777051204.518479:0:8470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d6dbcff1/0x85f51a6b96714398 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x199:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.518493:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051204.518496:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051204.518500:0:8470:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d6dbcff1/0x85f51a6b96714398 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x199:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.518516:0:8470:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d6dbcff1/0x85f51a6b96714398 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x199:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.518530:0:8470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d6dbcff1/0x85f51a6b96714398 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x199:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.518544:0:8470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d6dbcff1/0x85f51a6b96714398 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x199:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.518592:0:8470:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1777051204.518606:0:6567:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777051204.518614:0:6567:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d6dbcff1/0x85f51a6b96714398 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x199:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.518684:0:6567:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d955a8e800 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:1.0:1777051204.518691:0:6567:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d6dbcff1/0x85f51a6b96714398 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x199:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.518704:0:6567:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d6dbcff1/0x85f51a6b96714398 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x199:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.518726:0:6567:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d6dbcff1/0x85f51a6b96714398 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x199:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.518746:0:6567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d6dbcff1/0x85f51a6b96714398 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x199:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.519096:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051204.519101:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051204.519104:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1777051204.519185:0:8470:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x198:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777051204.519231:0:8470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005c4d4f80/0x85f51a6b9671439f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x198:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.519247:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051204.519250:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051204.519255:0:8470:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005c4d4f80/0x85f51a6b9671439f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x198:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.519272:0:8470:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005c4d4f80/0x85f51a6b9671439f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x198:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.519286:0:8470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005c4d4f80/0x85f51a6b9671439f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x198:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.519297:0:8470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005c4d4f80/0x85f51a6b9671439f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x198:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.519320:0:8470:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1777051204.519333:0:6567:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777051204.519340:0:6567:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005c4d4f80/0x85f51a6b9671439f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x198:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.519351:0:6567:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d955a8e200 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:1.0:1777051204.519356:0:6567:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005c4d4f80/0x85f51a6b9671439f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x198:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.519378:0:6567:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005c4d4f80/0x85f51a6b9671439f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x198:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.519396:0:6567:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005c4d4f80/0x85f51a6b9671439f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x198:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.519408:0:6567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005c4d4f80/0x85f51a6b9671439f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x198:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.519434:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051204.519437:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051204.519440:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051204.520360:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1777051204.520376:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051204.520433:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051204.520484:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051204.520541:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051204.520546:0:27884:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425835392 00000100:00100000:3.0:1777051204.520596:0:27884:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425835392 00000100:00100000:1.0:1777051204.520669:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051204.520891:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00002000:00010000:1.0:1777051204.520999:0:8470:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x197:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777051204.521011:0:8470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003c36c963/0x85f51a6b967143a6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x197:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.521336:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051204.521341:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051204.521347:0:8470:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c36c963/0x85f51a6b967143a6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x197:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.521375:0:8470:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003c36c963/0x85f51a6b967143a6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x197:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.521392:0:8470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003c36c963/0x85f51a6b967143a6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x197:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.521408:0:8470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003c36c963/0x85f51a6b967143a6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x197:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.521437:0:8470:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1777051204.521472:0:27887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10111 00000100:00100000:1.0:1777051204.521495:0:27887:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955ebf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c11b6966-0775-44d2-bdc6-c74c26eb2226+48:2436:x1863365425835392:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:3.0:1777051204.521530:0:27884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10113 00000100:00100000:3.0:1777051204.521577:0:27884:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94e627800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+50:2436:x1863365425835648:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:1.0:1777051204.521600:0:27887:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955ebf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c11b6966-0775-44d2-bdc6-c74c26eb2226+48:2436:x1863365425835392:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 110us (1162us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051204.521627:0:27887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10111 00000100:00100000:3.0:1777051204.521651:0:27884:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94e627800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+50:2436:x1863365425835648:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 101us (1107us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051204.521670:0:27887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10114 00000100:00100000:3.0:1777051204.521684:0:27884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10113 00000100:00100000:1.0:1777051204.521693:0:27887:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94e625180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+47:2437:x1863365425835776:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:1.0:1777051204.521754:0:27887:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94e625180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+47:2437:x1863365425835776:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 70us (872us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051204.521768:0:27887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10114 00010000:00010000:1.0:1777051204.521815:0:6567:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777051204.521824:0:6567:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003c36c963/0x85f51a6b967143a6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x197:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.521847:0:6567:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d955a8e600 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:1.0:1777051204.521854:0:6567:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003c36c963/0x85f51a6b967143a6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x197:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.521870:0:6567:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003c36c963/0x85f51a6b967143a6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x197:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.521893:0:6567:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003c36c963/0x85f51a6b967143a6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x197:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.521907:0:6567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003c36c963/0x85f51a6b967143a6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x197:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.521933:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051204.521937:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051204.521940:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1777051204.522017:0:8470:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x196:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777051204.522026:0:8470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e7e9f35d/0x85f51a6b967143ad lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x196:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.522039:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051204.522042:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051204.522046:0:8470:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e7e9f35d/0x85f51a6b967143ad lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x196:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.522061:0:8470:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e7e9f35d/0x85f51a6b967143ad lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x196:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.522074:0:8470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e7e9f35d/0x85f51a6b967143ad lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x196:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.522086:0:8470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e7e9f35d/0x85f51a6b967143ad lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x196:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.522119:0:8470:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1777051204.522177:0:8470:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x195:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777051204.522185:0:8470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000059ff3362/0x85f51a6b967143b4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x195:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.522226:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051204.522229:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051204.522235:0:8470:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000059ff3362/0x85f51a6b967143b4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x195:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.522251:0:8470:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000059ff3362/0x85f51a6b967143b4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x195:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.522264:0:8470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000059ff3362/0x85f51a6b967143b4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x195:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.522277:0:8470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000059ff3362/0x85f51a6b967143b4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x195:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.522298:0:8470:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1777051204.522369:0:8470:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x194:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777051204.522379:0:8470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008d6ae8ef/0x85f51a6b967143bb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x194:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.522391:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051204.522394:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051204.522399:0:8470:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008d6ae8ef/0x85f51a6b967143bb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x194:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.522413:0:8470:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008d6ae8ef/0x85f51a6b967143bb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x194:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.522425:0:8470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008d6ae8ef/0x85f51a6b967143bb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x194:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.522436:0:8470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008d6ae8ef/0x85f51a6b967143bb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x194:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.522456:0:8470:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:1.0:1777051204.522510:0:8470:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x193:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777051204.522517:0:8470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002d5e2d19/0x85f51a6b967143c2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x193:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.522528:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051204.522531:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051204.522536:0:8470:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002d5e2d19/0x85f51a6b967143c2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x193:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.522583:0:8470:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002d5e2d19/0x85f51a6b967143c2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x193:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.522599:0:8470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002d5e2d19/0x85f51a6b967143c2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x193:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.522612:0:8470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002d5e2d19/0x85f51a6b967143c2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x193:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.522636:0:8470:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:1.0:1777051204.522650:0:6567:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1777051204.522658:0:6567:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e7e9f35d/0x85f51a6b967143ad lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x196:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.522670:0:6567:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d955a8ec00 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:1.0:1777051204.522676:0:6567:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e7e9f35d/0x85f51a6b967143ad lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x196:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.522689:0:6567:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e7e9f35d/0x85f51a6b967143ad lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x196:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.522706:0:6567:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e7e9f35d/0x85f51a6b967143ad lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x196:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.522720:0:6567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e7e9f35d/0x85f51a6b967143ad lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x196:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.522751:0:6567:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1777051204.522757:0:6567:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000059ff3362/0x85f51a6b967143b4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x195:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.523051:0:13753:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1777051204.523056:0:6567:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d955a8f000 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:3.0:1777051204.523064:0:13753:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008d6ae8ef/0x85f51a6b967143bb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x194:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.523065:0:6567:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000059ff3362/0x85f51a6b967143b4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x195:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.523105:0:13753:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d955a8ee00 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:1.0:1777051204.523109:0:6567:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000059ff3362/0x85f51a6b967143b4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x195:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.523115:0:13753:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008d6ae8ef/0x85f51a6b967143bb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x194:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.523151:0:13753:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008d6ae8ef/0x85f51a6b967143bb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x194:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.523152:0:6567:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000059ff3362/0x85f51a6b967143b4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x195:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.523191:0:6567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000059ff3362/0x85f51a6b967143b4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x195:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.523235:0:13753:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008d6ae8ef/0x85f51a6b967143bb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x194:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.523249:0:6567:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777051204.523255:0:13753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008d6ae8ef/0x85f51a6b967143bb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x194:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.523257:0:6567:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002d5e2d19/0x85f51a6b967143c2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x193:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.523298:0:6567:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d955a8f400 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:1.0:1777051204.523305:0:6567:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002d5e2d19/0x85f51a6b967143c2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x193:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.523320:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051204.523321:0:6567:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002d5e2d19/0x85f51a6b967143c2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x193:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.523328:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051204.523335:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051204.523358:0:6567:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002d5e2d19/0x85f51a6b967143c2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x193:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.523370:0:6567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002d5e2d19/0x85f51a6b967143c2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x193:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.523392:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051204.523396:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051204.523399:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1777051204.523468:0:8470:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x192:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777051204.523477:0:8470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002e2f0676/0x85f51a6b967143c9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x192:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.523492:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051204.523495:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051204.523500:0:8470:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002e2f0676/0x85f51a6b967143c9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x192:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.523515:0:8470:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002e2f0676/0x85f51a6b967143c9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x192:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.523529:0:8470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002e2f0676/0x85f51a6b967143c9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x192:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.523542:0:8470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002e2f0676/0x85f51a6b967143c9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x192:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.526869:0:8470:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1777051204.526917:0:6568:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777051204.526930:0:6568:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002e2f0676/0x85f51a6b967143c9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x192:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.526949:0:6568:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d955a8f800 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:3.0:1777051204.526957:0:6568:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002e2f0676/0x85f51a6b967143c9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x192:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.526975:0:6568:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002e2f0676/0x85f51a6b967143c9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x192:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1777051204.526979:0:8470:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x191:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777051204.527002:0:8470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003c75feec/0x85f51a6b967143d0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x191:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.527014:0:6568:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002e2f0676/0x85f51a6b967143c9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x192:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.527020:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051204.527026:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051204.527036:0:8470:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c75feec/0x85f51a6b967143d0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x191:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.527038:0:6568:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002e2f0676/0x85f51a6b967143c9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x192:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.527080:0:8470:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003c75feec/0x85f51a6b967143d0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x191:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.527097:0:8470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003c75feec/0x85f51a6b967143d0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x191:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.527100:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051204.527105:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051204.527111:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051204.527120:0:8470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003c75feec/0x85f51a6b967143d0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x191:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.527154:0:8470:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1777051204.527218:0:8470:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x190:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777051204.527226:0:8470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008f2c258c/0x85f51a6b967143d7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x190:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.527238:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051204.527241:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051204.527248:0:8470:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008f2c258c/0x85f51a6b967143d7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x190:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.527265:0:8470:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008f2c258c/0x85f51a6b967143d7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x190:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.527278:0:8470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008f2c258c/0x85f51a6b967143d7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x190:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.527290:0:8470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008f2c258c/0x85f51a6b967143d7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x190:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.527318:0:8470:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1777051204.527367:0:13753:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1777051204.527378:0:13753:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003c75feec/0x85f51a6b967143d0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x191:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.527395:0:13753:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d955a8e400 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:3.0:1777051204.527404:0:13753:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003c75feec/0x85f51a6b967143d0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x191:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1777051204.527405:0:8470:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x18f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777051204.527425:0:8470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000096a3a23f/0x85f51a6b967143de lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.527433:0:13753:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003c75feec/0x85f51a6b967143d0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x191:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.527472:0:13753:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003c75feec/0x85f51a6b967143d0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x191:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.527494:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051204.527496:0:13753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003c75feec/0x85f51a6b967143d0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x191:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.527503:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051204.527514:0:8470:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000096a3a23f/0x85f51a6b967143de lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.527585:0:8470:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000096a3a23f/0x85f51a6b967143de lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.527585:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051204.527592:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051204.527599:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051204.527628:0:8470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000096a3a23f/0x85f51a6b967143de lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.527668:0:8470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000096a3a23f/0x85f51a6b967143de lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.527709:0:8470:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1777051204.527750:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051204.528247:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051204.528252:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051204.528257:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051204.528434:0:8470:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1777051204.528515:0:8470:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x18d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777051204.528528:0:8470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006cb02dc1/0x85f51a6b967143ec lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.528594:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051204.528600:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051204.528610:0:8470:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006cb02dc1/0x85f51a6b967143ec lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.528630:0:8470:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006cb02dc1/0x85f51a6b967143ec lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.528652:0:8470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006cb02dc1/0x85f51a6b967143ec lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.528666:0:8470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006cb02dc1/0x85f51a6b967143ec lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.528700:0:8470:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1777051204.528769:0:8470:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x18c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777051204.528778:0:8470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c9fbe2bd/0x85f51a6b967143f3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.528792:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051204.528794:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051204.528800:0:8470:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c9fbe2bd/0x85f51a6b967143f3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.528822:0:8470:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c9fbe2bd/0x85f51a6b967143f3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.528835:0:8470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c9fbe2bd/0x85f51a6b967143f3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.528848:0:8470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c9fbe2bd/0x85f51a6b967143f3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.528881:0:8470:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1777051204.528944:0:6567:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00002000:00010000:3.0:1777051204.528944:0:8470:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x18b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777051204.528960:0:6567:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c9fbe2bd/0x85f51a6b967143f3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.528964:0:8470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a40f0ac0/0x85f51a6b967143fa lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.528992:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051204.528998:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051204.529005:0:8470:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a40f0ac0/0x85f51a6b967143fa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.529017:0:6567:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d95595ac00 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:1.0:1777051204.529030:0:6567:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c9fbe2bd/0x85f51a6b967143f3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.529049:0:8470:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a40f0ac0/0x85f51a6b967143fa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.529075:0:6567:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c9fbe2bd/0x85f51a6b967143f3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.529094:0:8470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a40f0ac0/0x85f51a6b967143fa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.529112:0:8470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a40f0ac0/0x85f51a6b967143fa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.529420:0:6567:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c9fbe2bd/0x85f51a6b967143f3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x18c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.529437:0:6567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c9fbe2bd/0x85f51a6b967143f3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.529486:0:6567:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777051204.529493:0:6567:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a40f0ac0/0x85f51a6b967143fa lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.529504:0:8470:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1777051204.529525:0:6567:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d95595b600 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:1.0:1777051204.529531:0:6567:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a40f0ac0/0x85f51a6b967143fa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.529544:0:6567:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a40f0ac0/0x85f51a6b967143fa lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.529593:0:6567:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a40f0ac0/0x85f51a6b967143fa lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x18b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.529606:0:6567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a40f0ac0/0x85f51a6b967143fa lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1777051204.529616:0:8470:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x18a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777051204.529629:0:8470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c429bca5/0x85f51a6b96714401 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.529630:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051204.529637:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051204.529643:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051204.529653:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051204.529658:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051204.529663:0:8470:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c429bca5/0x85f51a6b96714401 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.529680:0:8470:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c429bca5/0x85f51a6b96714401 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.529693:0:8470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c429bca5/0x85f51a6b96714401 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.529706:0:8470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c429bca5/0x85f51a6b96714401 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.529736:0:8470:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1777051204.529800:0:8470:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x189:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777051204.529815:0:8470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000035b77175/0x85f51a6b96714408 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x189:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.529841:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051204.529846:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051204.529855:0:8470:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000035b77175/0x85f51a6b96714408 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x189:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.529897:0:8470:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000035b77175/0x85f51a6b96714408 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x189:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.529924:0:8470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000035b77175/0x85f51a6b96714408 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x189:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.529956:0:8470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000035b77175/0x85f51a6b96714408 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x189:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.529993:0:8470:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1777051204.530041:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1777051204.530065:0:8470:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x188:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777051204.530084:0:8470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006f555381/0x85f51a6b9671440f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x188:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.530101:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051204.530106:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051204.530114:0:8470:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006f555381/0x85f51a6b9671440f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x188:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.530131:0:8470:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006f555381/0x85f51a6b9671440f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x188:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.530144:0:8470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006f555381/0x85f51a6b9671440f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x188:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.530165:0:8470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006f555381/0x85f51a6b9671440f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x188:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.530193:0:8470:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1777051204.530267:0:6567:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777051204.530277:0:6567:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006f555381/0x85f51a6b9671440f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x188:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1777051204.530280:0:8470:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x187:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777051204.530299:0:8470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007692fab8/0x85f51a6b96714416 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x187:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.530303:0:6567:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d95595ae00 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:1.0:1777051204.530316:0:6567:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006f555381/0x85f51a6b9671440f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x188:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.530321:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051204.530326:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051204.530334:0:8470:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007692fab8/0x85f51a6b96714416 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x187:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.530381:0:6567:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006f555381/0x85f51a6b9671440f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x188:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.530384:0:8470:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007692fab8/0x85f51a6b96714416 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x187:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.530421:0:8470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007692fab8/0x85f51a6b96714416 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x187:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.530423:0:6567:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006f555381/0x85f51a6b9671440f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x188:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.530459:0:6567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006f555381/0x85f51a6b9671440f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x188:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.530464:0:8470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007692fab8/0x85f51a6b96714416 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x187:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.530485:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051204.530489:0:6567:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777051204.530493:0:6567:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007692fab8/0x85f51a6b96714416 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x187:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.530503:0:8470:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1777051204.530505:0:6567:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d95595aa00 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:1.0:1777051204.530515:0:6567:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007692fab8/0x85f51a6b96714416 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x187:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.530529:0:6567:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007692fab8/0x85f51a6b96714416 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x187:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.530549:0:6567:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007692fab8/0x85f51a6b96714416 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x187:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.530591:0:6567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007692fab8/0x85f51a6b96714416 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x187:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1777051204.530602:0:8470:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x186:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777051204.530615:0:8470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000062488c71/0x85f51a6b9671441d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x186:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.530617:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051204.530622:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051204.530626:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051204.530645:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051204.530648:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051204.530654:0:8470:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000062488c71/0x85f51a6b9671441d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x186:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.530675:0:8470:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000062488c71/0x85f51a6b9671441d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x186:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.530689:0:8470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000062488c71/0x85f51a6b9671441d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x186:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.530702:0:8470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000062488c71/0x85f51a6b9671441d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x186:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.530735:0:8470:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1777051204.530796:0:8470:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x185:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777051204.530804:0:8470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e60ecbf9/0x85f51a6b96714424 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x185:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.530817:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051204.530820:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051204.530825:0:8470:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e60ecbf9/0x85f51a6b96714424 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x185:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.530847:0:8470:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e60ecbf9/0x85f51a6b96714424 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x185:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.530870:0:8470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e60ecbf9/0x85f51a6b96714424 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x185:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.530882:0:8470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e60ecbf9/0x85f51a6b96714424 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x185:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.530918:0:8470:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1777051204.530985:0:8470:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x184:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777051204.530994:0:8470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005fe8468b/0x85f51a6b9671442b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x184:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.531008:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051204.531014:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051204.531020:0:8470:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005fe8468b/0x85f51a6b9671442b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x184:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.531333:0:8470:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005fe8468b/0x85f51a6b9671442b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x184:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.531349:0:8470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005fe8468b/0x85f51a6b9671442b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x184:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.531362:0:8470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005fe8468b/0x85f51a6b9671442b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x184:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.531392:0:8470:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1777051204.531395:0:13753:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1777051204.531404:0:13753:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e60ecbf9/0x85f51a6b96714424 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x185:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.531409:0:6567:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777051204.531422:0:13753:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da429d6800 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:3.0:1777051204.531422:0:6567:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005fe8468b/0x85f51a6b9671442b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x184:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.531429:0:13753:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e60ecbf9/0x85f51a6b96714424 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x185:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.531465:0:6567:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da429d7a00 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:1.0:1777051204.531473:0:13753:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e60ecbf9/0x85f51a6b96714424 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x185:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.531478:0:6567:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005fe8468b/0x85f51a6b9671442b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x184:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.531509:0:6567:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005fe8468b/0x85f51a6b9671442b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x184:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.531512:0:13753:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e60ecbf9/0x85f51a6b96714424 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x185:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.531581:0:13753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e60ecbf9/0x85f51a6b96714424 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x185:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.531588:0:6567:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005fe8468b/0x85f51a6b9671442b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x184:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.531633:0:6567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005fe8468b/0x85f51a6b9671442b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x184:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.531638:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051204.531645:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051204.531652:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051204.531676:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051204.531681:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051204.531686:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1777051204.531762:0:8470:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x183:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777051204.531771:0:8470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f0c7272c/0x85f51a6b96714432 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x183:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.531784:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051204.531786:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051204.531791:0:8470:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f0c7272c/0x85f51a6b96714432 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x183:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.531814:0:8470:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f0c7272c/0x85f51a6b96714432 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x183:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.531827:0:8470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f0c7272c/0x85f51a6b96714432 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x183:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.531839:0:8470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f0c7272c/0x85f51a6b96714432 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x183:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.531870:0:8470:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1777051204.531932:0:8470:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x182:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777051204.531943:0:8470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d4050073/0x85f51a6b96714439 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x182:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.531986:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051204.531991:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051204.532000:0:8470:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d4050073/0x85f51a6b96714439 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x182:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.532043:0:8470:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d4050073/0x85f51a6b96714439 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x182:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.532077:0:8470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d4050073/0x85f51a6b96714439 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x182:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.532107:0:8470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d4050073/0x85f51a6b96714439 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x182:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.532155:0:8470:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1777051204.532444:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:3.0:1777051204.532735:0:8470:0:(ofd_dev.c:1515:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:350 00000100:00100000:3.0:1777051204.532857:0:8470:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7c9a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:99945:x1863365452476416:12345-0@lo:5:osp-pre-1-0.0 Request processed in 39163us (39441us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051204.532872:0:8470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7934 00000100:00100000:1.0:1777051204.533298:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7fdf1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452476672:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1777051204.533641:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051204.533727:0:8473:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452476672 00000100:00100000:3.0:1777051204.533739:0:8473:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452476672 00000100:00100000:3.0:1777051204.533835:0:8473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5488 00000100:00100000:3.0:1777051204.533854:0:8473:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94e625f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3679:x1863365452476672:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1777051204.533885:0:8473:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 430296128 pending 0 free 3645853696 avail 3414331392 00000100:00100000:3.0:1777051204.533969:0:8473:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94e625f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3679:x1863365452476672:12345-0@lo:13:osp-pre-1-0.0 Request processed in 119us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051204.533982:0:8473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5488 00000100:00100000:1.0:1777051204.534519:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7fdf1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452476672:0@lo:13:osp-pre-1-0.0 00002000:00010000:0.0:1777051204.534783:0:8468:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x1a1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1777051204.534798:0:8468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008f4e2bdb/0x85f51a6b96714440 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051204.534818:0:8468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777051204.534823:0:8468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777051204.534830:0:8468:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008f4e2bdb/0x85f51a6b96714440 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051204.534853:0:8468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008f4e2bdb/0x85f51a6b96714440 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051204.534877:0:8468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008f4e2bdb/0x85f51a6b96714440 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051204.534891:0:8468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008f4e2bdb/0x85f51a6b96714440 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051204.534931:0:8468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1777051204.535075:0:8468:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x1a0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1777051204.535352:0:8468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004eb8931b/0x85f51a6b96714447 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051204.535371:0:8468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777051204.535375:0:8468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777051204.535381:0:8468:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004eb8931b/0x85f51a6b96714447 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051204.535399:0:8468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004eb8931b/0x85f51a6b96714447 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051204.535417:0:8468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004eb8931b/0x85f51a6b96714447 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051204.535430:0:8468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004eb8931b/0x85f51a6b96714447 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051204.535533:0:8468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1777051204.535637:0:6567:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1777051204.535647:0:6567:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004eb8931b/0x85f51a6b96714447 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051204.535662:0:6567:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da7d507600 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:0.0:1777051204.535671:0:6567:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004eb8931b/0x85f51a6b96714447 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051204.535685:0:6567:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004eb8931b/0x85f51a6b96714447 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051204.535708:0:6567:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004eb8931b/0x85f51a6b96714447 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051204.535725:0:6567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004eb8931b/0x85f51a6b96714447 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051204.535754:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777051204.535758:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777051204.535763:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777051204.537187:0:8471:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fdf3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:99945:x1863365452476800:12345-0@lo:5:osp-pre-1-0.0 Request processed in 3324us (3540us total) trans 4294968349 rc 0/0 00000100:00100000:3.0:1777051204.537231:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7936 00000100:00100000:0.0:1777051204.537460:0:99945:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7fdf1180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:99945:1863365452476800:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1777051204.537482:0:99945:0:(osp_precreate.c:701:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x1a1:0x0]-[0x2c0000401:0x1c1:0x0] 00002000:00010000:0.0:1777051204.538057:0:8468:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x19f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1777051204.538071:0:8468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c2e44b85/0x85f51a6b9671444e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051204.538089:0:8468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777051204.538094:0:8468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777051204.538099:0:8468:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c2e44b85/0x85f51a6b9671444e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051204.538118:0:8468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c2e44b85/0x85f51a6b9671444e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051204.538134:0:8468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c2e44b85/0x85f51a6b9671444e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051204.538406:0:8468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c2e44b85/0x85f51a6b9671444e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051204.538438:0:8468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1777051204.538513:0:8468:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x19e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1777051204.538526:0:8468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ee707457/0x85f51a6b96714455 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051204.538540:0:8468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777051204.538544:0:8468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777051204.538585:0:8468:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ee707457/0x85f51a6b96714455 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051204.538609:0:8468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ee707457/0x85f51a6b96714455 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051204.538662:0:8468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ee707457/0x85f51a6b96714455 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051204.538685:0:8468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ee707457/0x85f51a6b96714455 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.539170:0:8468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1777051204.539256:0:8468:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x19d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777051204.539270:0:13753:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777051204.539279:0:8468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000070869722/0x85f51a6b9671445c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.539287:0:13753:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ee707457/0x85f51a6b96714455 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.539318:0:8468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051204.539325:0:8468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051204.539336:0:8468:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000070869722/0x85f51a6b9671445c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.539338:0:13753:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da7d507a00 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:1.0:1777051204.539351:0:13753:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ee707457/0x85f51a6b96714455 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.539407:0:13753:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ee707457/0x85f51a6b96714455 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.539412:0:8468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000070869722/0x85f51a6b9671445c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.539459:0:8468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000070869722/0x85f51a6b9671445c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.539465:0:13753:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ee707457/0x85f51a6b96714455 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x19e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.539486:0:8468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000070869722/0x85f51a6b9671445c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.539505:0:13753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ee707457/0x85f51a6b96714455 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.539538:0:13753:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777051204.539545:0:13753:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000070869722/0x85f51a6b9671445c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.539578:0:8468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1777051204.539597:0:13753:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da429d6200 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:1.0:1777051204.539606:0:13753:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000070869722/0x85f51a6b9671445c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.539623:0:13753:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000070869722/0x85f51a6b9671445c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.539646:0:13753:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000070869722/0x85f51a6b9671445c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x19d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.539662:0:13753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000070869722/0x85f51a6b9671445c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.539689:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051204.539694:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051204.539985:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1777051204.539985:0:8468:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x19c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777051204.540002:0:8468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006fb857ee/0x85f51a6b96714463 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.540018:0:8468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051204.540021:0:8468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051204.540026:0:8468:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006fb857ee/0x85f51a6b96714463 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.540070:0:8468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006fb857ee/0x85f51a6b96714463 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.540084:0:8468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006fb857ee/0x85f51a6b96714463 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.540096:0:8468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006fb857ee/0x85f51a6b96714463 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.540129:0:8468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1777051204.540514:0:8468:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x19b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777051204.540524:0:8468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000062812b6e/0x85f51a6b9671446a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.540540:0:8468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051204.540544:0:8468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051204.540550:0:8468:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000062812b6e/0x85f51a6b9671446a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.540602:0:8468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000062812b6e/0x85f51a6b9671446a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.540617:0:8468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000062812b6e/0x85f51a6b9671446a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.540631:0:8468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000062812b6e/0x85f51a6b9671446a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.540670:0:8468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1777051204.540734:0:8468:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x19a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777051204.540744:0:8468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000018a39fb2/0x85f51a6b96714471 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.540759:0:8468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051204.540764:0:8468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051204.540775:0:8468:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000018a39fb2/0x85f51a6b96714471 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051204.540812:0:6567:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777051204.540821:0:8468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000018a39fb2/0x85f51a6b96714471 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051204.540825:0:6567:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000062812b6e/0x85f51a6b9671446a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.540871:0:8468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000018a39fb2/0x85f51a6b96714471 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051204.540878:0:6567:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da429d7000 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:0.0:1777051204.540892:0:6567:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000062812b6e/0x85f51a6b9671446a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.540915:0:8468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000018a39fb2/0x85f51a6b96714471 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051204.540947:0:6567:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000062812b6e/0x85f51a6b9671446a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.540965:0:8468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1777051204.541009:0:6567:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000062812b6e/0x85f51a6b9671446a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x19b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051204.541026:0:6567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000062812b6e/0x85f51a6b9671446a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1777051204.541044:0:8468:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x199:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777051204.541064:0:8468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b80c72bd/0x85f51a6b96714478 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x199:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051204.541074:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777051204.541084:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051204.541086:0:8468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777051204.541090:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051204.541411:0:8468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051204.541422:0:8468:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b80c72bd/0x85f51a6b96714478 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x199:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.541446:0:8468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b80c72bd/0x85f51a6b96714478 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x199:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.541466:0:8468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b80c72bd/0x85f51a6b96714478 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x199:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.541540:0:8468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b80c72bd/0x85f51a6b96714478 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x199:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.541598:0:8468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1777051204.541692:0:8468:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x198:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777051204.541716:0:8468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005fe8468b/0x85f51a6b9671447f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x198:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051204.541739:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051204.541758:0:8468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051204.541763:0:8468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051204.541770:0:8468:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005fe8468b/0x85f51a6b9671447f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x198:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.541790:0:8468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005fe8468b/0x85f51a6b9671447f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x198:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.541813:0:8468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005fe8468b/0x85f51a6b9671447f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x198:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.541829:0:8468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005fe8468b/0x85f51a6b9671447f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x198:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.541869:0:8468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1777051204.541932:0:6567:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00002000:00010000:3.0:1777051204.541934:0:8468:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x197:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1777051204.541945:0:6567:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005fe8468b/0x85f51a6b9671447f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x198:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.541946:0:8468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e60ecbf9/0x85f51a6b96714486 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x197:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051204.541985:0:6567:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da429d7a00 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:0.0:1777051204.541997:0:6567:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005fe8468b/0x85f51a6b9671447f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x198:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.541998:0:8468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051204.542003:0:8468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051204.542011:0:8468:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e60ecbf9/0x85f51a6b96714486 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x197:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051204.542031:0:6567:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005fe8468b/0x85f51a6b9671447f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x198:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.542039:0:8468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e60ecbf9/0x85f51a6b96714486 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x197:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.542066:0:8468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e60ecbf9/0x85f51a6b96714486 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x197:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051204.542071:0:6567:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005fe8468b/0x85f51a6b9671447f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x198:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.542094:0:8468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e60ecbf9/0x85f51a6b96714486 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x197:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.542125:0:8468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1777051204.542169:0:13753:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777051204.542181:0:13753:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e60ecbf9/0x85f51a6b96714486 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x197:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1777051204.542192:0:8468:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x196:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777051204.542240:0:8468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d4050073/0x85f51a6b9671448d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x196:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.542255:0:8468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051204.542257:0:8468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051204.542262:0:8468:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d4050073/0x85f51a6b9671448d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x196:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.542278:0:8468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d4050073/0x85f51a6b9671448d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x196:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.542302:0:8468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d4050073/0x85f51a6b9671448d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x196:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.542315:0:8468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d4050073/0x85f51a6b9671448d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x196:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.542342:0:8468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1777051204.542368:0:6567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005fe8468b/0x85f51a6b9671447f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x198:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051204.542406:0:6567:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00002000:00010000:3.0:1777051204.542410:0:8468:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x195:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1777051204.542415:0:6567:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d4050073/0x85f51a6b9671448d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x196:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.542423:0:8468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f0c7272c/0x85f51a6b96714494 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x195:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051204.542444:0:6567:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da429d7200 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:3.0:1777051204.542451:0:8468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051204.542455:0:8468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051204.542460:0:8468:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f0c7272c/0x85f51a6b96714494 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x195:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.542478:0:8468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f0c7272c/0x85f51a6b96714494 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x195:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.542493:0:8468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f0c7272c/0x85f51a6b96714494 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x195:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051204.542497:0:6567:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d4050073/0x85f51a6b9671448d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x196:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.542519:0:8468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f0c7272c/0x85f51a6b96714494 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x195:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051204.542530:0:6567:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d4050073/0x85f51a6b9671448d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x196:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051204.542586:0:6567:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d4050073/0x85f51a6b9671448d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x196:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.542594:0:13753:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da429d6800 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:0.0:1777051204.542606:0:6567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d4050073/0x85f51a6b9671448d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x196:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.542611:0:13753:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e60ecbf9/0x85f51a6b96714486 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x197:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.542647:0:13753:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e60ecbf9/0x85f51a6b96714486 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x197:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051204.542653:0:6567:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1777051204.542665:0:6567:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f0c7272c/0x85f51a6b96714494 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x195:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.542675:0:13753:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e60ecbf9/0x85f51a6b96714486 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x197:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051204.542681:0:6567:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da429d7e00 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:0.0:1777051204.542692:0:6567:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f0c7272c/0x85f51a6b96714494 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x195:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.542701:0:13753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e60ecbf9/0x85f51a6b96714486 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x197:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051204.542720:0:6567:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f0c7272c/0x85f51a6b96714494 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x195:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051204.542766:0:6567:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f0c7272c/0x85f51a6b96714494 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x195:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.542778:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777051204.542782:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051204.542784:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777051204.542788:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051204.542792:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777051204.542794:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051204.543958:0:8468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1777051204.543969:0:8468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f0c7272c/0x85f51a6b96714494 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x195:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1777051204.544059:0:8468:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x194:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777051204.544068:0:8468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000062488c71/0x85f51a6b9671449b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x194:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.544083:0:8468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051204.544085:0:8468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051204.544090:0:8468:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000062488c71/0x85f51a6b9671449b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x194:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.544106:0:8468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000062488c71/0x85f51a6b9671449b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x194:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.544119:0:8468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000062488c71/0x85f51a6b9671449b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x194:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.544131:0:8468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000062488c71/0x85f51a6b9671449b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x194:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.544161:0:8468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1777051204.544211:0:8468:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x193:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777051204.544217:0:8468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008acd3fe7/0x85f51a6b967144a2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x193:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.544226:0:8468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051204.544228:0:8468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051204.544232:0:8468:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008acd3fe7/0x85f51a6b967144a2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x193:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.544243:0:8468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008acd3fe7/0x85f51a6b967144a2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x193:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.544252:0:8468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008acd3fe7/0x85f51a6b967144a2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x193:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.544260:0:8468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008acd3fe7/0x85f51a6b967144a2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x193:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.544287:0:8468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1777051204.544363:0:8468:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x192:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777051204.544374:0:8468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000580b71f4/0x85f51a6b967144a9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x192:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.544410:0:8468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051204.544415:0:8468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051204.544421:0:8468:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000580b71f4/0x85f51a6b967144a9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x192:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.544423:0:13753:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777051204.544436:0:13753:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008acd3fe7/0x85f51a6b967144a2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x193:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.544471:0:8468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000580b71f4/0x85f51a6b967144a9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x192:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.544479:0:13753:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da713e2200 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:1.0:1777051204.544492:0:13753:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008acd3fe7/0x85f51a6b967144a2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x193:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.544520:0:8468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000580b71f4/0x85f51a6b967144a9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x192:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.544527:0:13753:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008acd3fe7/0x85f51a6b967144a2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x193:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.544616:0:13753:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008acd3fe7/0x85f51a6b967144a2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x193:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.544662:0:8468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000580b71f4/0x85f51a6b967144a9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x192:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.544664:0:13753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008acd3fe7/0x85f51a6b967144a2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x193:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.544730:0:13753:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777051204.544738:0:13753:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000580b71f4/0x85f51a6b967144a9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x192:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.544739:0:8468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1777051204.544758:0:13753:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da713e2000 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:1.0:1777051204.544765:0:13753:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000580b71f4/0x85f51a6b967144a9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x192:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.544781:0:13753:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000580b71f4/0x85f51a6b967144a9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x192:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.544800:0:13753:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000580b71f4/0x85f51a6b967144a9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x192:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1777051204.544810:0:8468:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x191:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777051204.544813:0:13753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000580b71f4/0x85f51a6b967144a9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x192:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.544825:0:8468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ebbb1168/0x85f51a6b967144b0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x191:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.544838:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051204.544841:0:8468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051204.544842:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051204.544849:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051204.544849:0:8468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051204.544857:0:8468:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ebbb1168/0x85f51a6b967144b0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x191:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.544874:0:8468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ebbb1168/0x85f51a6b967144b0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x191:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.544885:0:8468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ebbb1168/0x85f51a6b967144b0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x191:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.544892:0:8468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ebbb1168/0x85f51a6b967144b0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x191:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.544915:0:8468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1777051204.544961:0:8468:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x190:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777051204.544966:0:8468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000013727dee/0x85f51a6b967144b7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x190:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.544980:0:8468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051204.544982:0:8468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051204.544985:0:8468:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000013727dee/0x85f51a6b967144b7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x190:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.544994:0:8468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000013727dee/0x85f51a6b967144b7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x190:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.545002:0:8468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000013727dee/0x85f51a6b967144b7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x190:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.545010:0:8468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000013727dee/0x85f51a6b967144b7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x190:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.545028:0:8468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1777051204.545060:0:8468:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x18f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777051204.545065:0:8468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002509ba09/0x85f51a6b967144be lrc: 3/0,1 mode: --/PW res: [0x280000401:0x18f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.545072:0:8468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051204.545074:0:8468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051204.545077:0:8468:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002509ba09/0x85f51a6b967144be lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.545085:0:8468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002509ba09/0x85f51a6b967144be lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.545099:0:8468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002509ba09/0x85f51a6b967144be lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.545106:0:8468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002509ba09/0x85f51a6b967144be lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.545116:0:8468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1777051204.545143:0:8468:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x18e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777051204.545148:0:8468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e542d62e/0x85f51a6b967144c5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x18e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.545155:0:8468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051204.545156:0:8468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051204.545159:0:8468:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e542d62e/0x85f51a6b967144c5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.545168:0:8468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e542d62e/0x85f51a6b967144c5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.545175:0:8468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e542d62e/0x85f51a6b967144c5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.545182:0:8468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e542d62e/0x85f51a6b967144c5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.545189:0:8468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:3.0:1777051204.545241:0:8468:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x18d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777051204.545247:0:8468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c692a5de/0x85f51a6b967144cc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x18d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.545256:0:8468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051204.545257:0:8468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051204.545260:0:8468:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c692a5de/0x85f51a6b967144cc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.545269:0:8468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c692a5de/0x85f51a6b967144cc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.545277:0:8468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c692a5de/0x85f51a6b967144cc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.545284:0:8468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c692a5de/0x85f51a6b967144cc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.545296:0:8468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:3.0:1777051204.545344:0:8468:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x18c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777051204.545353:0:8468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a7f30ece/0x85f51a6b967144d3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x18c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.545365:0:8468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051204.545368:0:8468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051204.545372:0:8468:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a7f30ece/0x85f51a6b967144d3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.545388:0:8468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a7f30ece/0x85f51a6b967144d3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.545401:0:8468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a7f30ece/0x85f51a6b967144d3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.545414:0:8468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a7f30ece/0x85f51a6b967144d3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.545428:0:8468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:3.0:1777051204.545477:0:8468:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x18b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777051204.545485:0:8468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c8c596da/0x85f51a6b967144da lrc: 3/0,1 mode: --/PW res: [0x280000401:0x18b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.545497:0:8468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051204.545500:0:8468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051204.545504:0:8468:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c8c596da/0x85f51a6b967144da lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.545518:0:8468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c8c596da/0x85f51a6b967144da lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.545532:0:8468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c8c596da/0x85f51a6b967144da lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.545546:0:8468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c8c596da/0x85f51a6b967144da lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.545592:0:8468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00002000:00010000:3.0:1777051204.545654:0:8468:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x18a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777051204.545669:0:8468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a31138b/0x85f51a6b967144e1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x18a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.545696:0:8468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051204.545701:0:8468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051204.545707:0:8468:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006a31138b/0x85f51a6b967144e1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.546025:0:8468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006a31138b/0x85f51a6b967144e1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.546046:0:8468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a31138b/0x85f51a6b967144e1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.546074:0:8468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006a31138b/0x85f51a6b967144e1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.546117:0:8468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:3.0:1777051204.546188:0:8468:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x189:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777051204.546229:0:8468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006711b150/0x85f51a6b967144e8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x189:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.546244:0:8468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051204.546250:0:8468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051204.546257:0:8468:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006711b150/0x85f51a6b967144e8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x189:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.546294:0:8468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006711b150/0x85f51a6b967144e8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x189:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.546334:0:8468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006711b150/0x85f51a6b967144e8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x189:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.546374:0:8468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006711b150/0x85f51a6b967144e8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x189:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.546397:0:8468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:3.0:1777051204.546463:0:8468:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x188:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777051204.546481:0:8468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000000e9c07a/0x85f51a6b967144ef lrc: 3/0,1 mode: --/PW res: [0x280000401:0x188:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.546511:0:8468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051204.546516:0:8468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051204.546523:0:8468:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000000e9c07a/0x85f51a6b967144ef lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x188:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051204.546722:0:6567:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1777051204.546733:0:6567:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c8c596da/0x85f51a6b967144da lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051204.546776:0:6567:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da713e3400 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:0.0:1777051204.546786:0:6567:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c8c596da/0x85f51a6b967144da lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051204.547081:0:6567:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c8c596da/0x85f51a6b967144da lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x18b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051204.547119:0:6567:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c8c596da/0x85f51a6b967144da lrc: 1/0,0 mode: --/PW res: [0x280000401:0x18b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051204.547158:0:6567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c8c596da/0x85f51a6b967144da lrc: 0/0,0 mode: --/PW res: [0x280000401:0x18b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051204.547240:0:6567:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1777051204.547249:0:6567:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006711b150/0x85f51a6b967144e8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x189:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051204.547281:0:6567:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da713e2400 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:0.0:1777051204.547288:0:6567:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006711b150/0x85f51a6b967144e8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x189:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051204.547324:0:6567:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006711b150/0x85f51a6b967144e8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x189:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051204.547359:0:6567:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006711b150/0x85f51a6b967144e8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x189:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051204.547380:0:6567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006711b150/0x85f51a6b967144e8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x189:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051204.547408:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777051204.547411:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777051204.547415:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051204.547479:0:8468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000000e9c07a/0x85f51a6b967144ef lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x188:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.547497:0:8468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000000e9c07a/0x85f51a6b967144ef lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x188:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.547509:0:8468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000000e9c07a/0x85f51a6b967144ef lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x188:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.547540:0:8468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1777051204.547630:0:13753:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00002000:00010000:3.0:1777051204.547640:0:8468:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x187:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777051204.547642:0:13753:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000000e9c07a/0x85f51a6b967144ef lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x188:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.547656:0:8468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f02d5b94/0x85f51a6b967144f6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x187:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.547665:0:13753:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da713e3000 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:1.0:1777051204.547676:0:13753:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000000e9c07a/0x85f51a6b967144ef lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x188:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.547680:0:8468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051204.547686:0:8468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051204.547695:0:8468:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f02d5b94/0x85f51a6b967144f6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x187:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.547704:0:13753:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000000e9c07a/0x85f51a6b967144ef lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x188:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.547725:0:8468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f02d5b94/0x85f51a6b967144f6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x187:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.547736:0:13753:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000000e9c07a/0x85f51a6b967144ef lrc: 1/0,0 mode: --/PW res: [0x280000401:0x188:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.547741:0:8468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f02d5b94/0x85f51a6b967144f6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x187:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.548077:0:8468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f02d5b94/0x85f51a6b967144f6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x187:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.548125:0:13753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000000e9c07a/0x85f51a6b967144ef lrc: 0/0,0 mode: --/PW res: [0x280000401:0x188:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.548158:0:13753:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777051204.548166:0:13753:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f02d5b94/0x85f51a6b967144f6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x187:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.548177:0:13753:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d943ebba00 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:1.0:1777051204.548184:0:13753:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f02d5b94/0x85f51a6b967144f6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x187:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.548477:0:8468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1777051204.548509:0:13753:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f02d5b94/0x85f51a6b967144f6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x187:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.548537:0:13753:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f02d5b94/0x85f51a6b967144f6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x187:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.548573:0:13753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f02d5b94/0x85f51a6b967144f6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x187:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1777051204.548580:0:8468:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x186:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777051204.548601:0:8468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000020699bcd/0x85f51a6b967144fd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x186:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.548614:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051204.548617:0:8468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051204.548621:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051204.548623:0:8468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051204.548633:0:8468:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000020699bcd/0x85f51a6b967144fd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x186:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.548651:0:8468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000020699bcd/0x85f51a6b967144fd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x186:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.548665:0:8468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000020699bcd/0x85f51a6b967144fd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x186:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.548677:0:8468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000020699bcd/0x85f51a6b967144fd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x186:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051204.548726:0:6567:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777051204.548739:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051204.549039:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777051204.549075:0:6567:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000020699bcd/0x85f51a6b967144fd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x186:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051204.549091:0:6567:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d943ebb200 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:0.0:1777051204.549097:0:6567:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000020699bcd/0x85f51a6b967144fd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x186:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051204.549113:0:6567:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000020699bcd/0x85f51a6b967144fd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x186:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051204.549134:0:6567:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000020699bcd/0x85f51a6b967144fd lrc: 2/0,0 mode: --/PW res: [0x280000401:0x186:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051204.549150:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777051204.549153:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777051204.549157:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051204.549284:0:8468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1777051204.549294:0:8468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000020699bcd/0x85f51a6b967144fd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x186:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1777051204.549387:0:8468:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x185:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777051204.549394:0:8468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d3782cbf/0x85f51a6b96714504 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x185:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.549404:0:8468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051204.549405:0:8468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051204.549409:0:8468:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d3782cbf/0x85f51a6b96714504 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x185:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.549420:0:8468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d3782cbf/0x85f51a6b96714504 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x185:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.549428:0:8468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d3782cbf/0x85f51a6b96714504 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x185:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.549436:0:8468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d3782cbf/0x85f51a6b96714504 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x185:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.549463:0:8468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1777051204.549506:0:13753:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777051204.549518:0:13753:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d3782cbf/0x85f51a6b96714504 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x185:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1777051204.549527:0:8468:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x184:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777051204.549538:0:8468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005bfcd804/0x85f51a6b9671450b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x184:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.549589:0:8468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051204.549595:0:8468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051204.549601:0:8468:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005bfcd804/0x85f51a6b9671450b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x184:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.549604:0:13753:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d943ebb800 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:1.0:1777051204.549616:0:13753:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d3782cbf/0x85f51a6b96714504 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x185:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.549625:0:8468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005bfcd804/0x85f51a6b9671450b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x184:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.549645:0:13753:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d3782cbf/0x85f51a6b96714504 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x185:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.549654:0:8468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005bfcd804/0x85f51a6b9671450b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x184:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.549671:0:13753:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d3782cbf/0x85f51a6b96714504 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x185:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.549674:0:8468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005bfcd804/0x85f51a6b9671450b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x184:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.549716:0:13753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d3782cbf/0x85f51a6b96714504 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x185:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.549739:0:8468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1777051204.549746:0:13753:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777051204.550400:0:13753:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005bfcd804/0x85f51a6b9671450b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x184:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.550415:0:13753:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d943eba200 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:1.0:1777051204.550422:0:13753:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005bfcd804/0x85f51a6b9671450b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x184:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.550435:0:13753:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005bfcd804/0x85f51a6b9671450b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x184:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.550455:0:13753:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005bfcd804/0x85f51a6b9671450b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x184:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.550469:0:13753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005bfcd804/0x85f51a6b9671450b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x184:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051204.550497:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051204.550502:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051204.550505:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1777051204.550604:0:8468:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x183:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777051204.550614:0:8468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000867be76e/0x85f51a6b96714512 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x183:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.550628:0:8468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051204.550631:0:8468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051204.550637:0:8468:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000867be76e/0x85f51a6b96714512 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x183:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.550653:0:8468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000867be76e/0x85f51a6b96714512 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x183:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.550666:0:8468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000867be76e/0x85f51a6b96714512 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x183:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.550679:0:8468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000867be76e/0x85f51a6b96714512 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x183:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.550777:0:8468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1777051204.550830:0:8468:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x182:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777051204.550836:0:8468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007bd6c51a/0x85f51a6b96714519 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x182:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.550845:0:8468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051204.550847:0:8468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051204.550851:0:8468:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007bd6c51a/0x85f51a6b96714519 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x182:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.550865:0:8468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007bd6c51a/0x85f51a6b96714519 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x182:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.550879:0:8468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007bd6c51a/0x85f51a6b96714519 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x182:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051204.550902:0:8468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007bd6c51a/0x85f51a6b96714519 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x182:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051204.551008:0:6567:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1777051204.551017:0:6567:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000867be76e/0x85f51a6b96714512 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x183:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051204.551026:0:6567:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d943ebaa00 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:0.0:1777051204.551030:0:6567:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000867be76e/0x85f51a6b96714512 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x183:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051204.551041:0:6567:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000867be76e/0x85f51a6b96714512 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x183:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051204.551060:0:6567:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000867be76e/0x85f51a6b96714512 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x183:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051204.551074:0:6567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000867be76e/0x85f51a6b96714512 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x183:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051204.551100:0:6567:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1777051204.551106:0:6567:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007bd6c51a/0x85f51a6b96714519 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x182:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051204.551117:0:6567:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d943ebb600 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:0.0:1777051204.551123:0:6567:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007bd6c51a/0x85f51a6b96714519 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x182:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051204.551387:0:6567:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007bd6c51a/0x85f51a6b96714519 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x182:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051204.551409:0:6567:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007bd6c51a/0x85f51a6b96714519 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x182:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051204.551425:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777051204.551428:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777051204.551466:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051204.551522:0:8468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1777051204.551532:0:8468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007bd6c51a/0x85f51a6b96714519 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x182:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:3.0:1777051204.552134:0:8468:0:(ofd_dev.c:1515:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:350 00000100:00100000:3.0:1777051204.552594:0:8468:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d956128000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:99943:x1863365452476544:12345-0@lo:5:osp-pre-0-0.0 Request processed in 58871us (59071us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051204.552613:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7935 00000100:00100000:1.0:1777051204.552695:0:99943:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94ed2ea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:99943:1863365452476544:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1777051204.552714:0:99943:0:(osp_precreate.c:955:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x1a1:0x0] from OST, last_created [0x280000401:0x1a1:0x0]last_used is [0x280000401:0x15e:0x0] 00000100:00100000:3.0:1777051204.552900:0:99943:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7c9a1f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:99943:1863365452477056:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1777051204.552923:0:3679:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1777051204.552947:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7c9a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452476928:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1777051204.552959:0:99943:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051204.553286:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051204.553315:0:99943:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d958800f00 going to sleep for 11 seconds 00000100:00100000:0.0:1777051204.553585:0:8472:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452476928 00000100:00100000:0.0:1777051204.553596:0:8472:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452476928 00000100:00100000:0.0:1777051204.553692:0:8472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5489 00000100:00100000:0.0:1777051204.553711:0:8472:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94e627b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3679:x1863365452476928:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1777051204.553740:0:8472:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 440355904 pending 896 free 3862671360 avail 3631149056 00000100:00100000:0.0:1777051204.553834:0:8472:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94e627b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3679:x1863365452476928:12345-0@lo:13:osp-pre-0-0.0 Request processed in 126us (547us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051204.553851:0:8472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5489 00000100:00100000:3.0:1777051204.553875:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7c9a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452476928:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1777051204.556252:0:99943:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7c9a1f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:99943:1863365452477056:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1777051204.556276:0:99943:0:(osp_precreate.c:701:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x1a1:0x0]-[0x280000401:0x1c1:0x0] 00000001:00100000:1.0:1777051204.890652:0:7498:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:1.0:1777051205.720175:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1777051205.960073:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051205.960254:0:46494:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425835904 00000100:00100000:0.0:1777051205.960271:0:46494:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425835904 00000100:00100000:0.0:1777051205.960379:0:46494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111621 00000100:00100000:0.0:1777051205.960399:0:46494:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94e624380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c11b6966-0775-44d2-bdc6-c74c26eb2226+13:128714:x1863365425835904:12345-192.168.201.46@tcp:101:lfs.0 00010000:00010000:0.0:1777051205.960455:0:46494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051205.960489:0:46494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d507600/0x85f51a6b96714520 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b5e69 expref: -99 pid: 46494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051206.004572:0:8492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425836032 00000100:00100000:3.0:1777051206.004587:0:8492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425836032 00000100:00100000:3.0:1777051206.005011:0:8492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111622 00000100:00100000:3.0:1777051206.005033:0:8492:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fdf1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+17:128714:x1863365425836032:12345-192.168.201.46@tcp:41:lfs.0 00000004:00000024:3.0:1777051206.005417:0:8492:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4194304 pending 0 free 1441603584 avail 1295364096 00000100:00100000:3.0:1777051206.005559:0:8492:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fdf1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+17:128714:x1863365425836032:12345-192.168.201.46@tcp:41:lfs.0 Request processed in 503us (1359us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051206.005575:0:8492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111622 00000100:00080000:1.0:1777051206.005745:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1777051206.013994:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051206.014186:0:27882:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425836160 00000100:00100000:1.0:1777051206.014365:0:27882:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425836160 00000100:00100000:1.0:1777051206.014664:0:27882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111623 00000100:00100000:1.0:1777051206.014684:0:27882:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7c9a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+48:128714:x1863365425836160:12345-192.168.201.46@tcp:41:lfs.0 00000004:00000024:1.0:1777051206.014736:0:27882:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4243456 pending 0 free 1446064128 avail 1299824640 00000100:00100000:1.0:1777051206.014821:0:27882:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7c9a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+48:128714:x1863365425836160:12345-192.168.201.46@tcp:41:lfs.0 Request processed in 142us (839us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051206.014837:0:27882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111623 00000100:00080000:3.0:1777051206.014921:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1777051206.024690:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051206.025032:0:10113:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425836288 00000100:00100000:1.0:1777051206.025048:0:10113:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425836288 00000100:00100000:1.0:1777051206.025281:0:10113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 5490 00000100:00100000:1.0:1777051206.025302:0:10113:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94ed2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+50:128714:x1863365425836288:12345-192.168.201.46@tcp:13:lfs.0 00002000:00000024:1.0:1777051206.025353:0:10113:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 440355008 pending 0 free 3862671360 avail 3631149056 00000100:00100000:1.0:1777051206.025450:0:10113:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94ed2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+50:128714:x1863365425836288:12345-192.168.201.46@tcp:13:lfs.0 Request processed in 152us (772us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051206.025466:0:10113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 5490 00000100:00080000:3.0:1777051206.028642:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1777051206.038809:0:47388:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425836416 00000100:00100000:3.0:1777051206.038826:0:47388:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425836416 00000100:00100000:3.0:1777051206.039070:0:47388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 5491 00000100:00100000:3.0:1777051206.039091:0:47388:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fdf2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+47:128714:x1863365425836416:12345-192.168.201.46@tcp:13:lfs.0 00002000:00000024:3.0:1777051206.039142:0:47388:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 430295232 pending 0 free 3645853696 avail 3414331392 00000100:00100000:3.0:1777051206.039279:0:47388:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fdf2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+47:128714:x1863365425836416:12345-192.168.201.46@tcp:13:lfs.0 Request processed in 192us (620us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051206.039363:0:47388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 5491 00000100:00080000:1.0:1777051206.039461:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1777051206.742563:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1777051208.470593:0:3678:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1777051208.470626:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94e624700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452477184:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1777051208.470719:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051208.470907:0:10113:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452477184 00000100:00100000:1.0:1777051208.470921:0:10113:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452477184 00000100:00080000:3.0:1777051208.471426:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1777051208.471478:0:10113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5492 00000100:00100000:1.0:1777051208.471530:0:10113:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94ed2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3678:x1863365452477184:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1777051208.471574:0:10113:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 430295232 pending 0 free 3645853696 avail 3414331392 00000100:00100000:1.0:1777051208.471687:0:10113:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94ed2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3678:x1863365452477184:12345-0@lo:13:osp-pre-1-1.0 Request processed in 195us (967us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051208.471702:0:10113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5492 00000100:00100000:0.0:1777051208.472032:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94e624700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452477184:0@lo:13:osp-pre-1-1.0 00000040:00080000:1.0:1777051208.982545:0:99289:0:(llog.c:801:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1777051208.982555:0:99289:0:(llog_cat.c:158:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:3.0:1777051208.982599:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f9bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452477312:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1777051208.982720:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1777051208.983412:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:1.0:1777051208.983672:0:99289:0:(llog.c:858:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:1.0:1777051208.983687:0:99289:0:(llog.c:858:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1777051208.983833:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f9bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452477312:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1777051209.494593:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94ed2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452477440:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1777051209.495393:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051209.495552:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94f42df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3679:1863365452477952:0@lo:400:kworker.0 00000100:00100000:0.0:1777051209.495662:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051209.495721:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d9533bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452478464:0@lo:400:kworker.0 00000100:00100000:0.0:1777051209.495818:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051209.495907:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da4384ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3679:1863365452478976:0@lo:400:kworker.0 00000100:00100000:0.0:1777051209.495990:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051209.496384:0:3679:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1777051209.496404:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d944070e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452477568:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1777051209.496515:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051209.496601:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94f42ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3679:1863365452478080:0@lo:400:kworker.0 00000100:00100000:0.0:1777051209.496670:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051209.496763:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d9533bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452478592:0@lo:400:kworker.0 00000100:00100000:0.0:1777051209.496820:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051209.496922:0:46498:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452477440 00000100:00100000:0.0:1777051209.496934:0:46498:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452477440 00000100:00100000:0.0:1777051209.497014:0:46498:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452477568 00000100:00100000:0.0:1777051209.497021:0:46498:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452477568 00000100:00100000:0.0:1777051209.497074:0:46498:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452478592 00000100:00100000:0.0:1777051209.497083:0:46498:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452478592 00000100:00100000:3.0:1777051209.497090:0:27885:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452478208 00000100:00100000:3.0:1777051209.497103:0:27885:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452478208 00000100:00100000:0.0:1777051209.497151:0:46498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7957 00000100:00100000:3.0:1777051209.497173:0:27885:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452478080 00000100:00100000:0.0:1777051209.497177:0:46498:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94ed2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+7:3679:x1863365452477440:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1777051209.497180:0:27885:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452478080 00000100:00100000:3.0:1777051209.497269:0:27885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13045 00000004:00000024:0.0:1777051209.497280:0:46498:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4194304 pending 0 free 1441603584 avail 1295364096 00000100:00100000:3.0:1777051209.497282:0:27885:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95a582300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000-lwp-MDT0000_UUID+5:3679:x1863365452478976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777051209.497404:0:46498:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94ed2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+7:3679:x1863365452477440:12345-0@lo:41:osp-pre-0-1.0 Request processed in 236us (2011us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051209.497409:0:27885:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95a582300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000-lwp-MDT0000_UUID+5:3679:x1863365452478976:12345-0@lo:400:kworker.0 Request processed in 125us (1424us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051209.497434:0:46498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7957 00000100:00100000:3.0:1777051209.497436:0:27885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13045 00000100:00100000:3.0:1777051209.497516:0:27885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13046 00000100:00100000:3.0:1777051209.497531:0:27885:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f865f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000-lwp-OST0001_UUID+5:3677:x1863365452478208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051209.497602:0:27885:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f865f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000-lwp-OST0001_UUID+5:3677:x1863365452478208:12345-0@lo:400:kworker.0 Request processed in 74us (1671us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051209.497614:0:27885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13046 00000100:00100000:3.0:1777051209.497640:0:27885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13047 00000100:00100000:3.0:1777051209.497653:0:27885:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f865500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000-lwp-MDT0001_UUID+5:3677:x1863365452477824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051209.497714:0:27885:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f865500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000-lwp-MDT0001_UUID+5:3677:x1863365452477824:12345-0@lo:400:kworker.0 Request processed in 62us (1131us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051209.497726:0:27885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13047 00000100:00100000:3.0:1777051209.497759:0:27885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13048 00000100:00100000:3.0:1777051209.497773:0:27885:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95a580700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:lustre-MDT0001-lwp-OST0000_UUID+5:3679:x1863365452478080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051209.497840:0:27885:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95a580700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:lustre-MDT0001-lwp-OST0000_UUID+5:3679:x1863365452478080:12345-0@lo:400:kworker.0 Request processed in 68us (1173us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051209.497853:0:27885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13048 00000100:00100000:3.0:1777051209.497892:0:27887:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452478464 00000100:00100000:3.0:1777051209.497900:0:27887:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452478464 00000100:00100000:3.0:1777051209.498178:0:27887:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452478720 00000100:00100000:3.0:1777051209.498185:0:27887:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452478720 00000100:00100000:3.0:1777051209.498271:0:27887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10115 00000100:00100000:3.0:1777051209.498284:0:27887:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94ed2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3679:x1863365452478464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051209.498348:0:27887:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94ed2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3679:x1863365452478464:12345-0@lo:400:kworker.0 Request processed in 68us (2538us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051209.498362:0:27887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10115 00000100:00100000:3.0:1777051209.498458:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051209.498535:0:46498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7958 00000100:00100000:0.0:1777051209.498559:0:46498:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95a581f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+6:3679:x1863365452477568:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1777051209.498602:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7959 00000004:00000024:0.0:1777051209.498612:0:46498:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4243456 pending 0 free 1446064128 avail 1299824640 00000100:00100000:3.0:1777051209.498622:0:6585:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95a583800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3679:x1863365452478592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051209.498725:0:6585:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95a583800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3679:x1863365452478592:12345-0@lo:400:kworker.0 Request processed in 112us (1907us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051209.498741:0:46498:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95a581f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+6:3679:x1863365452477568:12345-0@lo:41:osp-pre-1-0.0 Request processed in 185us (2227us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051209.499072:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7959 00000100:00100000:3.0:1777051209.499170:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94f42d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3677:1863365452478336:0@lo:400:kworker.0 00000100:00100000:0.0:1777051209.500456:0:46498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7958 00000100:00100000:0.0:1777051209.500685:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d944070e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452477568:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1777051209.500716:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94f42ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3679:1863365452478080:0@lo:400:kworker.0 00000100:00100000:0.0:1777051209.500745:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d9533bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452478592:0@lo:400:kworker.0 00000100:00100000:0.0:1777051209.500768:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d9533bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452478464:0@lo:400:kworker.0 00000100:00100000:0.0:1777051209.500793:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da4384ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3679:1863365452478976:0@lo:400:kworker.0 00000100:00100000:0.0:1777051209.500817:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94f42df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3679:1863365452477952:0@lo:400:kworker.0 00000100:00100000:0.0:1777051209.500849:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94ed2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452477440:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1777051209.501230:0:8628:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452478848 00000100:00100000:3.0:1777051209.501239:0:8628:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452478848 00000100:00100000:3.0:1777051209.501324:0:8628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10117 00000100:00100000:3.0:1777051209.501344:0:8628:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f865180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3677:x1863365452478848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051209.501447:0:8628:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f865180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3677:x1863365452478848:12345-0@lo:400:kworker.0 Request processed in 112us (552us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051209.501458:0:8628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10117 00000100:00100000:0.0:1777051209.501579:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d9533bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3677:1863365452478848:0@lo:400:kworker.0 00000100:00100000:0.0:1777051209.635757:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051209.635836:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051209.635868:0:99935:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425836544 00000100:00100000:1.0:1777051209.635883:0:99935:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425836544 00000100:00100000:0.0:1777051209.635907:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051209.635951:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051209.635978:0:99935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 85 00000100:00100000:0.0:1777051209.636005:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051209.636005:0:99935:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5faf2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:29c4352d-3260-4734-909d-9ea5de9e7fa4+12:2438:x1863365425836544:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:3.0:1777051209.636037:0:46494:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425836800 00000100:00100000:3.0:1777051209.636049:0:46494:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425836800 00000100:00100000:0.0:1777051209.636065:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051209.636379:0:99935:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5faf2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:29c4352d-3260-4734-909d-9ea5de9e7fa4+12:2438:x1863365425836544:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 382us (630us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051209.636396:0:46494:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425837312 00000100:00100000:1.0:1777051209.636404:0:99935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 85 00000100:00100000:3.0:1777051209.636410:0:46494:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425837312 00000100:00100000:0.0:1777051209.636412:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051209.636642:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051209.636942:0:21368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13050 00000100:00100000:0.0:1777051209.636963:0:21368:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95a581880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+6:2438:x1863365425836800:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:3.0:1777051209.637039:0:46494:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425836672 00000100:00100000:0.0:1777051209.637042:0:21368:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95a581880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+6:2438:x1863365425836800:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 85us (1206us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051209.637055:0:46494:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425836672 00000100:00100000:0.0:1777051209.637063:0:21368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13050 00000100:00100000:0.0:1777051209.637098:0:21368:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425837184 00000100:00100000:0.0:1777051209.637105:0:21368:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425837184 00000100:00100000:3.0:1777051209.637138:0:46494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13051 00000100:00100000:3.0:1777051209.637364:0:46494:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95a580e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+48:2438:x1863365425837312:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:1.0:1777051209.637400:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051209.637429:0:46494:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95a580e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+48:2438:x1863365425837312:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 74us (1476us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051209.637650:0:27884:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425837056 00000100:00100000:1.0:1777051209.637660:0:27884:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425837056 00000100:00100000:1.0:1777051209.638024:0:27884:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425837568 00000100:00100000:1.0:1777051209.638032:0:27884:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425837568 00000100:00100000:1.0:1777051209.638070:0:27884:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425836928 00000100:00100000:1.0:1777051209.638076:0:27884:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425836928 00000100:00100000:1.0:1777051209.638112:0:27884:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425837440 00000100:00100000:1.0:1777051209.638117:0:27884:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425837440 00000100:00100000:1.0:1777051209.638150:0:27884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10118 00000100:00100000:1.0:1777051209.638163:0:27884:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95a580380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+48:2438:x1863365425837056:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:0.0:1777051209.638276:0:21368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13052 00000100:00100000:0.0:1777051209.638292:0:21368:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95a581500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+14:2438:x1863365425836672:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:3.0:1777051209.638578:0:46494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13051 00000100:00100000:3.0:1777051209.638619:0:46494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13053 00000100:00100000:3.0:1777051209.638637:0:46494:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94e624700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+17:2438:x1863365425837184:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:1.0:1777051209.638656:0:27884:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95a580380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+48:2438:x1863365425837056:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 485us (2742us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051209.638657:0:21368:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95a581500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+14:2438:x1863365425836672:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 361us (2587us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051209.638690:0:27884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10118 00000100:00100000:1.0:1777051209.639010:0:27884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10119 00000100:00100000:1.0:1777051209.639024:0:27884:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95a581180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+47:2438:x1863365425837568:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:0.0:1777051209.639186:0:21368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13052 00000100:00100000:3.0:1777051209.641011:0:46494:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94e624700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+17:2438:x1863365425837184:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 2376us (4369us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051209.641026:0:46494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13053 00000100:00100000:3.0:1777051209.641071:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10120 00000100:00100000:3.0:1777051209.641520:0:8468:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95a580000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+50:2438:x1863365425836928:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:1.0:1777051209.641530:0:27884:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95a581180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+47:2438:x1863365425837568:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 2500us (5523us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051209.641549:0:27884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10119 00000100:00100000:1.0:1777051209.641587:0:27884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10121 00000100:00100000:3.0:1777051209.641603:0:8468:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95a580000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+50:2438:x1863365425836928:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 516us (5201us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051209.641614:0:27884:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d944e12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+50:2438:x1863365425837440:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:3.0:1777051209.641938:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10120 00000100:00080000:3.0:1777051209.641994:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1777051209.642004:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1777051209.642012:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1777051209.642018:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1777051209.642054:0:27884:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d944e12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+50:2438:x1863365425837440:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 451us (4656us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051209.642075:0:27884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10121 00000100:00100000:1.0:1777051210.006911:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d944e11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3680:1863365452479104:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1777051210.007034:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051210.007284:0:8473:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452479104 00000100:00100000:3.0:1777051210.007305:0:8473:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452479104 00000100:00100000:3.0:1777051210.007429:0:8473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5494 00000100:00100000:3.0:1777051210.007453:0:8473:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d944e10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3680:x1863365452479104:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1777051210.007535:0:8473:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 440355008 pending 0 free 3862671360 avail 3631149056 00000100:00100000:3.0:1777051210.007846:0:8473:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d944e10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3680:x1863365452479104:12345-0@lo:13:osp-pre-0-0.0 Request processed in 395us (807us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051210.007863:0:8473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5494 00000100:00100000:1.0:1777051210.008434:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d944e11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3680:1863365452479104:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1777051210.008886:0:47388:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452479232 00000100:00100000:0.0:1777051210.008898:0:47388:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452479232 00000100:00100000:0.0:1777051210.008994:0:47388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5495 00000100:00100000:0.0:1777051210.009016:0:47388:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f866d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3677:x1863365452479232:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1777051210.009055:0:47388:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 430295232 pending 0 free 3645853696 avail 3414331392 00000100:00100000:0.0:1777051210.009165:0:47388:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f866d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3677:x1863365452479232:12345-0@lo:13:osp-pre-1-0.0 Request processed in 157us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051210.009184:0:47388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5495 00000100:00100000:3.0:1777051210.009524:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95a582680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3677:1863365452479232:0@lo:13:osp-pre-1-0.0 00000001:00080000:3.0:1777051210.524936:0:8464:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0000: transno 4294968346 is committed 00000001:00080000:0.0:1777051210.525118:0:9540:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0001: transno 4294968349 is committed 00010000:00010000:1.0:1777051210.839956:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1777051211.289402:0:99954:0:(llog.c:858:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:02000400:1.0:1777051211.371825:0:100445:0:(debug.c:645:libcfs_debug_mark_buffer()) DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec 00000100:00100000:0.0:1777051213.147685:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00080000:3.0:1777051213.148544:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1777051213.153043:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00080000:3.0:1777051213.154014:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1777051213.157280:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00080000:3.0:1777051213.157515:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1777051213.162820:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00080000:3.0:1777051213.163248:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1777051213.591442:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95f867480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452479360:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1777051213.591532:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051213.591610:0:8473:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452479360 00000100:00100000:1.0:1777051213.591910:0:8473:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452479360 00000100:00100000:1.0:1777051213.592018:0:8473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5498 00000100:00100000:1.0:1777051213.592032:0:8473:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3678:x1863365452479360:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1777051213.592063:0:8473:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 430295232 pending 0 free 3645853696 avail 3414331392 00000100:00100000:1.0:1777051213.592134:0:8473:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3678:x1863365452479360:12345-0@lo:13:osp-pre-1-1.0 Request processed in 104us (601us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051213.592148:0:8473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5498 00000100:00100000:1.0:1777051213.592236:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95f867480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452479360:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1777051213.912607:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777051214.103936:0:3680:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1777051214.103971:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f9b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3680:1863365452479488:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1777051214.104461:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1777051214.105393:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1777051214.105553:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f9b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3680:1863365452479488:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1777051214.615080:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d944e13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452479744:0@lo:400:kworker.0 00000100:00100000:0.0:1777051214.615489:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051214.615524:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d944e11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3678:1863365452479872:0@lo:400:kworker.0 00000100:00100000:0.0:1777051214.615565:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d944e10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3677:1863365452480256:0@lo:400:kworker.0 00000100:00100000:1.0:1777051214.615592:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051214.615629:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051214.616040:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d944e11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3677:1863365452480768:0@lo:400:kworker.0 00000100:00100000:1.0:1777051214.616052:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d944e13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3678:1863365452480384:0@lo:400:kworker.0 00000100:00100000:0.0:1777051214.616098:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051214.616124:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051214.616168:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d944e13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452479744:0@lo:400:kworker.0 00000100:00100000:1.0:1777051214.616177:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d951fa1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3678:1863365452480896:0@lo:400:kworker.0 00000100:00100000:0.0:1777051214.616246:0:6580:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452479872 00000100:00100000:0.0:1777051214.616253:0:6580:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452479872 00000100:00100000:1.0:1777051214.616283:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051214.616308:0:6580:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452480256 00000100:00100000:0.0:1777051214.616314:0:6580:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452480256 00000100:00100000:1.0:1777051214.616367:0:99929:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452479616 00000100:00100000:1.0:1777051214.616377:0:99929:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452479616 00000100:00100000:0.0:1777051214.616379:0:6580:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452480384 00000100:00100000:0.0:1777051214.616416:0:6580:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452480384 00000100:00100000:0.0:1777051214.616474:0:6580:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452480000 00000100:00100000:1.0:1777051214.616476:0:99929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1777051214.616483:0:6580:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452480000 00000100:00100000:1.0:1777051214.616497:0:99929:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da70b21450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9351a01-5b0e-4470-97fd-58b9b4b312a2+23:3680:x1863365452479616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051214.616517:0:8468:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452480768 00000100:00100000:3.0:1777051214.616530:0:8468:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452480768 00000100:00100000:0.0:1777051214.616537:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13054 00000100:00100000:0.0:1777051214.616553:0:6580:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d951fa3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3678:x1863365452479872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777051214.616587:0:99929:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da70b21450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9351a01-5b0e-4470-97fd-58b9b4b312a2+23:3680:x1863365452479616:12345-0@lo:400:kworker.0 Request processed in 90us (1425us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051214.616605:0:99929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1777051214.616915:0:8468:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452480896 00000100:00100000:0.0:1777051214.616926:0:6580:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d951fa3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3678:x1863365452479872:12345-0@lo:400:kworker.0 Request processed in 374us (1334us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051214.616926:0:8468:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452480896 00000100:00100000:0.0:1777051214.616943:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13054 00000100:00100000:0.0:1777051214.616976:0:6580:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452481024 00000100:00100000:1.0:1777051214.616981:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d944e11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3678:1863365452479872:0@lo:400:kworker.0 00000100:00100000:0.0:1777051214.616985:0:6580:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452481024 00000100:00100000:3.0:1777051214.616995:0:8468:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452480512 00000100:00100000:3.0:1777051214.617007:0:8468:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452480512 00000100:00100000:0.0:1777051214.617043:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13055 00000100:00100000:0.0:1777051214.617059:0:6580:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da4384ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3677:x1863365452480256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051214.617077:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10122 00000100:00100000:1.0:1777051214.617096:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10123 00000100:00100000:3.0:1777051214.617100:0:8468:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d9533bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3677:x1863365452480768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777051214.617126:0:8471:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d9418f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3678:x1863365452480896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777051214.617131:0:6580:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da4384ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3677:x1863365452480256:12345-0@lo:400:kworker.0 Request processed in 78us (1504us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051214.617151:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13055 00000100:00100000:0.0:1777051214.617178:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13057 00000100:00100000:0.0:1777051214.617190:0:6580:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f864000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3679:x1863365452480000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051214.617253:0:8468:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d9533bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3677:x1863365452480768:12345-0@lo:400:kworker.0 Request processed in 161us (1152us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051214.617267:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10122 00000100:00100000:3.0:1777051214.617313:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10124 00000100:00100000:1.0:1777051214.617317:0:8471:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d9418f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3678:x1863365452480896:12345-0@lo:400:kworker.0 Request processed in 194us (1034us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051214.617321:0:6580:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f864000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3679:x1863365452480000:12345-0@lo:400:kworker.0 Request processed in 130us (977us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051214.617344:0:8468:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f864a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3679:x1863365452480512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777051214.617353:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13057 00000100:00100000:1.0:1777051214.617357:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10123 00000100:00080000:0.0:1777051214.617416:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1777051214.617423:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1777051214.617429:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1777051214.617436:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1777051214.617462:0:8468:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f864a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3679:x1863365452480512:12345-0@lo:400:kworker.0 Request processed in 127us (999us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051214.617475:0:46498:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452481152 00000100:00100000:3.0:1777051214.617476:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10124 00000100:00100000:1.0:1777051214.617486:0:46498:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452481152 00000100:00100000:0.0:1777051214.617530:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d944e10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3677:1863365452480256:0@lo:400:kworker.0 00000100:00100000:0.0:1777051214.617553:0:3677:0:(client.c:3101:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968346 gen 2 00000100:00100000:1.0:1777051214.617555:0:46498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7961 00000100:00100000:1.0:1777051214.617576:0:46498:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d9600baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3679:x1863365452481152:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1777051214.617579:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d944e11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3677:1863365452480768:0@lo:400:kworker.0 00000100:00100000:0.0:1777051214.617625:0:6580:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452480128 00000004:00000024:1.0:1777051214.617628:0:46498:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4243456 pending 0 free 1446064128 avail 1299824640 00000100:00100000:0.0:1777051214.617632:0:6580:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452480128 00000100:00100000:0.0:1777051214.617693:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13059 00000100:00100000:0.0:1777051214.617708:0:6580:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d9600b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3680:x1863365452480128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777051214.617748:0:46498:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d9600baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3679:x1863365452481152:12345-0@lo:41:osp-pre-1-0.0 Request processed in 175us (753us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051214.617765:0:46498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7961 00000100:00100000:0.0:1777051214.617782:0:6580:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d9600b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3680:x1863365452480128:12345-0@lo:400:kworker.0 Request processed in 75us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051214.617792:0:46498:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452480640 00000100:00100000:0.0:1777051214.617797:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13059 00000100:00100000:1.0:1777051214.617802:0:46498:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452480640 00000100:00080000:0.0:1777051214.617837:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1777051214.617865:0:46498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7962 00000100:00100000:1.0:1777051214.617886:0:46498:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f65ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3680:x1863365452480640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777051214.617931:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d9533bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452481280:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1777051214.617975:0:46498:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f65ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3680:x1863365452480640:12345-0@lo:400:kworker.0 Request processed in 95us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051214.617991:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051214.618010:0:46498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7962 00000100:00100000:0.0:1777051214.619008:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d9533bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452481280:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1777051214.755604:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051214.756107:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051214.756162:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051214.756225:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051214.756274:0:46497:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425838336 00000100:00100000:3.0:1777051214.756282:0:10328:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425838464 00000100:00100000:0.0:1777051214.756291:0:46497:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425838336 00000100:00100000:3.0:1777051214.756293:0:10328:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425838464 00000100:00100000:1.0:1777051214.756343:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051214.756433:0:46497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13060 00000100:00100000:1.0:1777051214.756435:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051214.756463:0:46497:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d9418f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:c11b6966-0775-44d2-bdc6-c74c26eb2226+14:2438:x1863365425838336:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:1.0:1777051214.756496:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051214.756518:0:10328:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425838848 00000100:00100000:3.0:1777051214.756528:0:10328:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425838848 00000100:00100000:0.0:1777051214.756574:0:46497:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d9418f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:c11b6966-0775-44d2-bdc6-c74c26eb2226+14:2438:x1863365425838336:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 119us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051214.756580:0:10328:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425838976 00000100:00100000:3.0:1777051214.756588:0:10328:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425838976 00000100:00100000:0.0:1777051214.756595:0:46497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13060 00000100:00100000:3.0:1777051214.756629:0:10328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13061 00000100:00100000:3.0:1777051214.756647:0:10328:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d9418f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+6:2439:x1863365425838464:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:0.0:1777051214.756661:0:46497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13062 00000100:00100000:0.0:1777051214.756683:0:46497:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d944d29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+17:2438:x1863365425838848:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:1.0:1777051214.756937:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051214.757800:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051214.757841:0:55805:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425838592 00000100:00100000:1.0:1777051214.757849:0:55805:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425838592 00000100:00100000:1.0:1777051214.757890:0:55805:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425838720 00000100:00100000:1.0:1777051214.757894:0:55805:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425838720 00000100:00100000:1.0:1777051214.757916:0:55805:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425839104 00000100:00100000:1.0:1777051214.757919:0:55805:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425839104 00000100:00100000:1.0:1777051214.757943:0:55805:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425839232 00000100:00100000:1.0:1777051214.757948:0:55805:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425839232 00000100:00100000:1.0:1777051214.757983:0:55805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10125 00000100:00100000:1.0:1777051214.757997:0:55805:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d9418f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c11b6966-0775-44d2-bdc6-c74c26eb2226+50:2438:x1863365425838592:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:1.0:1777051214.758061:0:55805:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d9418f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c11b6966-0775-44d2-bdc6-c74c26eb2226+50:2438:x1863365425838592:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 66us (1838us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051214.759020:0:46497:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d944d29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+17:2438:x1863365425838848:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 2338us (2585us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051214.759050:0:55805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10125 00000100:00100000:0.0:1777051214.759052:0:46497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13062 00000100:00100000:1.0:1777051214.759112:0:55805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10126 00000100:00100000:0.0:1777051214.759115:0:46497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13063 00000100:00100000:0.0:1777051214.759145:0:46497:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d944d2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+48:2439:x1863365425838976:12345-192.168.201.46@tcp:400:kworker.0 00000100:00080000:0.0:1777051214.759492:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1777051214.759500:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1777051214.759504:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1777051214.759508:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1777051214.759558:0:13320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10127 00000100:00100000:0.0:1777051214.759572:0:13320:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d944d2a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+50:2438:x1863365425839104:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:0.0:1777051214.759952:0:13320:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d944d2a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+50:2438:x1863365425839104:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 381us (3015us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051214.759964:0:13320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10127 00000100:00100000:0.0:1777051214.759992:0:13320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10128 00000100:00100000:0.0:1777051214.760003:0:13320:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d944d29f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+47:2439:x1863365425839232:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:0.0:1777051214.760047:0:13320:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d944d29f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+47:2439:x1863365425839232:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 46us (2250us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051214.760059:0:13320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10128 00000100:00100000:0.0:1777051214.760151:0:46497:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d944d2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+48:2439:x1863365425838976:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 1007us (3648us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051214.760172:0:46497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13063 00000100:00100000:1.0:1777051214.761041:0:55805:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d9418f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c11b6966-0775-44d2-bdc6-c74c26eb2226+48:2439:x1863365425838720:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:1.0:1777051214.761129:0:55805:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d9418f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c11b6966-0775-44d2-bdc6-c74c26eb2226+48:2439:x1863365425838720:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 1994us (4842us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051214.761150:0:55805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10126 00010000:00010000:1.0:1777051214.934638:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1777051215.126511:0:3677:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1777051215.126543:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d944d29c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3677:1863365452481408:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1777051215.126650:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051215.126778:0:8473:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452481408 00000100:00100000:0.0:1777051215.126807:0:8473:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452481408 00000100:00100000:3.0:1777051215.126871:0:10113:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452481536 00000100:00100000:3.0:1777051215.126882:0:10113:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452481536 00000100:00100000:0.0:1777051215.126908:0:8473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5500 00000100:00100000:0.0:1777051215.126931:0:8473:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d944d29500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3677:x1863365452481408:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1777051215.126973:0:10113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5501 00002000:00000024:0.0:1777051215.126979:0:8473:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 440355008 pending 0 free 3862671360 avail 3631149056 00000100:00100000:3.0:1777051215.126996:0:10113:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f658700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3679:x1863365452481536:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1777051215.127035:0:10113:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 430295232 pending 0 free 3645853696 avail 3414331392 00000100:00100000:0.0:1777051215.127073:0:8473:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d944d29500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3677:x1863365452481408:12345-0@lo:13:osp-pre-0-0.0 Request processed in 147us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051215.127089:0:8473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5500 00000100:00100000:3.0:1777051215.127146:0:10113:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f658700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3679:x1863365452481536:12345-0@lo:13:osp-pre-1-0.0 Request processed in 156us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051215.127162:0:10113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5501 00000100:00100000:1.0:1777051215.127369:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d944d29c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3677:1863365452481408:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1777051216.983009:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051218.006643:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1777051218.710925:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95f659500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3680:1863365452481664:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1777051218.711017:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051218.712518:0:8473:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452481664 00000100:00100000:1.0:1777051218.712531:0:8473:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452481664 00000100:00080000:0.0:1777051218.712629:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1777051218.712640:0:8473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5502 00000100:00100000:1.0:1777051218.712660:0:8473:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d9533bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3680:x1863365452481664:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1777051218.712699:0:8473:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 430295232 pending 0 free 3645853696 avail 3414331392 00000100:00100000:1.0:1777051218.713068:0:8473:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d9533bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3680:x1863365452481664:12345-0@lo:13:osp-pre-1-1.0 Request processed in 414us (2051us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051218.713083:0:8473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5502 00000100:00100000:0.0:1777051218.713650:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95f659500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3680:1863365452481664:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1777051219.031461:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777051219.222600:0:3678:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1777051219.222634:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f9b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452481792:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1777051219.222743:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051219.222874:0:10113:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452481792 00000100:00100000:3.0:1777051219.222884:0:10113:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452481792 00000100:00100000:3.0:1777051219.222977:0:10113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5503 00000100:00100000:3.0:1777051219.222994:0:10113:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3678:x1863365452481792:12345-0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1777051219.223024:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:3.0:1777051219.223039:0:10113:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 440355008 pending 0 free 3862671360 avail 3631149056 00000100:00100000:3.0:1777051219.223455:0:10113:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3678:x1863365452481792:12345-0@lo:13:osp-pre-0-1.0 Request processed in 464us (715us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051219.223468:0:10113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5503 00000100:00100000:1.0:1777051219.223845:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f9b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452481792:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1777051219.735480:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d9533bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452481920:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1777051219.735620:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051219.735744:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955612300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3678:1863365452482432:0@lo:400:kworker.0 00000100:00100000:3.0:1777051219.735784:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051219.735826:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051219.735854:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955610000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3679:1863365452482560:0@lo:400:kworker.0 00000100:00100000:0.0:1777051219.735885:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da444a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3678:1863365452482944:0@lo:400:kworker.0 00000100:00100000:3.0:1777051219.735961:0:99929:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452482176 00000100:00100000:3.0:1777051219.735974:0:99929:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452482176 00000100:00100000:0.0:1777051219.735996:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051219.736056:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da444a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3678:1863365452483456:0@lo:400:kworker.0 00000100:00100000:3.0:1777051219.736070:0:99929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1777051219.736091:0:99929:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da70b23050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9351a01-5b0e-4470-97fd-58b9b4b312a2+23:3680:x1863365452482176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777051219.736126:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051219.736192:0:3678:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1777051219.736259:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f9bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452482304:0@lo:400:kworker.0 00000100:00100000:3.0:1777051219.736274:0:99929:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da70b23050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9351a01-5b0e-4470-97fd-58b9b4b312a2+23:3680:x1863365452482176:12345-0@lo:400:kworker.0 Request processed in 188us (555us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051219.736291:0:99929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1777051219.736350:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051219.736407:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955613480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3678:1863365452482816:0@lo:400:kworker.0 00000100:00100000:3.0:1777051219.736442:0:46498:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452481920 00000100:00100000:3.0:1777051219.736454:0:46498:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452481920 00000100:00100000:0.0:1777051219.736468:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051219.736527:0:46498:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452482048 00000100:00100000:3.0:1777051219.736537:0:46498:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452482048 00000100:00100000:0.0:1777051219.736545:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da444a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3678:1863365452483328:0@lo:400:kworker.0 00000100:00100000:3.0:1777051219.736593:0:46498:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452483200 00000100:00100000:3.0:1777051219.736603:0:46498:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452483200 00000100:00100000:0.0:1777051219.736618:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051219.736652:0:46498:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452482304 00000100:00100000:3.0:1777051219.736661:0:46498:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452482304 00000100:00100000:3.0:1777051219.736718:0:46498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7964 00000100:00100000:0.0:1777051219.736734:0:11727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7965 00000100:00100000:3.0:1777051219.736744:0:46498:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7c9a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+8:3678:x1863365452481920:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1777051219.736765:0:11727:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94c12bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3679:x1863365452482048:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1777051219.736793:0:46498:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4194304 pending 0 free 1441603584 avail 1295364096 00000004:00000024:0.0:1777051219.736817:0:11727:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4243456 pending 0 free 1446064128 avail 1299824640 00000100:00100000:3.0:1777051219.736898:0:46498:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7c9a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+8:3678:x1863365452481920:12345-0@lo:41:osp-pre-0-1.0 Request processed in 162us (1278us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051219.736912:0:11727:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94c12bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3679:x1863365452482048:12345-0@lo:41:osp-pre-1-0.0 Request processed in 158us (1130us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051219.736916:0:46498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7964 00000100:00100000:0.0:1777051219.736939:0:11727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7965 00000100:00100000:3.0:1777051219.736968:0:46498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7966 00000100:00100000:0.0:1777051219.736988:0:11727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7967 00000100:00100000:3.0:1777051219.736998:0:46498:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fdf1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3680:x1863365452483200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777051219.737010:0:11727:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d944e10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:3678:x1863365452482304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051219.737098:0:46498:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fdf1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3680:x1863365452483200:12345-0@lo:400:kworker.0 Request processed in 110us (997us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051219.737118:0:46498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7966 00000100:00100000:0.0:1777051219.737120:0:11727:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d944e10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:3678:x1863365452482304:12345-0@lo:400:kworker.0 Request processed in 110us (766us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051219.737139:0:11727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7967 00000100:00100000:3.0:1777051219.737184:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051219.737283:0:27882:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452482560 00000100:00100000:0.0:1777051219.737292:0:27882:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452482560 00000100:00100000:3.0:1777051219.737348:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da444a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452483072:0@lo:400:kworker.0 00000100:00100000:0.0:1777051219.737402:0:27882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13068 00000100:00100000:3.0:1777051219.737423:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051219.737426:0:27882:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f29bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0000_UUID+5:3679:x1863365452482560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051219.737485:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da444a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3679:1863365452483584:0@lo:400:kworker.0 00000100:00100000:0.0:1777051219.737526:0:27882:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f29bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0000_UUID+5:3679:x1863365452482560:12345-0@lo:400:kworker.0 Request processed in 106us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051219.737548:0:27882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13068 00000100:00100000:3.0:1777051219.737566:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051219.737645:0:27887:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452483456 00000100:00100000:0.0:1777051219.737655:0:27887:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452483456 00000100:00100000:3.0:1777051219.737668:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95f65aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452482048:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1777051219.737737:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955610000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3679:1863365452482560:0@lo:400:kworker.0 00000100:00100000:0.0:1777051219.737741:0:27887:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452483328 00000100:00100000:0.0:1777051219.737751:0:27887:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452483328 00000100:00100000:0.0:1777051219.737813:0:27887:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452483072 00000100:00100000:0.0:1777051219.737820:0:27887:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452483072 00000100:00100000:3.0:1777051219.737863:0:8470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10129 00000100:00100000:0.0:1777051219.737881:0:27887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10130 00000100:00100000:3.0:1777051219.737891:0:8470:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d944e11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3678:x1863365452483456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777051219.737909:0:27887:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d944e13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3678:x1863365452483328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051219.737977:0:8470:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d944e11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3678:x1863365452483456:12345-0@lo:400:kworker.0 Request processed in 97us (1851us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051219.737992:0:8470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10129 00000100:00100000:0.0:1777051219.738018:0:27887:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d944e13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3678:x1863365452483328:12345-0@lo:400:kworker.0 Request processed in 117us (1401us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051219.738032:0:27887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10130 00000100:00100000:3.0:1777051219.738084:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da444a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3680:1863365452483200:0@lo:400:kworker.0 00000100:00100000:3.0:1777051219.738111:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f9b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3680:1863365452482176:0@lo:400:kworker.0 00000100:00100000:3.0:1777051219.738150:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955612680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3680:1863365452482688:0@lo:400:kworker.0 00000100:00100000:0.0:1777051219.738711:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f9bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452482304:0@lo:400:kworker.0 00000100:00100000:0.0:1777051219.738727:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955613480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3678:1863365452482816:0@lo:400:kworker.0 00000100:00100000:0.0:1777051219.738741:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da444a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3678:1863365452483328:0@lo:400:kworker.0 00000100:00100000:0.0:1777051219.738762:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955612300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3678:1863365452482432:0@lo:400:kworker.0 00000100:00100000:0.0:1777051219.738779:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da444a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3678:1863365452482944:0@lo:400:kworker.0 00000100:00100000:0.0:1777051219.738797:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da444a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3678:1863365452483456:0@lo:400:kworker.0 00000100:00100000:0.0:1777051219.738822:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d9533bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452481920:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1777051219.881882:0:99930:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425839360 00000100:00100000:0.0:1777051219.881898:0:99930:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425839360 00000100:00100000:0.0:1777051219.881987:0:99930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 89 00000100:00100000:0.0:1777051219.882013:0:99930:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da70b23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29c4352d-3260-4734-909d-9ea5de9e7fa4+12:2438:x1863365425839360:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:3.0:1777051219.882036:0:27885:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425839488 00000100:00100000:3.0:1777051219.882049:0:27885:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425839488 00000100:00100000:0.0:1777051219.882150:0:99930:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da70b23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29c4352d-3260-4734-909d-9ea5de9e7fa4+12:2438:x1863365425839360:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 143us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051219.882153:0:27885:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425839616 00000100:00100000:3.0:1777051219.882164:0:27885:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425839616 00000100:00100000:0.0:1777051219.882173:0:99930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 89 00000100:00100000:3.0:1777051219.882219:0:27885:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425840000 00000100:00100000:3.0:1777051219.882236:0:27885:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425840000 00000100:00100000:0.0:1777051219.882288:0:8471:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425839744 00000100:00100000:0.0:1777051219.882297:0:8471:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425839744 00000100:00100000:3.0:1777051219.882355:0:27885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13070 00000100:00100000:3.0:1777051219.882377:0:27885:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d951fa1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c11b6966-0775-44d2-bdc6-c74c26eb2226+14:2439:x1863365425839488:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:0.0:1777051219.882401:0:8471:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425839872 00000100:00100000:0.0:1777051219.882411:0:8471:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425839872 00000100:00100000:0.0:1777051219.882479:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10132 00000100:00100000:3.0:1777051219.882479:0:27885:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d951fa1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c11b6966-0775-44d2-bdc6-c74c26eb2226+14:2439:x1863365425839488:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 101us (638us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051219.882499:0:27885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13070 00000100:00100000:0.0:1777051219.882510:0:8471:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f864380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+50:2439:x1863365425839744:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:3.0:1777051219.882532:0:27885:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425840128 00000100:00100000:3.0:1777051219.882540:0:27885:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425840128 00000100:00100000:0.0:1777051219.882579:0:8471:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f864380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+50:2439:x1863365425839744:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 79us (584us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051219.882600:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10132 00000100:00100000:0.0:1777051219.882634:0:8471:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425840384 00000100:00100000:0.0:1777051219.882643:0:8471:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425840384 00000100:00100000:0.0:1777051219.882695:0:8471:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425840256 00000100:00100000:0.0:1777051219.882702:0:8471:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425840256 00000100:00100000:0.0:1777051219.882749:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10133 00000100:00100000:0.0:1777051219.882761:0:8471:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da44494380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+48:2438:x1863365425839872:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:0.0:1777051219.882820:0:8471:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da44494380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+48:2438:x1863365425839872:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 60us (766us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051219.882831:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10133 00000100:00100000:0.0:1777051219.882855:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10134 00000100:00100000:0.0:1777051219.882866:0:8471:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fd64380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+47:2438:x1863365425840384:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:0.0:1777051219.882904:0:8471:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fd64380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+47:2438:x1863365425840384:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 41us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051219.882914:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10134 00000100:00100000:0.0:1777051219.882934:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10135 00000100:00100000:0.0:1777051219.882945:0:8471:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fd67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+50:2439:x1863365425840256:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:0.0:1777051219.882985:0:8471:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fd67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+50:2439:x1863365425840256:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 41us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051219.882996:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10135 00000100:00100000:3.0:1777051219.883114:0:27885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13071 00000100:00100000:3.0:1777051219.883127:0:27885:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d951fa1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c11b6966-0775-44d2-bdc6-c74c26eb2226+6:2438:x1863365425839616:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:3.0:1777051219.883181:0:27885:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d951fa1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c11b6966-0775-44d2-bdc6-c74c26eb2226+6:2438:x1863365425839616:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 56us (1281us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051219.883193:0:27885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13071 00000100:00100000:3.0:1777051219.883215:0:27885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13072 00000100:00100000:3.0:1777051219.883226:0:27885:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da44497b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+17:2439:x1863365425840000:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:3.0:1777051219.883269:0:27885:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da44497b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+17:2439:x1863365425840000:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 43us (1143us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051219.883279:0:27885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13072 00000100:00100000:3.0:1777051219.883300:0:27885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13073 00000100:00100000:3.0:1777051219.883342:0:27885:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fd65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+48:2438:x1863365425840128:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:3.0:1777051219.883385:0:27885:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fd65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+48:2438:x1863365425840128:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 45us (980us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051219.883396:0:27885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13073 00000100:00080000:3.0:1777051219.883433:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1777051219.883441:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1777051219.883446:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1777051219.883450:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1777051220.054494:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777051220.246465:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d944e11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3680:1863365452483712:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1777051220.246558:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d944e10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3677:1863365452483840:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1777051220.246573:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051220.246648:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051220.247039:0:47388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5504 00000100:00100000:3.0:1777051220.247060:0:47388:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95aecea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3680:x1863365452483712:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1777051220.247104:0:47388:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 430295232 pending 0 free 3645853696 avail 3414331392 00000100:00100000:3.0:1777051220.247249:0:47388:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95aecea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3680:x1863365452483712:12345-0@lo:13:osp-pre-1-0.0 Request processed in 192us (679us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051220.247271:0:47388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5504 00000100:00100000:0.0:1777051220.247415:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d944e10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3677:1863365452483840:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1777051220.247422:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d944e11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3680:1863365452483712:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1777051221.079443:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1777051221.529093:0:99954:0:(llog.c:858:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000080:1.0:1777051222.047552:0:100833:0:(class_obd.c:319:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe8e454250 20000000:00000080:1.0:1777051222.047574:0:100833:0:(mgs_handler.c:1163:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff99da5f35a000 uarg=0000000000000000 20000000:01000000:1.0:1777051222.047626:0:100833:0:(mgs_llog.c:6175:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm.default_archive_id=2' 20000000:01000000:1.0:1777051222.047633:0:100833:0:(mgs_llog.c:4637:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm.default_archive_id=2' 20000000:01000000:1.0:1777051222.047639:0:100833:0:(mgs_llog.c:1366:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm.default_archive_id=2 del=0 20000000:02000000:1.0:1777051222.048724:0:100833:0:(mgs_llog.c:4110:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm.default_archive_id=2 in log params 00000040:00080000:1.0:1777051222.073796:0:100833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].31, 224 off14144 00000040:00080000:1.0:1777051222.073856:0:100833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].32, 136 off14280 00000040:00080000:1.0:1777051222.073885:0:100833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].33, 224 off14504 10000000:01000000:1.0:1777051222.073915:0:100833:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1777051222.073943:0:100833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99d955a8ea00/0x85f51a6b9671452e lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 100833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051222.073972:0:100833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99da7d784e00/0x85f51a6b967141a0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b96714199 expref: 22 pid: 99935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051222.073992:0:100833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99d94ffbdc00/0x85f51a6b967141d8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5e46 expref: 11 pid: 99930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051222.074316:0:100833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99d953299e00/0x85f51a6b967141ed lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5e5b expref: 11 pid: 99930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051222.074330:0:100833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99d953298000/0x85f51a6b9671422c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b96714225 expref: 22 pid: 99929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051222.074341:0:100833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99da7d785200/0x85f51a6b96714256 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b9671424f expref: 22 pid: 99930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051222.074353:0:100833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99d95595ba00/0x85f51a6b967142aa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b967142a3 expref: 22 pid: 99929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051222.074365:0:100833:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99d955a8ea00/0x85f51a6b9671452e lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 100833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051222.074783:0:100833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99d95595ba00/0x85f51a6b967142aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x85f51a6b967142a3 expref: 22 pid: 99929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051222.074808:0:100833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99d95595ba00/0x85f51a6b967142aa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x85f51a6b967142a3 expref: 22 pid: 99929 timeout: 7951 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051222.074837:0:100833:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d944d29c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:100833:1863365452483968:0@lo:104: 00000100:00100000:1.0:1777051222.074928:0:100833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1777051222.075027:0:100833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99da7d785200/0x85f51a6b96714256 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x85f51a6b9671424f expref: 22 pid: 99930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051222.075047:0:100833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99da7d785200/0x85f51a6b96714256 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x85f51a6b9671424f expref: 22 pid: 99930 timeout: 7951 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051222.075066:0:100833:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d942a0d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:100833:1863365452484096:0@lo:104: 00000100:00100000:3.0:1777051222.075071:0:6563:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452483968 00000100:00100000:3.0:1777051222.075085:0:6563:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452483968 00000100:00100000:1.0:1777051222.075114:0:100833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1777051222.075165:0:100833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99d953298000/0x85f51a6b9671422c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x85f51a6b96714225 expref: 22 pid: 99929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051222.075168:0:6563:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452484096 00000100:00100000:3.0:1777051222.075178:0:6563:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452484096 00010000:00010000:1.0:1777051222.075193:0:100833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99d953298000/0x85f51a6b9671422c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x85f51a6b96714225 expref: 22 pid: 99929 timeout: 7951 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051222.075251:0:100833:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d942a0c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:100833:1863365452484224:0@lo:104: 00000100:00100000:3.0:1777051222.075329:0:6563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1777051222.075339:0:100833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051222.075356:0:6563:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d944d2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f9351a01-5b0e-4470-97fd-58b9b4b312a2+4:100833:x1863365452483968:12345-0@lo:104: 00010000:00010000:3.0:1777051222.075379:0:6563:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.146@tcp lock: ffff99da7d784600/0x85f51a6b967142a3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x85f51a6b967142aa expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051222.075401:0:100833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99d953299e00/0x85f51a6b967141ed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5e5b expref: 11 pid: 99930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051222.075439:0:100833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99d953299e00/0x85f51a6b967141ed lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5e5b expref: 11 pid: 99930 timeout: 7951 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051222.075457:0:100833:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d942a0ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:100833:1863365452484352:192.168.201.46@tcp:104: 00010000:00010000:1.0:1777051222.075559:0:100833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99d94ffbdc00/0x85f51a6b967141d8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5e46 expref: 11 pid: 99930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051222.075586:0:100833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99d94ffbdc00/0x85f51a6b967141d8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5e46 expref: 11 pid: 99930 timeout: 7951 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051222.075604:0:100833:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d942a0df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:100833:1863365452484480:192.168.201.46@tcp:104: 00010000:00010000:3.0:1777051222.075713:0:6563:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1777051222.075728:0:6563:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d944d2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f9351a01-5b0e-4470-97fd-58b9b4b312a2+5:100833:x1863365452483968:12345-0@lo:104: Request processed in 378us (798us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051222.075756:0:6563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1777051222.075799:0:6563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1777051222.075814:0:6563:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d943427450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f9351a01-5b0e-4470-97fd-58b9b4b312a2+4:100833:x1863365452484224:12345-0@lo:104: 00010000:00010000:3.0:1777051222.075829:0:6563:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.146@tcp lock: ffff99da7d785000/0x85f51a6b96714225 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x85f51a6b9671422c expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051222.075894:0:100833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99da7d784e00/0x85f51a6b967141a0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x85f51a6b96714199 expref: 22 pid: 99935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051222.075906:0:100833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99da7d784e00/0x85f51a6b967141a0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x85f51a6b96714199 expref: 22 pid: 99935 timeout: 7951 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051222.075914:0:6563:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1777051222.075926:0:100833:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d942a0d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:100833:1863365452484608:0@lo:104: 00000100:00100000:3.0:1777051222.075929:0:6563:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d943427450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f9351a01-5b0e-4470-97fd-58b9b4b312a2+4:100833:x1863365452484224:12345-0@lo:104: Request processed in 116us (592us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051222.075947:0:6563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1777051222.075993:0:100833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051222.076033:0:100833:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d94e77eb40 going to sleep for 11 seconds 00000100:00100000:1.0:1777051222.076074:0:100833:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d944d29c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:100833:1863365452483968:0@lo:104: 00000100:00100000:1.0:1777051222.076099:0:100833:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d942a0d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:100833:1863365452484096:0@lo:104: 00000100:00100000:1.0:1777051222.076118:0:100833:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d942a0c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:100833:1863365452484224:0@lo:104: 00010000:00010000:3.0:1777051222.076123:0:13753:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1777051222.076136:0:13753:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.146@tcp lock: ffff99da7d784600/0x85f51a6b967142a3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x85f51a6b967142aa expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051222.076162:0:13753:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da7d784600 already unused, calling callback (ffffffffc1208c20) 10000000:00010000:3.0:1777051222.076170:0:13753:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.146@tcp lock: ffff99da7d784600/0x85f51a6b967142a3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x85f51a6b967142aa expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051222.076186:0:13753:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.146@tcp lock: ffff99da7d784600/0x85f51a6b967142a3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x85f51a6b967142aa expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1777051222.076199:0:13753:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.146@tcp lock: ffff99da7d784600/0x85f51a6b967142a3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x85f51a6b967142aa expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1777051222.076207:0:13753:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1777051222.076242:0:6567:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1777051222.076256:0:6567:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.146@tcp lock: ffff99da7d785000/0x85f51a6b96714225 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x85f51a6b9671422c expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051222.076257:0:13753:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.146@tcp lock: ffff99da7d784600/0x85f51a6b967142a3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x85f51a6b967142aa expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051222.076304:0:6567:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da7d785000 already unused, calling callback (ffffffffc1208c20) 10000000:00010000:0.0:1777051222.076314:0:6567:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.146@tcp lock: ffff99da7d785000/0x85f51a6b96714225 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x85f51a6b9671422c expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051222.076330:0:6567:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.146@tcp lock: ffff99da7d785000/0x85f51a6b96714225 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x85f51a6b9671422c expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1777051222.076344:0:6567:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.146@tcp lock: ffff99da7d785000/0x85f51a6b96714225 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x85f51a6b9671422c expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1777051222.076354:0:6567:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1777051222.076403:0:6567:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.146@tcp lock: ffff99da7d785000/0x85f51a6b96714225 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x85f51a6b9671422c expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051222.076416:0:6567:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1777051222.076459:0:6567:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.146@tcp lock: ffff99da7d785000/0x85f51a6b96714225 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x85f51a6b9671422c expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051222.076475:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d944e10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3678:1863365452484864:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1777051222.076476:0:6567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.146@tcp lock: ffff99da7d785000/0x85f51a6b96714225 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x85f51a6b9671422c expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051222.076510:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777051222.076515:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777051222.076519:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1777051222.076542:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051222.076596:0:6564:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452484864 00000100:00100000:0.0:1777051222.076605:0:6564:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452484864 00010000:00010000:0.0:1777051222.076636:0:6564:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99d953298000/0x85f51a6b9671422c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x85f51a6b96714225 expref: 23 pid: 99929 timeout: 7951 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051222.076955:0:6564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3809 00000100:00100000:0.0:1777051222.076971:0:6564:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942a0f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f9351a01-5b0e-4470-97fd-58b9b4b312a2+23:3678:x1863365452484864:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1777051222.076991:0:6564:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777051222.077000:0:6564:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99d953298000/0x85f51a6b9671422c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x85f51a6b96714225 expref: 23 pid: 99929 timeout: 7951 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051222.077015:0:6564:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99d953298000/0x85f51a6b9671422c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x85f51a6b96714225 expref: 23 pid: 99929 timeout: 7951 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051222.077579:0:13753:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1777051222.077624:0:13753:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.146@tcp lock: ffff99da7d784600/0x85f51a6b967142a3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x85f51a6b967142aa expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051222.077637:0:13753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.146@tcp lock: ffff99da7d784600/0x85f51a6b967142a3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x85f51a6b967142aa expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051222.077656:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051222.077661:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051222.077665:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1777051222.077675:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95aecd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3679:1863365452484736:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1777051222.077691:0:6563:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452484608 00000100:00100000:3.0:1777051222.077700:0:6563:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452484608 00000100:00100000:1.0:1777051222.077726:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051222.077756:0:6563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1777051222.077771:0:6563:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942a0c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f9351a01-5b0e-4470-97fd-58b9b4b312a2+4:100833:x1863365452484608:12345-0@lo:104: 00010000:00010000:3.0:1777051222.077786:0:6563:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.146@tcp lock: ffff99d953299600/0x85f51a6b96714199 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x85f51a6b967141a0 expref: -99 pid: 99922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051222.077814:0:6565:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452484736 00000100:00100000:1.0:1777051222.077823:0:6565:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452484736 00010000:00010000:1.0:1777051222.077853:0:6565:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99d95595ba00/0x85f51a6b967142aa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x85f51a6b967142a3 expref: 24 pid: 99929 timeout: 7951 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051222.077870:0:6563:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1777051222.077882:0:6563:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942a0c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f9351a01-5b0e-4470-97fd-58b9b4b312a2+4:100833:x1863365452484608:12345-0@lo:104: Request processed in 114us (1892us total) trans 0 rc 0/0 00010000:00010000:0.0:1777051222.077889:0:6564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d953298000/0x85f51a6b9671422c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x85f51a6b96714225 expref: 23 pid: 99929 timeout: 7951 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051222.077899:0:6563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00010000:00010000:0.0:1777051222.077926:0:6564:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1777051222.077951:0:6565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3810 00010000:00010000:3.0:1777051222.077975:0:6568:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:1.0:1777051222.077983:0:6565:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942a0e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f9351a01-5b0e-4470-97fd-58b9b4b312a2+23:3679:x1863365452484736:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1777051222.077989:0:6568:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.146@tcp lock: ffff99d953299600/0x85f51a6b96714199 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x85f51a6b967141a0 expref: -99 pid: 99922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051222.078006:0:6565:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777051222.078006:0:6568:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d953299600 already unused, calling callback (ffffffffc1208c20) 00000100:00100000:0.0:1777051222.078016:0:6564:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942a0f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f9351a01-5b0e-4470-97fd-58b9b4b312a2+23:3678:x1863365452484864:12345-0@lo:103:ldlm_bl.0 Request processed in 1041us (1468us total) trans 0 rc 0/0 10000000:00010000:3.0:1777051222.078019:0:6568:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.146@tcp lock: ffff99d953299600/0x85f51a6b96714199 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x85f51a6b967141a0 expref: -99 pid: 99922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051222.078025:0:6565:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99d95595ba00/0x85f51a6b967142aa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x85f51a6b967142a3 expref: 23 pid: 99929 timeout: 7951 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051222.078056:0:6568:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.146@tcp lock: ffff99d953299600/0x85f51a6b96714199 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x85f51a6b967141a0 expref: -99 pid: 99922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1777051222.078070:0:6568:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.146@tcp lock: ffff99d953299600/0x85f51a6b96714199 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x85f51a6b967141a0 expref: -99 pid: 99922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051222.078091:0:6564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3809 00010000:00010000:1.0:1777051222.078101:0:6565:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99d95595ba00/0x85f51a6b967142aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x85f51a6b967142a3 expref: 23 pid: 99929 timeout: 7951 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1777051222.078104:0:6568:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1777051222.078147:0:6565:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d95595ba00/0x85f51a6b967142aa lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x85f51a6b967142a3 expref: 22 pid: 99929 timeout: 7951 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051222.078161:0:6568:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.146@tcp lock: ffff99d953299600/0x85f51a6b96714199 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x85f51a6b967141a0 expref: -99 pid: 99922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051222.078165:0:6565:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1777051222.078172:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d944e10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3678:1863365452484864:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1777051222.078187:0:6568:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1777051222.078234:0:6565:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942a0e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f9351a01-5b0e-4470-97fd-58b9b4b312a2+21:3679:x1863365452484736:12345-0@lo:103:ldlm_bl.0 Request processed in 263us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051222.078248:0:6565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3810 00010000:00010000:3.0:1777051222.078259:0:6568:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.146@tcp lock: ffff99d953299600/0x85f51a6b96714199 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x85f51a6b967141a0 expref: -99 pid: 99922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051222.078314:0:6568:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.146@tcp lock: ffff99d953299600/0x85f51a6b96714199 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x85f51a6b967141a0 expref: -99 pid: 99922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051222.078335:0:100833:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d942a0d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:100833:1863365452484608:0@lo:104: 00010000:00010000:3.0:1777051222.078354:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051222.078361:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051222.078368:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1777051222.078403:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95aecd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3679:1863365452484736:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1777051222.078418:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95aecc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3680:1863365452484992:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1777051222.078477:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051222.078552:0:47827:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452484992 00000100:00100000:0.0:1777051222.078560:0:47827:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452484992 00010000:00010000:0.0:1777051222.078586:0:47827:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99da7d784e00/0x85f51a6b967141a0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x85f51a6b96714199 expref: 21 pid: 99935 timeout: 7951 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051222.078630:0:47827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3811 00000100:00100000:0.0:1777051222.078642:0:47827:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95aecd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:f9351a01-5b0e-4470-97fd-58b9b4b312a2+21:3680:x1863365452484992:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1777051222.079195:0:47827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777051222.079205:0:47827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99da7d784e00/0x85f51a6b967141a0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x85f51a6b96714199 expref: 21 pid: 99935 timeout: 7951 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051222.079225:0:47827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99da7d784e00/0x85f51a6b967141a0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x85f51a6b96714199 expref: 21 pid: 99935 timeout: 7951 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051222.079256:0:47827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99da7d784e00/0x85f51a6b967141a0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x85f51a6b96714199 expref: 21 pid: 99935 timeout: 7951 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051222.079310:0:47827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1777051222.079376:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7fd65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3677:1863365452485120:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1777051222.079392:0:47827:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95aecd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:f9351a01-5b0e-4470-97fd-58b9b4b312a2+20:3680:x1863365452484992:12345-0@lo:103:ldlm_bl.0 Request processed in 745us (910us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051222.079408:0:47827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3811 00000100:00100000:3.0:1777051222.079420:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95aecc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3680:1863365452484992:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1777051222.079446:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051222.079533:0:6566:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452485120 00000100:00100000:3.0:1777051222.079542:0:6566:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452485120 00010000:00010000:3.0:1777051222.079571:0:6566:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99da7d785200/0x85f51a6b96714256 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x85f51a6b9671424f expref: 20 pid: 99930 timeout: 7951 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051222.079618:0:6566:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3812 00000100:00100000:3.0:1777051222.079630:0:6566:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942a0c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f9351a01-5b0e-4470-97fd-58b9b4b312a2+20:3677:x1863365452485120:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1777051222.079641:0:6566:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777051222.079647:0:6566:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99da7d785200/0x85f51a6b96714256 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x85f51a6b9671424f expref: 20 pid: 99930 timeout: 7951 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051222.079658:0:6566:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99da7d785200/0x85f51a6b96714256 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x85f51a6b9671424f expref: 20 pid: 99930 timeout: 7951 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051222.079671:0:6566:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99da7d785200/0x85f51a6b96714256 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x85f51a6b9671424f expref: 20 pid: 99930 timeout: 7951 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051222.079683:0:6566:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1777051222.079735:0:6566:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942a0c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f9351a01-5b0e-4470-97fd-58b9b4b312a2+19:3677:x1863365452485120:12345-0@lo:103:ldlm_bl.0 Request processed in 107us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051222.079819:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7fd65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3677:1863365452485120:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1777051222.080003:0:6566:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3812 00000100:00100000:0.0:1777051222.080244:0:100833:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d942a0ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:100833:1863365452484352:192.168.201.46@tcp:104: 00000100:00100000:0.0:1777051222.080303:0:100833:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d942a0df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:100833:1863365452484480:192.168.201.46@tcp:104: 00010000:00010000:0.0:1777051222.080372:0:100833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99d955a8ea00/0x85f51a6b9671452e lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 100833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051222.086998:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051222.087118:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051222.087236:0:24467:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425840512 00000100:00100000:0.0:1777051222.087367:0:6565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3813 00000100:00100000:0.0:1777051222.087394:0:6565:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d944e10000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:29c4352d-3260-4734-909d-9ea5de9e7fa4+12:2437:x1863365425840640:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1777051222.087417:0:6565:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777051222.087431:0:6565:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99d94ffbdc00/0x85f51a6b967141d8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5e46 expref: 12 pid: 99930 timeout: 7951 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051222.087435:0:24467:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425840512 00010000:00010000:0.0:1777051222.087460:0:6565:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99d94ffbdc00/0x85f51a6b967141d8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5e46 expref: 13 pid: 99930 timeout: 7951 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051222.087476:0:24467:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99d953299e00/0x85f51a6b967141ed lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5e5b expref: 13 pid: 99930 timeout: 7951 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051222.087494:0:6565:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d94ffbdc00/0x85f51a6b967141d8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5e46 expref: 13 pid: 99930 timeout: 7951 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051222.087521:0:6565:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1777051222.087530:0:24467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3814 00000100:00100000:1.0:1777051222.087548:0:24467:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d944e13800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:29c4352d-3260-4734-909d-9ea5de9e7fa4+12:2437:x1863365425840512:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1777051222.087567:0:24467:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1777051222.087579:0:24467:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99d953299e00/0x85f51a6b967141ed lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5e5b expref: 12 pid: 99930 timeout: 7951 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051222.087611:0:24467:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99d953299e00/0x85f51a6b967141ed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5e5b expref: 12 pid: 99930 timeout: 7951 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051222.087633:0:24467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d953299e00/0x85f51a6b967141ed lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5e5b expref: 12 pid: 99930 timeout: 7951 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051222.087675:0:24467:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99d955a8ea00/0x85f51a6b9671452e lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 100833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051222.087691:0:24467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d955a8ea00/0x85f51a6b9671452e lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 100833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051222.087704:0:6565:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d944e10000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:29c4352d-3260-4734-909d-9ea5de9e7fa4+11:2437:x1863365425840640:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 312us (711us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051222.087725:0:6565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3813 00010000:00010000:1.0:1777051222.087727:0:24467:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99d955a8ea00/0x85f51a6b9671452e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 100833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051222.087744:0:24467:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99d955a8ea00/0x85f51a6b9671452e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 100833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051222.087758:0:24467:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99d955a8ea00/0x85f51a6b9671452e lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 100833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051222.087772:0:24467:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99d955a8ea00/0x85f51a6b9671452e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 100833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051222.087784:0:24467:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d955a8ea00 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:1.0:1777051222.087791:0:24467:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99d955a8ea00/0x85f51a6b9671452e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 100833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051222.087805:0:24467:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99d955a8ea00/0x85f51a6b9671452e lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 100833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051222.087854:0:24467:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99d955a8ea00/0x85f51a6b9671452e lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 100833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051222.087871:0:24467:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1777051222.087898:0:100833:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99d955a8ea00/0x85f51a6b9671452e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 100833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051222.087920:0:24467:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d944e13800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:29c4352d-3260-4734-909d-9ea5de9e7fa4+10:2437:x1863365425840512:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 371us (798us total) trans 0 rc 0/0 00010000:00010000:0.0:1777051222.087922:0:100833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99d955a8ea00/0x85f51a6b9671452e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 100833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051222.087948:0:100833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d955a8ea00/0x85f51a6b9671452e lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 100833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051222.087951:0:24467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3814 00010000:00010000:0.0:1777051222.102574:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1777051222.821690:0:100882:0:(class_obd.c:319:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffeec595a00 20000000:00000080:3.0:1777051222.821711:0:100882:0:(mgs_handler.c:1163:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff99da50c2fc00 uarg=0000000000000000 20000000:01000000:3.0:1777051222.821764:0:100882:0:(mgs_llog.c:6175:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0001.hsm.default_archive_id=2' 20000000:01000000:3.0:1777051222.821773:0:100882:0:(mgs_llog.c:4637:mgs_write_log_param2()) next param 'mdt.lustre-MDT0001.hsm.default_archive_id=2' 20000000:01000000:3.0:1777051222.821779:0:100882:0:(mgs_llog.c:1366:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0001.hsm.default_archive_id=2 del=0 00000040:00080000:3.0:1777051222.822430:0:100883:0:(llog.c:858:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 34 count 34 20000000:02000000:1.0:1777051222.822579:0:100882:0:(mgs_llog.c:4110:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0001.hsm.default_archive_id=2 in log params 00000040:00080000:1.0:1777051222.822654:0:100882:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].34, 224 off14728 00000040:00080000:1.0:1777051222.822712:0:100882:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].35, 136 off14864 00000040:00080000:1.0:1777051222.822737:0:100882:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].36, 224 off15088 10000000:01000000:1.0:1777051222.822772:0:100882:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1777051222.822804:0:100882:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99d955a8ee00/0x85f51a6b96714535 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 100882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051222.822827:0:100882:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d955a8ee00/0x85f51a6b96714535 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 100882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051222.822841:0:100882:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99d955a8ee00/0x85f51a6b96714535 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 100882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051222.822852:0:100882:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99d955a8ee00/0x85f51a6b96714535 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 100882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051222.822862:0:100882:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99d955a8ee00/0x85f51a6b96714535 lrc: 3/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 100882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051222.822873:0:100882:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99d955a8ee00/0x85f51a6b96714535 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 100882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051222.822890:0:100882:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d955a8ee00 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:1.0:1777051222.822895:0:100882:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99d955a8ee00/0x85f51a6b96714535 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 100882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051222.822903:0:100882:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99d955a8ee00/0x85f51a6b96714535 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 100882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051222.822915:0:100882:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99d955a8ee00/0x85f51a6b96714535 lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 100882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051222.822924:0:100882:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99d955a8ee00/0x85f51a6b96714535 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 100882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051222.822934:0:100882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d955a8ee00/0x85f51a6b96714535 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 100882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051223.126437:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1777051223.831480:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d942a0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452485248:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1777051223.831646:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051223.831769:0:10113:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452485248 00000100:00100000:1.0:1777051223.831780:0:10113:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452485248 00000100:00080000:3.0:1777051223.831851:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1777051223.831869:0:10113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5506 00000100:00100000:1.0:1777051223.831888:0:10113:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942a0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3678:x1863365452485248:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1777051223.831927:0:10113:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 430295232 pending 0 free 3645853696 avail 3414331392 00000100:00100000:1.0:1777051223.832049:0:10113:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942a0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3678:x1863365452485248:12345-0@lo:13:osp-pre-1-1.0 Request processed in 164us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051223.832064:0:10113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5506 00000100:00100000:3.0:1777051223.832549:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d942a0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452485248:0@lo:13:osp-pre-1-1.0 10000000:01000000:1.0:1777051223.898333:0:6577:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1777051223.898395:0:6577:0:(mgc_request.c:1799:mgc_process_log()) Process log params-ffff99d958727800 from 31 10000000:01000000:1.0:1777051223.898403:0:6577:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1777051223.898459:0:6577:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.146@tcp lock: ffff99d955a8f000/0x85f51a6b9671453c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051223.898473:0:6577:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.146@tcp lock: ffff99d955a8f000/0x85f51a6b9671453c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051223.898488:0:6577:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.146@tcp lock: ffff99d955a8f000/0x85f51a6b9671453c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051223.898519:0:6577:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d942a0d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452485376:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1777051223.898629:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051223.898683:0:99929:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452485376 00000100:00100000:3.0:1777051223.898697:0:99929:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452485376 00000100:00100000:1.0:1777051223.898720:0:6577:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d95ba006c0 going to sleep for 11 seconds 00000100:00100000:3.0:1777051223.899106:0:99929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1777051223.899123:0:99929:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da70b22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9351a01-5b0e-4470-97fd-58b9b4b312a2+19:6577:x1863365452485376:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1777051223.899142:0:99929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777051223.899166:0:99929:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d943ebb600/0x85f51a6b96714543 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x85f51a6b9671453c expref: -99 pid: 99929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051223.899205:0:99929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d943ebb600/0x85f51a6b96714543 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x85f51a6b9671453c expref: 20 pid: 99929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051223.899229:0:99929:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d943ebb600/0x85f51a6b96714543 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b9671453c expref: 20 pid: 99929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051223.899282:0:99929:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d943ebb600, rc 0) 00000100:00100000:3.0:1777051223.899625:0:99929:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da70b22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9351a01-5b0e-4470-97fd-58b9b4b312a2+20:6577:x1863365452485376:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 501us (992us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051223.899640:0:99929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1777051223.900294:0:6577:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d942a0d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452485376:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1777051223.900319:0:6577:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.146@tcp lock: ffff99d955a8f000/0x85f51a6b9671453c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b96714543 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051223.900338:0:6577:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.146@tcp lock: ffff99d955a8f000/0x85f51a6b9671453c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x85f51a6b96714543 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051223.900436:0:6577:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d942a0d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452485504:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1777051223.900485:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051223.900538:0:6577:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d95ba006c0 going to sleep for 11 seconds 00000100:00100000:3.0:1777051223.900944:0:6577:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d942a0d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452485504:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1777051223.901301:0:6577:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95aecc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452485632:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1777051223.901393:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051223.901456:0:6577:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d94ecc3900 going to sleep for 11 seconds 00000100:00100000:3.0:1777051223.902485:0:6577:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95aecc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452485632:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1777051223.903445:0:100947:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95aecc380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f9351a01-5b0e-4470-97fd-58b9b4b312a2:100947:1863365452485760:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1777051223.903518:0:100947:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051223.903577:0:100947:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d94ecc36c0 going to sleep for 11 seconds 00000100:00100000:3.0:1777051223.904331:0:100947:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95aecc380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f9351a01-5b0e-4470-97fd-58b9b4b312a2:100947:1863365452485760:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1777051223.904384:0:100947:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1777051223.904399:0:100947:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1777051223.904403:0:100947:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre mdt.lustre-MDT0000.hsm.default_archive_id 00000020:01000000:3.0:1777051223.904415:0:100947:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff99d958727800 00000020:00000080:3.0:1777051223.904421:0:100947:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1777051223.904514:0:100947:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1777051223.904522:0:100947:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1777051223.904525:0:100947:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre mdt.lustre-MDT0000.hsm.default_archive_id 00000020:01000000:3.0:1777051223.904530:0:100947:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1777051223.904537:0:100947:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1777051223.904542:0:100947:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre mdt.lustre-MDT0001.hsm.default_archive_id 00000020:01000000:3.0:1777051223.904552:0:100947:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff99d958727800 00000020:00000080:3.0:1777051223.904556:0:100947:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1777051223.904652:0:100947:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95aecc380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f9351a01-5b0e-4470-97fd-58b9b4b312a2:100947:1863365452485888:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1777051223.904770:0:100947:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051223.904821:0:100947:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d94ecc36c0 going to sleep for 11 seconds 00000100:00100000:3.0:1777051223.905133:0:100947:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95aecc380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f9351a01-5b0e-4470-97fd-58b9b4b312a2:100947:1863365452485888:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1777051223.905183:0:100947:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1777051223.905191:0:100947:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1777051223.905195:0:100947:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre mdt.lustre-MDT0001.hsm.default_archive_id 00000040:00080000:3.0:1777051223.905202:0:100947:0:(llog.c:858:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 37 count 37 00000020:01000000:0.0:1777051223.906358:0:6577:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 31-36 (rc=0) 10000000:01000000:0.0:1777051223.906406:0:6577:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.201.146@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1777051223.906420:0:6577:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff99d955a8f000/0x85f51a6b9671453c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b96714543 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051223.906440:0:6577:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.146@tcp lock: ffff99d955a8f000/0x85f51a6b9671453c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b96714543 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1777051223.906457:0:6577:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1777051223.906463:0:6577:0:(mgc_request.c:1799:mgc_process_log()) Process log params-ffff99d941839800 from 31 10000000:01000000:0.0:1777051223.906469:0:6577:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1777051223.906508:0:6577:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.146@tcp lock: ffff99da7d507800/0x85f51a6b9671454a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051223.906522:0:6577:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.146@tcp lock: ffff99da7d507800/0x85f51a6b9671454a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051223.906538:0:6577:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.146@tcp lock: ffff99da7d507800/0x85f51a6b9671454a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051223.906566:0:6577:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d944e11180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452486016:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1777051223.906632:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051223.906694:0:6577:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d9566000c0 going to sleep for 11 seconds 00000100:00100000:3.0:1777051223.906698:0:99935:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452486016 00000100:00100000:3.0:1777051223.906706:0:99935:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452486016 00000100:00100000:3.0:1777051223.906762:0:99935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1777051223.906773:0:99935:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7d9dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f9351a01-5b0e-4470-97fd-58b9b4b312a2+20:6577:x1863365452486016:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1777051223.906785:0:99935:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777051223.906800:0:99935:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d943ebb200/0x85f51a6b96714551 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x85f51a6b9671454a expref: -99 pid: 99935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051223.906827:0:99935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d943ebb200/0x85f51a6b96714551 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x85f51a6b9671454a expref: 21 pid: 99935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051223.906840:0:99935:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d943ebb200/0x85f51a6b96714551 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b9671454a expref: 21 pid: 99935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051223.906850:0:99935:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d943ebb200, rc 0) 00000100:00100000:3.0:1777051223.906900:0:99935:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7d9dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f9351a01-5b0e-4470-97fd-58b9b4b312a2+21:6577:x1863365452486016:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 129us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051223.906908:0:99935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1777051223.906956:0:6577:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d944e11180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452486016:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1777051223.906991:0:6577:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.146@tcp lock: ffff99da7d507800/0x85f51a6b9671454a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b96714551 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051223.907009:0:6577:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.146@tcp lock: ffff99da7d507800/0x85f51a6b9671454a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x85f51a6b96714551 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051223.907118:0:6577:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d944e11180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452486144:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1777051223.907186:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051223.907326:0:99928:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452486144 00000100:00100000:0.0:1777051223.907336:0:6577:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d9566000c0 going to sleep for 11 seconds 00000100:00100000:3.0:1777051223.907338:0:99928:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452486144 00000100:00100000:3.0:1777051223.907416:0:99928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1777051223.907432:0:99928:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7d9df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9351a01-5b0e-4470-97fd-58b9b4b312a2+21:6577:x1863365452486144:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1777051223.907582:0:99928:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7d9df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9351a01-5b0e-4470-97fd-58b9b4b312a2+21:6577:x1863365452486144:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 153us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051223.907596:0:99928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1777051223.907655:0:6577:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d944e11180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452486144:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1777051223.907721:0:6577:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d944e11180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452486272:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1777051223.907806:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051223.907899:0:99930:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452486272 00000100:00100000:3.0:1777051223.907907:0:99930:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452486272 00000100:00100000:0.0:1777051223.907911:0:6577:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d9566000c0 going to sleep for 11 seconds 00000100:00100000:3.0:1777051223.907958:0:99930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1777051223.907970:0:99930:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7d9ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9351a01-5b0e-4470-97fd-58b9b4b312a2+21:6577:x1863365452486272:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1777051223.908104:0:99930:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7d9ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9351a01-5b0e-4470-97fd-58b9b4b312a2+21:6577:x1863365452486272:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 134us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051223.908120:0:99930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1777051223.908147:0:6577:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d944e11180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452486272:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1777051223.908950:0:100950:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d944e11180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f9351a01-5b0e-4470-97fd-58b9b4b312a2:100950:1863365452486400:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1777051223.909033:0:100950:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051223.909097:0:100950:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d956600480 going to sleep for 11 seconds 00000100:00100000:3.0:1777051223.909394:0:99929:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452486400 00000100:00100000:3.0:1777051223.909403:0:99929:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452486400 00000100:00100000:3.0:1777051223.909455:0:99929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1777051223.909468:0:99929:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7d9dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9351a01-5b0e-4470-97fd-58b9b4b312a2+21:100950:x1863365452486400:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1777051223.909618:0:99929:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7d9dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9351a01-5b0e-4470-97fd-58b9b4b312a2+21:100950:x1863365452486400:12345-0@lo:502:llog_process_th.0 Request processed in 153us (586us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051223.909631:0:99929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1777051223.909665:0:100950:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d944e11180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f9351a01-5b0e-4470-97fd-58b9b4b312a2:100950:1863365452486400:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1777051223.909718:0:100950:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1777051223.909732:0:100950:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1777051223.909737:0:100950:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre mdt.lustre-MDT0000.hsm.default_archive_id 00000020:01000000:0.0:1777051223.909748:0:100950:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff99d941839800 00000020:00000080:0.0:1777051223.909754:0:100950:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1777051223.909816:0:100950:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1777051223.909824:0:100950:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1777051223.909828:0:100950:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre mdt.lustre-MDT0000.hsm.default_archive_id 00000020:01000000:0.0:1777051223.909835:0:100950:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1777051223.909842:0:100950:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1777051223.909845:0:100950:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre mdt.lustre-MDT0001.hsm.default_archive_id 00000020:01000000:0.0:1777051223.909853:0:100950:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff99d941839800 00000020:00000080:0.0:1777051223.909858:0:100950:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1777051223.909930:0:100950:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d944e11180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f9351a01-5b0e-4470-97fd-58b9b4b312a2:100950:1863365452486528:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1777051223.910002:0:100950:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051223.910066:0:100950:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d941aecd80 going to sleep for 11 seconds 00000100:00100000:3.0:1777051223.910160:0:99930:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452486528 00000100:00100000:3.0:1777051223.910169:0:99930:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452486528 00000100:00100000:3.0:1777051223.910226:0:99930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1777051223.910271:0:99930:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7d9dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9351a01-5b0e-4470-97fd-58b9b4b312a2+21:100950:x1863365452486528:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1777051223.910419:0:99930:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7d9dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9351a01-5b0e-4470-97fd-58b9b4b312a2+21:100950:x1863365452486528:12345-0@lo:502:llog_process_th.0 Request processed in 179us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051223.910430:0:99930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1777051223.910458:0:100950:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d944e11180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f9351a01-5b0e-4470-97fd-58b9b4b312a2:100950:1863365452486528:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1777051223.910511:0:100950:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1777051223.910522:0:100950:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1777051223.910525:0:100950:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre mdt.lustre-MDT0001.hsm.default_archive_id 00000040:00080000:0.0:1777051223.910531:0:100950:0:(llog.c:858:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 37 count 37 00000020:01000000:3.0:1777051223.910654:0:6577:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 31-36 (rc=0) 10000000:01000000:3.0:1777051223.910698:0:6577:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.201.146@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1777051223.910708:0:6577:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff99da7d507800/0x85f51a6b9671454a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b96714551 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051223.910722:0:6577:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.146@tcp lock: ffff99da7d507800/0x85f51a6b9671454a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b96714551 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1777051223.910748:0:6577:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1777051223.910751:0:6577:0:(mgc_request.c:1799:mgc_process_log()) Process log params-ffff99da44f8d000 from 31 10000000:01000000:3.0:1777051223.910756:0:6577:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1777051223.910788:0:6577:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.146@tcp lock: ffff99d943ebbe00/0x85f51a6b96714558 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051223.910802:0:6577:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.146@tcp lock: ffff99d943ebbe00/0x85f51a6b96714558 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051223.910817:0:6577:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.146@tcp lock: ffff99d943ebbe00/0x85f51a6b96714558 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051223.910837:0:6577:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95aecc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452486656:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1777051223.910890:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051223.910941:0:6577:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d957e91240 going to sleep for 11 seconds 00000100:00100000:0.0:1777051223.910982:0:99929:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452486656 00000100:00100000:0.0:1777051223.910993:0:99929:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452486656 00000100:00100000:0.0:1777051223.911062:0:99929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1777051223.911078:0:99929:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7d9dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9351a01-5b0e-4470-97fd-58b9b4b312a2+21:6577:x1863365452486656:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1777051223.911093:0:99929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051223.911110:0:99929:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99da7d507400/0x85f51a6b9671455f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x85f51a6b96714558 expref: -99 pid: 99929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051223.911139:0:99929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99da7d507400/0x85f51a6b9671455f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x85f51a6b96714558 expref: 22 pid: 99929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051223.911156:0:99929:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99da7d507400/0x85f51a6b9671455f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b96714558 expref: 22 pid: 99929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051223.911171:0:99929:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99da7d507400, rc 0) 00000100:00100000:0.0:1777051223.912132:0:99929:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7d9dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9351a01-5b0e-4470-97fd-58b9b4b312a2+22:6577:x1863365452486656:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1055us (1240us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051223.912146:0:99929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1777051223.912393:0:6577:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95aecc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452486656:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1777051223.912417:0:6577:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.146@tcp lock: ffff99d943ebbe00/0x85f51a6b96714558 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b9671455f expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051223.912435:0:6577:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.146@tcp lock: ffff99d943ebbe00/0x85f51a6b96714558 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x85f51a6b9671455f expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051223.912517:0:6577:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d942a0c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452486784:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1777051223.912567:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051223.912697:0:6577:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d95ba00900 going to sleep for 11 seconds 00000100:00100000:0.0:1777051223.912766:0:99930:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452486784 00000100:00100000:0.0:1777051223.912775:0:99930:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452486784 00000100:00100000:0.0:1777051223.912837:0:99930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1777051223.912864:0:99930:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7d9de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9351a01-5b0e-4470-97fd-58b9b4b312a2+22:6577:x1863365452486784:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1777051223.913018:0:99930:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7d9de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9351a01-5b0e-4470-97fd-58b9b4b312a2+22:6577:x1863365452486784:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 159us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051223.913032:0:99930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1777051223.913429:0:6577:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d942a0c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452486784:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1777051223.913515:0:6577:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d942a0c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452486912:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1777051223.913585:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051223.913936:0:6577:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d95ba00900 going to sleep for 11 seconds 00000100:00100000:0.0:1777051223.913943:0:99928:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452486912 00000100:00100000:0.0:1777051223.913954:0:99928:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452486912 00000100:00100000:0.0:1777051223.914061:0:99928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1777051223.914079:0:99928:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7d9dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9351a01-5b0e-4470-97fd-58b9b4b312a2+22:6577:x1863365452486912:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1777051223.914267:0:99928:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7d9dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9351a01-5b0e-4470-97fd-58b9b4b312a2+22:6577:x1863365452486912:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 161us (649us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051223.914285:0:99928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1777051223.914568:0:6577:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d942a0c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452486912:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1777051223.915783:0:100951:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d944e11180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f9351a01-5b0e-4470-97fd-58b9b4b312a2:100951:1863365452487040:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1777051223.915869:0:100951:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051223.915939:0:100951:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da50cb1d80 going to sleep for 11 seconds 00000100:00100000:1.0:1777051223.915976:0:99935:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452487040 00000100:00100000:1.0:1777051223.915987:0:99935:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452487040 00000100:00100000:1.0:1777051223.916080:0:99935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1777051223.916095:0:99935:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7d9dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f9351a01-5b0e-4470-97fd-58b9b4b312a2+22:100951:x1863365452487040:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1777051223.916295:0:99935:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7d9dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f9351a01-5b0e-4470-97fd-58b9b4b312a2+22:100951:x1863365452487040:12345-0@lo:502:llog_process_th.0 Request processed in 201us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051223.916311:0:99935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1777051223.916614:0:100951:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d944e11180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f9351a01-5b0e-4470-97fd-58b9b4b312a2:100951:1863365452487040:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1777051223.916687:0:100951:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1777051223.916702:0:100951:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1777051223.916706:0:100951:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre mdt.lustre-MDT0000.hsm.default_archive_id 00000020:01000000:0.0:1777051223.916719:0:100951:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff99da44f8d000 00000020:00000080:0.0:1777051223.916740:0:100951:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1777051223.916833:0:100951:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1777051223.916842:0:100951:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1777051223.916845:0:100951:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre mdt.lustre-MDT0000.hsm.default_archive_id 00000020:01000000:0.0:1777051223.916851:0:100951:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1777051223.916858:0:100951:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1777051223.916862:0:100951:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre mdt.lustre-MDT0001.hsm.default_archive_id 00000020:01000000:0.0:1777051223.916871:0:100951:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff99da44f8d000 00000020:00000080:0.0:1777051223.916878:0:100951:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1777051223.916976:0:100951:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d944e11180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f9351a01-5b0e-4470-97fd-58b9b4b312a2:100951:1863365452487168:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1777051223.917061:0:100951:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051223.917112:0:99928:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452487168 00000100:00100000:0.0:1777051223.917120:0:99928:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452487168 00000100:00100000:0.0:1777051223.917645:0:99928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1777051223.917665:0:99928:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7d9dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9351a01-5b0e-4470-97fd-58b9b4b312a2+22:100951:x1863365452487168:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1777051223.918082:0:99928:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7d9dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9351a01-5b0e-4470-97fd-58b9b4b312a2+22:100951:x1863365452487168:12345-0@lo:502:llog_process_th.0 Request processed in 423us (1021us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051223.918096:0:99928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1777051223.918291:0:100951:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d95c67b9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1777051223.918324:0:100951:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d944e11180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f9351a01-5b0e-4470-97fd-58b9b4b312a2:100951:1863365452487168:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1777051223.918362:0:100951:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1777051223.918597:0:100951:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1777051223.918600:0:100951:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre mdt.lustre-MDT0001.hsm.default_archive_id 00000040:00080000:0.0:1777051223.918607:0:100951:0:(llog.c:858:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 37 count 37 00000100:00100000:1.0:1777051223.919520:0:99930:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452487296 00000100:00100000:1.0:1777051223.919530:0:99930:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452487296 00000100:00100000:1.0:1777051223.919590:0:99930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1777051223.919606:0:99930:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942edfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9351a01-5b0e-4470-97fd-58b9b4b312a2+22:6577:x1863365452487296:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1777051223.919621:0:99930:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777051223.919642:0:99930:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d955a8ec00/0x85f51a6b9671456d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x85f51a6b96714566 expref: -99 pid: 99930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051223.919696:0:99930:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d955a8ec00/0x85f51a6b9671456d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x85f51a6b96714566 expref: 23 pid: 99930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051223.919714:0:99930:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d955a8ec00/0x85f51a6b9671456d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b96714566 expref: 23 pid: 99930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051223.919729:0:99930:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d955a8ec00, rc 0) 00000100:00100000:1.0:1777051223.919806:0:99930:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942edfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9351a01-5b0e-4470-97fd-58b9b4b312a2+23:6577:x1863365452487296:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 202us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051223.919818:0:99930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1777051223.919946:0:6577:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7fd67800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452487296:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1777051223.919969:0:6577:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.146@tcp lock: ffff99d95595be00/0x85f51a6b96714566 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b9671456d expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051223.919984:0:6577:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.146@tcp lock: ffff99d95595be00/0x85f51a6b96714566 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x85f51a6b9671456d expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051223.920072:0:6577:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d942a0c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452487424:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1777051223.920131:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051223.920546:0:6577:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d95ba00780 going to sleep for 11 seconds 00000100:00100000:3.0:1777051223.920620:0:99929:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452487424 00000100:00100000:3.0:1777051223.920633:0:99929:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452487424 00000100:00100000:3.0:1777051223.920781:0:99929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1777051223.920807:0:99929:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942edd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9351a01-5b0e-4470-97fd-58b9b4b312a2+23:6577:x1863365452487424:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1777051223.920982:0:99929:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942edd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9351a01-5b0e-4470-97fd-58b9b4b312a2+23:6577:x1863365452487424:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 185us (849us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051223.920997:0:99929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1777051223.921065:0:6577:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d942a0c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452487424:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1777051223.921159:0:6577:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d942a0c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452487552:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1777051223.921316:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051223.921375:0:6577:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d95ba00780 going to sleep for 11 seconds 00000100:00100000:3.0:1777051223.921400:0:99930:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452487552 00000100:00100000:3.0:1777051223.921411:0:99930:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452487552 00000100:00100000:3.0:1777051223.921479:0:99930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1777051223.921492:0:99930:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942eddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9351a01-5b0e-4470-97fd-58b9b4b312a2+23:6577:x1863365452487552:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1777051223.921950:0:99930:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942eddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9351a01-5b0e-4470-97fd-58b9b4b312a2+23:6577:x1863365452487552:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 458us (632us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051223.921967:0:99930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1777051223.922019:0:6577:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d942a0c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452487552:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1777051223.923567:0:100954:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d942a0c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f9351a01-5b0e-4470-97fd-58b9b4b312a2:100954:1863365452487680:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1777051223.923659:0:100954:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051223.923744:0:99928:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452487680 00000100:00100000:1.0:1777051223.923783:0:99928:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452487680 00000100:00100000:1.0:1777051223.923841:0:99928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1777051223.923859:0:99928:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942edf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9351a01-5b0e-4470-97fd-58b9b4b312a2+23:100954:x1863365452487680:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1777051223.924024:0:99928:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942edf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9351a01-5b0e-4470-97fd-58b9b4b312a2+23:100954:x1863365452487680:12345-0@lo:502:llog_process_th.0 Request processed in 144us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051223.924046:0:99928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1777051223.924124:0:100954:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d95ba00cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1777051223.924151:0:100954:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d942a0c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f9351a01-5b0e-4470-97fd-58b9b4b312a2:100954:1863365452487680:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1777051223.924386:0:100954:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1777051223.924401:0:100954:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1777051223.924405:0:100954:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre mdt.lustre-MDT0000.hsm.default_archive_id 00000020:01000000:1.0:1777051223.924421:0:100954:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff99da57ae9000 00000020:00000080:1.0:1777051223.924427:0:100954:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1777051223.924514:0:100954:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1777051223.924975:0:100954:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1777051223.924980:0:100954:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre mdt.lustre-MDT0000.hsm.default_archive_id 00000020:01000000:1.0:1777051223.924991:0:100954:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1777051223.924999:0:100954:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1777051223.925003:0:100954:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre mdt.lustre-MDT0001.hsm.default_archive_id 00000020:01000000:1.0:1777051223.925013:0:100954:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff99da57ae9000 00000020:00000080:1.0:1777051223.925020:0:100954:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1777051223.925876:0:100954:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d942a0c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f9351a01-5b0e-4470-97fd-58b9b4b312a2:100954:1863365452487808:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1777051223.925951:0:100954:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051223.925991:0:99935:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452487808 00000100:00100000:1.0:1777051223.925999:0:99935:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452487808 00000100:00100000:1.0:1777051223.926061:0:99935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1777051223.926078:0:99935:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942ede050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f9351a01-5b0e-4470-97fd-58b9b4b312a2+23:100954:x1863365452487808:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1777051223.926632:0:99935:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942ede050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f9351a01-5b0e-4470-97fd-58b9b4b312a2+23:100954:x1863365452487808:12345-0@lo:502:llog_process_th.0 Request processed in 557us (679us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051223.926646:0:99935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1777051223.927437:0:100954:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d95ba00cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1777051223.927467:0:100954:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d942a0c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f9351a01-5b0e-4470-97fd-58b9b4b312a2:100954:1863365452487808:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1777051223.927504:0:100954:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1777051223.927513:0:100954:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1777051223.927516:0:100954:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre mdt.lustre-MDT0001.hsm.default_archive_id 00000040:00080000:1.0:1777051223.927524:0:100954:0:(llog.c:858:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 37 count 37 00000020:01000000:3.0:1777051223.927637:0:6577:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 31-36 (rc=0) 10000000:01000000:3.0:1777051223.927684:0:6577:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.201.146@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1777051223.927698:0:6577:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff99d95595be00/0x85f51a6b96714566 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b9671456d expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051223.927719:0:6577:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.146@tcp lock: ffff99d95595be00/0x85f51a6b96714566 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b9671456d expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051223.971998:0:99929:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425840768 00000100:00100000:3.0:1777051223.972020:0:99929:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425840768 00000100:00100000:3.0:1777051223.972127:0:99929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 110 00000100:00100000:3.0:1777051223.972147:0:99929:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942edc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29c4352d-3260-4734-909d-9ea5de9e7fa4+10:6255:x1863365425840768:12345-192.168.201.46@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1777051223.972175:0:99929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777051223.972281:0:99929:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d943ebbc00/0x85f51a6b96714574 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b5e70 expref: -99 pid: 99929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051223.976879:0:99930:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425840896 00000100:00100000:3.0:1777051223.976895:0:99930:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425840896 00000100:00100000:0.0:1777051223.983977:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051223.991113:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051223.996761:0:99929:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425841280 00000100:00100000:0.0:1777051223.996772:0:99929:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425841280 00000100:00100000:0.0:1777051223.996844:0:99929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 114 00000100:00100000:0.0:1777051223.996859:0:99929:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942edf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29c4352d-3260-4734-909d-9ea5de9e7fa4+11:129838:x1863365425841280:12345-192.168.201.46@tcp:502:llog_process_th.0 00000100:00100000:0.0:1777051223.997357:0:99929:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942edf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29c4352d-3260-4734-909d-9ea5de9e7fa4+11:129838:x1863365425841280:12345-192.168.201.46@tcp:502:llog_process_th.0 Request processed in 495us (681us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051223.997377:0:99929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 114 00000100:00100000:0.0:1777051224.001405:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051224.001492:0:99930:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425841408 00000100:00100000:3.0:1777051224.001505:0:99930:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425841408 00000100:00100000:3.0:1777051224.005778:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051224.013692:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051224.014491:0:99935:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425841664 00000100:00100000:3.0:1777051224.014504:0:99935:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425841664 00000100:00100000:3.0:1777051224.014591:0:99935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 117 00000100:00100000:3.0:1777051224.014610:0:99935:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942edf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:29c4352d-3260-4734-909d-9ea5de9e7fa4+12:6255:x1863365425841664:12345-192.168.201.46@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1777051224.015488:0:99935:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942edf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:29c4352d-3260-4734-909d-9ea5de9e7fa4+12:6255:x1863365425841664:12345-192.168.201.46@tcp:503:ll_cfg_requeue.0 Request processed in 881us (1802us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051224.015509:0:99935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 117 00000100:00100000:0.0:1777051224.023792:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051224.023913:0:99929:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425841792 00000100:00100000:1.0:1777051224.023925:0:99929:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425841792 00000100:00100000:1.0:1777051224.024007:0:99929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 118 00000100:00100000:1.0:1777051224.024024:0:99929:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94343fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29c4352d-3260-4734-909d-9ea5de9e7fa4+12:129841:x1863365425841792:12345-192.168.201.46@tcp:502:llog_process_th.0 00000100:00100000:1.0:1777051224.024281:0:99929:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94343fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29c4352d-3260-4734-909d-9ea5de9e7fa4+12:129841:x1863365425841792:12345-192.168.201.46@tcp:502:llog_process_th.0 Request processed in 257us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051224.024298:0:99929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 118 00000100:00100000:0.0:1777051224.031701:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051224.032519:0:99930:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425841920 00000100:00100000:3.0:1777051224.032534:0:99930:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425841920 00000100:00100000:3.0:1777051224.032613:0:99930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 119 00000100:00100000:3.0:1777051224.032632:0:99930:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94343cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29c4352d-3260-4734-909d-9ea5de9e7fa4+12:129841:x1863365425841920:12345-192.168.201.46@tcp:502:llog_process_th.0 00000100:00100000:3.0:1777051224.032833:0:99930:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94343cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29c4352d-3260-4734-909d-9ea5de9e7fa4+12:129841:x1863365425841920:12345-192.168.201.46@tcp:502:llog_process_th.0 Request processed in 203us (1137us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051224.032849:0:99930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 119 00010000:00010000:0.0:1777051224.150527:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1777051224.342538:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95aecf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452487936:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1777051224.342627:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051224.342726:0:47388:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452487936 00000100:00100000:3.0:1777051224.342739:0:47388:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452487936 00000100:00080000:0.0:1777051224.342804:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1777051224.342846:0:47388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5507 00000100:00100000:3.0:1777051224.342863:0:47388:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d944e11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3679:x1863365452487936:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1777051224.342900:0:47388:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 440355008 pending 0 free 3862671360 avail 3631149056 00000100:00100000:3.0:1777051224.342979:0:47388:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d944e11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3679:x1863365452487936:12345-0@lo:13:osp-pre-0-1.0 Request processed in 121us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051224.342991:0:47388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5507 00000100:00100000:0.0:1777051224.343100:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95aecf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452487936:0@lo:13:osp-pre-0-1.0 00000020:01000004:1.0:1777051224.507668:0:100993:0:(tgt_mount.c:2015:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:1.0:1777051224.507743:0:100993:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.146@tcp lock: ffff99d953298e00/0x85f51a6b967141a7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b967141ae expref: -99 pid: 99922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051224.507762:0:100993:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff99d953298e00/0x85f51a6b967141a7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x85f51a6b967141ae expref: -99 pid: 99922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051224.507774:0:100993:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff99d953298e00/0x85f51a6b967141a7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x85f51a6b967141ae expref: -99 pid: 99922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051224.507785:0:100993:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.146@tcp lock: ffff99d953298e00/0x85f51a6b967141a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x85f51a6b967141ae expref: -99 pid: 99922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051224.507832:0:100993:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1777051224.507840:0:100993:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1777051224.507888:0:100993:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1777051224.507895:0:100993:0:(client.c:3101:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1777051224.507904:0:100993:0:(pinger.c:396:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00010000:00010000:0.0:1777051224.507914:0:38719:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1777051224.507929:0:38719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.146@tcp lock: ffff99d953298e00/0x85f51a6b967141a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x85f51a6b967141ae expref: -99 pid: 99922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1777051224.507941:0:100993:0:(import.c:65:import_set_state_nolock()) ffff99da48b2e800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:0.0:1777051224.507945:0:38719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d953298e00 already unused, calling callback (ffffffffc1208c20) 10000000:00010000:0.0:1777051224.507955:0:38719:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.146@tcp lock: ffff99d953298e00/0x85f51a6b967141a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x85f51a6b967141ae expref: -99 pid: 99922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051224.507973:0:38719:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.146@tcp lock: ffff99d953298e00/0x85f51a6b967141a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x85f51a6b967141ae expref: -99 pid: 99922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1777051224.507988:0:38719:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.146@tcp lock: ffff99d953298e00/0x85f51a6b967141a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x85f51a6b967141ae expref: -99 pid: 99922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1777051224.508000:0:38719:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1777051224.508005:0:38719:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1777051224.508011:0:38719:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00000100:00100000:1.0:1777051224.508022:0:3676:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d942a0c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3676:1863365452488064:0@lo:39:umount.0 00010000:00010000:0.0:1777051224.508408:0:38719:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.146@tcp lock: ffff99d953298e00/0x85f51a6b967141a7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x85f51a6b967141ae expref: -99 pid: 99922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051224.508421:0:38719:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1777051224.508472:0:3676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1777051224.508487:0:38719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.146@tcp lock: ffff99d953298e00/0x85f51a6b967141a7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x85f51a6b967141ae expref: -99 pid: 99922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051224.508503:0:38719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.146@tcp lock: ffff99d953298e00/0x85f51a6b967141a7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x85f51a6b967141ae expref: -99 pid: 99922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051224.508534:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777051224.508540:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777051224.508547:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1777051224.508572:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d9533bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3680:1863365452488192:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1777051224.508636:0:6579:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452488064 00000100:00100000:1.0:1777051224.508648:0:6579:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452488064 00000100:00100000:0.0:1777051224.508655:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051224.508998:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111626 00000100:00100000:1.0:1777051224.509020:0:6579:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942a0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3676:x1863365452488064:12345-0@lo:39:umount.0 00000020:00000080:1.0:1777051224.509089:0:6579:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x85f51a6b967142d4 00000100:00080000:1.0:1777051224.509114:0:6579:0:(import.c:65:import_set_state_nolock()) ffff99da5f3d2000 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1777051224.509118:0:47827:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452488192 00000100:00100000:0.0:1777051224.509129:0:47827:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452488192 00000100:00100000:1.0:1777051224.509287:0:6579:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942a0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+1:3676:x1863365452488064:12345-0@lo:39:umount.0 Request processed in 274us (816us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051224.509295:0:47827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13658 00000100:00100000:1.0:1777051224.509314:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111626 00000100:00100000:0.0:1777051224.509319:0:47827:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da6fd47050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:f9351a01-5b0e-4470-97fd-58b9b4b312a2+23:3680:x1863365452488192:12345-0@lo:103:ldlm_bl.0 00000020:00000080:1.0:1777051224.509334:0:6579:0:(genops.c:906:class_export_put()) final put ffff99da48b2e000/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:0.0:1777051224.509349:0:47827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000020:00000080:3.0:1777051224.509378:0:46211:0:(genops.c:865:class_export_destroy()) destroying export ffff99da48b2e000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00010000:00010000:0.0:1777051224.509386:0:47827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99da7d784a00/0x85f51a6b967141ae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x85f51a6b967141a7 expref: 23 pid: 99928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051224.509414:0:47827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000020:00000080:3.0:1777051224.509462:0:46211:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99da5f3d2000 for lustre-MDT0000 00000100:00100000:0.0:1777051224.509489:0:47827:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da6fd47050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:f9351a01-5b0e-4470-97fd-58b9b4b312a2+22:3680:x1863365452488192:12345-0@lo:103:ldlm_bl.0 Request processed in 176us (837us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051224.509503:0:47827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13658 00000100:00080000:1.0:1777051224.509581:0:3676:0:(import.c:65:import_set_state_nolock()) ffff99da48b2e800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00010000:00010000:0.0:1777051224.509590:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1777051224.509604:0:3676:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d942a0c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3676:1863365452488064:0@lo:39:umount.0 00000100:00100000:0.0:1777051224.509644:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d9533bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3680:1863365452488192:0@lo:103:ldlm_bl.0 00000100:00080000:1.0:1777051224.509647:0:100993:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1777051224.509654:0:100993:0:(client.c:3101:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1777051224.509661:0:100993:0:(import.c:321:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1777051224.511525:0:100993:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.146@tcp lock: ffff99d953299a00/0x85f51a6b967140c0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b967140c7 expref: -99 pid: 99922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051224.511583:0:100993:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff99d953299a00/0x85f51a6b967140c0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x85f51a6b967140c7 expref: -99 pid: 99922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051224.511602:0:100993:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff99d953299a00/0x85f51a6b967140c0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x85f51a6b967140c7 expref: -99 pid: 99922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051224.511612:0:100993:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.146@tcp lock: ffff99d953299a00/0x85f51a6b967140c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x85f51a6b967140c7 expref: -99 pid: 99922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051224.511634:0:100993:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1777051224.511645:0:13753:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777051224.511664:0:13753:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.146@tcp lock: ffff99d953299a00/0x85f51a6b967140c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x85f51a6b967140c7 expref: -99 pid: 99922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051224.511672:0:13753:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d953299a00 already unused, calling callback (ffffffffc1208c20) 10000000:00010000:1.0:1777051224.511676:0:13753:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.146@tcp lock: ffff99d953299a00/0x85f51a6b967140c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x85f51a6b967140c7 expref: -99 pid: 99922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051224.511683:0:13753:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.146@tcp lock: ffff99d953299a00/0x85f51a6b967140c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x85f51a6b967140c7 expref: -99 pid: 99922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1777051224.511690:0:13753:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.146@tcp lock: ffff99d953299a00/0x85f51a6b967140c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x85f51a6b967140c7 expref: -99 pid: 99922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1777051224.511696:0:13753:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1777051224.511699:0:13753:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:1.0:1777051224.511998:0:13753:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.146@tcp lock: ffff99d953299a00/0x85f51a6b967140c0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x85f51a6b967140c7 expref: -99 pid: 99922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051224.512018:0:13753:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1777051224.512052:0:13753:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.146@tcp lock: ffff99d953299a00/0x85f51a6b967140c0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x85f51a6b967140c7 expref: -99 pid: 99922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051224.512065:0:13753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.146@tcp lock: ffff99d953299a00/0x85f51a6b967140c0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x85f51a6b967140c7 expref: -99 pid: 99922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051224.512081:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051224.512085:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051224.512088:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1777051224.512411:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d942a0c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3677:1863365452488320:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1777051224.512471:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1777051224.512534:0:100993:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.146@tcp lock: ffff99d953298400/0x85f51a6b967141fb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b96714202 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051224.512549:0:100993:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff99d953298400/0x85f51a6b967141fb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x85f51a6b96714202 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051224.512562:0:100993:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff99d953298400/0x85f51a6b967141fb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x85f51a6b96714202 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051224.512573:0:100993:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.146@tcp lock: ffff99d953298400/0x85f51a6b967141fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x85f51a6b96714202 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051224.512597:0:100993:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1777051224.512607:0:100993:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.146@tcp lock: ffff99d955a8f000/0x85f51a6b9671453c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b96714543 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051224.512619:0:100993:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff99d955a8f000/0x85f51a6b9671453c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x85f51a6b96714543 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051224.512630:0:100993:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff99d955a8f000/0x85f51a6b9671453c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x85f51a6b96714543 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051224.512641:0:100993:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.146@tcp lock: ffff99d955a8f000/0x85f51a6b9671453c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x85f51a6b96714543 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051224.512662:0:100993:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1777051224.512670:0:100993:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.146@tcp lock: ffff99da7d785c00/0x85f51a6b967140ab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b967140b9 expref: -99 pid: 99922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051224.512682:0:100993:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff99da7d785c00/0x85f51a6b967140ab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x85f51a6b967140b9 expref: -99 pid: 99922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051224.512692:0:100993:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff99da7d785c00/0x85f51a6b967140ab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x85f51a6b967140b9 expref: -99 pid: 99922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051224.512702:0:100993:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.146@tcp lock: ffff99da7d785c00/0x85f51a6b967140ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x85f51a6b967140b9 expref: -99 pid: 99922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051224.512722:0:100993:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 10000000:01000000:1.0:1777051224.512728:0:100993:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:1.0:1777051224.512734:0:100993:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:1.0:1777051224.512773:0:100993:0:(tgt_mount.c:2065:server_put_super()) stopping lustre-MDT0000 00000020:01000000:1.0:1777051224.512780:0:100993:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='FA') 00000020:00000080:1.0:1777051224.512787:0:100993:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:02000400:1.0:1777051224.512795:0:100993:0:(obd_config.c:932:class_cleanup()) Failing over lustre-MDT0000 00000100:00100000:3.0:1777051224.513939:0:6566:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452488320 00000100:00100000:3.0:1777051224.513950:0:6566:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452488320 00000100:00100000:3.0:1777051224.514021:0:6566:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13659 00000100:00100000:3.0:1777051224.514036:0:6566:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942a0f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f9351a01-5b0e-4470-97fd-58b9b4b312a2+22:3677:x1863365452488320:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1777051224.514054:0:6566:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777051224.514075:0:6566:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99da7d784400/0x85f51a6b967140c7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x85f51a6b967140c0 expref: 22 pid: 99930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051224.514108:0:6566:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1777051224.514501:0:6566:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942a0f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f9351a01-5b0e-4470-97fd-58b9b4b312a2+21:3677:x1863365452488320:12345-0@lo:103:ldlm_bl.0 Request processed in 467us (2030us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051224.514516:0:6566:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13659 00000100:00100000:3.0:1777051224.514581:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d942a0c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3677:1863365452488320:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1777051224.514715:0:6568:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1777051224.514727:0:6568:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.146@tcp lock: ffff99d953298400/0x85f51a6b967141fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x85f51a6b96714202 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051224.514742:0:6568:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d953298400 already unused, calling callback (ffffffffc1208c20) 10000000:00010000:0.0:1777051224.514748:0:6568:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.146@tcp lock: ffff99d953298400/0x85f51a6b967141fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x85f51a6b96714202 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051224.514762:0:6568:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.146@tcp lock: ffff99d953298400/0x85f51a6b967141fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x85f51a6b96714202 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1777051224.514775:0:6568:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.146@tcp lock: ffff99d953298400/0x85f51a6b967141fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x85f51a6b96714202 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1777051224.514794:0:6568:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1777051224.514799:0:6568:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:0.0:1777051224.514802:0:6568:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1777051224.514829:0:6568:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.146@tcp lock: ffff99d953298400/0x85f51a6b967141fb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x85f51a6b96714202 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051224.514842:0:6568:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1777051224.514879:0:6568:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.146@tcp lock: ffff99d953298400/0x85f51a6b967141fb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x85f51a6b96714202 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051224.514892:0:6568:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.146@tcp lock: ffff99d953298400/0x85f51a6b967141fb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x85f51a6b96714202 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051224.514901:0:3677:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:0.0:1777051224.514914:0:6568:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1777051224.514924:0:6568:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.146@tcp lock: ffff99d955a8f000/0x85f51a6b9671453c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x85f51a6b96714543 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051224.514924:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d9533bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3677:1863365452488448:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1777051224.514946:0:6568:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d955a8f000 already unused, calling callback (ffffffffc1208c20) 10000000:00010000:0.0:1777051224.514952:0:6568:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.146@tcp lock: ffff99d955a8f000/0x85f51a6b9671453c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x85f51a6b96714543 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051224.514965:0:6568:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.146@tcp lock: ffff99d955a8f000/0x85f51a6b9671453c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x85f51a6b96714543 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1777051224.514977:0:6568:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.146@tcp lock: ffff99d955a8f000/0x85f51a6b9671453c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x85f51a6b96714543 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1777051224.514987:0:6568:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1777051224.514992:0:6568:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1777051224.514997:0:6568:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1777051224.515053:0:6568:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.146@tcp lock: ffff99d955a8f000/0x85f51a6b9671453c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x85f51a6b96714543 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051224.515065:0:6568:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1777051224.515401:0:6568:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.146@tcp lock: ffff99d955a8f000/0x85f51a6b9671453c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x85f51a6b96714543 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051224.515418:0:6568:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.146@tcp lock: ffff99d955a8f000/0x85f51a6b9671453c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x85f51a6b96714543 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051224.515427:0:47597:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452488448 00000100:00100000:3.0:1777051224.515437:0:47597:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452488448 00010000:00010000:0.0:1777051224.515440:0:6568:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1777051224.515448:0:6568:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.146@tcp lock: ffff99da7d785c00/0x85f51a6b967140ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x85f51a6b967140b9 expref: -99 pid: 99922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051224.515463:0:6568:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da7d785c00 already unused, calling callback (ffffffffc1208c20) 10000000:00010000:0.0:1777051224.515473:0:6568:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.146@tcp lock: ffff99da7d785c00/0x85f51a6b967140ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x85f51a6b967140b9 expref: -99 pid: 99922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051224.515487:0:47597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13660 00010000:00010000:0.0:1777051224.515488:0:6568:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.146@tcp lock: ffff99da7d785c00/0x85f51a6b967140ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x85f51a6b967140b9 expref: -99 pid: 99922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051224.515501:0:47597:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fd65880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f9351a01-5b0e-4470-97fd-58b9b4b312a2+21:3677:x1863365452488448:12345-0@lo:103:ldlm_bl.0 10000000:00010000:0.0:1777051224.515507:0:6568:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.146@tcp lock: ffff99da7d785c00/0x85f51a6b967140ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x85f51a6b967140b9 expref: -99 pid: 99922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051224.515516:0:47597:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 10000000:01000000:0.0:1777051224.515528:0:6568:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1777051224.515537:0:6568:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 00010000:00010000:3.0:1777051224.515537:0:47597:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d9442ea400/0x85f51a6b96714202 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x85f51a6b967141fb expref: 21 pid: 99935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1777051224.515544:0:6568:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1777051224.515568:0:47597:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1777051224.515580:0:6568:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.146@tcp lock: ffff99da7d785c00/0x85f51a6b967140ab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x85f51a6b967140b9 expref: -99 pid: 99922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051224.515593:0:6568:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1777051224.515624:0:6568:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.146@tcp lock: ffff99da7d785c00/0x85f51a6b967140ab lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x85f51a6b967140b9 expref: -99 pid: 99922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051224.515643:0:47597:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fd65880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f9351a01-5b0e-4470-97fd-58b9b4b312a2+21:3677:x1863365452488448:12345-0@lo:103:ldlm_bl.0 Request processed in 142us (561us total) trans 0 rc 0/0 00010000:00010000:0.0:1777051224.515645:0:6568:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.146@tcp lock: ffff99da7d785c00/0x85f51a6b967140ab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x85f51a6b967140b9 expref: -99 pid: 99922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051224.515671:0:47597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13660 00010000:00010000:0.0:1777051224.515987:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777051224.515994:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777051224.516002:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777051224.516019:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1777051224.516043:0:3679:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1777051224.516060:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d9533bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3677:1863365452488448:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1777051224.516066:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d944e13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3679:1863365452488704:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1777051224.516454:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1777051224.516486:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1777051224.516520:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d944e10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3679:1863365452488576:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1777051224.516530:0:9550:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452488704 00000100:00100000:3.0:1777051224.516539:0:9550:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452488704 00000100:00100000:3.0:1777051224.516605:0:9550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13662 00000100:00100000:3.0:1777051224.516619:0:9550:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f42d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f9351a01-5b0e-4470-97fd-58b9b4b312a2+19:3679:x1863365452488704:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1777051224.516641:0:9550:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777051224.516663:0:9550:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d953299000/0x85f51a6b967140b9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x85f51a6b967140ab expref: 19 pid: 99928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051224.516680:0:9550:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1777051224.517266:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d944e13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3679:1863365452488704:0@lo:103:ldlm_bl.0 00000004:00000080:1.0:1777051224.520398:0:100993:0:(mdt_handler.c:8165:mdt_iocontrol()) lustre-MDT0000: cmd=40086672 len=0 karg=0000000000000000 uarg=0000000000000000 00000020:00000080:1.0:1777051224.524521:0:100993:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 6/13 00000020:00080000:1.0:1777051224.524531:0:100993:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff99d94bba4000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1777051224.524540:0:100993:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff99da48b2c800 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1777051224.524547:0:100993:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff99d94bba3000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1777051224.524558:0:100993:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff99da71c68000 c11b6966-0775-44d2-bdc6-c74c26eb2226 192.168.201.46@tcp 13 (0 0 8) 0 0 0 0: 0000000000000000 12884904250 stale:0 00000020:00080000:1.0:1777051224.524567:0:100993:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff99da71c6b800 2dd4696c-edce-4cd1-86d2-dbd2ff957fa1 192.168.201.46@tcp 16 (0 0 11) 0 0 0 0: 0000000000000000 12884904249 stale:0 00000020:00080000:1.0:1777051224.524574:0:100993:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff99da71c6d800 lustre-MDT0001-mdtlov_UUID 0@lo 6 (0 0 1) 0 0 0 0: 0000000000000000 12884902301 stale:0 00000020:00080000:1.0:1777051224.524583:0:100993:0:(genops.c:1574:class_disconnect_exports()) OBD device 5 (ffff99d941ce0000) has exports, disconnecting them 00000020:00080000:1.0:1777051224.524589:0:100993:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff99d94bba4000), last request at 1777051219 00000020:00000080:1.0:1777051224.524598:0:100993:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x85f51a6b967142cd 00000100:00080000:1.0:1777051224.524610:0:100993:0:(import.c:65:import_set_state_nolock()) ffff99d94bba5800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1777051224.524652:0:100993:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff99d94bba4000): rc 0 00000020:00000080:1.0:1777051224.524656:0:100993:0:(genops.c:906:class_export_put()) final put ffff99d94bba4000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:1.0:1777051224.524673:0:100993:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff99da48b2c800), last request at 1777051204 00000020:00000080:1.0:1777051224.524677:0:100993:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x85f51a6b967142c6 00000100:00080000:1.0:1777051224.524681:0:100993:0:(import.c:65:import_set_state_nolock()) ffff99da48b2f800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1777051224.524697:0:100993:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff99da48b2c800): rc 0 00000020:00000080:1.0:1777051224.524700:0:100993:0:(genops.c:906:class_export_put()) final put ffff99da48b2c800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:1.0:1777051224.524707:0:100993:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff99d94bba3000), last request at 1777051219 00000020:00000080:1.0:1777051224.524713:0:100993:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x85f51a6b967142bf 00000100:00080000:1.0:1777051224.524730:0:100993:0:(import.c:65:import_set_state_nolock()) ffff99d94bba3800 : changing import state from FULL to CLOSED 00000020:00000080:3.0:1777051224.524774:0:48457:0:(genops.c:865:class_export_destroy()) destroying export ffff99d94bba4000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00010000:00010000:0.0:1777051224.524777:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777051224.524790:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1777051224.524802:0:100993:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff99d94bba3000): rc 0 00000020:00000080:1.0:1777051224.524808:0:100993:0:(genops.c:906:class_export_put()) final put ffff99d94bba3000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:1.0:1777051224.524819:0:100993:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 192.168.201.46@tcp (ffff99da71c68000), last request at 1777051219 00000020:00000080:1.0:1777051224.524826:0:100993:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x85f51a6b9671411b 00000020:00010000:1.0:1777051224.524837:0:100993:0:(genops.c:1942:obd_stale_export_put()) Put export ffff99da71c68000: total 3 00000100:00080000:1.0:1777051224.524843:0:100993:0:(import.c:65:import_set_state_nolock()) ffff99da48b28000 : changing import state from FULL to CLOSED 00000020:00000080:3.0:1777051224.524859:0:48457:0:(genops.c:865:class_export_destroy()) destroying export ffff99da48b2c800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00080000:1.0:1777051224.524876:0:100993:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.201.46@tcp (ffff99da71c68000): rc 0 00000020:00000080:3.0:1777051224.524898:0:48457:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99d94bba5800 for lustre-MDT0000 00000020:00000080:3.0:1777051224.524907:0:48457:0:(genops.c:865:class_export_destroy()) destroying export ffff99d94bba3000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00080000:1.0:1777051224.524915:0:100993:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 192.168.201.46@tcp (ffff99da71c6b800), last request at 1777051219 00000020:00010000:0.0:1777051224.524935:0:38719:0:(genops.c:1928:obd_stale_export_get()) Get export ffff99da71c68000: total 1 00000020:00000080:1.0:1777051224.524939:0:100993:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x85f51a6b96714114 00010000:00010000:0.0:1777051224.524943:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00010000:1.0:1777051224.524959:0:100993:0:(genops.c:1942:obd_stale_export_put()) Put export ffff99da71c6b800: total 1 00000100:00080000:1.0:1777051224.524967:0:100993:0:(import.c:65:import_set_state_nolock()) ffff99da44f1f000 : changing import state from FULL to CLOSED 00000020:00000080:3.0:1777051224.524967:0:48457:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99da48b2f800 for lustre-MDT0000 00000020:00000080:3.0:1777051224.524982:0:48457:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99d94bba3800 for lustre-MDT0000 00010000:00010000:0.0:1777051224.525017:0:38719:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff99da71c68000, canceled 0 locks, left on hash table 8. 00000020:00010000:3.0:1777051224.525033:0:13753:0:(genops.c:1928:obd_stale_export_get()) Get export ffff99da71c6b800: total 0 00000020:00080000:1.0:1777051224.525048:0:100993:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.201.46@tcp (ffff99da71c6b800): rc 0 00000020:00080000:1.0:1777051224.525057:0:100993:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff99da71c6d800), last request at 1777051198 00000020:00000080:1.0:1777051224.525065:0:100993:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x85f51a6b9671410d 00010000:00010000:0.0:1777051224.525071:0:38719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d95d338e00/0x85f51a6b9671433d lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0xb0:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b555c expref: 9 pid: 99961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00010000:1.0:1777051224.525076:0:100993:0:(genops.c:1942:obd_stale_export_put()) Put export ffff99da71c6d800: total 0 00000100:00080000:1.0:1777051224.525084:0:100993:0:(import.c:65:import_set_state_nolock()) ffff99da4622a800 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1777051224.525109:0:13753:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff99da71c6b800, canceled 0 locks, left on hash table 11. 00000020:00080000:1.0:1777051224.525117:0:100993:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff99da71c6d800): rc 0 00010000:00010000:0.0:1777051224.525125:0:38719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d95d339e00/0x85f51a6b96714336 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b0fbe expref: 8 pid: 99961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00000080:1.0:1777051224.525135:0:100993:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffb08941cefae0 00000100:00080000:1.0:1777051224.525161:0:100993:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1777051224.525170:0:100993:0:(client.c:3101:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00010000:00010000:3.0:1777051224.525272:0:13753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f683e00/0x85f51a6b967142e2 lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0x9d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b50a1 expref: 12 pid: 99961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051224.525285:0:38719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d95d338800/0x85f51a6b9671432f lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x96:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b244e expref: 7 pid: 99961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051224.525326:0:13753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f682c00/0x85f51a6b967142db lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0x9f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b50af expref: 11 pid: 99961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051224.525340:0:38719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d95d339a00/0x85f51a6b96714321 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xc2:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b4882 expref: 6 pid: 99961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051224.525372:0:13753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f682800/0x85f51a6b967142fe lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x96:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b41c1 expref: 10 pid: 99961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051224.525387:0:38719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f682000/0x85f51a6b9671431a lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xc4:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b4e9b expref: 5 pid: 99961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051224.525441:0:13753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f683000/0x85f51a6b96714305 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5d12 expref: 9 pid: 99961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051224.525446:0:38719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f683a00/0x85f51a6b96714313 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xc6:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b54f3 expref: 4 pid: 99961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051224.525504:0:13753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d95595b200/0x85f51a6b96714359 lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0xb0:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5707 expref: 8 pid: 99961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051224.525510:0:38719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da40031600/0x85f51a6b96714527 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5e69 expref: 3 pid: 46494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051224.525591:0:38719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d95d339600/0x85f51a6b96714328 lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0x9e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b4ee8 expref: 2 pid: 99961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051224.525601:0:13753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f682a00/0x85f51a6b9671430c lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0xb2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5715 expref: 7 pid: 99961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051224.525654:0:38719:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff99da71c68000, canceled 8 locks, left on hash table 0. 00010000:00010000:3.0:1777051224.525654:0:13753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d95d339800/0x85f51a6b9671434b lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0x51:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b445a expref: 6 pid: 99961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051224.525694:0:13753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f682600/0x85f51a6b967142f0 lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0xb5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5731 expref: 5 pid: 99961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051224.525728:0:13753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f683600/0x85f51a6b967142e9 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x57:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b0bdc expref: 4 pid: 99961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051224.525755:0:13753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f683400/0x85f51a6b967142f7 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x96:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b245c expref: 3 pid: 99961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051224.525775:0:13753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d95d339000/0x85f51a6b96714352 lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0xb1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b570e expref: 2 pid: 99961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051224.525813:0:13753:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff99da71c6b800, canceled 11 locks, left on hash table 0. 00000100:00080000:1.0:1777051224.528507:0:100993:0:(pinger.c:396:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1777051224.528541:0:100993:0:(import.c:65:import_set_state_nolock()) ffff99da7b3ce000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1777051224.528605:0:3676:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d942a0c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3676:1863365452488832:0@lo:39:umount.0 00000100:00100000:1.0:1777051224.528720:0:3676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1777051224.528966:0:100993:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1777051224.528972:0:100993:0:(client.c:3101:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968346 gen 3 00000004:00080000:1.0:1777051224.528990:0:100993:0:(osp_dev.c:1629:osp_import_event()) got inactive 00000100:00080000:1.0:1777051224.530104:0:100993:0:(pinger.c:396:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1777051224.530124:0:100993:0:(import.c:65:import_set_state_nolock()) ffff99da454e2800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1777051224.530143:0:100993:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1777051224.530147:0:100993:0:(client.c:3101:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968349 gen 3 00000004:00080000:1.0:1777051224.530158:0:100993:0:(osp_dev.c:1629:osp_import_event()) got inactive 00000100:00100000:1.0:1777051224.532181:0:3676:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d942a0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3676:1863365452488960:0@lo:9:umount.0 00000100:00100000:1.0:1777051224.532301:0:3676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1777051224.532352:0:100993:0:(pinger.c:396:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1777051224.532373:0:100993:0:(import.c:65:import_set_state_nolock()) ffff99d941c45000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1777051224.532400:0:3676:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d942a0d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3676:1863365452489088:0@lo:9:umount.0 00000100:00100000:1.0:1777051224.532441:0:3676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051224.532494:0:24468:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452488960 00000100:00100000:1.0:1777051224.532504:0:24468:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452488960 00000100:00100000:1.0:1777051224.532567:0:24468:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452489088 00000100:00100000:1.0:1777051224.532572:0:24468:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452489088 00000100:00100000:1.0:1777051224.532605:0:24468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7938 00000100:00100000:1.0:1777051224.532618:0:24468:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942a0c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3676:x1863365452488960:12345-0@lo:9:umount.0 00000020:00000080:1.0:1777051224.532649:0:24468:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x85f51a6b9671416f 00000100:00080000:1.0:1777051224.532658:0:24468:0:(import.c:65:import_set_state_nolock()) ffff99da7dbcf800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1777051224.532707:0:24468:0:(tgt_lastrcvd.c:732:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294968346 00000100:00100000:1.0:1777051224.532975:0:24468:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942a0c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+2:3676:x1863365452488960:12345-0@lo:9:umount.0 Request processed in 357us (672us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051224.532989:0:24468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7938 00000100:00100000:1.0:1777051224.533018:0:24468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7939 00000100:00100000:1.0:1777051224.533031:0:24468:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942a0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3676:x1863365452489088:12345-0@lo:9:umount.0 00000020:00000080:1.0:1777051224.533051:0:24468:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x85f51a6b96714184 00000100:00080000:1.0:1777051224.533061:0:24468:0:(import.c:65:import_set_state_nolock()) ffff99da7fa94000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1777051224.533091:0:24468:0:(tgt_lastrcvd.c:732:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294968349 00000100:00100000:1.0:1777051224.533296:0:24468:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942a0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+2:3676:x1863365452489088:12345-0@lo:9:umount.0 Request processed in 265us (851us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051224.533308:0:24468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7939 00000100:00080000:1.0:1777051224.533361:0:3676:0:(import.c:65:import_set_state_nolock()) ffff99d941c45000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1777051224.533369:0:3676:0:(osp_dev.c:1613:osp_import_event()) got disconnected 00000004:00080000:1.0:1777051224.533371:0:3676:0:(osp_dev.c:1629:osp_import_event()) got inactive 00000100:00100000:1.0:1777051224.533376:0:3676:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d942a0d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3676:1863365452489088:0@lo:9:umount.0 00000100:00080000:1.0:1777051224.533392:0:3676:0:(import.c:65:import_set_state_nolock()) ffff99da454e2800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1777051224.533397:0:3676:0:(osp_dev.c:1613:osp_import_event()) got disconnected 00000004:00080000:1.0:1777051224.533399:0:3676:0:(osp_dev.c:1629:osp_import_event()) got inactive 00000100:00100000:1.0:1777051224.533403:0:3676:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d942a0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3676:1863365452488960:0@lo:9:umount.0 00000020:00080000:1.0:1777051224.533488:0:100993:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff99d941ce0000) has no exports 00000100:00080000:1.0:1777051224.534060:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1777051224.534068:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1777051224.534118:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1777051224.568609:0:46498:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452488832 00000100:00100000:1.0:1777051224.568626:0:46498:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452488832 00000100:00100000:1.0:1777051224.568709:0:46498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7968 00000100:00100000:1.0:1777051224.568725:0:46498:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942a0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3676:x1863365452488832:12345-0@lo:39:umount.0 00000020:00000080:1.0:1777051224.568769:0:46498:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x85f51a6b9671415a 00000100:00080000:1.0:1777051224.568781:0:46498:0:(import.c:65:import_set_state_nolock()) ffff99da58bfa000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1777051224.568812:0:46498:0:(tgt_lastrcvd.c:732:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294970572 00000100:00100000:1.0:1777051224.569050:0:46498:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942a0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+3:3676:x1863365452488832:12345-0@lo:39:umount.0 Request processed in 326us (40328us total) trans 4294970573 rc 0/0 00000100:00100000:1.0:1777051224.569065:0:46498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7968 00000100:00080000:1.0:1777051224.569139:0:3676:0:(import.c:65:import_set_state_nolock()) ffff99da7b3ce000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1777051224.569153:0:3676:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d942a0c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3676:1863365452488832:0@lo:39:umount.0 00010000:00010000:1.0:1777051224.569179:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1777051224.855618:0:3678:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1777051224.855646:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d942a0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452489216:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1777051224.856015:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051224.856097:0:6584:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452489216 00000100:00100000:1.0:1777051224.856107:0:6584:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452489216 00000100:00100000:1.0:1777051224.856157:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7969 00000100:00100000:1.0:1777051224.856167:0:6584:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942a0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3678:x1863365452489216:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:1.0:1777051224.856181:0:6584:0:(tgt_handler.c:795:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1777051224.856302:0:6584:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942a0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3678:x1863365452489216:12345-0@lo:41:osp-pre-0-1.0 Request processed in 132us (287us total) trans 0 rc -107/-107 00000100:00100000:1.0:1777051224.856314:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7969 00000100:02020000:1.0:1777051224.856370:0:3678:0:(client.c:1490:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00080000:1.0:1777051224.868569:0:3678:0:(recover.c:203:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1777051224.868578:0:3678:0:(import.c:65:import_set_state_nolock()) ffff99da7dbeb000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1777051224.868586:0:3678:0:(import.c:181:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1777051224.887070:0:3678:0:(import.c:65:import_set_state_nolock()) ffff99da7dbeb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1777051224.887085:0:3678:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 7833 00000100:00080000:1.0:1777051224.887098:0:3678:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff99da7dbeb000 using connection 192.168.201.146@tcp/0@lo 00000100:00100000:1.0:1777051224.888791:0:3678:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99da44975880 x1863365452489344/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1777051224.888850:0:3676:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da44975880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3676:1863365452489344:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:1.0:1777051224.888931:0:3676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051224.889008:0:46500:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452489344 00000100:00100000:1.0:1777051224.889018:0:46500:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452489344 00000100:00100000:1.0:1777051224.889067:0:46500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7970 00000100:00100000:1.0:1777051224.889078:0:46500:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da44974380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:0+-99:3676:x1863365452489344:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:1.0:1777051224.889101:0:46500:0:(ldlm_lib.c:1193:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000020:00000080:0.0:1777051224.897955:0:38719:0:(genops.c:906:class_export_put()) final put ffff99da71c68000/c11b6966-0775-44d2-bdc6-c74c26eb2226 00000020:00000080:0.0:1777051224.898044:0:48457:0:(genops.c:865:class_export_destroy()) destroying export ffff99da71c68000/c11b6966-0775-44d2-bdc6-c74c26eb2226 for lustre-MDT0000 00000020:00000080:0.0:1777051224.898107:0:48457:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99da48b28000 for lustre-MDT0000 00000100:00080000:0.0:1777051224.898254:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1777051224.898383:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111627 00000100:00100000:0.0:1777051224.898401:0:6581:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95fbad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3680:x1863365452489728:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1777051224.898414:0:6581:0:(tgt_handler.c:795:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1777051224.898494:0:6581:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95fbad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3680:x1863365452489728:12345-0@lo:400:kworker.0 Request processed in 90us (756us total) trans 0 rc -107/-107 00000100:00100000:0.0:1777051224.898516:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111627 00000100:00100000:0.0:1777051224.898562:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111629 00000100:00100000:0.0:1777051224.898573:0:6581:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95fbae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3680:x1863365452490112:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1777051224.898581:0:6581:0:(tgt_handler.c:795:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1777051224.898902:0:6581:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95fbae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3680:x1863365452490112:12345-0@lo:400:kworker.0 Request processed in 328us (954us total) trans 0 rc -107/-107 00000100:00100000:0.0:1777051224.898912:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111629 00000100:00100000:0.0:1777051224.899365:0:3676:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95fbadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3676:1863365452490496:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:0.0:1777051224.899422:0:3676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051224.899465:0:3676:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da449c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3676:1863365452490624:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:0.0:1777051224.899511:0:3676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051224.899556:0:3676:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da449c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3676:1863365452490752:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:0.0:1777051224.899610:0:3676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051224.899705:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111631 00000100:00100000:0.0:1777051224.899722:0:6579:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f42d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3676:x1863365452490624:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:0.0:1777051224.899741:0:6579:0:(ldlm_lib.c:1193:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1777051224.899833:0:6579:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f42d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3676:x1863365452490624:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 109us (322us total) trans 0 rc -19/-19 00000100:00100000:0.0:1777051224.899861:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111631 00000100:00080000:0.0:1777051224.899938:0:3676:0:(import.c:65:import_set_state_nolock()) ffff99da7fa93000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1777051224.899949:0:3676:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1777051224.899958:0:3676:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95fbadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3676:1863365452490496:0@lo:38:ptlrpcd_00_03.0 00000100:00080000:0.0:1777051224.899982:0:3676:0:(import.c:65:import_set_state_nolock()) ffff99da5f282000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1777051224.899995:0:3676:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1777051224.900002:0:3676:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da449c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3676:1863365452490624:0@lo:38:ptlrpcd_00_03.0 00000100:00080000:0.0:1777051224.900038:0:3676:0:(import.c:65:import_set_state_nolock()) ffff99d94183b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1777051224.900045:0:3676:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1777051224.900049:0:3676:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da449c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3676:1863365452490752:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:0.0:1777051224.901333:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d944d2bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3677:1863365452489856:0@lo:400:kworker.0 00000100:00100000:0.0:1777051224.901385:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051224.901416:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95fbac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452490368:0@lo:400:kworker.0 00000100:00100000:0.0:1777051224.901441:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051224.901479:0:3677:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1777051224.901488:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7fd65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3677:1863365452489472:0@lo:400:kworker.0 00000100:00100000:0.0:1777051224.901523:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051224.901572:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95fbafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452489984:0@lo:400:kworker.0 00000100:00100000:0.0:1777051224.901617:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051224.901678:0:99928:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452489472 00000100:00100000:0.0:1777051224.901688:0:99928:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452489472 00000100:00100000:0.0:1777051224.901744:0:99928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1777051224.901759:0:99928:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94343e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9351a01-5b0e-4470-97fd-58b9b4b312a2+18:3677:x1863365452489472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777051224.901822:0:99928:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94343e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9351a01-5b0e-4470-97fd-58b9b4b312a2+18:3677:x1863365452489472:12345-0@lo:400:kworker.0 Request processed in 66us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051224.901835:0:99928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1777051224.901909:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7fd65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3677:1863365452489472:0@lo:400:kworker.0 00000100:00100000:0.0:1777051224.901933:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95fbafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452489984:0@lo:400:kworker.0 00000100:00100000:0.0:1777051224.901952:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95fbac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452490368:0@lo:400:kworker.0 00000100:00100000:0.0:1777051224.902130:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d944d2bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3677:1863365452489856:0@lo:400:kworker.0 00010000:00010000:0.0:1777051224.903672:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777051224.903678:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777051224.903681:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1777051224.906819:0:13753:0:(genops.c:906:class_export_put()) final put ffff99da71c6b800/2dd4696c-edce-4cd1-86d2-dbd2ff957fa1 00000020:00000080:0.0:1777051224.906909:0:46211:0:(genops.c:865:class_export_destroy()) destroying export ffff99da71c6b800/2dd4696c-edce-4cd1-86d2-dbd2ff957fa1 for lustre-MDT0000 00000020:00000080:0.0:1777051224.906989:0:46211:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99da44f1f000 for lustre-MDT0000 00000100:00080000:0.0:1777051224.913587:0:3676:0:(import.c:65:import_set_state_nolock()) ffff99da7dbeb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1777051224.913597:0:3676:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1777051224.913603:0:3676:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da44975880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3676:1863365452489344:0@lo:38:ptlrpcd_00_01.0 00000020:00080000:0.0:1777051224.913697:0:100993:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff99d941ce0000) has no exports 00000020:00000080:0.0:1777051224.977118:0:100993:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x85f51a6b96714130 00000020:00000080:0.0:1777051224.977138:0:100993:0:(genops.c:906:class_export_put()) final put ffff99d94405e800/lustre-QMT0000_UUID 00000020:01000000:0.0:1777051224.977182:0:100993:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:1.0:1777051224.977353:0:100993:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1777051224.977369:0:100993:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1777051224.977377:0:100993:0:(genops.c:1579:class_disconnect_exports()) OBD device 7 (ffff99d941e6b380) has no exports 00000020:00000080:1.0:1777051224.977781:0:100993:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x85f51a6b96714129 00000020:00000080:1.0:1777051224.977793:0:100993:0:(genops.c:906:class_export_put()) final put ffff99da7dbc8800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1777051224.977914:0:100993:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1777051224.977929:0:100993:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1777051224.977933:0:100993:0:(genops.c:906:class_export_put()) final put ffff99da5f282800/lustre-QMT0000_UUID 00000020:00000080:1.0:1777051224.977938:0:100993:0:(genops.c:865:class_export_destroy()) destroying export ffff99da5f282800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:1.0:1777051224.977954:0:100993:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:01000000:1.0:1777051224.978152:0:100993:0:(lprocfs_status_server.c:298:lprocfs_free_client_stats()) stat ffff99d9434dfcc0 - data ffff99d94a31e438/ffff99da45f64400 00000020:01000000:0.0:1777051224.978621:0:100993:0:(lprocfs_status_server.c:298:lprocfs_free_client_stats()) stat ffff99d95cbf5900 - data ffff99da70efa870/ffff99da6fd56c00 00000100:00100000:3.0:1777051224.998816:0:13320:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425842432 00000100:00100000:3.0:1777051224.998831:0:13320:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425842432 00000100:00100000:1.0:1777051224.999019:0:6579:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425842176 00000100:00100000:1.0:1777051224.999028:0:6579:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425842176 00000100:00100000:1.0:1777051224.999083:0:6579:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425842688 00000100:00100000:1.0:1777051224.999090:0:6579:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425842688 00000100:00100000:1.0:1777051224.999128:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111633 00000100:00100000:1.0:1777051224.999142:0:6579:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da449c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2437:x1863365425842176:12345-192.168.201.46@tcp:400:kworker.0 00000020:00080000:1.0:1777051224.999159:0:6579:0:(tgt_handler.c:795:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.201.46@tcp 00000100:00100000:3.0:1777051224.999189:0:13320:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425842944 00000100:00100000:3.0:1777051224.999199:0:13320:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425842944 00000100:00100000:3.0:1777051224.999299:0:13320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10138 00000100:00100000:1.0:1777051224.999315:0:6579:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da449c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2437:x1863365425842176:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 167us (1236us total) trans 0 rc -107/-107 00000100:00100000:3.0:1777051224.999324:0:13320:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da449c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+50:2437:x1863365425842432:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:1.0:1777051224.999345:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111633 00000100:00100000:1.0:1777051224.999384:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111634 00000100:00100000:1.0:1777051224.999395:0:6579:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da449cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2437:x1863365425842688:12345-192.168.201.46@tcp:400:kworker.0 00000020:00080000:1.0:1777051224.999447:0:6579:0:(tgt_handler.c:795:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.201.46@tcp 00000100:00100000:1.0:1777051224.999493:0:6579:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da449cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2437:x1863365425842688:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 96us (754us total) trans 0 rc -107/-107 00000100:00100000:1.0:1777051224.999507:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111634 00000100:00100000:1.0:1777051224.999550:0:24468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10139 00000100:00100000:1.0:1777051224.999565:0:24468:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da449cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+50:2437:x1863365425842944:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:1.0:1777051224.999616:0:24468:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da449cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+50:2437:x1863365425842944:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 53us (740us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051224.999629:0:24468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10139 00000100:00100000:3.0:1777051225.000042:0:13320:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da449c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+50:2437:x1863365425842432:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 95us (805us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051225.000065:0:13320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10138 00000100:00080000:3.0:1777051225.000105:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1777051225.000131:0:99930:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425842048 00000100:00100000:3.0:1777051225.000139:0:99930:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425842048 00000100:00100000:3.0:1777051225.000266:0:99930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 121 00000100:00100000:3.0:1777051225.000283:0:99930:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94343c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29c4352d-3260-4734-909d-9ea5de9e7fa4+12:2437:x1863365425842048:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:1.0:1777051225.000343:0:10328:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425842304 00000100:00100000:1.0:1777051225.000353:0:10328:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425842304 00000100:00100000:1.0:1777051225.000417:0:10328:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425842816 00000100:00100000:1.0:1777051225.000422:0:10328:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425842816 00000100:00100000:1.0:1777051225.000464:0:10328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13076 00000100:00100000:3.0:1777051225.000546:0:99930:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94343c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29c4352d-3260-4734-909d-9ea5de9e7fa4+12:2437:x1863365425842048:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 262us (1597us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051225.000560:0:99930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 121 00000100:00100000:3.0:1777051225.000753:0:8470:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425842560 00000100:00100000:3.0:1777051225.000763:0:8470:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425842560 00000100:00100000:1.0:1777051225.000812:0:10328:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da449cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+6:2437:x1863365425842304:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:3.0:1777051225.000822:0:8470:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425843072 00000100:00100000:3.0:1777051225.000834:0:8470:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425843072 00000100:00100000:1.0:1777051225.000901:0:10328:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da449cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+6:2437:x1863365425842304:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 420us (1912us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051225.000913:0:8470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10140 00000100:00100000:1.0:1777051225.000934:0:10328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13076 00000100:00100000:3.0:1777051225.000943:0:8470:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da449c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+48:2437:x1863365425842560:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:1.0:1777051225.000979:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10141 00000100:00100000:1.0:1777051225.000996:0:8468:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da449cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+47:2437:x1863365425843072:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:1.0:1777051225.001049:0:8468:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da449cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+47:2437:x1863365425843072:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 57us (601us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051225.001061:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10141 00000100:00100000:3.0:1777051225.001551:0:8470:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da449c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+48:2437:x1863365425842560:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 619us (1186us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051225.001565:0:8470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10140 00000100:00080000:3.0:1777051225.034511:0:100993:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1777051225.034521:0:100993:0:(client.c:3101:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1777051225.034537:0:100993:0:(client.c:3139:ptlrpc_free_committed()) @@@ free request with old gen req@ffff99d942a0c700 x1863365452488832/t4294970573(4294970573) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1777051234 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777051225.034570:0:100993:0:(import.c:321:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1777051225.037659:0:100993:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1777051225.037667:0:100993:0:(client.c:3101:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968346 gen 4 00000004:00080000:3.0:1777051225.037691:0:100993:0:(osp_dev.c:1629:osp_import_event()) got inactive 00000100:00100000:3.0:1777051225.037696:0:100993:0:(import.c:321:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1777051225.038372:0:99942:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1777051225.038381:0:99942:0:(llog.c:858:llog_process_thread()) stop processing plain [0x1:0x1f:0x0] index 1 count 1 00000040:00080000:1.0:1777051225.038398:0:99942:0:(llog.c:858:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 5 count 2 00000100:00080000:3.0:1777051225.040357:0:100993:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1777051225.040364:0:100993:0:(client.c:3101:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968349 gen 4 00000004:00080000:3.0:1777051225.040395:0:100993:0:(osp_dev.c:1629:osp_import_event()) got inactive 00000100:00100000:3.0:1777051225.040398:0:100993:0:(import.c:321:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00100000:1.0:1777051225.043509:0:46497:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425843200 00000100:00100000:1.0:1777051225.043523:0:46497:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425843200 00000100:00100000:1.0:1777051225.043583:0:46497:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425843328 00000100:00100000:1.0:1777051225.043589:0:46497:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425843328 00000100:00100000:1.0:1777051225.043632:0:46497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111635 00000100:00100000:1.0:1777051225.043658:0:46497:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da449ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:0+-99:2435:x1863365425843200:12345-192.168.201.46@tcp:38:ptlrpcd_00_01.0 00000100:00100000:3.0:1777051225.043662:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111636 00000100:00100000:3.0:1777051225.043685:0:6579:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da449c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2435:x1863365425843328:12345-192.168.201.46@tcp:38:ptlrpcd_00_01.0 00010000:02000000:1.0:1777051225.043697:0:46497:0:(ldlm_lib.c:1193:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.201.46@tcp (stopping) 00010000:02000000:3.0:1777051225.043709:0:6579:0:(ldlm_lib.c:1193:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.201.46@tcp (stopping) 00000100:00100000:1.0:1777051225.044138:0:46497:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da449ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:0+-99:2435:x1863365425843200:12345-192.168.201.46@tcp:38:ptlrpcd_00_01.0 Request processed in 487us (1163us total) trans 0 rc -19/-19 00000100:00100000:3.0:1777051225.044142:0:6579:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da449c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2435:x1863365425843328:12345-192.168.201.46@tcp:38:ptlrpcd_00_01.0 Request processed in 452us (1052us total) trans 0 rc -19/-19 00000100:00100000:1.0:1777051225.044170:0:46497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111635 00000100:00100000:3.0:1777051225.044183:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111636 00000020:00000080:3.0:1777051225.047358:0:100993:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x85f51a6b967140d5 00000020:00000080:3.0:1777051225.047371:0:100993:0:(genops.c:906:class_export_put()) final put ffff99d958e39000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1777051225.048921:0:100993:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x85f51a6b967140f1 00000020:00000080:3.0:1777051225.048930:0:100993:0:(genops.c:906:class_export_put()) final put ffff99da5f3d6000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1777051225.048943:0:100993:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:3.0:1777051225.048952:0:100993:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1777051225.048964:0:100993:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1777051225.048975:0:100993:0:(genops.c:1579:class_disconnect_exports()) OBD device 4 (ffff99d941ce19c0) has no exports 00000004:01000000:3.0:1777051225.049331:0:100993:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1777051225.049346:0:100993:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x85f51a6b9671417d 00000020:00000080:3.0:1777051225.049356:0:100993:0:(genops.c:906:class_export_put()) final put ffff99da4875d000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1777051225.049380:0:100993:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:3.0:1777051225.049388:0:100993:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1777051225.049402:0:100993:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1777051225.049409:0:100993:0:(genops.c:1579:class_disconnect_exports()) OBD device 22 (ffff99da7f993380) has no exports 00000020:00000080:3.0:1777051225.049418:0:100993:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x85f51a6b96714176 00000020:00000080:3.0:1777051225.049424:0:100993:0:(genops.c:906:class_export_put()) final put ffff99d941c46800/lustre-MDT0000-osd_UUID 00010000:01000000:3.0:1777051225.052060:0:100993:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:3.0:1777051225.052068:0:100993:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1777051225.052074:0:100993:0:(client.c:3101:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968349 gen 5 00000004:00080000:3.0:1777051225.052082:0:100993:0:(osp_dev.c:1629:osp_import_event()) got inactive 00000100:00100000:3.0:1777051225.052087:0:100993:0:(import.c:321:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1777051225.052170:0:100993:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1777051225.052183:0:100993:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1777051225.052192:0:100993:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x85f51a6b96714161 00000020:00000080:3.0:1777051225.052282:0:100993:0:(genops.c:906:class_export_put()) final put ffff99da7b5f7800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1777051225.052290:0:100993:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:3.0:1777051225.052318:0:100993:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1777051225.052327:0:100993:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1777051225.052331:0:100993:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff99da7f990000) has no exports 00000020:00000080:3.0:1777051225.052338:0:100993:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x85f51a6b96714153 00000020:00000080:3.0:1777051225.052344:0:100993:0:(genops.c:906:class_export_put()) final put ffff99da454e4800/lustre-MDT0000-osd_UUID 00010000:01000000:3.0:1777051225.053248:0:100993:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:3.0:1777051225.053254:0:100993:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1777051225.053259:0:100993:0:(client.c:3101:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968346 gen 5 00000004:00080000:3.0:1777051225.053265:0:100993:0:(osp_dev.c:1629:osp_import_event()) got inactive 00000100:00100000:3.0:1777051225.053269:0:100993:0:(import.c:321:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1777051225.053330:0:100993:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1777051225.053341:0:100993:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:3.0:1777051225.053361:0:100993:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:3.0:1777051225.053370:0:100993:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x85f51a6b96714145 00000020:00000080:3.0:1777051225.053378:0:100993:0:(genops.c:906:class_export_put()) final put ffff99da7b5f5800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1777051225.053386:0:100993:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:3.0:1777051225.053394:0:100993:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1777051225.053401:0:100993:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1777051225.053406:0:100993:0:(genops.c:1579:class_disconnect_exports()) OBD device 8 (ffff99da7f994d40) has no exports 00000020:00000080:3.0:1777051225.053414:0:100993:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x85f51a6b9671413e 00000020:00000080:3.0:1777051225.053422:0:100993:0:(genops.c:906:class_export_put()) final put ffff99d944058000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1777051225.057260:0:48457:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99da7b3ce000 for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1777051225.057275:0:48457:0:(genops.c:906:class_export_put()) final put ffff99da7b5f2800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1777051225.057279:0:48457:0:(genops.c:865:class_export_destroy()) destroying export ffff99da7b5f2800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:1.0:1777051225.057308:0:48457:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1777051225.057624:0:48457:0:(genops.c:865:class_export_destroy()) destroying export ffff99da5f3d1000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1777051225.058341:0:48457:0:(genops.c:865:class_export_destroy()) destroying export ffff99d958e38800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00010000:1.0:1777051225.058372:0:6567:0:(genops.c:1928:obd_stale_export_get()) Get export ffff99da5f3d5800: total 0 00010000:00010000:1.0:1777051225.058444:0:6567:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff99da5f3d5800, canceled 0 locks, left on hash table 13. 00010000:00010000:1.0:1777051225.058498:0:6567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d953298c00/0x85f51a6b96714280 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x85f51a6b96714279 expref: 14 pid: 99935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051225.058537:0:6567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d955a8ec00/0x85f51a6b9671456d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x85f51a6b96714566 expref: 13 pid: 99930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051225.058570:0:6567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d9442eb600/0x85f51a6b96714210 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x85f51a6b96714209 expref: 12 pid: 99935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051225.058604:0:6567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d94ffbd200/0x85f51a6b96714272 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x85f51a6b9671426b expref: 11 pid: 99935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051225.058639:0:6567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d953298200/0x85f51a6b9671428e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x85f51a6b96714287 expref: 10 pid: 99929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051225.058679:0:6567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d9442eb400/0x85f51a6b9671421e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x85f51a6b96714217 expref: 9 pid: 99930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051225.058732:0:6567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99da40030c00/0x85f51a6b9671429c lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x85f51a6b96714295 expref: 8 pid: 99930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051225.058800:0:6567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d953298800/0x85f51a6b9671423a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x85f51a6b96714233 expref: 7 pid: 99935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051225.058875:0:6567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d94f683200/0x85f51a6b967142b8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x85f51a6b967142b1 expref: 6 pid: 99935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051225.058907:0:6567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d9442eba00/0x85f51a6b96714248 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x85f51a6b96714241 expref: 5 pid: 99928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051225.058933:0:6567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99da7d785800/0x85f51a6b96714264 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x85f51a6b9671425d expref: 4 pid: 99929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051225.058959:0:6567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d943ebb200/0x85f51a6b96714551 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x85f51a6b9671454a expref: 3 pid: 99935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051225.058980:0:6567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99da7d507400/0x85f51a6b9671455f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x85f51a6b96714558 expref: 2 pid: 99929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051225.059003:0:6567:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff99da5f3d5800, canceled 13 locks, left on hash table 0. 00000020:00000080:1.0:1777051225.059041:0:6567:0:(genops.c:906:class_export_put()) final put ffff99da5f3d5800/f9351a01-5b0e-4470-97fd-58b9b4b312a2 00010000:00010000:1.0:1777051225.059056:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051225.059061:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051225.059065:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1777051225.059083:0:48457:0:(genops.c:865:class_export_destroy()) destroying export ffff99da5f3d5000/29c4352d-3260-4734-909d-9ea5de9e7fa4 for MGS 00000020:00000080:1.0:1777051225.059131:0:48457:0:(genops.c:865:class_export_destroy()) destroying export ffff99da5f3d5800/f9351a01-5b0e-4470-97fd-58b9b4b312a2 for MGS 00000020:00000080:1.0:1777051225.059164:0:48457:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99da5f3d4000 for MGS 00000020:00000080:1.0:1777051225.059173:0:48457:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99da5f3d0800 for MGS 00000100:00100000:1.0:1777051225.059355:0:99928:0:(service.c:3162:ptlrpc_main()) ll_mgs_0000: service thread [ffff99da5f869a00:99928] 0 exiting: rc = 1 00000100:00100000:0.0:1777051225.059401:0:99929:0:(service.c:3162:ptlrpc_main()) ll_mgs_0001: service thread [ffff99da45f62c00:99929] 1 exiting: rc = 0 00000020:00000080:1.0:1777051225.068628:0:46211:0:(genops.c:865:class_export_destroy()) destroying export ffff99da7fa96800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1777051225.068963:0:46211:0:(genops.c:865:class_export_destroy()) destroying export ffff99da48b2d000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:3.0:1777051225.072493:0:100993:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:3.0:1777051225.072500:0:100993:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1777051225.072522:0:100993:0:(client.c:3101:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1777051225.072532:0:100993:0:(import.c:321:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1777051225.072699:0:100993:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1777051225.072713:0:100993:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:3.0:1777051225.072722:0:100993:0:(obd_mount.c:701:lustre_put_lsi()) put ffff99d958727800 1 00000020:00000080:3.0:1777051225.072727:0:100993:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x85f51a6b96714088 00000020:00000080:3.0:1777051225.072734:0:100993:0:(genops.c:906:class_export_put()) final put ffff99da4a377800/lustre-MDT0000-osd_UUID 00000020:01000000:3.0:1777051225.072740:0:100993:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:3.0:1777051225.072746:0:100993:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1777051225.072751:0:100993:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1777051225.072756:0:100993:0:(genops.c:1579:class_disconnect_exports()) OBD device 0 (ffff99d941e68000) has no exports 00000020:00000080:1.0:1777051225.073059:0:46211:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99da48b2e800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1777051225.074298:0:46211:0:(genops.c:906:class_export_put()) final put ffff99da7b5f1000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1777051225.074306:0:46211:0:(genops.c:865:class_export_destroy()) destroying export ffff99da7b5f1000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:1.0:1777051225.074321:0:46211:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:1.0:1777051225.074518:0:46211:0:(genops.c:865:class_export_destroy()) destroying export ffff99da4a377800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1777051225.143166:0:100993:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1777051225.143184:0:100993:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:3.0:1777051225.143192:0:100993:0:(genops.c:906:class_export_put()) final put ffff99d958726800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1777051225.143284:0:100993:0:(genops.c:865:class_export_destroy()) destroying export ffff99d958726800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:3.0:1777051225.143306:0:100993:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:3.0:1777051225.143736:0:100993:0:(obd_mount.c:659:lustre_free_lsi()) Freeing lsi ffff99d958724000 00000020:02000400:3.0:1777051225.143882:0:100993:0:(tgt_mount.c:2134:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:0.0:1777051225.174753:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051226.198792:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051228.246953:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1777051228.438954:0:99289:0:(llog.c:801:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1777051228.438963:0:99289:0:(llog_cat.c:158:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1777051228.439736:0:99289:0:(llog.c:858:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:0.0:1777051228.439748:0:99289:0:(llog.c:858:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1777051228.951511:0:3677:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1777051228.951556:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da44976a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452490880:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1777051228.951736:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051228.953726:0:10113:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452490880 00000100:00100000:1.0:1777051228.953740:0:10113:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452490880 00000100:00100000:1.0:1777051228.953954:0:10113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5508 00000100:00100000:1.0:1777051228.953982:0:10113:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d944e10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3677:x1863365452490880:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1777051228.954073:0:10113:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 430295232 pending 0 free 3645853696 avail 3414331392 00000100:00100000:1.0:1777051228.954309:0:10113:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d944e10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3677:x1863365452490880:12345-0@lo:13:osp-pre-1-1.0 Request processed in 330us (2572us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051228.954326:0:10113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5508 00000100:00100000:0.0:1777051228.954454:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da44976a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452490880:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1777051229.270478:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1777051229.463140:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95aecd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452491008:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1777051229.463295:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051229.463420:0:8473:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452491008 00000100:00100000:1.0:1777051229.463458:0:8473:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452491008 00000100:00100000:1.0:1777051229.463577:0:8473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5509 00000100:00100000:1.0:1777051229.463599:0:8473:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fd65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3679:x1863365452491008:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1777051229.463642:0:8473:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 440355008 pending 0 free 3862671360 avail 3631149056 00000100:00100000:1.0:1777051229.464023:0:8473:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fd65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3679:x1863365452491008:12345-0@lo:13:osp-pre-0-1.0 Request processed in 429us (727us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051229.464039:0:8473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5509 00000100:00100000:0.0:1777051229.464297:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95aecd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452491008:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1777051229.974685:0:3679:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1777051229.977483:0:3676:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da449caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3676:1863365452491264:0@lo:38:kworker.0 00000100:00100000:0.0:1777051229.977600:0:3676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051229.978050:0:3676:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da449c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3676:1863365452491392:0@lo:38:kworker.0 00000100:00100000:1.0:1777051229.978221:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da449c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3679:1863365452492032:0@lo:400:kworker.0 00000100:00100000:3.0:1777051229.978278:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da449c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3677:1863365452491648:0@lo:400:kworker.0 00000100:00100000:0.0:1777051229.978285:0:3676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051229.978343:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051229.978353:0:3676:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da449ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3676:1863365452491520:0@lo:38:kworker.0 00000100:00100000:3.0:1777051229.978589:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051229.978688:0:21368:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452491392 00000100:00100000:3.0:1777051229.978702:0:21368:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452491392 00000100:00100000:3.0:1777051229.979101:0:21368:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452492032 00000100:00100000:3.0:1777051229.979113:0:21368:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452492032 00000100:00100000:3.0:1777051229.979236:0:21368:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452491648 00000100:00100000:3.0:1777051229.979244:0:21368:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452491648 00000100:00100000:3.0:1777051229.979303:0:21368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13078 00000100:00100000:3.0:1777051229.979324:0:21368:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da44975500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3679:x1863365452492032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051229.979475:0:21368:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da44975500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3679:x1863365452492032:12345-0@lo:400:kworker.0 Request processed in 154us (1132us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051229.979499:0:21368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13078 00000100:00100000:3.0:1777051229.979543:0:21368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13079 00000100:00100000:3.0:1777051229.979565:0:21368:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95aecf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3677:x1863365452491648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777051229.979632:0:3676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051229.979675:0:21368:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95aecf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3677:x1863365452491648:12345-0@lo:400:kworker.0 Request processed in 110us (1082us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051229.979692:0:3676:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da449c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3676:1863365452491904:0@lo:38:kworker.0 00000100:00100000:3.0:1777051229.979717:0:21368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13079 00000100:00100000:3.0:1777051229.979752:0:21368:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452491520 00000100:00100000:0.0:1777051229.979762:0:3676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051229.979763:0:21368:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452491520 00000100:00100000:3.0:1777051229.979858:0:21368:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452491904 00000100:00100000:3.0:1777051229.979866:0:21368:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452491904 00000100:00100000:0.0:1777051229.979880:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111638 00000100:00100000:0.0:1777051229.979892:0:6580:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3676:x1863365452491520:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1777051229.979925:0:21368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111639 00000100:00100000:3.0:1777051229.979937:0:21368:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3676:x1863365452491904:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1777051229.980506:0:6580:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1777051229.980575:0:6580:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3676:x1863365452491520:12345-0@lo:38:kworker.0 Request processed in 681us (953us total) trans 0 rc -19/-19 00000100:00100000:0.0:1777051229.980589:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111638 00000100:00100000:0.0:1777051229.980632:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d944d2bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3680:1863365452492160:0@lo:400:kworker.0 00000100:00100000:0.0:1777051229.980674:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051229.980724:0:8628:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452492160 00000100:00100000:0.0:1777051229.980731:0:8628:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452492160 00000100:00100000:0.0:1777051229.980774:0:8628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10143 00000100:00100000:0.0:1777051229.980786:0:8628:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3680:x1863365452492160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777051229.980845:0:8628:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3680:x1863365452492160:12345-0@lo:400:kworker.0 Request processed in 61us (170us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051229.980857:0:8628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10143 00000100:00100000:0.0:1777051229.980908:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d944d2bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3680:1863365452492160:0@lo:400:kworker.0 00000100:00080000:0.0:1777051229.981230:0:3676:0:(import.c:65:import_set_state_nolock()) ffff99d94183b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1777051229.981241:0:3676:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1777051229.981247:0:3676:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da449ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3676:1863365452491520:0@lo:38:kworker.0 00000100:00100000:0.0:1777051229.981308:0:46498:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452491264 00000100:00100000:0.0:1777051229.981316:0:46498:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452491264 00000100:00100000:0.0:1777051229.981359:0:46498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7971 00000100:00100000:0.0:1777051229.981369:0:46498:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d944070e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:0+-99:3676:x1863365452491264:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1777051229.981768:0:21368:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00020000:0.0:1777051229.981779:0:46498:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1777051229.981870:0:46498:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d944070e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:0+-99:3676:x1863365452491264:12345-0@lo:38:kworker.0 Request processed in 499us (4272us total) trans 0 rc -19/-19 00000100:00100000:0.0:1777051229.981883:0:46498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7971 00000100:00080000:0.0:1777051229.981962:0:3676:0:(import.c:65:import_set_state_nolock()) ffff99da5f282000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1777051229.981971:0:3676:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1777051229.981979:0:3676:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da449c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3676:1863365452491904:0@lo:38:kworker.0 00000100:00080000:0.0:1777051229.981996:0:3676:0:(import.c:65:import_set_state_nolock()) ffff99da7dbeb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1777051229.982002:0:3676:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1777051229.982007:0:3676:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da449caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3676:1863365452491264:0@lo:38:kworker.0 00000100:00100000:0.0:1777051229.982117:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da449c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3677:1863365452491648:0@lo:400:kworker.0 00000100:00100000:3.0:1777051229.983429:0:21368:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3676:x1863365452491904:12345-0@lo:38:kworker.0 Request processed in 3485us (3665us total) trans 0 rc -19/-19 00000100:00100000:3.0:1777051229.983446:0:21368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111639 00000100:00100000:1.0:1777051229.983486:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da449c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3679:1863365452492032:0@lo:400:kworker.0 00000100:00100000:1.0:1777051229.983509:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da449c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3679:1863365452491136:0@lo:400:kworker.0 00000400:00000100:1.0:1777051229.983552:0:3679:0:(lib-move.c:4517:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1863365452491136 offset 0 length 224: 4 00000100:00100000:3.0:1777051230.059725:0:10328:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3676:x1863365452491392:12345-0@lo:38:kworker.0 Request processed in 80077us (81435us total) trans 0 rc -19/-19 00000100:00100000:3.0:1777051230.059753:0:10328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111637 00000100:00080000:1.0:1777051230.059811:0:3676:0:(import.c:65:import_set_state_nolock()) ffff99da7fa93000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1777051230.059822:0:3676:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1777051230.059830:0:3676:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da449c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3676:1863365452491392:0@lo:38:kworker.0 00000100:00100000:0.0:1777051230.117617:0:6580:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425843712 00000100:00100000:0.0:1777051230.117632:0:6580:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425843712 00000100:00080000:3.0:1777051230.118492:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1777051230.118885:0:13320:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425843840 00000100:00100000:3.0:1777051230.118917:0:13320:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425843840 00000100:00100000:0.0:1777051230.119028:0:6580:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425843584 00000100:00100000:0.0:1777051230.119040:0:6580:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425843584 00000100:00100000:3.0:1777051230.119041:0:13320:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425843968 00000100:00100000:3.0:1777051230.119052:0:13320:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425843968 00000100:00100000:0.0:1777051230.119101:0:6580:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425844224 00000100:00100000:0.0:1777051230.119111:0:6580:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425844224 00000100:00100000:3.0:1777051230.119112:0:13320:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425844480 00000100:00100000:3.0:1777051230.119492:0:13320:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425844480 00000100:00100000:3.0:1777051230.119588:0:13320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10144 00000100:00100000:3.0:1777051230.119941:0:13320:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da449c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+50:2436:x1863365425843840:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:3.0:1777051230.120047:0:13320:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da449c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+50:2436:x1863365425843840:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 443us (1333us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051230.120181:0:13320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10144 00000100:00100000:3.0:1777051230.120265:0:13320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10146 00000100:00100000:3.0:1777051230.120287:0:13320:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da449c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+47:2437:x1863365425844480:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:3.0:1777051230.120363:0:13320:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da449c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+47:2437:x1863365425844480:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 77us (1458us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051230.120378:0:13320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10146 00000100:00100000:3.0:1777051230.120463:0:13320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10147 00000100:00100000:3.0:1777051230.120483:0:13320:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da449ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+50:2437:x1863365425844352:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:3.0:1777051230.120549:0:13320:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da449ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+50:2437:x1863365425844352:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 70us (1571us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051230.120562:0:13320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10147 00000100:00080000:3.0:1777051230.120613:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1777051230.120620:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1777051230.120919:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1777051230.121466:0:27882:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425844096 00000100:00100000:3.0:1777051230.121475:0:27882:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425844096 00000100:00100000:0.0:1777051230.121507:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13081 00000100:00100000:0.0:1777051230.121540:0:6580:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da449c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+48:2436:x1863365425844224:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:3.0:1777051230.121556:0:27882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111640 00000100:00100000:3.0:1777051230.121568:0:27882:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da449c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0+-99:2435:x1863365425843584:12345-192.168.201.46@tcp:38:kworker.0 00010000:00020000:3.0:1777051230.121607:0:27882:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.201.46@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1777051230.121639:0:6580:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da449c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+48:2436:x1863365425844224:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 103us (2806us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051230.121660:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13081 00000100:00100000:3.0:1777051230.121675:0:27882:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da449c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0+-99:2435:x1863365425843584:12345-192.168.201.46@tcp:38:kworker.0 Request processed in 101us (4231us total) trans 0 rc -19/-19 00000100:00100000:3.0:1777051230.121708:0:27882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111640 00000100:00100000:3.0:1777051230.121895:0:46494:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da449caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:0+-99:2435:x1863365425844096:12345-192.168.201.46@tcp:38:kworker.0 Request processed in 189us (3041us total) trans 0 rc -19/-19 00000100:00100000:3.0:1777051230.121910:0:46494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111641 00010000:00010000:3.0:1777051230.298522:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1777051231.004596:0:7498:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1777051231.004621:0:7498:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0001: transno 4294970573 is committed 00000020:00000080:1.0:1777051231.004658:0:7498:0:(genops.c:906:class_export_put()) final put ffff99da58bff000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1777051231.004983:0:8464:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1777051231.004988:0:8464:0:(genops.c:906:class_export_put()) final put ffff99da7dbce800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1777051231.005271:0:9540:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1777051231.005279:0:9540:0:(genops.c:906:class_export_put()) final put ffff99da5f280000/lustre-MDT0000-mdtlov_UUID 00010000:00010000:3.0:1777051231.318988:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051232.342608:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777051233.366610:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1777051234.071504:0:8472:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452492288 00000100:00100000:0.0:1777051234.071519:0:8472:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452492288 00000100:00080000:3.0:1777051234.071603:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1777051234.072006:0:8472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5510 00000100:00100000:0.0:1777051234.072029:0:8472:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da449cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3678:x1863365452492288:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1777051234.072100:0:8472:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 430295232 pending 0 free 3645853696 avail 3414331392 00000100:00100000:0.0:1777051234.072261:0:8472:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da449cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3678:x1863365452492288:12345-0@lo:13:osp-pre-1-1.0 Request processed in 236us (863us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051234.072276:0:8472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5510 00010000:00010000:3.0:1777051234.390982:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1777051234.583478:0:3677:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1777051234.583509:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95aecc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452492416:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1777051234.583634:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051234.583760:0:47388:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452492416 00000100:00100000:3.0:1777051234.583774:0:47388:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452492416 00000100:00100000:3.0:1777051234.583889:0:47388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5511 00000100:00080000:0.0:1777051234.583892:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1777051234.583938:0:47388:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3677:x1863365452492416:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1777051234.583977:0:47388:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 440355008 pending 0 free 3862671360 avail 3631149056 00000100:00100000:3.0:1777051234.584054:0:47388:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3677:x1863365452492416:12345-0@lo:13:osp-pre-0-1.0 Request processed in 152us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051234.584096:0:47388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5511 00000100:00100000:0.0:1777051234.584459:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95aecc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452492416:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1777051235.094904:0:48457:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1777051235.094917:0:48457:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1777051235.094925:0:48457:0:(import.c:65:import_set_state_nolock()) ffff99da7dbeb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1777051235.094938:0:48457:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 7859 00000100:00080000:3.0:1777051235.094948:0:48457:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1777051235.094960:0:48457:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff99da7dbeb000 using connection 192.168.201.146@tcp/0@lo 00000100:00100000:3.0:1777051235.095005:0:48457:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d95aecc380 x1863365452492672/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1777051235.095020:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95aecd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3679:1863365452492544:0@lo:400:kworker.0 00000100:00080000:3.0:1777051235.095097:0:48457:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1777051235.095106:0:48457:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1777051235.095112:0:48457:0:(import.c:65:import_set_state_nolock()) ffff99da7fa93000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1777051235.095121:0:48457:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 7859 00000100:00080000:3.0:1777051235.095128:0:48457:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1777051235.095137:0:48457:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff99da7fa93000 using connection 192.168.201.146@tcp/0@lo 00000400:00000100:1.0:1777051235.095150:0:3679:0:(lib-move.c:4517:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1863365452492544 offset 0 length 224: 4 00000100:00100000:3.0:1777051235.095172:0:48457:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d95aece680 x1863365452492800/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1777051235.095215:0:3676:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95aecc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3676:1863365452492672:0@lo:38:kworker.0 00000100:00080000:3.0:1777051235.095316:0:48457:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1777051235.095326:0:48457:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1777051235.095330:0:48457:0:(import.c:65:import_set_state_nolock()) ffff99d94183b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1777051235.095341:0:48457:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 7859 00000100:00080000:3.0:1777051235.095347:0:48457:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1777051235.095354:0:48457:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff99d94183b000 using connection 192.168.201.146@tcp/0@lo 00000100:00100000:3.0:1777051235.095383:0:48457:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d95aecd500 x1863365452492928/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1777051235.095433:0:3676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1777051235.095494:0:48457:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1777051235.095503:0:48457:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00100000:0.0:1777051235.095506:0:3676:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95aece680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3676:1863365452492800:0@lo:38:kworker.0 00000100:00080000:3.0:1777051235.095511:0:48457:0:(import.c:65:import_set_state_nolock()) ffff99da5f282000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1777051235.095527:0:48457:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 7859 00000100:00080000:3.0:1777051235.095534:0:48457:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1777051235.095542:0:48457:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff99da5f282000 using connection 192.168.201.146@tcp/0@lo 00000100:00100000:1.0:1777051235.095556:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d942a0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3680:1863365452493056:0@lo:400:kworker.0 00000100:00100000:3.0:1777051235.095576:0:48457:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d942a0c700 x1863365452493312/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1777051235.095602:0:3676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051235.096115:0:3676:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95aecd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3676:1863365452492928:0@lo:38:kworker.0 00000100:00100000:1.0:1777051235.096128:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d942a0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452493184:0@lo:400:kworker.0 00000100:00100000:3.0:1777051235.096183:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d9533bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452493568:0@lo:400:kworker.0 00000100:00100000:0.0:1777051235.096264:0:3676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051235.096264:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051235.096345:0:3677:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1777051235.096359:0:3676:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d942a0c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3676:1863365452493312:0@lo:38:kworker.0 00000100:00100000:1.0:1777051235.096368:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d9533bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3677:1863365452493440:0@lo:400:kworker.0 00000100:00100000:3.0:1777051235.096371:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051235.096467:0:3676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051235.096476:0:8471:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452493184 00000100:00100000:1.0:1777051235.096486:0:8471:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452493184 00000100:00100000:3.0:1777051235.096507:0:21368:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452492800 00000100:00100000:3.0:1777051235.096519:0:21368:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452492800 00000100:00100000:1.0:1777051235.096553:0:8471:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452493568 00000100:00100000:1.0:1777051235.096560:0:8471:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452493568 00000100:00080000:0.0:1777051235.096568:0:3676:0:(import.c:65:import_set_state_nolock()) ffff99da7dbeb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1777051235.096581:0:3676:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1777051235.096584:0:21368:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452493312 00000100:00100000:0.0:1777051235.096594:0:3676:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95aecc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3676:1863365452492672:0@lo:38:kworker.0 00000100:00100000:3.0:1777051235.096595:0:21368:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452493312 00000100:00100000:1.0:1777051235.096613:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10148 00000100:00100000:1.0:1777051235.096632:0:8471:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da44975c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3677:x1863365452493184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051235.096664:0:21368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111643 00000100:00100000:3.0:1777051235.096681:0:21368:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3676:x1863365452492928:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1777051235.096688:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111644 00000100:00100000:0.0:1777051235.096715:0:6580:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3676:x1863365452493312:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1777051235.096722:0:8471:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da44975c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3677:x1863365452493184:12345-0@lo:400:kworker.0 Request processed in 91us (465us total) trans 0 rc 0/0 00010000:00020000:3.0:1777051235.096724:0:21368:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1777051235.097046:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10148 00010000:00020000:0.0:1777051235.097103:0:6580:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1777051235.097121:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10149 00000100:00100000:1.0:1777051235.097141:0:8471:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3679:x1863365452493568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051235.097190:0:21368:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3676:x1863365452492928:12345-0@lo:38:kworker.0 Request processed in 503us (984us total) trans 0 rc -19/-19 00000100:00100000:0.0:1777051235.097256:0:6580:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3676:x1863365452493312:12345-0@lo:38:kworker.0 Request processed in 539us (788us total) trans 0 rc -19/-19 00000100:00100000:3.0:1777051235.097273:0:21368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111643 00000100:00100000:0.0:1777051235.097295:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111644 00000100:00100000:1.0:1777051235.097308:0:8471:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3679:x1863365452493568:12345-0@lo:400:kworker.0 Request processed in 168us (946us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051235.097323:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10149 00000100:00100000:3.0:1777051235.097331:0:21368:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452493056 00000100:00100000:3.0:1777051235.097341:0:21368:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452493056 00000100:00100000:1.0:1777051235.097383:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1777051235.097388:0:3676:0:(import.c:65:import_set_state_nolock()) ffff99d94183b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1777051235.097404:0:3676:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1777051235.097418:0:3676:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95aecd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3676:1863365452492928:0@lo:38:kworker.0 00000100:00100000:3.0:1777051235.097452:0:21368:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452493440 00000100:00080000:0.0:1777051235.097462:0:3676:0:(import.c:65:import_set_state_nolock()) ffff99da5f282000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:3.0:1777051235.097463:0:21368:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452493440 00000100:00100000:1.0:1777051235.097465:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d942a0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452493184:0@lo:400:kworker.0 00000100:00080000:0.0:1777051235.097486:0:3676:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1777051235.097500:0:3676:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d942a0c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3676:1863365452493312:0@lo:38:kworker.0 00000100:00100000:1.0:1777051235.097559:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d9533bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452493568:0@lo:400:kworker.0 00000100:00080000:0.0:1777051235.097563:0:3676:0:(import.c:65:import_set_state_nolock()) ffff99da7fa93000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:3.0:1777051235.097563:0:21368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13083 00000100:00080000:0.0:1777051235.097585:0:3676:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1777051235.097601:0:3676:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95aece680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3676:1863365452492800:0@lo:38:kworker.0 00000100:00100000:3.0:1777051235.097602:0:21368:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da44974700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3677:x1863365452493440:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1777051235.097644:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1777051235.098116:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d942a0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3680:1863365452493056:0@lo:400:kworker.0 00000100:00100000:3.0:1777051235.103463:0:21368:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da44974700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3677:x1863365452493440:12345-0@lo:400:kworker.0 Request processed in 5869us (6073us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051235.103483:0:21368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13083 00000100:00100000:0.0:1777051235.103736:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d9533bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3677:1863365452493440:0@lo:400:kworker.0 00000100:00100000:3.0:1777051235.235676:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051235.239040:0:27885:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425845248 00000100:00100000:0.0:1777051235.239054:0:27885:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425845248 00000100:00100000:1.0:1777051235.240894:0:6581:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425845376 00000100:00100000:1.0:1777051235.240908:0:6581:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425845376 00000100:00100000:0.0:1777051235.240914:0:27885:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425844864 00000100:00100000:0.0:1777051235.240930:0:27885:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425844864 00000100:00100000:1.0:1777051235.241046:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13084 00000100:00100000:0.0:1777051235.241103:0:27885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13085 00000100:00100000:1.0:1777051235.241106:0:6581:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da449c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+48:2439:x1863365425845376:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:0.0:1777051235.241139:0:27885:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f299180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c11b6966-0775-44d2-bdc6-c74c26eb2226+6:2439:x1863365425844864:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:1.0:1777051235.241275:0:6581:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da449c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+48:2439:x1863365425845376:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 208us (2159us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051235.241292:0:27885:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f299180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c11b6966-0775-44d2-bdc6-c74c26eb2226+6:2439:x1863365425844864:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 159us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051235.241309:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13084 00000100:00100000:0.0:1777051235.241330:0:27885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13085 00000100:00100000:1.0:1777051235.241366:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111646 00000100:00100000:1.0:1777051235.241380:0:6581:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da449cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2435:x1863365425845248:12345-192.168.201.46@tcp:38:kworker.0 00000100:00100000:0.0:1777051235.241418:0:8628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10150 00010000:00020000:1.0:1777051235.241418:0:6581:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.201.46@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1777051235.241451:0:8628:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da449c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+50:2439:x1863365425844992:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:1.0:1777051235.241487:0:6581:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da449cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2435:x1863365425845248:12345-192.168.201.46@tcp:38:kworker.0 Request processed in 102us (2572us total) trans 0 rc -19/-19 00000100:00100000:1.0:1777051235.241502:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111646 00000100:00100000:0.0:1777051235.241528:0:8628:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da449c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+50:2439:x1863365425844992:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 84us (2500us total) trans 0 rc 0/0 00000100:00080000:1.0:1777051235.241564:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1777051235.241571:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1777051235.241577:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1777051235.242622:0:8628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10150 00000100:00100000:3.0:1777051235.242719:0:24468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10152 00000100:00100000:3.0:1777051235.242752:0:24468:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f298000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+48:2439:x1863365425845120:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:1.0:1777051235.242763:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10153 00000100:00100000:1.0:1777051235.242800:0:8468:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f97ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+50:2439:x1863365425845504:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:3.0:1777051235.242881:0:24468:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f298000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+48:2439:x1863365425845120:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 138us (1924us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051235.242905:0:8468:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f97ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+50:2439:x1863365425845504:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 111us (1871us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051235.242922:0:24468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10152 00000100:00100000:1.0:1777051235.242940:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10153 00010000:00010000:3.0:1777051235.415176:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051236.438556:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777051237.462329:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051238.487219:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1777051238.678481:0:99289:0:(llog.c:801:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1777051238.678493:0:99289:0:(llog_cat.c:158:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1777051238.679422:0:99289:0:(llog.c:858:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:0.0:1777051238.679441:0:99289:0:(llog.c:858:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1777051239.191718:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da44975180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3680:1863365452493696:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1777051239.191809:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051239.191913:0:10113:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452493696 00000100:00100000:1.0:1777051239.191927:0:10113:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452493696 00000100:00100000:1.0:1777051239.192057:0:10113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5512 00000100:00100000:1.0:1777051239.192073:0:10113:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da444a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3680:x1863365452493696:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1777051239.192114:0:10113:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 430295232 pending 0 free 3645853696 avail 3414331392 00000100:00080000:3.0:1777051239.192185:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1777051239.192253:0:10113:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da444a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3680:x1863365452493696:12345-0@lo:13:osp-pre-1-1.0 Request processed in 181us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051239.192268:0:10113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5512 00000100:00100000:0.0:1777051239.192359:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da44975180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3680:1863365452493696:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1777051239.702514:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f9fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452493824:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1777051239.702625:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051239.702776:0:47388:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452493824 00000100:00100000:1.0:1777051239.702815:0:47388:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452493824 00000100:00080000:3.0:1777051239.702920:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1777051239.702928:0:47388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5513 00000100:00100000:1.0:1777051239.702953:0:47388:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da44974000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3677:x1863365452493824:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1777051239.703032:0:47388:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 440355008 pending 0 free 3862671360 avail 3631149056 00000100:00100000:1.0:1777051239.703159:0:47388:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da44974000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3677:x1863365452493824:12345-0@lo:13:osp-pre-0-1.0 Request processed in 214us (538us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051239.703172:0:47388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5513 00000100:00100000:0.0:1777051239.703473:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f9fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452493824:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1777051240.214412:0:84827:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1777051240.214422:0:84827:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1777051240.214428:0:84827:0:(import.c:65:import_set_state_nolock()) ffff99da7dbeb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1777051240.214441:0:84827:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 7864 00000100:00080000:0.0:1777051240.214450:0:84827:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1777051240.214460:0:84827:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff99da7dbeb000 using connection 192.168.201.146@tcp/0@lo 00000100:00100000:1.0:1777051240.214493:0:3677:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1777051240.214506:0:84827:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99da5f9fd880 x1863365452494080/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1777051240.214524:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f9fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3677:1863365452493952:0@lo:400:kworker.0 00000100:00080000:0.0:1777051240.214545:0:84827:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1777051240.214553:0:84827:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1777051240.214557:0:84827:0:(import.c:65:import_set_state_nolock()) ffff99da7fa93000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1777051240.214564:0:84827:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 7864 00000100:00080000:0.0:1777051240.214569:0:84827:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1777051240.214575:0:84827:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff99da7fa93000 using connection 192.168.201.146@tcp/0@lo 00000400:00000100:1.0:1777051240.214602:0:3677:0:(lib-move.c:4517:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1863365452493952 offset 0 length 224: 4 00000100:00100000:0.0:1777051240.214604:0:84827:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99da5f9fc380 x1863365452494208/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1777051240.214903:0:84827:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1777051240.214909:0:84827:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1777051240.214923:0:84827:0:(import.c:65:import_set_state_nolock()) ffff99d94183b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1777051240.214933:0:84827:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 7864 00000100:00080000:0.0:1777051240.214939:0:84827:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1777051240.214947:0:84827:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff99d94183b000 using connection 192.168.201.146@tcp/0@lo 00000100:00100000:0.0:1777051240.214974:0:84827:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99da5f9fea00 x1863365452494336/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1777051240.215029:0:3676:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f9fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3676:1863365452494080:0@lo:38:kworker.0 00000100:00100000:0.0:1777051240.215399:0:3680:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1777051240.215418:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f9fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3680:1863365452494464:0@lo:400:kworker.0 00000100:00100000:1.0:1777051240.215466:0:3676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051240.215531:0:3676:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f9fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3676:1863365452494208:0@lo:38:kworker.0 00000100:00100000:0.0:1777051240.215544:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051240.215604:0:3676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051240.215643:0:3676:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f9fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3676:1863365452494336:0@lo:38:kworker.0 00000100:00080000:0.0:1777051240.215674:0:84827:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1777051240.215682:0:84827:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1777051240.215687:0:84827:0:(import.c:65:import_set_state_nolock()) ffff99da5f282000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1777051240.215703:0:84827:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 7864 00000100:00100000:1.0:1777051240.215703:0:3676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1777051240.215715:0:84827:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1777051240.215730:0:84827:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff99da5f282000 using connection 192.168.201.146@tcp/0@lo 00000100:00100000:0.0:1777051240.215752:0:3679:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1777051240.215766:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f9fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452494592:0@lo:400:kworker.0 00000100:00100000:0.0:1777051240.215829:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051240.215931:0:8471:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452494592 00000100:00100000:0.0:1777051240.215941:0:8471:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452494592 00000100:00100000:3.0:1777051240.216026:0:21368:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452494208 00000100:00100000:3.0:1777051240.216036:0:21368:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452494208 00000100:00100000:0.0:1777051240.216045:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10154 00000100:00100000:0.0:1777051240.216067:0:8471:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3679:x1863365452494592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777051240.216067:0:84827:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99da44977100 x1863365452494720/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1777051240.216097:0:21368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13086 00000100:00100000:3.0:1777051240.216118:0:21368:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3680:x1863365452494464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777051240.216169:0:8471:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3679:x1863365452494592:12345-0@lo:400:kworker.0 Request processed in 107us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051240.216190:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10154 00000100:00100000:3.0:1777051240.216273:0:21368:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3680:x1863365452494464:12345-0@lo:400:kworker.0 Request processed in 156us (733us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051240.216279:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da44977480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3677:1863365452494848:0@lo:400:kworker.0 00000100:00100000:0.0:1777051240.216293:0:27885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111648 00000100:00100000:0.0:1777051240.216311:0:27885:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da44976d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:0+-99:3676:x1863365452494336:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1777051240.216311:0:21368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13086 00010000:00020000:0.0:1777051240.216341:0:27885:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1777051240.216353:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051240.216405:0:27885:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da44976d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:0+-99:3676:x1863365452494336:12345-0@lo:38:kworker.0 Request processed in 97us (712us total) trans 0 rc -19/-19 00000100:00100000:3.0:1777051240.216406:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f9fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3680:1863365452494464:0@lo:400:kworker.0 00000100:00100000:0.0:1777051240.216432:0:27885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111648 00000100:00100000:1.0:1777051240.216434:0:3677:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1777051240.216454:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da44974a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452494976:0@lo:400:kworker.0 00000100:00100000:0.0:1777051240.216475:0:27885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13087 00000100:00100000:0.0:1777051240.216495:0:27885:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da44977b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:lustre-MDT0001-lwp-OST0001_UUID+5:3677:x1863365452494848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777051240.216510:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051240.216574:0:27885:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da44977b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:lustre-MDT0001-lwp-OST0001_UUID+5:3677:x1863365452494848:12345-0@lo:400:kworker.0 Request processed in 84us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051240.216587:0:27885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13087 00000100:00100000:1.0:1777051240.216595:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da44977480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3677:1863365452494848:0@lo:400:kworker.0 00000100:00100000:0.0:1777051240.216632:0:8470:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452494976 00000100:00100000:0.0:1777051240.216642:0:8470:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452494976 00000100:00100000:0.0:1777051240.216720:0:8470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10155 00000100:00100000:3.0:1777051240.216732:0:6580:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452494720 00000100:00100000:1.0:1777051240.216736:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f9fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452494592:0@lo:400:kworker.0 00000100:00100000:0.0:1777051240.216741:0:8470:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da44977800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3677:x1863365452494976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051240.216742:0:6580:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452494720 00000100:00100000:3.0:1777051240.216791:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111649 00000100:00100000:3.0:1777051240.216802:0:6580:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f97c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3676:x1863365452494720:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1777051240.216827:0:6580:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1777051240.216838:0:8470:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da44977800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3677:x1863365452494976:12345-0@lo:400:kworker.0 Request processed in 101us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051240.216854:0:8470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10155 00000100:00100000:3.0:1777051240.216893:0:6580:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f97c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3676:x1863365452494720:12345-0@lo:38:kworker.0 Request processed in 90us (226us total) trans 0 rc -19/-19 00000100:00100000:3.0:1777051240.216902:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111649 00000100:00100000:0.0:1777051240.216950:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da44974a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452494976:0@lo:400:kworker.0 00000100:00100000:3.0:1777051240.355476:0:21368:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425845888 00000100:00100000:3.0:1777051240.355495:0:21368:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425845888 00000100:00100000:0.0:1777051240.355693:0:8492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425846528 00000100:00100000:0.0:1777051240.355703:0:8492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425846528 00000100:00100000:0.0:1777051240.356466:0:8492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425846016 00000100:00100000:0.0:1777051240.356476:0:8492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425846016 00000100:00100000:0.0:1777051240.356558:0:8492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13089 00000100:00100000:0.0:1777051240.356579:0:8492:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f518a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+6:2437:x1863365425846016:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:0.0:1777051240.356663:0:8492:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f518a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+6:2437:x1863365425846016:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 85us (1036us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051240.357010:0:8492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13089 00000100:00100000:0.0:1777051240.357072:0:8492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111651 00000100:00100000:0.0:1777051240.357086:0:8492:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f168700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2435:x1863365425846400:12345-192.168.201.46@tcp:38:kworker.0 00010000:00020000:0.0:1777051240.357119:0:8492:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.201.46@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1777051240.357480:0:8492:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f168700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2435:x1863365425846400:12345-192.168.201.46@tcp:38:kworker.0 Request processed in 388us (1921us total) trans 0 rc -19/-19 00000100:00100000:0.0:1777051240.357497:0:8492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111651 00000100:00100000:0.0:1777051240.357564:0:27884:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425846784 00000100:00100000:0.0:1777051240.357573:0:27884:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425846784 00000100:00100000:0.0:1777051240.357652:0:27884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10157 00000100:00100000:0.0:1777051240.357683:0:27884:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f519180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+47:2436:x1863365425846784:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:3.0:1777051240.357743:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051240.357774:0:27884:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f519180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+47:2436:x1863365425846784:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 99us (2088us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051240.357793:0:8468:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425846272 00000100:00100000:0.0:1777051240.357794:0:27884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10157 00000100:00100000:1.0:1777051240.357804:0:8468:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425846272 00000100:00100000:1.0:1777051240.357889:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10158 00000100:00100000:1.0:1777051240.357910:0:8468:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da444a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+48:2437:x1863365425846272:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:1.0:1777051240.358001:0:8468:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da444a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+48:2437:x1863365425846272:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 70us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051240.358018:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10158 00000100:00100000:3.0:1777051240.358478:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051240.358537:0:8628:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425846656 00000100:00100000:1.0:1777051240.358547:0:8628:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425846656 00000100:00100000:1.0:1777051240.358652:0:8628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10159 00000100:00100000:1.0:1777051240.358668:0:8628:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da444a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+50:2437:x1863365425846656:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:1.0:1777051240.359092:0:8628:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da444a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+50:2437:x1863365425846656:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 426us (970us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051240.359107:0:8628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10159 00000100:00080000:1.0:1777051240.359140:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1777051240.534547:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777051241.558545:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051242.582544:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:0.0:1777051242.781266:0:101416:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:0.0:1777051242.785865:0:101416:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:0.0:1777051242.793679:0:101416:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:0.0:1777051242.795761:0:101416:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:0.0:1777051242.798053:0:101416:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:0.0:1777051242.798629:0:101416:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:0.0:1777051242.799682:0:101416:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:0.0:1777051242.800303:0:101416:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:0.0:1777051242.801516:0:101416:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:0.0:1777051242.802903:0:101416:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:0.0:1777051242.804084:0:101416:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:0.0:1777051242.804884:0:101416:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:0.0:1777051242.805431:0:101416:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:0.0:1777051242.806375:0:101416:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:0.0:1777051242.811423:0:101416:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:0.0:1777051242.813079:0:101416:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:0.0:1777051242.814417:0:101416:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:0.0:1777051242.814996:0:101416:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:0.0:1777051242.816087:0:101416:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:0.0:1777051242.818356:0:101416:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:0.0:1777051242.820987:0:101416:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:0.0:1777051242.825277:0:101416:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:0.0:1777051242.825986:0:101416:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:0.0:1777051242.826894:0:101416:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:0.0:1777051242.827607:0:101416:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:0.0:1777051242.829072:0:101416:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:1.0:1777051242.830321:0:101416:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:1.0:1777051242.832099:0:101416:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:1.0:1777051242.836432:0:101416:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:1.0:1777051242.838191:0:101416:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:1.0:1777051242.839467:0:101416:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:1.0:1777051242.841496:0:101416:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:1.0:1777051242.842967:0:101416:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:1.0:1777051242.843523:0:101416:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:1.0:1777051242.845451:0:101416:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:1.0:1777051242.846283:0:101416:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:1.0:1777051242.848176:0:101416:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:1.0:1777051242.850750:0:101416:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:1.0:1777051242.851358:0:101416:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:1.0:1777051242.852135:0:101416:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:1.0:1777051242.852862:0:101416:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:1.0:1777051242.853445:0:101416:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:1.0:1777051242.854019:0:101416:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:1.0:1777051242.856491:0:101416:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:1.0:1777051242.857983:0:101416:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:1.0:1777051242.859099:0:101416:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:1.0:1777051242.862674:0:101416:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:1.0:1777051242.875465:0:101416:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:1.0:1777051242.877926:0:101416:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:1.0:1777051242.878834:0:101416:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:1.0:1777051242.880088:0:101416:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:1.0:1777051242.880696:0:101416:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:1.0:1777051242.881776:0:101416:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:01000000:1.0:1777051242.884619:0:101416:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1777051242.885342:0:101416:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1777051242.885355:0:101416:0:(osd_handler.c:8912:osd_obd_connect()) connect #0 00000020:00000080:1.0:1777051242.885372:0:101416:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x85f51a6b96714589 00000020:01000004:1.0:1777051242.885380:0:101416:0:(tgt_mount.c:2538:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:1.0:1777051242.885398:0:101416:0:(tgt_mount.c:217:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1777051242.885407:0:101416:0:(tgt_mount.c:99:server_register_mount()) register mount ffff99da44f8b000 from MGS 00000020:01000004:1.0:1777051242.885413:0:101416:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1777051242.885429:0:101416:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff99d94bef99c0) 00000020:00000080:1.0:1777051242.885450:0:101416:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:1.0:1777051242.885537:0:101416:0:(tgt_mount.c:151:server_get_mount()) get mount ffff99da44f8b000 from MGS, refs=2 00080000:01000000:1.0:1777051242.885544:0:101416:0:(osd_handler.c:8912:osd_obd_connect()) connect #1 00000020:00000080:1.0:1777051242.885550:0:101416:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x85f51a6b96714597 00010000:00010000:1.0:1777051242.886027:0:101416:0:(ldlm_pool.c:924:ldlm_pool_init()) Lock pool ldlm-pool-MGS-3 is initialized 00000040:01000000:0.0:1777051242.899528:0:101416:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:0.0:1777051242.900828:0:101421:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 00000100:00100000:1.0:1777051242.904301:0:101416:0:(service.c:3441:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1777051242.904316:0:101416:0:(service.c:3500:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1777051242.905378:0:101416:0:(service.c:3441:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1777051242.905394:0:101416:0:(service.c:3500:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1777051242.907119:0:101416:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1777051242.907153:0:101416:0:(obd_mount.c:383:lustre_start_mgc()) New MGS with live MGC 00000020:01000004:1.0:1777051242.907156:0:101416:0:(obd_mount.c:394:lustre_start_mgc()) MGC192.168.201.146@tcp:Set MGC reconnect 2 10000000:01000000:1.0:1777051242.907162:0:101416:0:(mgc_request.c:1069:mgc_set_info_async()) InitRecov MGC192.168.201.146@tcp 2/d0:i0:r0:or0:FULL 00000100:00080000:1.0:1777051242.907172:0:101416:0:(import.c:65:import_set_state_nolock()) ffff99da48759800 MGS: changing import state from FULL to DISCONN 00000100:02020000:1.0:1777051242.907180:0:101416:0:(import.c:185:ptlrpc_set_import_discon()) MGC192.168.201.146@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:1.0:1777051242.926478:0:101416:0:(import.c:191:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.201.146@tcp not replayable, auto-deactivating 00000100:00080000:1.0:1777051242.926486:0:101416:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1777051242.926503:0:101416:0:(client.c:3579:ptlrpc_abort_inflight()) @@@ inflight req@ffff99da449c8380 x1863365452491136/t0(0) o400->MGC192.168.201.146@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1777051245 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1777051242.926537:0:101416:0:(client.c:3579:ptlrpc_abort_inflight()) @@@ inflight req@ffff99d95aecd180 x1863365452492544/t0(0) o400->MGC192.168.201.146@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1777051251 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1777051242.926555:0:101416:0:(client.c:3579:ptlrpc_abort_inflight()) @@@ inflight req@ffff99da5f9fe300 x1863365452493952/t0(0) o400->MGC192.168.201.146@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1777051256 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777051242.926585:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95aecd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3679:1863365452492544:0@lo:400:kworker.0 10000000:01000000:1.0:1777051242.926604:0:101416:0:(mgc_request.c:1166:mgc_import_event()) import event 0x808001 00000100:00100000:3.0:1777051242.926630:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da449c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3679:1863365452491136:0@lo:400:kworker.0 00000100:00100000:0.0:1777051242.927019:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f9fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3677:1863365452493952:0@lo:400:kworker.0 00000100:00080000:1.0:1777051242.927652:0:101416:0:(pinger.c:192:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1777051242.927658:0:101416:0:(mgc_request.c:1166:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1777051242.927664:0:101416:0:(import.c:321:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00100000:1.0:1777051242.930991:0:3676:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d942d22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3676:1863365452495104:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1777051242.931082:0:3676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051242.931625:0:101422:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452495104 00000100:00100000:0.0:1777051242.931930:0:101422:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452495104 00000100:00100000:0.0:1777051242.932108:0:101422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1777051242.932121:0:101422:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5fa2c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3676:x1863365452495104:12345-0@lo:250:mount.lustre.0 00010000:00080000:0.0:1777051242.932157:0:101422:0:(ldlm_lib.c:1431:target_handle_connect()) MGS: connection from f9351a01-5b0e-4470-97fd-58b9b4b312a2@0@lo t0 exp 0000000000000000 cur 7872 last 0 00000020:00000080:0.0:1777051242.932206:0:101422:0:(genops.c:1406:class_connect()) connect: client f9351a01-5b0e-4470-97fd-58b9b4b312a2, cookie 0x85f51a6b9671459e 00000100:00080000:0.0:1777051242.932435:0:101422:0:(import.c:65:import_set_state_nolock()) ffff99d950ad8800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1777051242.932529:0:101422:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5fa2c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9351a01-5b0e-4470-97fd-58b9b4b312a2+4:3676:x1863365452495104:12345-0@lo:250:mount.lustre.0 Request processed in 406us (1447us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051242.932544:0:101422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1777051242.933365:0:101416:0:(recover.c:349:ptlrpc_recover_import()) MGS: recovery finished FULL, rc = 0 00000020:01000004:1.0:1777051242.933382:0:101416:0:(tgt_mount.c:1762:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1777051242.933431:0:101416:0:(tgt_mount.c:278:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:1.0:1777051242.933439:0:101416:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.146@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1777051242.933565:0:101416:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.146@tcp ctxt 0 is initialized 00000020:01000004:1.0:1777051242.933614:0:101416:0:(tgt_mount.c:1387:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.201.146@tcp, index=0000, flags=0x20005 00000020:01000004:1.0:1777051242.933621:0:101416:0:(tgt_mount.c:1144:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1777051242.933624:0:101416:0:(tgt_mount.c:1145:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1777051242.933626:0:101416:0:(tgt_mount.c:1146:server_mti_print()) fs: lustre 00000020:01000004:1.0:1777051242.933629:0:101416:0:(tgt_mount.c:1147:server_mti_print()) uuid: 00000020:01000004:1.0:1777051242.933631:0:101416:0:(tgt_mount.c:1148:server_mti_print()) ver: 0 00000020:01000004:1.0:1777051242.933634:0:101416:0:(tgt_mount.c:1149:server_mti_print()) flags: 00000020:01000004:1.0:1777051242.933906:0:101416:0:(tgt_mount.c:1151:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1777051242.933909:0:101416:0:(tgt_mount.c:1155:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1777051242.933913:0:101416:0:(tgt_mount.c:1183:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1777051242.933915:0:101416:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1777051242.933921:0:101416:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:1.0:1777051242.933925:0:101416:0:(tgt_mount.c:1144:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1777051242.933928:0:101416:0:(tgt_mount.c:1145:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1777051242.933930:0:101416:0:(tgt_mount.c:1146:server_mti_print()) fs: lustre 00000020:01000004:1.0:1777051242.933961:0:101416:0:(tgt_mount.c:1147:server_mti_print()) uuid: 00000020:01000004:1.0:1777051242.933963:0:101416:0:(tgt_mount.c:1148:server_mti_print()) ver: 0 00000020:01000004:1.0:1777051242.933966:0:101416:0:(tgt_mount.c:1149:server_mti_print()) flags: 00000020:01000004:1.0:1777051242.933968:0:101416:0:(tgt_mount.c:1151:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1777051242.933970:0:101416:0:(tgt_mount.c:1155:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1777051242.933973:0:101416:0:(tgt_mount.c:1183:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1777051242.933975:0:101416:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1777051242.934001:0:101416:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1777051242.934025:0:101416:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da44977480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9351a01-5b0e-4470-97fd-58b9b4b312a2:101416:1863365452495232:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1777051242.934092:0:101416:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051242.934149:0:101416:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d956bda480 going to sleep for 11 seconds 00000100:00100000:1.0:1777051242.934430:0:101424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1777051242.934447:0:101424:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5fa2dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9351a01-5b0e-4470-97fd-58b9b4b312a2+4:101416:x1863365452495232:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1777051242.934497:0:101424:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1777051242.934502:0:101424:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1777051242.934508:0:101424:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 00000020:01000000:0.0:1777051242.934637:0:48457:0:(tgt_mount.c:1579:tgt_import_update()) NID #0: 192.168.201.146@tcp 10000000:01000000:0.0:1777051242.934658:0:48457:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-MDT0001 about 1 new NIDs 00000020:01000004:0.0:1777051242.934663:0:48457:0:(tgt_mount.c:1144:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:0.0:1777051242.934667:0:48457:0:(tgt_mount.c:1145:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1777051242.934670:0:48457:0:(tgt_mount.c:1146:server_mti_print()) fs: lustre 00000020:01000004:0.0:1777051242.934673:0:48457:0:(tgt_mount.c:1147:server_mti_print()) uuid: 00000020:01000004:0.0:1777051242.934677:0:48457:0:(tgt_mount.c:1148:server_mti_print()) ver: 0 00000020:01000004:0.0:1777051242.934680:0:48457:0:(tgt_mount.c:1149:server_mti_print()) flags: 00000020:01000004:0.0:1777051242.934682:0:48457:0:(tgt_mount.c:1151:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1777051242.934685:0:48457:0:(tgt_mount.c:1183:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1777051242.934689:0:48457:0:(tgt_mount.c:1189:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:1.0:1777051242.934799:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f9fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3679:1863365452495360:0@lo:253:kworker.0 00000100:00100000:1.0:1777051242.934862:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:0.0:1777051242.934912:0:48457:0:(tgt_mount.c:1590:tgt_import_update()) lustre-MDT0001: notify about 1 NIDs, rc = 0 10000000:01000000:0.0:1777051242.935069:0:48457:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0000 about 1 new NIDs 00000020:01000004:0.0:1777051242.935075:0:48457:0:(tgt_mount.c:1144:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:0.0:1777051242.935078:0:48457:0:(tgt_mount.c:1145:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1777051242.935080:0:48457:0:(tgt_mount.c:1146:server_mti_print()) fs: lustre 00000020:01000004:0.0:1777051242.935082:0:48457:0:(tgt_mount.c:1147:server_mti_print()) uuid: 00000020:01000004:0.0:1777051242.935084:0:48457:0:(tgt_mount.c:1148:server_mti_print()) ver: 0 00000020:01000004:0.0:1777051242.935087:0:48457:0:(tgt_mount.c:1149:server_mti_print()) flags: 00000020:01000004:0.0:1777051242.935089:0:48457:0:(tgt_mount.c:1153:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1777051242.935091:0:48457:0:(tgt_mount.c:1183:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1777051242.935093:0:48457:0:(tgt_mount.c:1189:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:1.0:1777051242.935184:0:3679:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000020:01000000:0.0:1777051242.935221:0:48457:0:(tgt_mount.c:1590:tgt_import_update()) lustre-OST0000: notify about 1 NIDs, rc = 0 10000000:01000000:0.0:1777051242.935236:0:48457:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0001 about 1 new NIDs 00000020:01000004:0.0:1777051242.935241:0:48457:0:(tgt_mount.c:1144:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:0.0:1777051242.935245:0:48457:0:(tgt_mount.c:1145:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1777051242.935248:0:48457:0:(tgt_mount.c:1146:server_mti_print()) fs: lustre 00000020:01000004:0.0:1777051242.935250:0:48457:0:(tgt_mount.c:1147:server_mti_print()) uuid: 00000020:01000004:0.0:1777051242.935252:0:48457:0:(tgt_mount.c:1148:server_mti_print()) ver: 0 00000020:01000004:0.0:1777051242.935254:0:48457:0:(tgt_mount.c:1149:server_mti_print()) flags: 00000020:01000004:0.0:1777051242.935256:0:48457:0:(tgt_mount.c:1153:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1777051242.935258:0:48457:0:(tgt_mount.c:1183:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1777051242.935260:0:48457:0:(tgt_mount.c:1189:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:0.0:1777051242.935363:0:48457:0:(tgt_mount.c:1590:tgt_import_update()) lustre-OST0001: notify about 1 NIDs, rc = 0 00000100:00100000:0.0:1777051242.935406:0:101422:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452495360 00000100:00100000:0.0:1777051242.935416:0:101422:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452495360 00000100:00100000:0.0:1777051242.935470:0:101422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1777051242.935490:0:101422:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5fa2e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9351a01-5b0e-4470-97fd-58b9b4b312a2+5:3679:x1863365452495360:12345-0@lo:253:kworker.0 20000000:01000000:0.0:1777051242.935515:0:101422:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 00000100:00100000:1.0:1777051242.935718:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f9fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3679:1863365452495488:0@lo:253:kworker.0 00000100:00100000:1.0:1777051242.935784:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051242.936171:0:101425:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452495616 00000100:00100000:3.0:1777051242.936181:0:101425:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452495616 00000100:00100000:3.0:1777051242.936270:0:101425:0:(service.c:3441:ptlrpc_start_thread()) mgs[-1] started 3 min 3 max 32 00000100:00100000:3.0:1777051242.936285:0:101425:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452495488 00000100:00100000:3.0:1777051242.936291:0:101425:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452495488 20000000:01000000:0.0:1777051242.938220:0:101424:0:(mgs_nids.c:664:mgs_nidtbl_init_fs()) IR: current version is 22 20000000:01000000:0.0:1777051242.942645:0:101428:0:(mgs_llog.c:341:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:0.0:1777051242.942655:0:101428:0:(mgs_llog.c:341:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:0.0:1777051242.942662:0:101428:0:(mgs_llog.c:325:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:0.0:1777051242.942667:0:101428:0:(mgs_llog.c:325:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:0.0:1777051242.944689:0:101428:0:(llog.c:858:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64 count 63 20000000:01000000:1.0:1777051242.945366:0:101424:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1777051242.945405:0:101424:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1777051242.950534:0:101424:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5fa2dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9351a01-5b0e-4470-97fd-58b9b4b312a2+7:101416:x1863365452495232:12345-0@lo:253:mount.lustre.0 Request processed in 16085us (16436us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051242.950552:0:101424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1777051242.950636:0:101424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1777051242.950658:0:101424:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942f33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9351a01-5b0e-4470-97fd-58b9b4b312a2+6:3679:x1863365452495488:12345-0@lo:253:kworker.0 20000000:01000000:3.0:1777051242.950658:0:101427:0:(mgs_nids.c:813:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1777051242.950675:0:101427:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1777051242.950766:0:101424:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1777051242.950788:0:101424:0:(mgs_nids.c:461:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1777051242.951535:0:101427:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5fa2c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f9351a01-5b0e-4470-97fd-58b9b4b312a2+6:3677:x1863365452495616:12345-0@lo:253:kworker.0 Request processed in 14380us (16025us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051242.951551:0:101427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000020:01000004:0.0:1777051242.951666:0:3677:0:(tgt_mount.c:1144:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:0.0:1777051242.951672:0:3677:0:(tgt_mount.c:1145:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1777051242.951675:0:3677:0:(tgt_mount.c:1146:server_mti_print()) fs: lustre 00000020:01000004:0.0:1777051242.951678:0:3677:0:(tgt_mount.c:1147:server_mti_print()) uuid: 00000020:01000004:0.0:1777051242.951681:0:3677:0:(tgt_mount.c:1148:server_mti_print()) ver: 0 00000020:01000004:0.0:1777051242.951686:0:3677:0:(tgt_mount.c:1149:server_mti_print()) flags: 00000020:01000004:0.0:1777051242.951689:0:3677:0:(tgt_mount.c:1153:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1777051242.951692:0:3677:0:(tgt_mount.c:1183:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1777051242.951695:0:3677:0:(tgt_mount.c:1189:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:0.0:1777051242.951703:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f9fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3677:1863365452495616:0@lo:253:kworker.0 00000100:00100000:3.0:1777051242.951919:0:101425:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452495744 00000100:00100000:3.0:1777051242.951929:0:101425:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452495744 00000100:00100000:3.0:1777051242.952024:0:101425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1777051242.952056:0:101425:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942f30050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9351a01-5b0e-4470-97fd-58b9b4b312a2+6:101416:x1863365452495744:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1777051242.952072:0:101425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777051242.952093:0:101425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d943ebae00/0x85f51a6b967145b3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x85f51a6b967145ac expref: -99 pid: 101425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051242.952122:0:101425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d943ebae00/0x85f51a6b967145b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x85f51a6b967145ac expref: 7 pid: 101425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051242.952140:0:101425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d943ebae00/0x85f51a6b967145b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b967145ac expref: 7 pid: 101425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051242.952152:0:101425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d943ebae00, rc 0) 00000100:00100000:3.0:1777051242.952247:0:101425:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942f30050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9351a01-5b0e-4470-97fd-58b9b4b312a2+7:101416:x1863365452495744:12345-0@lo:101:mount.lustre.0 Request processed in 194us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051242.952263:0:101425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1777051242.952391:0:101416:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d942d22300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9351a01-5b0e-4470-97fd-58b9b4b312a2:101416:1863365452495744:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1777051242.952416:0:101416:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.146@tcp lock: ffff99d95595a200/0x85f51a6b967145ac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b967145b3 expref: -99 pid: 101416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051242.952434:0:101416:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.146@tcp lock: ffff99d95595a200/0x85f51a6b967145ac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x85f51a6b967145b3 expref: -99 pid: 101416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1777051242.952457:0:101416:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.201.146@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1777051242.952484:0:101416:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff99d95595a200/0x85f51a6b967145ac lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b967145b3 expref: -99 pid: 101416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051242.952500:0:101416:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.146@tcp lock: ffff99d95595a200/0x85f51a6b967145ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b967145b3 expref: -99 pid: 101416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1777051242.952514:0:101416:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1777051242.952523:0:101416:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1777051242.952531:0:101416:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff99da44f8b000 10000000:01000000:1.0:1777051242.952537:0:101416:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1777051242.952542:0:101416:0:(mgc_request.c:1799:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1777051242.952546:0:101416:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1777051242.952576:0:101416:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.146@tcp lock: ffff99d955a8ea00/0x85f51a6b967145ba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 101416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051242.952589:0:101416:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.146@tcp lock: ffff99d955a8ea00/0x85f51a6b967145ba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 101416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051242.952612:0:101416:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.146@tcp lock: ffff99d955a8ea00/0x85f51a6b967145ba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 101416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051242.952975:0:101416:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da44976300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9351a01-5b0e-4470-97fd-58b9b4b312a2:101416:1863365452495872:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1777051242.953033:0:101416:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051242.953088:0:101416:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d95dc37900 going to sleep for 11 seconds 00000100:00100000:3.0:1777051242.953206:0:101427:0:(service.c:3441:ptlrpc_start_thread()) mgs[-1] started 4 min 3 max 32 00000100:00100000:3.0:1777051242.953220:0:101427:0:(service.c:3500:ptlrpc_start_thread()) starting thread 'll_mgs_0004' 00000100:00100000:1.0:1777051242.953830:0:101416:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da44976300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9351a01-5b0e-4470-97fd-58b9b4b312a2:101416:1863365452495872:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1777051242.953852:0:101416:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.146@tcp lock: ffff99d955a8ea00/0x85f51a6b967145ba lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b967145c1 expref: -99 pid: 101416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051242.953866:0:101416:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.146@tcp lock: ffff99d955a8ea00/0x85f51a6b967145ba lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x85f51a6b967145c1 expref: -99 pid: 101416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051242.953974:0:101416:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da44976300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9351a01-5b0e-4470-97fd-58b9b4b312a2:101416:1863365452496000:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1777051242.954027:0:101416:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051242.954362:0:101416:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d95dc37900 going to sleep for 11 seconds 00000100:00100000:1.0:1777051242.955316:0:101416:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da44976300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9351a01-5b0e-4470-97fd-58b9b4b312a2:101416:1863365452496000:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1777051242.955512:0:101416:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da44976300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9351a01-5b0e-4470-97fd-58b9b4b312a2:101416:1863365452496128:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1777051242.955585:0:101416:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051242.955972:0:101416:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d95dc37900 going to sleep for 11 seconds 00000100:00100000:0.0:1777051242.956049:0:101429:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452496128 00000100:00100000:0.0:1777051242.956058:0:101429:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452496128 00000100:00100000:0.0:1777051242.957114:0:101429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1777051242.957130:0:101429:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942f32450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f9351a01-5b0e-4470-97fd-58b9b4b312a2+9:101416:x1863365452496128:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1777051242.959919:0:101429:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942f32450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f9351a01-5b0e-4470-97fd-58b9b4b312a2+9:101416:x1863365452496128:12345-0@lo:503:mount.lustre.0 Request processed in 2787us (4329us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051242.959964:0:101429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1777051242.960016:0:101416:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da44976300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9351a01-5b0e-4470-97fd-58b9b4b312a2:101416:1863365452496128:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1777051242.960992:0:101430:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da44976300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f9351a01-5b0e-4470-97fd-58b9b4b312a2:101430:1863365452496256:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1777051242.961067:0:101430:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051242.961429:0:101425:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452496256 00000100:00100000:3.0:1777051242.961440:0:101425:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452496256 00000100:00100000:3.0:1777051242.961499:0:101425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1777051242.961513:0:101425:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942f30450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9351a01-5b0e-4470-97fd-58b9b4b312a2+9:101430:x1863365452496256:12345-0@lo:502:llog_process_th.0 20000000:01000000:0.0:1777051242.962492:0:101422:0:(mgs_nids.c:461:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1777051242.962504:0:101430:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d95dc379c0 going to sleep for 11 seconds 00000020:01000004:3.0:1777051242.963484:0:3679:0:(tgt_mount.c:1144:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:3.0:1777051242.963488:0:3679:0:(tgt_mount.c:1145:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1777051242.963491:0:3679:0:(tgt_mount.c:1146:server_mti_print()) fs: lustre 00000020:01000004:3.0:1777051242.963493:0:3679:0:(tgt_mount.c:1147:server_mti_print()) uuid: 00000020:01000004:3.0:1777051242.963496:0:3679:0:(tgt_mount.c:1148:server_mti_print()) ver: 0 00000020:01000004:3.0:1777051242.963499:0:3679:0:(tgt_mount.c:1149:server_mti_print()) flags: 00000020:01000004:3.0:1777051242.963501:0:3679:0:(tgt_mount.c:1153:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1777051242.963504:0:3679:0:(tgt_mount.c:1183:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1777051242.963507:0:3679:0:(tgt_mount.c:1189:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:3.0:1777051242.963512:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f9fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3679:1863365452495488:0@lo:253:kworker.0 00000100:00100000:1.0:1777051242.966517:0:101430:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da44976300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f9351a01-5b0e-4470-97fd-58b9b4b312a2:101430:1863365452496256:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1777051242.966578:0:101430:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1777051242.966597:0:101430:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1777051242.966602:0:101430:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1777051242.966611:0:101430:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1777051242.966617:0:101430:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1777051242.966642:0:101430:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff99d94befcd40) 00000020:00000080:1.0:1777051242.966674:0:101430:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1777051242.966682:0:101430:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1777051242.966799:0:101430:0:(osd_handler.c:8912:osd_obd_connect()) connect #2 00000020:00000080:1.0:1777051242.966809:0:101430:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x85f51a6b967145d6 00000020:00000080:1.0:1777051242.967186:0:101430:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1777051242.967195:0:101430:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1777051242.967276:0:101430:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1777051242.967280:0:101430:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1777051242.967288:0:101430:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1777051242.967296:0:101430:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1777051242.967300:0:101430:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1777051242.967308:0:101430:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1777051242.967322:0:101430:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff99d94bef8000) 00000020:00000080:1.0:1777051242.967347:0:101430:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1777051242.967355:0:101430:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1777051242.967359:0:101430:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1777051242.967364:0:101430:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1777051242.967374:0:101430:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1777051242.967458:0:101430:0:(tgt_mount.c:151:server_get_mount()) get mount ffff99da44f8b000 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1777051242.967477:0:101430:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff99d94befb380) 00000020:00000080:1.0:1777051242.967495:0:101430:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1777051242.967674:0:101430:0:(lod_dev.c:2288:lod_obd_connect()) connect #0 00000020:00000080:1.0:1777051242.967685:0:101430:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x85f51a6b967145eb 00000020:00000080:1.0:1777051242.968265:0:101430:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1777051242.968277:0:101430:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1777051242.968288:0:101430:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x85f51a6b967145f2 00080000:01000000:1.0:1777051242.968297:0:101430:0:(osd_handler.c:8912:osd_obd_connect()) connect #3 00000020:00000080:1.0:1777051242.968302:0:101430:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x85f51a6b967145f9 20000000:01000000:0.0:1777051242.973125:0:101422:0:(mgs_nids.c:813:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1777051242.973348:0:101422:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:3.0:1777051242.975389:0:101422:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5fa2e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9351a01-5b0e-4470-97fd-58b9b4b312a2+7:3679:x1863365452495360:12345-0@lo:253:kworker.0 Request processed in 39901us (40523us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051242.975408:0:101422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1777051243.071908:0:101430:0:(ldlm_pool.c:924:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-4 is initialized 00000001:00080000:0.0:1777051243.072706:0:101430:0:(tgt_lastrcvd.c:1758:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0001-mdtlov_UUID idx: 0 lr: 12884902301 srv lr: 21474836480 lx: 0 gen 1 00000001:00080000:0.0:1777051243.072792:0:101430:0:(tgt_lastrcvd.c:1758:tgt_clients_data_init()) RCVRNG CLIENT uuid: 2dd4696c-edce-4cd1-86d2-dbd2ff957fa1 idx: 1 lr: 12884904249 srv lr: 21474836480 lx: 0 gen 9 00000001:00080000:0.0:1777051243.072833:0:101430:0:(tgt_lastrcvd.c:1758:tgt_clients_data_init()) RCVRNG CLIENT uuid: c11b6966-0775-44d2-bdc6-c74c26eb2226 idx: 3 lr: 12884904250 srv lr: 21474836480 lx: 0 gen 10 00000001:00000004:0.0:1777051243.072873:0:101430:0:(tgt_lastrcvd.c:732:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 6, last_transno is 21474836480 00000001:00080000:0.0:1777051243.073463:0:101430:0:(tgt_lastrcvd.c:223:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000001:00080000:0.0:1777051243.073560:0:101430:0:(tgt_lastrcvd.c:2296:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff99d9591dca80: xid 1863365425794688, transno 12884904250, client gen 10, slot idx 0 00000001:00080000:0.0:1777051243.073578:0:101430:0:(tgt_lastrcvd.c:2296:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff99d95ba62a80: xid 1863365452132608, transno 12884902301, client gen 1, slot idx 1 00000001:00080000:0.0:1777051243.073588:0:101430:0:(tgt_lastrcvd.c:2296:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff99d95ba62600: xid 1863365425793024, transno 12884904249, client gen 9, slot idx 2 00000001:00080000:0.0:1777051243.073598:0:101430:0:(tgt_lastrcvd.c:2296:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff99d95ba62f00: xid 1863365425791872, transno 12884904246, client gen 9, slot idx 3 00000001:00080000:0.0:1777051243.073607:0:101430:0:(tgt_lastrcvd.c:2296:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff99d95ba62b40: xid 1863365425791104, transno 12884904237, client gen 10, slot idx 4 00000001:00080000:0.0:1777051243.073620:0:101430:0:(tgt_lastrcvd.c:2296:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff99d95ba62900: xid 1863365425792128, transno 12884904242, client gen 10, slot idx 5 00000001:00080000:0.0:1777051243.073629:0:101430:0:(tgt_lastrcvd.c:2296:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff99d95ba62240: xid 1863365425539328, transno 12884903901, client gen 10, slot idx 6 00000001:00080000:0.0:1777051243.073639:0:101430:0:(tgt_lastrcvd.c:2296:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff99d95ba62cc0: xid 1863365425435392, transno 12884903784, client gen 10, slot idx 7 00000001:00080000:0.0:1777051243.073649:0:101430:0:(tgt_lastrcvd.c:2296:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff99d95ba62c00: xid 1863365425436032, transno 12884903788, client gen 10, slot idx 8 00000001:00080000:0.0:1777051243.073658:0:101430:0:(tgt_lastrcvd.c:2296:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff99d95ba62480: xid 1863365425435136, transno 12884903781, client gen 10, slot idx 9 00000001:00080000:0.0:1777051243.073667:0:101430:0:(tgt_lastrcvd.c:2296:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff99d95ba62000: xid 1863365425430144, transno 12884903754, client gen 10, slot idx 10 00000001:00080000:0.0:1777051243.073677:0:101430:0:(tgt_lastrcvd.c:2296:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff99d95ba62780: xid 1863365425155200, transno 12884903075, client gen 9, slot idx 11 00000001:00080000:0.0:1777051243.073686:0:101430:0:(tgt_lastrcvd.c:2296:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff99d95ba62180: xid 1863365425418240, transno 12884903704, client gen 10, slot idx 12 00000020:00000080:0.0:1777051243.074516:0:101430:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff99d941ce0000) 00000020:00000080:0.0:1777051243.074546:0:101430:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:0.0:1777051243.074657:0:101430:0:(osd_handler.c:8912:osd_obd_connect()) connect #4 00000020:00000080:0.0:1777051243.074668:0:101430:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x85f51a6b96714623 00000020:00000080:1.0:1777051243.079137:0:101430:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1777051243.092475:0:101430:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x85f51a6b9671462a 00000020:00000080:1.0:1777051243.093607:0:101430:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1777051243.093626:0:101430:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1777051243.093637:0:101430:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1777051243.093641:0:101430:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1777051243.093649:0:101430:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1777051243.093664:0:101430:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #9 00000020:01000000:1.0:1777051243.093668:0:101430:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1777051243.093672:0:101430:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1777051243.093675:0:101430:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1777051243.093681:0:101430:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1777051243.093684:0:101430:0:(obd_config.c:1561:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:1.0:1777051243.093691:0:101430:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1777051243.093700:0:101430:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1777051243.093703:0:101430:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1777051243.093712:0:101430:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1777051243.093783:0:101430:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1777051243.093822:0:101430:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1777051243.093830:0:101430:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1777051243.093833:0:101430:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1777051243.093840:0:101430:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1777051243.093846:0:101430:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1777051243.093850:0:101430:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:1.0:1777051243.093856:0:101430:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1777051243.093866:0:101430:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.201.146@tcp to nid 0x20000c0a8c992 (192.168.201.146@tcp) 00000020:00000080:1.0:1777051243.093907:0:101430:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1777051243.093963:0:101430:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff99d941e68000) 00000020:00000080:1.0:1777051243.094003:0:101430:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:1.0:1777051243.094016:0:101430:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1777051243.094115:0:101430:0:(osp_dev.c:1199:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:1.0:1777051243.094125:0:101430:0:(osd_handler.c:8912:osd_obd_connect()) connect #5 00000020:00000080:1.0:1777051243.094144:0:101430:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x85f51a6b96714638 00010000:00080000:1.0:1777051243.094214:0:101430:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99da71c60000@lustre-MDT0001-osp-MDT0000: add connection 192.168.201.146@tcp at head 00010000:00010000:1.0:1777051243.105427:0:101430:0:(ldlm_pool.c:924:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-9 is initialized 00000020:00000080:0.0:1777051243.108380:0:101430:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1777051243.108404:0:101430:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1777051243.108466:0:101430:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:0.0:1777051243.108497:0:101430:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x85f51a6b9671463f 00000100:00080000:0.0:1777051243.108512:0:101430:0:(import.c:509:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1777051243.108523:0:101430:0:(import.c:623:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff99da71c60000 using connection 192.168.201.146@tcp/0@lo 00000100:00100000:0.0:1777051243.108575:0:101430:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99da5f9fea00 x1863365452496384/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1777051243.108623:0:101430:0:(pinger.c:371:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1777051243.108729:0:48457:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1777051243.108749:0:48457:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1777051243.108757:0:48457:0:(import.c:65:import_set_state_nolock()) ffff99da7dbeb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1777051243.108768:0:48457:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 7869 00000100:00080000:1.0:1777051243.108775:0:48457:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1777051243.108784:0:48457:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff99da7dbeb000 using connection 192.168.201.146@tcp/0@lo 00000100:00100000:1.0:1777051243.108824:0:48457:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99da44976300 x1863365452496512/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1777051243.108884:0:48457:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1777051243.108897:0:48457:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1777051243.108902:0:48457:0:(import.c:65:import_set_state_nolock()) ffff99da7fa93000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000020:01000000:0.0:1777051243.108906:0:101430:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000100:00080000:1.0:1777051243.108913:0:48457:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 7869 00000020:00000080:0.0:1777051243.108920:0:101430:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000100:00080000:1.0:1777051243.108920:0:48457:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000020:00000080:0.0:1777051243.108928:0:101430:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:0.0:1777051243.108965:0:101430:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000100:00080000:1.0:1777051243.108967:0:48457:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff99da7fa93000 using connection 192.168.201.146@tcp/0@lo 00000020:01000000:0.0:1777051243.108973:0:101430:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #20 00000020:01000000:0.0:1777051243.108979:0:101430:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1777051243.108983:0:101430:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1777051243.108986:0:101430:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1777051243.108994:0:101430:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1777051243.108998:0:101430:0:(obd_config.c:1561:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000100:00100000:1.0:1777051243.109005:0:48457:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99da44977480 x1863365452496640/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000020:01000000:0.0:1777051243.109008:0:101430:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1777051243.109022:0:101430:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1777051243.109038:0:101430:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1777051243.109045:0:101430:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000100:00080000:1.0:1777051243.109051:0:48457:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000080:0.0:1777051243.109053:0:101430:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1777051243.109065:0:101430:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.201.146@tcp to nid 0x20000c0a8c992 (192.168.201.146@tcp) 00000100:00080000:1.0:1777051243.109066:0:48457:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1777051243.109072:0:48457:0:(import.c:65:import_set_state_nolock()) ffff99d94183b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1777051243.109082:0:48457:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 7869 00000100:00080000:1.0:1777051243.109088:0:48457:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1777051243.109098:0:48457:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff99d94183b000 using connection 192.168.201.146@tcp/0@lo 00000020:01000000:0.0:1777051243.109100:0:101430:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1777051243.109408:0:101430:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1777051243.109431:0:101430:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff99d941ce3380) 00000020:00000080:0.0:1777051243.109461:0:101430:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osp with refcount 2 00000020:00000080:0.0:1777051243.109481:0:101430:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1777051243.109597:0:101430:0:(osp_dev.c:1199:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1777051243.109610:0:101430:0:(osd_handler.c:8912:osd_obd_connect()) connect #6 00000020:00000080:0.0:1777051243.109626:0:101430:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x85f51a6b9671464d 00010000:00080000:0.0:1777051243.109690:0:101430:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99da7b35c800@lustre-OST0000-osc-MDT0000: add connection 192.168.201.146@tcp at head 00000100:00100000:1.0:1777051243.110082:0:48457:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99da44977100 x1863365452496768/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1777051243.110246:0:48457:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1777051243.110254:0:48457:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1777051243.110258:0:48457:0:(import.c:65:import_set_state_nolock()) ffff99da5f282000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1777051243.110265:0:48457:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 7869 00000100:00080000:1.0:1777051243.110270:0:48457:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1777051243.110277:0:48457:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff99da5f282000 using connection 192.168.201.146@tcp/0@lo 00000100:00100000:1.0:1777051243.110307:0:48457:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99da44976680 x1863365452497152/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1777051243.110404:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da44974a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3678:1863365452496896:0@lo:400:kworker.0 00000100:00100000:1.0:1777051243.110475:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051243.110533:0:3678:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:0.0:1777051243.110536:0:101430:0:(ldlm_pool.c:924:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-10 is initialized 00000100:00100000:1.0:1777051243.110553:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da44975880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452497408:0@lo:400:kworker.0 00000100:00100000:1.0:1777051243.110973:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051243.111070:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da44975180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452497024:0@lo:400:kworker.0 00000100:00100000:1.0:1777051243.111135:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051243.111184:0:3679:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1777051243.111240:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da44976a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3679:1863365452497280:0@lo:400:kworker.0 00000100:00100000:1.0:1777051243.111299:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051243.111323:0:6580:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452496640 00000100:00100000:0.0:1777051243.111334:0:6580:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452496640 00000100:00100000:1.0:1777051243.111369:0:13320:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452497408 00000100:00100000:1.0:1777051243.111380:0:13320:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452497408 00000100:00100000:0.0:1777051243.111392:0:6580:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452496896 00000100:00100000:0.0:1777051243.111401:0:6580:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452496896 00000100:00100000:1.0:1777051243.111482:0:13320:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452497024 00000100:00100000:0.0:1777051243.111487:0:6580:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452497280 00000100:00100000:1.0:1777051243.111491:0:13320:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452497024 00000100:00100000:0.0:1777051243.111498:0:6580:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452497280 00000100:00100000:1.0:1777051243.111562:0:13320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10160 00000100:00100000:0.0:1777051243.111578:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13091 00000100:00100000:1.0:1777051243.111587:0:13320:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d9533bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3678:x1863365452497408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777051243.111604:0:6580:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942a0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3679:x1863365452497280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777051243.112344:0:13320:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d9533bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3678:x1863365452497408:12345-0@lo:400:kworker.0 Request processed in 764us (1661us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051243.112375:0:13320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10160 00000100:00100000:1.0:1777051243.112420:0:13320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10161 00000100:00100000:1.0:1777051243.112440:0:13320:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942a0c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3679:x1863365452497024:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1777051243.112480:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1777051243.112491:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1777051243.112499:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1777051243.112532:0:13320:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942a0c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3679:x1863365452497024:12345-0@lo:400:kworker.0 Request processed in 97us (1395us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051243.112546:0:13320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10161 00000100:00100000:1.0:1777051243.112627:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da44975880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452497408:0@lo:400:kworker.0 00000100:00100000:0.0:1777051243.112644:0:6580:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942a0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3679:x1863365452497280:12345-0@lo:400:kworker.0 Request processed in 1047us (1345us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051243.112662:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da44974a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3678:1863365452496896:0@lo:400:kworker.0 00000100:00100000:0.0:1777051243.112676:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13091 00000100:00100000:1.0:1777051243.112752:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da44976a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3679:1863365452497280:0@lo:400:kworker.0 00000100:00100000:1.0:1777051243.112780:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da44975180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452497024:0@lo:400:kworker.0 00000100:00100000:1.0:1777051243.115063:0:10328:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452496768 00000100:00100000:0.0:1777051243.115069:0:6580:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452497152 00000100:00100000:1.0:1777051243.115076:0:10328:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452496768 00000100:00100000:0.0:1777051243.115082:0:6580:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452497152 00000100:00100000:1.0:1777051243.115147:0:10328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111653 00000100:00100000:1.0:1777051243.115170:0:10328:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942d22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3676:x1863365452496768:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1777051243.115171:0:21368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111654 00000100:00100000:3.0:1777051243.115195:0:21368:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955504000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3676:x1863365452497152:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1777051243.115300:0:21368:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955504000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3676:x1863365452497152:12345-0@lo:38:kworker.0 Request processed in 105us (2498us total) trans 0 rc -11/-11 00000100:00100000:1.0:1777051243.115315:0:10328:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942d22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3676:x1863365452496768:12345-0@lo:38:kworker.0 Request processed in 145us (2622us total) trans 0 rc -11/-11 00000100:00100000:3.0:1777051243.115326:0:21368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111654 00000100:00100000:1.0:1777051243.115349:0:10328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111653 00000100:00100000:0.0:1777051243.115735:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955506300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3678:1863365452497536:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1777051243.115797:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051243.116366:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955506300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3678:1863365452497536:0@lo:41:osp-pre-1-0.0 00000040:01000000:0.0:1777051243.116839:0:101430:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1777051243.118775:0:101430:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1777051243.143962:0:101436:0:(llog.c:801:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:0.0:1777051243.143972:0:101436:0:(llog_cat.c:158:llog_cat_process_common()) processing log [0x1:0x23:0x0] at index 6 of catalog [0x1:0x2:0x0] 00000100:00100000:0.0:1777051243.146057:0:3676:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955505180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3676:1863365452497664:0@lo:8:llog_process_th.0 00000100:00100000:0.0:1777051243.146507:0:3676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051243.146916:0:24468:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452497664 00000100:00100000:0.0:1777051243.146955:0:24468:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452497664 00000100:00100000:0.0:1777051243.147012:0:24468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7940 00000100:00100000:0.0:1777051243.147024:0:24468:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:3676:x1863365452497664:12345-0@lo:8:llog_process_th.0 00010000:00080000:0.0:1777051243.147066:0:24468:0:(ldlm_lib.c:1431:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 7872 last 0 00000020:00000080:0.0:1777051243.147389:0:24468:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x85f51a6b96714669 00002000:00100000:0.0:1777051243.147414:0:24468:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff99d94119d000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113436 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1777051243.147425:0:24468:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1777051243.147430:0:24468:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1777051243.147527:0:24468:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1777051243.147563:0:24468:0:(import.c:65:import_set_state_nolock()) ffff99d94119c000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1777051243.147653:0:24468:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3676:x1863365452497664:12345-0@lo:8:llog_process_th.0 Request processed in 627us (1152us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051243.147664:0:24468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7940 00000100:00100000:0.0:1777051243.147721:0:3676:0:(client.c:3101:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1777051243.147735:0:3676:0:(import.c:1130:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1777051243.147747:0:3676:0:(import.c:958:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1777051243.147755:0:3676:0:(import.c:1211:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1777051243.147761:0:3676:0:(import.c:65:import_set_state_nolock()) ffff99da7b35c800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1777051243.147777:0:3676:0:(osp_dev.c:1643:osp_import_event()) got connected 00000100:00100000:0.0:1777051243.147788:0:3676:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955505180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3676:1863365452497664:0@lo:8:llog_process_th.0 00000004:00080000:0.0:1777051243.147831:0:101436:0:(osp_sync.c:1044:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1777051243.147920:0:101436:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 7872340721037ns, next at 0ns, rc = 0 00000100:00100000:3.0:1777051243.148399:0:3680:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1777051243.148417:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da444a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3680:1863365452497792:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1777051243.148523:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051243.148581:0:8472:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452497792 00000100:00100000:3.0:1777051243.148588:0:8472:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452497792 00000100:00100000:3.0:1777051243.148672:0:8472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5514 00000100:00100000:3.0:1777051243.148688:0:8472:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da444a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3680:x1863365452497792:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1777051243.149038:0:8472:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 440355008 pending 0 free 3862671360 avail 3631149056 00000100:00100000:3.0:1777051243.149398:0:8472:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da444a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3680:x1863365452497792:12345-0@lo:13:osp-pre-0-0.0 Request processed in 710us (869us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051243.149413:0:8472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5514 00000100:00100000:1.0:1777051243.149450:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da444a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3680:1863365452497792:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1777051243.149455:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:01000000:3.0:1777051243.151176:0:101430:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1777051243.151243:0:101430:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00080000:00080000:0.0:1777051243.151806:0:101436:0:(osd_handler.c:2852:osd_commit_async()) lustre-MDT0000: async commit OSD 00000040:00080000:3.0:1777051243.157458:0:101430:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1777051243.158178:0:101430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].6, 64 off8576 00000040:00080000:3.0:1777051243.158700:0:101430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x25:0x0].1, 64 off8256 00000040:00080000:3.0:1777051243.159518:0:101438:0:(llog.c:801:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:3.0:1777051243.159526:0:101438:0:(llog_cat.c:158:llog_cat_process_common()) processing log [0x1:0x25:0x0] at index 6 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1777051243.161445:0:101430:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1777051243.161465:0:101430:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1777051243.161529:0:101430:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1777051243.161564:0:101430:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x85f51a6b96714677 00000100:00080000:0.0:1777051243.161580:0:101430:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1777051243.161589:0:101430:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff99da58bfc800 using connection 192.168.201.146@tcp/0@lo 00000100:00100000:0.0:1777051243.161638:0:101430:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99da5f9fdc00 x1863365452497920/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1777051243.161692:0:101430:0:(pinger.c:371:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1777051243.161813:0:101430:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1777051243.161825:0:101430:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1777051243.161830:0:101430:0:(obd_config.c:1561:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1777051243.161839:0:101430:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1777051243.161849:0:101430:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1777051243.161853:0:101430:0:(obd_config.c:1561:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:0.0:1777051243.161862:0:101430:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1777051243.161866:0:101430:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1777051243.161871:0:101430:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1777051243.161878:0:101430:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1777051243.161883:0:101430:0:(obd_config.c:1561:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:0.0:1777051243.161887:0:101430:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1777051243.161893:0:101430:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1777051243.161897:0:101430:0:(obd_config.c:1561:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1777051243.161909:0:101430:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1777051243.161922:0:101430:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1777051243.161926:0:101430:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1777051243.161968:0:101430:0:(obd_config.c:1561:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000020:01000000:0.0:1777051243.161977:0:101430:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1777051243.161983:0:101430:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #44 00000020:01000000:0.0:1777051243.161988:0:101430:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1777051243.161990:0:101430:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000100:00100000:0.0:1777051243.162035:0:101430:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f9fd500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f9351a01-5b0e-4470-97fd-58b9b4b312a2:101430:1863365452498048:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1777051243.162089:0:8471:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452497920 00000100:00100000:3.0:1777051243.162102:0:8471:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452497920 00000100:00100000:0.0:1777051243.162148:0:101430:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051243.162188:0:101430:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d95875df00 going to sleep for 11 seconds 00000100:00100000:3.0:1777051243.162240:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7941 00000100:00100000:3.0:1777051243.162258:0:8471:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955506d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3676:x1863365452497920:12345-0@lo:8:llog_process_th.0 00000100:00100000:0.0:1777051243.162286:0:101429:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452498048 00000100:00100000:0.0:1777051243.162297:0:101429:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452498048 00010000:00080000:3.0:1777051243.162306:0:8471:0:(ldlm_lib.c:1431:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 7872 last 0 00000020:00000080:3.0:1777051243.162353:0:8471:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x85f51a6b9671467e 00000100:00100000:0.0:1777051243.162374:0:101429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00002000:00100000:3.0:1777051243.162376:0:8471:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff99d942e03800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113436 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1777051243.162387:0:8471:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:3.0:1777051243.162393:0:8471:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:0.0:1777051243.162401:0:101429:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942f31050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f9351a01-5b0e-4470-97fd-58b9b4b312a2+7:101430:x1863365452498048:12345-0@lo:502:llog_process_th.0 00002000:00080000:3.0:1777051243.162492:0:8471:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1777051243.162575:0:8471:0:(import.c:65:import_set_state_nolock()) ffff99d942e07000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1777051243.162664:0:8471:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955506d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3676:x1863365452497920:12345-0@lo:8:llog_process_th.0 Request processed in 408us (757us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051243.162681:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7941 00000100:00100000:0.0:1777051243.162746:0:3676:0:(client.c:3101:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1777051243.162761:0:3676:0:(import.c:1130:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1777051243.162770:0:3676:0:(import.c:958:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1777051243.162778:0:3676:0:(import.c:1211:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1777051243.162782:0:3676:0:(import.c:65:import_set_state_nolock()) ffff99da58bfc800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1777051243.162837:0:3676:0:(osp_dev.c:1643:osp_import_event()) got connected 00000100:00100000:0.0:1777051243.162848:0:3676:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f9fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3676:1863365452497920:0@lo:8:llog_process_th.0 00000100:00100000:0.0:1777051243.163088:0:101429:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942f31050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f9351a01-5b0e-4470-97fd-58b9b4b312a2+7:101430:x1863365452498048:12345-0@lo:502:llog_process_th.0 Request processed in 694us (938us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051243.163108:0:101429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1777051243.163269:0:101430:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f9fd500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f9351a01-5b0e-4470-97fd-58b9b4b312a2:101430:1863365452498048:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1777051243.163321:0:101430:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1777051243.163332:0:101430:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1777051243.163335:0:101430:0:(obd_config.c:1561:class_process_config()) marker 44 (0x6) lustre-MDT0000-m new lustre.test_11c 00000020:01000000:0.0:1777051243.163341:0:101430:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1777051243.163347:0:101430:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #47 00000020:01000000:0.0:1777051243.163350:0:101430:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1777051243.163353:0:101430:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1777051243.163357:0:101430:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1777051243.163364:0:101430:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1777051243.163367:0:101430:0:(obd_config.c:1561:class_process_config()) marker 47 (0x6) lustre-MDT0000-m add lustre.test_11c.lustre-OST0001_UUID 00000020:01000000:0.0:1777051243.163373:0:101430:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1777051243.163381:0:101430:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1777051243.163385:0:101430:0:(obd_config.c:1561:class_process_config()) marker 50 (0x1) lustre-MDT0000-m rem lustre.test_11c.lustre-OST0001_UUID 00000020:00000080:0.0:1777051243.163394:0:101430:0:(obd_config.c:1470:class_process_config()) processing cmd: ce022 00000020:01000000:0.0:1777051243.163406:0:101430:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1777051243.163414:0:101430:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1777051243.163417:0:101430:0:(obd_config.c:1561:class_process_config()) marker 50 (0x2) lustre-MDT0000-m rem lustre.test_11c.lustre-OST0001_UUID 00000020:01000000:0.0:1777051243.163423:0:101430:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1777051243.163431:0:101430:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1777051243.163434:0:101430:0:(obd_config.c:1561:class_process_config()) marker 53 (0x1) lustre-MDT0000-m del lustre.test_11c 00000020:00000080:0.0:1777051243.163442:0:101430:0:(obd_config.c:1470:class_process_config()) processing cmd: ce023 00000100:00100000:0.0:1777051243.163490:0:101430:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f9fd500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f9351a01-5b0e-4470-97fd-58b9b4b312a2:101430:1863365452498176:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1777051243.163570:0:101430:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051243.163621:0:101430:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d95875df00 going to sleep for 11 seconds 00000100:00100000:1.0:1777051243.164294:0:3679:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1777051243.164316:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da444a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452498304:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1777051243.164381:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051243.164888:0:8473:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452498304 00000100:00100000:3.0:1777051243.164899:0:8473:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452498304 00000100:00100000:3.0:1777051243.165006:0:8473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5515 00000100:00100000:3.0:1777051243.165022:0:8473:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942a0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3679:x1863365452498304:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1777051243.165058:0:8473:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 430295232 pending 0 free 3645853696 avail 3414331392 00000100:00100000:3.0:1777051243.165159:0:8473:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942a0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3679:x1863365452498304:12345-0@lo:13:osp-pre-1-0.0 Request processed in 138us (776us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051243.165176:0:8473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5515 00000100:00080000:1.0:1777051243.165355:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1777051243.165428:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da444a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452498304:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1777051243.165656:0:101430:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f9fd500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f9351a01-5b0e-4470-97fd-58b9b4b312a2:101430:1863365452498176:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1777051243.165696:0:101430:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1777051243.165705:0:101430:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1777051243.165708:0:101430:0:(obd_config.c:1561:class_process_config()) marker 53 (0x2) lustre-MDT0000-m del lustre.test_11c 00000040:00080000:0.0:1777051243.165715:0:101430:0:(llog.c:858:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 59 count 58 00000100:00100000:3.0:1777051243.167162:0:101422:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452498432 00000100:00100000:3.0:1777051243.167173:0:101422:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452498432 00000100:00100000:3.0:1777051243.167279:0:101422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1777051243.167296:0:101422:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f323c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9351a01-5b0e-4470-97fd-58b9b4b312a2+7:101416:x1863365452498432:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1777051243.167314:0:101422:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777051243.167359:0:101422:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d943eba000/0x85f51a6b9671468c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x85f51a6b96714685 expref: -99 pid: 101422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051243.167395:0:101422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d943eba000/0x85f51a6b9671468c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x85f51a6b96714685 expref: 8 pid: 101422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051243.167415:0:101422:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d943eba000/0x85f51a6b9671468c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b96714685 expref: 8 pid: 101422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051243.167430:0:101422:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d943eba000, rc 0) 00000100:00100000:3.0:1777051243.167642:0:101422:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f323c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9351a01-5b0e-4470-97fd-58b9b4b312a2+8:101416:x1863365452498432:12345-0@lo:101:mount.lustre.0 Request processed in 347us (618us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051243.168019:0:101422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1777051243.168962:0:101416:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955506a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9351a01-5b0e-4470-97fd-58b9b4b312a2:101416:1863365452498432:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1777051243.168992:0:101416:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.146@tcp lock: ffff99d95595be00/0x85f51a6b96714685 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b9671468c expref: -99 pid: 101416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051243.172787:0:101416:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.146@tcp lock: ffff99d95595be00/0x85f51a6b96714685 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x85f51a6b9671468c expref: -99 pid: 101416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051243.175365:0:101416:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da44976680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9351a01-5b0e-4470-97fd-58b9b4b312a2:101416:1863365452498560:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1777051243.175472:0:101416:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051243.175544:0:101416:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d958800cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1777051243.175585:0:101429:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452498560 00000100:00100000:0.0:1777051243.175599:0:101429:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452498560 00000100:00100000:0.0:1777051243.175681:0:101429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1777051243.175697:0:101429:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f322050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f9351a01-5b0e-4470-97fd-58b9b4b312a2+8:101416:x1863365452498560:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1777051243.175727:0:101429:0:(mgs_nids.c:912:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1777051243.175755:0:101429:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1777051243.175763:0:101429:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1777051243.175769:0:101429:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1777051243.175774:0:101429:0:(mgs_nids.c:316:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 25 00000100:00100000:0.0:1777051243.175977:0:101429:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f322050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f9351a01-5b0e-4470-97fd-58b9b4b312a2+8:101416:x1863365452498560:12345-0@lo:256:mount.lustre.0 Request processed in 281us (502us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051243.175993:0:101429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1777051243.176534:0:101416:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da44976680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9351a01-5b0e-4470-97fd-58b9b4b312a2:101416:1863365452498560:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1777051243.178621:0:101416:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.201.146@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1777051243.178655:0:101416:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff99d95595be00/0x85f51a6b96714685 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b9671468c expref: -99 pid: 101416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051243.178676:0:101416:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.146@tcp lock: ffff99d95595be00/0x85f51a6b96714685 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b9671468c expref: -99 pid: 101416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1777051243.178692:0:101416:0:(mgc_request.c:1799:mgc_process_log()) Process log params-ffff99da44f8b000 from 1 10000000:01000000:1.0:1777051243.178699:0:101416:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1777051243.178745:0:101416:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.146@tcp lock: ffff99d955a8ee00/0x85f51a6b96714693 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 101416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051243.178760:0:101416:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.146@tcp lock: ffff99d955a8ee00/0x85f51a6b96714693 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 101416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051243.178777:0:101416:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.146@tcp lock: ffff99d955a8ee00/0x85f51a6b96714693 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 101416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051243.178815:0:101416:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da44976680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9351a01-5b0e-4470-97fd-58b9b4b312a2:101416:1863365452498688:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1777051243.178864:0:101416:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051243.178903:0:101416:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d958800cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1777051243.179584:0:101416:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da44976680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9351a01-5b0e-4470-97fd-58b9b4b312a2:101416:1863365452498688:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1777051243.179608:0:101416:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.146@tcp lock: ffff99d955a8ee00/0x85f51a6b96714693 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b9671469a expref: -99 pid: 101416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051243.179626:0:101416:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.146@tcp lock: ffff99d955a8ee00/0x85f51a6b96714693 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x85f51a6b9671469a expref: -99 pid: 101416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051243.180048:0:101416:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da44976680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9351a01-5b0e-4470-97fd-58b9b4b312a2:101416:1863365452498816:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1777051243.180105:0:101416:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051243.180156:0:101416:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d958800cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1777051243.181469:0:101416:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da44976680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9351a01-5b0e-4470-97fd-58b9b4b312a2:101416:1863365452498816:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1777051243.181519:0:101416:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da44976680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9351a01-5b0e-4470-97fd-58b9b4b312a2:101416:1863365452498944:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1777051243.181598:0:101416:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051243.181642:0:101416:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d958800cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1777051243.182450:0:101429:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452498944 00000100:00100000:0.0:1777051243.182461:0:101429:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452498944 00000100:00100000:0.0:1777051243.182517:0:101429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1777051243.182531:0:101429:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d943425450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f9351a01-5b0e-4470-97fd-58b9b4b312a2+9:101416:x1863365452498944:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1777051243.182705:0:101429:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d943425450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f9351a01-5b0e-4470-97fd-58b9b4b312a2+9:101416:x1863365452498944:12345-0@lo:503:mount.lustre.0 Request processed in 174us (1104us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051243.182739:0:101429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1777051243.182899:0:101416:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da44976680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9351a01-5b0e-4470-97fd-58b9b4b312a2:101416:1863365452498944:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1777051243.183820:0:101440:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da44976680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f9351a01-5b0e-4470-97fd-58b9b4b312a2:101440:1863365452499072:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1777051243.183897:0:101440:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051243.183990:0:101440:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d958800d80 going to sleep for 11 seconds 00000100:00100000:0.0:1777051243.189768:0:101424:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942db5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9351a01-5b0e-4470-97fd-58b9b4b312a2+9:101440:x1863365452499072:12345-0@lo:502:llog_process_th.0 Request processed in 5332us (5865us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051243.189788:0:101424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1777051243.189872:0:101440:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da44976680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f9351a01-5b0e-4470-97fd-58b9b4b312a2:101440:1863365452499072:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1777051243.189956:0:101440:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1777051243.189990:0:101440:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1777051243.190001:0:101440:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1777051243.190014:0:101440:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff99da44f8b000 00000020:00000080:1.0:1777051243.190019:0:101440:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1777051243.190033:0:101440:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1777051243.190038:0:101440:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1777051243.190041:0:101440:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1777051243.190046:0:101440:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1777051243.190051:0:101440:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1777051243.190053:0:101440:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1777051243.190060:0:101440:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff99da44f8b000 00000020:00000080:1.0:1777051243.190065:0:101440:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1777051243.190182:0:101440:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1777051243.190188:0:101440:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1777051243.190190:0:101440:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1777051243.190193:0:101440:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1777051243.190342:0:101440:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #4 00000020:01000000:1.0:1777051243.190346:0:101440:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1777051243.190350:0:101440:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1777051243.190353:0:101440:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1777051243.190361:0:101440:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1777051243.190364:0:101440:0:(obd_config.c:1561:class_process_config()) marker 4 (0x6) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1777051243.190371:0:101440:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1777051243.190373:0:101440:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #5 00000020:01000000:1.0:1777051243.190376:0:101440:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1777051243.190379:0:101440:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1777051243.190382:0:101440:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1777051243.190386:0:101440:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1777051243.190388:0:101440:0:(obd_config.c:1561:class_process_config()) marker 5 (0x6) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1777051243.190393:0:101440:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1777051243.190396:0:101440:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #6 00000020:01000000:1.0:1777051243.190398:0:101440:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1777051243.190400:0:101440:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1777051243.190403:0:101440:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1777051243.190406:0:101440:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1777051243.190409:0:101440:0:(obd_config.c:1561:class_process_config()) marker 6 (0x6) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1777051243.190413:0:101440:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1777051243.190416:0:101440:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #7 00000020:01000000:1.0:1777051243.190418:0:101440:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1777051243.190420:0:101440:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1777051243.190423:0:101440:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1777051243.190427:0:101440:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1777051243.190429:0:101440:0:(obd_config.c:1561:class_process_config()) marker 7 (0x6) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1777051243.190434:0:101440:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1777051243.190436:0:101440:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #2 00000020:01000000:1.0:1777051243.190438:0:101440:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1777051243.190440:0:101440:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1777051243.190443:0:101440:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1777051243.190447:0:101440:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1777051243.190449:0:101440:0:(obd_config.c:1561:class_process_config()) marker 2 (0x6) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1777051243.190454:0:101440:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1777051243.190457:0:101440:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #3 00000020:01000000:1.0:1777051243.190460:0:101440:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1777051243.190463:0:101440:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1777051243.190466:0:101440:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1777051243.190470:0:101440:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1777051243.190472:0:101440:0:(obd_config.c:1561:class_process_config()) marker 3 (0x6) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1777051243.190477:0:101440:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1777051243.190481:0:101440:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1777051243.190510:0:101440:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1777051243.190520:0:101440:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff99da44f8b000 00000020:00000080:1.0:1777051243.190525:0:101440:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1777051243.190570:0:101440:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1777051243.190576:0:101440:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1777051243.190579:0:101440:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1777051243.190584:0:101440:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1777051243.190588:0:101440:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1777051243.190591:0:101440:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1777051243.190597:0:101440:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff99da44f8b000 00000020:00000080:1.0:1777051243.190601:0:101440:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1777051243.190630:0:101440:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1777051243.190636:0:101440:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1777051243.190638:0:101440:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1777051243.190643:0:101440:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1777051243.190647:0:101440:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1777051243.190649:0:101440:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre mdt.lustre-MDT0000.hsm.default_archive_id 00000020:01000000:1.0:1777051243.190655:0:101440:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff99da44f8b000 00000020:00000080:1.0:1777051243.190659:0:101440:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1777051243.190687:0:101440:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1777051243.190692:0:101440:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1777051243.190694:0:101440:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre mdt.lustre-MDT0000.hsm.default_archive_id 00000020:01000000:1.0:1777051243.190699:0:101440:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1777051243.190703:0:101440:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1777051243.190705:0:101440:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre mdt.lustre-MDT0001.hsm.default_archive_id 00000020:01000000:1.0:1777051243.190712:0:101440:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff99da44f8b000 00000020:00000080:1.0:1777051243.190716:0:101440:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1777051243.190786:0:101440:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da44976680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f9351a01-5b0e-4470-97fd-58b9b4b312a2:101440:1863365452499200:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1777051243.190871:0:101440:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051243.190963:0:101440:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d958800d80 going to sleep for 11 seconds 00000100:00100000:1.0:1777051243.192785:0:101440:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da44976680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f9351a01-5b0e-4470-97fd-58b9b4b312a2:101440:1863365452499200:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1777051243.192829:0:101440:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1777051243.192838:0:101440:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1777051243.192841:0:101440:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre mdt.lustre-MDT0001.hsm.default_archive_id 00000040:00080000:1.0:1777051243.192847:0:101440:0:(llog.c:858:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 37 count 37 00000100:00100000:0.0:1777051243.194075:0:101429:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452499328 00000100:00100000:0.0:1777051243.194086:0:101429:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452499328 00000100:00100000:0.0:1777051243.194464:0:101429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1777051243.194481:0:101429:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942db7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f9351a01-5b0e-4470-97fd-58b9b4b312a2+9:101416:x1863365452499328:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1777051243.194500:0:101429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051243.194529:0:101429:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99da7d506e00/0x85f51a6b967146a8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x85f51a6b967146a1 expref: -99 pid: 101429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051243.194569:0:101429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99da7d506e00/0x85f51a6b967146a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x85f51a6b967146a1 expref: 10 pid: 101429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051243.194592:0:101429:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99da7d506e00/0x85f51a6b967146a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b967146a1 expref: 10 pid: 101429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051243.194608:0:101429:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99da7d506e00, rc 0) 00000100:00100000:0.0:1777051243.194694:0:101429:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942db7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f9351a01-5b0e-4470-97fd-58b9b4b312a2+10:101416:x1863365452499328:12345-0@lo:101:mount.lustre.0 Request processed in 217us (781us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051243.194726:0:101429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1777051243.195579:0:101424:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452499456 00000100:00100000:0.0:1777051243.195589:0:101424:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452499456 00000100:00100000:0.0:1777051243.196001:0:101424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1777051243.196021:0:101424:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942db6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9351a01-5b0e-4470-97fd-58b9b4b312a2+10:101416:x1863365452499456:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1777051243.196269:0:101424:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942db6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9351a01-5b0e-4470-97fd-58b9b4b312a2+10:101416:x1863365452499456:12345-0@lo:501:mount.lustre.0 Request processed in 252us (1217us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051243.196284:0:101424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1777051243.197608:0:101427:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452499584 00000100:00100000:1.0:1777051243.197620:0:101427:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452499584 00000100:00100000:1.0:1777051243.198041:0:101427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1777051243.198057:0:101427:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942db4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f9351a01-5b0e-4470-97fd-58b9b4b312a2+10:101416:x1863365452499584:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1777051243.198280:0:101427:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942db4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f9351a01-5b0e-4470-97fd-58b9b4b312a2+10:101416:x1863365452499584:12345-0@lo:503:mount.lustre.0 Request processed in 225us (783us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051243.198301:0:101427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1777051243.200593:0:101429:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452499712 00000100:00100000:1.0:1777051243.200602:0:101429:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452499712 00000100:00100000:1.0:1777051243.200808:0:101429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1777051243.200835:0:101429:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942db6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f9351a01-5b0e-4470-97fd-58b9b4b312a2+10:101442:x1863365452499712:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1777051243.201047:0:101429:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942db6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f9351a01-5b0e-4470-97fd-58b9b4b312a2+10:101442:x1863365452499712:12345-0@lo:502:llog_process_th.0 Request processed in 222us (1443us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051243.201065:0:101429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1777051243.207725:0:3676:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955507800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3676:1863365452499840:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1777051243.208442:0:3676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051243.209381:0:3676:0:(client.c:3101:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1777051243.209396:0:3676:0:(import.c:65:import_set_state_nolock()) ffff99d9410cc800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1777051243.209407:0:3676:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1777051243.209418:0:3676:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955507800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3676:1863365452499840:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1777051243.213396:0:101424:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452499968 00000100:00100000:1.0:1777051243.213407:0:101424:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452499968 00000100:00100000:1.0:1777051243.213474:0:101424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1777051243.213491:0:101424:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da45f65450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9351a01-5b0e-4470-97fd-58b9b4b312a2+10:101442:x1863365452499968:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1777051243.214015:0:101424:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da45f65450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9351a01-5b0e-4470-97fd-58b9b4b312a2+10:101442:x1863365452499968:12345-0@lo:502:llog_process_th.0 Request processed in 525us (4402us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051243.214032:0:101424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1777051243.214969:0:101427:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452500096 00000100:00100000:1.0:1777051243.214980:0:101427:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452500096 00000100:00100000:1.0:1777051243.215039:0:101427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1777051243.215056:0:101427:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da45f64450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f9351a01-5b0e-4470-97fd-58b9b4b312a2+10:101442:x1863365452500096:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1777051243.215476:0:101427:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da45f64450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f9351a01-5b0e-4470-97fd-58b9b4b312a2+10:101442:x1863365452500096:12345-0@lo:502:llog_process_th.0 Request processed in 423us (892us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051243.215498:0:101427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000020:01000000:1.0:1777051243.216343:0:101416:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-63 (rc=0) 10000000:01000000:1.0:1777051243.216408:0:101416:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.201.146@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1777051243.216440:0:101416:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff99d95595b600/0x85f51a6b967146a1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b967146a8 expref: -99 pid: 101416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051243.216463:0:101416:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.146@tcp lock: ffff99d95595b600/0x85f51a6b967146a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b967146a8 expref: -99 pid: 101416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1777051243.216576:0:101416:0:(tgt_mount.c:1144:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1777051243.216581:0:101416:0:(tgt_mount.c:1145:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1777051243.216585:0:101416:0:(tgt_mount.c:1146:server_mti_print()) fs: lustre 00000020:01000004:1.0:1777051243.216588:0:101416:0:(tgt_mount.c:1147:server_mti_print()) uuid: 00000020:01000004:1.0:1777051243.216591:0:101416:0:(tgt_mount.c:1148:server_mti_print()) ver: 0 00000020:01000004:1.0:1777051243.216595:0:101416:0:(tgt_mount.c:1149:server_mti_print()) flags: 00000020:01000004:1.0:1777051243.216598:0:101416:0:(tgt_mount.c:1151:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1777051243.216601:0:101416:0:(tgt_mount.c:1155:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1777051243.216605:0:101416:0:(tgt_mount.c:1183:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1777051243.216608:0:101416:0:(tgt_mount.c:1189:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1777051243.216615:0:101416:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:1.0:1777051243.216620:0:101416:0:(tgt_mount.c:1144:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1777051243.216624:0:101416:0:(tgt_mount.c:1145:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1777051243.216628:0:101416:0:(tgt_mount.c:1146:server_mti_print()) fs: lustre 00000020:01000004:1.0:1777051243.216631:0:101416:0:(tgt_mount.c:1147:server_mti_print()) uuid: 00000020:01000004:1.0:1777051243.216634:0:101416:0:(tgt_mount.c:1148:server_mti_print()) ver: 0 00000020:01000004:1.0:1777051243.216637:0:101416:0:(tgt_mount.c:1149:server_mti_print()) flags: 00000020:01000004:1.0:1777051243.216640:0:101416:0:(tgt_mount.c:1151:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1777051243.216643:0:101416:0:(tgt_mount.c:1155:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1777051243.216646:0:101416:0:(tgt_mount.c:1183:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1777051243.216650:0:101416:0:(tgt_mount.c:1189:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1777051243.216678:0:101416:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1777051243.216703:0:101416:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da44976680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9351a01-5b0e-4470-97fd-58b9b4b312a2:101416:1863365452500224:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1777051243.216786:0:101416:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051243.216831:0:101416:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d958800240 going to sleep for 11 seconds 00000100:00100000:1.0:1777051243.216889:0:101429:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452500224 00000100:00100000:1.0:1777051243.216899:0:101429:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452500224 00000100:00100000:1.0:1777051243.216995:0:101429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1777051243.217011:0:101429:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da45f65050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f9351a01-5b0e-4470-97fd-58b9b4b312a2+10:101416:x1863365452500224:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1777051243.217048:0:101429:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1777051243.217070:0:101429:0:(mgs_nids.c:461:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1777051243.230893:0:101429:0:(mgs_nids.c:813:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1777051243.230922:0:101429:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1777051243.231748:0:101429:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da45f65050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f9351a01-5b0e-4470-97fd-58b9b4b312a2+10:101416:x1863365452500224:12345-0@lo:253:mount.lustre.0 Request processed in 14733us (14958us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051243.231771:0:101429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1777051243.231879:0:101416:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da44976680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9351a01-5b0e-4470-97fd-58b9b4b312a2:101416:1863365452500224:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1777051243.231901:0:101416:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1777051243.231909:0:101416:0:(tgt_mount.c:1144:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1777051243.231911:0:101416:0:(tgt_mount.c:1145:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1777051243.231914:0:101416:0:(tgt_mount.c:1146:server_mti_print()) fs: lustre 00000020:01000004:1.0:1777051243.231917:0:101416:0:(tgt_mount.c:1147:server_mti_print()) uuid: 00000020:01000004:1.0:1777051243.231920:0:101416:0:(tgt_mount.c:1148:server_mti_print()) ver: 0 00000020:01000004:1.0:1777051243.231923:0:101416:0:(tgt_mount.c:1149:server_mti_print()) flags: 00000020:01000004:1.0:1777051243.231958:0:101416:0:(tgt_mount.c:1151:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1777051243.231961:0:101416:0:(tgt_mount.c:1155:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1777051243.231965:0:101416:0:(tgt_mount.c:1183:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1777051243.231967:0:101416:0:(tgt_mount.c:1189:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1777051243.231992:0:101416:0:(tgt_mount.c:2642:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:3.0:1777051243.233639:0:6568:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777051243.233652:0:6568:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.146@tcp lock: ffff99d95595be00/0x85f51a6b96714685 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x85f51a6b9671468c expref: -99 pid: 101416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051243.233669:0:6568:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d95595be00 already unused, calling callback (ffffffffc1208c20) 10000000:00010000:3.0:1777051243.233676:0:6568:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.146@tcp lock: ffff99d95595be00/0x85f51a6b96714685 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x85f51a6b9671468c expref: -99 pid: 101416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051243.233692:0:6568:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.146@tcp lock: ffff99d95595be00/0x85f51a6b96714685 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x85f51a6b9671468c expref: -99 pid: 101416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1777051243.233706:0:6568:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.146@tcp lock: ffff99d95595be00/0x85f51a6b96714685 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x85f51a6b9671468c expref: -99 pid: 101416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1777051243.233717:0:6568:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1777051243.233773:0:6568:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.146@tcp lock: ffff99d95595be00/0x85f51a6b96714685 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x85f51a6b9671468c expref: -99 pid: 101416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051243.233786:0:6568:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1777051243.233820:0:6568:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.146@tcp lock: ffff99d95595be00/0x85f51a6b96714685 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x85f51a6b9671468c expref: -99 pid: 101416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051243.233834:0:6568:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.146@tcp lock: ffff99d95595be00/0x85f51a6b96714685 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x85f51a6b9671468c expref: -99 pid: 101416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051243.233867:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051243.233871:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051243.233876:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1777051243.233969:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da444a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3677:1863365452500480:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1777051243.234071:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051243.234591:0:47597:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452500480 00000100:00100000:3.0:1777051243.234603:0:47597:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452500480 00010000:00010000:3.0:1777051243.234644:0:47597:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99d943eba000/0x85f51a6b9671468c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x85f51a6b96714685 expref: 10 pid: 101422 timeout: 7972 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051243.235013:0:47597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3815 00000100:00100000:3.0:1777051243.235034:0:47597:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f9351a01-5b0e-4470-97fd-58b9b4b312a2+10:3677:x1863365452500480:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1777051243.235055:0:47597:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777051243.235064:0:47597:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99d943eba000/0x85f51a6b9671468c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x85f51a6b96714685 expref: 10 pid: 101422 timeout: 7972 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051243.235083:0:47597:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99d943eba000/0x85f51a6b9671468c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x85f51a6b96714685 expref: 10 pid: 101422 timeout: 7972 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051243.235106:0:47597:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d943eba000/0x85f51a6b9671468c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x85f51a6b96714685 expref: 10 pid: 101422 timeout: 7972 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051243.235127:0:47597:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99d95595b200/0x85f51a6b967146bd lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 101426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051243.235140:0:47597:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d95595b200/0x85f51a6b967146bd lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 101426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1777051243.235164:0:47597:0:(mgs_nids.c:686:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003727226s 00010000:00010000:3.0:1777051243.235171:0:47597:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99d95595b200/0x85f51a6b967146bd lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 101426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051243.235184:0:47597:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99d95595b200/0x85f51a6b967146bd lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 101426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051243.235254:0:47597:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99d95595b200/0x85f51a6b967146bd lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 101426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051243.235269:0:47597:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99d95595b200/0x85f51a6b967146bd lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 101426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051243.235282:0:47597:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d95595b200 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:3.0:1777051243.235289:0:47597:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99d95595b200/0x85f51a6b967146bd lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 101426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051243.235303:0:47597:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99d95595b200/0x85f51a6b967146bd lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 101426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051243.235331:0:47597:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99d95595b200/0x85f51a6b967146bd lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 101426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051243.235350:0:47597:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1777051243.235435:0:47597:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f9351a01-5b0e-4470-97fd-58b9b4b312a2+9:3677:x1863365452500480:12345-0@lo:103:ldlm_bl.0 Request processed in 405us (1362us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051243.235449:0:47597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3815 00000040:01000000:1.0:1777051243.268555:0:101416:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:0.0:1777051243.268602:0:101453:0:(update_trans.c:1520:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8590017025 00000020:00080000:0.0:1777051243.268610:0:101453:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8590017025 00000040:01000000:0.0:1777051243.269762:0:101454:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1777051243.269818:0:101416:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00100000:3.0:1777051243.270377:0:101455:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da444a1500 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:101455:1863365452500608:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1777051243.270467:0:101455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051243.270522:0:101455:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d9565d4540 going to sleep for 11 seconds 00000100:00100000:0.0:1777051243.270554:0:11727:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452500608 00000100:00100000:0.0:1777051243.270568:0:11727:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452500608 00000100:00100000:0.0:1777051243.270681:0:11727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7977 00000100:00100000:0.0:1777051243.270701:0:11727:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da444a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:101455:x1863365452500608:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1777051243.271431:0:11727:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da444a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:101455:x1863365452500608:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 733us (960us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051243.271446:0:11727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7977 00000100:00100000:3.0:1777051243.271995:0:101455:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da444a1500 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:101455:1863365452500608:0@lo:1000:lod0000_rec0001.0 00000040:01000000:3.0:1777051243.272396:0:101455:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1777051243.272453:0:101455:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da444a1500 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:101455:1863365452500736:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1777051243.272525:0:101455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051243.272572:0:101455:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d9565d4540 going to sleep for 11 seconds 00000100:00100000:0.0:1777051243.272678:0:47208:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452500736 00000100:00100000:0.0:1777051243.272713:0:47208:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452500736 00000100:00100000:0.0:1777051243.273078:0:47208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7978 00000100:00100000:0.0:1777051243.273151:0:47208:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da449c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+6:101455:x1863365452500736:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1777051243.273388:0:47208:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da449c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+6:101455:x1863365452500736:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 295us (863us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051243.273403:0:47208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7978 00000100:00100000:3.0:1777051243.273966:0:101455:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da444a1500 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:101455:1863365452500736:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1777051243.274085:0:101455:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da444a1500 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:101455:1863365452500864:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1777051243.274145:0:101455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051243.274244:0:101455:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d9565d4540 going to sleep for 11 seconds 00000100:00100000:0.0:1777051243.274419:0:46498:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452500864 00000100:00100000:0.0:1777051243.274429:0:46498:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452500864 00000100:00100000:0.0:1777051243.274532:0:46498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7979 00000100:00100000:0.0:1777051243.274549:0:46498:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955612300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+6:101455:x1863365452500864:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1777051243.274658:0:46498:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955612300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+6:101455:x1863365452500864:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 111us (512us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051243.274674:0:46498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7979 00000100:00100000:3.0:1777051243.274697:0:101455:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da444a1500 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:101455:1863365452500864:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1777051243.275124:0:101455:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955613480 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:101455:1863365452500992:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1777051243.275317:0:101455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051243.275358:0:101455:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d9565d4300 going to sleep for 11 seconds 00000100:00100000:1.0:1777051243.275448:0:6584:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452500992 00000100:00100000:1.0:1777051243.275460:0:6584:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452500992 00000100:00100000:1.0:1777051243.275515:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7980 00000100:00100000:1.0:1777051243.275529:0:6584:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955612680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:101455:x1863365452500992:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1777051243.275794:0:6584:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955612680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:101455:x1863365452500992:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 266us (476us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051243.275808:0:101455:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955613480 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:101455:1863365452500992:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1777051243.275831:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7980 00000040:00080000:0.0:1777051243.312330:0:101416:0:(llog.c:858:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1777051243.327629:0:101455:0:(llog.c:858:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1777051243.327758:0:101455:0:(lod_dev.c:520:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000040:00080000:0.0:1777051243.330549:0:101416:0:(llog.c:858:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1777051243.330639:0:101416:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:1.0:1777051243.332035:0:101454:0:(llog.c:858:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1777051243.332134:0:101454:0:(lod_dev.c:520:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1777051243.332141:0:101454:0:(lod_dev.c:544:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00080000:10000000:0.0:1777051243.332792:0:101416:0:(osd_handler.c:5577:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3d:0x0] (8/32) registered 00010000:00080000:0.0:1777051243.336349:0:101416:0:(ldlm_lib.c:3036:target_recovery_init()) RECOVERY: service lustre-MDT0000, 3 recoverable clients, last_transno 21474836480 00010000:00080000:0.0:1777051243.338571:0:101457:0:(ldlm_lib.c:2839:target_recovery_thread()) lustre-MDT0000: started recovery thread pid 101457 00010000:02000000:0.0:1777051243.338597:0:101457:0:(ldlm_lib.c:2321:target_recovery_overseer()) lustre-MDT0000: in recovery but waiting for the first client to connect 00000020:00000004:1.0:1777051243.348087:0:101416:0:(tgt_mount.c:2297:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1777051243.349099:0:101416:0:(tgt_mount.c:2312:is_cmd_supported()) ioctl cmd=81009431 00010000:00080000:0.0:1777051243.352664:0:101457:0:(ldlm_lib.c:2531:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 3 abort 0 expired 0 00010000:00080000:0.0:1777051243.352672:0:101457:0:(ldlm_lib.c:2531:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 3 abort 0 expired 0 00010000:00010000:1.0:1777051243.606637:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1777051244.121339:0:6577:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1777051244.121394:0:6577:0:(mgc_request.c:1799:mgc_process_log()) Process log lustre-mdtir-ffff99da44f8b000 from 26 10000000:01000000:0.0:1777051244.121404:0:6577:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1777051244.121472:0:6577:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.146@tcp lock: ffff99da7d506200/0x85f51a6b967146c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051244.121493:0:6577:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.146@tcp lock: ffff99da7d506200/0x85f51a6b967146c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051244.121514:0:6577:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.146@tcp lock: ffff99da7d506200/0x85f51a6b967146c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051244.121584:0:6577:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f9fed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452501120:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1777051244.121680:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051244.121780:0:6577:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d95c3e2f00 going to sleep for 11 seconds 00000100:00100000:1.0:1777051244.121978:0:101425:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452501120 00000100:00100000:1.0:1777051244.122021:0:101425:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452501120 00000100:00100000:1.0:1777051244.122418:0:101425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1777051244.122443:0:101425:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da45f64c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9351a01-5b0e-4470-97fd-58b9b4b312a2+9:6577:x1863365452501120:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1777051244.122468:0:101425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777051244.122519:0:101425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d955a8e600/0x85f51a6b967146cb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x85f51a6b967146c4 expref: -99 pid: 101425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051244.122562:0:101425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d955a8e600/0x85f51a6b967146cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x85f51a6b967146c4 expref: 10 pid: 101425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051244.122583:0:101425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d955a8e600/0x85f51a6b967146cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b967146c4 expref: 10 pid: 101425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051244.122600:0:101425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d955a8e600, rc 0) 00000100:00100000:1.0:1777051244.122729:0:101425:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da45f64c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9351a01-5b0e-4470-97fd-58b9b4b312a2+10:6577:x1863365452501120:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 262us (1015us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051244.122743:0:101425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1777051244.123818:0:6577:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f9fed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452501120:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1777051244.123851:0:6577:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.146@tcp lock: ffff99da7d506200/0x85f51a6b967146c4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b967146cb expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051244.123892:0:6577:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.146@tcp lock: ffff99da7d506200/0x85f51a6b967146c4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x85f51a6b967146cb expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051244.124048:0:6577:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955613480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452501248:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1777051244.124505:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051244.124589:0:101422:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452501248 00000100:00100000:3.0:1777051244.124599:0:6577:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d9565d4540 going to sleep for 11 seconds 00000100:00100000:1.0:1777051244.124601:0:101422:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452501248 00000100:00100000:1.0:1777051244.124686:0:101422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1777051244.124703:0:101422:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da45f67850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9351a01-5b0e-4470-97fd-58b9b4b312a2+10:6577:x1863365452501248:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1777051244.124732:0:101422:0:(mgs_nids.c:912:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1777051244.124762:0:101422:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1777051244.124768:0:101422:0:(mgs_nids.c:316:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 26 00000100:00100000:1.0:1777051244.124949:0:101422:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da45f67850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9351a01-5b0e-4470-97fd-58b9b4b312a2+10:6577:x1863365452501248:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 216us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051244.124962:0:101422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1777051244.125778:0:6577:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955613480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452501248:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1777051244.125863:0:6577:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.201.146@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1777051244.125888:0:6577:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff99da7d506200/0x85f51a6b967146c4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b967146cb expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051244.125936:0:6577:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.146@tcp lock: ffff99da7d506200/0x85f51a6b967146c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b967146cb expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1777051244.125964:0:6577:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1777051244.125968:0:6577:0:(mgc_request.c:1799:mgc_process_log()) Process log lustre-client-ffff99d941839800 from 64 10000000:01000000:3.0:1777051244.125973:0:6577:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1777051244.126006:0:6577:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.146@tcp lock: ffff99d943eba000/0x85f51a6b967146d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051244.126021:0:6577:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.146@tcp lock: ffff99d943eba000/0x85f51a6b967146d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051244.126036:0:6577:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.146@tcp lock: ffff99d943eba000/0x85f51a6b967146d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051244.126066:0:6577:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955613480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452501376:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1777051244.126131:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051244.126233:0:6577:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d9565d4540 going to sleep for 11 seconds 00000100:00100000:1.0:1777051244.126416:0:101429:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452501376 00000100:00100000:1.0:1777051244.126425:0:101429:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452501376 00000100:00100000:1.0:1777051244.126491:0:101429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1777051244.126503:0:101429:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da6fd55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f9351a01-5b0e-4470-97fd-58b9b4b312a2+10:6577:x1863365452501376:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1777051244.126516:0:101429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777051244.126532:0:101429:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d955a8e200/0x85f51a6b967146d9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x85f51a6b967146d2 expref: -99 pid: 101429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051244.126558:0:101429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d955a8e200/0x85f51a6b967146d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x85f51a6b967146d2 expref: 11 pid: 101429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051244.126576:0:101429:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d955a8e200/0x85f51a6b967146d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b967146d2 expref: 11 pid: 101429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051244.126591:0:101429:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d955a8e200, rc 0) 00000100:00100000:1.0:1777051244.126670:0:101429:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da6fd55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f9351a01-5b0e-4470-97fd-58b9b4b312a2+11:6577:x1863365452501376:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 167us (539us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051244.126683:0:101429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1777051244.126761:0:6577:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955613480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452501376:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1777051244.126788:0:6577:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.146@tcp lock: ffff99d943eba000/0x85f51a6b967146d2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b967146d9 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051244.126809:0:6577:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.146@tcp lock: ffff99d943eba000/0x85f51a6b967146d2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x85f51a6b967146d9 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051244.126963:0:6577:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f9fed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452501504:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1777051244.127026:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051244.127473:0:6577:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d95c3e2f00 going to sleep for 11 seconds 00000100:00100000:1.0:1777051244.128017:0:101425:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452501504 00000100:00100000:1.0:1777051244.128027:0:101425:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452501504 00000100:00100000:1.0:1777051244.128384:0:101425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1777051244.128400:0:101425:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da6fd56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9351a01-5b0e-4470-97fd-58b9b4b312a2+11:6577:x1863365452501504:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1777051244.128625:0:101425:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da6fd56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9351a01-5b0e-4470-97fd-58b9b4b312a2+11:6577:x1863365452501504:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 227us (1598us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051244.128639:0:101425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1777051244.129266:0:6577:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f9fed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452501504:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1777051244.129404:0:6577:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f9fed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452501632:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1777051244.129502:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051244.129584:0:6577:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d95c3e2f00 going to sleep for 11 seconds 00000100:00100000:1.0:1777051244.129659:0:101424:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452501632 00000100:00100000:1.0:1777051244.129671:0:101424:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452501632 00000100:00100000:1.0:1777051244.129753:0:101424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1777051244.129773:0:101424:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da6fd57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9351a01-5b0e-4470-97fd-58b9b4b312a2+11:6577:x1863365452501632:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1777051244.129977:0:101424:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da6fd57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9351a01-5b0e-4470-97fd-58b9b4b312a2+11:6577:x1863365452501632:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 210us (477us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051244.129992:0:101424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000040:00080000:1.0:1777051244.135261:0:101506:0:(llog.c:858:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 63 00000020:01000000:0.0:1777051244.135490:0:6577:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 64-63 (rc=0) 10000000:01000000:0.0:1777051244.135554:0:6577:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.201.146@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1777051244.135571:0:6577:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff99d943eba000/0x85f51a6b967146d2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b967146d9 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051244.135593:0:6577:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.146@tcp lock: ffff99d943eba000/0x85f51a6b967146d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b967146d9 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1777051244.135610:0:6577:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:0.0:1777051244.135615:0:6577:0:(mgc_request.c:1799:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:0.0:1777051244.135622:0:6577:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1777051244.136516:0:6577:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.146@tcp lock: ffff99da7d507e00/0x85f51a6b967146e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051244.136536:0:6577:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.146@tcp lock: ffff99da7d507e00/0x85f51a6b967146e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051244.136556:0:6577:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.146@tcp lock: ffff99da7d507e00/0x85f51a6b967146e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051244.136599:0:6577:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f9fea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452501760:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1777051244.136691:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051244.136803:0:6577:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d942ccd240 going to sleep for 11 seconds 00000100:00100000:0.0:1777051244.136839:0:101429:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452501760 00000100:00100000:0.0:1777051244.136849:0:101429:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452501760 00000100:00100000:0.0:1777051244.136943:0:101429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1777051244.136964:0:101429:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942fa8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f9351a01-5b0e-4470-97fd-58b9b4b312a2+11:6577:x1863365452501760:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1777051244.136985:0:101429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051244.137007:0:101429:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99da7d507800/0x85f51a6b967146e7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x85f51a6b967146e0 expref: -99 pid: 101429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051244.137050:0:101429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99da7d507800/0x85f51a6b967146e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x85f51a6b967146e0 expref: 12 pid: 101429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051244.137073:0:101429:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99da7d507800/0x85f51a6b967146e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b967146e0 expref: 12 pid: 101429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051244.137091:0:101429:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99da7d507800, rc 0) 00000100:00100000:0.0:1777051244.137252:0:101429:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942fa8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f9351a01-5b0e-4470-97fd-58b9b4b312a2+12:6577:x1863365452501760:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 242us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051244.137268:0:101429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1777051244.137386:0:6577:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f9fea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452501760:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1777051244.137417:0:6577:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.146@tcp lock: ffff99da7d507e00/0x85f51a6b967146e0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b967146e7 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051244.137436:0:6577:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.146@tcp lock: ffff99da7d507e00/0x85f51a6b967146e0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x85f51a6b967146e7 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051244.137540:0:6577:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f9fea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452501888:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1777051244.137601:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051244.137647:0:6577:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d942ccd240 going to sleep for 11 seconds 00000100:00100000:3.0:1777051244.137730:0:101422:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452501888 00000100:00100000:3.0:1777051244.137743:0:101422:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452501888 00000100:00100000:3.0:1777051244.137810:0:101422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1777051244.137827:0:101422:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942fabc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9351a01-5b0e-4470-97fd-58b9b4b312a2+12:6577:x1863365452501888:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1777051244.138073:0:101422:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942fabc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9351a01-5b0e-4470-97fd-58b9b4b312a2+12:6577:x1863365452501888:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 248us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051244.138087:0:101422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1777051244.142124:0:6577:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f9fea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452501888:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1777051244.142513:0:6577:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f9fea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452502016:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1777051244.142606:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051244.142675:0:6577:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d942ccd240 going to sleep for 11 seconds 00000100:00100000:0.0:1777051244.146883:0:6577:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f9fea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452502016:0@lo:503:ll_cfg_requeue.0 00000020:01000000:0.0:1777051244.152370:0:6577:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:0.0:1777051244.152412:0:6577:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.201.146@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1777051244.152426:0:6577:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff99da7d507e00/0x85f51a6b967146e0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b967146e7 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051244.152447:0:6577:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.146@tcp lock: ffff99da7d507e00/0x85f51a6b967146e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b967146e7 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1777051244.152463:0:6577:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1777051244.152468:0:6577:0:(mgc_request.c:1799:mgc_process_log()) Process log params-ffff99d941839800 from 37 10000000:01000000:0.0:1777051244.152473:0:6577:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1777051244.152521:0:6577:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.146@tcp lock: ffff99da7d507c00/0x85f51a6b967146ee lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051244.152538:0:6577:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.146@tcp lock: ffff99da7d507c00/0x85f51a6b967146ee lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051244.152556:0:6577:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.146@tcp lock: ffff99da7d507c00/0x85f51a6b967146ee lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051244.152595:0:6577:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f9fea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452502144:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1777051244.153031:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051244.153104:0:6577:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d942ccd240 going to sleep for 11 seconds 00000100:00100000:0.0:1777051244.154046:0:6577:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f9fea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452502144:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1777051244.154075:0:6577:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.146@tcp lock: ffff99da7d507c00/0x85f51a6b967146ee lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b967146f5 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051244.154471:0:6577:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.146@tcp lock: ffff99da7d507c00/0x85f51a6b967146ee lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x85f51a6b967146f5 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051244.154571:0:6577:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f9fea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452502272:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1777051244.154641:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051244.154694:0:101424:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452502272 00000100:00100000:0.0:1777051244.154702:0:101424:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452502272 00000100:00100000:0.0:1777051244.154759:0:101424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1777051244.154774:0:101424:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942b18050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9351a01-5b0e-4470-97fd-58b9b4b312a2+13:6577:x1863365452502272:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1777051244.154961:0:101424:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942b18050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9351a01-5b0e-4470-97fd-58b9b4b312a2+13:6577:x1863365452502272:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 188us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051244.154976:0:101424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1777051244.155044:0:6577:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d942ccd240 going to sleep for 11 seconds 00000100:00100000:0.0:1777051244.155071:0:6577:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f9fea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452502272:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1777051244.155438:0:6577:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f9fea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452502400:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1777051244.155511:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051244.155552:0:6577:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d942ccd240 going to sleep for 11 seconds 00000100:00100000:3.0:1777051244.155766:0:101427:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452502400 00000100:00100000:3.0:1777051244.155776:0:101427:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452502400 00000100:00100000:3.0:1777051244.155827:0:101427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1777051244.155840:0:101427:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942b1ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f9351a01-5b0e-4470-97fd-58b9b4b312a2+13:6577:x1863365452502400:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1777051244.156459:0:101427:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942b1ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f9351a01-5b0e-4470-97fd-58b9b4b312a2+13:6577:x1863365452502400:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 617us (945us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051244.156477:0:101427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1777051244.157975:0:6577:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f9fea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452502400:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1777051244.173701:0:101508:0:(llog.c:858:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 37 00000100:00100000:0.0:1777051244.178653:0:101425:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452502528 00000100:00100000:0.0:1777051244.178669:0:101425:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452502528 00000100:00100000:3.0:1777051244.178701:0:6577:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d95c3e2f00 going to sleep for 11 seconds 00000100:00100000:0.0:1777051244.178834:0:101425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1777051244.178854:0:101425:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da58075050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9351a01-5b0e-4470-97fd-58b9b4b312a2+13:6577:x1863365452502528:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1777051244.178877:0:101425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051244.178898:0:101425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99da7d507400/0x85f51a6b96714703 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x85f51a6b967146fc expref: -99 pid: 101425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051244.178976:0:101425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99da7d507400/0x85f51a6b96714703 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x85f51a6b967146fc expref: 14 pid: 101425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051244.178998:0:101425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99da7d507400/0x85f51a6b96714703 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b967146fc expref: 14 pid: 101425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051244.179349:0:101425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99da7d507400, rc 0) 00000100:00100000:0.0:1777051244.179435:0:101425:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da58075050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9351a01-5b0e-4470-97fd-58b9b4b312a2+14:6577:x1863365452502528:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 585us (1532us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051244.179452:0:101425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1777051244.179689:0:6577:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955507800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452502528:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1777051244.179719:0:6577:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.146@tcp lock: ffff99d95595b800/0x85f51a6b967146fc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b96714703 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051244.179740:0:6577:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.146@tcp lock: ffff99d95595b800/0x85f51a6b967146fc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x85f51a6b96714703 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051244.179847:0:6577:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955610000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452502656:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1777051244.180603:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051244.181139:0:6577:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d9565d46c0 going to sleep for 11 seconds 00000100:00100000:0.0:1777051244.181610:0:101429:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452502656 00000100:00100000:0.0:1777051244.181622:0:101429:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452502656 00000100:00100000:0.0:1777051244.181732:0:101429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1777051244.181752:0:101429:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94a770450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f9351a01-5b0e-4470-97fd-58b9b4b312a2+14:6577:x1863365452502656:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1777051244.181999:0:101429:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94a770450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f9351a01-5b0e-4470-97fd-58b9b4b312a2+14:6577:x1863365452502656:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 250us (1400us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051244.182015:0:101429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1777051244.182958:0:6577:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955610000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452502656:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1777051244.183044:0:6577:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f9fea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452502784:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1777051244.185090:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051244.185152:0:6577:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d942ccd300 going to sleep for 11 seconds 00000100:00100000:3.0:1777051244.185208:0:101422:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452502784 00000100:00100000:3.0:1777051244.185230:0:101422:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452502784 00000100:00100000:3.0:1777051244.185295:0:101422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1777051244.185335:0:101422:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94a770850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9351a01-5b0e-4470-97fd-58b9b4b312a2+14:6577:x1863365452502784:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1777051244.185667:0:101422:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94a770850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9351a01-5b0e-4470-97fd-58b9b4b312a2+14:6577:x1863365452502784:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 335us (578us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051244.185684:0:101422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000020:01000000:3.0:1777051244.192292:0:6577:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 64-63 (rc=0) 10000000:01000000:3.0:1777051244.192348:0:6577:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.201.146@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1777051244.192367:0:6577:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff99d95595b800/0x85f51a6b967146fc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b96714703 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051244.192391:0:6577:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.146@tcp lock: ffff99d95595b800/0x85f51a6b967146fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b96714703 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1777051244.192421:0:6577:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1777051244.192427:0:6577:0:(mgc_request.c:1799:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:3.0:1777051244.192432:0:6577:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1777051244.192482:0:6577:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.146@tcp lock: ffff99d943eba600/0x85f51a6b9671470a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051244.192497:0:6577:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.146@tcp lock: ffff99d943eba600/0x85f51a6b9671470a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051244.192516:0:6577:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.146@tcp lock: ffff99d943eba600/0x85f51a6b9671470a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051244.192549:0:6577:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955610000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452502912:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1777051244.192631:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051244.193022:0:6577:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d9565d4540 going to sleep for 11 seconds 00000100:00100000:1.0:1777051244.196314:0:6577:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955610000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452502912:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1777051244.196351:0:6577:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.146@tcp lock: ffff99d943eba600/0x85f51a6b9671470a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b96714711 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051244.196375:0:6577:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.146@tcp lock: ffff99d943eba600/0x85f51a6b9671470a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x85f51a6b96714711 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051244.196499:0:6577:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da44976680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452503040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1777051244.196597:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051244.196664:0:6577:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da7da589c0 going to sleep for 11 seconds 00000100:00100000:3.0:1777051244.197219:0:6577:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da44976680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452503040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1777051244.197373:0:6577:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955613480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452503168:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1777051244.197466:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051244.197520:0:101422:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452503168 00000100:00100000:3.0:1777051244.197530:0:101422:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452503168 00000100:00100000:3.0:1777051244.197592:0:101422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1777051244.197614:0:101422:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da48dcfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9351a01-5b0e-4470-97fd-58b9b4b312a2+15:6577:x1863365452503168:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1777051244.198442:0:6577:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d9565d4b40 going to sleep for 11 seconds 00000100:00100000:1.0:1777051244.201472:0:101422:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da48dcfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9351a01-5b0e-4470-97fd-58b9b4b312a2+15:6577:x1863365452503168:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 3859us (3999us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051244.201493:0:101422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000040:00080000:1.0:1777051244.208044:0:101512:0:(llog.c:858:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 14 00000020:01000000:0.0:1777051244.211339:0:6577:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:0.0:1777051244.211394:0:6577:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.201.146@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1777051244.211412:0:6577:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff99d943eba600/0x85f51a6b9671470a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b96714711 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051244.211437:0:6577:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.146@tcp lock: ffff99d943eba600/0x85f51a6b9671470a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b96714711 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1777051244.211456:0:6577:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1777051244.211461:0:6577:0:(mgc_request.c:1799:mgc_process_log()) Process log params-ffff99da44f8d000 from 37 10000000:01000000:0.0:1777051244.211466:0:6577:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1777051244.211523:0:6577:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.146@tcp lock: ffff99da7d507200/0x85f51a6b96714718 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051244.211538:0:6577:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.146@tcp lock: ffff99da7d507200/0x85f51a6b96714718 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051244.211556:0:6577:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.146@tcp lock: ffff99da7d507200/0x85f51a6b96714718 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051244.211596:0:6577:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f9fe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452503296:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1777051244.211700:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051244.211791:0:6577:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d942ccd480 going to sleep for 11 seconds 00000100:00100000:1.0:1777051244.215130:0:6577:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f9fe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452503296:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1777051244.215162:0:6577:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.146@tcp lock: ffff99da7d507200/0x85f51a6b96714718 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b9671471f expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051244.215182:0:6577:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.146@tcp lock: ffff99da7d507200/0x85f51a6b96714718 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x85f51a6b9671471f expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051244.215310:0:6577:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da44977100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452503424:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1777051244.215372:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051244.215434:0:6577:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d9591dc480 going to sleep for 11 seconds 00000100:00100000:1.0:1777051244.218328:0:6577:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da44977100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452503424:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1777051244.218394:0:6577:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da44977100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452503552:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1777051244.218479:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051244.218532:0:6577:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d9591dc480 going to sleep for 11 seconds 00000100:00100000:3.0:1777051244.218576:0:101422:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452503552 00000100:00100000:3.0:1777051244.218588:0:101422:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452503552 00000100:00100000:3.0:1777051244.218668:0:101422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1777051244.218684:0:101422:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7d9cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9351a01-5b0e-4470-97fd-58b9b4b312a2+16:6577:x1863365452503552:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1777051244.219498:0:101422:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7d9cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9351a01-5b0e-4470-97fd-58b9b4b312a2+16:6577:x1863365452503552:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 816us (1018us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051244.219513:0:101422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1777051244.220048:0:6577:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da44977100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452503552:0@lo:503:ll_cfg_requeue.0 00000020:01000000:0.0:1777051244.224498:0:6577:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 37-36 (rc=0) 10000000:01000000:0.0:1777051244.224544:0:6577:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.201.146@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1777051244.224559:0:6577:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff99da7d507200/0x85f51a6b96714718 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b9671471f expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051244.224579:0:6577:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.146@tcp lock: ffff99da7d507200/0x85f51a6b96714718 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b9671471f expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1777051244.224597:0:6577:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1777051244.224601:0:6577:0:(mgc_request.c:1799:mgc_process_log()) Process log lustre-client-ffff99da57ae9000 from 64 10000000:01000000:0.0:1777051244.224607:0:6577:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1777051244.224657:0:6577:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.146@tcp lock: ffff99da7d507600/0x85f51a6b96714726 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051244.224674:0:6577:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.146@tcp lock: ffff99da7d507600/0x85f51a6b96714726 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051244.224690:0:6577:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.146@tcp lock: ffff99da7d507600/0x85f51a6b96714726 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051244.224718:0:6577:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f9fd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452503680:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1777051244.224790:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051244.224845:0:6577:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d942ccd480 going to sleep for 11 seconds 00000100:00100000:1.0:1777051244.225461:0:6577:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f9fd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452503680:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1777051244.225562:0:6577:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.146@tcp lock: ffff99da7d507600/0x85f51a6b96714726 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b9671472d expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051244.225584:0:6577:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.146@tcp lock: ffff99da7d507600/0x85f51a6b96714726 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x85f51a6b9671472d expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051244.225700:0:6577:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da44977100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452503808:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1777051244.225762:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051244.225818:0:6577:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d95d8383c0 going to sleep for 11 seconds 00000100:00100000:3.0:1777051244.225962:0:101425:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452503808 00000100:00100000:3.0:1777051244.225974:0:101425:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452503808 00000100:00100000:3.0:1777051244.226044:0:101425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1777051244.226061:0:101425:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7d9ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9351a01-5b0e-4470-97fd-58b9b4b312a2+17:6577:x1863365452503808:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1777051244.226265:0:101425:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7d9ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9351a01-5b0e-4470-97fd-58b9b4b312a2+17:6577:x1863365452503808:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 206us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051244.226281:0:101425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1777051244.226367:0:6577:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da44977100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452503808:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1777051244.226435:0:6577:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da44977100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452503936:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1777051244.226523:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051244.226578:0:6577:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d95d8383c0 going to sleep for 11 seconds 00000040:00080000:0.0:1777051244.229501:0:101515:0:(llog.c:858:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 63 00000020:01000000:3.0:1777051244.230056:0:6577:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 64-63 (rc=0) 10000000:01000000:3.0:1777051244.230102:0:6577:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.201.146@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1777051244.230115:0:6577:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff99da7d507600/0x85f51a6b96714726 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b9671472d expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051244.230134:0:6577:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.146@tcp lock: ffff99da7d507600/0x85f51a6b96714726 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b9671472d expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1777051244.230150:0:6577:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1777051244.230154:0:6577:0:(mgc_request.c:1799:mgc_process_log()) Process log lustre-mdtir-ffff99da57ae9000 from 23 10000000:01000000:3.0:1777051244.230160:0:6577:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1777051244.230197:0:6577:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.146@tcp lock: ffff99d943ebb000/0x85f51a6b96714734 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051244.230212:0:6577:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.146@tcp lock: ffff99d943ebb000/0x85f51a6b96714734 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051244.230228:0:6577:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.146@tcp lock: ffff99d943ebb000/0x85f51a6b96714734 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051244.230300:0:6577:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955613480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452504064:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1777051244.230361:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051244.230407:0:6577:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d95c3e2f00 going to sleep for 11 seconds 00000100:00100000:3.0:1777051244.231555:0:6577:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955613480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452504064:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1777051244.231579:0:6577:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.146@tcp lock: ffff99d943ebb000/0x85f51a6b96714734 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b9671473b expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051244.231596:0:6577:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.146@tcp lock: ffff99d943ebb000/0x85f51a6b96714734 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x85f51a6b9671473b expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051244.231976:0:6577:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955613480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452504192:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1777051244.232040:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051244.232118:0:6577:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d95c3e2f00 going to sleep for 11 seconds 00000100:00100000:3.0:1777051244.233655:0:6577:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955613480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452504192:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1777051244.233785:0:6577:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.201.146@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1777051244.233797:0:6577:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff99d943ebb000/0x85f51a6b96714734 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b9671473b expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051244.233814:0:6577:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.146@tcp lock: ffff99d943ebb000/0x85f51a6b96714734 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b9671473b expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1777051244.233827:0:6577:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:3.0:1777051244.233831:0:6577:0:(mgc_request.c:1799:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 59 10000000:01000000:3.0:1777051244.233836:0:6577:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1777051244.233865:0:6577:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.146@tcp lock: ffff99d943ebb400/0x85f51a6b96714742 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051244.233881:0:6577:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.146@tcp lock: ffff99d943ebb400/0x85f51a6b96714742 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051244.233892:0:6577:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.146@tcp lock: ffff99d943ebb400/0x85f51a6b96714742 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051244.233943:0:6577:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955613480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452504320:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1777051244.233996:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051244.234070:0:6577:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da50cb1600 going to sleep for 11 seconds 00000100:00100000:0.0:1777051244.235110:0:6577:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955613480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452504320:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1777051244.235138:0:6577:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.146@tcp lock: ffff99d943ebb400/0x85f51a6b96714742 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b96714749 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051244.235159:0:6577:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.146@tcp lock: ffff99d943ebb400/0x85f51a6b96714742 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x85f51a6b96714749 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051244.235320:0:6577:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f9fd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452504448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1777051244.235395:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051244.235442:0:6577:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d942ccd840 going to sleep for 11 seconds 00000100:00100000:3.0:1777051244.236407:0:101422:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452504448 00000100:00100000:3.0:1777051244.236419:0:101422:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452504448 00000100:00100000:3.0:1777051244.236495:0:101422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1777051244.236521:0:101422:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942ed6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9351a01-5b0e-4470-97fd-58b9b4b312a2+19:6577:x1863365452504448:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1777051244.236774:0:101422:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942ed6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9351a01-5b0e-4470-97fd-58b9b4b312a2+19:6577:x1863365452504448:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 261us (1377us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051244.236791:0:101422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1777051244.236995:0:6577:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f9fd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452504448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1777051244.237067:0:6577:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f9fd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452504576:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1777051244.237153:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051244.237230:0:6577:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d942ccd840 going to sleep for 11 seconds 00000100:00100000:3.0:1777051244.239046:0:6577:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f9fd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452504576:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1777051244.241580:0:101516:0:(llog.c:858:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 64768 count 58 00000020:01000000:1.0:1777051244.242123:0:6577:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 59-58 (rc=0) 10000000:01000000:1.0:1777051244.242169:0:6577:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.201.146@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1777051244.242182:0:6577:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff99d943ebb400/0x85f51a6b96714742 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b96714749 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051244.242205:0:6577:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.146@tcp lock: ffff99d943ebb400/0x85f51a6b96714742 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b96714749 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1777051244.242226:0:6577:0:(mgc_request.c:611:do_requeue()) updating log lustre-barrier 10000000:01000000:1.0:1777051244.242233:0:6577:0:(mgc_request.c:1799:mgc_process_log()) Process log lustre-barrier-ffff99da57ae9000 from 1 10000000:01000000:1.0:1777051244.242239:0:6577:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1777051244.242287:0:6577:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.146@tcp lock: ffff99d955a8f000/0x85f51a6b96714750 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051244.242304:0:6577:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.146@tcp lock: ffff99d955a8f000/0x85f51a6b96714750 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051244.242322:0:6577:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.146@tcp lock: ffff99d955a8f000/0x85f51a6b96714750 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051244.242360:0:6577:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da44976300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452504704:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1777051244.242434:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051244.242524:0:6577:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da43823900 going to sleep for 11 seconds 00000100:00100000:3.0:1777051244.242614:0:101427:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452504704 00000100:00100000:3.0:1777051244.242628:0:101427:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452504704 00000100:00100000:3.0:1777051244.242703:0:101427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1777051244.242723:0:101427:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942ed6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f9351a01-5b0e-4470-97fd-58b9b4b312a2+19:6577:x1863365452504704:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1777051244.242743:0:101427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777051244.242764:0:101427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d943ebac00/0x85f51a6b96714757 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x85f51a6b96714750 expref: -99 pid: 101427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051244.242808:0:101427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d943ebac00/0x85f51a6b96714757 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x85f51a6b96714750 expref: 20 pid: 101427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051244.242827:0:101427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d943ebac00/0x85f51a6b96714757 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b96714750 expref: 20 pid: 101427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051244.242844:0:101427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d943ebac00, rc 0) 00000100:00100000:3.0:1777051244.242958:0:101427:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942ed6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f9351a01-5b0e-4470-97fd-58b9b4b312a2+20:6577:x1863365452504704:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 239us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051244.242971:0:101427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1777051244.243599:0:6577:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da44976300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452504704:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1777051244.243627:0:6577:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.146@tcp lock: ffff99d955a8f000/0x85f51a6b96714750 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b96714757 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051244.243648:0:6577:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.146@tcp lock: ffff99d955a8f000/0x85f51a6b96714750 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x85f51a6b96714757 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1777051244.243673:0:6577:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.201.146@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1777051244.243681:0:6577:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff99d955a8f000/0x85f51a6b96714750 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b96714757 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051244.243697:0:6577:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.146@tcp lock: ffff99d955a8f000/0x85f51a6b96714750 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b96714757 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1777051244.243711:0:6577:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1777051244.243716:0:6577:0:(mgc_request.c:1799:mgc_process_log()) Process log nodemap-ffff99da70a599c0 from 1 10000000:01000000:0.0:1777051244.243721:0:6577:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1777051244.243779:0:6577:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.146@tcp lock: ffff99da7d506000/0x85f51a6b9671475e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051244.243802:0:6577:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.146@tcp lock: ffff99da7d506000/0x85f51a6b9671475e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051244.243819:0:6577:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.146@tcp lock: ffff99da7d506000/0x85f51a6b9671475e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051244.243848:0:6577:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f9fe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452504832:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1777051244.243949:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051244.244173:0:6577:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d942ccd240 going to sleep for 11 seconds 00000100:00100000:3.0:1777051244.244417:0:101422:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452504832 00000100:00100000:3.0:1777051244.244427:0:101422:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452504832 00000100:00100000:3.0:1777051244.244513:0:101422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1777051244.244530:0:101422:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fca4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9351a01-5b0e-4470-97fd-58b9b4b312a2+20:6577:x1863365452504832:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1777051244.244546:0:101422:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777051244.244567:0:101422:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d943ebbe00/0x85f51a6b96714765 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x85f51a6b9671475e expref: -99 pid: 101422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051244.244598:0:101422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d943ebbe00/0x85f51a6b96714765 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x85f51a6b9671475e expref: 21 pid: 101422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051244.244617:0:101422:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d943ebbe00/0x85f51a6b96714765 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b9671475e expref: 21 pid: 101422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051244.244633:0:101422:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d943ebbe00, rc 0) 00000100:00100000:3.0:1777051244.245126:0:101422:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fca4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9351a01-5b0e-4470-97fd-58b9b4b312a2+21:6577:x1863365452504832:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 597us (1207us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051244.245142:0:101422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1777051244.249057:0:101425:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452504960 00000100:00100000:3.0:1777051244.249358:0:101425:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452504960 00000100:00100000:3.0:1777051244.249417:0:101425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1777051244.249434:0:101425:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fca5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9351a01-5b0e-4470-97fd-58b9b4b312a2+21:6577:x1863365452504960:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1777051244.249449:0:101425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777051244.249468:0:101425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d943ebbc00/0x85f51a6b96714773 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x85f51a6b9671476c expref: -99 pid: 101425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051244.249497:0:101425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d943ebbc00/0x85f51a6b96714773 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x85f51a6b9671476c expref: 22 pid: 101425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051244.249513:0:101425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d943ebbc00/0x85f51a6b96714773 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b9671476c expref: 22 pid: 101425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051244.249526:0:101425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d943ebbc00, rc 0) 00000100:00100000:3.0:1777051244.249612:0:101425:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fca5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9351a01-5b0e-4470-97fd-58b9b4b312a2+22:6577:x1863365452504960:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 181us (3956us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051244.249625:0:101425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1777051244.250104:0:6577:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955505180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452504960:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1777051244.250130:0:6577:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.146@tcp lock: ffff99d94ffbd800/0x85f51a6b9671476c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b96714773 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051244.250147:0:6577:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.146@tcp lock: ffff99d94ffbd800/0x85f51a6b9671476c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x85f51a6b96714773 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051244.250241:0:6577:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f9fea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452505088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1777051244.250293:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051244.250350:0:6577:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d942ccd780 going to sleep for 11 seconds 00000100:00100000:3.0:1777051244.250370:0:101427:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452505088 00000100:00100000:3.0:1777051244.250381:0:101427:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452505088 00000100:00100000:3.0:1777051244.250445:0:101427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1777051244.250460:0:101427:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7f989050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f9351a01-5b0e-4470-97fd-58b9b4b312a2+22:6577:x1863365452505088:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1777051244.250904:0:101427:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7f989050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f9351a01-5b0e-4470-97fd-58b9b4b312a2+22:6577:x1863365452505088:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 446us (608us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051244.250950:0:101427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1777051244.251682:0:6577:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f9fea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452505088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1777051244.251739:0:6577:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f9fea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452505216:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1777051244.251807:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051244.251859:0:6577:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d942ccd780 going to sleep for 11 seconds 00000100:00100000:3.0:1777051244.252009:0:101429:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452505216 00000100:00100000:3.0:1777051244.252021:0:101429:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452505216 00000100:00100000:3.0:1777051244.252085:0:101429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1777051244.252098:0:101429:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7f989850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f9351a01-5b0e-4470-97fd-58b9b4b312a2+22:6577:x1863365452505216:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1777051244.252255:0:101429:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7f989850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f9351a01-5b0e-4470-97fd-58b9b4b312a2+22:6577:x1863365452505216:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 156us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051244.252271:0:101429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000020:01000000:0.0:1777051244.260346:0:6577:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 37-36 (rc=0) 10000000:01000000:0.0:1777051244.260391:0:6577:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.201.146@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1777051244.260407:0:6577:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff99d94ffbd800/0x85f51a6b9671476c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b96714773 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051244.260424:0:6577:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.146@tcp lock: ffff99d94ffbd800/0x85f51a6b9671476c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b96714773 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1777051244.260436:0:6577:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1777051244.260438:0:6577:0:(mgc_request.c:1799:mgc_process_log()) Process log lustre-sptlrpc-ffff99da70a599c0 from 1 10000000:01000000:0.0:1777051244.260441:0:6577:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1777051244.260479:0:6577:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.146@tcp lock: ffff99da7d507a00/0x85f51a6b9671477a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051244.260494:0:6577:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.146@tcp lock: ffff99da7d507a00/0x85f51a6b9671477a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051244.260513:0:6577:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.146@tcp lock: ffff99da7d507a00/0x85f51a6b9671477a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051244.260548:0:6577:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f9fed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452505344:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1777051244.260631:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051244.260697:0:6577:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d942ccd840 going to sleep for 11 seconds 00000100:00100000:0.0:1777051244.261185:0:6577:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f9fed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452505344:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1777051244.261212:0:6577:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.146@tcp lock: ffff99da7d507a00/0x85f51a6b9671477a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b96714781 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051244.261232:0:6577:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.146@tcp lock: ffff99da7d507a00/0x85f51a6b9671477a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x85f51a6b96714781 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051244.261320:0:6577:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f9fed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452505472:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1777051244.261399:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051244.261518:0:6577:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d942ccd840 going to sleep for 11 seconds 00000100:00100000:0.0:1777051244.262390:0:6577:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f9fed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452505472:0@lo:501:ll_cfg_requeue.0 10000000:01000000:0.0:1777051244.262447:0:6577:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.201.146@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1777051244.262459:0:6577:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff99da7d507a00/0x85f51a6b9671477a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b96714781 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051244.262476:0:6577:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.146@tcp lock: ffff99da7d507a00/0x85f51a6b9671477a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b96714781 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051244.312088:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da44977480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452505600:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1777051244.312209:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051244.312402:0:10113:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452505600 00000100:00100000:3.0:1777051244.312415:0:10113:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452505600 00000100:00100000:3.0:1777051244.312497:0:10113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5516 00000100:00100000:3.0:1777051244.312511:0:10113:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3678:x1863365452505600:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1777051244.312548:0:10113:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 430295232 pending 0 free 3645853696 avail 3414331392 00000100:00100000:3.0:1777051244.312635:0:10113:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3678:x1863365452505600:12345-0@lo:13:osp-pre-1-1.0 Request processed in 124us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051244.312650:0:10113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5516 00000100:00100000:1.0:1777051244.312708:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da44977480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452505600:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1777051244.630527:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777051244.823779:0:8473:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452505728 00000100:00100000:3.0:1777051244.823792:0:8473:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452505728 00000100:00100000:3.0:1777051244.823870:0:8473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5517 00000100:00100000:3.0:1777051244.823883:0:8473:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955505180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3680:x1863365452505728:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1777051244.823958:0:8473:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 440355008 pending 0 free 3862671360 avail 3631149056 00000100:00100000:3.0:1777051244.824030:0:8473:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955505180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3680:x1863365452505728:12345-0@lo:13:osp-pre-0-1.0 Request processed in 149us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051244.824040:0:8473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5517 00000100:00100000:3.0:1777051244.824107:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955506300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3680:1863365452505728:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1777051245.478534:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051245.478583:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051245.478644:0:101429:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425846912 00000100:00100000:0.0:1777051245.478645:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051245.478662:0:101429:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425846912 00000100:00100000:0.0:1777051245.479026:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051245.479045:0:101429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 61 00000100:00100000:1.0:1777051245.479061:0:101429:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942b87050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:0+-99:2437:x1863365425846912:12345-192.168.201.46@tcp:400:kworker.0 00000020:00080000:1.0:1777051245.479078:0:101429:0:(tgt_handler.c:795:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.201.46@tcp 00000100:00100000:0.0:1777051245.479131:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051245.479189:0:101429:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942b87050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:0+-99:2437:x1863365425846912:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 126us (660us total) trans 0 rc -107/-107 00000100:00100000:0.0:1777051245.479230:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051245.479254:0:101429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 61 00000100:00080000:1.0:1777051245.479342:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1777051245.479435:0:46497:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425847680 00000100:00100000:1.0:1777051245.479446:0:46497:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425847680 00000100:00100000:0.0:1777051245.479473:0:6580:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425847168 00000100:00100000:0.0:1777051245.479484:0:6580:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425847168 00000100:00100000:1.0:1777051245.479534:0:46497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13092 00000100:00100000:1.0:1777051245.479556:0:46497:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+48:2437:x1863365425847680:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:0.0:1777051245.479572:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111656 00000100:00100000:0.0:1777051245.479593:0:6580:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2435:x1863365425847040:12345-192.168.201.46@tcp:38:kworker.0 00010000:00080000:0.0:1777051245.479626:0:6580:0:(ldlm_lib.c:926:target_handle_reconnect()) connect export for UUID 'c11b6966-0775-44d2-bdc6-c74c26eb2226' at ffff99d950ad8000, cookie 0x85f51a6b96714615 00000100:00100000:1.0:1777051245.479638:0:46497:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+48:2437:x1863365425847680:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 87us (611us total) trans 0 rc 0/0 00010000:00080000:0.0:1777051245.479639:0:6580:0:(ldlm_lib.c:1431:target_handle_connect()) lustre-MDT0000: connection from c11b6966-0775-44d2-bdc6-c74c26eb2226@192.168.201.46@tcp recovering/t8590016948 exp ffff99d950ad8000 cur 7874 last 1777051243 00010000:02000400:0.0:1777051245.479665:0:6580:0:(ldlm_lib.c:2022:target_start_recovery_timer()) lustre-MDT0000: Will be in recovery for at least 1:00, or until 3 clients reconnect 00000100:00100000:1.0:1777051245.479669:0:46497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13092 00000100:00100000:1.0:1777051245.479715:0:46497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111657 00000100:00100000:1.0:1777051245.479728:0:46497:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95aece680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:0+-99:2435:x1863365425847552:12345-192.168.201.46@tcp:38:kworker.0 00010000:00080000:1.0:1777051245.480082:0:46497:0:(ldlm_lib.c:926:target_handle_reconnect()) connect export for UUID '2dd4696c-edce-4cd1-86d2-dbd2ff957fa1' at ffff99d950adc800, cookie 0x85f51a6b9671460e 00010000:00080000:1.0:1777051245.480093:0:46497:0:(ldlm_lib.c:1431:target_handle_connect()) lustre-MDT0000: connection from 2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp recovering/t8590016949 exp ffff99d950adc800 cur 7874 last 1777051243 00010000:00080000:1.0:1777051245.480111:0:46497:0:(ldlm_lib.c:2086:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 70 seconds 00000004:00100000:1.0:1777051245.480150:0:46497:0:(mdt_handler.c:7281:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type b7, return b7 00000100:00080000:1.0:1777051245.480482:0:46497:0:(import.c:65:import_set_state_nolock()) ffff99d9434a0800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1777051245.480556:0:46497:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95aece680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+6:2435:x1863365425847552:12345-192.168.201.46@tcp:38:kworker.0 Request processed in 826us (1359us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051245.480578:0:46497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111657 00000100:00100000:1.0:1777051245.480630:0:13320:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425847808 00000100:00100000:1.0:1777051245.480641:0:13320:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425847808 00000100:00100000:1.0:1777051245.480713:0:13320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10164 00000100:00100000:1.0:1777051245.480731:0:13320:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955506300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+48:2436:x1863365425847424:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:1.0:1777051245.480794:0:13320:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955506300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+48:2436:x1863365425847424:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 65us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051245.480823:0:13320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10164 00000100:00100000:1.0:1777051245.490472:0:6581:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425848064 00000100:00100000:1.0:1777051245.490486:0:6581:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425848064 00000100:00100000:1.0:1777051245.490586:0:6581:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425848192 00000100:00100000:1.0:1777051245.490595:0:6581:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425848192 00000100:00100000:1.0:1777051245.490638:0:6581:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425848320 00000100:00100000:1.0:1777051245.490645:0:6581:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425848320 00000100:00100000:1.0:1777051245.490675:0:6581:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425848448 00000100:00100000:1.0:1777051245.490680:0:6581:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425848448 00000100:00100000:1.0:1777051245.490712:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111658 00000100:00100000:1.0:1777051245.490728:0:6581:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955ebf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+9:2435:x1863365425848064:12345-192.168.201.46@tcp:101:ldlm_lock_repla.0 00010000:00080000:1.0:1777051245.490795:0:6581:0:(ldlm_lib.c:3170:target_queue_recovery_request()) @@@ queue lock replay req req@ffff99d955ebf800 x1863365425848064/t0(0) o101->2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp:206/0 lens 328/0 e 0 to 0 dl 1777051256 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1777051245.490839:0:6581:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955ebf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+9:2435:x1863365425848064:12345-192.168.201.46@tcp:101:ldlm_lock_repla.0 Request processed in 110us (491us total) trans 0 rc 0/-999 00000100:00100000:1.0:1777051245.490854:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111658 00000100:00100000:1.0:1777051245.490872:0:6581:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425848576 00000100:00100000:1.0:1777051245.490878:0:6581:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425848576 00000100:00100000:1.0:1777051245.490938:0:6581:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425848704 00000100:00100000:1.0:1777051245.490945:0:6581:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425848704 00000100:00100000:1.0:1777051245.490970:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111659 00000100:00100000:1.0:1777051245.490981:0:6581:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94e627100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+11:2435:x1863365425848192:12345-192.168.201.46@tcp:101:ldlm_lock_repla.0 00010000:00080000:1.0:1777051245.491000:0:6581:0:(ldlm_lib.c:3170:target_queue_recovery_request()) @@@ queue lock replay req req@ffff99d94e627100 x1863365425848192/t0(0) o101->2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp:206/0 lens 328/0 e 0 to 0 dl 1777051256 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1777051245.491066:0:6581:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94e627100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+11:2435:x1863365425848192:12345-192.168.201.46@tcp:101:ldlm_lock_repla.0 Request processed in 39us (597us total) trans 0 rc 0/-999 00000100:00100000:1.0:1777051245.491081:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111659 00000100:00100000:1.0:1777051245.491102:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111660 00000100:00100000:1.0:1777051245.491125:0:6581:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94e627800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+11:2435:x1863365425848320:12345-192.168.201.46@tcp:101:ldlm_lock_repla.0 00010000:00080000:1.0:1777051245.491155:0:6581:0:(ldlm_lib.c:3170:target_queue_recovery_request()) @@@ queue lock replay req req@ffff99d94e627800 x1863365425848320/t0(0) o101->2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp:206/0 lens 328/0 e 0 to 0 dl 1777051256 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1777051245.491177:0:6581:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94e627800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+11:2435:x1863365425848320:12345-192.168.201.46@tcp:101:ldlm_lock_repla.0 Request processed in 65us (688us total) trans 0 rc 0/-999 00000100:00100000:1.0:1777051245.491188:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111660 00000100:00100000:1.0:1777051245.491203:0:6581:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425848832 00000100:00100000:1.0:1777051245.491210:0:6581:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425848832 00000100:00100000:1.0:1777051245.491251:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111661 00000100:00100000:1.0:1777051245.491272:0:6581:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94e625180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+12:2435:x1863365425848448:12345-192.168.201.46@tcp:101:ldlm_lock_repla.0 00010000:00080000:1.0:1777051245.491291:0:6581:0:(ldlm_lib.c:3170:target_queue_recovery_request()) @@@ queue lock replay req req@ffff99d94e625180 x1863365425848448/t0(0) o101->2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp:206/0 lens 328/0 e 0 to 0 dl 1777051256 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1777051245.491314:0:6581:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94e625180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+12:2435:x1863365425848448:12345-192.168.201.46@tcp:101:ldlm_lock_repla.0 Request processed in 46us (764us total) trans 0 rc 0/-999 00000100:00100000:1.0:1777051245.491331:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111661 00000100:00100000:1.0:1777051245.491354:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111662 00000100:00100000:1.0:1777051245.491370:0:6581:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fdf1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+13:2435:x1863365425848576:12345-192.168.201.46@tcp:101:ldlm_lock_repla.0 00010000:00080000:1.0:1777051245.491384:0:6581:0:(ldlm_lib.c:3170:target_queue_recovery_request()) @@@ queue lock replay req req@ffff99da7fdf1880 x1863365425848576/t0(0) o101->2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp:206/0 lens 328/0 e 0 to 0 dl 1777051256 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1777051245.491395:0:6581:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fdf1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+13:2435:x1863365425848576:12345-192.168.201.46@tcp:101:ldlm_lock_repla.0 Request processed in 34us (628us total) trans 0 rc 0/-999 00000100:00100000:1.0:1777051245.491870:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111662 00000100:00100000:1.0:1777051245.491931:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111664 00000100:00100000:1.0:1777051245.491956:0:6581:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95a580380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+13:2435:x1863365425848832:12345-192.168.201.46@tcp:101:ldlm_lock_repla.0 00010000:00080000:1.0:1777051245.491985:0:6581:0:(ldlm_lib.c:3170:target_queue_recovery_request()) @@@ queue lock replay req req@ffff99d95a580380 x1863365425848832/t0(0) o101->2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp:206/0 lens 328/0 e 0 to 0 dl 1777051256 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1777051245.492023:0:6581:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95a580380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+13:2435:x1863365425848832:12345-192.168.201.46@tcp:101:ldlm_lock_repla.0 Request processed in 75us (901us total) trans 0 rc 0/-999 00000100:00100000:1.0:1777051245.492243:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111664 00010000:00080000:1.0:1777051245.492301:0:101457:0:(ldlm_lib.c:2531:check_for_recovery_ready()) connected 1 stale 0 max_recoverable_clients 3 abort 0 expired 0 00000004:00100000:1.0:1777051245.502038:0:6580:0:(mdt_handler.c:7281:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type b7, return b7 00000100:00080000:1.0:1777051245.502128:0:6580:0:(import.c:65:import_set_state_nolock()) ffff99d9434a4800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1777051245.502278:0:6580:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+6:2435:x1863365425847040:12345-192.168.201.46@tcp:38:kworker.0 Request processed in 22684us (23630us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051245.502297:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111656 00000100:00100000:1.0:1777051245.505595:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051245.506417:0:101425:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425849088 00000100:00100000:3.0:1777051245.506433:0:101425:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425849088 00000100:00100000:3.0:1777051245.506518:0:101425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 62 00000100:00100000:3.0:1777051245.506533:0:101425:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942b85850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2435:x1863365425849088:12345-192.168.201.46@tcp:250:ptlrpcd_00_01.0 00010000:00080000:3.0:1777051245.506575:0:101425:0:(ldlm_lib.c:1431:target_handle_connect()) MGS: connection from 29c4352d-3260-4734-909d-9ea5de9e7fa4@192.168.201.46@tcp t0 exp 0000000000000000 cur 7874 last 0 00000020:00000080:3.0:1777051245.506624:0:101425:0:(genops.c:1406:class_connect()) connect: client 29c4352d-3260-4734-909d-9ea5de9e7fa4, cookie 0x85f51a6b96714788 00000100:00080000:3.0:1777051245.507187:0:101425:0:(import.c:65:import_set_state_nolock()) ffff99d944b1f800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1777051245.507341:0:101425:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942b85850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29c4352d-3260-4734-909d-9ea5de9e7fa4+4:2435:x1863365425849088:12345-192.168.201.46@tcp:250:ptlrpcd_00_01.0 Request processed in 804us (1748us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051245.507360:0:101425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 62 00000100:00100000:1.0:1777051245.510563:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051245.510741:0:27882:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425849216 00000100:00100000:0.0:1777051245.510752:0:27882:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425849216 00000100:00100000:0.0:1777051245.510868:0:27882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111666 00000100:00100000:0.0:1777051245.510887:0:27882:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da44977480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+6:2435:x1863365425849216:12345-192.168.201.46@tcp:101:ldlm_lock_repla.0 00010000:00080000:0.0:1777051245.511062:0:27882:0:(ldlm_lib.c:3170:target_queue_recovery_request()) @@@ queue lock replay req req@ffff99da44977480 x1863365425849216/t0(0) o101->c11b6966-0775-44d2-bdc6-c74c26eb2226@192.168.201.46@tcp:206/0 lens 328/0 e 0 to 0 dl 1777051256 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1777051245.511109:0:27882:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da44977480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+6:2435:x1863365425849216:12345-192.168.201.46@tcp:101:ldlm_lock_repla.0 Request processed in 228us (551us total) trans 0 rc 0/-999 00000100:00100000:0.0:1777051245.511122:0:27882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111666 00010000:00080000:1.0:1777051245.511850:0:101457:0:(ldlm_lib.c:2531:check_for_recovery_ready()) connected 2 stale 0 max_recoverable_clients 3 abort 0 expired 0 00000100:00100000:1.0:1777051245.512961:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051245.513409:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051245.513458:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051245.513499:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051245.513538:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051245.513627:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051245.513670:0:10328:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425849344 00000100:00100000:1.0:1777051245.513678:0:10328:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425849344 00000100:00100000:1.0:1777051245.513724:0:10328:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425849472 00000100:00100000:1.0:1777051245.513731:0:10328:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425849472 00000100:00100000:1.0:1777051245.513759:0:10328:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425849600 00000100:00100000:1.0:1777051245.513764:0:10328:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425849600 00000100:00100000:1.0:1777051245.513784:0:10328:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425849728 00000100:00100000:1.0:1777051245.513788:0:10328:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425849728 00000100:00100000:1.0:1777051245.513813:0:10328:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425849856 00000100:00100000:1.0:1777051245.513818:0:10328:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425849856 00000100:00100000:1.0:1777051245.513836:0:10328:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425849984 00000100:00100000:1.0:1777051245.513839:0:10328:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425849984 00000100:00100000:1.0:1777051245.513863:0:10328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111667 00000100:00100000:1.0:1777051245.513876:0:10328:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da44975180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+12:2435:x1863365425849344:12345-192.168.201.46@tcp:101:ldlm_lock_repla.0 00010000:00080000:1.0:1777051245.513922:0:10328:0:(ldlm_lib.c:3170:target_queue_recovery_request()) @@@ queue lock replay req req@ffff99da44975180 x1863365425849344/t0(0) o101->c11b6966-0775-44d2-bdc6-c74c26eb2226@192.168.201.46@tcp:206/0 lens 328/0 e 0 to 0 dl 1777051256 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1777051245.513954:0:10328:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da44975180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+12:2435:x1863365425849344:12345-192.168.201.46@tcp:101:ldlm_lock_repla.0 Request processed in 80us (1001us total) trans 0 rc 0/-999 00000100:00100000:1.0:1777051245.513967:0:10328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111667 00000100:00100000:1.0:1777051245.513987:0:10328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111668 00000100:00100000:1.0:1777051245.514000:0:10328:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da44976a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+12:2435:x1863365425849472:12345-192.168.201.46@tcp:101:ldlm_lock_repla.0 00010000:00080000:1.0:1777051245.514017:0:10328:0:(ldlm_lib.c:3170:target_queue_recovery_request()) @@@ queue lock replay req req@ffff99da44976a00 x1863365425849472/t0(0) o101->c11b6966-0775-44d2-bdc6-c74c26eb2226@192.168.201.46@tcp:206/0 lens 328/0 e 0 to 0 dl 1777051256 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1777051245.514047:0:10328:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da44976a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+12:2435:x1863365425849472:12345-192.168.201.46@tcp:101:ldlm_lock_repla.0 Request processed in 51us (641us total) trans 0 rc 0/-999 00000100:00100000:1.0:1777051245.514057:0:10328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111668 00000100:00100000:1.0:1777051245.514076:0:10328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111669 00000100:00100000:1.0:1777051245.514394:0:10328:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da44974a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+12:2435:x1863365425849600:12345-192.168.201.46@tcp:101:ldlm_lock_repla.0 00000100:00100000:0.0:1777051245.514412:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111670 00010000:00080000:1.0:1777051245.514420:0:10328:0:(ldlm_lib.c:3170:target_queue_recovery_request()) @@@ queue lock replay req req@ffff99da44974a80 x1863365425849600/t0(0) o101->c11b6966-0775-44d2-bdc6-c74c26eb2226@192.168.201.46@tcp:206/0 lens 328/0 e 0 to 0 dl 1777051256 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1777051245.514442:0:6579:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da44975880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+12:2435:x1863365425849728:12345-192.168.201.46@tcp:101:ldlm_lock_repla.0 00000100:00100000:1.0:1777051245.514452:0:10328:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da44974a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+12:2435:x1863365425849600:12345-192.168.201.46@tcp:101:ldlm_lock_repla.0 Request processed in 359us (989us total) trans 0 rc 0/-999 00000100:00100000:1.0:1777051245.514469:0:10328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111669 00010000:00080000:0.0:1777051245.514478:0:6579:0:(ldlm_lib.c:3170:target_queue_recovery_request()) @@@ queue lock replay req req@ffff99da44975880 x1863365425849728/t0(0) o101->c11b6966-0775-44d2-bdc6-c74c26eb2226@192.168.201.46@tcp:206/0 lens 328/0 e 0 to 0 dl 1777051256 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1777051245.514499:0:10328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111671 00000100:00100000:0.0:1777051245.514509:0:6579:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da44975880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+12:2435:x1863365425849728:12345-192.168.201.46@tcp:101:ldlm_lock_repla.0 Request processed in 74us (1006us total) trans 0 rc 0/-999 00000100:00100000:1.0:1777051245.514525:0:10328:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da44976300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+12:2435:x1863365425849856:12345-192.168.201.46@tcp:101:ldlm_lock_repla.0 00010000:00080000:1.0:1777051245.514548:0:10328:0:(ldlm_lib.c:3170:target_queue_recovery_request()) @@@ queue lock replay req req@ffff99da44976300 x1863365425849856/t0(0) o101->c11b6966-0775-44d2-bdc6-c74c26eb2226@192.168.201.46@tcp:206/0 lens 328/0 e 0 to 0 dl 1777051256 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1777051245.514556:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111670 00000100:00100000:1.0:1777051245.514579:0:10328:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da44976300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+12:2435:x1863365425849856:12345-192.168.201.46@tcp:101:ldlm_lock_repla.0 Request processed in 66us (1040us total) trans 0 rc 0/-999 00000100:00100000:0.0:1777051245.514594:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111672 00000100:00100000:0.0:1777051245.514612:0:6579:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da44977100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+12:2435:x1863365425849984:12345-192.168.201.46@tcp:101:ldlm_lock_repla.0 00010000:00080000:0.0:1777051245.514632:0:6579:0:(ldlm_lib.c:3170:target_queue_recovery_request()) @@@ queue lock replay req req@ffff99da44977100 x1863365425849984/t0(0) o101->c11b6966-0775-44d2-bdc6-c74c26eb2226@192.168.201.46@tcp:206/0 lens 328/0 e 0 to 0 dl 1777051256 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1777051245.514653:0:6579:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da44977100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+12:2435:x1863365425849984:12345-192.168.201.46@tcp:101:ldlm_lock_repla.0 Request processed in 48us (1028us total) trans 0 rc 0/-999 00010000:00080000:3.0:1777051245.515475:0:101457:0:(ldlm_lib.c:2531:check_for_recovery_ready()) connected 2 stale 0 max_recoverable_clients 3 abort 0 expired 0 00000100:00100000:1.0:1777051245.515884:0:10328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111671 00000100:00100000:0.0:1777051245.516049:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111672 00000100:00100000:0.0:1777051247.011571:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051247.015386:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051247.015436:0:101422:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425850240 00000100:00100000:3.0:1777051247.015444:0:101422:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425850240 00000100:00100000:3.0:1777051247.015499:0:101422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 64 00000100:00100000:3.0:1777051247.015512:0:101422:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5fa2c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29c4352d-3260-4734-909d-9ea5de9e7fa4+5:6255:x1863365425850240:12345-192.168.201.46@tcp:256:ll_cfg_requeue.0 20000000:01000000:1.0:1777051247.015581:0:101422:0:(mgs_nids.c:912:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 16384. 20000000:01000000:1.0:1777051247.015616:0:101422:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1777051247.015624:0:101422:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:1.0:1777051247.015630:0:101422:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:1.0:1777051247.015635:0:101422:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:1.0:1777051247.015640:0:101422:0:(mgs_nids.c:316:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 26 00000100:00100000:1.0:1777051247.019225:0:101422:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5fa2c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29c4352d-3260-4734-909d-9ea5de9e7fa4+5:6255:x1863365425850240:12345-192.168.201.46@tcp:256:ll_cfg_requeue.0 Request processed in 3710us (4171us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051247.019253:0:101422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 64 00000100:00100000:3.0:1777051247.021778:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051247.021902:0:101425:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425850368 00000100:00100000:0.0:1777051247.021913:0:101425:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425850368 00000100:00100000:0.0:1777051247.022000:0:101425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 65 00000100:00100000:0.0:1777051247.022016:0:101425:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5fa2dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29c4352d-3260-4734-909d-9ea5de9e7fa4+5:6255:x1863365425850368:12345-192.168.201.46@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1777051247.022032:0:101425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051247.022053:0:101425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99da713e3a00/0x85f51a6b96714796 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b5e85 expref: -99 pid: 101425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051247.022388:0:101425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99da713e3a00/0x85f51a6b96714796 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5e85 expref: 6 pid: 101425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051247.022417:0:101425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99da713e3a00/0x85f51a6b96714796 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5e85 expref: 6 pid: 101425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051247.022433:0:101425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99da713e3a00, rc 0) 00000100:00100000:0.0:1777051247.022492:0:101425:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5fa2dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29c4352d-3260-4734-909d-9ea5de9e7fa4+6:6255:x1863365425850368:12345-192.168.201.46@tcp:101:ll_cfg_requeue.0 Request processed in 478us (717us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051247.022504:0:101425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 65 00000100:00100000:3.0:1777051247.028418:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051247.028495:0:101427:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425850496 00000100:00100000:0.0:1777051247.028509:0:101427:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425850496 00000100:00100000:0.0:1777051247.028577:0:101427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 66 00000100:00100000:0.0:1777051247.028593:0:101427:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5fa2c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:29c4352d-3260-4734-909d-9ea5de9e7fa4+6:6255:x1863365425850496:12345-192.168.201.46@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1777051247.028839:0:101427:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5fa2c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:29c4352d-3260-4734-909d-9ea5de9e7fa4+7:6255:x1863365425850496:12345-192.168.201.46@tcp:501:ll_cfg_requeue.0 Request processed in 247us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051247.028852:0:101427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 66 00000100:00100000:3.0:1777051247.031828:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051247.032159:0:101422:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425850624 00000100:00100000:0.0:1777051247.032171:0:101422:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425850624 00000100:00100000:0.0:1777051247.032260:0:101422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 67 00000100:00100000:0.0:1777051247.032304:0:101422:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942f30050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29c4352d-3260-4734-909d-9ea5de9e7fa4+7:6255:x1863365425850624:12345-192.168.201.46@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1777051247.032521:0:101422:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942f30050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29c4352d-3260-4734-909d-9ea5de9e7fa4+7:6255:x1863365425850624:12345-192.168.201.46@tcp:503:ll_cfg_requeue.0 Request processed in 219us (693us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051247.032534:0:101422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 67 00000100:00100000:0.0:1777051247.037088:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051247.037534:0:101429:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425850752 00000100:00100000:1.0:1777051247.037545:0:101429:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425850752 00000100:00100000:1.0:1777051247.037617:0:101429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 68 00000100:00100000:1.0:1777051247.037633:0:101429:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942f33850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:29c4352d-3260-4734-909d-9ea5de9e7fa4+7:6255:x1863365425850752:12345-192.168.201.46@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1777051247.037650:0:101429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777051247.037672:0:101429:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d955a8f400/0x85f51a6b9671479d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b5e8c expref: -99 pid: 101429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051247.037708:0:101429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d955a8f400/0x85f51a6b9671479d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5e8c expref: 8 pid: 101429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051247.037725:0:101429:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d955a8f400/0x85f51a6b9671479d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5e8c expref: 8 pid: 101429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051247.037738:0:101429:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d955a8f400, rc 0) 00000100:00100000:1.0:1777051247.037818:0:101429:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942f33850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:29c4352d-3260-4734-909d-9ea5de9e7fa4+8:6255:x1863365425850752:12345-192.168.201.46@tcp:101:ll_cfg_requeue.0 Request processed in 188us (734us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051247.037831:0:101429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 68 00000100:00100000:0.0:1777051247.041253:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051247.041304:0:101424:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425850880 00000100:00100000:1.0:1777051247.041314:0:101424:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425850880 00000100:00100000:1.0:1777051247.041381:0:101424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 69 00000100:00100000:1.0:1777051247.041396:0:101424:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942f32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29c4352d-3260-4734-909d-9ea5de9e7fa4+8:6255:x1863365425850880:12345-192.168.201.46@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1777051247.041548:0:101424:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942f32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29c4352d-3260-4734-909d-9ea5de9e7fa4+8:6255:x1863365425850880:12345-192.168.201.46@tcp:501:ll_cfg_requeue.0 Request processed in 153us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051247.041567:0:101424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 69 00000100:00100000:0.0:1777051247.045115:0:101422:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425851008 00000100:00100000:0.0:1777051247.045126:0:101422:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425851008 00000100:00100000:1.0:1777051247.045243:0:101429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 70 00000100:00100000:1.0:1777051247.045264:0:101429:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942f32450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:29c4352d-3260-4734-909d-9ea5de9e7fa4+8:6255:x1863365425851008:12345-192.168.201.46@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1777051247.045400:0:101429:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942f32450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:29c4352d-3260-4734-909d-9ea5de9e7fa4+8:6255:x1863365425851008:12345-192.168.201.46@tcp:503:ll_cfg_requeue.0 Request processed in 141us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051247.045417:0:101429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 70 00000100:00100000:0.0:1777051247.051639:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051247.051716:0:101427:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425851136 00000100:00100000:1.0:1777051247.051728:0:101427:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425851136 00000100:00100000:1.0:1777051247.051804:0:101427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 71 00000100:00100000:1.0:1777051247.051823:0:101427:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942f33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:29c4352d-3260-4734-909d-9ea5de9e7fa4+8:6255:x1863365425851136:12345-192.168.201.46@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1777051247.051844:0:101427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777051247.051896:0:101427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d955a8e400/0x85f51a6b967147a4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b5e93 expref: -99 pid: 101427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051247.051934:0:101427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d955a8e400/0x85f51a6b967147a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5e93 expref: 9 pid: 101427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051247.052003:0:101427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d955a8e400/0x85f51a6b967147a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5e93 expref: 9 pid: 101427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051247.052018:0:101427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d955a8e400, rc 0) 00000100:00100000:1.0:1777051247.052124:0:101427:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942f33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:29c4352d-3260-4734-909d-9ea5de9e7fa4+9:6255:x1863365425851136:12345-192.168.201.46@tcp:101:ll_cfg_requeue.0 Request processed in 306us (488us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051247.052137:0:101427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 71 00000100:00100000:0.0:1777051247.057337:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051247.057593:0:101424:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425851264 00000100:00100000:1.0:1777051247.057603:0:101424:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425851264 00000100:00100000:1.0:1777051247.057772:0:101424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 72 00000100:00100000:1.0:1777051247.057791:0:101424:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942f30450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29c4352d-3260-4734-909d-9ea5de9e7fa4+9:6255:x1863365425851264:12345-192.168.201.46@tcp:256:ll_cfg_requeue.0 20000000:01000000:1.0:1777051247.057820:0:101424:0:(mgs_nids.c:912:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 16384. 20000000:01000000:1.0:1777051247.057851:0:101424:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1777051247.057892:0:101424:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:1.0:1777051247.057899:0:101424:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:1.0:1777051247.057905:0:101424:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:1.0:1777051247.057911:0:101424:0:(mgs_nids.c:316:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 26 00000100:00100000:0.0:1777051247.062266:0:101424:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942f30450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29c4352d-3260-4734-909d-9ea5de9e7fa4+9:6255:x1863365425851264:12345-192.168.201.46@tcp:256:ll_cfg_requeue.0 Request processed in 4472us (4924us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051247.062286:0:101424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 72 00000100:00100000:3.0:1777051247.066990:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051247.067085:0:101429:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425851392 00000100:00100000:1.0:1777051247.067097:0:101429:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425851392 00000100:00100000:1.0:1777051247.067176:0:101429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 73 00000100:00100000:1.0:1777051247.067195:0:101429:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5fa2e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:29c4352d-3260-4734-909d-9ea5de9e7fa4+9:6255:x1863365425851392:12345-192.168.201.46@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1777051247.067215:0:101429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777051247.067241:0:101429:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d955a8fc00/0x85f51a6b967147ab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b5e9a expref: -99 pid: 101429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051247.067283:0:101429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d955a8fc00/0x85f51a6b967147ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5e9a expref: 10 pid: 101429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051247.067304:0:101429:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d955a8fc00/0x85f51a6b967147ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5e9a expref: 10 pid: 101429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051247.067320:0:101429:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d955a8fc00, rc 0) 00000100:00100000:1.0:1777051247.067395:0:101429:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5fa2e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:29c4352d-3260-4734-909d-9ea5de9e7fa4+10:6255:x1863365425851392:12345-192.168.201.46@tcp:101:ll_cfg_requeue.0 Request processed in 204us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051247.067409:0:101429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 73 00000100:00100000:3.0:1777051247.073096:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051247.073653:0:101427:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425851520 00000100:00100000:0.0:1777051247.073666:0:101427:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425851520 00000100:00100000:0.0:1777051247.073767:0:101427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 74 00000100:00100000:0.0:1777051247.073789:0:101427:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942f31050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:29c4352d-3260-4734-909d-9ea5de9e7fa4+10:6255:x1863365425851520:12345-192.168.201.46@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1777051247.074007:0:101427:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942f31050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:29c4352d-3260-4734-909d-9ea5de9e7fa4+10:6255:x1863365425851520:12345-192.168.201.46@tcp:501:ll_cfg_requeue.0 Request processed in 222us (917us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051247.074022:0:101427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 74 00000100:00100000:0.0:1777051247.079560:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051247.079655:0:101424:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425851648 00000100:00100000:1.0:1777051247.079668:0:101424:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425851648 00000100:00100000:1.0:1777051247.079740:0:101424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 75 00000100:00100000:1.0:1777051247.079759:0:101424:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942f32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29c4352d-3260-4734-909d-9ea5de9e7fa4+10:6255:x1863365425851648:12345-192.168.201.46@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1777051247.079952:0:101424:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942f32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29c4352d-3260-4734-909d-9ea5de9e7fa4+10:6255:x1863365425851648:12345-192.168.201.46@tcp:503:ll_cfg_requeue.0 Request processed in 197us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051247.079967:0:101424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 75 00000100:00100000:3.0:1777051247.085324:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051247.085404:0:101429:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425851776 00000100:00100000:1.0:1777051247.085416:0:101429:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425851776 00000100:00100000:1.0:1777051247.085481:0:101429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 76 00000100:00100000:1.0:1777051247.085496:0:101429:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f323c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:29c4352d-3260-4734-909d-9ea5de9e7fa4+10:6255:x1863365425851776:12345-192.168.201.46@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1777051247.085515:0:101429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777051247.085539:0:101429:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d955a8f200/0x85f51a6b967147b2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b5ea1 expref: -99 pid: 101429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051247.085575:0:101429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d955a8f200/0x85f51a6b967147b2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5ea1 expref: 11 pid: 101429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051247.085589:0:101429:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d955a8f200/0x85f51a6b967147b2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5ea1 expref: 11 pid: 101429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051247.085599:0:101429:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d955a8f200, rc 0) 00000100:00100000:1.0:1777051247.086022:0:101429:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f323c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:29c4352d-3260-4734-909d-9ea5de9e7fa4+11:6255:x1863365425851776:12345-192.168.201.46@tcp:101:ll_cfg_requeue.0 Request processed in 526us (703us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051247.086034:0:101429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 76 00000100:00100000:1.0:1777051247.088801:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051247.088926:0:101427:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425851904 00000100:00100000:0.0:1777051247.088938:0:101427:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425851904 00000100:00100000:0.0:1777051247.089014:0:101427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 77 00000100:00100000:0.0:1777051247.089031:0:101427:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f322050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:29c4352d-3260-4734-909d-9ea5de9e7fa4+11:6255:x1863365425851904:12345-192.168.201.46@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1777051247.089240:0:101427:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f322050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:29c4352d-3260-4734-909d-9ea5de9e7fa4+11:6255:x1863365425851904:12345-192.168.201.46@tcp:501:ll_cfg_requeue.0 Request processed in 210us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051247.089257:0:101427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 77 00000100:00100000:0.0:1777051247.091296:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051247.091385:0:101425:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425852032 00000100:00100000:1.0:1777051247.091396:0:101425:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425852032 00000100:00100000:1.0:1777051247.091474:0:101425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 78 00000100:00100000:1.0:1777051247.091490:0:101425:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f320850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29c4352d-3260-4734-909d-9ea5de9e7fa4+11:6255:x1863365425852032:12345-192.168.201.46@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1777051247.091650:0:101425:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f320850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29c4352d-3260-4734-909d-9ea5de9e7fa4+11:6255:x1863365425852032:12345-192.168.201.46@tcp:503:ll_cfg_requeue.0 Request processed in 162us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051247.091667:0:101425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 78 00000100:00100000:3.0:1777051247.095971:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051247.096133:0:101429:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425852160 00000100:00100000:1.0:1777051247.096145:0:101429:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425852160 00000100:00100000:1.0:1777051247.096224:0:101429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 79 00000100:00100000:1.0:1777051247.096241:0:101429:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f323850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:29c4352d-3260-4734-909d-9ea5de9e7fa4+11:6255:x1863365425852160:12345-192.168.201.46@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1777051247.096261:0:101429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777051247.096284:0:101429:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d955a8e800/0x85f51a6b967147b9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b5ea8 expref: -99 pid: 101429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051247.096336:0:101429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d955a8e800/0x85f51a6b967147b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5ea8 expref: 12 pid: 101429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051247.096357:0:101429:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d955a8e800/0x85f51a6b967147b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5ea8 expref: 12 pid: 101429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051247.096375:0:101429:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d955a8e800, rc 0) 00000100:00100000:1.0:1777051247.096451:0:101429:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f323850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:29c4352d-3260-4734-909d-9ea5de9e7fa4+12:6255:x1863365425852160:12345-192.168.201.46@tcp:101:ll_cfg_requeue.0 Request processed in 209us (484us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051247.096467:0:101429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 79 00000100:00100000:3.0:1777051247.101641:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051247.102027:0:101427:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425852288 00000100:00100000:1.0:1777051247.102040:0:101427:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425852288 00000100:00100000:1.0:1777051247.102215:0:101427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 80 00000100:00100000:1.0:1777051247.102235:0:101427:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d943425450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:29c4352d-3260-4734-909d-9ea5de9e7fa4+12:6255:x1863365425852288:12345-192.168.201.46@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1777051247.102408:0:101427:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d943425450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:29c4352d-3260-4734-909d-9ea5de9e7fa4+12:6255:x1863365425852288:12345-192.168.201.46@tcp:501:ll_cfg_requeue.0 Request processed in 177us (773us total) trans 0 rc -2/-2 00000100:00100000:1.0:1777051247.102423:0:101427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 80 00000001:02000400:0.0:1777051247.607607:0:101690:0:(debug.c:645:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg146-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:0.0:1777051248.406544:0:48457:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1777051248.406554:0:48457:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1777051248.406560:0:48457:0:(import.c:65:import_set_state_nolock()) ffff99da7dbeb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:3.0:1777051248.406561:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95aecd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3680:1863365452505856:0@lo:400:kworker.0 00000100:00080000:0.0:1777051248.406577:0:48457:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff99da7dbeb000 using connection 192.168.201.146@tcp/0@lo 00000100:00100000:0.0:1777051248.406629:0:48457:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d95aecc380 x1863365452505984/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1777051248.406660:0:48457:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1777051248.406664:0:48457:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1777051248.406666:0:48457:0:(import.c:65:import_set_state_nolock()) ffff99da7fa93000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1777051248.406671:0:48457:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff99da7fa93000 using connection 192.168.201.146@tcp/0@lo 00000100:00100000:0.0:1777051248.406694:0:48457:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d9418f7100 x1863365452506112/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1777051248.406711:0:48457:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1777051248.406718:0:48457:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1777051248.406721:0:48457:0:(import.c:65:import_set_state_nolock()) ffff99d94183b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1777051248.406728:0:48457:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff99d94183b000 using connection 192.168.201.146@tcp/0@lo 00000100:00100000:3.0:1777051248.406741:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051248.406750:0:48457:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d9418f6680 x1863365452506240/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1777051248.406756:0:3676:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95aecc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3676:1863365452505984:0@lo:38:kworker.0 00000100:00080000:0.0:1777051248.406880:0:48457:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:3.0:1777051248.406885:0:101425:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452505856 00000100:00080000:0.0:1777051248.406887:0:48457:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1777051248.406894:0:48457:0:(import.c:65:import_set_state_nolock()) ffff99da5f282000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:3.0:1777051248.406898:0:101425:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452505856 00000100:00080000:0.0:1777051248.406904:0:48457:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff99da5f282000 using connection 192.168.201.146@tcp/0@lo 00000100:00100000:0.0:1777051248.406932:0:48457:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d95f865180 x1863365452506624/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1777051248.406965:0:3676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051248.406978:0:101425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1777051248.406998:0:101425:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942db5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9351a01-5b0e-4470-97fd-58b9b4b312a2+23:3680:x1863365452505856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777051248.407018:0:3676:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d9418f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3676:1863365452506112:0@lo:38:kworker.0 00000100:00080000:0.0:1777051248.407082:0:48457:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1777051248.407093:0:48457:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00100000:3.0:1777051248.407093:0:101425:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942db5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9351a01-5b0e-4470-97fd-58b9b4b312a2+23:3680:x1863365452505856:12345-0@lo:400:kworker.0 Request processed in 96us (351us total) trans 0 rc 0/0 00000100:00080000:0.0:1777051248.407097:0:48457:0:(import.c:65:import_set_state_nolock()) ffff99d9410cc800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1777051248.407114:0:48457:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff99d9410cc800 using connection 192.168.201.146@tcp/0@lo 00000100:00100000:3.0:1777051248.407120:0:101425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1777051248.407130:0:3676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051248.407144:0:48457:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d944e13100 x1863365452507392/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1777051248.407181:0:3676:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d9418f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3676:1863365452506240:0@lo:38:kworker.0 00000100:00100000:0.0:1777051248.407199:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d9418f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3677:1863365452506368:0@lo:400:kworker.0 00000100:00100000:1.0:1777051248.407289:0:3676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051248.407304:0:47208:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452505984 00000100:00100000:0.0:1777051248.407312:0:47208:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452505984 00000100:00100000:1.0:1777051248.407338:0:3676:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95f865180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3676:1863365452506624:0@lo:38:kworker.0 00000100:00100000:1.0:1777051248.407399:0:3676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051248.407407:0:47208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7981 00000100:00100000:0.0:1777051248.407417:0:47208:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da44976680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:0+-99:3676:x1863365452505984:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1777051248.407440:0:3676:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d944e13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3676:1863365452507392:0@lo:38:kworker.0 00010000:00080000:0.0:1777051248.407455:0:47208:0:(ldlm_lib.c:926:target_handle_reconnect()) connect export for UUID 'lustre-MDT0001-mdtlov_UUID' at ffff99d950ade800, cookie 0x85f51a6b96714607 00010000:00080000:0.0:1777051248.407467:0:47208:0:(ldlm_lib.c:1431:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo recovering/t0 exp ffff99d950ade800 cur 7877 last 1777051243 00000004:00100000:0.0:1777051248.407496:0:47208:0:(mdt_handler.c:7285:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:1.0:1777051248.407497:0:3676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051248.407604:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95f864a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3679:1863365452506752:0@lo:400:kworker.0 00000100:00100000:1.0:1777051248.407947:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051248.407997:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d944e11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452507264:0@lo:400:kworker.0 00000100:00080000:0.0:1777051248.408336:0:47208:0:(import.c:65:import_set_state_nolock()) ffff99d944c1a800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1777051248.408349:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051248.408393:0:3679:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1777051248.408408:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95f864380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452506880:0@lo:400:kworker.0 00000100:00100000:3.0:1777051248.408432:0:8492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452506112 00000100:00100000:3.0:1777051248.408442:0:8492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452506112 00000100:00100000:0.0:1777051248.408450:0:47208:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da44976680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+6:3676:x1863365452505984:12345-0@lo:38:kworker.0 Request processed in 1029us (1488us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051248.408468:0:47208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7981 00000100:00100000:3.0:1777051248.408484:0:8492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452506240 00000100:00100000:1.0:1777051248.408493:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051248.408493:0:8492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452506240 00000100:00100000:0.0:1777051248.408515:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051248.408540:0:8492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452506624 00000100:00100000:3.0:1777051248.408548:0:8492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452506624 00000100:00100000:0.0:1777051248.408559:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da44494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3677:1863365452507008:0@lo:400:kworker.0 00000100:00100000:3.0:1777051248.408581:0:8492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452507392 00000100:00100000:3.0:1777051248.408589:0:8492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452507392 00000100:00100000:0.0:1777051248.408606:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051248.408621:0:8492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452506752 00000100:00100000:3.0:1777051248.408627:0:8492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452506752 00000100:00100000:0.0:1777051248.408667:0:6579:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452506368 00000100:00100000:3.0:1777051248.408675:0:8492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13094 00000100:00100000:0.0:1777051248.408678:0:6579:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452506368 00000100:00100000:3.0:1777051248.408692:0:8492:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95fbafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3679:x1863365452506752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777051248.408733:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13095 00000100:00100000:0.0:1777051248.408750:0:6579:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d944e13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3677:x1863365452506368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051248.408763:0:8492:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95fbafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3679:x1863365452506752:12345-0@lo:400:kworker.0 Request processed in 73us (816us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051248.408775:0:8492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13094 00000100:00100000:3.0:1777051248.408805:0:8492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111673 00000100:00100000:3.0:1777051248.408814:0:8492:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d944d2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3676:x1863365452506112:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1777051248.408828:0:6579:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d944e13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3677:x1863365452506368:12345-0@lo:400:kworker.0 Request processed in 80us (311us total) trans 0 rc 0/0 00010000:00080000:3.0:1777051248.408841:0:8492:0:(ldlm_lib.c:1431:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 7877 last 0 00000100:00100000:0.0:1777051248.408870:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13095 00000100:00100000:0.0:1777051248.408905:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111674 00000100:00100000:0.0:1777051248.408915:0:6579:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d944d29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3676:x1863365452506240:12345-0@lo:38:kworker.0 00000020:00000080:3.0:1777051248.408926:0:8492:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x85f51a6b967147c0 00000004:00100000:3.0:1777051248.408942:0:8492:0:(mdt_handler.c:7285:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00010000:00080000:0.0:1777051248.408944:0:6579:0:(ldlm_lib.c:1431:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 7877 last 0 00000100:00080000:3.0:1777051248.408983:0:8492:0:(import.c:65:import_set_state_nolock()) ffff99d944b1f000 : changing import state from RECOVER to FULL 00000020:00000080:0.0:1777051248.408992:0:6579:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x85f51a6b967147c7 00000004:00100000:0.0:1777051248.409009:0:6579:0:(mdt_handler.c:7285:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1777051248.409051:0:6579:0:(import.c:65:import_set_state_nolock()) ffff99d944c1b000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1777051248.409052:0:8492:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d944d2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3676:x1863365452506112:12345-0@lo:38:kworker.0 Request processed in 234us (1927us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051248.409070:0:8492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111673 00000100:00100000:0.0:1777051248.409416:0:6579:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d944d29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3676:x1863365452506240:12345-0@lo:38:kworker.0 Request processed in 495us (2125us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051248.409436:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111674 00000100:00100000:1.0:1777051248.409453:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7c9a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452507520:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1777051248.409471:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111675 00000100:00100000:0.0:1777051248.409481:0:6579:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d944d29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3676:x1863365452506624:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1777051248.409515:0:6579:0:(ldlm_lib.c:1431:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 7877 last 0 00000100:00100000:1.0:1777051248.409517:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:0.0:1777051248.409571:0:6579:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x85f51a6b967147ce 00000004:00100000:0.0:1777051248.409589:0:6579:0:(mdt_handler.c:7285:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:1.0:1777051248.409595:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95f864a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3679:1863365452506752:0@lo:400:kworker.0 00000100:00080000:0.0:1777051248.409632:0:6579:0:(import.c:65:import_set_state_nolock()) ffff99da45f4c000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1777051248.410051:0:13320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10167 00000100:00100000:0.0:1777051248.410059:0:6579:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d944d29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3676:x1863365452506624:12345-0@lo:38:kworker.0 Request processed in 569us (2653us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051248.410079:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111675 00000100:00100000:1.0:1777051248.410079:0:13320:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94ed2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3678:x1863365452507136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051248.410104:0:8492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111676 00000100:00100000:3.0:1777051248.410117:0:8492:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95fbac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3676:x1863365452507392:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1777051248.410144:0:8492:0:(ldlm_lib.c:1431:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 7877 last 0 00000100:00100000:1.0:1777051248.410158:0:13320:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94ed2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3678:x1863365452507136:12345-0@lo:400:kworker.0 Request processed in 88us (2604us total) trans 0 rc 0/0 00000020:00000080:3.0:1777051248.410219:0:8492:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x85f51a6b967147d5 00000004:00100000:3.0:1777051248.410233:0:8492:0:(mdt_handler.c:7285:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1777051248.410271:0:8492:0:(import.c:65:import_set_state_nolock()) ffff99d944b18800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1777051248.410287:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d9418f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3677:1863365452506368:0@lo:400:kworker.0 00000100:00100000:3.0:1777051248.410342:0:8492:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95fbac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3676:x1863365452507392:12345-0@lo:38:kworker.0 Request processed in 221us (2843us total) trans 0 rc 0/0 00010000:00080000:0.0:1777051248.410351:0:3676:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99d9418f6680 x1863365452506240/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1777051273 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777051248.410361:0:8492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111676 00000100:00080000:0.0:1777051248.410381:0:3676:0:(import.c:1130:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 6 00000100:00100000:3.0:1777051248.410416:0:6585:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452507008 00000100:00100000:3.0:1777051248.410425:0:6585:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452507008 00000100:00100000:3.0:1777051248.410463:0:6585:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452507520 00000100:00100000:3.0:1777051248.410469:0:6585:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452507520 00000100:00100000:3.0:1777051248.410497:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7982 00000100:00100000:3.0:1777051248.410508:0:6585:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f42ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:3677:x1863365452507008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051248.410565:0:6585:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f42ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:3677:x1863365452507008:12345-0@lo:400:kworker.0 Request processed in 57us (1959us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051248.410575:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7982 00000100:00100000:3.0:1777051248.410595:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7983 00000100:00100000:3.0:1777051248.410604:0:6585:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95fbac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3679:x1863365452507520:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1777051248.410631:0:6585:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4243456 pending 0 free 1446064128 avail 1299824640 00000100:00100000:3.0:1777051248.410712:0:6585:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95fbac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3679:x1863365452507520:12345-0@lo:41:osp-pre-1-0.0 Request processed in 108us (1202us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051248.410724:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7983 00000100:00100000:1.0:1777051248.410912:0:13320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10167 00000100:00100000:1.0:1777051248.410955:0:13320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10169 00000100:00100000:1.0:1777051248.410975:0:13320:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95fbad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3679:x1863365452506880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777051248.411052:0:13320:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95fbad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3679:x1863365452506880:12345-0@lo:400:kworker.0 Request processed in 84us (2584us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051248.411068:0:13320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10169 00000100:00100000:1.0:1777051248.411421:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da44494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3677:1863365452507008:0@lo:400:kworker.0 00000100:00100000:3.0:1777051248.411515:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95f864380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452506880:0@lo:400:kworker.0 00000100:00100000:3.0:1777051248.411536:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7c9a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452507520:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1777051248.411559:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d944e11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452507264:0@lo:400:kworker.0 00000100:00080000:0.0:1777051248.411936:0:3676:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0000: lwp recover req@ffff99d9418f6680 x1863365452506240/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1777051273 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1777051248.411951:0:3676:0:(import.c:65:import_set_state_nolock()) ffff99d94183b000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:0.0:1777051248.411958:0:3676:0:(import.c:65:import_set_state_nolock()) ffff99d94183b000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:0.0:1777051248.411964:0:3676:0:(import.c:1737:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0000: Connection restored to 0@lo (at 0@lo) 00000100:00100000:0.0:1777051248.432148:0:3676:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d9418f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3676:1863365452506240:0@lo:38:kworker.0 00010000:00080000:0.0:1777051248.433255:0:3676:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99d95f865180 x1863365452506624/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1777051273 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1777051248.433284:0:3676:0:(import.c:1130:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 6 00000100:00080000:0.0:1777051248.434766:0:3676:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0001: lwp recover req@ffff99d95f865180 x1863365452506624/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1777051273 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1777051248.434783:0:3676:0:(import.c:65:import_set_state_nolock()) ffff99da5f282000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:0.0:1777051248.434791:0:3676:0:(import.c:65:import_set_state_nolock()) ffff99da5f282000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:0.0:1777051248.434798:0:3676:0:(import.c:1737:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:0.0:1777051248.434806:0:3676:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95f865180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3676:1863365452506624:0@lo:38:kworker.0 00010000:00080000:0.0:1777051248.434871:0:3676:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99d944e13100 x1863365452507392/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1777051258 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1777051248.434891:0:3676:0:(import.c:1130:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 6 00000100:00080000:0.0:1777051248.434899:0:3676:0:(import.c:958:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1777051248.434906:0:3676:0:(import.c:1211:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1777051248.434909:0:3676:0:(import.c:65:import_set_state_nolock()) ffff99d9410cc800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1777051248.434917:0:3676:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d944e13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3676:1863365452507392:0@lo:38:kworker.0 00000100:00080000:0.0:1777051248.434940:0:3676:0:(import.c:1130:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 6 00000100:00080000:0.0:1777051248.434949:0:3676:0:(import.c:65:import_set_state_nolock()) ffff99da7dbeb000 lustre-MDT0000_UUID: changing import state from CONNECTING to REPLAY 00000100:00080000:0.0:1777051248.434954:0:3676:0:(import.c:1694:ptlrpc_import_recovery_state_machine()) replay requested by lustre-MDT0000_UUID 00000100:00100000:0.0:1777051248.434958:0:3676:0:(client.c:3101:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 12884902301 gen 2 00000100:00080000:0.0:1777051248.434964:0:3676:0:(recover.c:53:ptlrpc_replay_next()) import ffff99da7dbeb000 from lustre-MDT0000_UUID committed 12884902301 last 0 00000100:00080000:0.0:1777051248.434969:0:3676:0:(import.c:65:import_set_state_nolock()) ffff99da7dbeb000 lustre-MDT0000_UUID: changing import state from REPLAY to REPLAY_LOCKS 00000100:00100000:0.0:1777051248.435708:0:3676:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95aecc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3676:1863365452505984:0@lo:38:kworker.0 00010000:00080000:0.0:1777051248.435733:0:3676:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99d9418f7100 x1863365452506112/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1777051273 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1777051248.435747:0:3676:0:(import.c:1130:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 6 00000100:00080000:0.0:1777051248.442678:0:3676:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-MDT0001: lwp recover req@ffff99d9418f7100 x1863365452506112/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1777051273 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1777051248.442695:0:3676:0:(import.c:65:import_set_state_nolock()) ffff99da7fa93000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:0.0:1777051248.443015:0:3676:0:(import.c:65:import_set_state_nolock()) ffff99da7fa93000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:0.0:1777051248.443025:0:3676:0:(import.c:1737:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:0.0:1777051248.443034:0:3676:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d9418f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3676:1863365452506112:0@lo:38:kworker.0 00000100:00100000:1.0:1777051248.443510:0:3676:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7c9a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3676:1863365452507648:0@lo:101:ldlm_lock_repla.0 00000100:00100000:1.0:1777051248.443601:0:3676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051248.443691:0:47208:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452507648 00000100:00100000:0.0:1777051248.443703:0:47208:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452507648 00000100:00100000:0.0:1777051248.443778:0:47208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7984 00000100:00100000:0.0:1777051248.443792:0:47208:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da44494380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+6:3676:x1863365452507648:12345-0@lo:101:ldlm_lock_repla.0 00010000:00080000:0.0:1777051248.443814:0:47208:0:(ldlm_lib.c:3170:target_queue_recovery_request()) @@@ queue lock replay req req@ffff99da44494380 x1863365452507648/t0(0) o101->lustre-MDT0001-mdtlov_UUID@0@lo:209/0 lens 328/0 e 0 to 0 dl 1777051259 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1777051248.444997:0:47208:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da44494380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+6:3676:x1863365452507648:12345-0@lo:101:ldlm_lock_repla.0 Request processed in 1204us (1394us total) trans 0 rc 0/-999 00000100:00100000:0.0:1777051248.445011:0:47208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7984 00000020:00080000:1.0:1777051248.445446:0:101457:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1777051248.445453:0:101457:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 3, connected: 3, completed: 3, queue_len: 0, req_transno: 0, next_transno: 21474836481 00010000:00080000:1.0:1777051248.445460:0:101457:0:(ldlm_lib.c:2248:check_for_next_transno()) waking for completed recovery 00000020:00080000:1.0:1777051248.445465:0:101457:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1777051248.445474:0:101457:0:(ldlm_lib.c:2438:target_next_replay_lock()) Waiting for lock 00010000:00080000:1.0:1777051248.445478:0:101457:0:(ldlm_lib.c:2268:check_for_next_lock()) waking for next lock 00010000:00080000:1.0:1777051248.445492:0:101457:0:(ldlm_lib.c:2871:target_recovery_thread()) @@@ processing lock from 192.168.201.46@tcp: req@ffff99d955ebf800 x1863365425848064/t0(0) o101->2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp:206/0 lens 328/0 e 0 to 0 dl 1777051256 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1777051248.445519:0:101457:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777051248.445634:0:101457:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d955a8ec00/0x85f51a6b967147dc lrc: 2/0,0 mode: --/PR res: [0x200000bd3:0x9f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b50af expref: -99 pid: 101457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.445669:0:101457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d955a8ec00/0x85f51a6b967147dc lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x9f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b50af expref: 14 pid: 101457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.445715:0:101457:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d955a8ec00/0x85f51a6b967147dc lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x9f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b50af expref: 14 pid: 101457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.445732:0:101457:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d955a8ec00, rc 0) 00010000:00080000:1.0:1777051248.445887:0:101457:0:(ldlm_lib.c:2086:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 101 seconds 00010000:00080000:1.0:1777051248.445908:0:101457:0:(ldlm_lib.c:2438:target_next_replay_lock()) Waiting for lock 00010000:00080000:1.0:1777051248.445912:0:101457:0:(ldlm_lib.c:2268:check_for_next_lock()) waking for next lock 00010000:00080000:1.0:1777051248.445923:0:101457:0:(ldlm_lib.c:2871:target_recovery_thread()) @@@ processing lock from 192.168.201.46@tcp: req@ffff99d94e627100 x1863365425848192/t0(0) o101->2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp:206/0 lens 328/0 e 0 to 0 dl 1777051256 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1777051248.445944:0:101457:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777051248.445965:0:101457:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d955a8e000/0x85f51a6b967147e3 lrc: 2/0,0 mode: --/PR res: [0x200000bd3:0x9d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b50a1 expref: -99 pid: 101457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.445992:0:101457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d955a8e000/0x85f51a6b967147e3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x9d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b50a1 expref: 14 pid: 101457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.446009:0:101457:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d955a8e000/0x85f51a6b967147e3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x9d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b50a1 expref: 14 pid: 101457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.446024:0:101457:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d955a8e000, rc 0) 00010000:00080000:1.0:1777051248.446087:0:101457:0:(ldlm_lib.c:2086:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00010000:00080000:1.0:1777051248.446101:0:101457:0:(ldlm_lib.c:2438:target_next_replay_lock()) Waiting for lock 00010000:00080000:1.0:1777051248.446104:0:101457:0:(ldlm_lib.c:2268:check_for_next_lock()) waking for next lock 00010000:00080000:1.0:1777051248.446114:0:101457:0:(ldlm_lib.c:2871:target_recovery_thread()) @@@ processing lock from 192.168.201.46@tcp: req@ffff99d94e627800 x1863365425848320/t0(0) o101->2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp:206/0 lens 328/0 e 0 to 0 dl 1777051256 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1777051248.446134:0:101457:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777051248.446155:0:101457:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d955a8fa00/0x85f51a6b967147ea lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x57:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b0bdc expref: -99 pid: 101457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.446182:0:101457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d955a8fa00/0x85f51a6b967147ea lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x57:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b0bdc expref: 14 pid: 101457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.446234:0:101457:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d955a8fa00/0x85f51a6b967147ea lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x57:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b0bdc expref: 14 pid: 101457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.446248:0:101457:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d955a8fa00, rc 0) 00010000:00080000:1.0:1777051248.446281:0:101457:0:(ldlm_lib.c:2086:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00010000:00080000:1.0:1777051248.446293:0:101457:0:(ldlm_lib.c:2438:target_next_replay_lock()) Waiting for lock 00010000:00080000:1.0:1777051248.446296:0:101457:0:(ldlm_lib.c:2268:check_for_next_lock()) waking for next lock 00010000:00080000:1.0:1777051248.446305:0:101457:0:(ldlm_lib.c:2871:target_recovery_thread()) @@@ processing lock from 192.168.201.46@tcp: req@ffff99d94e625180 x1863365425848448/t0(0) o101->2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp:206/0 lens 328/0 e 0 to 0 dl 1777051256 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1777051248.446325:0:101457:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777051248.446344:0:101457:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d955a8f600/0x85f51a6b967147f1 lrc: 2/0,0 mode: --/PR res: [0x200000bd3:0xb5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b5731 expref: -99 pid: 101457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.446369:0:101457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d955a8f600/0x85f51a6b967147f1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0xb5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5731 expref: 14 pid: 101457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.446390:0:101457:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d955a8f600/0x85f51a6b967147f1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0xb5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5731 expref: 14 pid: 101457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.446404:0:101457:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d955a8f600, rc 0) 00010000:00080000:1.0:1777051248.446438:0:101457:0:(ldlm_lib.c:2086:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00010000:00080000:1.0:1777051248.446451:0:101457:0:(ldlm_lib.c:2438:target_next_replay_lock()) Waiting for lock 00010000:00080000:1.0:1777051248.446455:0:101457:0:(ldlm_lib.c:2268:check_for_next_lock()) waking for next lock 00010000:00080000:1.0:1777051248.446466:0:101457:0:(ldlm_lib.c:2871:target_recovery_thread()) @@@ processing lock from 192.168.201.46@tcp: req@ffff99da7fdf1880 x1863365425848576/t0(0) o101->2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp:206/0 lens 328/0 e 0 to 0 dl 1777051256 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1777051248.446484:0:101457:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777051248.446504:0:101457:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da429d6400/0x85f51a6b967147f8 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x96:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b41c1 expref: -99 pid: 101457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.446525:0:101457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da429d6400/0x85f51a6b967147f8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x96:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b41c1 expref: 14 pid: 101457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.446536:0:101457:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99da429d6400/0x85f51a6b967147f8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x96:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b41c1 expref: 14 pid: 101457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.446544:0:101457:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99da429d6400, rc 0) 00010000:00080000:1.0:1777051248.446565:0:101457:0:(ldlm_lib.c:2086:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00010000:00080000:1.0:1777051248.446573:0:101457:0:(ldlm_lib.c:2438:target_next_replay_lock()) Waiting for lock 00010000:00080000:1.0:1777051248.446575:0:101457:0:(ldlm_lib.c:2268:check_for_next_lock()) waking for next lock 00010000:00080000:1.0:1777051248.446581:0:101457:0:(ldlm_lib.c:2871:target_recovery_thread()) @@@ processing lock from 192.168.201.46@tcp: req@ffff99da7fdf3100 x1863365425848704/t0(0) o101->2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp:206/0 lens 328/0 e 0 to 0 dl 1777051256 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1777051248.446592:0:101457:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777051248.446601:0:101457:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da429d6800/0x85f51a6b967147ff lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x96:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b245c expref: -99 pid: 101457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.446615:0:101457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da429d6800/0x85f51a6b967147ff lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x96:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b245c expref: 14 pid: 101457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.446625:0:101457:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99da429d6800/0x85f51a6b967147ff lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x96:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b245c expref: 14 pid: 101457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.446646:0:101457:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99da429d6800, rc 0) 00010000:00080000:1.0:1777051248.446673:0:101457:0:(ldlm_lib.c:2086:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00010000:00080000:1.0:1777051248.446684:0:101457:0:(ldlm_lib.c:2438:target_next_replay_lock()) Waiting for lock 00010000:00080000:1.0:1777051248.446686:0:101457:0:(ldlm_lib.c:2268:check_for_next_lock()) waking for next lock 00010000:00080000:1.0:1777051248.446696:0:101457:0:(ldlm_lib.c:2871:target_recovery_thread()) @@@ processing lock from 192.168.201.46@tcp: req@ffff99d95a580380 x1863365425848832/t0(0) o101->2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp:206/0 lens 328/0 e 0 to 0 dl 1777051256 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1777051248.446715:0:101457:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777051248.446733:0:101457:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da429d7e00/0x85f51a6b96714806 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b5d12 expref: -99 pid: 101457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.447040:0:101457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da429d7e00/0x85f51a6b96714806 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5d12 expref: 14 pid: 101457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.447057:0:101457:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99da429d7e00/0x85f51a6b96714806 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5d12 expref: 14 pid: 101457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.447069:0:101457:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99da429d7e00, rc 0) 00010000:00080000:1.0:1777051248.447407:0:101457:0:(ldlm_lib.c:2086:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00010000:00080000:1.0:1777051248.447420:0:101457:0:(ldlm_lib.c:2438:target_next_replay_lock()) Waiting for lock 00010000:00080000:1.0:1777051248.447423:0:101457:0:(ldlm_lib.c:2268:check_for_next_lock()) waking for next lock 00010000:00080000:1.0:1777051248.447433:0:101457:0:(ldlm_lib.c:2871:target_recovery_thread()) @@@ processing lock from 192.168.201.46@tcp: req@ffff99d95a581180 x1863365425848960/t0(0) o101->2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp:206/0 lens 328/0 e 0 to 0 dl 1777051256 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1777051248.447453:0:101457:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777051248.447473:0:101457:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da429d7c00/0x85f51a6b9671480d lrc: 2/0,0 mode: --/PR res: [0x200000bd3:0xb2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b5715 expref: -99 pid: 101457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.447507:0:101457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da429d7c00/0x85f51a6b9671480d lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0xb2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5715 expref: 14 pid: 101457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.447526:0:101457:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99da429d7c00/0x85f51a6b9671480d lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0xb2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5715 expref: 14 pid: 101457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.447535:0:101457:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99da429d7c00, rc 0) 00010000:00080000:1.0:1777051248.447564:0:101457:0:(ldlm_lib.c:2086:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00010000:00080000:1.0:1777051248.447576:0:101457:0:(ldlm_lib.c:2438:target_next_replay_lock()) Waiting for lock 00010000:00080000:1.0:1777051248.447581:0:101457:0:(ldlm_lib.c:2268:check_for_next_lock()) waking for next lock 00010000:00080000:1.0:1777051248.447592:0:101457:0:(ldlm_lib.c:2871:target_recovery_thread()) @@@ processing lock from 192.168.201.46@tcp: req@ffff99da44977480 x1863365425849216/t0(0) o101->c11b6966-0775-44d2-bdc6-c74c26eb2226@192.168.201.46@tcp:206/0 lens 328/0 e 0 to 0 dl 1777051256 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1777051248.447611:0:101457:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777051248.448756:0:101457:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da429d6600/0x85f51a6b96714814 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0xc6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b54f3 expref: -99 pid: 101457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.448784:0:101457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da429d6600/0x85f51a6b96714814 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xc6:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b54f3 expref: 13 pid: 101457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.448797:0:101457:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99da429d6600/0x85f51a6b96714814 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xc6:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b54f3 expref: 13 pid: 101457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.448805:0:101457:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99da429d6600, rc 0) 00010000:00080000:1.0:1777051248.448872:0:101457:0:(ldlm_lib.c:2086:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00010000:00080000:1.0:1777051248.448885:0:101457:0:(ldlm_lib.c:2438:target_next_replay_lock()) Waiting for lock 00010000:00080000:1.0:1777051248.448889:0:101457:0:(ldlm_lib.c:2268:check_for_next_lock()) waking for next lock 00010000:00080000:1.0:1777051248.448900:0:101457:0:(ldlm_lib.c:2871:target_recovery_thread()) @@@ processing lock from 192.168.201.46@tcp: req@ffff99da44975180 x1863365425849344/t0(0) o101->c11b6966-0775-44d2-bdc6-c74c26eb2226@192.168.201.46@tcp:206/0 lens 328/0 e 0 to 0 dl 1777051256 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1777051248.448921:0:101457:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777051248.448940:0:101457:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da429d7600/0x85f51a6b9671481b lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0xc4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b4e9b expref: -99 pid: 101457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.448964:0:101457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da429d7600/0x85f51a6b9671481b lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xc4:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b4e9b expref: 13 pid: 101457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.448982:0:101457:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99da429d7600/0x85f51a6b9671481b lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xc4:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b4e9b expref: 13 pid: 101457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.448994:0:101457:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99da429d7600, rc 0) 00010000:00080000:1.0:1777051248.450924:0:101457:0:(ldlm_lib.c:2086:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00010000:00080000:1.0:1777051248.450943:0:101457:0:(ldlm_lib.c:2438:target_next_replay_lock()) Waiting for lock 00010000:00080000:2.0:1777051248.451777:0:101457:0:(ldlm_lib.c:2268:check_for_next_lock()) waking for next lock 00010000:00080000:2.0:1777051248.451784:0:101457:0:(ldlm_lib.c:2871:target_recovery_thread()) @@@ processing lock from 192.168.201.46@tcp: req@ffff99da44977100 x1863365425849984/t0(0) o101->c11b6966-0775-44d2-bdc6-c74c26eb2226@192.168.201.46@tcp:206/0 lens 328/0 e 0 to 0 dl 1777051256 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1777051248.451801:0:101457:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051248.451816:0:101457:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e9d7200/0x85f51a6b9671483e lrc: 2/0,0 mode: --/PR res: [0x200000bd3:0xb0:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b555c expref: -99 pid: 101457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051248.451840:0:101457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e9d7200/0x85f51a6b9671483e lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0xb0:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b555c expref: 13 pid: 101457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051248.451887:0:101457:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e9d7200/0x85f51a6b9671483e lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0xb0:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b555c expref: 13 pid: 101457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051248.451902:0:101457:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d94e9d7200, rc 0) 00010000:00080000:2.0:1777051248.451936:0:101457:0:(ldlm_lib.c:2086:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00010000:00080000:2.0:1777051248.451947:0:101457:0:(ldlm_lib.c:2438:target_next_replay_lock()) Waiting for lock 00010000:00080000:2.0:1777051248.451950:0:101457:0:(ldlm_lib.c:2268:check_for_next_lock()) waking for next lock 00010000:00080000:2.0:1777051248.451960:0:101457:0:(ldlm_lib.c:2871:target_recovery_thread()) @@@ processing lock from 0@lo: req@ffff99da44494380 x1863365452507648/t0(0) o101->lustre-MDT0001-mdtlov_UUID@0@lo:209/0 lens 328/0 e 0 to 0 dl 1777051259 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1777051248.451978:0:101457:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051248.451999:0:101457:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e9d7000/0x85f51a6b96714845 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x85f51a6b96149c5e expref: -99 pid: 101457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051248.452023:0:101457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e9d7000/0x85f51a6b96714845 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x85f51a6b96149c5e expref: 7 pid: 101457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051248.452040:0:101457:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e9d7000/0x85f51a6b96714845 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b96149c5e expref: 7 pid: 101457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051248.452053:0:101457:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d94e9d7000, rc 0) 00010000:00080000:2.0:1777051248.452130:0:101457:0:(ldlm_lib.c:2086:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00010000:00080000:2.0:1777051248.452143:0:101457:0:(ldlm_lib.c:2438:target_next_replay_lock()) Waiting for lock 00010000:00010000:3.0:1777051248.459439:0:3676:0:(ldlm_request.c:2765:replay_lock_interpret()) ### replayed lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d9418d3400/0x85f51a6b96149c5e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x85f51a6b96714845 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1777051248.459464:0:3676:0:(import.c:65:import_set_state_nolock()) ffff99da7dbeb000 lustre-MDT0000_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000100:00100000:3.0:1777051248.459958:0:3676:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7c9a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3676:1863365452507648:0@lo:101:ldlm_lock_repla.0 00000100:00100000:3.0:1777051248.460019:0:3676:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955610000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3676:1863365452507776:0@lo:400:ptlrpcd_rcv.0 00000100:00100000:3.0:1777051248.460102:0:3676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051248.460460:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051248.460501:0:46498:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452507776 00000100:00100000:3.0:1777051248.460512:0:46498:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452507776 00000100:00100000:0.0:1777051248.460529:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051248.460586:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051248.460592:0:46498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7985 00000100:00100000:3.0:1777051248.460610:0:46498:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955613480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+7:3676:x1863365452507776:12345-0@lo:400:ptlrpcd_rcv.0 00010000:00080000:3.0:1777051248.460638:0:46498:0:(ldlm_lib.c:3120:target_queue_recovery_request()) @@@ queue final req req@ffff99d955613480 x1863365452507776/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:209/0 lens 224/0 e 0 to 0 dl 1777051259 ref 2 fl Interpret:/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777051248.460975:0:46498:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955613480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+7:3676:x1863365452507776:12345-0@lo:400:ptlrpcd_rcv.0 Request processed in 369us (874us total) trans 0 rc 0/-999 00000100:00100000:3.0:1777051248.460989:0:46498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7985 00000100:00100000:0.0:1777051248.461001:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051248.461105:0:6579:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425852416 00000100:00100000:0.0:1777051248.461389:0:6579:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425852416 00000100:00100000:3.0:1777051248.461394:0:27885:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425852544 00000100:00100000:3.0:1777051248.461405:0:27885:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425852544 00000100:00100000:2.0:1777051248.461421:0:46494:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425852672 00000100:00100000:2.0:1777051248.461433:0:46494:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425852672 00000100:00100000:0.0:1777051248.461474:0:6579:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425852800 00000100:00100000:0.0:1777051248.461483:0:6579:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425852800 00000100:00100000:3.0:1777051248.461495:0:27885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111677 00000100:00100000:3.0:1777051248.461518:0:27885:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d9418f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+16:2435:x1863365425852416:12345-192.168.201.46@tcp:101:ldlm_lock_repla.0 00000100:00100000:0.0:1777051248.461555:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13096 00000100:00100000:2.0:1777051248.461574:0:46494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111678 00000100:00100000:0.0:1777051248.461580:0:6579:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fd64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+13:2435:x1863365425852800:12345-192.168.201.46@tcp:400:ptlrpcd_rcv.0 00010000:00080000:3.0:1777051248.461580:0:27885:0:(ldlm_lib.c:3170:target_queue_recovery_request()) @@@ queue lock replay req req@ffff99d9418f7100 x1863365425852416/t0(0) o101->2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp:209/0 lens 328/0 e 0 to 0 dl 1777051259 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1777051248.461604:0:46494:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d9418f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+16:2435:x1863365425852544:12345-192.168.201.46@tcp:101:ldlm_lock_repla.0 00010000:00080000:0.0:1777051248.461619:0:6579:0:(ldlm_lib.c:3120:target_queue_recovery_request()) @@@ queue final req req@ffff99da7fd64380 x1863365425852800/t0(0) o400->c11b6966-0775-44d2-bdc6-c74c26eb2226@192.168.201.46@tcp:209/0 lens 224/0 e 0 to 0 dl 1777051259 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777051248.461623:0:27885:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d9418f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+16:2435:x1863365425852416:12345-192.168.201.46@tcp:101:ldlm_lock_repla.0 Request processed in 111us (1167us total) trans 0 rc 0/-999 00010000:00080000:2.0:1777051248.461636:0:46494:0:(ldlm_lib.c:3170:target_queue_recovery_request()) @@@ queue lock replay req req@ffff99d9418f6680 x1863365425852544/t0(0) o101->2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp:209/0 lens 328/0 e 0 to 0 dl 1777051259 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777051248.461659:0:27885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111677 00000100:00100000:0.0:1777051248.461682:0:6579:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fd64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+13:2435:x1863365425852800:12345-192.168.201.46@tcp:400:ptlrpcd_rcv.0 Request processed in 109us (684us total) trans 0 rc 0/-999 00000100:00100000:2.0:1777051248.462014:0:46494:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d9418f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+16:2435:x1863365425852544:12345-192.168.201.46@tcp:101:ldlm_lock_repla.0 Request processed in 98us (1163us total) trans 0 rc 0/-999 00000100:00100000:3.0:1777051248.462445:0:27885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111679 00000100:00100000:2.0:1777051248.462462:0:46494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111678 00000100:00100000:3.0:1777051248.462471:0:27885:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d9418f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+16:2435:x1863365425852672:12345-192.168.201.46@tcp:101:ldlm_lock_repla.0 00010000:00080000:3.0:1777051248.462493:0:27885:0:(ldlm_lib.c:3170:target_queue_recovery_request()) @@@ queue lock replay req req@ffff99d9418f5500 x1863365425852672/t0(0) o101->2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp:209/0 lens 328/0 e 0 to 0 dl 1777051259 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00080000:2.0:1777051248.462505:0:101457:0:(ldlm_lib.c:2268:check_for_next_lock()) waking for next lock 00000100:00100000:3.0:1777051248.462522:0:27885:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d9418f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+16:2435:x1863365425852672:12345-192.168.201.46@tcp:101:ldlm_lock_repla.0 Request processed in 58us (1934us total) trans 0 rc 0/-999 00010000:00080000:2.0:1777051248.462528:0:101457:0:(ldlm_lib.c:2871:target_recovery_thread()) @@@ processing lock from 192.168.201.46@tcp: req@ffff99d9418f7100 x1863365425852416/t0(0) o101->2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp:209/0 lens 328/0 e 0 to 0 dl 1777051259 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777051248.462546:0:27885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111679 00010000:00010000:2.0:1777051248.462571:0:101457:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051248.462609:0:101457:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e9d6400/0x85f51a6b9671484c lrc: 2/0,0 mode: --/PR res: [0x200000bd3:0xb1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b570e expref: -99 pid: 101457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051248.462651:0:101457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e9d6400/0x85f51a6b9671484c lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0xb1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b570e expref: 17 pid: 101457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051248.462677:0:101457:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e9d6400/0x85f51a6b9671484c lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0xb1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b570e expref: 17 pid: 101457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051248.462694:0:101457:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d94e9d6400, rc 0) 00010000:00080000:2.0:1777051248.462766:0:101457:0:(ldlm_lib.c:2086:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00010000:00080000:2.0:1777051248.462783:0:101457:0:(ldlm_lib.c:2438:target_next_replay_lock()) Waiting for lock 00010000:00080000:2.0:1777051248.462788:0:101457:0:(ldlm_lib.c:2268:check_for_next_lock()) waking for next lock 00010000:00080000:2.0:1777051248.462798:0:101457:0:(ldlm_lib.c:2871:target_recovery_thread()) @@@ processing lock from 192.168.201.46@tcp: req@ffff99d9418f6680 x1863365425852544/t0(0) o101->2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp:209/0 lens 328/0 e 0 to 0 dl 1777051259 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1777051248.462820:0:101457:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051248.462871:0:101457:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e9d6800/0x85f51a6b96714853 lrc: 2/0,0 mode: --/PR res: [0x200000bd3:0x51:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b445a expref: -99 pid: 101457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051248.462901:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13096 00010000:00010000:2.0:1777051248.462905:0:101457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e9d6800/0x85f51a6b96714853 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x51:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b445a expref: 17 pid: 101457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051248.462927:0:101457:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e9d6800/0x85f51a6b96714853 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x51:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b445a expref: 17 pid: 101457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051248.462942:0:101457:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d94e9d6800, rc 0) 00010000:00080000:2.0:1777051248.463009:0:101457:0:(ldlm_lib.c:2086:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00010000:00080000:2.0:1777051248.463028:0:101457:0:(ldlm_lib.c:2438:target_next_replay_lock()) Waiting for lock 00010000:00080000:2.0:1777051248.463032:0:101457:0:(ldlm_lib.c:2268:check_for_next_lock()) waking for next lock 00010000:00080000:2.0:1777051248.463047:0:101457:0:(ldlm_lib.c:2871:target_recovery_thread()) @@@ processing lock from 192.168.201.46@tcp: req@ffff99d9418f5500 x1863365425852672/t0(0) o101->2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp:209/0 lens 328/0 e 0 to 0 dl 1777051259 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1777051248.463070:0:101457:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051248.463090:0:101457:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e9d6600/0x85f51a6b9671485a lrc: 2/0,0 mode: --/PR res: [0x200000bd3:0xb0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b5707 expref: -99 pid: 101457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051248.463118:0:101457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e9d6600/0x85f51a6b9671485a lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0xb0:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5707 expref: 17 pid: 101457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051248.463139:0:101457:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e9d6600/0x85f51a6b9671485a lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0xb0:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5707 expref: 17 pid: 101457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051248.463162:0:101457:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d94e9d6600, rc 0) 00010000:00080000:2.0:1777051248.463265:0:101457:0:(ldlm_lib.c:2086:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00010000:00080000:2.0:1777051248.463280:0:101457:0:(ldlm_lib.c:2438:target_next_replay_lock()) Waiting for lock 00000100:00100000:0.0:1777051248.467148:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051248.467294:0:10328:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425852928 00000100:00100000:2.0:1777051248.467305:0:10328:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425852928 00000100:00100000:2.0:1777051248.467498:0:10328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13097 00000100:00100000:2.0:1777051248.467516:0:10328:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fd67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+17:2435:x1863365425852928:12345-192.168.201.46@tcp:400:ptlrpcd_rcv.0 00010000:00080000:2.0:1777051248.467540:0:10328:0:(ldlm_lib.c:3120:target_queue_recovery_request()) @@@ queue final req req@ffff99da7fd67100 x1863365425852928/t0(0) o400->2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp:209/0 lens 224/0 e 0 to 0 dl 1777051259 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1777051248.467586:0:10328:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fd67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+17:2435:x1863365425852928:12345-192.168.201.46@tcp:400:ptlrpcd_rcv.0 Request processed in 75us (446us total) trans 0 rc 0/-999 00000100:00100000:2.0:1777051248.467598:0:10328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13097 00010000:00080000:0.0:1777051248.468040:0:101457:0:(ldlm_lib.c:2271:check_for_next_lock()) waking for completed lock replay 00000001:00000004:0.0:1777051248.468333:0:101457:0:(tgt_lastrcvd.c:732:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 6, last_transno is 25769803776 00000001:00100000:1.0:1777051248.473580:0:101417:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 2dd4696c-edce-4cd1-86d2-dbd2ff957fa1 00000001:00100000:1.0:1777051248.473594:0:101417:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of c11b6966-0775-44d2-bdc6-c74c26eb2226 00000001:00100000:1.0:1777051248.473600:0:101417:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00080000:0.0:1777051248.473759:0:101457:0:(tgt_lastrcvd.c:223:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00010000:00080000:0.0:1777051248.473833:0:101457:0:(ldlm_lib.c:1982:target_cancel_recovery_timer()) lustre-MDT0000: cancel recovery timer 00010000:00080000:0.0:1777051248.473887:0:101457:0:(ldlm_lib.c:2923:target_recovery_thread()) @@@ processing final ping from 0@lo: req@ffff99d955613480 x1863365452507776/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:209/0 lens 224/0 e 0 to 0 dl 1777051259 ref 1 fl Complete:/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00010000:00080000:0.0:1777051248.474081:0:101457:0:(ldlm_lib.c:2923:target_recovery_thread()) @@@ processing final ping from 192.168.201.46@tcp: req@ffff99da7fd64380 x1863365425852800/t0(0) o400->c11b6966-0775-44d2-bdc6-c74c26eb2226@192.168.201.46@tcp:209/0 lens 224/0 e 0 to 0 dl 1777051259 ref 1 fl Complete:H/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1777051248.474150:0:3676:0:(import.c:65:import_set_state_nolock()) ffff99da7dbeb000 lustre-MDT0000_UUID: changing import state from REPLAY_WAIT to RECOVER 00000100:00080000:1.0:1777051248.474166:0:3676:0:(client.c:3223:ptlrpc_resend_req()) @@@ going to resend req@ffff99d955610000 x1863365452507776/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1777051264 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1777051248.474184:0:3676:0:(client.c:3232:ptlrpc_resend_req()) @@@ it has reply, so skip it req@ffff99d955610000 x1863365452507776/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1777051264 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1777051248.474198:0:3676:0:(import.c:65:import_set_state_nolock()) ffff99da7dbeb000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:1.0:1777051248.474222:0:3676:0:(import.c:1737:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-osp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00080000:1.0:1777051248.474235:0:3676:0:(recover.c:189:ptlrpc_wake_delayed()) @@@ waking (set 000000005ce78dbb): req@ffff99d942a0e300 x1863365452489216/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1777051240 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00010000:00080000:0.0:1777051248.474280:0:101457:0:(ldlm_lib.c:2923:target_recovery_thread()) @@@ processing final ping from 192.168.201.46@tcp: req@ffff99da7fd67100 x1863365425852928/t0(0) o400->2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp:209/0 lens 224/0 e 0 to 0 dl 1777051259 ref 1 fl Complete:H/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1777051248.474307:0:3676:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955610000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3676:1863365452507776:0@lo:400:ptlrpcd_rcv.0 00010000:02000000:0.0:1777051248.474358:0:101457:0:(ldlm_lib.c:1854:target_finish_recovery()) lustre-MDT0000: Recovery over after 0:03, of 3 clients 3 recovered and 0 were evicted. 00000100:00100000:1.0:1777051248.474535:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051248.474592:0:3678:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1777051248.474611:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95f865180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452507904:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1777051248.474643:0:11727:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452489216 00000100:00100000:3.0:1777051248.474657:0:11727:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452489216 00000100:00100000:1.0:1777051248.474676:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051248.474728:0:11727:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452507904 00000100:00100000:3.0:1777051248.474735:0:11727:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452507904 00000100:00100000:3.0:1777051248.474784:0:11727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7986 00000100:00100000:1.0:1777051248.474800:0:46500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7987 00000100:00100000:3.0:1777051248.474802:0:11727:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f864380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:3678:x1863365452489216:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1777051248.474841:0:46500:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f867b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+8:3678:x1863365452507904:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1777051248.474877:0:11727:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4194304 pending 0 free 1441603584 avail 1295364096 00000004:00000024:1.0:1777051248.474917:0:46500:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4194304 pending 0 free 1441603584 avail 1295364096 00000100:00100000:3.0:1777051248.475017:0:11727:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f864380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:3678:x1863365452489216:12345-0@lo:41:osp-pre-0-1.0 Request processed in 217us (480us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051248.475037:0:46500:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f867b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+8:3678:x1863365452507904:12345-0@lo:41:osp-pre-0-1.0 Request processed in 211us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051248.475037:0:11727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7986 00000100:00100000:1.0:1777051248.475057:0:46500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7987 00000100:00100000:3.0:1777051248.475134:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95f865180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452507904:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1777051248.475471:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d942a0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452489216:0@lo:41:osp-pre-0-1.0 00000004:00000080:1.0:1777051248.541537:0:101457:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb08942bb3e10 00100000:10000000:1.0:1777051248.541556:0:101457:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000004:00080000:3.0:1777051248.543030:0:101437:0:(osp_precreate.c:877:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x15e:0x0] 00000100:00100000:3.0:1777051248.543395:0:101437:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955610000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:101437:1863365452508032:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1777051248.543508:0:101437:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1777051248.543568:0:101439:0:(osp_precreate.c:877:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x15e:0x0] 00000100:00100000:3.0:1777051248.543571:0:101437:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d94eea9cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1777051248.543620:0:101439:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95f864a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:101439:1863365452508160:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1777051248.543624:0:24468:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452508032 00000100:00100000:3.0:1777051248.543638:0:24468:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452508032 00000100:00100000:3.0:1777051248.543720:0:24468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7942 00000100:00100000:1.0:1777051248.543734:0:101439:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051248.543744:0:24468:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942a0e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:101437:x1863365452508032:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1777051248.543791:0:24468:0:(ofd_dev.c:1637:ofd_create_hdl()) ofd_last_id() = 449 -> diff = -99 00002000:02000040:3.0:1777051248.543799:0:24468:0:(ofd_dev.c:1488:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:351 to 0x280000401:449) 00000100:00100000:1.0:1777051248.544290:0:101439:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d94e77e780 going to sleep for 11 seconds 00000100:00100000:0.0:1777051248.544446:0:8628:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452508160 00000100:00100000:0.0:1777051248.544456:0:8628:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452508160 00000100:00100000:0.0:1777051248.544518:0:8628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7943 00000100:00100000:0.0:1777051248.544535:0:8628:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f865180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:101439:x1863365452508160:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1777051248.544569:0:8628:0:(ofd_dev.c:1637:ofd_create_hdl()) ofd_last_id() = 449 -> diff = -99 00002000:02000040:0.0:1777051248.544576:0:8628:0:(ofd_dev.c:1488:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:351 to 0x2c0000401:449) 00002000:00010000:3.0:1777051248.560339:0:24468:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x1c1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777051248.560356:0:24468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000020699bcd/0x85f51a6b96714861 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1c1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.560381:0:24468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051248.560384:0:24468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051248.560393:0:24468:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000020699bcd/0x85f51a6b96714861 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.560419:0:24468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000020699bcd/0x85f51a6b96714861 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.560435:0:24468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000020699bcd/0x85f51a6b96714861 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.560451:0:24468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000020699bcd/0x85f51a6b96714861 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.560495:0:24468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1777051248.560548:0:38719:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777051248.560561:0:38719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000020699bcd/0x85f51a6b96714861 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.560582:0:38719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d943ebb200 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:1.0:1777051248.560590:0:38719:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000020699bcd/0x85f51a6b96714861 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.560618:0:38719:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000020699bcd/0x85f51a6b96714861 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.560648:0:38719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000020699bcd/0x85f51a6b96714861 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.560662:0:38719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000020699bcd/0x85f51a6b96714861 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.560691:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051248.560697:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051248.560701:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1777051248.561413:0:24468:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x1c0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777051248.561426:0:24468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007bd6c51a/0x85f51a6b96714868 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.561443:0:24468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051248.561446:0:24468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051248.561453:0:24468:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007bd6c51a/0x85f51a6b96714868 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.561472:0:24468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007bd6c51a/0x85f51a6b96714868 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.561488:0:24468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007bd6c51a/0x85f51a6b96714868 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.561502:0:24468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007bd6c51a/0x85f51a6b96714868 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.561534:0:24468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1777051248.561551:0:13753:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777051248.561560:0:13753:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007bd6c51a/0x85f51a6b96714868 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.561574:0:13753:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d943ebb600 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:3.0:1777051248.561581:0:13753:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007bd6c51a/0x85f51a6b96714868 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.561596:0:13753:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007bd6c51a/0x85f51a6b96714868 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.561628:0:13753:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007bd6c51a/0x85f51a6b96714868 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.561643:0:13753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007bd6c51a/0x85f51a6b96714868 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.561670:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051248.561675:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051248.561683:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1777051248.561802:0:24468:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x1bf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777051248.561814:0:24468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005bfcd804/0x85f51a6b9671486f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1bf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.561920:0:24468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051248.561924:0:24468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051248.561931:0:24468:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005bfcd804/0x85f51a6b9671486f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.561952:0:24468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005bfcd804/0x85f51a6b9671486f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.561964:0:24468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005bfcd804/0x85f51a6b9671486f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.561977:0:24468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005bfcd804/0x85f51a6b9671486f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.562439:0:24468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1777051248.562459:0:6568:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777051248.562468:0:6568:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005bfcd804/0x85f51a6b9671486f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.562484:0:6568:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d943eba200 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:3.0:1777051248.562491:0:6568:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005bfcd804/0x85f51a6b9671486f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.562516:0:6568:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005bfcd804/0x85f51a6b9671486f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.562542:0:6568:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005bfcd804/0x85f51a6b9671486f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.562556:0:6568:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005bfcd804/0x85f51a6b9671486f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.562596:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051248.562599:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051248.562603:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1777051248.562724:0:24468:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x1be:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777051248.562736:0:24468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d3782cbf/0x85f51a6b96714876 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1be:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.562753:0:24468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051248.562757:0:24468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051248.562773:0:24468:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d3782cbf/0x85f51a6b96714876 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.562792:0:24468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d3782cbf/0x85f51a6b96714876 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.562807:0:24468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d3782cbf/0x85f51a6b96714876 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.562821:0:24468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d3782cbf/0x85f51a6b96714876 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.562886:0:24468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1777051248.562963:0:24468:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x1bd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777051248.562973:0:24468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f02d5b94/0x85f51a6b9671487d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1bd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.563019:0:24468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051248.563022:0:24468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051248.563027:0:24468:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f02d5b94/0x85f51a6b9671487d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.563045:0:24468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f02d5b94/0x85f51a6b9671487d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.563059:0:24468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f02d5b94/0x85f51a6b9671487d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.563083:0:24468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f02d5b94/0x85f51a6b9671487d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.563163:0:24468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1777051248.563176:0:38719:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1777051248.563185:0:38719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d3782cbf/0x85f51a6b96714876 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.563233:0:38719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d943ebb800 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:3.0:1777051248.563241:0:38719:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d3782cbf/0x85f51a6b96714876 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.563258:0:38719:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d3782cbf/0x85f51a6b96714876 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.563278:0:38719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d3782cbf/0x85f51a6b96714876 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.563292:0:38719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d3782cbf/0x85f51a6b96714876 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.563319:0:38719:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777051248.563326:0:38719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f02d5b94/0x85f51a6b9671487d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.563347:0:38719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d943ebba00 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:3.0:1777051248.563353:0:38719:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f02d5b94/0x85f51a6b9671487d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.563366:0:38719:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f02d5b94/0x85f51a6b9671487d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.563384:0:38719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f02d5b94/0x85f51a6b9671487d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.563397:0:38719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f02d5b94/0x85f51a6b9671487d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.563461:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051248.563463:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051248.563469:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051248.563474:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1777051248.563626:0:24468:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x1bc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777051248.563637:0:24468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000867be76e/0x85f51a6b96714884 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1bc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.563653:0:24468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051248.563656:0:24468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051248.563662:0:24468:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000867be76e/0x85f51a6b96714884 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.563679:0:24468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000867be76e/0x85f51a6b96714884 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.563988:0:24468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000867be76e/0x85f51a6b96714884 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.564002:0:24468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000867be76e/0x85f51a6b96714884 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.564075:0:24468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1777051248.564531:0:24468:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x1bb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777051248.564543:0:24468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df56773e/0x85f51a6b9671488b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1bb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.564558:0:24468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051248.564561:0:24468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051248.564599:0:24468:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df56773e/0x85f51a6b9671488b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.564619:0:24468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000df56773e/0x85f51a6b9671488b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.564634:0:24468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df56773e/0x85f51a6b9671488b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.564648:0:24468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000df56773e/0x85f51a6b9671488b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:3.0:1777051248.564701:0:8464:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:3.0:1777051248.564728:0:24468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1777051248.564739:0:6568:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1777051248.564747:0:6568:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000867be76e/0x85f51a6b96714884 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.564760:0:6568:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d943ebaa00 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:3.0:1777051248.564766:0:6568:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000867be76e/0x85f51a6b96714884 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.564780:0:6568:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000867be76e/0x85f51a6b96714884 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.564799:0:6568:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000867be76e/0x85f51a6b96714884 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.564812:0:6568:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000867be76e/0x85f51a6b96714884 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.564839:0:6568:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777051248.564952:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051248.565017:0:6568:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000df56773e/0x85f51a6b9671488b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.565031:0:6568:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94f683200 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:3.0:1777051248.565037:0:6568:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000df56773e/0x85f51a6b9671488b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.565052:0:6568:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000df56773e/0x85f51a6b9671488b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.565072:0:6568:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000df56773e/0x85f51a6b9671488b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.565085:0:6568:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000df56773e/0x85f51a6b9671488b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.565108:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051248.565111:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051248.565114:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1777051248.565188:0:24468:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x1ba:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777051248.565219:0:24468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006ddcd6db/0x85f51a6b96714892 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1ba:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.565241:0:24468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051248.565244:0:24468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051248.565250:0:24468:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006ddcd6db/0x85f51a6b96714892 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.565268:0:24468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006ddcd6db/0x85f51a6b96714892 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.565284:0:24468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006ddcd6db/0x85f51a6b96714892 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.565297:0:24468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006ddcd6db/0x85f51a6b96714892 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.565336:0:24468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1777051248.565387:0:6567:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777051248.565400:0:6567:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006ddcd6db/0x85f51a6b96714892 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.565420:0:6567:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94f683a00 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:1.0:1777051248.565429:0:6567:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006ddcd6db/0x85f51a6b96714892 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1777051248.565435:0:24468:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x1b9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777051248.565455:0:6567:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006ddcd6db/0x85f51a6b96714892 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.565456:0:24468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b6313c21/0x85f51a6b96714899 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1b9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.565502:0:24468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051248.565505:0:24468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051248.565510:0:6567:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006ddcd6db/0x85f51a6b96714892 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.565512:0:24468:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6313c21/0x85f51a6b96714899 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.565558:0:6567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006ddcd6db/0x85f51a6b96714892 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.565564:0:24468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6313c21/0x85f51a6b96714899 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.565600:0:24468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b6313c21/0x85f51a6b96714899 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.565614:0:24468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b6313c21/0x85f51a6b96714899 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.565634:0:6567:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777051248.565639:0:24468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1777051248.565644:0:6567:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b6313c21/0x85f51a6b96714899 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.565653:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051248.565663:0:6567:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94f683400 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:1.0:1777051248.565669:0:6567:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6313c21/0x85f51a6b96714899 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.565685:0:6567:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6313c21/0x85f51a6b96714899 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.565709:0:6567:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b6313c21/0x85f51a6b96714899 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.565723:0:6567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6313c21/0x85f51a6b96714899 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1777051248.565726:0:24468:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x1b8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777051248.565747:0:24468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000411d5ce8/0x85f51a6b967148a0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1b8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.565763:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051248.565765:0:24468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051248.565770:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051248.565771:0:24468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051248.565778:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051248.565780:0:24468:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000411d5ce8/0x85f51a6b967148a0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.565800:0:24468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000411d5ce8/0x85f51a6b967148a0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.565815:0:24468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000411d5ce8/0x85f51a6b967148a0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.565829:0:24468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000411d5ce8/0x85f51a6b967148a0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.565888:0:24468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1777051248.565958:0:24468:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x1b7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777051248.565968:0:24468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ce6e2e2f/0x85f51a6b967148a7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1b7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.565983:0:24468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051248.565986:0:24468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051248.565991:0:24468:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ce6e2e2f/0x85f51a6b967148a7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.566009:0:24468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ce6e2e2f/0x85f51a6b967148a7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.566025:0:24468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ce6e2e2f/0x85f51a6b967148a7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.566051:0:24468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ce6e2e2f/0x85f51a6b967148a7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.566077:0:24468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1777051248.566089:0:6568:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1777051248.566096:0:6568:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000411d5ce8/0x85f51a6b967148a0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.566111:0:6568:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94f683600 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:1.0:1777051248.566113:0:13753:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777051248.566119:0:6568:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000411d5ce8/0x85f51a6b967148a0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.566126:0:13753:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ce6e2e2f/0x85f51a6b967148a7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.566147:0:6568:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000411d5ce8/0x85f51a6b967148a0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.566157:0:13753:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94f682600 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:1.0:1777051248.566170:0:13753:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ce6e2e2f/0x85f51a6b967148a7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.566180:0:6568:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000411d5ce8/0x85f51a6b967148a0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.566197:0:13753:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ce6e2e2f/0x85f51a6b967148a7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.566226:0:13753:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ce6e2e2f/0x85f51a6b967148a7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.566246:0:6568:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000411d5ce8/0x85f51a6b967148a0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.566251:0:13753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ce6e2e2f/0x85f51a6b967148a7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.566305:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051248.566312:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051248.566317:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051248.566319:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051248.566326:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051248.566332:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1777051248.566402:0:24468:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x1b6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777051248.566413:0:24468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000025581c0a/0x85f51a6b967148ae lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1b6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.566428:0:24468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051248.566431:0:24468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051248.566437:0:24468:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000025581c0a/0x85f51a6b967148ae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.566453:0:24468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000025581c0a/0x85f51a6b967148ae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.566466:0:24468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000025581c0a/0x85f51a6b967148ae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.566479:0:24468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000025581c0a/0x85f51a6b967148ae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.566510:0:24468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1777051248.566560:0:38719:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777051248.566572:0:38719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000025581c0a/0x85f51a6b967148ae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1777051248.566577:0:24468:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x1b5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777051248.566597:0:24468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000e711329/0x85f51a6b967148b5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1b5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.566598:0:38719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94f682000 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:1.0:1777051248.566608:0:38719:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000025581c0a/0x85f51a6b967148ae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.566629:0:24468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051248.566635:0:24468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051248.566636:0:38719:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000025581c0a/0x85f51a6b967148ae lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.566642:0:24468:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000e711329/0x85f51a6b967148b5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.566685:0:24468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000e711329/0x85f51a6b967148b5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.566687:0:38719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000025581c0a/0x85f51a6b967148ae lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.566731:0:38719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000025581c0a/0x85f51a6b967148ae lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.566731:0:24468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000e711329/0x85f51a6b967148b5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.566779:0:24468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000e711329/0x85f51a6b967148b5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.566792:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051248.566799:0:38719:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777051248.566807:0:38719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000e711329/0x85f51a6b967148b5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.566810:0:24468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1777051248.566831:0:38719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94f682a00 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:1.0:1777051248.566838:0:38719:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000e711329/0x85f51a6b967148b5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.566885:0:38719:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000e711329/0x85f51a6b967148b5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.566907:0:38719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000e711329/0x85f51a6b967148b5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1777051248.566921:0:24468:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x1b4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777051248.566922:0:38719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000e711329/0x85f51a6b967148b5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.566943:0:24468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000061f3c88a/0x85f51a6b967148bc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1b4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.566956:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051248.566962:0:24468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051248.566963:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051248.566970:0:24468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051248.566971:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051248.566978:0:24468:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000061f3c88a/0x85f51a6b967148bc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.566985:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051248.567001:0:24468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000061f3c88a/0x85f51a6b967148bc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.567017:0:24468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000061f3c88a/0x85f51a6b967148bc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.567031:0:24468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000061f3c88a/0x85f51a6b967148bc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.567062:0:24468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1777051248.567107:0:6568:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777051248.567118:0:6568:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000061f3c88a/0x85f51a6b967148bc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1777051248.567125:0:24468:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x1b3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777051248.567143:0:6568:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94f683000 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:3.0:1777051248.567147:0:24468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b0bc321/0x85f51a6b967148c3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1b3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.567152:0:6568:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000061f3c88a/0x85f51a6b967148bc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.567190:0:24468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051248.567195:0:6568:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000061f3c88a/0x85f51a6b967148bc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.567196:0:24468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051248.567221:0:6568:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000061f3c88a/0x85f51a6b967148bc lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.567238:0:24468:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b0bc321/0x85f51a6b967148c3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.567242:0:6568:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000061f3c88a/0x85f51a6b967148bc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.567274:0:24468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006b0bc321/0x85f51a6b967148c3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.567291:0:24468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b0bc321/0x85f51a6b967148c3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.567329:0:24468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006b0bc321/0x85f51a6b967148c3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.567351:0:6568:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777051248.567359:0:24468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1777051248.567362:0:6568:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006b0bc321/0x85f51a6b967148c3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.567375:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051248.567380:0:6568:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94f682800 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:1.0:1777051248.567389:0:6568:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006b0bc321/0x85f51a6b967148c3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.567418:0:6568:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006b0bc321/0x85f51a6b967148c3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1777051248.567442:0:24468:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x1b2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777051248.567444:0:6568:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006b0bc321/0x85f51a6b967148c3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.567460:0:24468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005384d42f/0x85f51a6b967148ca lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1b2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.567465:0:6568:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b0bc321/0x85f51a6b967148c3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.567499:0:24468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051248.567504:0:24468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051248.567510:0:24468:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005384d42f/0x85f51a6b967148ca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.567513:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051248.567521:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051248.567528:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051248.567550:0:24468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005384d42f/0x85f51a6b967148ca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.567566:0:24468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005384d42f/0x85f51a6b967148ca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.567580:0:24468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005384d42f/0x85f51a6b967148ca lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.567609:0:24468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1777051248.567628:0:38719:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777051248.567637:0:38719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005384d42f/0x85f51a6b967148ca lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.567653:0:38719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94f682c00 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:1.0:1777051248.567662:0:38719:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005384d42f/0x85f51a6b967148ca lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.568003:0:38719:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005384d42f/0x85f51a6b967148ca lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1777051248.568006:0:24468:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x1b1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777051248.568029:0:24468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007f0f2531/0x85f51a6b967148d1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1b1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.568042:0:38719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005384d42f/0x85f51a6b967148ca lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.568048:0:24468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051248.568054:0:24468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051248.568063:0:24468:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007f0f2531/0x85f51a6b967148d1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.568102:0:38719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005384d42f/0x85f51a6b967148ca lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.568109:0:24468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007f0f2531/0x85f51a6b967148d1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.568146:0:24468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007f0f2531/0x85f51a6b967148d1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.568160:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051248.568160:0:24468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007f0f2531/0x85f51a6b967148d1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.568168:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051248.568177:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051248.568249:0:24468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1777051248.568259:0:6567:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777051248.568271:0:6567:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007f0f2531/0x85f51a6b967148d1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.568286:0:6567:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94f683e00 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:1.0:1777051248.568292:0:6567:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007f0f2531/0x85f51a6b967148d1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.568308:0:6567:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007f0f2531/0x85f51a6b967148d1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.568331:0:6567:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007f0f2531/0x85f51a6b967148d1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.568346:0:6567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007f0f2531/0x85f51a6b967148d1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1777051248.568361:0:24468:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x1b0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777051248.568376:0:24468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000000156e0a/0x85f51a6b967148d8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1b0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.568378:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051248.568385:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051248.568391:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051248.568402:0:24468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051248.568406:0:24468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051248.568412:0:24468:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000000156e0a/0x85f51a6b967148d8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.568433:0:24468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000000156e0a/0x85f51a6b967148d8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.568448:0:24468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000000156e0a/0x85f51a6b967148d8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.568462:0:24468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000000156e0a/0x85f51a6b967148d8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.568494:0:24468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1777051248.568547:0:13753:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00002000:00010000:3.0:1777051248.568556:0:24468:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x1af:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1777051248.568560:0:13753:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000000156e0a/0x85f51a6b967148d8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.568569:0:24468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c98c2e90/0x85f51a6b967148df lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1af:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051248.568594:0:13753:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d953298a00 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:3.0:1777051248.568599:0:24468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777051248.568604:0:13753:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000000156e0a/0x85f51a6b967148d8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.568605:0:24468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051248.568616:0:24468:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c98c2e90/0x85f51a6b967148df lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051248.568631:0:13753:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000000156e0a/0x85f51a6b967148d8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.568642:0:24468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c98c2e90/0x85f51a6b967148df lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.568660:0:24468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c98c2e90/0x85f51a6b967148df lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.568674:0:24468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c98c2e90/0x85f51a6b967148df lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.568706:0:24468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1777051248.568753:0:6568:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777051248.569050:0:6568:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c98c2e90/0x85f51a6b967148df lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1777051248.569053:0:24468:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x1ae:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777051248.569075:0:24468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd1cff08/0x85f51a6b967148e6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1ae:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.569079:0:6568:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d953298600 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:1.0:1777051248.569091:0:6568:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c98c2e90/0x85f51a6b967148df lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.569104:0:24468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051248.569112:0:24468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051248.569118:0:6568:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c98c2e90/0x85f51a6b967148df lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.569121:0:24468:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fd1cff08/0x85f51a6b967148e6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.569436:0:24468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fd1cff08/0x85f51a6b967148e6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.569446:0:6568:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c98c2e90/0x85f51a6b967148df lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.569458:0:24468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd1cff08/0x85f51a6b967148e6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.569472:0:6568:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c98c2e90/0x85f51a6b967148df lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.569520:0:24468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fd1cff08/0x85f51a6b967148e6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.569530:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051248.569535:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051248.569550:0:24468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1777051248.569566:0:6568:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777051248.569567:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051248.569579:0:6568:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fd1cff08/0x85f51a6b967148e6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.569594:0:6568:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d953299200 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:1.0:1777051248.569600:0:6568:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd1cff08/0x85f51a6b967148e6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.569625:0:6568:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd1cff08/0x85f51a6b967148e6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1777051248.569640:0:24468:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x1ad:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1777051248.569646:0:13753:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000000156e0a/0x85f51a6b967148d8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.569651:0:6568:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fd1cff08/0x85f51a6b967148e6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.569653:0:24468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aec60412/0x85f51a6b967148ed lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1ad:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051248.569698:0:13753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000000156e0a/0x85f51a6b967148d8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.569704:0:6568:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fd1cff08/0x85f51a6b967148e6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.569706:0:24468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051248.569712:0:24468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051248.569724:0:24468:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aec60412/0x85f51a6b967148ed lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.569760:0:24468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aec60412/0x85f51a6b967148ed lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051248.569763:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051248.569771:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777051248.569773:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051248.569781:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777051248.569783:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051248.569785:0:24468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aec60412/0x85f51a6b967148ed lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.569789:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051248.569806:0:24468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aec60412/0x85f51a6b967148ed lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.569839:0:24468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1777051248.569899:0:6567:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777051248.569910:0:6567:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aec60412/0x85f51a6b967148ed lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051248.569925:0:6567:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d953299400 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:2.0:1777051248.569932:0:6567:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aec60412/0x85f51a6b967148ed lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1777051248.569941:0:24468:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x1ac:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1777051248.569947:0:6567:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aec60412/0x85f51a6b967148ed lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.569954:0:24468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b57fa0e9/0x85f51a6b967148f4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1ac:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.569980:0:24468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777051248.569983:0:6567:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aec60412/0x85f51a6b967148ed lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.569984:0:24468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051248.569994:0:24468:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b57fa0e9/0x85f51a6b967148f4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051248.570009:0:6567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aec60412/0x85f51a6b967148ed lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.570021:0:24468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b57fa0e9/0x85f51a6b967148f4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.570040:0:24468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b57fa0e9/0x85f51a6b967148f4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051248.570046:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777051248.570052:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051248.570056:0:24468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b57fa0e9/0x85f51a6b967148f4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051248.570060:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051248.570410:0:24468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1777051248.570430:0:38719:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777051248.570441:0:38719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b57fa0e9/0x85f51a6b967148f4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051248.570456:0:38719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d953298800 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:2.0:1777051248.570466:0:38719:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b57fa0e9/0x85f51a6b967148f4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051248.570482:0:38719:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b57fa0e9/0x85f51a6b967148f4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1777051248.570504:0:24468:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x1ab:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1777051248.570506:0:38719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b57fa0e9/0x85f51a6b967148f4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.570521:0:24468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000034a85079/0x85f51a6b967148fb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1ab:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051248.570529:0:38719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b57fa0e9/0x85f51a6b967148f4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.570558:0:24468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051248.570563:0:24468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051248.570569:0:24468:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000034a85079/0x85f51a6b967148fb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051248.570577:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777051248.570582:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777051248.570587:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051248.570594:0:24468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000034a85079/0x85f51a6b967148fb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.570620:0:24468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000034a85079/0x85f51a6b967148fb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.570634:0:24468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000034a85079/0x85f51a6b967148fb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.570666:0:24468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1777051248.570710:0:13753:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777051248.570719:0:13753:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000034a85079/0x85f51a6b967148fb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1777051248.570737:0:24468:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x1aa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1777051248.570742:0:13753:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d953298200 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:3.0:1777051248.570749:0:24468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003d3d28d3/0x85f51a6b96714902 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1aa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051248.570752:0:13753:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000034a85079/0x85f51a6b967148fb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.570790:0:24468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051248.570797:0:24468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051248.570805:0:24468:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003d3d28d3/0x85f51a6b96714902 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051248.570809:0:13753:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000034a85079/0x85f51a6b967148fb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051248.570881:0:13753:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000034a85079/0x85f51a6b967148fb lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.570882:0:24468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003d3d28d3/0x85f51a6b96714902 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051248.570923:0:13753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000034a85079/0x85f51a6b967148fb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.570927:0:24468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003d3d28d3/0x85f51a6b96714902 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.570967:0:24468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003d3d28d3/0x85f51a6b96714902 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051248.570985:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777051248.570991:0:13753:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777051248.570997:0:13753:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003d3d28d3/0x85f51a6b96714902 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.571000:0:24468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1777051248.571019:0:13753:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d953298c00 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:1.0:1777051248.571022:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777051248.571026:0:13753:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003d3d28d3/0x85f51a6b96714902 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051248.571044:0:13753:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003d3d28d3/0x85f51a6b96714902 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051248.571065:0:13753:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003d3d28d3/0x85f51a6b96714902 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1777051248.571078:0:24468:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x1a9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1777051248.571080:0:13753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003d3d28d3/0x85f51a6b96714902 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.571099:0:24468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000bda7984/0x85f51a6b96714909 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051248.571109:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777051248.571114:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777051248.571119:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051248.571120:0:24468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051248.571126:0:24468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051248.571132:0:24468:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000bda7984/0x85f51a6b96714909 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.571151:0:24468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000bda7984/0x85f51a6b96714909 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.571168:0:24468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000bda7984/0x85f51a6b96714909 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.571181:0:24468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000bda7984/0x85f51a6b96714909 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.571241:0:24468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1777051248.571310:0:24468:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x1a8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777051248.571316:0:6567:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777051248.571320:0:24468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003a6ac3f9/0x85f51a6b96714910 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.571328:0:6567:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000bda7984/0x85f51a6b96714909 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.571350:0:24468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051248.571356:0:24468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051248.571361:0:6567:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d953298400 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:3.0:1777051248.571365:0:24468:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003a6ac3f9/0x85f51a6b96714910 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.571372:0:6567:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000bda7984/0x85f51a6b96714909 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.571396:0:24468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003a6ac3f9/0x85f51a6b96714910 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.571402:0:6567:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000bda7984/0x85f51a6b96714909 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.571433:0:24468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003a6ac3f9/0x85f51a6b96714910 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.571447:0:6567:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000bda7984/0x85f51a6b96714909 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.571450:0:24468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003a6ac3f9/0x85f51a6b96714910 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.571493:0:6567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000bda7984/0x85f51a6b96714909 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.571507:0:24468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1777051248.571523:0:38719:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777051248.571533:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051248.571533:0:38719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003a6ac3f9/0x85f51a6b96714910 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.571541:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051248.571547:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051248.571557:0:38719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d953298e00 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:3.0:1777051248.571565:0:38719:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003a6ac3f9/0x85f51a6b96714910 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.571583:0:38719:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003a6ac3f9/0x85f51a6b96714910 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.571604:0:38719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003a6ac3f9/0x85f51a6b96714910 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.571618:0:38719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003a6ac3f9/0x85f51a6b96714910 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.571647:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051248.571651:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051248.571655:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1777051248.571725:0:24468:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x1a7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777051248.571736:0:24468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000075ed02f0/0x85f51a6b96714917 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.571752:0:24468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051248.571755:0:24468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051248.571761:0:24468:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000075ed02f0/0x85f51a6b96714917 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.571777:0:24468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000075ed02f0/0x85f51a6b96714917 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.571793:0:24468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000075ed02f0/0x85f51a6b96714917 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.571807:0:24468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000075ed02f0/0x85f51a6b96714917 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.571868:0:24468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1777051248.571908:0:6568:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777051248.571920:0:6568:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000075ed02f0/0x85f51a6b96714917 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.571937:0:6568:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d953299a00 already unused, calling callback (ffffffffc0bed2d0) 00002000:00010000:3.0:1777051248.571938:0:24468:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x1a6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777051248.571945:0:6568:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000075ed02f0/0x85f51a6b96714917 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.571952:0:24468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aa6fe782/0x85f51a6b9671491e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.571986:0:6568:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000075ed02f0/0x85f51a6b96714917 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.571989:0:24468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051248.571995:0:24468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051248.572005:0:24468:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aa6fe782/0x85f51a6b9671491e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.572018:0:6568:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000075ed02f0/0x85f51a6b96714917 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.572051:0:6568:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000075ed02f0/0x85f51a6b96714917 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.572054:0:24468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aa6fe782/0x85f51a6b9671491e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.572091:0:24468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aa6fe782/0x85f51a6b9671491e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.572110:0:24468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aa6fe782/0x85f51a6b9671491e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.572115:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051248.572122:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051248.572128:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051248.572147:0:24468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1777051248.572280:0:24468:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x1a5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777051248.572291:0:24468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008889c7d5/0x85f51a6b96714925 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.572307:0:24468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051248.572311:0:24468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051248.572316:0:24468:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008889c7d5/0x85f51a6b96714925 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.572334:0:24468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008889c7d5/0x85f51a6b96714925 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.572351:0:24468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008889c7d5/0x85f51a6b96714925 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.572364:0:24468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008889c7d5/0x85f51a6b96714925 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.572395:0:24468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1777051248.572410:0:6567:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1777051248.572421:0:6567:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aa6fe782/0x85f51a6b9671491e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.572437:0:6567:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d953299000 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:1.0:1777051248.572443:0:6567:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aa6fe782/0x85f51a6b9671491e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.572458:0:6567:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aa6fe782/0x85f51a6b9671491e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1777051248.572460:0:24468:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x1a4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777051248.572478:0:24468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000efd61c8/0x85f51a6b9671492c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.572492:0:6567:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aa6fe782/0x85f51a6b9671491e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.572495:0:24468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051248.572501:0:24468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051248.572509:0:24468:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000efd61c8/0x85f51a6b9671492c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.572517:0:6567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aa6fe782/0x85f51a6b9671491e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.572544:0:24468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000efd61c8/0x85f51a6b9671492c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.572561:0:6567:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777051248.572561:0:24468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000efd61c8/0x85f51a6b9671492c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.572573:0:6567:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008889c7d5/0x85f51a6b96714925 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.572587:0:24468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000efd61c8/0x85f51a6b9671492c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.572601:0:6567:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d953299e00 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:1.0:1777051248.572612:0:6567:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008889c7d5/0x85f51a6b96714925 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.572624:0:24468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1777051248.572629:0:6567:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008889c7d5/0x85f51a6b96714925 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.572638:0:38719:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777051248.572649:0:38719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000efd61c8/0x85f51a6b9671492c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.572657:0:6567:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008889c7d5/0x85f51a6b96714925 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.572673:0:38719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d953298000 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:3.0:1777051248.572684:0:38719:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000efd61c8/0x85f51a6b9671492c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.572687:0:6567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008889c7d5/0x85f51a6b96714925 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.572719:0:38719:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000efd61c8/0x85f51a6b9671492c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.572739:0:38719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000efd61c8/0x85f51a6b9671492c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.572755:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051248.572756:0:38719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000efd61c8/0x85f51a6b9671492c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.572762:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051248.572770:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051248.572798:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051248.572803:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051248.572807:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1777051248.572926:0:24468:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x1a3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777051248.572937:0:24468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e959e0e6/0x85f51a6b96714933 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.572953:0:24468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051248.572957:0:24468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051248.572963:0:24468:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e959e0e6/0x85f51a6b96714933 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.572980:0:24468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e959e0e6/0x85f51a6b96714933 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.572994:0:24468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e959e0e6/0x85f51a6b96714933 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.573016:0:24468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e959e0e6/0x85f51a6b96714933 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.573052:0:24468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1777051248.573404:0:24468:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x1a2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777051248.573416:0:24468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000513568eb/0x85f51a6b9671493a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.573432:0:24468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051248.573436:0:6568:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777051248.573436:0:24468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051248.573445:0:24468:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000513568eb/0x85f51a6b9671493a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.573450:0:6568:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e959e0e6/0x85f51a6b96714933 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.573477:0:24468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000513568eb/0x85f51a6b9671493a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.573480:0:6568:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d953299600 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:1.0:1777051248.573493:0:6568:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e959e0e6/0x85f51a6b96714933 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.573506:0:24468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000513568eb/0x85f51a6b9671493a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.573519:0:6568:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e959e0e6/0x85f51a6b96714933 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.573527:0:24468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000513568eb/0x85f51a6b9671493a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.573561:0:6568:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e959e0e6/0x85f51a6b96714933 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.573571:0:24468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1777051248.573586:0:6568:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e959e0e6/0x85f51a6b96714933 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.573632:0:6568:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777051248.573640:0:6568:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000513568eb/0x85f51a6b9671493a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.573652:0:6568:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da7d784c00 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:1.0:1777051248.573659:0:6568:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000513568eb/0x85f51a6b9671493a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.573673:0:6568:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000513568eb/0x85f51a6b9671493a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051248.573684:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051248.573696:0:6568:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000513568eb/0x85f51a6b9671493a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.573711:0:6568:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000513568eb/0x85f51a6b9671493a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.573737:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051248.573742:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051248.573748:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051248.573762:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:3.0:1777051248.574751:0:24468:0:(ofd_dev.c:1515:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:350 00000100:00100000:3.0:1777051248.574898:0:24468:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942a0e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:101437:x1863365452508032:12345-0@lo:5:osp-pre-0-0.0 Request processed in 31159us (31391us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051248.574921:0:24468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7942 00000100:00100000:1.0:1777051248.575401:0:101437:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955610000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:101437:1863365452508032:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1777051248.575425:0:101437:0:(osp_precreate.c:955:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x1c1:0x0] from OST, last_created [0x280000401:0x1c1:0x0]last_used is [0x280000401:0x15e:0x0] 00000100:00100000:1.0:1777051248.575558:0:101437:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d950264380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:101437:1863365452508416:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1777051248.575635:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955610000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3678:1863365452508288:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1777051248.575637:0:101437:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051248.575705:0:101437:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d94e77ec00 going to sleep for 11 seconds 00000100:00100000:1.0:1777051248.575746:0:27887:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452508416 00000100:00100000:1.0:1777051248.575756:0:27887:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452508416 00000100:00100000:3.0:1777051248.575765:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051248.575828:0:27887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7944 00000100:00100000:1.0:1777051248.575878:0:27887:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7d309c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:101437:x1863365452508416:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:1.0:1777051248.575931:0:27887:0:(ofd_dev.c:1745:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 450 00000100:00100000:3.0:1777051248.576329:0:8472:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452508288 00000100:00100000:3.0:1777051248.576339:0:8472:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452508288 00000100:00100000:3.0:1777051248.576396:0:8472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5518 00000100:00100000:3.0:1777051248.576412:0:8472:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da444a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3678:x1863365452508288:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1777051248.576438:0:8472:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 440355008 pending 896 free 3862671360 avail 3631149056 00000100:00100000:3.0:1777051248.576511:0:8472:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da444a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3678:x1863365452508288:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (750us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051248.576524:0:8472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5518 00000100:00100000:3.0:1777051248.576602:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955610000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3678:1863365452508288:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1777051248.579362:0:27887:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7d309c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+6:101437:x1863365452508416:12345-0@lo:5:osp-pre-0-0.0 Request processed in 3515us (3725us total) trans 4294968347 rc 0/0 00000100:00100000:1.0:1777051248.579379:0:27887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7944 00000100:00100000:2.0:1777051248.580396:0:101437:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d950264380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:101437:1863365452508416:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1777051248.580419:0:101437:0:(osp_precreate.c:701:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x1c1:0x0]-[0x280000401:0x1e1:0x0] 00002000:00010000:1.0:1777051248.587599:0:8628:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x1c1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777051248.587616:0:8628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005fe8468b/0x85f51a6b96714941 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1c1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.587642:0:8628:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051248.587646:0:8628:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051248.587653:0:8628:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005fe8468b/0x85f51a6b96714941 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.587679:0:8628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005fe8468b/0x85f51a6b96714941 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.587698:0:8628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005fe8468b/0x85f51a6b96714941 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.587711:0:8628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005fe8468b/0x85f51a6b96714941 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.588075:0:8628:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1777051248.588139:0:38719:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777051248.588150:0:38719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005fe8468b/0x85f51a6b96714941 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051248.588163:0:38719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da429d7a00 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:2.0:1777051248.588169:0:38719:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005fe8468b/0x85f51a6b96714941 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051248.588181:0:38719:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005fe8468b/0x85f51a6b96714941 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051248.588240:0:38719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005fe8468b/0x85f51a6b96714941 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051248.588255:0:38719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005fe8468b/0x85f51a6b96714941 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1777051248.588281:0:8628:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x1c0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1777051248.588288:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777051248.588293:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051248.588295:0:8628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000062812b6e/0x85f51a6b96714948 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051248.588300:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051248.588317:0:8628:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051248.588321:0:8628:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051248.588328:0:8628:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000062812b6e/0x85f51a6b96714948 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.588346:0:8628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000062812b6e/0x85f51a6b96714948 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.588362:0:8628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000062812b6e/0x85f51a6b96714948 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.588375:0:8628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000062812b6e/0x85f51a6b96714948 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.588410:0:8628:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1777051248.588464:0:13753:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777051248.588484:0:13753:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000062812b6e/0x85f51a6b96714948 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051248.588501:0:13753:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da429d7000 already unused, calling callback (ffffffffc0bed2d0) 00002000:00010000:1.0:1777051248.588505:0:8628:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x1bf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1777051248.588508:0:13753:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000062812b6e/0x85f51a6b96714948 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.588521:0:8628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000070869722/0x85f51a6b9671494f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1bf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051248.588531:0:13753:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000062812b6e/0x85f51a6b96714948 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.588543:0:8628:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051248.588549:0:8628:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051248.588558:0:8628:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000070869722/0x85f51a6b9671494f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051248.588564:0:13753:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000062812b6e/0x85f51a6b96714948 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.588586:0:8628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000070869722/0x85f51a6b9671494f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051248.588587:0:13753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000062812b6e/0x85f51a6b96714948 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.588618:0:8628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000070869722/0x85f51a6b9671494f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.588640:0:8628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000070869722/0x85f51a6b9671494f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051248.588642:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777051248.588647:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777051248.588653:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051248.588961:0:8628:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1777051248.588983:0:6568:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1777051248.588995:0:6568:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000070869722/0x85f51a6b9671494f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051248.589012:0:6568:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da429d6200 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:0.0:1777051248.589020:0:6568:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000070869722/0x85f51a6b9671494f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051248.589034:0:6568:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000070869722/0x85f51a6b9671494f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1777051248.589038:0:8628:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x1be:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777051248.589056:0:8628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d4050073/0x85f51a6b96714956 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1be:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051248.589066:0:6568:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000070869722/0x85f51a6b9671494f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.589073:0:8628:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051248.589078:0:8628:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777051248.589087:0:6568:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000070869722/0x85f51a6b9671494f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.589087:0:8628:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d4050073/0x85f51a6b96714956 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.589133:0:8628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d4050073/0x85f51a6b96714956 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051248.589140:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777051248.589146:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777051248.589152:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051248.589152:0:8628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d4050073/0x85f51a6b96714956 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.589180:0:8628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d4050073/0x85f51a6b96714956 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.589247:0:8628:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1777051248.589319:0:8628:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x1bd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777051248.589331:0:8628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000039d760f0/0x85f51a6b9671495d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1bd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.589346:0:8628:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051248.589350:0:8628:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051248.589356:0:8628:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000039d760f0/0x85f51a6b9671495d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.589373:0:8628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000039d760f0/0x85f51a6b9671495d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.589388:0:8628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000039d760f0/0x85f51a6b9671495d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051248.589394:0:6567:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777051248.589399:0:8628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000039d760f0/0x85f51a6b9671495d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051248.589408:0:6567:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d4050073/0x85f51a6b96714956 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051248.589430:0:6567:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da429d7200 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:1.0:1777051248.589432:0:8628:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1777051248.589440:0:6567:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d4050073/0x85f51a6b96714956 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051248.589459:0:6567:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d4050073/0x85f51a6b96714956 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1777051248.589512:0:8628:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x1bc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777051248.589525:0:8628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b6f27459/0x85f51a6b96714964 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1bc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.589550:0:8628:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051248.589554:0:8628:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051248.589561:0:8628:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b6f27459/0x85f51a6b96714964 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051248.589568:0:6567:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d4050073/0x85f51a6b96714956 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.589580:0:8628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b6f27459/0x85f51a6b96714964 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051248.589588:0:6567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d4050073/0x85f51a6b96714956 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.589610:0:8628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b6f27459/0x85f51a6b96714964 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.589627:0:8628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b6f27459/0x85f51a6b96714964 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051248.589631:0:6567:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1777051248.589642:0:6567:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000039d760f0/0x85f51a6b9671495d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051248.589657:0:6567:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d9442eb200 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:1.0:1777051248.589661:0:8628:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1777051248.589663:0:6567:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000039d760f0/0x85f51a6b9671495d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051248.589680:0:6567:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000039d760f0/0x85f51a6b9671495d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051248.589702:0:6567:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000039d760f0/0x85f51a6b9671495d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051248.590046:0:6567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000039d760f0/0x85f51a6b9671495d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1777051248.590046:0:8628:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x1bb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777051248.590065:0:8628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001903dda0/0x85f51a6b9671496b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1bb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.590083:0:8628:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051248.590086:0:8628:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051248.590091:0:8628:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001903dda0/0x85f51a6b9671496b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.590108:0:8628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001903dda0/0x85f51a6b9671496b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051248.590114:0:6567:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1777051248.590132:0:6567:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b6f27459/0x85f51a6b96714964 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.590138:0:8628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001903dda0/0x85f51a6b9671496b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051248.590160:0:6567:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d9442ebe00 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:1.0:1777051248.590168:0:8628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001903dda0/0x85f51a6b9671496b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051248.590169:0:6567:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b6f27459/0x85f51a6b96714964 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051248.590237:0:6567:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b6f27459/0x85f51a6b96714964 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051248.590262:0:6567:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b6f27459/0x85f51a6b96714964 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051248.590277:0:6567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b6f27459/0x85f51a6b96714964 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.590298:0:8628:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1777051248.590317:0:6567:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1777051248.590325:0:6567:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001903dda0/0x85f51a6b9671496b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051248.590339:0:6567:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d9442eaa00 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:0.0:1777051248.590345:0:6567:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001903dda0/0x85f51a6b9671496b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051248.590367:0:6567:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001903dda0/0x85f51a6b9671496b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051248.590368:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1777051248.590377:0:8628:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x1ba:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1777051248.590381:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051248.590395:0:8628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c454c4cc/0x85f51a6b96714972 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1ba:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051248.590398:0:6567:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001903dda0/0x85f51a6b9671496b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.590431:0:8628:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777051248.590433:0:6567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001903dda0/0x85f51a6b9671496b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.590437:0:8628:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051248.590446:0:8628:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c454c4cc/0x85f51a6b96714972 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.590463:0:8628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c454c4cc/0x85f51a6b96714972 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051248.590464:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777051248.590470:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777051248.590477:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051248.590479:0:8628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c454c4cc/0x85f51a6b96714972 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.590490:0:8628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c454c4cc/0x85f51a6b96714972 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.590519:0:8628:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1777051248.590592:0:8628:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x1b9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777051248.590603:0:8628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000049fd92b5/0x85f51a6b96714979 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1b9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051248.590611:0:6568:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777051248.590618:0:8628:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777051248.590622:0:6568:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c454c4cc/0x85f51a6b96714972 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.590623:0:8628:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051248.590632:0:8628:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000049fd92b5/0x85f51a6b96714979 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051248.590648:0:6568:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d9442eba00 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:0.0:1777051248.590660:0:6568:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c454c4cc/0x85f51a6b96714972 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.590664:0:8628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000049fd92b5/0x85f51a6b96714979 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051248.590684:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051248.590977:0:8628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000049fd92b5/0x85f51a6b96714979 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051248.590986:0:6568:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c454c4cc/0x85f51a6b96714972 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.590996:0:8628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000049fd92b5/0x85f51a6b96714979 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051248.591022:0:6568:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c454c4cc/0x85f51a6b96714972 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.591039:0:8628:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1777051248.591051:0:6568:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c454c4cc/0x85f51a6b96714972 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051248.591074:0:6568:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1777051248.591081:0:6568:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000049fd92b5/0x85f51a6b96714979 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051248.591085:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777051248.591095:0:6568:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d9442eb400 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:0.0:1777051248.591101:0:6568:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000049fd92b5/0x85f51a6b96714979 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051248.591113:0:6568:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000049fd92b5/0x85f51a6b96714979 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1777051248.591117:0:8628:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x1b8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777051248.591138:0:8628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002da22fbd/0x85f51a6b96714980 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1b8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051248.591139:0:6568:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000049fd92b5/0x85f51a6b96714979 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051248.591178:0:6568:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000049fd92b5/0x85f51a6b96714979 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.591182:0:8628:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051248.591189:0:8628:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051248.591240:0:8628:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002da22fbd/0x85f51a6b96714980 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051248.591246:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777051248.591252:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777051248.591258:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051248.591268:0:8628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002da22fbd/0x85f51a6b96714980 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.591286:0:8628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002da22fbd/0x85f51a6b96714980 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.591300:0:8628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002da22fbd/0x85f51a6b96714980 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.591330:0:8628:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1777051248.591344:0:6567:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1777051248.591353:0:6567:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002da22fbd/0x85f51a6b96714980 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051248.591366:0:6567:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d9442eb600 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:0.0:1777051248.591372:0:6567:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002da22fbd/0x85f51a6b96714980 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051248.591384:0:6567:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002da22fbd/0x85f51a6b96714980 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1777051248.591400:0:8628:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x1b7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1777051248.591402:0:6567:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002da22fbd/0x85f51a6b96714980 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.591419:0:8628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d1127f8c/0x85f51a6b96714987 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1b7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051248.591422:0:6567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002da22fbd/0x85f51a6b96714980 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.591455:0:8628:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051248.591460:0:8628:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051248.591466:0:8628:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d1127f8c/0x85f51a6b96714987 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051248.591468:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777051248.591474:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777051248.591482:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051248.591489:0:8628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d1127f8c/0x85f51a6b96714987 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.591505:0:8628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d1127f8c/0x85f51a6b96714987 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.591517:0:8628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d1127f8c/0x85f51a6b96714987 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.591553:0:8628:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1777051248.591615:0:8628:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x1b6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777051248.591622:0:8628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000086c63cdc/0x85f51a6b9671498e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1b6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.591631:0:8628:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051248.591633:0:8628:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051248.591637:0:8628:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000086c63cdc/0x85f51a6b9671498e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.591646:0:8628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000086c63cdc/0x85f51a6b9671498e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.591654:0:8628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000086c63cdc/0x85f51a6b9671498e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.591661:0:8628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000086c63cdc/0x85f51a6b9671498e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.591681:0:8628:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1777051248.592042:0:13753:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1777051248.592050:0:13753:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d1127f8c/0x85f51a6b96714987 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1777051248.592063:0:8628:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x1b5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777051248.592071:0:8628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b7f160cd/0x85f51a6b96714995 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1b5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051248.592074:0:13753:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d9442ea400 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:2.0:1777051248.592080:0:13753:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d1127f8c/0x85f51a6b96714987 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.592084:0:8628:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051248.592086:0:8628:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051248.592092:0:8628:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b7f160cd/0x85f51a6b96714995 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051248.592094:0:13753:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d1127f8c/0x85f51a6b96714987 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.592109:0:8628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b7f160cd/0x85f51a6b96714995 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051248.592114:0:13753:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d1127f8c/0x85f51a6b96714987 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.592123:0:8628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b7f160cd/0x85f51a6b96714995 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051248.592127:0:13753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d1127f8c/0x85f51a6b96714987 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.592137:0:8628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b7f160cd/0x85f51a6b96714995 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051248.592156:0:13753:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1777051248.592161:0:13753:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000086c63cdc/0x85f51a6b9671498e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.592163:0:8628:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1777051248.592173:0:13753:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d9442eac00 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:1.0:1777051248.592175:0:6568:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777051248.592178:0:13753:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000086c63cdc/0x85f51a6b9671498e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.592180:0:6568:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b7f160cd/0x85f51a6b96714995 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.592193:0:6568:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d9442ea800 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:2.0:1777051248.592193:0:13753:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000086c63cdc/0x85f51a6b9671498e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051248.592209:0:13753:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000086c63cdc/0x85f51a6b9671498e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051248.592224:0:13753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000086c63cdc/0x85f51a6b9671498e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051248.592250:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777051248.592254:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777051248.592257:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051248.592569:0:6568:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b7f160cd/0x85f51a6b96714995 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.592583:0:6568:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b7f160cd/0x85f51a6b96714995 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.592626:0:6568:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b7f160cd/0x85f51a6b96714995 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.592638:0:6568:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b7f160cd/0x85f51a6b96714995 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.592656:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051248.592660:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051248.592663:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1777051248.594755:0:8628:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x1b4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777051248.594766:0:8628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006e16e75b/0x85f51a6b9671499c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1b4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.594782:0:8628:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051248.594785:0:8628:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051248.594790:0:8628:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006e16e75b/0x85f51a6b9671499c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051248.594799:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051248.594807:0:8628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006e16e75b/0x85f51a6b9671499c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.594822:0:8628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006e16e75b/0x85f51a6b9671499c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.594834:0:8628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006e16e75b/0x85f51a6b9671499c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.594889:0:8628:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1777051248.594935:0:6567:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1777051248.594946:0:6567:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006e16e75b/0x85f51a6b9671499c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1777051248.594952:0:8628:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x1b3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1777051248.594971:0:6567:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d9442ea200 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:1.0:1777051248.594973:0:8628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007b859ac7/0x85f51a6b967149a3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1b3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051248.594989:0:6567:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006e16e75b/0x85f51a6b9671499c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.594993:0:8628:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051248.594997:0:8628:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051248.595003:0:8628:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007b859ac7/0x85f51a6b967149a3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.595028:0:8628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007b859ac7/0x85f51a6b967149a3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.595068:0:8628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007b859ac7/0x85f51a6b967149a3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051248.595079:0:6567:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006e16e75b/0x85f51a6b9671499c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.595083:0:8628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007b859ac7/0x85f51a6b967149a3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051248.595129:0:6567:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006e16e75b/0x85f51a6b9671499c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.595144:0:8628:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1777051248.595145:0:6567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006e16e75b/0x85f51a6b9671499c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051248.595180:0:6567:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1777051248.595187:0:6567:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007b859ac7/0x85f51a6b967149a3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051248.595199:0:6567:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d9442ea000 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:0.0:1777051248.595205:0:6567:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007b859ac7/0x85f51a6b967149a3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051248.595220:0:6567:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007b859ac7/0x85f51a6b967149a3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051248.595241:0:6567:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007b859ac7/0x85f51a6b967149a3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1777051248.595268:0:8628:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x1b2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777051248.595279:0:8628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fe12e804/0x85f51a6b967149aa lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1b2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.595294:0:8628:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051248.595297:0:8628:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051248.595302:0:8628:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fe12e804/0x85f51a6b967149aa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.595318:0:8628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fe12e804/0x85f51a6b967149aa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051248.595331:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051248.595332:0:8628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fe12e804/0x85f51a6b967149aa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.595345:0:8628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fe12e804/0x85f51a6b967149aa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.595375:0:8628:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1777051248.595410:0:6568:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777051248.595418:0:6568:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fe12e804/0x85f51a6b967149aa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051248.595431:0:6568:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d9442eb800 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:2.0:1777051248.595438:0:6568:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fe12e804/0x85f51a6b967149aa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1777051248.595448:0:8628:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x1b1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1777051248.595450:0:6568:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fe12e804/0x85f51a6b967149aa lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.595456:0:8628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007cef667b/0x85f51a6b967149b1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1b1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.595469:0:8628:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051248.595472:0:8628:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777051248.595472:0:6568:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fe12e804/0x85f51a6b967149aa lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.595478:0:8628:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007cef667b/0x85f51a6b967149b1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051248.595486:0:6568:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fe12e804/0x85f51a6b967149aa lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.595496:0:8628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007cef667b/0x85f51a6b967149b1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.595509:0:8628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007cef667b/0x85f51a6b967149b1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051248.595513:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777051248.595519:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051248.595521:0:8628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007cef667b/0x85f51a6b967149b1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051248.595523:0:6567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007b859ac7/0x85f51a6b967149a3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051248.595524:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051248.595564:0:8628:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1777051248.595579:0:38719:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1777051248.595580:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051248.595586:0:38719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007cef667b/0x85f51a6b967149b1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051248.595587:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777051248.595592:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051248.595606:0:38719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d9442eb000 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:1.0:1777051248.595613:0:38719:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007cef667b/0x85f51a6b967149b1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.595627:0:38719:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007cef667b/0x85f51a6b967149b1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.595648:0:38719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007cef667b/0x85f51a6b967149b1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.595662:0:38719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007cef667b/0x85f51a6b967149b1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.595692:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051248.595695:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051248.595698:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1777051248.595767:0:8628:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x1b0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777051248.595777:0:8628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000044456dcf/0x85f51a6b967149b8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1b0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.595790:0:8628:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051248.595793:0:8628:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051248.595798:0:8628:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000044456dcf/0x85f51a6b967149b8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.595813:0:8628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000044456dcf/0x85f51a6b967149b8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.595827:0:8628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000044456dcf/0x85f51a6b967149b8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.595878:0:8628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000044456dcf/0x85f51a6b967149b8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.595912:0:8628:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1777051248.595968:0:13753:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00002000:00010000:1.0:1777051248.595972:0:8628:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x1af:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777051248.595980:0:13753:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000044456dcf/0x85f51a6b967149b8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.595984:0:8628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d7a33e2b/0x85f51a6b967149bf lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1af:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.596015:0:13753:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d9442ea600 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:1.0:1777051248.596020:0:8628:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051248.596023:0:13753:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000044456dcf/0x85f51a6b967149b8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.596025:0:8628:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051248.596034:0:8628:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d7a33e2b/0x85f51a6b967149bf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.596046:0:13753:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000044456dcf/0x85f51a6b967149b8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.596059:0:8628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d7a33e2b/0x85f51a6b967149bf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.596073:0:13753:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000044456dcf/0x85f51a6b967149b8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.596076:0:8628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d7a33e2b/0x85f51a6b967149bf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.596113:0:8628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d7a33e2b/0x85f51a6b967149bf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.596125:0:13753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000044456dcf/0x85f51a6b967149b8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.596155:0:8628:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1777051248.596156:0:13753:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777051248.596165:0:13753:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d7a33e2b/0x85f51a6b967149bf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051248.596502:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051248.597957:0:13753:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d9442eae00 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:3.0:1777051248.597966:0:13753:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d7a33e2b/0x85f51a6b967149bf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.597981:0:13753:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d7a33e2b/0x85f51a6b967149bf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.598001:0:13753:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d7a33e2b/0x85f51a6b967149bf lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.598014:0:13753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d7a33e2b/0x85f51a6b967149bf lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.598036:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051248.598039:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051248.598042:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1777051248.600587:0:9540:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00002000:00010000:2.0:1777051248.600619:0:8628:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x1ae:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1777051248.600630:0:8628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c440dff5/0x85f51a6b967149c6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1ae:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051248.600649:0:8628:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777051248.600651:0:8628:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777051248.600656:0:8628:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c440dff5/0x85f51a6b967149c6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051248.600667:0:8628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c440dff5/0x85f51a6b967149c6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051248.600677:0:8628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c440dff5/0x85f51a6b967149c6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051248.600688:0:8628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c440dff5/0x85f51a6b967149c6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051248.600748:0:8628:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1777051248.600785:0:6567:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1777051248.600798:0:6567:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c440dff5/0x85f51a6b967149c6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051248.600817:0:6567:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94e9d7600 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:0.0:1777051248.600825:0:6567:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c440dff5/0x85f51a6b967149c6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1777051248.600829:0:8628:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x1ad:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1777051248.600871:0:8628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ba6c3a04/0x85f51a6b967149cd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1ad:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051248.600886:0:6567:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c440dff5/0x85f51a6b967149c6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051248.600891:0:8628:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777051248.600896:0:8628:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777051248.600902:0:8628:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ba6c3a04/0x85f51a6b967149cd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051248.600927:0:6567:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c440dff5/0x85f51a6b967149c6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051248.600930:0:8628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ba6c3a04/0x85f51a6b967149cd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051248.600953:0:6567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c440dff5/0x85f51a6b967149c6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051248.600983:0:8628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ba6c3a04/0x85f51a6b967149cd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051248.600994:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777051248.600999:0:8628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ba6c3a04/0x85f51a6b967149cd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051248.601000:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777051248.601006:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777051248.601044:0:8628:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1777051248.601409:0:8628:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x1ac:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1777051248.601418:0:8628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e34c3d6a/0x85f51a6b967149d4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1ac:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051248.601431:0:8628:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777051248.601433:0:8628:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777051248.601438:0:8628:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e34c3d6a/0x85f51a6b967149d4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051248.601452:0:8628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e34c3d6a/0x85f51a6b967149d4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051248.601464:0:8628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e34c3d6a/0x85f51a6b967149d4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051248.601476:0:8628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e34c3d6a/0x85f51a6b967149d4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051248.601502:0:8628:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1777051248.601564:0:8628:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x1ab:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1777051248.601571:0:8628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000837b311d/0x85f51a6b967149db lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1ab:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051248.601583:0:8628:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777051248.601586:0:8628:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777051248.601590:0:8628:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000837b311d/0x85f51a6b967149db lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051248.601605:0:8628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000837b311d/0x85f51a6b967149db lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051248.601617:0:8628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000837b311d/0x85f51a6b967149db lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051248.601628:0:8628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000837b311d/0x85f51a6b967149db lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051248.601649:0:8628:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:2.0:1777051248.601702:0:8628:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x1aa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1777051248.601709:0:8628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000112ac9a6/0x85f51a6b967149e2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1aa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051248.601718:0:8628:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777051248.601720:0:8628:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777051248.601725:0:8628:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000112ac9a6/0x85f51a6b967149e2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051248.601736:0:8628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000112ac9a6/0x85f51a6b967149e2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.601739:0:13753:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1777051248.602021:0:8628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000112ac9a6/0x85f51a6b967149e2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.602023:0:13753:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ba6c3a04/0x85f51a6b967149cd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051248.602053:0:8628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000112ac9a6/0x85f51a6b967149e2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.602074:0:13753:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94e9d6c00 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:2.0:1777051248.602077:0:8628:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1777051248.602082:0:13753:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ba6c3a04/0x85f51a6b967149cd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.602100:0:13753:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ba6c3a04/0x85f51a6b967149cd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.602126:0:13753:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ba6c3a04/0x85f51a6b967149cd lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.602417:0:13753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ba6c3a04/0x85f51a6b967149cd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1777051248.602429:0:8628:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x1a9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1777051248.602442:0:8628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000809b39cf/0x85f51a6b967149e9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.602447:0:13753:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1777051248.602459:0:8628:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777051248.602463:0:8628:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051248.602465:0:13753:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e34c3d6a/0x85f51a6b967149d4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051248.602469:0:8628:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000809b39cf/0x85f51a6b967149e9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.602498:0:13753:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d955a90600 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:3.0:1777051248.602505:0:13753:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e34c3d6a/0x85f51a6b967149d4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051248.602506:0:8628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000809b39cf/0x85f51a6b967149e9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.602537:0:13753:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e34c3d6a/0x85f51a6b967149d4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051248.602541:0:8628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000809b39cf/0x85f51a6b967149e9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.602572:0:13753:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e34c3d6a/0x85f51a6b967149d4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051248.602577:0:8628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000809b39cf/0x85f51a6b967149e9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051248.602634:0:8628:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:2.0:1777051248.602699:0:8628:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x1a8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1777051248.602707:0:8628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002dda27db/0x85f51a6b967149f0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.603386:0:38719:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1777051248.603394:0:38719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000837b311d/0x85f51a6b967149db lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.603408:0:38719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d955a90a00 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:1.0:1777051248.603415:0:38719:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000837b311d/0x85f51a6b967149db lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.603430:0:38719:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000837b311d/0x85f51a6b967149db lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.603450:0:38719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000837b311d/0x85f51a6b967149db lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.603463:0:38719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000837b311d/0x85f51a6b967149db lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051248.603481:0:6568:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1777051248.603489:0:38719:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1777051248.603493:0:6568:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000112ac9a6/0x85f51a6b967149e2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.603497:0:38719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000809b39cf/0x85f51a6b967149e9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.603515:0:38719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d955a90e00 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:1.0:1777051248.603520:0:38719:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000809b39cf/0x85f51a6b967149e9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.603545:0:38719:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000809b39cf/0x85f51a6b967149e9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051248.603549:0:6568:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d955a91e00 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:0.0:1777051248.603558:0:6568:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000112ac9a6/0x85f51a6b967149e2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.603568:0:38719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000809b39cf/0x85f51a6b967149e9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051248.603579:0:6568:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000112ac9a6/0x85f51a6b967149e2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.603589:0:38719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000809b39cf/0x85f51a6b967149e9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.603620:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051248.603623:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777051248.603624:0:6568:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000112ac9a6/0x85f51a6b967149e2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.603626:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777051248.603643:0:6568:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000112ac9a6/0x85f51a6b967149e2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.603667:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777051248.603673:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777051248.603679:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777051248.603683:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777051248.604061:0:8628:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777051248.604064:0:8628:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777051248.604069:0:8628:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002dda27db/0x85f51a6b967149f0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051248.604087:0:8628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002dda27db/0x85f51a6b967149f0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051248.604100:0:8628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002dda27db/0x85f51a6b967149f0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051248.604113:0:8628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002dda27db/0x85f51a6b967149f0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.604118:0:13753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e34c3d6a/0x85f51a6b967149d4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.604160:0:13753:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777051248.604168:0:13753:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002dda27db/0x85f51a6b967149f0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.604180:0:13753:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d955a90400 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:3.0:1777051248.604186:0:13753:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002dda27db/0x85f51a6b967149f0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.604201:0:13753:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002dda27db/0x85f51a6b967149f0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.604222:0:13753:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002dda27db/0x85f51a6b967149f0 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x1a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051248.604227:0:8628:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1777051248.604243:0:13753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002dda27db/0x85f51a6b967149f0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.604269:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051248.604274:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1777051248.604352:0:8628:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x1a7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1777051248.604361:0:8628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004c52e686/0x85f51a6b967149f7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051248.604383:0:8628:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777051248.604386:0:8628:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777051248.604391:0:8628:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004c52e686/0x85f51a6b967149f7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051248.604407:0:8628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004c52e686/0x85f51a6b967149f7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051248.604420:0:8628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004c52e686/0x85f51a6b967149f7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051248.604432:0:8628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004c52e686/0x85f51a6b967149f7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.604513:0:38719:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777051248.604522:0:38719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004c52e686/0x85f51a6b967149f7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.604535:0:38719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d955a99c00 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:1.0:1777051248.604540:0:38719:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004c52e686/0x85f51a6b967149f7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.604553:0:38719:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004c52e686/0x85f51a6b967149f7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.604572:0:38719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004c52e686/0x85f51a6b967149f7 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x1a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051248.604586:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051248.604590:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051248.604594:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777051248.604693:0:8628:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1777051248.604702:0:8628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004c52e686/0x85f51a6b967149f7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051248.604737:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051248.604773:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1777051248.604813:0:8628:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x1a6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1777051248.604823:0:8628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e529f81b/0x85f51a6b967149fe lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051248.604837:0:8628:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777051248.604839:0:8628:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777051248.604870:0:8628:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e529f81b/0x85f51a6b967149fe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051248.604898:0:8628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e529f81b/0x85f51a6b967149fe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051248.604914:0:8628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e529f81b/0x85f51a6b967149fe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051248.604927:0:8628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e529f81b/0x85f51a6b967149fe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051248.604960:0:8628:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1777051248.605021:0:8628:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x1a5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1777051248.605030:0:8628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000027fa85ff/0x85f51a6b96714a05 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051248.605044:0:8628:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777051248.605047:0:8628:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777051248.605052:0:8628:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000027fa85ff/0x85f51a6b96714a05 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051248.605069:0:6568:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777051248.605069:0:8628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000027fa85ff/0x85f51a6b96714a05 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051248.605083:0:6568:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e529f81b/0x85f51a6b967149fe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051248.605087:0:8628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000027fa85ff/0x85f51a6b96714a05 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051248.605116:0:6568:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d955a99000 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:2.0:1777051248.605119:0:8628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000027fa85ff/0x85f51a6b96714a05 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051248.605124:0:6568:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e529f81b/0x85f51a6b967149fe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051248.605165:0:6568:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e529f81b/0x85f51a6b967149fe lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051248.605174:0:8628:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1777051248.605182:0:6568:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e529f81b/0x85f51a6b967149fe lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051248.605191:0:6568:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e529f81b/0x85f51a6b967149fe lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051248.605209:0:6568:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1777051248.605214:0:6568:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000027fa85ff/0x85f51a6b96714a05 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051248.605223:0:6568:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d955a98c00 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:0.0:1777051248.605230:0:6568:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000027fa85ff/0x85f51a6b96714a05 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1777051248.605245:0:8628:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x1a4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1777051248.605246:0:6568:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000027fa85ff/0x85f51a6b96714a05 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051248.605264:0:8628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008c914de6/0x85f51a6b96714a0c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051248.605275:0:6568:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000027fa85ff/0x85f51a6b96714a05 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.605275:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777051248.605288:0:8628:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777051248.605295:0:8628:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777051248.605297:0:6568:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000027fa85ff/0x85f51a6b96714a05 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051248.605302:0:8628:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008c914de6/0x85f51a6b96714a0c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051248.605342:0:8628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008c914de6/0x85f51a6b96714a0c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051248.605359:0:8628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008c914de6/0x85f51a6b96714a0c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051248.605362:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777051248.605367:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777051248.605373:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777051248.605409:0:8628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008c914de6/0x85f51a6b96714a0c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051248.605441:0:8628:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1777051248.605485:0:13753:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777051248.605505:0:13753:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008c914de6/0x85f51a6b96714a0c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1777051248.605510:0:8628:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x1a3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1777051248.605529:0:8628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d0dfae23/0x85f51a6b96714a13 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.605531:0:13753:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d955a99a00 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:3.0:1777051248.605543:0:13753:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008c914de6/0x85f51a6b96714a0c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051248.605555:0:8628:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777051248.605561:0:8628:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051248.605568:0:13753:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008c914de6/0x85f51a6b96714a0c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051248.605569:0:8628:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d0dfae23/0x85f51a6b96714a13 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051248.605614:0:8628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d0dfae23/0x85f51a6b96714a13 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.605621:0:13753:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008c914de6/0x85f51a6b96714a0c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051248.605633:0:8628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d0dfae23/0x85f51a6b96714a13 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.605646:0:13753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008c914de6/0x85f51a6b96714a0c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051248.605957:0:8628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d0dfae23/0x85f51a6b96714a13 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051248.605999:0:8628:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1777051248.606081:0:8628:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x1a2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777051248.606082:0:13753:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777051248.606094:0:13753:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d0dfae23/0x85f51a6b96714a13 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051248.606099:0:8628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000094dd232d/0x85f51a6b96714a1a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.606128:0:13753:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d955a98800 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:2.0:1777051248.606134:0:8628:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051248.606138:0:13753:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d0dfae23/0x85f51a6b96714a13 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051248.606139:0:8628:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777051248.606148:0:8628:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000094dd232d/0x85f51a6b96714a1a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.606170:0:13753:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d0dfae23/0x85f51a6b96714a13 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051248.606179:0:8628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000094dd232d/0x85f51a6b96714a1a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.606194:0:13753:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d0dfae23/0x85f51a6b96714a13 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.606206:0:13753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d0dfae23/0x85f51a6b96714a13 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.606228:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051248.606231:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051248.606235:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777051248.606239:0:8628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000094dd232d/0x85f51a6b96714a1a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051248.606267:0:8628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000094dd232d/0x85f51a6b96714a1a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051248.606296:0:8628:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1777051248.606311:0:38719:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777051248.606320:0:38719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000094dd232d/0x85f51a6b96714a1a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.606334:0:38719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d955a98400 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:3.0:1777051248.606340:0:38719:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000094dd232d/0x85f51a6b96714a1a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.606353:0:38719:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000094dd232d/0x85f51a6b96714a1a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.606376:0:38719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000094dd232d/0x85f51a6b96714a1a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.606390:0:38719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000094dd232d/0x85f51a6b96714a1a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051248.606417:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051248.606422:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051248.606428:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777051248.607036:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:2.0:1777051248.607515:0:8628:0:(ofd_dev.c:1515:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:350 00000100:00100000:2.0:1777051248.607642:0:8628:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f865180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:101439:x1863365452508160:12345-0@lo:5:osp-pre-1-0.0 Request processed in 63107us (63907us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051248.607659:0:8628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7943 00000100:00100000:3.0:1777051248.607714:0:101439:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95f864a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:101439:1863365452508160:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1777051248.607739:0:101439:0:(osp_precreate.c:955:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x1c1:0x0] from OST, last_created [0x2c0000401:0x1c1:0x0]last_used is [0x2c0000401:0x15e:0x0] 00000100:00100000:3.0:1777051248.607883:0:101439:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955610000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:101439:1863365452508672:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1777051248.607891:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95f864a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452508544:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1777051248.608227:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051248.608227:0:101439:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051248.608305:0:101439:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d94eea9cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1777051248.608534:0:8473:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452508544 00000100:00100000:0.0:1777051248.608543:0:8473:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452508544 00000100:00100000:0.0:1777051248.608599:0:8473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5519 00000100:00100000:0.0:1777051248.608623:0:8473:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da57e96c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3679:x1863365452508544:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1777051248.608661:0:8473:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 430295232 pending 0 free 3645853696 avail 3414331392 00000100:00100000:0.0:1777051248.608730:0:8473:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da57e96c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3679:x1863365452508544:12345-0@lo:13:osp-pre-1-0.0 Request processed in 121us (512us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051248.608743:0:8473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5519 00000100:00100000:2.0:1777051248.608806:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95f864a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452508544:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1777051248.609575:0:8468:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452508672 00000100:00100000:0.0:1777051248.609583:0:8468:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452508672 00000100:00100000:0.0:1777051248.609643:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7945 00000100:00100000:0.0:1777051248.609655:0:8468:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f65a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:101439:x1863365452508672:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1777051248.609695:0:8468:0:(ofd_dev.c:1745:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 450 00000100:00100000:1.0:1777051248.614669:0:8468:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f65a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:101439:x1863365452508672:12345-0@lo:5:osp-pre-1-0.0 Request processed in 5011us (6449us total) trans 4294968350 rc 0/0 00000100:00100000:1.0:1777051248.614691:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7945 00000100:00100000:2.0:1777051248.615596:0:101439:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955610000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:101439:1863365452508672:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1777051248.615620:0:101439:0:(osp_precreate.c:701:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x1c1:0x0]-[0x2c0000401:0x1e1:0x0] 00000020:00000004:1.0:1777051248.644289:0:101744:0:(tgt_mount.c:2297:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1777051248.644668:0:101744:0:(tgt_mount.c:2312:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1777051248.727416:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1777051248.920108:0:99289:0:(llog.c:801:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1777051248.920122:0:99289:0:(llog_cat.c:158:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1777051248.925580:0:99289:0:(llog.c:858:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:0.0:1777051248.925600:0:99289:0:(llog.c:858:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00100000:1.0:1777051248.929568:0:7498:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1777051249.431171:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7d308700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3680:1863365452508800:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1777051249.431296:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051249.431651:0:8472:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452508800 00000100:00100000:3.0:1777051249.431665:0:8472:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452508800 00000100:00100000:3.0:1777051249.431749:0:8472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5520 00000100:00100000:3.0:1777051249.431766:0:8472:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7d309180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3680:x1863365452508800:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1777051249.431802:0:8472:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 430294336 pending 0 free 3645853696 avail 3414331392 00000100:00100000:3.0:1777051249.431931:0:8472:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7d309180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3680:x1863365452508800:12345-0@lo:13:osp-pre-1-1.0 Request processed in 167us (633us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051249.431947:0:8472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5520 00000100:00100000:1.0:1777051249.432040:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7d308700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3680:1863365452508800:0@lo:13:osp-pre-1-1.0 00000020:00000004:3.0:1777051249.708035:0:101794:0:(tgt_mount.c:2297:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1777051249.709076:0:101794:0:(tgt_mount.c:2312:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1777051249.753026:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1777051249.942486:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7c9a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452508928:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1777051249.942592:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051249.942980:0:47388:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452508928 00000100:00100000:2.0:1777051249.942995:0:47388:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452508928 00000100:00100000:2.0:1777051249.943079:0:47388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5521 00000100:00100000:2.0:1777051249.943100:0:47388:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7d308700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3677:x1863365452508928:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1777051249.943147:0:47388:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 440354112 pending 0 free 3862671360 avail 3631149056 00000100:00100000:2.0:1777051249.943316:0:47388:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7d308700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3677:x1863365452508928:12345-0@lo:13:osp-pre-0-1.0 Request processed in 222us (723us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051249.943329:0:47388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5521 00000100:00100000:1.0:1777051249.943588:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7c9a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452508928:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1777051250.598975:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051250.599273:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051250.599345:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051250.599398:0:8471:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425853440 00000100:00100000:3.0:1777051250.599415:0:8471:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425853440 00000100:00100000:3.0:1777051250.599656:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10170 00000100:00100000:3.0:1777051250.599672:0:8471:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d950266d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+50:2437:x1863365425853440:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:3.0:1777051250.599762:0:8471:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d950266d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+50:2437:x1863365425853440:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 94us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051250.599772:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10170 00000100:00080000:1.0:1777051250.600419:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1777051250.603407:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051250.603498:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051250.603553:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051250.603654:0:55805:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425853952 00000100:00100000:1.0:1777051250.603667:0:55805:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425853952 00000100:00100000:1.0:1777051250.604102:0:55805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10171 00000100:00100000:1.0:1777051250.604125:0:55805:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d950889500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+50:2437:x1863365425853952:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:1.0:1777051250.604273:0:55805:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d950889500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+50:2437:x1863365425853952:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 154us (872us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051250.604287:0:55805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10171 00000100:00080000:1.0:1777051250.604456:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1777051250.604522:0:101424:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425853056 00000100:00100000:1.0:1777051250.604531:0:101424:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425853056 00000100:00100000:1.0:1777051250.604589:0:101424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 82 00000100:00100000:1.0:1777051250.604605:0:101424:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942db6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29c4352d-3260-4734-909d-9ea5de9e7fa4+12:2437:x1863365425853056:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:1.0:1777051250.604670:0:101424:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942db6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29c4352d-3260-4734-909d-9ea5de9e7fa4+12:2437:x1863365425853056:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 68us (1173us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051250.604684:0:101424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 82 00000100:00100000:2.0:1777051250.606642:0:46494:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425853184 00000100:00100000:2.0:1777051250.606653:0:46494:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425853184 00000100:00100000:2.0:1777051250.606743:0:46494:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425853696 00000100:00100000:2.0:1777051250.606750:0:46494:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425853696 00000100:00100000:2.0:1777051250.606800:0:46494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13098 00000100:00100000:2.0:1777051250.606852:0:46494:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fd65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c11b6966-0775-44d2-bdc6-c74c26eb2226+13:2437:x1863365425853184:12345-192.168.201.46@tcp:400:kworker.0 00000100:00080000:1.0:1777051250.606867:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1777051250.606951:0:46494:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fd65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c11b6966-0775-44d2-bdc6-c74c26eb2226+13:2437:x1863365425853184:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 131us (7984us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051250.606958:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13099 00000100:00100000:2.0:1777051250.606983:0:46494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13098 00000100:00100000:1.0:1777051250.606996:0:6581:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d950889180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+17:2437:x1863365425853696:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:1.0:1777051250.607069:0:6581:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d950889180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+17:2437:x1863365425853696:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 84us (7724us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051250.607090:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13099 00000100:00100000:0.0:1777051250.607535:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051250.607596:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051250.608301:0:13320:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425853568 00000100:00100000:3.0:1777051250.608312:0:13320:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425853568 00000100:00100000:3.0:1777051250.608397:0:13320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10172 00000100:00100000:3.0:1777051250.608414:0:13320:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955ebf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+48:2437:x1863365425853568:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:3.0:1777051250.608491:0:13320:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955ebf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+48:2437:x1863365425853568:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 80us (957us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051250.608507:0:13320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10172 00000100:00080000:1.0:1777051250.608537:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1777051250.612610:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051250.612921:0:8628:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425854080 00000100:00100000:3.0:1777051250.612950:0:8628:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425854080 00000100:00100000:2.0:1777051250.613029:0:6579:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425853312 00000100:00100000:2.0:1777051250.613397:0:6579:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425853312 00000100:00100000:3.0:1777051250.613410:0:8628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10173 00000100:00100000:3.0:1777051250.613440:0:8628:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94ed2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+47:2437:x1863365425854080:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:2.0:1777051250.613475:0:6579:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425853824 00000100:00080000:0.0:1777051250.613479:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1777051250.613484:0:6579:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425853824 00000100:00080000:0.0:1777051250.613491:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1777051250.613538:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1777051250.613546:0:8628:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94ed2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+47:2437:x1863365425854080:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 111us (934us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051250.613569:0:8628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10173 00000100:00100000:2.0:1777051250.613587:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13100 00000100:00100000:2.0:1777051250.613609:0:6579:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955ebe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+6:2437:x1863365425853312:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:0.0:1777051250.613617:0:46497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13101 00000100:00100000:0.0:1777051250.613650:0:46497:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94ed2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+48:2437:x1863365425853824:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:2.0:1777051250.614080:0:6579:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955ebe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+6:2437:x1863365425853312:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 473us (10520us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051250.614103:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13100 00000100:00100000:0.0:1777051250.614107:0:46497:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94ed2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+48:2437:x1863365425853824:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 460us (6501us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051250.614458:0:46497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13101 00010000:00010000:3.0:1777051250.777353:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777051251.611499:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051251.611728:0:27882:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425854208 00000100:00100000:1.0:1777051251.611742:0:27882:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425854208 00000100:00100000:1.0:1777051251.611855:0:27882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111680 00000100:00100000:1.0:1777051251.611871:0:27882:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f65b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+13:130110:x1863365425854208:12345-192.168.201.46@tcp:101:lfs.0 00010000:00010000:1.0:1777051251.611898:0:27882:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777051251.611944:0:27882:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d9442eae00/0x85f51a6b96714a21 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b5eaf expref: -99 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1777051251.616055:0:27882:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 4038us 00010000:00010000:3.0:1777051251.635538:0:27882:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d785600/0x85f51a6b96714a28 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051251.635566:0:27882:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d785600/0x85f51a6b96714a28 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051251.635590:0:27882:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d785600/0x85f51a6b96714a28 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1777051251.635659:0:27882:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 12288 00000004:00200000:3.0:1777051251.635666:0:27882:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1777051251.635717:0:27882:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d785600/0x85f51a6b96714a28 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051251.636061:0:27882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d9442eae00/0x85f51a6b96714a21 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5eaf expref: 15 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051251.636113:0:27882:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d785600/0x85f51a6b96714a28 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5eaf expref: 14 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051251.636129:0:27882:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d9413d0100) 00010000:00010000:3.0:1777051251.636135:0:27882:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1777051251.636141:0:27882:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99da7d785600, rc 0) 00000100:00100000:3.0:1777051251.636274:0:27882:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f65b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+14:130110:x1863365425854208:12345-192.168.201.46@tcp:101:lfs.0 Request processed in 24403us (24782us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051251.636291:0:27882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111680 00000100:00100000:3.0:1777051251.643052:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051251.643387:0:21368:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425854336 00000100:00100000:2.0:1777051251.643400:0:21368:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425854336 00000100:00100000:2.0:1777051251.643486:0:21368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111681 00000100:00100000:2.0:1777051251.643502:0:21368:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f65b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+17:130110:x1863365425854336:12345-192.168.201.46@tcp:41:lfs.0 00000004:00000024:2.0:1777051251.643552:0:21368:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4194304 pending 0 free 1441603584 avail 1295364096 00000100:00100000:2.0:1777051251.643660:0:21368:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f65b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+17:130110:x1863365425854336:12345-192.168.201.46@tcp:41:lfs.0 Request processed in 160us (617us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051251.643674:0:21368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111681 00000100:00100000:0.0:1777051251.647066:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051251.647875:0:6581:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425854464 00000100:00100000:1.0:1777051251.647886:0:6581:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425854464 00000100:00100000:1.0:1777051251.647961:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111682 00000100:00100000:1.0:1777051251.647977:0:6581:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fdf2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+48:130110:x1863365425854464:12345-192.168.201.46@tcp:41:lfs.0 00000004:00000024:1.0:1777051251.648019:0:6581:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4243456 pending 0 free 1446064128 avail 1299824640 00000100:00100000:1.0:1777051251.648367:0:6581:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fdf2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+48:130110:x1863365425854464:12345-192.168.201.46@tcp:41:lfs.0 Request processed in 392us (1305us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051251.648381:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111682 00000100:00100000:3.0:1777051251.652766:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051251.652874:0:10113:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425854592 00000100:00100000:1.0:1777051251.652886:0:10113:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425854592 00000100:00100000:1.0:1777051251.652964:0:10113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 5522 00000100:00100000:1.0:1777051251.652981:0:10113:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f65aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+50:130110:x1863365425854592:12345-192.168.201.46@tcp:13:lfs.0 00002000:00000024:1.0:1777051251.653010:0:10113:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 440354112 pending 0 free 3862671360 avail 3631149056 00000100:00100000:1.0:1777051251.653734:0:10113:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f65aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+50:130110:x1863365425854592:12345-192.168.201.46@tcp:13:lfs.0 Request processed in 753us (971us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051251.653751:0:10113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 5522 00000100:00100000:3.0:1777051251.659718:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051251.659855:0:8473:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425854720 00000100:00100000:0.0:1777051251.659867:0:8473:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425854720 00000100:00100000:0.0:1777051251.659933:0:8473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 5523 00000100:00100000:0.0:1777051251.659946:0:8473:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f658700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+47:130110:x1863365425854720:12345-192.168.201.46@tcp:13:lfs.0 00002000:00000024:0.0:1777051251.659981:0:8473:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 430294336 pending 0 free 3645853696 avail 3414331392 00000100:00100000:0.0:1777051251.660060:0:8473:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f658700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+47:130110:x1863365425854720:12345-192.168.201.46@tcp:13:lfs.0 Request processed in 116us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051251.660070:0:8473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 5523 00010000:00010000:0.0:1777051251.799043:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777051252.822633:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1777051253.526553:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7fdf2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3678:1863365452509056:0@lo:400:kworker.0 00000100:00100000:1.0:1777051253.526560:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95a582680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3677:1863365452509440:0@lo:400:kworker.0 00000100:00100000:2.0:1777051253.526685:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051253.526691:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051253.526694:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94e627b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3680:1863365452509312:0@lo:400:kworker.0 00000100:00100000:0.0:1777051253.526804:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051253.526842:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f9bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3678:1863365452509568:0@lo:400:kworker.0 00000100:00100000:1.0:1777051253.526847:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f9bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3677:1863365452509952:0@lo:400:kworker.0 00000100:00100000:3.0:1777051253.526849:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94e625f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452509184:0@lo:400:kworker.0 00000100:00100000:0.0:1777051253.526858:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f9b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3680:1863365452509824:0@lo:400:kworker.0 00000100:00100000:2.0:1777051253.526920:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051253.526950:0:101427:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452509056 00000100:00100000:1.0:1777051253.526961:0:101427:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452509056 00000100:00100000:0.0:1777051253.526978:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051253.526985:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d9533bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452510080:0@lo:400:kworker.0 00000100:00100000:3.0:1777051253.526987:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051253.527343:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d944d28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3680:1863365452510336:0@lo:400:kworker.0 00000100:00100000:3.0:1777051253.527354:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f9b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452509696:0@lo:400:kworker.0 00000100:00100000:1.0:1777051253.527385:0:101427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1777051253.527410:0:101427:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942db7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f9351a01-5b0e-4470-97fd-58b9b4b312a2+23:3678:x1863365452509056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777051253.527425:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051253.527450:0:6584:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452509184 00000100:00100000:3.0:1777051253.527461:0:6584:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452509184 00000100:00100000:2.0:1777051253.527500:0:8492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452509440 00000100:00100000:0.0:1777051253.527501:0:3680:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1777051253.527511:0:8492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452509440 00000100:00100000:1.0:1777051253.527522:0:101427:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942db7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f9351a01-5b0e-4470-97fd-58b9b4b312a2+23:3678:x1863365452509056:12345-0@lo:400:kworker.0 Request processed in 116us (839us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051253.527523:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7c9a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3680:1863365452510720:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1777051253.527543:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7988 00000100:00100000:1.0:1777051253.527554:0:101427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1777051253.527570:0:6584:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da444a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:3679:x1863365452509184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777051253.527603:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051253.527606:0:8492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452509312 00000100:00100000:2.0:1777051253.527614:0:8492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452509312 00000100:00100000:2.0:1777051253.527675:0:8492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452509568 00000100:00100000:2.0:1777051253.527686:0:8492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452509568 00000100:00100000:3.0:1777051253.527686:0:6584:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da444a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:3679:x1863365452509184:12345-0@lo:400:kworker.0 Request processed in 120us (708us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051253.527692:0:46497:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452509824 00000100:00100000:0.0:1777051253.527705:0:46497:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452509824 00000100:00100000:1.0:1777051253.527717:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13102 00000100:00100000:3.0:1777051253.527717:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7988 00000100:00100000:1.0:1777051253.527747:0:6580:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7d308000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3677:x1863365452509440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051253.527758:0:6584:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452510720 00000100:00100000:3.0:1777051253.527801:0:6584:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452510720 00000100:00100000:2.0:1777051253.527803:0:8492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13103 00000100:00100000:0.0:1777051253.527819:0:46497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13104 00000100:00100000:2.0:1777051253.527837:0:8492:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955504a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3680:x1863365452509312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777051253.527847:0:46497:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7c9a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:lustre-MDT0001-lwp-OST0000_UUID+5:3678:x1863365452509568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777051253.527856:0:6580:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7d308000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3677:x1863365452509440:12345-0@lo:400:kworker.0 Request processed in 115us (1170us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051253.527868:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7989 00000100:00100000:1.0:1777051253.527880:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13102 00000100:00100000:3.0:1777051253.527892:0:6584:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3680:x1863365452510720:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1777051253.527923:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13105 00000100:00100000:2.0:1777051253.527939:0:8492:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955504a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3680:x1863365452509312:12345-0@lo:400:kworker.0 Request processed in 115us (1133us total) trans 0 rc 0/0 00000004:00000024:3.0:1777051253.527940:0:6584:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4243456 pending 0 free 1446064128 avail 1299824640 00000100:00100000:1.0:1777051253.527945:0:6580:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955505180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3680:x1863365452509824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777051253.527958:0:46497:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7c9a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:lustre-MDT0001-lwp-OST0000_UUID+5:3678:x1863365452509568:12345-0@lo:400:kworker.0 Request processed in 118us (1033us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051253.527975:0:8492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13103 00000100:00100000:0.0:1777051253.527986:0:46497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13104 00000100:00080000:0.0:1777051253.528042:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1777051253.528044:0:6584:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3680:x1863365452510720:12345-0@lo:41:osp-pre-1-0.0 Request processed in 150us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051253.528053:0:6580:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955505180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3680:x1863365452509824:12345-0@lo:400:kworker.0 Request processed in 113us (1078us total) trans 0 rc 0/0 00000100:00080000:0.0:1777051253.528055:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1777051253.528074:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7989 00000100:00100000:1.0:1777051253.528078:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13105 00000100:00100000:2.0:1777051253.528083:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051253.528096:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7d308e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3680:1863365452510848:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1777051253.528149:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da449cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3678:1863365452510592:0@lo:400:kworker.0 00000100:00100000:1.0:1777051253.528158:0:8468:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452510336 00000100:00100000:0.0:1777051253.528166:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051253.528168:0:8468:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452510336 00000100:00100000:3.0:1777051253.528176:0:8471:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452510080 00000100:00100000:3.0:1777051253.528186:0:8471:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452510080 00000100:00100000:2.0:1777051253.528283:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051253.528301:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10174 00000100:00100000:1.0:1777051253.528323:0:8468:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3680:x1863365452510336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777051253.528326:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7c9a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3680:1863365452510720:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1777051253.528326:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10175 00000100:00100000:2.0:1777051253.528353:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7fdf2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3678:1863365452509056:0@lo:400:kworker.0 00000100:00100000:3.0:1777051253.528355:0:8471:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f866d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3678:x1863365452510080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777051253.528371:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94e627b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3680:1863365452509312:0@lo:400:kworker.0 00000100:00100000:0.0:1777051253.528407:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f9b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3680:1863365452509824:0@lo:400:kworker.0 00000100:00100000:2.0:1777051253.528421:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f9bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3678:1863365452509568:0@lo:400:kworker.0 00000100:00100000:1.0:1777051253.528433:0:8468:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3680:x1863365452510336:12345-0@lo:400:kworker.0 Request processed in 111us (1009us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051253.528446:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d944d28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3680:1863365452510336:0@lo:400:kworker.0 00000100:00100000:1.0:1777051253.528455:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10174 00000100:00100000:3.0:1777051253.528471:0:8471:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f866d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3678:x1863365452510080:12345-0@lo:400:kworker.0 Request processed in 121us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051253.528482:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d9533bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452510080:0@lo:400:kworker.0 00000100:00100000:3.0:1777051253.528495:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10175 00000100:00100000:0.0:1777051253.528542:0:6585:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452510848 00000100:00100000:1.0:1777051253.528545:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051253.528550:0:6585:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452510848 00000100:00100000:3.0:1777051253.528565:0:27885:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452510592 00000100:00100000:3.0:1777051253.528574:0:27885:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452510592 00000100:00100000:1.0:1777051253.528600:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d944d29500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3677:1863365452510464:0@lo:400:kworker.0 00000100:00100000:2.0:1777051253.528621:0:46500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7990 00000100:00100000:3.0:1777051253.528639:0:27885:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452509952 00000100:00100000:2.0:1777051253.528642:0:46500:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942a0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+7:3680:x1863365452510848:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1777051253.528650:0:27885:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452509952 00000100:00080000:0.0:1777051253.528655:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1777051253.528664:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1777051253.528668:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1777051253.528676:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00000024:2.0:1777051253.528686:0:46500:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4194304 pending 0 free 1441603584 avail 1295364096 00000100:00100000:0.0:1777051253.528711:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051253.528724:0:27885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13106 00000100:00100000:1.0:1777051253.528734:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95a582680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3677:1863365452509440:0@lo:400:kworker.0 00000100:00100000:3.0:1777051253.528745:0:27885:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f864a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000-lwp-MDT0000_UUID+5:3678:x1863365452510592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777051253.528806:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d944d28a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452510208:0@lo:400:kworker.0 00000100:00100000:2.0:1777051253.528822:0:46500:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942a0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+7:3680:x1863365452510848:12345-0@lo:41:osp-pre-0-1.0 Request processed in 183us (660us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051253.528842:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13107 00000100:00100000:2.0:1777051253.528842:0:46500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7990 00000100:00100000:1.0:1777051253.528868:0:6581:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7d309f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3677:x1863365452509952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051253.528878:0:27885:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f864a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000-lwp-MDT0000_UUID+5:3678:x1863365452510592:12345-0@lo:400:kworker.0 Request processed in 134us (591us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051253.528883:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051253.528901:0:27885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13106 00000100:00100000:2.0:1777051253.528941:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da449cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3678:1863365452510592:0@lo:400:kworker.0 00000100:00100000:3.0:1777051253.528964:0:24468:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452510464 00000100:00100000:1.0:1777051253.528975:0:6581:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7d309f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3677:x1863365452509952:12345-0@lo:400:kworker.0 Request processed in 108us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051253.528975:0:24468:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452510464 00000100:00100000:0.0:1777051253.528988:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94e625f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452509184:0@lo:400:kworker.0 00000100:00100000:1.0:1777051253.529001:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13107 00000100:00100000:2.0:1777051253.529037:0:27887:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452509696 00000100:00100000:2.0:1777051253.529047:0:27887:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452509696 00000100:00100000:3.0:1777051253.529068:0:24468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10176 00000100:00100000:0.0:1777051253.529070:0:6584:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452510208 00000100:00100000:0.0:1777051253.529407:0:6584:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452510208 00000100:00100000:3.0:1777051253.529415:0:24468:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7d30ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3677:x1863365452510464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777051253.529418:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f9bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3677:1863365452509952:0@lo:400:kworker.0 00000100:00100000:0.0:1777051253.529474:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7991 00000100:00100000:0.0:1777051253.529491:0:6584:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d944d28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3679:x1863365452510208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051253.529517:0:24468:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7d30ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3677:x1863365452510464:12345-0@lo:400:kworker.0 Request processed in 110us (858us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051253.529538:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7d308e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3680:1863365452510848:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1777051253.529539:0:24468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10176 00000100:00100000:0.0:1777051253.529580:0:6584:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d944d28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3679:x1863365452510208:12345-0@lo:400:kworker.0 Request processed in 91us (708us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051253.529595:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7991 00000100:00080000:3.0:1777051253.529599:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1777051253.529608:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1777051253.529615:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d944d29500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3677:1863365452510464:0@lo:400:kworker.0 00000100:00100000:0.0:1777051253.529676:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d944d28a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452510208:0@lo:400:kworker.0 00000100:00100000:2.0:1777051253.529715:0:27887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10177 00000100:00100000:2.0:1777051253.529735:0:27887:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942a0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3679:x1863365452509696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777051253.529853:0:27887:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942a0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3679:x1863365452509696:12345-0@lo:400:kworker.0 Request processed in 125us (1146us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051253.529865:0:27887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10177 00000100:00100000:0.0:1777051253.530009:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f9b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452509696:0@lo:400:kworker.0 00010000:00010000:2.0:1777051253.846697:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1777051254.038491:0:3678:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1777051254.038520:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da449cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3678:1863365452510976:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1777051254.038615:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051254.038696:0:8472:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452510976 00000100:00100000:3.0:1777051254.038709:0:8472:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452510976 00000100:00100000:3.0:1777051254.038834:0:8472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5524 00000100:00100000:3.0:1777051254.038853:0:8472:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d9533bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3678:x1863365452510976:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1777051254.038891:0:8472:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 430294336 pending 0 free 3645853696 avail 3414331392 00000100:00100000:3.0:1777051254.038960:0:8472:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d9533bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3678:x1863365452510976:12345-0@lo:13:osp-pre-1-0.0 Request processed in 113us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051254.038973:0:8472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5524 00000100:00100000:2.0:1777051254.039122:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da449cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3678:1863365452510976:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1777051254.039164:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7d308e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3678:1863365452511104:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1777051254.039235:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051254.039421:0:47388:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452511104 00000100:00100000:1.0:1777051254.039430:0:47388:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452511104 00000100:00100000:1.0:1777051254.039482:0:47388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5525 00000100:00100000:1.0:1777051254.039495:0:47388:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da449cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3678:x1863365452511104:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1777051254.039526:0:47388:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 440354112 pending 0 free 3862671360 avail 3631149056 00000100:00100000:1.0:1777051254.039602:0:47388:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da449cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3678:x1863365452511104:12345-0@lo:13:osp-pre-0-0.0 Request processed in 107us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051254.039616:0:47388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5525 00000100:00100000:1.0:1777051254.040123:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7d308e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3678:1863365452511104:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1777051254.550898:0:3680:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1777051254.550941:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7d308e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3680:1863365452511232:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1777051254.551107:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051254.551652:0:10113:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452511232 00000100:00100000:1.0:1777051254.551666:0:10113:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452511232 00000100:00100000:1.0:1777051254.551813:0:10113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5526 00000100:00100000:1.0:1777051254.551836:0:10113:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7d30b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3680:x1863365452511232:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1777051254.551895:0:10113:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 430294336 pending 0 free 3645853696 avail 3414331392 00000100:00100000:1.0:1777051254.552002:0:10113:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7d30b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3680:x1863365452511232:12345-0@lo:13:osp-pre-1-1.0 Request processed in 172us (905us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051254.552503:0:10113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5526 00000100:00100000:1.0:1777051254.552642:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7d308e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3680:1863365452511232:0@lo:13:osp-pre-1-1.0 00000001:00080000:1.0:1777051254.568017:0:8464:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0000: transno 4294968347 is committed 00000001:00080000:3.0:1777051254.569494:0:9540:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0001: transno 4294968350 is committed 00000001:02000400:2.0:1777051254.793914:0:101892:0:(debug.c:645:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg146-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid 00010000:00010000:1.0:1777051254.870558:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1777051255.062658:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f9b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3680:1863365452511360:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1777051255.062800:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051255.062921:0:8473:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452511360 00000100:00100000:0.0:1777051255.062937:0:8473:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452511360 00000100:00100000:0.0:1777051255.063058:0:8473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5527 00000100:00080000:3.0:1777051255.063059:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1777051255.063082:0:8473:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7d308e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3680:x1863365452511360:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1777051255.063137:0:8473:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 440354112 pending 0 free 3862671360 avail 3631149056 00000100:00100000:0.0:1777051255.063555:0:8473:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7d308e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3680:x1863365452511360:12345-0@lo:13:osp-pre-0-1.0 Request processed in 477us (754us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051255.063571:0:8473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5527 00000100:00100000:2.0:1777051255.063677:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f9b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3680:1863365452511360:0@lo:13:osp-pre-0-1.0 00000040:00080000:3.0:1777051255.511603:0:101448:0:(llog.c:858:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1777051255.714699:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051255.714782:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051255.714823:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051255.714856:0:101429:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425854848 00000100:00100000:1.0:1777051255.714872:0:101429:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425854848 00000100:00100000:3.0:1777051255.714882:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051255.714903:0:6579:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425855104 00000100:00100000:2.0:1777051255.714915:0:6579:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425855104 00000100:00100000:3.0:1777051255.714937:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051255.714963:0:8470:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425855360 00000100:00100000:1.0:1777051255.714973:0:101429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 84 00000100:00100000:0.0:1777051255.714976:0:8470:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425855360 00000100:00100000:3.0:1777051255.714992:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051255.715003:0:101429:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942db6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:29c4352d-3260-4734-909d-9ea5de9e7fa4+12:2438:x1863365425854848:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:2.0:1777051255.715044:0:6579:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425855616 00000100:00100000:2.0:1777051255.715053:0:6579:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425855616 00000100:00100000:0.0:1777051255.715059:0:8470:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425855872 00000100:00100000:0.0:1777051255.715069:0:8470:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425855872 00000100:00100000:3.0:1777051255.715101:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051255.715111:0:101429:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942db6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:29c4352d-3260-4734-909d-9ea5de9e7fa4+12:2438:x1863365425854848:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 116us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051255.715120:0:6579:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425854976 00000100:00100000:2.0:1777051255.715127:0:6579:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425854976 00000100:00100000:1.0:1777051255.715129:0:101429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 84 00000100:00100000:0.0:1777051255.715166:0:8470:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425855232 00000100:00100000:0.0:1777051255.715177:0:8470:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425855232 00000100:00100000:2.0:1777051255.715246:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13108 00000100:00100000:2.0:1777051255.715267:0:6579:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da444a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+6:2438:x1863365425855104:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:1.0:1777051255.715283:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10178 00000100:00100000:1.0:1777051255.715302:0:8468:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da444a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+48:2438:x1863365425855360:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:0.0:1777051255.715338:0:8470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10179 00000100:00100000:2.0:1777051255.715351:0:6579:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da444a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+6:2438:x1863365425855104:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 89us (563us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051255.715360:0:8468:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da444a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+48:2438:x1863365425855360:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 60us (530us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051255.715365:0:8470:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da4384ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+47:2438:x1863365425855872:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:3.0:1777051255.715378:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051255.715401:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13108 00000100:00100000:1.0:1777051255.715408:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10178 00000100:00100000:2.0:1777051255.715436:0:6579:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425855488 00000100:00100000:2.0:1777051255.715444:0:6579:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425855488 00000100:00100000:0.0:1777051255.715455:0:8470:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da4384ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+47:2438:x1863365425855872:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 97us (512us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051255.715455:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10180 00000100:00100000:0.0:1777051255.715481:0:8470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10179 00000100:00100000:1.0:1777051255.715481:0:8468:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d951fa2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+50:2438:x1863365425855232:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:2.0:1777051255.715499:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13109 00000100:00100000:2.0:1777051255.715516:0:6579:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da4384ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+48:2438:x1863365425855616:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:1.0:1777051255.715539:0:8468:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d951fa2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+50:2438:x1863365425855232:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 65us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051255.715551:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10180 00000100:00100000:2.0:1777051255.715577:0:6579:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da4384ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+48:2438:x1863365425855616:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 65us (696us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051255.715585:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13109 00000100:00100000:1.0:1777051255.715622:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13110 00000100:00100000:2.0:1777051255.715635:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13111 00000100:00100000:1.0:1777051255.715644:0:6580:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d951fa0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+14:2438:x1863365425854976:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:2.0:1777051255.715659:0:6579:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d951fa3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+17:2438:x1863365425855488:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:1.0:1777051255.715697:0:6580:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d951fa0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+14:2438:x1863365425854976:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 62us (706us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051255.715710:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13110 00000100:00100000:2.0:1777051255.715719:0:6579:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d951fa3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+17:2438:x1863365425855488:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 65us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051255.715758:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13111 00000100:00080000:1.0:1777051255.715865:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1777051255.715878:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00080000:1.0:1777051255.715878:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1777051255.715890:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1777051255.715896:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1777051255.715917:0:24468:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425855744 00000100:00100000:2.0:1777051255.715926:0:24468:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425855744 00000100:00080000:0.0:1777051255.716000:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1777051255.716002:0:24468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10181 00000100:00100000:2.0:1777051255.716020:0:24468:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d944d28a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+50:2438:x1863365425855744:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:2.0:1777051255.716065:0:24468:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d944d28a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+50:2438:x1863365425855744:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 51us (195us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051255.716075:0:24468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10181 00010000:00010000:0.0:1777051255.894650:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1777051256.381519:0:101940:0:(debug.c:645:libcfs_debug_mark_buffer()) DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec 00010000:00010000:2.0:1777051256.919505:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051257.942679:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1777051258.135317:0:99289:0:(llog.c:801:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1777051258.135336:0:99289:0:(llog_cat.c:158:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1777051258.136459:0:99289:0:(llog.c:858:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:2.0:1777051258.136476:0:99289:0:(llog.c:858:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1777051258.243976:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051258.244130:0:6581:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425856000 00000100:00100000:2.0:1777051258.244146:0:6581:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425856000 00000100:00080000:0.0:1777051258.244273:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1777051258.244329:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111683 00000100:00100000:2.0:1777051258.244350:0:6581:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7d30b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+17:130558:x1863365425856000:12345-192.168.201.46@tcp:41:lfs.0 00000004:00000024:2.0:1777051258.244405:0:6581:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4194304 pending 0 free 1441603584 avail 1295364096 00000100:00100000:2.0:1777051258.244509:0:6581:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7d30b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+17:130558:x1863365425856000:12345-192.168.201.46@tcp:41:lfs.0 Request processed in 164us (542us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051258.244524:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111683 00000100:00100000:3.0:1777051258.249723:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051258.249926:0:6580:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425856128 00000100:00100000:1.0:1777051258.249938:0:6580:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425856128 00000100:00100000:1.0:1777051258.250054:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111684 00000100:00100000:1.0:1777051258.250073:0:6580:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d9418f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+48:130558:x1863365425856128:12345-192.168.201.46@tcp:41:lfs.0 00000004:00000024:1.0:1777051258.250494:0:6580:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4243456 pending 0 free 1446064128 avail 1299824640 00000100:00100000:1.0:1777051258.250590:0:6580:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d9418f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+48:130558:x1863365425856128:12345-192.168.201.46@tcp:41:lfs.0 Request processed in 521us (902us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051258.250604:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111684 00000100:00100000:3.0:1777051258.257122:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00080000:0.0:1777051258.257482:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1777051258.257532:0:10113:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425856256 00000100:00100000:1.0:1777051258.257544:0:10113:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425856256 00000100:00100000:1.0:1777051258.257977:0:10113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 5528 00000100:00100000:1.0:1777051258.257999:0:10113:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94c12b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+50:130558:x1863365425856256:12345-192.168.201.46@tcp:13:lfs.0 00000100:00080000:0.0:1777051258.258010:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:1.0:1777051258.258044:0:10113:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 440354112 pending 0 free 3862671360 avail 3631149056 00000100:00100000:1.0:1777051258.258143:0:10113:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94c12b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+50:130558:x1863365425856256:12345-192.168.201.46@tcp:13:lfs.0 Request processed in 150us (1027us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051258.258505:0:10113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 5528 00000100:00100000:3.0:1777051258.263797:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051258.264121:0:8473:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425856384 00000100:00100000:0.0:1777051258.264132:0:8473:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425856384 00000100:00080000:1.0:1777051258.264265:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1777051258.264284:0:8473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 5529 00000100:00100000:0.0:1777051258.264305:0:8473:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955612d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+47:130558:x1863365425856384:12345-192.168.201.46@tcp:13:lfs.0 00002000:00000024:0.0:1777051258.264343:0:8473:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 430294336 pending 0 free 3645853696 avail 3414331392 00000100:00100000:0.0:1777051258.264421:0:8473:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955612d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+47:130558:x1863365425856384:12345-192.168.201.46@tcp:13:lfs.0 Request processed in 123us (630us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051258.264435:0:8473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 5529 00000100:00100000:2.0:1777051258.646661:0:3678:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1777051258.647015:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7d308a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452511488:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1777051258.647111:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051258.647500:0:11727:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452511488 00000100:00100000:3.0:1777051258.647513:0:11727:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452511488 00000100:00100000:3.0:1777051258.647590:0:11727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7992 00000100:00100000:3.0:1777051258.647606:0:11727:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:3678:x1863365452511488:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1777051258.647644:0:11727:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4194304 pending 0 free 1441603584 avail 1295364096 00000100:00100000:3.0:1777051258.647748:0:11727:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:3678:x1863365452511488:12345-0@lo:41:osp-pre-0-1.0 Request processed in 144us (636us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051258.647761:0:11727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7992 00000100:00100000:2.0:1777051258.647783:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7d308a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452511488:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1777051258.649303:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955610e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3678:1863365452511616:0@lo:400:kworker.0 00000100:00100000:2.0:1777051258.649386:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051258.649439:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d9600b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3679:1863365452511744:0@lo:400:kworker.0 00000100:00100000:2.0:1777051258.649461:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f298a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452512128:0@lo:400:kworker.0 00000100:00100000:3.0:1777051258.649498:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051258.649527:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051258.649547:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f299880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3679:1863365452512256:0@lo:400:kworker.0 00000100:00100000:2.0:1777051258.649574:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d96040a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3678:1863365452512640:0@lo:400:kworker.0 00000100:00100000:3.0:1777051258.649603:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051258.649633:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051258.649649:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d943d90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452512768:0@lo:400:kworker.0 00000100:00100000:2.0:1777051258.649719:0:3678:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1777051258.649730:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051258.649741:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94f42c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3678:1863365452512000:0@lo:400:kworker.0 00000100:00100000:3.0:1777051258.649772:0:3679:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1777051258.649787:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94f42dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3679:1863365452511872:0@lo:400:kworker.0 00000100:00100000:2.0:1777051258.649813:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051258.651838:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051258.651853:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95f97ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452512512:0@lo:400:kworker.0 00000100:00100000:3.0:1777051258.651889:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95f97fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3679:1863365452512384:0@lo:400:kworker.0 00000100:00100000:2.0:1777051258.651904:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051258.651945:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051258.651981:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d943d90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452512896:0@lo:400:kworker.0 00000100:00100000:3.0:1777051258.652013:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051258.652373:0:8492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452511744 00000100:00100000:3.0:1777051258.652382:0:8492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452511744 00000100:00100000:2.0:1777051258.652396:0:55805:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452512128 00000100:00100000:2.0:1777051258.652407:0:55805:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452512128 00000100:00100000:3.0:1777051258.652439:0:8492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452512256 00000100:00100000:3.0:1777051258.652447:0:8492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452512256 00000100:00100000:2.0:1777051258.652485:0:55805:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452512768 00000100:00100000:2.0:1777051258.652493:0:55805:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452512768 00000100:00100000:3.0:1777051258.652502:0:8492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452512000 00000100:00100000:3.0:1777051258.652511:0:8492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452512000 00000100:00100000:2.0:1777051258.652543:0:55805:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452512512 00000100:00100000:2.0:1777051258.652549:0:55805:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452512512 00000100:00100000:3.0:1777051258.652566:0:8492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452511872 00000100:00100000:3.0:1777051258.652575:0:8492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452511872 00000100:00100000:2.0:1777051258.652601:0:55805:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452512896 00000100:00100000:3.0:1777051258.652630:0:8492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452512384 00000100:00100000:3.0:1777051258.652638:0:8492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452512384 00000100:00100000:2.0:1777051258.652646:0:55805:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452512896 00000100:00100000:3.0:1777051258.652705:0:8492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13112 00000100:00100000:3.0:1777051258.652722:0:8492:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fd60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3679:x1863365452511744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777051258.652738:0:55805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10182 00000100:00100000:2.0:1777051258.652756:0:55805:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3678:x1863365452512128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051258.652801:0:8492:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fd60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3679:x1863365452511744:12345-0@lo:400:kworker.0 Request processed in 83us (3305us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051258.652815:0:8492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13112 00000100:00100000:2.0:1777051258.652837:0:55805:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3678:x1863365452512128:12345-0@lo:400:kworker.0 Request processed in 83us (3310us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051258.652853:0:55805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10182 00000100:00100000:3.0:1777051258.652855:0:8492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13113 00000100:00100000:3.0:1777051258.652872:0:8492:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fd61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3679:x1863365452512256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777051258.652890:0:55805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10183 00000100:00100000:2.0:1777051258.652907:0:55805:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f168380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3679:x1863365452512768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051258.652921:0:8492:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fd61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3679:x1863365452512256:12345-0@lo:400:kworker.0 Request processed in 53us (3320us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051258.652929:0:8492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13113 00000100:00100000:3.0:1777051258.652956:0:8492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13114 00000100:00100000:3.0:1777051258.652967:0:8492:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3678:x1863365452512000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051258.653016:0:8492:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3678:x1863365452512000:12345-0@lo:400:kworker.0 Request processed in 51us (3206us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051258.653027:0:8492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13114 00000100:00100000:3.0:1777051258.653045:0:8492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13115 00000100:00100000:3.0:1777051258.653052:0:8492:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f16ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3679:x1863365452511872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777051258.653108:0:55805:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f168380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3679:x1863365452512768:12345-0@lo:400:kworker.0 Request processed in 203us (3378us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051258.653109:0:8492:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f16ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3679:x1863365452511872:12345-0@lo:400:kworker.0 Request processed in 53us (1271us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051258.653134:0:8492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13115 00000100:00100000:2.0:1777051258.653138:0:55805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10183 00000100:00100000:3.0:1777051258.653441:0:8492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13116 00000100:00100000:2.0:1777051258.653449:0:55805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10184 00000100:00100000:3.0:1777051258.653459:0:8492:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f168a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3679:x1863365452512384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777051258.653467:0:55805:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fdf2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3678:x1863365452512512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051258.653538:0:8492:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f168a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3679:x1863365452512384:12345-0@lo:400:kworker.0 Request processed in 83us (1593us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051258.653550:0:55805:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fdf2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3678:x1863365452512512:12345-0@lo:400:kworker.0 Request processed in 86us (1643us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051258.653556:0:8492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13116 00000100:00100000:2.0:1777051258.653573:0:55805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10184 00000100:00100000:2.0:1777051258.653609:0:55805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10185 00000100:00100000:2.0:1777051258.653619:0:55805:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f169880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3679:x1863365452512896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051258.653662:0:3677:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1777051258.653979:0:55805:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f169880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3679:x1863365452512896:12345-0@lo:400:kworker.0 Request processed in 56us (1660us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051258.653994:0:55805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10185 00000100:00100000:3.0:1777051258.654001:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7d30bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3677:1863365452513152:0@lo:41:osp-pre-1-0.0 00000100:00080000:2.0:1777051258.654031:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1777051258.654040:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1777051258.654045:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1777051258.654049:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1777051258.654058:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051258.654117:0:46500:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452512640 00000100:00100000:3.0:1777051258.654125:0:46500:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452512640 00000100:00100000:3.0:1777051258.654165:0:46500:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452513152 00000100:00100000:3.0:1777051258.654171:0:46500:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452513152 00000100:00100000:3.0:1777051258.654254:0:46500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7993 00000100:00100000:3.0:1777051258.654268:0:46500:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+6:3678:x1863365452512640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777051258.654323:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95f97ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452512512:0@lo:400:kworker.0 00000100:00100000:3.0:1777051258.654339:0:46500:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+6:3678:x1863365452512640:12345-0@lo:400:kworker.0 Request processed in 71us (4706us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051258.654343:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7fd63100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3678:1863365452513024:0@lo:400:kworker.0 00000100:00100000:3.0:1777051258.654365:0:46500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7993 00000100:00100000:3.0:1777051258.654395:0:46500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7994 00000100:00100000:2.0:1777051258.654416:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051258.654416:0:46500:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f169500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+5:3677:x1863365452513152:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1777051258.654446:0:46500:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4243456 pending 0 free 1446064128 avail 1299824640 00000100:00100000:2.0:1777051258.654467:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f298a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452512128:0@lo:400:kworker.0 00000100:00100000:2.0:1777051258.654490:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d96040a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3678:1863365452512640:0@lo:400:kworker.0 00000100:00100000:3.0:1777051258.654522:0:46500:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f169500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+5:3677:x1863365452513152:12345-0@lo:41:osp-pre-1-0.0 Request processed in 114us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051258.654535:0:46500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7994 00000100:00100000:2.0:1777051258.654542:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94f42c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3678:1863365452512000:0@lo:400:kworker.0 00000100:00100000:3.0:1777051258.654584:0:8492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452513024 00000100:00100000:3.0:1777051258.654593:0:8492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452513024 00000100:00100000:2.0:1777051258.654625:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94f42dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3679:1863365452511872:0@lo:400:kworker.0 00000100:00100000:3.0:1777051258.654649:0:8492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13117 00000100:00100000:2.0:1777051258.654653:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95f97fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3679:1863365452512384:0@lo:400:kworker.0 00000100:00100000:3.0:1777051258.654668:0:8492:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95aecea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3678:x1863365452513024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777051258.654675:0:3679:0:(client.c:3101:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968350 gen 2 00000100:00100000:2.0:1777051258.654987:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d943d90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452512896:0@lo:400:kworker.0 00000100:00100000:2.0:1777051258.655011:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d9600b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3679:1863365452511744:0@lo:400:kworker.0 00000100:00100000:2.0:1777051258.655027:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f299880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3679:1863365452512256:0@lo:400:kworker.0 00000100:00100000:2.0:1777051258.655041:0:3679:0:(client.c:3101:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968347 gen 2 00000100:00100000:2.0:1777051258.655056:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d943d90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452512768:0@lo:400:kworker.0 00000100:00100000:2.0:1777051258.655127:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7d30bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3677:1863365452513152:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1777051258.655266:0:101422:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452511616 00000100:00100000:2.0:1777051258.655273:0:101422:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452511616 00000100:00100000:2.0:1777051258.655319:0:101422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1777051258.655334:0:101422:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942db4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9351a01-5b0e-4470-97fd-58b9b4b312a2+23:3678:x1863365452511616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777051258.655405:0:101422:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942db4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9351a01-5b0e-4470-97fd-58b9b4b312a2+23:3678:x1863365452511616:12345-0@lo:400:kworker.0 Request processed in 76us (6023us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051258.655419:0:101422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1777051258.655499:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955610e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3678:1863365452511616:0@lo:400:kworker.0 00000100:00100000:3.0:1777051258.655788:0:8492:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95aecea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3678:x1863365452513024:12345-0@lo:400:kworker.0 Request processed in 1125us (1380us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051258.655799:0:8492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13117 00000100:00100000:2.0:1777051258.655861:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7fd63100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3678:1863365452513024:0@lo:400:kworker.0 00010000:00010000:1.0:1777051258.966518:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1777051259.158415:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95aecc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452513280:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1777051259.158498:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051259.158626:0:3679:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1777051259.158644:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d944d29500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452513408:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1777051259.158726:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051259.158810:0:10113:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452513280 00000100:00100000:2.0:1777051259.158824:0:10113:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452513280 00000100:00100000:0.0:1777051259.158825:0:8472:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452513408 00000100:00100000:0.0:1777051259.158837:0:8472:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452513408 00000100:00100000:2.0:1777051259.158920:0:10113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5530 00000100:00100000:0.0:1777051259.158938:0:8472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5531 00000100:00100000:2.0:1777051259.158947:0:10113:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95aecd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3679:x1863365452513280:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1777051259.158963:0:8472:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fd63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3679:x1863365452513408:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1777051259.158986:0:10113:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 430294336 pending 0 free 3645853696 avail 3414331392 00002000:00000024:0.0:1777051259.158992:0:8472:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 440354112 pending 0 free 3862671360 avail 3631149056 00000100:00100000:3.0:1777051259.159363:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d944d29500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452513408:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1777051259.159396:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95aecc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452513280:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1777051259.159511:0:10113:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95aecd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3679:x1863365452513280:12345-0@lo:13:osp-pre-1-0.0 Request processed in 574us (1011us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051259.159520:0:8472:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fd63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3679:x1863365452513408:12345-0@lo:13:osp-pre-0-0.0 Request processed in 562us (789us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051259.159534:0:10113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5530 00000100:00100000:0.0:1777051259.159545:0:8472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5531 00000100:00100000:0.0:1777051259.298715:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051259.298786:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051259.298908:0:27885:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425856512 00000100:00100000:2.0:1777051259.298936:0:27885:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425856512 00000100:00100000:2.0:1777051259.299048:0:27885:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425856640 00000100:00100000:2.0:1777051259.299057:0:27885:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425856640 00000100:00100000:2.0:1777051259.299132:0:27885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111685 00000100:00100000:2.0:1777051259.299153:0:27885:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d944d29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+17:2439:x1863365425856512:12345-192.168.201.46@tcp:17:kworker.0 00000100:00100000:2.0:1777051259.299318:0:27885:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d944d29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+17:2439:x1863365425856512:12345-192.168.201.46@tcp:17:kworker.0 Request processed in 169us (643us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051259.299334:0:27885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111685 00000100:00100000:2.0:1777051259.299374:0:27885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111686 00000100:00100000:2.0:1777051259.299391:0:27885:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94e625f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+48:2438:x1863365425856640:12345-192.168.201.46@tcp:17:kworker.0 00000100:00100000:2.0:1777051259.299462:0:27885:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94e625f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+48:2438:x1863365425856640:12345-192.168.201.46@tcp:17:kworker.0 Request processed in 72us (674us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051259.299478:0:27885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111686 00000100:00100000:1.0:1777051259.670499:0:3678:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1777051259.670528:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7d30b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452513536:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1777051259.670620:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051259.670767:0:47388:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452513536 00000100:00100000:1.0:1777051259.670778:0:47388:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452513536 00000100:00100000:1.0:1777051259.670850:0:47388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5532 00000100:00100000:1.0:1777051259.670866:0:47388:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7d30a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3678:x1863365452513536:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1777051259.670896:0:47388:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 430294336 pending 0 free 3645853696 avail 3414331392 00000100:00100000:1.0:1777051259.670961:0:47388:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7d30a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3678:x1863365452513536:12345-0@lo:13:osp-pre-1-1.0 Request processed in 99us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051259.670973:0:47388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5532 00000100:00100000:1.0:1777051259.671034:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7d30b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452513536:0@lo:13:osp-pre-1-1.0 00000020:00000080:1.0:1777051259.897654:0:102037:0:(class_obd.c:319:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdf5e1cbd0 20000000:00000080:1.0:1777051259.897791:0:102037:0:(mgs_handler.c:1163:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff99d95cd95000 uarg=0000000000000000 20000000:01000000:1.0:1777051259.897861:0:102037:0:(mgs_llog.c:6175:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm.default_archive_id=' 20000000:01000000:1.0:1777051259.897872:0:102037:0:(mgs_llog.c:4637:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm.default_archive_id=' 20000000:01000000:1.0:1777051259.897881:0:102037:0:(mgs_llog.c:1366:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm.default_archive_id= del=1 00000040:00080000:2.0:1777051259.899775:0:102038:0:(llog.c:858:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 37 count 37 20000000:02000000:1.0:1777051259.900122:0:102037:0:(mgs_llog.c:4110:mgs_wlp_lcfg()) Disabling parameter lustre.mdt.lustre-MDT0000.hsm.default_archive_id= in log params 10000000:01000000:1.0:1777051259.934272:0:102037:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1777051259.935926:0:102037:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99d955a98000/0x85f51a6b96714a2f lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 102037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051259.935967:0:102037:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99d95595ba00/0x85f51a6b9671469a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b96714693 expref: 22 pid: 101424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051259.935985:0:102037:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99d95595aa00/0x85f51a6b967146f5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b967146ee expref: 22 pid: 101425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051259.935998:0:102037:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99d95595b400/0x85f51a6b9671471f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b96714718 expref: 22 pid: 101427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051259.936016:0:102037:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99d943ebbc00/0x85f51a6b96714773 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b9671476c expref: 22 pid: 101425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051259.936032:0:102037:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99d955a8f400/0x85f51a6b9671479d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5e8c expref: 11 pid: 101429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051259.936051:0:102037:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99d955a8f200/0x85f51a6b967147b2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5ea1 expref: 11 pid: 101429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051259.936066:0:102037:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99d955a98000/0x85f51a6b96714a2f lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 102037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051259.936139:0:102037:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99d955a8f200/0x85f51a6b967147b2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5ea1 expref: 11 pid: 101429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051259.936162:0:102037:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99d955a8f200/0x85f51a6b967147b2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5ea1 expref: 11 pid: 101429 timeout: 7989 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051259.936192:0:102037:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d9600b9180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:102037:1863365452513664:192.168.201.46@tcp:104: 00010000:00010000:2.0:1777051259.936437:0:102037:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99d955a8f400/0x85f51a6b9671479d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5e8c expref: 11 pid: 101429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051259.936456:0:102037:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99d955a8f400/0x85f51a6b9671479d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5e8c expref: 11 pid: 101429 timeout: 7989 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051259.936480:0:102037:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d943d90380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:102037:1863365452513792:192.168.201.46@tcp:104: 00010000:00010000:2.0:1777051259.936563:0:102037:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99d943ebbc00/0x85f51a6b96714773 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x85f51a6b9671476c expref: 22 pid: 101425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051259.936579:0:102037:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99d943ebbc00/0x85f51a6b96714773 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x85f51a6b9671476c expref: 22 pid: 101425 timeout: 7989 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051259.936600:0:102037:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d943d90000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:102037:1863365452513920:0@lo:104: 00000100:00100000:2.0:1777051259.936719:0:102037:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1777051259.936810:0:102037:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99d95595b400/0x85f51a6b9671471f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x85f51a6b96714718 expref: 22 pid: 101427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051259.936841:0:102037:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99d95595b400/0x85f51a6b9671471f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x85f51a6b96714718 expref: 22 pid: 101427 timeout: 7989 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051259.936868:0:102037:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955610e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:102037:1863365452514048:0@lo:104: 00000100:00100000:0.0:1777051259.936904:0:6562:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452513920 00000100:00100000:0.0:1777051259.936924:0:6562:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452513920 00000100:00100000:2.0:1777051259.936926:0:102037:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1777051259.937013:0:102037:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99d95595aa00/0x85f51a6b967146f5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x85f51a6b967146ee expref: 22 pid: 101425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051259.937020:0:6562:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452514048 00000100:00100000:0.0:1777051259.937031:0:6562:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452514048 00010000:00010000:2.0:1777051259.937038:0:102037:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99d95595aa00/0x85f51a6b967146f5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x85f51a6b967146ee expref: 22 pid: 101425 timeout: 7989 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051259.937467:0:102037:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94f42dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:102037:1863365452514176:0@lo:104: 00000100:00100000:0.0:1777051259.937529:0:6562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1777051259.937532:0:102037:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051259.937563:0:6562:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d950264380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f9351a01-5b0e-4470-97fd-58b9b4b312a2+4:102037:x1863365452513920:12345-0@lo:104: 00010000:00010000:0.0:1777051259.937592:0:6562:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.146@tcp lock: ffff99d94ffbd800/0x85f51a6b9671476c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x85f51a6b96714773 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051259.937609:0:102037:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99d95595ba00/0x85f51a6b9671469a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x85f51a6b96714693 expref: 22 pid: 101424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051259.937631:0:99220:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452514176 00010000:00010000:2.0:1777051259.937638:0:102037:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99d95595ba00/0x85f51a6b9671469a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x85f51a6b96714693 expref: 22 pid: 101424 timeout: 7989 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051259.937645:0:99220:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452514176 00000100:00100000:2.0:1777051259.937700:0:102037:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d96040a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:102037:1863365452514304:0@lo:104: 00010000:00010000:0.0:1777051259.937759:0:6562:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1777051259.937781:0:102037:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051259.937782:0:6562:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d950264380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f9351a01-5b0e-4470-97fd-58b9b4b312a2+5:102037:x1863365452513920:12345-0@lo:104: Request processed in 221us (1054us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051259.937807:0:6562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1777051259.937815:0:102037:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da7b3793c0 going to sleep for 11 seconds 00000100:00100000:0.0:1777051259.937853:0:6562:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452514304 00000100:00100000:2.0:1777051259.937860:0:102037:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d943d90000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:102037:1863365452513920:0@lo:104: 00000100:00100000:0.0:1777051259.937864:0:6562:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452514304 00000100:00100000:0.0:1777051259.937917:0:6562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1777051259.937932:0:6562:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955610000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f9351a01-5b0e-4470-97fd-58b9b4b312a2+5:102037:x1863365452514048:12345-0@lo:104: 00010000:00010000:0.0:1777051259.937947:0:6562:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.146@tcp lock: ffff99da7d507200/0x85f51a6b96714718 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x85f51a6b9671471f expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051259.938042:0:99220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1777051259.938062:0:6563:0:(service.c:3441:ptlrpc_start_thread()) ldlm_cbd[0] started 3 min 2 max 56 00000100:00100000:3.0:1777051259.938064:0:99220:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f299880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:f9351a01-5b0e-4470-97fd-58b9b4b312a2+5:102037:x1863365452514304:12345-0@lo:104: 00010000:00010000:0.0:1777051259.938086:0:6562:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1777051259.938089:0:6563:0:(service.c:3500:ptlrpc_start_thread()) starting thread 'ldlm_cb00_003' 00010000:00010000:3.0:1777051259.938094:0:99220:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.146@tcp lock: ffff99d955a8ee00/0x85f51a6b96714693 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x85f51a6b9671469a expref: -99 pid: 101416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051259.938109:0:6562:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955610000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f9351a01-5b0e-4470-97fd-58b9b4b312a2+5:102037:x1863365452514048:12345-0@lo:104: Request processed in 174us (1183us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051259.938136:0:6562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1777051259.938546:0:6562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1777051259.938571:0:6562:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f42c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f9351a01-5b0e-4470-97fd-58b9b4b312a2+4:102037:x1863365452514176:12345-0@lo:104: 00010000:00010000:3.0:1777051259.938593:0:99220:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00010000:00010000:0.0:1777051259.938594:0:6562:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.146@tcp lock: ffff99da7d507c00/0x85f51a6b967146ee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x85f51a6b967146f5 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051259.938617:0:99220:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f299880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:f9351a01-5b0e-4470-97fd-58b9b4b312a2+4:102037:x1863365452514304:12345-0@lo:104: Request processed in 554us (837us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051259.939023:0:99220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00010000:00010000:0.0:1777051259.939105:0:6562:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00010000:00010000:3.0:1777051259.939110:0:13753:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00000100:00100000:0.0:1777051259.939122:0:6562:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f42c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f9351a01-5b0e-4470-97fd-58b9b4b312a2+3:102037:x1863365452514176:12345-0@lo:104: Request processed in 554us (1589us total) trans 0 rc 0/0 00010000:00010000:3.0:1777051259.939126:0:13753:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.146@tcp lock: ffff99d94ffbd800/0x85f51a6b9671476c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x85f51a6b96714773 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051259.939160:0:6562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00010000:00010000:3.0:1777051259.939163:0:13753:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94ffbd800 already unused, calling callback (ffffffffc1208c20) 10000000:00010000:3.0:1777051259.939179:0:13753:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.146@tcp lock: ffff99d94ffbd800/0x85f51a6b9671476c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x85f51a6b96714773 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051259.939197:0:13753:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.146@tcp lock: ffff99d94ffbd800/0x85f51a6b9671476c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x85f51a6b96714773 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1777051259.939268:0:13753:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.146@tcp lock: ffff99d94ffbd800/0x85f51a6b9671476c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x85f51a6b96714773 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051259.939278:0:6567:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 10000000:01000000:3.0:1777051259.939282:0:13753:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:2.0:1777051259.939286:0:102037:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955610e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:102037:1863365452514048:0@lo:104: 00010000:00010000:0.0:1777051259.939292:0:6567:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.146@tcp lock: ffff99da7d507200/0x85f51a6b96714718 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x85f51a6b9671471f expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051259.939313:0:102037:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94f42dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:102037:1863365452514176:0@lo:104: 00010000:00010000:0.0:1777051259.939324:0:6567:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da7d507200 already unused, calling callback (ffffffffc1208c20) 10000000:00010000:0.0:1777051259.939333:0:6567:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.146@tcp lock: ffff99da7d507200/0x85f51a6b96714718 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x85f51a6b9671471f expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051259.939337:0:102037:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d96040a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:102037:1863365452514304:0@lo:104: 00010000:00010000:0.0:1777051259.939369:0:6567:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.146@tcp lock: ffff99da7d507200/0x85f51a6b96714718 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x85f51a6b9671471f expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1777051259.939387:0:6567:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.146@tcp lock: ffff99da7d507200/0x85f51a6b96714718 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x85f51a6b9671471f expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1777051259.939398:0:6567:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1777051259.939463:0:6567:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.146@tcp lock: ffff99da7d507200/0x85f51a6b96714718 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x85f51a6b9671471f expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051259.939477:0:6567:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1777051259.939541:0:13753:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.146@tcp lock: ffff99d94ffbd800/0x85f51a6b9671476c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x85f51a6b96714773 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051259.939562:0:13753:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1777051259.939579:0:6567:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.146@tcp lock: ffff99da7d507200/0x85f51a6b96714718 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x85f51a6b9671471f expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051259.939609:0:13753:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.146@tcp lock: ffff99d94ffbd800/0x85f51a6b9671476c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x85f51a6b96714773 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051259.939612:0:6567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.146@tcp lock: ffff99da7d507200/0x85f51a6b96714718 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x85f51a6b9671471f expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051259.939656:0:13753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.146@tcp lock: ffff99d94ffbd800/0x85f51a6b9671476c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x85f51a6b96714773 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051259.939735:0:13753:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1777051259.939744:0:13753:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.146@tcp lock: ffff99d955a8ee00/0x85f51a6b96714693 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x85f51a6b9671469a expref: -99 pid: 101416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051259.939760:0:13753:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d955a8ee00 already unused, calling callback (ffffffffc1208c20) 10000000:00010000:3.0:1777051259.939767:0:13753:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.146@tcp lock: ffff99d955a8ee00/0x85f51a6b96714693 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x85f51a6b9671469a expref: -99 pid: 101416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051259.939781:0:13753:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.146@tcp lock: ffff99d955a8ee00/0x85f51a6b96714693 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x85f51a6b9671469a expref: -99 pid: 101416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1777051259.939800:0:13753:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.146@tcp lock: ffff99d955a8ee00/0x85f51a6b96714693 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x85f51a6b9671469a expref: -99 pid: 101416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1777051259.939811:0:13753:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1777051259.939852:0:13753:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.146@tcp lock: ffff99d955a8ee00/0x85f51a6b96714693 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x85f51a6b9671469a expref: -99 pid: 101416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051259.939857:0:38719:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777051259.939874:0:38719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.146@tcp lock: ffff99da7d507c00/0x85f51a6b967146ee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x85f51a6b967146f5 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051259.939875:0:13753:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1777051259.939900:0:13753:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.146@tcp lock: ffff99d955a8ee00/0x85f51a6b96714693 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x85f51a6b9671469a expref: -99 pid: 101416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051259.939903:0:38719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da7d507c00 already unused, calling callback (ffffffffc1208c20) 10000000:00010000:1.0:1777051259.939916:0:38719:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.146@tcp lock: ffff99da7d507c00/0x85f51a6b967146ee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x85f51a6b967146f5 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051259.939968:0:38719:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.146@tcp lock: ffff99da7d507c00/0x85f51a6b967146ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x85f51a6b967146f5 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051259.939970:0:13753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.146@tcp lock: ffff99d955a8ee00/0x85f51a6b96714693 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x85f51a6b9671469a expref: -99 pid: 101416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1777051259.940012:0:38719:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.146@tcp lock: ffff99da7d507c00/0x85f51a6b967146ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x85f51a6b967146f5 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051259.940022:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051259.940029:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051259.940383:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1777051259.940437:0:38719:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:3.0:1777051259.940467:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95aecc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3679:1863365452514560:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1777051259.940484:0:38719:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.146@tcp lock: ffff99da7d507c00/0x85f51a6b967146ee lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x85f51a6b967146f5 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051259.940515:0:38719:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1777051259.940533:0:38719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.146@tcp lock: ffff99da7d507c00/0x85f51a6b967146ee lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x85f51a6b967146f5 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051259.940552:0:38719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.146@tcp lock: ffff99da7d507c00/0x85f51a6b967146ee lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x85f51a6b967146f5 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051259.940581:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1777051259.940592:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051259.940599:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051259.940604:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051259.940619:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1777051259.940728:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7d30b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3677:1863365452514816:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1777051259.940793:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051259.940937:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94e627b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3678:1863365452514432:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1777051259.940997:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051259.941091:0:3679:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1777051259.941111:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da45f75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3679:1863365452514688:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1777051259.941135:0:24467:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452514560 00000100:00100000:1.0:1777051259.941146:0:24467:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452514560 00000100:00100000:3.0:1777051259.941182:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1777051259.941190:0:24467:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99d943ebbc00/0x85f51a6b96714773 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x85f51a6b9671476c expref: 23 pid: 101425 timeout: 7989 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051259.941244:0:24467:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452514816 00000100:00100000:1.0:1777051259.941251:0:24467:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452514816 00010000:00010000:1.0:1777051259.941277:0:24467:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99d95595aa00/0x85f51a6b967146f5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x85f51a6b967146ee expref: 24 pid: 101425 timeout: 7989 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051259.941279:0:6566:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452514432 00000100:00100000:3.0:1777051259.941293:0:6566:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452514432 00000100:00100000:1.0:1777051259.941324:0:24467:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452514688 00010000:00010000:3.0:1777051259.941334:0:6566:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99d95595b400/0x85f51a6b9671471f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x85f51a6b96714718 expref: 25 pid: 101427 timeout: 7989 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051259.941336:0:24467:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452514688 00010000:00010000:1.0:1777051259.941374:0:24467:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99d95595ba00/0x85f51a6b9671469a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x85f51a6b96714693 expref: 26 pid: 101424 timeout: 7989 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051259.941388:0:6566:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3816 00000100:00100000:3.0:1777051259.941416:0:6566:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da70a31f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f9351a01-5b0e-4470-97fd-58b9b4b312a2+26:3679:x1863365452514560:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1777051259.941470:0:24467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3817 00000100:00100000:1.0:1777051259.941488:0:24467:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da6fd47850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f9351a01-5b0e-4470-97fd-58b9b4b312a2+26:3677:x1863365452514816:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1777051259.941512:0:24467:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777051259.941512:0:6566:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777051259.941530:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051259.941532:0:6566:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99d943ebbc00/0x85f51a6b96714773 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x85f51a6b9671476c expref: 26 pid: 101425 timeout: 7989 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051259.941533:0:24467:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99d95595aa00/0x85f51a6b967146f5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x85f51a6b967146ee expref: 26 pid: 101425 timeout: 7989 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051259.941538:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777051259.941545:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051259.941586:0:6566:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99d943ebbc00/0x85f51a6b96714773 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x85f51a6b9671476c expref: 26 pid: 101425 timeout: 7989 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051259.941589:0:6564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3818 00000100:00100000:0.0:1777051259.941614:0:6564:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f298a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f9351a01-5b0e-4470-97fd-58b9b4b312a2+26:3678:x1863365452514432:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1777051259.941633:0:6564:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777051259.941643:0:6564:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99d95595b400/0x85f51a6b9671471f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x85f51a6b96714718 expref: 26 pid: 101427 timeout: 7989 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051259.943010:0:24467:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99d95595aa00/0x85f51a6b967146f5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x85f51a6b967146ee expref: 26 pid: 101425 timeout: 7989 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051259.943259:0:24467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d95595aa00/0x85f51a6b967146f5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x85f51a6b967146ee expref: 26 pid: 101425 timeout: 7989 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051259.943285:0:24467:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1777051259.943352:0:24467:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da6fd47850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f9351a01-5b0e-4470-97fd-58b9b4b312a2+25:3677:x1863365452514816:12345-0@lo:103:ldlm_bl.0 Request processed in 1867us (2558us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051259.943368:0:24467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3817 00000100:00100000:1.0:1777051259.943401:0:24467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3819 00000100:00100000:1.0:1777051259.943416:0:24467:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da70a32d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f9351a01-5b0e-4470-97fd-58b9b4b312a2+24:3679:x1863365452514688:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1777051259.943436:0:24467:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1777051259.943445:0:24467:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99d95595ba00/0x85f51a6b9671469a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x85f51a6b96714693 expref: 24 pid: 101424 timeout: 7989 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051259.943463:0:24467:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99d95595ba00/0x85f51a6b9671469a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x85f51a6b96714693 expref: 24 pid: 101424 timeout: 7989 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051259.943487:0:24467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d95595ba00/0x85f51a6b9671469a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x85f51a6b96714693 expref: 24 pid: 101424 timeout: 7989 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051259.943506:0:24467:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1777051259.943570:0:24467:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da70a32d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f9351a01-5b0e-4470-97fd-58b9b4b312a2+23:3679:x1863365452514688:12345-0@lo:103:ldlm_bl.0 Request processed in 155us (2390us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051259.943594:0:24467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3819 00010000:00010000:3.0:1777051259.943650:0:6566:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d943ebbc00/0x85f51a6b96714773 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x85f51a6b9671476c expref: 22 pid: 101425 timeout: 7989 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051259.943655:0:6564:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99d95595b400/0x85f51a6b9671471f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x85f51a6b96714718 expref: 22 pid: 101427 timeout: 7989 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051259.943700:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7d30b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3677:1863365452514816:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1777051259.943750:0:6564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d95595b400/0x85f51a6b9671471f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x85f51a6b96714718 expref: 21 pid: 101427 timeout: 7989 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051259.943753:0:6566:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1777051259.943781:0:6564:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1777051259.943975:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da45f75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3679:1863365452514688:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1777051259.943992:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95aecc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3679:1863365452514560:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1777051259.944200:0:6566:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da70a31f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f9351a01-5b0e-4470-97fd-58b9b4b312a2+20:3679:x1863365452514560:12345-0@lo:103:ldlm_bl.0 Request processed in 2787us (3621us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051259.944219:0:6566:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3816 00000100:00100000:0.0:1777051259.944290:0:6564:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f298a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f9351a01-5b0e-4470-97fd-58b9b4b312a2+19:3678:x1863365452514432:12345-0@lo:103:ldlm_bl.0 Request processed in 2678us (3290us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051259.944309:0:6564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3818 00000100:00100000:0.0:1777051259.944562:0:102037:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d9600b9180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:102037:1863365452513664:192.168.201.46@tcp:104: 00000100:00100000:2.0:1777051259.944591:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051259.944601:0:102037:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d943d90380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:102037:1863365452513792:192.168.201.46@tcp:104: 00000100:00100000:3.0:1777051259.944617:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94e627b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3678:1863365452514432:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1777051259.944710:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051259.944740:0:24467:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425856768 00010000:00010000:0.0:1777051259.944742:0:102037:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99d955a98000/0x85f51a6b96714a2f lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 102037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051259.944756:0:24467:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425856768 00000100:00100000:2.0:1777051259.944766:0:47827:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425856896 00000100:00100000:2.0:1777051259.944777:0:47827:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425856896 00010000:00010000:3.0:1777051259.944982:0:24467:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99d955a8f200/0x85f51a6b967147b2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5ea1 expref: 13 pid: 101429 timeout: 7989 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051259.945057:0:24467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3820 00000100:00100000:3.0:1777051259.945073:0:24467:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95aecc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:29c4352d-3260-4734-909d-9ea5de9e7fa4+13:2437:x1863365425856768:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1777051259.945092:0:24467:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777051259.945100:0:47827:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99d955a8f400/0x85f51a6b9671479d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5e8c expref: 13 pid: 101429 timeout: 7989 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051259.945101:0:24467:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99d955a8f200/0x85f51a6b967147b2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5ea1 expref: 13 pid: 101429 timeout: 7989 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051259.945124:0:24467:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99d955a8f200/0x85f51a6b967147b2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5ea1 expref: 13 pid: 101429 timeout: 7989 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051259.945149:0:24467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d955a8f200/0x85f51a6b967147b2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5ea1 expref: 13 pid: 101429 timeout: 7989 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051259.945156:0:47827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3821 00000100:00100000:2.0:1777051259.945170:0:47827:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da45f75c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:29c4352d-3260-4734-909d-9ea5de9e7fa4+12:2436:x1863365425856896:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1777051259.945170:0:24467:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1777051259.945185:0:47827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777051259.945194:0:47827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99d955a8f400/0x85f51a6b9671479d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5e8c expref: 12 pid: 101429 timeout: 7989 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051259.945213:0:47827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99d955a8f400/0x85f51a6b9671479d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5e8c expref: 12 pid: 101429 timeout: 7989 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051259.945236:0:47827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d955a8f400/0x85f51a6b9671479d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5e8c expref: 12 pid: 101429 timeout: 7989 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051259.945236:0:24467:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95aecc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:29c4352d-3260-4734-909d-9ea5de9e7fa4+12:2437:x1863365425856768:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 166us (654us total) trans 0 rc 0/0 00010000:00010000:2.0:1777051259.945259:0:47827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99d955a98000/0x85f51a6b96714a2f lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 102037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051259.945275:0:47827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d955a98000/0x85f51a6b96714a2f lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 102037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051259.945299:0:24467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3820 00010000:00010000:2.0:1777051259.945310:0:47827:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99d955a98000/0x85f51a6b96714a2f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 102037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051259.945324:0:47827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99d955a98000/0x85f51a6b96714a2f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 102037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051259.945339:0:47827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99d955a98000/0x85f51a6b96714a2f lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 102037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051259.945353:0:47827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99d955a98000/0x85f51a6b96714a2f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 102037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051259.945365:0:47827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d955a98000 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:2.0:1777051259.945373:0:47827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99d955a98000/0x85f51a6b96714a2f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 102037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051259.945387:0:47827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99d955a98000/0x85f51a6b96714a2f lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 102037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051259.945429:0:47827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99d955a98000/0x85f51a6b96714a2f lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 102037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051259.945448:0:47827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1777051259.945576:0:47827:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da45f75c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:29c4352d-3260-4734-909d-9ea5de9e7fa4+10:2436:x1863365425856896:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 405us (868us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051259.945593:0:47827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3821 00010000:00010000:3.0:1777051259.949035:0:102037:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99d955a98000/0x85f51a6b96714a2f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 102037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051259.949072:0:102037:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99d955a98000/0x85f51a6b96714a2f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 102037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051259.949090:0:102037:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d955a98000/0x85f51a6b96714a2f lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 102037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051259.990553:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1777051260.185551:0:3677:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1777051260.185590:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95f97fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452514944:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1777051260.186009:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051260.186113:0:8472:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452514944 00000100:00100000:1.0:1777051260.186126:0:8472:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452514944 00000100:00100000:1.0:1777051260.186532:0:8472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5533 00000100:00100000:1.0:1777051260.186545:0:8472:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7d30b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3677:x1863365452514944:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1777051260.186589:0:8472:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 440354112 pending 0 free 3862671360 avail 3631149056 00000100:00100000:1.0:1777051260.186952:0:8472:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7d30b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3677:x1863365452514944:12345-0@lo:13:osp-pre-0-1.0 Request processed in 406us (942us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051260.186964:0:8472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5533 00000100:00080000:1.0:1777051260.187000:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1777051260.187059:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95f97fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452514944:0@lo:13:osp-pre-0-1.0 00000020:00000080:1.0:1777051260.770303:0:102087:0:(class_obd.c:319:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffcad6eba00 20000000:00000080:1.0:1777051260.770326:0:102087:0:(mgs_handler.c:1163:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff99d94352a000 uarg=0000000000000000 20000000:01000000:1.0:1777051260.770381:0:102087:0:(mgs_llog.c:6175:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0001.hsm.default_archive_id=' 20000000:01000000:1.0:1777051260.770389:0:102087:0:(mgs_llog.c:4637:mgs_write_log_param2()) next param 'mdt.lustre-MDT0001.hsm.default_archive_id=' 20000000:01000000:1.0:1777051260.770396:0:102087:0:(mgs_llog.c:1366:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0001.hsm.default_archive_id= del=1 00000040:00080000:3.0:1777051260.771480:0:102088:0:(llog.c:858:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 37 count 37 20000000:02000000:1.0:1777051260.772517:0:102087:0:(mgs_llog.c:4110:mgs_wlp_lcfg()) Disabling parameter lustre.mdt.lustre-MDT0001.hsm.default_archive_id= in log params 10000000:01000000:1.0:1777051260.772525:0:102087:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1777051260.772551:0:102087:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99d9442ea800/0x85f51a6b96714a36 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 102087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051260.772580:0:102087:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d9442ea800/0x85f51a6b96714a36 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 102087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051260.772594:0:102087:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99d9442ea800/0x85f51a6b96714a36 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 102087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051260.772605:0:102087:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99d9442ea800/0x85f51a6b96714a36 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 102087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051260.772616:0:102087:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99d9442ea800/0x85f51a6b96714a36 lrc: 3/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 102087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051260.772626:0:102087:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99d9442ea800/0x85f51a6b96714a36 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 102087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051260.772636:0:102087:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d9442ea800 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:1.0:1777051260.772641:0:102087:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99d9442ea800/0x85f51a6b96714a36 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 102087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051260.772677:0:102087:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99d9442ea800/0x85f51a6b96714a36 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 102087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051260.772694:0:102087:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99d9442ea800/0x85f51a6b96714a36 lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 102087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051260.772705:0:102087:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99d9442ea800/0x85f51a6b96714a36 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 102087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051260.772716:0:102087:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d9442ea800/0x85f51a6b96714a36 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 102087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051260.837819:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051260.837876:0:101425:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425857024 00000100:00100000:3.0:1777051260.837892:0:101425:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425857024 00000100:00100000:2.0:1777051260.837894:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051260.837955:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051260.837981:0:101425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 86 00000100:00100000:0.0:1777051260.837984:0:6581:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425857280 00000100:00100000:0.0:1777051260.837994:0:6581:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425857280 00000100:00100000:3.0:1777051260.838003:0:101425:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942db6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29c4352d-3260-4734-909d-9ea5de9e7fa4+10:2437:x1863365425857024:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:2.0:1777051260.838018:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051260.838058:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051260.838072:0:6581:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425857792 00000100:00100000:0.0:1777051260.838078:0:6581:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425857792 00000100:00100000:3.0:1777051260.838114:0:101425:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942db6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29c4352d-3260-4734-909d-9ea5de9e7fa4+10:2437:x1863365425857024:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 116us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051260.838127:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13118 00000100:00100000:3.0:1777051260.838135:0:101425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 86 00000100:00100000:0.0:1777051260.838148:0:6581:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f97ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+6:2437:x1863365425857280:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:0.0:1777051260.838261:0:6581:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f97ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+6:2437:x1863365425857280:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 120us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051260.838274:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13118 00000100:00100000:0.0:1777051260.838301:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13119 00000100:00100000:0.0:1777051260.838315:0:6581:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d944e10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+48:2437:x1863365425857792:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:0.0:1777051260.838363:0:6581:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d944e10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+48:2437:x1863365425857792:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 51us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051260.838375:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13119 00000100:00100000:2.0:1777051260.838402:0:24468:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425857536 00000100:00080000:0.0:1777051260.838408:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1777051260.838409:0:24468:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425857536 00000100:00080000:0.0:1777051260.838469:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1777051260.838489:0:24468:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425858048 00000100:00100000:2.0:1777051260.838495:0:24468:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425858048 00000100:00100000:2.0:1777051260.838559:0:24468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10186 00000100:00080000:0.0:1777051260.838560:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1777051260.838575:0:24468:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f97fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+48:2437:x1863365425857536:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:3.0:1777051260.838617:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051260.838641:0:24468:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f97fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+48:2437:x1863365425857536:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 68us (683us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051260.838678:0:24468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10186 00000100:00100000:2.0:1777051260.838713:0:24468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10187 00000100:00100000:3.0:1777051260.838724:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051260.838734:0:24468:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d944e11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+47:2437:x1863365425858048:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:2.0:1777051260.838784:0:24468:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d944e11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+47:2437:x1863365425858048:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 59us (728us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051260.838795:0:24468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10187 00000100:00100000:2.0:1777051260.838813:0:24468:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425857408 00000100:00100000:2.0:1777051260.838819:0:24468:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425857408 00000100:00100000:0.0:1777051260.838854:0:10328:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425857152 00000100:00100000:0.0:1777051260.838865:0:10328:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425857152 00000100:00100000:2.0:1777051260.838884:0:24468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10188 00000100:00100000:2.0:1777051260.838901:0:24468:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da70a33100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+50:2437:x1863365425857408:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:0.0:1777051260.838938:0:10328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13120 00000100:00100000:2.0:1777051260.838953:0:24468:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da70a33100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+50:2437:x1863365425857408:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 55us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051260.838961:0:10328:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da70a31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+14:2437:x1863365425857152:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:2.0:1777051260.838973:0:24468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10188 00000100:00100000:0.0:1777051260.839030:0:10328:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da70a31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+14:2437:x1863365425857152:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 76us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051260.839046:0:10328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13120 00000100:00080000:2.0:1777051260.839046:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1777051260.839057:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1777051260.839514:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051260.839792:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051260.839812:0:27882:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425857664 00000100:00100000:2.0:1777051260.839822:0:27882:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425857664 00000100:00100000:2.0:1777051260.839920:0:27882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13121 00000100:00100000:2.0:1777051260.839939:0:27882:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da70a33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+17:2437:x1863365425857664:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:0.0:1777051260.839943:0:13320:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425857920 00000100:00100000:0.0:1777051260.839954:0:13320:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425857920 00000100:00100000:0.0:1777051260.840018:0:13320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10189 00000100:00100000:2.0:1777051260.840037:0:27882:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da70a33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+17:2437:x1863365425857664:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 97us (518us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051260.840039:0:13320:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da70a30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+50:2437:x1863365425857920:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:2.0:1777051260.840086:0:27882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13121 00000100:00100000:0.0:1777051260.840105:0:13320:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da70a30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+50:2437:x1863365425857920:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 71us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051260.840119:0:13320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10189 00000100:00080000:2.0:1777051260.840123:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1777051260.840132:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1777051261.015616:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1777051261.526458:0:6577:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1777051261.526465:0:6577:0:(mgc_request.c:1799:mgc_process_log()) Process log params-ffff99da44f8b000 from 37 10000000:01000000:1.0:1777051261.526473:0:6577:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1777051261.526528:0:6577:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.146@tcp lock: ffff99d9442ea800/0x85f51a6b96714a3d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051261.526544:0:6577:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.146@tcp lock: ffff99d9442ea800/0x85f51a6b96714a3d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051261.526561:0:6577:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.146@tcp lock: ffff99d9442ea800/0x85f51a6b96714a3d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051261.526594:0:6577:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7d309880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452515072:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1777051261.526708:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051261.527080:0:6577:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da7b3a4300 going to sleep for 11 seconds 00000100:00100000:2.0:1777051261.527258:0:101424:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452515072 00000100:00100000:2.0:1777051261.527269:0:101424:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452515072 00000100:00100000:2.0:1777051261.527327:0:101424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1777051261.527338:0:101424:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da45f65450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9351a01-5b0e-4470-97fd-58b9b4b312a2+19:6577:x1863365452515072:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1777051261.527353:0:101424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051261.527370:0:101424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d955a99000/0x85f51a6b96714a44 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x85f51a6b96714a3d expref: -99 pid: 101424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051261.527395:0:101424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d955a99000/0x85f51a6b96714a44 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x85f51a6b96714a3d expref: 20 pid: 101424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051261.527406:0:101424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d955a99000/0x85f51a6b96714a44 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b96714a3d expref: 20 pid: 101424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051261.527415:0:101424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d955a99000, rc 0) 00000100:00100000:2.0:1777051261.527473:0:101424:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da45f65450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9351a01-5b0e-4470-97fd-58b9b4b312a2+20:6577:x1863365452515072:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 136us (767us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051261.527482:0:101424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1777051261.527988:0:6577:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7d309880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452515072:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1777051261.528008:0:6577:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.146@tcp lock: ffff99d9442ea800/0x85f51a6b96714a3d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b96714a44 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051261.528019:0:6577:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.146@tcp lock: ffff99d9442ea800/0x85f51a6b96714a3d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x85f51a6b96714a44 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051261.528089:0:6577:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7d309880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452515200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1777051261.528124:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051261.528166:0:6577:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da7b3a4300 going to sleep for 11 seconds 00000100:00100000:2.0:1777051261.528308:0:101422:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452515200 00000100:00100000:2.0:1777051261.528315:0:101422:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452515200 00000100:00100000:2.0:1777051261.528362:0:101422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1777051261.528373:0:101422:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da45f64450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9351a01-5b0e-4470-97fd-58b9b4b312a2+20:6577:x1863365452515200:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1777051261.528904:0:101422:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da45f64450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9351a01-5b0e-4470-97fd-58b9b4b312a2+20:6577:x1863365452515200:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 531us (776us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051261.528915:0:101422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1777051261.529003:0:6577:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7d309880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452515200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1777051261.529047:0:6577:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94e627b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452515328:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1777051261.529106:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051261.529208:0:6577:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d9566006c0 going to sleep for 11 seconds 00000100:00100000:1.0:1777051261.529270:0:101429:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452515328 00000100:00100000:1.0:1777051261.529276:0:101429:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452515328 00000100:00100000:1.0:1777051261.532845:0:101429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1777051261.532863:0:101429:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da45f65050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f9351a01-5b0e-4470-97fd-58b9b4b312a2+20:6577:x1863365452515328:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1777051261.533017:0:101429:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da45f65050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f9351a01-5b0e-4470-97fd-58b9b4b312a2+20:6577:x1863365452515328:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 159us (3909us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051261.533029:0:101429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1777051261.533192:0:6577:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94e627b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452515328:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1777051261.535353:0:102101:0:(llog.c:858:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 37 00000020:01000000:1.0:1777051261.535713:0:6577:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 37-36 (rc=0) 10000000:01000000:1.0:1777051261.535748:0:6577:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.201.146@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1777051261.535761:0:6577:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff99d9442ea800/0x85f51a6b96714a3d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b96714a44 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051261.535777:0:6577:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.146@tcp lock: ffff99d9442ea800/0x85f51a6b96714a3d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b96714a44 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1777051261.535792:0:6577:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1777051261.535795:0:6577:0:(mgc_request.c:1799:mgc_process_log()) Process log params-ffff99d941839800 from 37 10000000:01000000:1.0:1777051261.535799:0:6577:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1777051261.535832:0:6577:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.146@tcp lock: ffff99d9442eb000/0x85f51a6b96714a4b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051261.535845:0:6577:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.146@tcp lock: ffff99d9442eb000/0x85f51a6b96714a4b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051261.535861:0:6577:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.146@tcp lock: ffff99d9442eb000/0x85f51a6b96714a4b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051261.535889:0:6577:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7d308380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452515456:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1777051261.535942:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051261.535989:0:6577:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da70a7f3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1777051261.536150:0:101427:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452515456 00000100:00100000:0.0:1777051261.536396:0:101427:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452515456 00000100:00100000:0.0:1777051261.536443:0:101427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1777051261.536456:0:101427:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da45f64c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f9351a01-5b0e-4470-97fd-58b9b4b312a2+20:6577:x1863365452515456:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1777051261.536470:0:101427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051261.536488:0:101427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99da713e3200/0x85f51a6b96714a52 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x85f51a6b96714a4b expref: -99 pid: 101427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051261.536517:0:101427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99da713e3200/0x85f51a6b96714a52 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x85f51a6b96714a4b expref: 21 pid: 101427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051261.536533:0:101427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99da713e3200/0x85f51a6b96714a52 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b96714a4b expref: 21 pid: 101427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051261.536546:0:101427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99da713e3200, rc 0) 00000100:00100000:2.0:1777051261.536776:0:6577:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7d308380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452515456:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1777051261.536779:0:101427:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da45f64c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f9351a01-5b0e-4470-97fd-58b9b4b312a2+21:6577:x1863365452515456:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 322us (833us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051261.536797:0:101427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00010000:00010000:2.0:1777051261.536805:0:6577:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.146@tcp lock: ffff99d9442eb000/0x85f51a6b96714a4b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b96714a52 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051261.536823:0:6577:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.146@tcp lock: ffff99d9442eb000/0x85f51a6b96714a4b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x85f51a6b96714a52 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051261.536902:0:6577:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d944e11880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452515584:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1777051261.536950:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051261.536997:0:6577:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da7b379cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1777051261.537048:0:101422:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452515584 00000100:00100000:1.0:1777051261.537058:0:101422:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452515584 00000100:00100000:1.0:1777051261.537106:0:101422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1777051261.537118:0:101422:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da45f67850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9351a01-5b0e-4470-97fd-58b9b4b312a2+21:6577:x1863365452515584:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1777051261.537306:0:101422:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da45f67850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9351a01-5b0e-4470-97fd-58b9b4b312a2+21:6577:x1863365452515584:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 189us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051261.537318:0:101422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1777051261.538493:0:6577:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d944e11880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452515584:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1777051261.538540:0:6577:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d944e11880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452515712:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1777051261.538601:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051261.538658:0:6577:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da7b379cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1777051261.538723:0:101429:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452515712 00000100:00100000:1.0:1777051261.538732:0:101429:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452515712 00000100:00100000:1.0:1777051261.538791:0:101429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1777051261.538803:0:101429:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da6fd55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f9351a01-5b0e-4470-97fd-58b9b4b312a2+21:6577:x1863365452515712:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1777051261.538941:0:101429:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da6fd55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f9351a01-5b0e-4470-97fd-58b9b4b312a2+21:6577:x1863365452515712:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 139us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051261.538955:0:101429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1777051261.541990:0:6577:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d944e11880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452515712:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1777051261.543547:0:102102:0:(llog.c:858:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 37 00000020:01000000:2.0:1777051261.543830:0:6577:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 37-36 (rc=0) 10000000:01000000:2.0:1777051261.543862:0:6577:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.201.146@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1777051261.543877:0:6577:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff99d9442eb000/0x85f51a6b96714a4b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b96714a52 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051261.543892:0:6577:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.146@tcp lock: ffff99d9442eb000/0x85f51a6b96714a4b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b96714a52 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1777051261.543914:0:6577:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1777051261.543917:0:6577:0:(mgc_request.c:1799:mgc_process_log()) Process log params-ffff99da44f8d000 from 37 10000000:01000000:2.0:1777051261.543921:0:6577:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1777051261.543960:0:6577:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.146@tcp lock: ffff99d955a98c00/0x85f51a6b96714a59 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051261.543972:0:6577:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.146@tcp lock: ffff99d955a98c00/0x85f51a6b96714a59 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051261.543985:0:6577:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.146@tcp lock: ffff99d955a98c00/0x85f51a6b96714a59 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051261.544013:0:6577:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d944e11180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452515840:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1777051261.544071:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051261.544391:0:101427:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452515840 00000100:00100000:0.0:1777051261.544423:0:101427:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452515840 00000100:00100000:0.0:1777051261.544474:0:101427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1777051261.544486:0:101427:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da6fd56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f9351a01-5b0e-4470-97fd-58b9b4b312a2+21:6577:x1863365452515840:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1777051261.544499:0:101427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051261.544543:0:101427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99da713e2e00/0x85f51a6b96714a60 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x85f51a6b96714a59 expref: -99 pid: 101427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051261.544570:0:101427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99da713e2e00/0x85f51a6b96714a60 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x85f51a6b96714a59 expref: 22 pid: 101427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051261.544584:0:101427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99da713e2e00/0x85f51a6b96714a60 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b96714a59 expref: 22 pid: 101427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051261.544593:0:101427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99da713e2e00, rc 0) 00000100:00100000:0.0:1777051261.544943:0:101427:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da6fd56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f9351a01-5b0e-4470-97fd-58b9b4b312a2+22:6577:x1863365452515840:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 455us (867us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051261.544958:0:101427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1777051261.547711:0:6577:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da7b379240 going to sleep for 11 seconds 00000100:00100000:2.0:1777051261.547748:0:6577:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d944e11180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452515840:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1777051261.547772:0:6577:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.146@tcp lock: ffff99d955a98c00/0x85f51a6b96714a59 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b96714a60 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051261.547788:0:6577:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.146@tcp lock: ffff99d955a98c00/0x85f51a6b96714a59 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x85f51a6b96714a60 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051261.547877:0:6577:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d944e11180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452515968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1777051261.547925:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051261.547970:0:6577:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da7b379240 going to sleep for 11 seconds 00000100:00100000:0.0:1777051261.548030:0:101422:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452515968 00000100:00100000:0.0:1777051261.548044:0:101422:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452515968 00000100:00100000:0.0:1777051261.548112:0:101422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1777051261.548126:0:101422:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da6fd57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9351a01-5b0e-4470-97fd-58b9b4b312a2+22:6577:x1863365452515968:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1777051261.548321:0:101422:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da6fd57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9351a01-5b0e-4470-97fd-58b9b4b312a2+22:6577:x1863365452515968:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 196us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051261.548335:0:101422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1777051261.548378:0:6577:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d944e11180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452515968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1777051261.548425:0:6577:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d944e11180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452516096:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1777051261.548489:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051261.548528:0:6577:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da7b379240 going to sleep for 11 seconds 00000100:00100000:1.0:1777051261.548572:0:101429:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452516096 00000100:00100000:1.0:1777051261.548581:0:101429:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452516096 00000100:00100000:1.0:1777051261.548660:0:101429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1777051261.548674:0:101429:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942fa8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f9351a01-5b0e-4470-97fd-58b9b4b312a2+22:6577:x1863365452516096:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1777051261.548805:0:101429:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942fa8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f9351a01-5b0e-4470-97fd-58b9b4b312a2+22:6577:x1863365452516096:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 133us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051261.548816:0:101429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1777051261.548881:0:6577:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d944e11180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452516096:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1777051261.551282:0:102103:0:(llog.c:858:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 37 00000020:01000000:2.0:1777051261.551397:0:6577:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 37-36 (rc=0) 10000000:01000000:2.0:1777051261.551429:0:6577:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.201.146@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1777051261.551436:0:6577:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff99d955a98c00/0x85f51a6b96714a59 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b96714a60 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051261.551448:0:6577:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.146@tcp lock: ffff99d955a98c00/0x85f51a6b96714a59 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b96714a60 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1777051261.551457:0:6577:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1777051261.551460:0:6577:0:(mgc_request.c:1799:mgc_process_log()) Process log params-ffff99da57ae9000 from 37 10000000:01000000:2.0:1777051261.551462:0:6577:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1777051261.551486:0:6577:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.146@tcp lock: ffff99d955a99a00/0x85f51a6b96714a67 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051261.551495:0:6577:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.146@tcp lock: ffff99d955a99a00/0x85f51a6b96714a67 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051261.551504:0:6577:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.146@tcp lock: ffff99d955a99a00/0x85f51a6b96714a67 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051261.551520:0:6577:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d944e11180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452516224:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1777051261.551558:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051261.551594:0:6577:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da7b379240 going to sleep for 11 seconds 00000100:00100000:0.0:1777051261.551670:0:101424:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452516224 00000100:00100000:0.0:1777051261.551678:0:101424:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452516224 00000100:00100000:0.0:1777051261.551723:0:101424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1777051261.551734:0:101424:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942fabc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9351a01-5b0e-4470-97fd-58b9b4b312a2+22:6577:x1863365452516224:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1777051261.551748:0:101424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051261.552060:0:101424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99da713e3c00/0x85f51a6b96714a6e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x85f51a6b96714a67 expref: -99 pid: 101424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051261.552093:0:101424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99da713e3c00/0x85f51a6b96714a6e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x85f51a6b96714a67 expref: 23 pid: 101424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051261.552108:0:101424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99da713e3c00/0x85f51a6b96714a6e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b96714a67 expref: 23 pid: 101424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051261.552121:0:101424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99da713e3c00, rc 0) 00000100:00100000:0.0:1777051261.552484:0:101424:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942fabc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9351a01-5b0e-4470-97fd-58b9b4b312a2+23:6577:x1863365452516224:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 749us (921us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051261.552495:0:101424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1777051261.553390:0:6577:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d944e11180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452516224:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1777051261.553416:0:6577:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.146@tcp lock: ffff99d955a99a00/0x85f51a6b96714a67 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b96714a6e expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051261.553432:0:6577:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.146@tcp lock: ffff99d955a99a00/0x85f51a6b96714a67 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x85f51a6b96714a6e expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051261.553502:0:6577:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d944e11180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452516352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1777051261.553544:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051261.553586:0:6577:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da7b379240 going to sleep for 11 seconds 00000100:00100000:0.0:1777051261.553624:0:101422:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452516352 00000100:00100000:0.0:1777051261.553655:0:101422:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452516352 00000100:00100000:1.0:1777051261.554033:0:101427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1777051261.554050:0:101427:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fd3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f9351a01-5b0e-4470-97fd-58b9b4b312a2+23:6577:x1863365452516352:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1777051261.554462:0:101427:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fd3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f9351a01-5b0e-4470-97fd-58b9b4b312a2+23:6577:x1863365452516352:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 417us (916us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051261.554473:0:101427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1777051261.554550:0:6577:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d944e11180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452516352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1777051261.554594:0:6577:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d944e11180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452516480:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1777051261.554931:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051261.554976:0:6577:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da7b379240 going to sleep for 11 seconds 00000100:00100000:1.0:1777051261.556048:0:101429:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452516480 00000100:00100000:1.0:1777051261.556056:0:101429:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452516480 00000100:00100000:1.0:1777051261.556375:0:101429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1777051261.556389:0:101429:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fd3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f9351a01-5b0e-4470-97fd-58b9b4b312a2+23:6577:x1863365452516480:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1777051261.556498:0:101429:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fd3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f9351a01-5b0e-4470-97fd-58b9b4b312a2+23:6577:x1863365452516480:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 112us (1567us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051261.556505:0:101429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1777051261.556585:0:6577:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d944e11180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452516480:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1777051261.559520:0:102104:0:(llog.c:858:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 37 00000020:01000000:1.0:1777051261.559740:0:6577:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 37-36 (rc=0) 10000000:01000000:1.0:1777051261.559767:0:6577:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.201.146@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1777051261.559778:0:6577:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff99d955a99a00/0x85f51a6b96714a67 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b96714a6e expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051261.559793:0:6577:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.146@tcp lock: ffff99d955a99a00/0x85f51a6b96714a67 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b96714a6e expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051261.605532:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051261.605665:0:101424:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425858176 00000100:00100000:3.0:1777051261.605681:0:101424:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425858176 00000100:00100000:3.0:1777051261.605765:0:101424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 99 00000100:00100000:3.0:1777051261.605782:0:101424:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942b18050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29c4352d-3260-4734-909d-9ea5de9e7fa4+10:6255:x1863365425858176:12345-192.168.201.46@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1777051261.605806:0:101424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777051261.605830:0:101424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99da7d785e00/0x85f51a6b96714a75 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b5eb6 expref: -99 pid: 101424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051261.605899:0:101424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99da7d785e00/0x85f51a6b96714a75 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5eb6 expref: 11 pid: 101424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051261.605918:0:101424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99da7d785e00/0x85f51a6b96714a75 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5eb6 expref: 11 pid: 101424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051261.605932:0:101424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99da7d785e00, rc 0) 00000100:00100000:3.0:1777051261.606019:0:101424:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942b18050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29c4352d-3260-4734-909d-9ea5de9e7fa4+11:6255:x1863365425858176:12345-192.168.201.46@tcp:101:ll_cfg_requeue.0 Request processed in 239us (492us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051261.606032:0:101424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 99 00000100:00100000:0.0:1777051261.613421:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051261.616069:0:101427:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425858304 00000100:00100000:1.0:1777051261.616084:0:101427:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425858304 00000100:00100000:1.0:1777051261.616169:0:101427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 100 00000100:00100000:1.0:1777051261.616186:0:101427:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942b1ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:29c4352d-3260-4734-909d-9ea5de9e7fa4+11:6255:x1863365425858304:12345-192.168.201.46@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1777051261.616428:0:101427:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942b1ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:29c4352d-3260-4734-909d-9ea5de9e7fa4+11:6255:x1863365425858304:12345-192.168.201.46@tcp:501:ll_cfg_requeue.0 Request processed in 245us (3421us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051261.616441:0:101427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 100 00000100:00100000:1.0:1777051261.621384:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051261.621437:0:101425:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425858432 00000100:00100000:3.0:1777051261.621449:0:101425:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425858432 00000100:00100000:3.0:1777051261.621530:0:101425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 101 00000100:00100000:3.0:1777051261.621547:0:101425:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da58075050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29c4352d-3260-4734-909d-9ea5de9e7fa4+11:6255:x1863365425858432:12345-192.168.201.46@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1777051261.621760:0:101425:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da58075050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29c4352d-3260-4734-909d-9ea5de9e7fa4+11:6255:x1863365425858432:12345-192.168.201.46@tcp:503:ll_cfg_requeue.0 Request processed in 216us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051261.621777:0:101425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 101 00000100:00100000:3.0:1777051261.626805:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051261.626891:0:101424:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425858560 00000100:00100000:0.0:1777051261.626908:0:101424:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425858560 00000100:00100000:0.0:1777051261.626968:0:101424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 102 00000100:00100000:0.0:1777051261.626983:0:101424:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94a770450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29c4352d-3260-4734-909d-9ea5de9e7fa4+11:6255:x1863365425858560:12345-192.168.201.46@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1777051261.627001:0:101424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051261.627025:0:101424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99da713e3800/0x85f51a6b96714a7c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b5ebd expref: -99 pid: 101424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051261.627454:0:101424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99da713e3800/0x85f51a6b96714a7c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5ebd expref: 12 pid: 101424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051261.627475:0:101424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99da713e3800/0x85f51a6b96714a7c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5ebd expref: 12 pid: 101424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051261.627489:0:101424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99da713e3800, rc 0) 00000100:00100000:0.0:1777051261.627605:0:101424:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94a770450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29c4352d-3260-4734-909d-9ea5de9e7fa4+12:6255:x1863365425858560:12345-192.168.201.46@tcp:101:ll_cfg_requeue.0 Request processed in 622us (803us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051261.627620:0:101424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 102 00000100:00100000:3.0:1777051261.636600:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051261.637025:0:101427:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425858688 00000100:00100000:1.0:1777051261.637038:0:101427:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425858688 00000100:00100000:1.0:1777051261.637111:0:101427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 103 00000100:00100000:1.0:1777051261.637126:0:101427:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94a770850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:29c4352d-3260-4734-909d-9ea5de9e7fa4+12:6255:x1863365425858688:12345-192.168.201.46@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1777051261.637318:0:101427:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94a770850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:29c4352d-3260-4734-909d-9ea5de9e7fa4+12:6255:x1863365425858688:12345-192.168.201.46@tcp:501:ll_cfg_requeue.0 Request processed in 192us (726us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051261.637332:0:101427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 103 00000100:00100000:0.0:1777051261.641855:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051261.641893:0:101425:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425858816 00000100:00100000:3.0:1777051261.641902:0:101425:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425858816 00000100:00100000:3.0:1777051261.641962:0:101425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 104 00000100:00100000:3.0:1777051261.641976:0:101425:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94a773050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29c4352d-3260-4734-909d-9ea5de9e7fa4+12:6255:x1863365425858816:12345-192.168.201.46@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1777051261.642116:0:101425:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94a773050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29c4352d-3260-4734-909d-9ea5de9e7fa4+12:6255:x1863365425858816:12345-192.168.201.46@tcp:503:ll_cfg_requeue.0 Request processed in 142us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051261.642136:0:101425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 104 00010000:00010000:1.0:1777051262.038534:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777051263.062844:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777051263.769867:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d944e10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3679:1863365452516608:0@lo:400:kworker.0 00000100:00100000:0.0:1777051263.769907:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d944e13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452516864:0@lo:400:kworker.0 00000100:00100000:3.0:1777051263.769967:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051263.769996:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051263.770026:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94e627b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452516992:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1777051263.770053:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d944e11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3679:1863365452517120:0@lo:400:kworker.0 00000100:00100000:0.0:1777051263.770064:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d944e11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3677:1863365452517376:0@lo:400:kworker.0 00000100:00100000:2.0:1777051263.770086:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051263.770098:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051263.770133:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051263.770138:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d944e11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452517504:0@lo:400:kworker.0 00000100:00100000:3.0:1777051263.770138:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d956128000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3679:1863365452517632:0@lo:400:kworker.0 00000100:00100000:3.0:1777051263.770229:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051263.770232:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051263.770249:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f826a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452517888:0@lo:400:kworker.0 00000100:00100000:2.0:1777051263.770275:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f825500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3678:1863365452518016:0@lo:400:kworker.0 00000100:00100000:3.0:1777051263.770275:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f826680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452518144:0@lo:400:kworker.0 00000100:00100000:0.0:1777051263.770303:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051263.770341:0:6580:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452517120 00000100:00100000:3.0:1777051263.770354:0:6580:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452517120 00000100:00100000:2.0:1777051263.770358:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051263.770374:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f824700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3677:1863365452518400:0@lo:400:kworker.0 00000100:00100000:3.0:1777051263.770419:0:6580:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452517376 00000100:00100000:2.0:1777051263.770424:0:47208:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452516864 00000100:00100000:3.0:1777051263.770428:0:6580:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452517376 00000100:00100000:0.0:1777051263.770434:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051263.770434:0:47208:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452516864 00000100:00100000:2.0:1777051263.770494:0:47208:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452516992 00000100:00100000:3.0:1777051263.770494:0:6580:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452517632 00000100:00100000:2.0:1777051263.770500:0:47208:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452516992 00000100:00100000:3.0:1777051263.770500:0:6580:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452517632 00000100:00100000:0.0:1777051263.770515:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da70a33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3680:1863365452516736:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1777051263.770536:0:47208:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452518016 00000100:00100000:3.0:1777051263.770536:0:6580:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452518400 00000100:00100000:2.0:1777051263.770542:0:47208:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452518016 00000100:00100000:3.0:1777051263.770542:0:6580:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452518400 00000100:00100000:3.0:1777051263.770581:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13122 00000100:00100000:2.0:1777051263.770582:0:47208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7995 00000100:00100000:2.0:1777051263.770632:0:47208:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d9600b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+8:3677:x1863365452516864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051263.770632:0:6580:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da70a33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3679:x1863365452517120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777051263.770639:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051263.770671:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d944e12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3680:1863365452517248:0@lo:400:kworker.0 00000100:00100000:3.0:1777051263.770735:0:6580:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da70a33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3679:x1863365452517120:12345-0@lo:400:kworker.0 Request processed in 138us (633us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051263.770736:0:47208:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d9600b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+8:3677:x1863365452516864:12345-0@lo:400:kworker.0 Request processed in 142us (747us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051263.770743:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051263.770761:0:47208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7995 00000100:00100000:3.0:1777051263.770761:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13122 00000100:00100000:0.0:1777051263.770793:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f824380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3680:1863365452517760:0@lo:400:kworker.0 00000100:00100000:3.0:1777051263.770795:0:6580:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452517248 00000100:00100000:2.0:1777051263.770796:0:47208:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452516736 00000100:00100000:2.0:1777051263.770805:0:47208:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452516736 00000100:00100000:3.0:1777051263.770805:0:6580:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452517248 00000100:00100000:2.0:1777051263.770845:0:47208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7996 00000100:00100000:3.0:1777051263.770862:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13123 00000100:00100000:0.0:1777051263.770863:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051263.770866:0:47208:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f825180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+7:3678:x1863365452516992:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1777051263.770877:0:6580:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d96040a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3677:x1863365452517376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777051263.770897:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f825c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3680:1863365452518272:0@lo:400:kworker.0 00000004:00000024:2.0:1777051263.770904:0:47208:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4194304 pending 0 free 1441603584 avail 1295364096 00000100:00100000:3.0:1777051263.770957:0:6580:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d96040a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3677:x1863365452517376:12345-0@lo:400:kworker.0 Request processed in 81us (825us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051263.770969:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13123 00000100:00100000:2.0:1777051263.770989:0:47208:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f825180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+7:3678:x1863365452516992:12345-0@lo:41:osp-pre-0-1.0 Request processed in 124us (898us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051263.770992:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051263.770993:0:6580:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452517760 00000100:00100000:3.0:1777051263.771001:0:6580:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452517760 00000100:00100000:2.0:1777051263.771008:0:47208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7996 00000100:00100000:2.0:1777051263.771034:0:47208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7997 00000100:00100000:3.0:1777051263.771034:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13124 00000100:00100000:2.0:1777051263.771048:0:47208:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da6ff7d050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+6:3678:x1863365452518016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051263.771048:0:6580:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da70a32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3679:x1863365452517632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777051263.771078:0:101424:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452516608 00000100:00100000:2.0:1777051263.771417:0:47208:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da6ff7d050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+6:3678:x1863365452518016:12345-0@lo:400:kworker.0 Request processed in 370us (1058us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051263.771417:0:6580:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da70a32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3679:x1863365452517632:12345-0@lo:400:kworker.0 Request processed in 371us (1219us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051263.771431:0:47208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7997 00000100:00100000:3.0:1777051263.771431:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13124 00000100:00100000:3.0:1777051263.771456:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13125 00000100:00100000:3.0:1777051263.771465:0:6580:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d943d90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3677:x1863365452518400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051263.771509:0:6580:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d943d90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3677:x1863365452518400:12345-0@lo:400:kworker.0 Request processed in 46us (1085us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051263.771519:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13125 00000100:00100000:3.0:1777051263.771537:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13126 00000100:00100000:3.0:1777051263.771547:0:6580:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7c9a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3680:x1863365452517248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051263.771623:0:6580:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7c9a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3680:x1863365452517248:12345-0@lo:400:kworker.0 Request processed in 49us (858us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051263.771634:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13126 00000100:00100000:3.0:1777051263.771658:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13127 00000100:00100000:3.0:1777051263.771679:0:6580:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da44974000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3680:x1863365452517760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051263.771720:0:6580:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da44974000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3680:x1863365452517760:12345-0@lo:400:kworker.0 Request processed in 53us (872us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051263.771729:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13127 00000100:00100000:3.0:1777051263.771814:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7998 00000100:00100000:3.0:1777051263.771827:0:6584:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d943d90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3680:x1863365452516736:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1777051263.771854:0:6584:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4243456 pending 0 free 1446064128 avail 1299824640 00000100:00100000:2.0:1777051263.771859:0:8470:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452517504 00000100:00100000:2.0:1777051263.771866:0:8470:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452517504 00000100:00100000:0.0:1777051263.771907:0:101424:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452516608 00000100:00100000:3.0:1777051263.771910:0:6584:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d943d90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3680:x1863365452516736:12345-0@lo:41:osp-pre-1-0.0 Request processed in 84us (1309us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051263.771913:0:8470:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452517888 00000100:00100000:2.0:1777051263.771920:0:8470:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452517888 00000100:00100000:3.0:1777051263.771925:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7998 00000100:00080000:3.0:1777051263.771960:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1777051263.771962:0:8470:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452518272 00000100:00080000:3.0:1777051263.771966:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1777051263.771967:0:8470:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452518272 00000100:00080000:3.0:1777051263.771970:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1777051263.771976:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1777051263.771981:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1777051263.771992:0:101424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1777051263.772012:0:101424:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da48dcc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9351a01-5b0e-4470-97fd-58b9b4b312a2+23:3679:x1863365452516608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777051263.772020:0:8470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10190 00000100:00100000:3.0:1777051263.772035:0:24468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10191 00000100:00100000:2.0:1777051263.772040:0:8470:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f824000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3678:x1863365452517504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051263.772048:0:24468:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955610e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3677:x1863365452517888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777051263.772124:0:101424:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da48dcc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9351a01-5b0e-4470-97fd-58b9b4b312a2+23:3679:x1863365452516608:12345-0@lo:400:kworker.0 Request processed in 115us (2154us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051263.772128:0:8470:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f824000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3678:x1863365452517504:12345-0@lo:400:kworker.0 Request processed in 89us (1891us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051263.772128:0:24468:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955610e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3677:x1863365452517888:12345-0@lo:400:kworker.0 Request processed in 80us (1824us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051263.772426:0:8470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10190 00000100:00100000:3.0:1777051263.772441:0:24468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10191 00000100:00100000:2.0:1777051263.772451:0:8470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10192 00000100:00100000:2.0:1777051263.772462:0:8470:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da46270e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3680:x1863365452518272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777051263.772525:0:8470:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da46270e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3680:x1863365452518272:12345-0@lo:400:kworker.0 Request processed in 61us (1540us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051263.772536:0:101424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1777051263.772538:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94e627b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452516992:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1777051263.772544:0:8470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10192 00000100:00100000:3.0:1777051263.772567:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d944e11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452517504:0@lo:400:kworker.0 00000100:00100000:3.0:1777051263.772589:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f825500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3678:1863365452518016:0@lo:400:kworker.0 00000100:00100000:0.0:1777051263.772670:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051263.773378:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d944e10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3679:1863365452516608:0@lo:400:kworker.0 00000100:00100000:0.0:1777051263.773417:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d944e11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3679:1863365452517120:0@lo:400:kworker.0 00000100:00100000:0.0:1777051263.773433:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d956128000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3679:1863365452517632:0@lo:400:kworker.0 00000100:00100000:0.0:1777051263.773497:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da70a33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3680:1863365452516736:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1777051263.773514:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d944e12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3680:1863365452517248:0@lo:400:kworker.0 00000100:00100000:0.0:1777051263.773530:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f824380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3680:1863365452517760:0@lo:400:kworker.0 00000100:00100000:0.0:1777051263.773547:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f825c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3680:1863365452518272:0@lo:400:kworker.0 00000100:00100000:1.0:1777051263.774800:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f826a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452517888:0@lo:400:kworker.0 00000100:00100000:1.0:1777051263.774822:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f824700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3677:1863365452518400:0@lo:400:kworker.0 00000100:00100000:1.0:1777051263.774837:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d944e13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452516864:0@lo:400:kworker.0 00000100:00100000:1.0:1777051263.774852:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d944e11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3677:1863365452517376:0@lo:400:kworker.0 00000100:00100000:0.0:1777051263.775040:0:8471:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452518144 00000100:00100000:0.0:1777051263.775050:0:8471:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452518144 00000100:00100000:2.0:1777051263.775116:0:27884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10193 00000100:00100000:2.0:1777051263.775136:0:27884:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da46271f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3679:x1863365452518144:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1777051263.775141:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1777051263.775221:0:27884:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da46271f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3679:x1863365452518144:12345-0@lo:400:kworker.0 Request processed in 91us (2550us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051263.775233:0:27884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10193 00000100:00100000:0.0:1777051263.775322:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f826680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452518144:0@lo:400:kworker.0 00010000:00010000:2.0:1777051264.089499:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1777051264.281045:0:3677:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1777051264.281082:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da46272d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3677:1863365452518528:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1777051264.281517:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051264.281891:0:47388:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452518528 00000100:00100000:0.0:1777051264.281902:0:47388:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452518528 00000100:00100000:0.0:1777051264.281989:0:47388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5534 00000100:00100000:0.0:1777051264.282007:0:47388:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7d30aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3677:x1863365452518528:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1777051264.282035:0:3680:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00002000:00000024:0.0:1777051264.282051:0:47388:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 440354112 pending 0 free 3862671360 avail 3631149056 00000100:00100000:2.0:1777051264.282081:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f825180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3680:1863365452518656:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1777051264.282150:0:47388:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7d30aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3677:x1863365452518528:12345-0@lo:13:osp-pre-0-0.0 Request processed in 143us (630us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051264.282166:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051264.282240:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da46272d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3677:1863365452518528:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1777051264.282278:0:47388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5534 00000100:00100000:1.0:1777051264.282305:0:8472:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452518656 00000100:00100000:1.0:1777051264.282314:0:8472:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452518656 00000100:00100000:1.0:1777051264.282370:0:8472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5535 00000100:00100000:1.0:1777051264.282388:0:8472:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f824e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3680:x1863365452518656:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1777051264.282427:0:8472:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 430294336 pending 0 free 3645853696 avail 3414331392 00000100:00100000:1.0:1777051264.282504:0:8472:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f824e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3680:x1863365452518656:12345-0@lo:13:osp-pre-1-0.0 Request processed in 121us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051264.282517:0:8472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5535 00000100:00100000:2.0:1777051264.282630:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f825180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3680:1863365452518656:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1777051264.790409:0:3679:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1777051264.790450:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7d309500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452518784:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1777051264.790558:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051264.790831:0:10113:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452518784 00000100:00100000:2.0:1777051264.790851:0:10113:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452518784 00000100:00100000:2.0:1777051264.790954:0:10113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5536 00000100:00100000:2.0:1777051264.790973:0:10113:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7d30a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3679:x1863365452518784:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1777051264.791038:0:10113:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 430294336 pending 0 free 3645853696 avail 3414331392 00000100:00100000:2.0:1777051264.791493:0:10113:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7d30a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3679:x1863365452518784:12345-0@lo:13:osp-pre-1-1.0 Request processed in 522us (931us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051264.791508:0:10113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5536 00000100:00100000:1.0:1777051264.791565:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7d309500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452518784:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1777051265.111388:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777051265.303487:0:3678:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1777051265.303524:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da70a31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452518912:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1777051265.303665:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051265.303801:0:47388:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452518912 00000100:00100000:3.0:1777051265.303814:0:47388:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452518912 00000100:00100000:3.0:1777051265.303929:0:47388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5537 00000100:00100000:3.0:1777051265.303947:0:47388:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da70a30380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3678:x1863365452518912:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1777051265.303987:0:47388:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 440354112 pending 0 free 3862671360 avail 3631149056 00000100:00100000:3.0:1777051265.304063:0:47388:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da70a30380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3678:x1863365452518912:12345-0@lo:13:osp-pre-0-1.0 Request processed in 120us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051265.304075:0:47388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5537 00000100:00100000:3.0:1777051265.304161:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da70a31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452518912:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1777051265.304289:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:3.0:1777051265.751429:0:101448:0:(llog.c:858:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1777051265.956339:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051265.956479:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051265.956546:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051265.956623:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051265.956663:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051265.956702:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051265.956718:0:6580:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425859200 00000100:00100000:3.0:1777051265.956735:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051265.956741:0:6580:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425859200 00000100:00100000:3.0:1777051265.956770:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051265.956807:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051265.956851:0:27885:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425859712 00000100:00100000:3.0:1777051265.956858:0:27885:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425859712 00000100:00100000:0.0:1777051265.956889:0:6580:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425859072 00000100:00100000:0.0:1777051265.956900:0:6580:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425859072 00000100:00100000:3.0:1777051265.956909:0:27885:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425859584 00000100:00100000:3.0:1777051265.956917:0:27885:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425859584 00000100:00100000:0.0:1777051265.956979:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13128 00000100:00100000:0.0:1777051265.957005:0:6580:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da70a31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+6:2436:x1863365425859200:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:0.0:1777051265.957548:0:6580:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da70a31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+6:2436:x1863365425859200:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 547us (1061us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051265.957592:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13128 00000100:00100000:2.0:1777051265.957620:0:8628:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425859456 00000100:00100000:2.0:1777051265.957629:0:8628:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425859456 00000100:00100000:0.0:1777051265.957647:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13129 00000100:00100000:0.0:1777051265.957668:0:6580:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da70a31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+48:2436:x1863365425859712:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:2.0:1777051265.957683:0:8628:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425859968 00000100:00100000:2.0:1777051265.957690:0:8628:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425859968 00000100:00100000:2.0:1777051265.957728:0:8628:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425859328 00000100:00100000:2.0:1777051265.957733:0:8628:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425859328 00000100:00100000:0.0:1777051265.957749:0:6580:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da70a31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+48:2436:x1863365425859712:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 84us (1120us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051265.957772:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13129 00000100:00100000:2.0:1777051265.957772:0:8628:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425859840 00000100:00100000:2.0:1777051265.957781:0:8628:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425859840 00000100:00100000:0.0:1777051265.957827:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13130 00000100:00100000:2.0:1777051265.957837:0:8628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10194 00000100:00100000:0.0:1777051265.957846:0:6580:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da70a31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+14:2436:x1863365425859072:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:2.0:1777051265.957858:0:8628:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da70a32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+48:2436:x1863365425859456:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:0.0:1777051265.957916:0:6580:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da70a31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+14:2436:x1863365425859072:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 72us (1209us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051265.957922:0:8628:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da70a32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+48:2436:x1863365425859456:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 69us (1374us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051265.957943:0:8628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10194 00000100:00100000:0.0:1777051265.957951:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13130 00000100:00100000:2.0:1777051265.957973:0:8628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10195 00000100:00100000:2.0:1777051265.957989:0:8628:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da70a32680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+47:2436:x1863365425859968:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:0.0:1777051265.958002:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13131 00000100:00100000:0.0:1777051265.958022:0:6580:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da70a31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+17:2436:x1863365425859584:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:2.0:1777051265.958035:0:8628:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da70a32680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+47:2436:x1863365425859968:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 49us (1370us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051265.958047:0:8628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10195 00000100:00100000:2.0:1777051265.958069:0:8628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10196 00000100:00100000:2.0:1777051265.958081:0:8628:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da70a30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+50:2436:x1863365425859328:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:0.0:1777051265.958101:0:6580:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da70a31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+17:2436:x1863365425859584:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 81us (1326us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051265.958115:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13131 00000100:00100000:2.0:1777051265.958126:0:8628:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da70a30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+50:2436:x1863365425859328:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 45us (1389us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051265.958161:0:8628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10196 00000100:00080000:0.0:1777051265.958488:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1777051265.958504:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1777051265.958510:0:8628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10197 00000100:00080000:0.0:1777051265.958515:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1777051265.958522:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1777051265.958528:0:8628:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da70a30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+50:2436:x1863365425859840:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:2.0:1777051265.958604:0:8628:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da70a30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+50:2436:x1863365425859840:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 82us (1794us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051265.958614:0:8628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10197 00000100:00100000:1.0:1777051265.958927:0:101427:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425858944 00000100:00100000:1.0:1777051265.958938:0:101427:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425858944 00000100:00100000:1.0:1777051265.959961:0:101427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 106 00000100:00100000:1.0:1777051265.959979:0:101427:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da48dcfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:29c4352d-3260-4734-909d-9ea5de9e7fa4+12:2436:x1863365425858944:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:1.0:1777051265.960368:0:101427:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da48dcfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:29c4352d-3260-4734-909d-9ea5de9e7fa4+12:2436:x1863365425858944:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 390us (4042us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051265.960382:0:101427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 106 00010000:00010000:1.0:1777051266.134979:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777051267.159401:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1777051267.570722:0:102287:0:(debug.c:645:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-hsm test 302: HSM tunnable are persistent when CDT is off ========================================================== 13:21:05 (1777051265) 00010000:00010000:1.0:1777051268.185092:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1777051268.374472:0:99289:0:(llog.c:801:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1777051268.374483:0:99289:0:(llog_cat.c:158:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1777051268.375837:0:99289:0:(llog.c:858:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:0.0:1777051268.375856:0:99289:0:(llog.c:858:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1777051268.887057:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da70a30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452519040:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1777051268.887452:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051268.888090:0:47208:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452519040 00000100:00100000:2.0:1777051268.888104:0:47208:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452519040 00000100:00100000:2.0:1777051268.888192:0:47208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7999 00000100:00100000:2.0:1777051268.888246:0:47208:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da70a33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+7:3678:x1863365452519040:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1777051268.888299:0:47208:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4194304 pending 0 free 1441603584 avail 1295364096 00000100:00100000:2.0:1777051268.888391:0:47208:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da70a33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+7:3678:x1863365452519040:12345-0@lo:41:osp-pre-0-1.0 Request processed in 151us (939us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051268.888405:0:47208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7999 00000100:00100000:2.0:1777051268.888498:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da70a30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452519040:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1777051268.890506:0:3680:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1777051268.890553:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da70a30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3680:1863365452519168:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1777051268.890612:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051268.890668:0:6585:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452519168 00000100:00100000:3.0:1777051268.890676:0:6585:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452519168 00000100:00100000:3.0:1777051268.890724:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8000 00000100:00100000:3.0:1777051268.890736:0:6585:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94e627b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3680:x1863365452519168:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1777051268.890769:0:6585:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4243456 pending 0 free 1446064128 avail 1299824640 00000100:00100000:3.0:1777051268.890818:0:6585:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94e627b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3680:x1863365452519168:12345-0@lo:41:osp-pre-1-0.0 Request processed in 85us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051268.890826:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8000 00000100:00100000:3.0:1777051268.890903:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da70a30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3680:1863365452519168:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1777051268.891080:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d942a0f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3677:1863365452519424:0@lo:400:kworker.0 00000100:00100000:3.0:1777051268.891119:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051268.891146:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7fd65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3677:1863365452519936:0@lo:400:kworker.0 00000100:00100000:3.0:1777051268.891181:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051268.891554:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94f42e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3677:1863365452520448:0@lo:400:kworker.0 00000100:00100000:3.0:1777051268.891602:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051268.891641:0:3677:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1777051268.891651:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d942a0d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3677:1863365452519552:0@lo:400:kworker.0 00000100:00100000:3.0:1777051268.891688:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051268.891719:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7fd67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3677:1863365452520064:0@lo:400:kworker.0 00000100:00100000:3.0:1777051268.891754:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051268.891797:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94f42ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3677:1863365452520576:0@lo:400:kworker.0 00000100:00100000:3.0:1777051268.891838:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051268.891888:0:27884:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452520448 00000100:00100000:3.0:1777051268.891896:0:27884:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452520448 00000100:00080000:0.0:1777051268.891954:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1777051268.891978:0:27884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10198 00000100:00100000:0.0:1777051268.891989:0:10328:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452519424 00000100:00100000:3.0:1777051268.892000:0:27884:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3677:x1863365452520448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777051268.892003:0:10328:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452519424 00000100:00100000:0.0:1777051268.892415:0:10328:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452519936 00000100:00100000:0.0:1777051268.892425:0:10328:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452519936 00000100:00100000:3.0:1777051268.892431:0:27884:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3677:x1863365452520448:12345-0@lo:400:kworker.0 Request processed in 436us (823us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051268.892449:0:27884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10198 00000100:00100000:0.0:1777051268.892499:0:10328:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452519552 00000100:00100000:3.0:1777051268.892502:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da70a30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3680:1863365452519296:0@lo:400:kworker.0 00000100:00100000:0.0:1777051268.892509:0:10328:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452519552 00000100:00100000:0.0:1777051268.892611:0:10328:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452520064 00000100:00100000:0.0:1777051268.892620:0:10328:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452520064 00000100:00100000:3.0:1777051268.892621:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051268.892665:0:10328:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452520576 00000100:00100000:0.0:1777051268.892672:0:10328:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452520576 00000100:00100000:3.0:1777051268.892691:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d942a0f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3680:1863365452519808:0@lo:400:kworker.0 00000100:00100000:0.0:1777051268.892729:0:10328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13132 00000100:00100000:3.0:1777051268.892751:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051268.892755:0:10328:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f42dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3677:x1863365452519424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051268.892797:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94f42c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3680:1863365452520320:0@lo:400:kworker.0 00000100:00100000:2.0:1777051268.893172:0:8628:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452519808 00000100:00100000:2.0:1777051268.893182:0:8628:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452519808 00000100:00100000:2.0:1777051268.893283:0:8628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10199 00000100:00100000:2.0:1777051268.893299:0:8628:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d944e11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3680:x1863365452519808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777051268.894645:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d942a0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3679:1863365452519680:0@lo:400:kworker.0 00000100:00100000:3.0:1777051268.895244:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051268.895296:0:10328:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f42dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3677:x1863365452519424:12345-0@lo:400:kworker.0 Request processed in 2548us (4167us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051268.895313:0:10328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13132 00000100:00100000:3.0:1777051268.895321:0:101425:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452519296 00000100:00100000:3.0:1777051268.895329:0:101425:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452519296 00000100:00100000:0.0:1777051268.895373:0:8492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13133 00000100:00100000:3.0:1777051268.895388:0:101425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1777051268.895397:0:8492:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f42d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3677:x1863365452519936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051268.895412:0:101425:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da48dcc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9351a01-5b0e-4470-97fd-58b9b4b312a2+23:3680:x1863365452519296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777051268.895472:0:8492:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f42d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3677:x1863365452519936:12345-0@lo:400:kworker.0 Request processed in 83us (4287us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051268.895486:0:8492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13133 00000100:00100000:3.0:1777051268.895550:0:101425:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da48dcc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9351a01-5b0e-4470-97fd-58b9b4b312a2+23:3680:x1863365452519296:12345-0@lo:400:kworker.0 Request processed in 113us (2900us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051268.895564:0:8492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13134 00000100:00100000:3.0:1777051268.895573:0:101425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1777051268.895591:0:8492:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3677:x1863365452519552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051268.895644:0:27885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13135 00000100:00100000:3.0:1777051268.895666:0:27885:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:lustre-MDT0001-lwp-OST0001_UUID+5:3677:x1863365452520064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777051268.895674:0:8492:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3677:x1863365452519552:12345-0@lo:400:kworker.0 Request processed in 90us (3981us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051268.895686:0:8492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13134 00000100:00100000:0.0:1777051268.895713:0:8492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13136 00000100:00100000:0.0:1777051268.895728:0:8492:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3677:x1863365452520576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051268.896101:0:27885:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:lustre-MDT0001-lwp-OST0001_UUID+5:3677:x1863365452520064:12345-0@lo:400:kworker.0 Request processed in 96us (3997us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051268.896119:0:27885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13135 00000100:00100000:0.0:1777051268.896131:0:8492:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3677:x1863365452520576:12345-0@lo:400:kworker.0 Request processed in 403us (4288us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051268.896148:0:8492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13136 00000100:00100000:3.0:1777051268.896174:0:8470:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452520320 00000100:00100000:3.0:1777051268.896184:0:8470:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452520320 00000100:00100000:3.0:1777051268.896284:0:8470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10200 00000100:00080000:0.0:1777051268.896299:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1777051268.896302:0:8470:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d944e11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3680:x1863365452520320:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1777051268.896312:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1777051268.896320:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1777051268.896376:0:8470:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d944e11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3680:x1863365452520320:12345-0@lo:400:kworker.0 Request processed in 79us (1133us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051268.896388:0:8470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10200 00000100:00100000:3.0:1777051268.896467:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da70a30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3680:1863365452519296:0@lo:400:kworker.0 00000100:00100000:3.0:1777051268.896498:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94f42c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3680:1863365452520320:0@lo:400:kworker.0 00000100:00100000:3.0:1777051268.896585:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d942a0d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3677:1863365452519552:0@lo:400:kworker.0 00000100:00100000:3.0:1777051268.896602:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7fd67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3677:1863365452520064:0@lo:400:kworker.0 00000100:00100000:3.0:1777051268.896618:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94f42ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3677:1863365452520576:0@lo:400:kworker.0 00000100:00100000:3.0:1777051268.896635:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d942a0f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3677:1863365452519424:0@lo:400:kworker.0 00000100:00100000:3.0:1777051268.896651:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7fd65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3677:1863365452519936:0@lo:400:kworker.0 00000100:00100000:3.0:1777051268.896667:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94f42e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3677:1863365452520448:0@lo:400:kworker.0 00000100:00100000:2.0:1777051268.897171:0:8628:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d944e11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3680:x1863365452519808:12345-0@lo:400:kworker.0 Request processed in 3874us (4425us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051268.897187:0:8628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10199 00000100:00100000:3.0:1777051268.897383:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d942a0f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3680:1863365452519808:0@lo:400:kworker.0 00000100:00100000:1.0:1777051268.897540:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051268.897607:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94f42ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452520192:0@lo:400:kworker.0 00000100:00100000:3.0:1777051268.897655:0:27885:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452519680 00000100:00100000:1.0:1777051268.897668:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051268.897670:0:27885:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452519680 00000100:00100000:3.0:1777051268.897772:0:27885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13137 00000100:00080000:1.0:1777051268.897775:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1777051268.897799:0:8468:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452520192 00000100:00100000:3.0:1777051268.897799:0:27885:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7d309500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:lustre-MDT0001-lwp-OST0000_UUID+5:3679:x1863365452519680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777051268.897815:0:8468:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452520192 00000100:00080000:1.0:1777051268.897873:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1777051268.897909:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10201 00000100:00100000:3.0:1777051268.897921:0:27885:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7d309500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:lustre-MDT0001-lwp-OST0000_UUID+5:3679:x1863365452519680:12345-0@lo:400:kworker.0 Request processed in 129us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051268.897936:0:8468:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7d308380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3679:x1863365452520192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051268.897950:0:27885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13137 00000100:00100000:1.0:1777051268.897951:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d942a0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3679:1863365452519680:0@lo:400:kworker.0 00000100:00100000:2.0:1777051268.898047:0:8468:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7d308380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3679:x1863365452520192:12345-0@lo:400:kworker.0 Request processed in 120us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051268.898066:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10201 00000100:00100000:1.0:1777051268.898082:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94f42ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452520192:0@lo:400:kworker.0 00010000:00010000:3.0:1777051269.207450:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1777051269.398424:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7d309880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3680:1863365452520704:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1777051269.398425:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f825180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452520832:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1777051269.398578:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051269.398633:0:8473:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452520832 00000100:00100000:1.0:1777051269.398647:0:8473:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452520832 00000100:00100000:2.0:1777051269.398994:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051269.399063:0:8473:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452520704 00000100:00100000:1.0:1777051269.399070:0:8473:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452520704 00000100:00100000:0.0:1777051269.399859:0:47388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5538 00000100:00100000:0.0:1777051269.399884:0:47388:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da46273100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3679:x1863365452520832:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1777051269.399893:0:10113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5539 00000100:00100000:2.0:1777051269.399912:0:10113:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f825f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3680:x1863365452520704:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1777051269.399946:0:47388:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 430294336 pending 0 free 3645853696 avail 3414331392 00002000:00000024:2.0:1777051269.399948:0:10113:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 440354112 pending 0 free 3862671360 avail 3631149056 00000100:00100000:0.0:1777051269.400041:0:47388:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da46273100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3679:x1863365452520832:12345-0@lo:13:osp-pre-1-0.0 Request processed in 165us (1462us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051269.400052:0:10113:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f825f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3680:x1863365452520704:12345-0@lo:13:osp-pre-0-0.0 Request processed in 145us (1375us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051269.400059:0:47388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5538 00000100:00100000:2.0:1777051269.400415:0:10113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5539 00000100:00100000:1.0:1777051269.400446:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7d309880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3680:1863365452520704:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1777051269.400474:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f825180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452520832:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1777051269.912387:0:3678:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1777051269.912425:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7d309880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452520960:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1777051269.912556:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051269.912656:0:8473:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452520960 00000100:00100000:1.0:1777051269.912671:0:8473:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452520960 00000100:00100000:1.0:1777051269.913039:0:8473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5540 00000100:00100000:1.0:1777051269.913053:0:8473:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d944e13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3678:x1863365452520960:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1777051269.913090:0:8473:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 430294336 pending 0 free 3645853696 avail 3414331392 00000100:00100000:1.0:1777051269.913546:0:8473:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d944e13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3678:x1863365452520960:12345-0@lo:13:osp-pre-1-1.0 Request processed in 495us (990us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051269.913558:0:8473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5540 00000100:00100000:3.0:1777051269.913597:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7d309880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452520960:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1777051270.233597:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1777051270.422712:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d944e12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452521088:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1777051270.422821:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051270.422944:0:47388:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452521088 00000100:00100000:1.0:1777051270.422957:0:47388:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452521088 00000100:00080000:2.0:1777051270.423392:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1777051270.423456:0:47388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5541 00000100:00100000:1.0:1777051270.423480:0:47388:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da46273480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3678:x1863365452521088:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1777051270.423553:0:47388:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 440354112 pending 0 free 3862671360 avail 3631149056 00000100:00100000:1.0:1777051270.423675:0:47388:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da46273480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3678:x1863365452521088:12345-0@lo:13:osp-pre-0-1.0 Request processed in 202us (852us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051270.423688:0:47388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5541 00000100:00100000:0.0:1777051270.423834:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d944e12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452521088:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1777051271.075623:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051271.075696:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051271.075710:0:6580:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425860224 00000100:00100000:0.0:1777051271.075725:0:6580:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425860224 00000100:00100000:0.0:1777051271.075830:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13138 00000100:00100000:0.0:1777051271.075847:0:6580:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d944e11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+14:2438:x1863365425860224:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:0.0:1777051271.075974:0:6580:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d944e11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+14:2438:x1863365425860224:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 130us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051271.075986:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13138 00000100:00080000:0.0:1777051271.076029:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1777051271.076108:0:24468:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425860480 00000100:00100000:2.0:1777051271.076118:0:24468:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425860480 00000100:00080000:0.0:1777051271.076167:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1777051271.076193:0:24468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10202 00000100:00100000:2.0:1777051271.076209:0:24468:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da57c87450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+50:2438:x1863365425860480:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:2.0:1777051271.076283:0:24468:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da57c87450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+50:2438:x1863365425860480:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 78us (589us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051271.076295:0:24468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10202 00000100:00100000:3.0:1777051271.077071:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051271.077124:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051271.077399:0:6581:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425860736 00000100:00100000:0.0:1777051271.077409:0:6581:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425860736 00000100:00080000:2.0:1777051271.077462:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1777051271.077520:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13139 00000100:00100000:0.0:1777051271.077534:0:6581:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d944e10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+17:2438:x1863365425860736:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:0.0:1777051271.077602:0:6581:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d944e10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+17:2438:x1863365425860736:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 70us (532us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051271.077615:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13139 00000100:00100000:0.0:1777051271.078371:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051271.078419:0:101424:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425860096 00000100:00100000:0.0:1777051271.078423:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051271.078430:0:101424:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425860096 00000100:00100000:0.0:1777051271.078476:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051271.078518:0:101424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 108 00000100:00100000:3.0:1777051271.078534:0:101424:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da48dcdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29c4352d-3260-4734-909d-9ea5de9e7fa4+12:2438:x1863365425860096:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:0.0:1777051271.078554:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051271.078955:0:8470:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425860992 00000100:00100000:2.0:1777051271.078963:0:8470:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425860992 00000100:00100000:2.0:1777051271.079017:0:8470:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425860608 00000100:00100000:2.0:1777051271.079022:0:8470:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425860608 00000100:00100000:2.0:1777051271.079056:0:8470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10203 00000100:00100000:2.0:1777051271.079068:0:8470:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d944e10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+50:2438:x1863365425860992:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:0.0:1777051271.079120:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051271.079393:0:8470:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d944e10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+50:2438:x1863365425860992:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 59us (2001us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051271.079409:0:8470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10203 00000100:00100000:2.0:1777051271.079435:0:8470:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425861120 00000100:00100000:2.0:1777051271.079443:0:8470:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425861120 00000100:00100000:0.0:1777051271.079471:0:27882:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425860352 00000100:00100000:0.0:1777051271.079509:0:27882:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425860352 00000100:00100000:2.0:1777051271.079523:0:8470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10204 00000100:00100000:2.0:1777051271.079535:0:8470:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da46273b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+48:2438:x1863365425860608:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:0.0:1777051271.079573:0:27882:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425860864 00000100:00100000:0.0:1777051271.079581:0:27882:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425860864 00000100:00100000:2.0:1777051271.079589:0:8470:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da46273b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+48:2438:x1863365425860608:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 54us (1113us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051271.079601:0:8470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10204 00000100:00100000:2.0:1777051271.079917:0:8470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10205 00000100:00100000:0.0:1777051271.079924:0:27882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13140 00000100:00100000:2.0:1777051271.079938:0:8470:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da46272300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+47:2438:x1863365425861120:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:0.0:1777051271.079949:0:27882:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da46270a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+6:2438:x1863365425860352:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:2.0:1777051271.079995:0:8470:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da46272300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+47:2438:x1863365425861120:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 60us (877us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051271.080007:0:8470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10205 00000100:00100000:0.0:1777051271.080020:0:27882:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da46270a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+6:2438:x1863365425860352:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 79us (1595us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051271.080032:0:27882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13140 00000100:00080000:2.0:1777051271.080465:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1777051271.080472:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1777051271.080502:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1777051271.082436:0:101424:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da48dcdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29c4352d-3260-4734-909d-9ea5de9e7fa4+12:2438:x1863365425860096:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 3904us (4068us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051271.082446:0:101424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 108 00000100:00100000:3.0:1777051271.082528:0:10328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13141 00000100:00100000:3.0:1777051271.082545:0:10328:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da46273800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+48:2438:x1863365425860864:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:3.0:1777051271.082604:0:10328:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da46273800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+48:2438:x1863365425860864:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 64us (4050us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051271.082617:0:10328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13141 00010000:00010000:0.0:1777051271.254461:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051272.279375:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1777051272.702129:0:102576:0:(class_obd.c:319:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd2b2c4d30 20000000:00000080:3.0:1777051272.702150:0:102576:0:(mgs_handler.c:1163:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff99d942f30c00 uarg=0000000000000000 20000000:01000000:3.0:1777051272.702249:0:102576:0:(mgs_llog.c:6175:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm.default_archive_id=3' 20000000:01000000:3.0:1777051272.702257:0:102576:0:(mgs_llog.c:4637:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm.default_archive_id=3' 20000000:01000000:3.0:1777051272.702263:0:102576:0:(mgs_llog.c:1366:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm.default_archive_id=3 del=0 00000040:00080000:3.0:1777051272.702835:0:102577:0:(llog.c:858:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 37 count 37 20000000:02000000:1.0:1777051272.703251:0:102576:0:(mgs_llog.c:4110:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm.default_archive_id=3 in log params 00000040:00080000:1.0:1777051272.727511:0:102576:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].37, 224 off15312 00000040:00080000:1.0:1777051272.727574:0:102576:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].38, 136 off15448 00000040:00080000:1.0:1777051272.727607:0:102576:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].39, 224 off15672 10000000:01000000:1.0:1777051272.727633:0:102576:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1777051272.727659:0:102576:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99d9442ea600/0x85f51a6b96714a83 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 102576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051272.727687:0:102576:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99d955a99000/0x85f51a6b96714a44 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b96714a3d expref: 22 pid: 101424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051272.727699:0:102576:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99da713e3200/0x85f51a6b96714a52 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b96714a4b expref: 22 pid: 101427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051272.727711:0:102576:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99da713e2e00/0x85f51a6b96714a60 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b96714a59 expref: 22 pid: 101427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051272.727722:0:102576:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99da713e3c00/0x85f51a6b96714a6e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b96714a67 expref: 22 pid: 101424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051272.727737:0:102576:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99da7d785e00/0x85f51a6b96714a75 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5eb6 expref: 11 pid: 101424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051272.727749:0:102576:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99da713e3800/0x85f51a6b96714a7c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5ebd expref: 11 pid: 101424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051272.727761:0:102576:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99d9442ea600/0x85f51a6b96714a83 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 102576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051272.727815:0:102576:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99da713e3800/0x85f51a6b96714a7c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5ebd expref: 11 pid: 101424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051272.727839:0:102576:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99da713e3800/0x85f51a6b96714a7c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5ebd expref: 11 pid: 101424 timeout: 8001 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051272.727864:0:102576:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7d30bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:102576:1863365452521216:192.168.201.46@tcp:104: 00010000:00010000:1.0:1777051272.728018:0:102576:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99da7d785e00/0x85f51a6b96714a75 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5eb6 expref: 11 pid: 101424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051272.728037:0:102576:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99da7d785e00/0x85f51a6b96714a75 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5eb6 expref: 11 pid: 101424 timeout: 8001 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051272.728054:0:102576:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7d308a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:102576:1863365452521344:192.168.201.46@tcp:104: 00010000:00010000:1.0:1777051272.728119:0:102576:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99da713e3c00/0x85f51a6b96714a6e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x85f51a6b96714a67 expref: 22 pid: 101424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051272.728487:0:102576:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99da713e3c00/0x85f51a6b96714a6e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x85f51a6b96714a67 expref: 22 pid: 101424 timeout: 8001 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051272.728507:0:102576:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7d309c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:102576:1863365452521472:0@lo:104: 00000100:00100000:1.0:1777051272.728576:0:102576:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1777051272.728647:0:102576:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99da713e2e00/0x85f51a6b96714a60 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x85f51a6b96714a59 expref: 22 pid: 101427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051272.728657:0:102576:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99da713e2e00/0x85f51a6b96714a60 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x85f51a6b96714a59 expref: 22 pid: 101427 timeout: 8001 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051272.728666:0:102576:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7d30ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:102576:1863365452521600:0@lo:104: 00010000:00010000:1.0:1777051272.728694:0:102576:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99da713e3200/0x85f51a6b96714a52 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x85f51a6b96714a4b expref: 22 pid: 101427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051272.728702:0:102576:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99da713e3200/0x85f51a6b96714a52 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x85f51a6b96714a4b expref: 22 pid: 101427 timeout: 8001 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051272.728710:0:102576:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7d308380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:102576:1863365452521728:0@lo:104: 00010000:00010000:1.0:1777051272.728727:0:102576:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99d955a99000/0x85f51a6b96714a44 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x85f51a6b96714a3d expref: 22 pid: 101424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051272.728734:0:102576:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99d955a99000/0x85f51a6b96714a44 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x85f51a6b96714a3d expref: 22 pid: 101424 timeout: 8001 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051272.728746:0:102576:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7d309880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:102576:1863365452521856:0@lo:104: 00000100:00100000:1.0:1777051272.728771:0:102576:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d959876180 going to sleep for 11 seconds 00000100:00100000:3.0:1777051272.728879:0:6562:0:(service.c:153:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1777051272.728915:0:6562:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051272.728966:0:6562:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051272.728998:0:6562:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051272.729023:0:6562:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452521472 00000100:00100000:3.0:1777051272.729036:0:6562:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452521472 00000100:00100000:3.0:1777051272.729406:0:6562:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452521600 00000100:00100000:3.0:1777051272.729415:0:6562:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452521600 00000100:00100000:3.0:1777051272.729431:0:6562:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452521728 00000100:00100000:3.0:1777051272.729435:0:6562:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452521728 00000100:00100000:3.0:1777051272.729482:0:6562:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452521856 00000100:00100000:3.0:1777051272.729487:0:6562:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452521856 00000100:00100000:3.0:1777051272.729519:0:6562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1777051272.729533:0:6562:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f2af050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f9351a01-5b0e-4470-97fd-58b9b4b312a2+6:102576:x1863365452521472:12345-0@lo:104: 00010000:00010000:3.0:1777051272.729556:0:6562:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.146@tcp lock: ffff99d955a99a00/0x85f51a6b96714a67 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x85f51a6b96714a6e expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051272.729662:0:99220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1777051272.729680:0:99220:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d944e11500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:f9351a01-5b0e-4470-97fd-58b9b4b312a2+6:102576:x1863365452521600:12345-0@lo:104: 00010000:00010000:0.0:1777051272.729694:0:99220:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.146@tcp lock: ffff99d955a98c00/0x85f51a6b96714a59 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x85f51a6b96714a60 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051272.729774:0:99220:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1777051272.729782:0:99220:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d944e11500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:f9351a01-5b0e-4470-97fd-58b9b4b312a2+6:102576:x1863365452521600:12345-0@lo:104: Request processed in 109us (869us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051272.729794:0:99220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1777051272.729824:0:99220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1777051272.729835:0:99220:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d944e11180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:f9351a01-5b0e-4470-97fd-58b9b4b312a2+5:102576:x1863365452521728:12345-0@lo:104: 00010000:00010000:0.0:1777051272.729846:0:99220:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.146@tcp lock: ffff99d9442eb000/0x85f51a6b96714a4b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x85f51a6b96714a52 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051272.729909:0:99220:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1777051272.729920:0:99220:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d944e11180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:f9351a01-5b0e-4470-97fd-58b9b4b312a2+5:102576:x1863365452521728:12345-0@lo:104: Request processed in 87us (953us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051272.729932:0:99220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1777051272.729960:0:99220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1777051272.729972:0:99220:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d944e11880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:f9351a01-5b0e-4470-97fd-58b9b4b312a2+4:102576:x1863365452521856:12345-0@lo:104: 00010000:00010000:0.0:1777051272.729986:0:99220:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.146@tcp lock: ffff99d9442ea800/0x85f51a6b96714a3d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x85f51a6b96714a44 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051272.730009:0:6562:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1777051272.730023:0:6562:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f2af050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f9351a01-5b0e-4470-97fd-58b9b4b312a2+4:102576:x1863365452521472:12345-0@lo:104: Request processed in 490us (1447us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051272.730039:0:6562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00010000:00010000:0.0:1777051272.730065:0:99220:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1777051272.730076:0:99220:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d944e11880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:f9351a01-5b0e-4470-97fd-58b9b4b312a2+3:102576:x1863365452521856:12345-0@lo:104: Request processed in 106us (1075us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051272.730089:0:99220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00010000:00010000:3.0:1777051272.730119:0:38719:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1777051272.730392:0:38719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.146@tcp lock: ffff99d955a98c00/0x85f51a6b96714a59 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x85f51a6b96714a60 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051272.730407:0:38719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d955a98c00 already unused, calling callback (ffffffffc1208c20) 10000000:00010000:3.0:1777051272.730414:0:38719:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.146@tcp lock: ffff99d955a98c00/0x85f51a6b96714a59 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x85f51a6b96714a60 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051272.730427:0:6568:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1777051272.730429:0:38719:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.146@tcp lock: ffff99d955a98c00/0x85f51a6b96714a59 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x85f51a6b96714a60 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051272.730440:0:6568:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.146@tcp lock: ffff99d9442eb000/0x85f51a6b96714a4b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x85f51a6b96714a52 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1777051272.730449:0:38719:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.146@tcp lock: ffff99d955a98c00/0x85f51a6b96714a59 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x85f51a6b96714a60 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051272.730487:0:6568:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d9442eb000 already unused, calling callback (ffffffffc1208c20) 10000000:00010000:0.0:1777051272.730494:0:6568:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.146@tcp lock: ffff99d9442eb000/0x85f51a6b96714a4b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x85f51a6b96714a52 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051272.730514:0:6568:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.146@tcp lock: ffff99d9442eb000/0x85f51a6b96714a4b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x85f51a6b96714a52 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1777051272.730543:0:38719:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:00010000:0.0:1777051272.730548:0:6568:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.146@tcp lock: ffff99d9442eb000/0x85f51a6b96714a4b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x85f51a6b96714a52 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1777051272.730559:0:6568:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1777051272.730590:0:38719:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.146@tcp lock: ffff99d955a98c00/0x85f51a6b96714a59 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x85f51a6b96714a60 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051272.730599:0:6568:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.146@tcp lock: ffff99d9442eb000/0x85f51a6b96714a4b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x85f51a6b96714a52 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051272.730608:0:38719:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1777051272.730620:0:6568:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1777051272.730918:0:6568:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.146@tcp lock: ffff99d9442eb000/0x85f51a6b96714a4b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x85f51a6b96714a52 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051272.730918:0:38719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.146@tcp lock: ffff99d955a98c00/0x85f51a6b96714a59 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x85f51a6b96714a60 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051272.730958:0:6568:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.146@tcp lock: ffff99d9442eb000/0x85f51a6b96714a4b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x85f51a6b96714a52 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051272.730960:0:38719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.146@tcp lock: ffff99d955a98c00/0x85f51a6b96714a59 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x85f51a6b96714a60 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051272.731014:0:6568:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1777051272.731022:0:38719:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1777051272.731023:0:6568:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.146@tcp lock: ffff99d955a99a00/0x85f51a6b96714a67 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x85f51a6b96714a6e expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051272.731041:0:38719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.146@tcp lock: ffff99d9442ea800/0x85f51a6b96714a3d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x85f51a6b96714a44 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051272.731042:0:6568:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d955a99a00 already unused, calling callback (ffffffffc1208c20) 10000000:00010000:0.0:1777051272.731052:0:6568:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.146@tcp lock: ffff99d955a99a00/0x85f51a6b96714a67 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x85f51a6b96714a6e expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051272.731381:0:102576:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7d309c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:102576:1863365452521472:0@lo:104: 00000100:00100000:1.0:1777051272.731402:0:102576:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7d30ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:102576:1863365452521600:0@lo:104: 00010000:00010000:3.0:1777051272.731410:0:38719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d9442ea800 already unused, calling callback (ffffffffc1208c20) 10000000:00010000:3.0:1777051272.731417:0:38719:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.146@tcp lock: ffff99d9442ea800/0x85f51a6b96714a3d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x85f51a6b96714a44 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051272.731419:0:102576:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7d308380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:102576:1863365452521728:0@lo:104: 00000100:00100000:1.0:1777051272.731444:0:102576:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7d309880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:102576:1863365452521856:0@lo:104: 00010000:00010000:1.0:1777051272.731512:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1777051272.731538:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da46271880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3680:1863365452522112:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1777051272.731601:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051272.731655:0:3680:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1777051272.731666:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d944e12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3680:1863365452521984:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1777051272.731705:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1777051272.731764:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1777051272.731768:0:6564:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452522112 00000100:00100000:1.0:1777051272.731777:0:6564:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452522112 00010000:00010000:1.0:1777051272.731811:0:6564:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99da713e3200/0x85f51a6b96714a52 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x85f51a6b96714a4b expref: 23 pid: 101427 timeout: 8001 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051272.731849:0:6564:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452521984 00000100:00100000:1.0:1777051272.731856:0:6564:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452521984 00010000:00010000:1.0:1777051272.731875:0:6564:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99da713e2e00/0x85f51a6b96714a60 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x85f51a6b96714a59 expref: 24 pid: 101427 timeout: 8001 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051272.731900:0:6566:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3822 00000100:00100000:1.0:1777051272.731919:0:6564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3823 00000100:00100000:2.0:1777051272.731924:0:6566:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95a580000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f9351a01-5b0e-4470-97fd-58b9b4b312a2+24:3680:x1863365452522112:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1777051272.731937:0:6564:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95a583800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f9351a01-5b0e-4470-97fd-58b9b4b312a2+24:3680:x1863365452521984:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1777051272.731946:0:6566:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1777051272.731955:0:6564:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777051272.731958:0:6566:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99da713e3200/0x85f51a6b96714a52 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x85f51a6b96714a4b expref: 24 pid: 101427 timeout: 8001 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051272.731966:0:6564:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99da713e2e00/0x85f51a6b96714a60 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x85f51a6b96714a59 expref: 24 pid: 101427 timeout: 8001 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051272.731993:0:6566:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99da713e3200/0x85f51a6b96714a52 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x85f51a6b96714a4b expref: 24 pid: 101427 timeout: 8001 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051272.732029:0:6568:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.146@tcp lock: ffff99d955a99a00/0x85f51a6b96714a67 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x85f51a6b96714a6e expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051272.732030:0:38719:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.146@tcp lock: ffff99d9442ea800/0x85f51a6b96714a3d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x85f51a6b96714a44 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1777051272.732054:0:38719:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.146@tcp lock: ffff99d9442ea800/0x85f51a6b96714a3d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x85f51a6b96714a44 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1777051272.732073:0:6568:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.146@tcp lock: ffff99d955a99a00/0x85f51a6b96714a67 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x85f51a6b96714a6e expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1777051272.732075:0:38719:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1777051272.732111:0:38719:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.146@tcp lock: ffff99d9442ea800/0x85f51a6b96714a3d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x85f51a6b96714a44 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051272.732131:0:38719:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1777051272.732158:0:38719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.146@tcp lock: ffff99d9442ea800/0x85f51a6b96714a3d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x85f51a6b96714a44 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051272.732170:0:38719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.146@tcp lock: ffff99d9442ea800/0x85f51a6b96714a3d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x85f51a6b96714a44 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051272.732188:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051272.732192:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051272.732195:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1777051272.732369:0:6568:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1777051272.732402:0:6568:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.146@tcp lock: ffff99d955a99a00/0x85f51a6b96714a67 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x85f51a6b96714a6e expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051272.732413:0:6568:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1777051272.732427:0:6568:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.146@tcp lock: ffff99d955a99a00/0x85f51a6b96714a67 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x85f51a6b96714a6e expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051272.732447:0:6568:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.146@tcp lock: ffff99d955a99a00/0x85f51a6b96714a67 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x85f51a6b96714a6e expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051272.732497:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777051272.732501:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777051272.732506:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1777051272.732525:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da46270380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3678:1863365452522368:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1777051272.732571:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051272.732581:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051272.732625:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7fd65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3677:1863365452522240:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1777051272.732661:0:47827:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425861248 00000100:00100000:0.0:1777051272.732667:0:47827:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425861248 00000100:00100000:3.0:1777051272.732684:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1777051272.732695:0:47827:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99da713e3800/0x85f51a6b96714a7c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5ebd expref: 12 pid: 101424 timeout: 8001 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051272.732741:0:47827:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452522368 00000100:00100000:0.0:1777051272.732747:0:47827:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452522368 00000100:00100000:3.0:1777051272.732759:0:9550:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452522240 00000100:00100000:3.0:1777051272.732769:0:9550:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452522240 00010000:00010000:0.0:1777051272.732774:0:47827:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99da713e3c00/0x85f51a6b96714a6e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x85f51a6b96714a67 expref: 25 pid: 101424 timeout: 8001 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051272.732803:0:9550:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99d955a99000/0x85f51a6b96714a44 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x85f51a6b96714a3d expref: 26 pid: 101424 timeout: 8001 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051272.732812:0:47827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3824 00000100:00100000:0.0:1777051272.732838:0:47827:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da6fd45450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:29c4352d-3260-4734-909d-9ea5de9e7fa4+12:2437:x1863365425861248:12345-192.168.201.46@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1777051272.732852:0:9550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3825 00010000:00010000:0.0:1777051272.732865:0:47827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1777051272.732873:0:9550:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da46272a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f9351a01-5b0e-4470-97fd-58b9b4b312a2+26:3678:x1863365452522368:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1777051272.732881:0:47827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99da713e3800/0x85f51a6b96714a7c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5ebd expref: 12 pid: 101424 timeout: 8001 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051272.732892:0:9550:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777051272.732902:0:9550:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99da713e3c00/0x85f51a6b96714a6e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x85f51a6b96714a67 expref: 26 pid: 101424 timeout: 8001 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051272.733143:0:6564:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99da713e2e00/0x85f51a6b96714a60 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x85f51a6b96714a59 expref: 26 pid: 101427 timeout: 8001 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051272.733178:0:6566:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99da713e3200/0x85f51a6b96714a52 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x85f51a6b96714a4b expref: 26 pid: 101427 timeout: 8001 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051272.733188:0:6564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99da713e2e00/0x85f51a6b96714a60 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x85f51a6b96714a59 expref: 26 pid: 101427 timeout: 8001 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051272.733218:0:6564:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1777051272.733243:0:6566:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1777051272.733278:0:6564:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95a583800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f9351a01-5b0e-4470-97fd-58b9b4b312a2+24:3680:x1863365452521984:12345-0@lo:103:ldlm_bl.0 Request processed in 1346us (1570us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051272.733293:0:6564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3823 00000100:00100000:2.0:1777051272.733318:0:6566:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95a580000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f9351a01-5b0e-4470-97fd-58b9b4b312a2+23:3680:x1863365452522112:12345-0@lo:103:ldlm_bl.0 Request processed in 1400us (1715us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051272.733332:0:6566:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3822 00000100:00100000:2.0:1777051272.733357:0:6566:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3826 00000100:00100000:2.0:1777051272.733370:0:6566:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fd67800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f9351a01-5b0e-4470-97fd-58b9b4b312a2+22:3677:x1863365452522240:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1777051272.733378:0:6566:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777051272.733385:0:6566:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99d955a99000/0x85f51a6b96714a44 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x85f51a6b96714a3d expref: 22 pid: 101424 timeout: 8001 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051272.733399:0:6566:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99d955a99000/0x85f51a6b96714a44 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x85f51a6b96714a3d expref: 22 pid: 101424 timeout: 8001 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051272.733419:0:6566:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d955a99000/0x85f51a6b96714a44 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x85f51a6b96714a3d expref: 22 pid: 101424 timeout: 8001 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051272.733429:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d944e12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3680:1863365452521984:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1777051272.733488:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da46271880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3680:1863365452522112:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1777051272.733488:0:6566:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1777051272.733550:0:6566:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fd67800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f9351a01-5b0e-4470-97fd-58b9b4b312a2+21:3677:x1863365452522240:12345-0@lo:103:ldlm_bl.0 Request processed in 181us (863us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051272.733563:0:102576:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7d30bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:102576:1863365452521216:192.168.201.46@tcp:104: 00000100:00100000:2.0:1777051272.733569:0:6566:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3826 00010000:00010000:0.0:1777051272.733658:0:47827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99da713e3800/0x85f51a6b96714a7c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5ebd expref: 12 pid: 101424 timeout: 8001 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051272.733682:0:9550:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99da713e3c00/0x85f51a6b96714a6e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x85f51a6b96714a67 expref: 20 pid: 101424 timeout: 8001 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051272.733753:0:102576:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7d308a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:102576:1863365452521344:192.168.201.46@tcp:104: 00000100:00100000:2.0:1777051272.733784:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051272.733824:0:6564:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425861376 00000100:00100000:2.0:1777051272.733831:0:6564:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425861376 00010000:00010000:2.0:1777051272.733858:0:6564:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99da7d785e00/0x85f51a6b96714a75 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5eb6 expref: 13 pid: 101424 timeout: 8001 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051272.733894:0:6564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3827 00000100:00100000:2.0:1777051272.733906:0:6564:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f824000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:29c4352d-3260-4734-909d-9ea5de9e7fa4+13:2437:x1863365425861376:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1777051272.733922:0:6564:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777051272.733930:0:6564:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99da7d785e00/0x85f51a6b96714a75 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5eb6 expref: 13 pid: 101424 timeout: 8001 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051272.734546:0:47827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99da713e3800/0x85f51a6b96714a7c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5ebd expref: 13 pid: 101424 timeout: 8001 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051272.734558:0:9550:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99da713e3c00/0x85f51a6b96714a6e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x85f51a6b96714a67 expref: 20 pid: 101424 timeout: 8001 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051272.734568:0:47827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1777051272.734594:0:9550:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1777051272.734928:0:47827:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da6fd45450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:29c4352d-3260-4734-909d-9ea5de9e7fa4+12:2437:x1863365425861248:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 1793us (2055us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051272.734943:0:47827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3824 00000100:00100000:3.0:1777051272.734972:0:9550:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da46272a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f9351a01-5b0e-4470-97fd-58b9b4b312a2+19:3678:x1863365452522368:12345-0@lo:103:ldlm_bl.0 Request processed in 2104us (2393us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051272.734988:0:9550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3825 00000100:00100000:3.0:1777051272.735081:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da46270380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3678:1863365452522368:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1777051272.735130:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7fd65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3677:1863365452522240:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1777051272.735328:0:102576:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99d9442ea600/0x85f51a6b96714a83 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 102576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051272.735330:0:6564:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99da7d785e00/0x85f51a6b96714a75 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5eb6 expref: 11 pid: 101424 timeout: 8001 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051272.735366:0:6564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99da7d785e00/0x85f51a6b96714a75 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5eb6 expref: 11 pid: 101424 timeout: 8001 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051272.735387:0:6564:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99d9442ea600/0x85f51a6b96714a83 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 102576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051272.735405:0:6564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d9442ea600/0x85f51a6b96714a83 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 102576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051272.735424:0:6564:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99d9442ea600/0x85f51a6b96714a83 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 102576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051272.735440:0:6564:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99d9442ea600/0x85f51a6b96714a83 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 102576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051272.735477:0:6564:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99d9442ea600/0x85f51a6b96714a83 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 102576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051272.735489:0:6564:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99d9442ea600/0x85f51a6b96714a83 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 102576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051272.735497:0:6564:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d9442ea600 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:2.0:1777051272.735503:0:6564:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99d9442ea600/0x85f51a6b96714a83 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 102576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051272.735514:0:6564:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99d9442ea600/0x85f51a6b96714a83 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 102576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051272.735536:0:6564:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99d9442ea600/0x85f51a6b96714a83 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 102576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051272.735552:0:102576:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99d9442ea600/0x85f51a6b96714a83 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 102576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051272.735553:0:6564:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1777051272.735575:0:102576:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99d9442ea600/0x85f51a6b96714a83 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 102576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051272.735588:0:102576:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d9442ea600/0x85f51a6b96714a83 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 102576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051272.735616:0:6564:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f824000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:29c4352d-3260-4734-909d-9ea5de9e7fa4+10:2437:x1863365425861376:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 1708us (1835us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051272.735631:0:6564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3827 00010000:00010000:1.0:1777051273.304035:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1777051273.505858:0:102625:0:(class_obd.c:319:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe6f4c33f0 20000000:00000080:1.0:1777051273.505876:0:102625:0:(mgs_handler.c:1163:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff99da5f324c00 uarg=0000000000000000 20000000:01000000:1.0:1777051273.505926:0:102625:0:(mgs_llog.c:6175:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0001.hsm.default_archive_id=3' 20000000:01000000:1.0:1777051273.505934:0:102625:0:(mgs_llog.c:4637:mgs_write_log_param2()) next param 'mdt.lustre-MDT0001.hsm.default_archive_id=3' 20000000:01000000:1.0:1777051273.505940:0:102625:0:(mgs_llog.c:1366:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0001.hsm.default_archive_id=3 del=0 00000040:00080000:3.0:1777051273.507023:0:102626:0:(llog.c:858:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 40 count 40 20000000:02000000:1.0:1777051273.507142:0:102625:0:(mgs_llog.c:4110:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0001.hsm.default_archive_id=3 in log params 00000040:00080000:1.0:1777051273.507228:0:102625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].40, 224 off15896 00000040:00080000:1.0:1777051273.507268:0:102625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].41, 136 off16032 00000040:00080000:1.0:1777051273.507292:0:102625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].42, 224 off16256 10000000:01000000:1.0:1777051273.507306:0:102625:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1777051273.507336:0:102625:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99d9442eba00/0x85f51a6b96714a8a lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 102625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051273.507356:0:102625:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d9442eba00/0x85f51a6b96714a8a lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 102625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051273.507368:0:102625:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99d9442eba00/0x85f51a6b96714a8a lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 102625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051273.507378:0:102625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99d9442eba00/0x85f51a6b96714a8a lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 102625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051273.507388:0:102625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99d9442eba00/0x85f51a6b96714a8a lrc: 3/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 102625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051273.507397:0:102625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99d9442eba00/0x85f51a6b96714a8a lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 102625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051273.507406:0:102625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d9442eba00 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:1.0:1777051273.507477:0:102625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99d9442eba00/0x85f51a6b96714a8a lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 102625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051273.507490:0:102625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99d9442eba00/0x85f51a6b96714a8a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 102625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051273.507506:0:102625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99d9442eba00/0x85f51a6b96714a8a lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 102625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051273.507517:0:102625:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99d9442eba00/0x85f51a6b96714a8a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 102625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051273.507526:0:102625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d9442eba00/0x85f51a6b96714a8a lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 102625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051274.007534:0:3680:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1777051274.007560:0:3679:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1777051274.007603:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f827100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3679:1863365452522624:0@lo:400:kworker.0 00000100:00100000:1.0:1777051274.007603:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f826d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3680:1863365452522496:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1777051274.007750:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051274.007757:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051274.008067:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f827480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452522752:0@lo:400:kworker.0 00000100:00100000:0.0:1777051274.008070:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f824a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3679:1863365452523008:0@lo:400:kworker.0 00000100:00100000:1.0:1777051274.008114:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f827b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3680:1863365452523136:0@lo:400:kworker.0 00000100:00100000:2.0:1777051274.008173:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051274.008181:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051274.008221:0:101427:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452522624 00000100:00100000:2.0:1777051274.008222:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f827800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3677:1863365452523264:0@lo:400:kworker.0 00000100:00100000:1.0:1777051274.008235:0:101427:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452522624 00000100:00100000:0.0:1777051274.008293:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f825880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3679:1863365452523520:0@lo:400:kworker.0 00000100:00100000:2.0:1777051274.008293:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051274.008328:0:101427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1777051274.008350:0:101427:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7d9cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f9351a01-5b0e-4470-97fd-58b9b4b312a2+19:3679:x1863365452522624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777051274.008353:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f825500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452523776:0@lo:400:kworker.0 00000100:00100000:0.0:1777051274.008372:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051274.008429:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f824700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452524032:0@lo:400:kworker.0 00000100:00100000:2.0:1777051274.008569:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051274.008610:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051274.008617:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f825c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3677:1863365452524288:0@lo:400:kworker.0 00000100:00100000:2.0:1777051274.008683:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051274.008706:0:6580:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452523008 00000100:00100000:0.0:1777051274.008715:0:6580:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452523008 00000100:00100000:2.0:1777051274.008736:0:3677:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1777051274.008754:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7fd65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3677:1863365452522880:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1777051274.008780:0:6580:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452523264 00000100:00100000:0.0:1777051274.008787:0:6580:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452523264 00000100:00100000:1.0:1777051274.008818:0:101427:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7d9cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f9351a01-5b0e-4470-97fd-58b9b4b312a2+19:3679:x1863365452522624:12345-0@lo:400:kworker.0 Request processed in 472us (1075us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051274.008836:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051274.008845:0:101427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1777051274.008846:0:6580:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452523520 00000100:00100000:0.0:1777051274.008855:0:6580:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452523520 00000100:00100000:2.0:1777051274.008898:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f826300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452523392:0@lo:400:kworker.0 00000100:00100000:0.0:1777051274.008910:0:6580:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452524288 00000100:00100000:0.0:1777051274.008918:0:6580:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452524288 00000100:00100000:1.0:1777051274.008932:0:46500:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452522496 00000100:00100000:1.0:1777051274.008943:0:46500:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452522496 00000100:00100000:2.0:1777051274.008959:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051274.008984:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13142 00000100:00100000:0.0:1777051274.009006:0:6580:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da46271500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3679:x1863365452523008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777051274.009010:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f826680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3677:1863365452523904:0@lo:400:kworker.0 00000100:00100000:1.0:1777051274.009039:0:46500:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452522752 00000100:00100000:1.0:1777051274.009054:0:46500:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452522752 00000100:00100000:2.0:1777051274.009075:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051274.009108:0:6580:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da46271500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3679:x1863365452523008:12345-0@lo:400:kworker.0 Request processed in 108us (936us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051274.009124:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13142 00000100:00100000:0.0:1777051274.009156:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13143 00000100:00100000:0.0:1777051274.009495:0:6580:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f298a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3677:x1863365452523264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777051274.009514:0:46500:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452522880 00000100:00100000:1.0:1777051274.009525:0:46500:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452522880 00000100:00100000:2.0:1777051274.009544:0:11727:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452523904 00000100:00100000:2.0:1777051274.009556:0:11727:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452523904 00000100:00100000:0.0:1777051274.009585:0:6580:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f298a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3677:x1863365452523264:12345-0@lo:400:kworker.0 Request processed in 98us (1295us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051274.009598:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13143 00000100:00100000:1.0:1777051274.009620:0:46500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8001 00000100:00100000:2.0:1777051274.009632:0:11727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8002 00000100:00100000:1.0:1777051274.009644:0:46500:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95a581f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+8:3680:x1863365452522496:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1777051274.009645:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13144 00000100:00100000:2.0:1777051274.009662:0:11727:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f824380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:3677:x1863365452522752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777051274.009673:0:6580:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da46272680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3679:x1863365452523520:12345-0@lo:400:kworker.0 00000004:00000024:1.0:1777051274.009700:0:46500:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4194304 pending 0 free 1441603584 avail 1295364096 00000100:00100000:2.0:1777051274.010090:0:11727:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f824380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:3677:x1863365452522752:12345-0@lo:400:kworker.0 Request processed in 435us (1921us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051274.010106:0:11727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8002 00000100:00100000:0.0:1777051274.010115:0:6580:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da46272680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3679:x1863365452523520:12345-0@lo:400:kworker.0 Request processed in 446us (1740us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051274.010121:0:46500:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95a581f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+8:3680:x1863365452522496:12345-0@lo:41:osp-pre-0-1.0 Request processed in 482us (2371us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051274.010144:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13144 00000100:00100000:1.0:1777051274.010149:0:46500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8001 00000100:00100000:2.0:1777051274.010161:0:11727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8003 00000100:00100000:2.0:1777051274.010180:0:11727:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955ebdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3677:x1863365452522880:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1777051274.010247:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13145 00000100:00100000:1.0:1777051274.010257:0:46500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8004 00000004:00000024:2.0:1777051274.010263:0:11727:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4243456 pending 0 free 1446064128 avail 1299824640 00000100:00100000:0.0:1777051274.010276:0:6580:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f298000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3677:x1863365452524288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777051274.010285:0:46500:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+6:3677:x1863365452523904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777051274.010342:0:11727:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955ebdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3677:x1863365452522880:12345-0@lo:41:osp-pre-1-0.0 Request processed in 165us (1514us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051274.010356:0:11727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8003 00000100:00100000:0.0:1777051274.010390:0:6580:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f298000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3677:x1863365452524288:12345-0@lo:400:kworker.0 Request processed in 122us (1706us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051274.010400:0:46500:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+5:3677:x1863365452523904:12345-0@lo:400:kworker.0 Request processed in 124us (1320us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051274.010411:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13145 00000100:00100000:1.0:1777051274.010417:0:46500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8004 00000100:00100000:2.0:1777051274.010418:0:8468:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452523776 00000100:00100000:2.0:1777051274.010428:0:8468:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452523776 00000100:00100000:0.0:1777051274.010502:0:24468:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452524032 00000100:00100000:0.0:1777051274.010513:0:24468:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452524032 00000100:00100000:2.0:1777051274.010526:0:8468:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452523392 00000100:00100000:2.0:1777051274.010536:0:8468:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452523392 00000100:00100000:1.0:1777051274.010540:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051274.010590:0:24468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10206 00000100:00100000:1.0:1777051274.010602:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f825180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3680:1863365452523648:0@lo:400:kworker.0 00000100:00100000:0.0:1777051274.010613:0:24468:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f299880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3677:x1863365452523776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777051274.010617:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10207 00000100:00100000:2.0:1777051274.010644:0:8468:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da46271c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3679:x1863365452524032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777051274.010662:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051274.010719:0:24468:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f299880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3677:x1863365452523776:12345-0@lo:400:kworker.0 Request processed in 114us (2148us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051274.010732:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f826a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3680:1863365452524160:0@lo:400:kworker.0 00000100:00100000:0.0:1777051274.010740:0:24468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10206 00000100:00100000:2.0:1777051274.010752:0:8468:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da46271c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3679:x1863365452524032:12345-0@lo:400:kworker.0 Request processed in 111us (2140us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051274.010769:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10207 00000100:00100000:0.0:1777051274.010788:0:24468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10208 00000100:00100000:1.0:1777051274.010805:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051274.010811:0:24468:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955ebf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3677:x1863365452523392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777051274.010841:0:27884:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452524160 00000100:00100000:2.0:1777051274.010851:0:27884:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452524160 00000100:00100000:0.0:1777051274.010900:0:24468:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955ebf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3677:x1863365452523392:12345-0@lo:400:kworker.0 Request processed in 97us (1941us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051274.010909:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f826d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3680:1863365452522496:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1777051274.010921:0:24468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10208 00000100:00100000:2.0:1777051274.010934:0:27884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10209 00000100:00100000:2.0:1777051274.010954:0:27884:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95a580000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3680:x1863365452524160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777051274.010978:0:46497:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452523136 00000100:00100000:0.0:1777051274.010987:0:46497:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452523136 00000100:00100000:1.0:1777051274.011015:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f824a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3679:1863365452523008:0@lo:400:kworker.0 00000100:00100000:2.0:1777051274.011042:0:27884:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95a580000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3680:x1863365452524160:12345-0@lo:400:kworker.0 Request processed in 91us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051274.011052:0:46497:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452523648 00000100:00100000:1.0:1777051274.011054:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f825880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3679:1863365452523520:0@lo:400:kworker.0 00000100:00100000:0.0:1777051274.011060:0:46497:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452523648 00000100:00100000:2.0:1777051274.011064:0:27884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10209 00000100:00100000:1.0:1777051274.011103:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f824700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452524032:0@lo:400:kworker.0 00000100:00100000:0.0:1777051274.011126:0:46497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13146 00000100:00100000:1.0:1777051274.011137:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f827100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3679:1863365452522624:0@lo:400:kworker.0 00000100:00100000:0.0:1777051274.011146:0:46497:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95a582680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:lustre-MDT0000-lwp-OST0000_UUID+5:3680:x1863365452523136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777051274.011250:0:27882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13147 00000100:00100000:1.0:1777051274.011282:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f826a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3680:1863365452524160:0@lo:400:kworker.0 00000100:00100000:2.0:1777051274.011282:0:27882:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95a583800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0001_UUID+5:3680:x1863365452523648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777051274.011283:0:46497:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95a582680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:lustre-MDT0000-lwp-OST0000_UUID+5:3680:x1863365452523136:12345-0@lo:400:kworker.0 Request processed in 133us (735us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051274.011313:0:46497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13146 00000100:00100000:1.0:1777051274.011340:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f827b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3680:1863365452523136:0@lo:400:kworker.0 00000100:00100000:1.0:1777051274.011380:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f825180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3680:1863365452523648:0@lo:400:kworker.0 00000100:00100000:2.0:1777051274.011380:0:27882:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95a583800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0001_UUID+5:3680:x1863365452523648:12345-0@lo:400:kworker.0 Request processed in 109us (717us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051274.011405:0:27882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13147 00000100:00080000:0.0:1777051274.011457:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1777051274.011467:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1777051274.011473:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1777051274.011478:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1777051274.011550:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7fd65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3677:1863365452522880:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1777051274.011571:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f826300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452523392:0@lo:400:kworker.0 00000100:00100000:0.0:1777051274.011584:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f826680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3677:1863365452523904:0@lo:400:kworker.0 00000100:00100000:0.0:1777051274.011599:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f827480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452522752:0@lo:400:kworker.0 00000100:00100000:0.0:1777051274.011613:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f827800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3677:1863365452523264:0@lo:400:kworker.0 00000100:00100000:0.0:1777051274.011627:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f825500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452523776:0@lo:400:kworker.0 00000100:00100000:0.0:1777051274.011642:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f825c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3677:1863365452524288:0@lo:400:kworker.0 10000000:01000000:2.0:1777051274.074992:0:6577:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1777051274.075001:0:6577:0:(mgc_request.c:1799:mgc_process_log()) Process log params-ffff99da44f8b000 from 37 10000000:01000000:2.0:1777051274.078485:0:6577:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1777051274.078547:0:6577:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.146@tcp lock: ffff99d955a98800/0x85f51a6b96714a91 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051274.078567:0:6577:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.146@tcp lock: ffff99d955a98800/0x85f51a6b96714a91 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051274.078587:0:6577:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.146@tcp lock: ffff99d955a98800/0x85f51a6b96714a91 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051274.078628:0:6577:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f9fd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452524416:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1777051274.079005:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051274.079088:0:6577:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d944917cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1777051274.079148:0:101422:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452524416 00000100:00100000:0.0:1777051274.079163:0:101422:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452524416 00000100:00100000:0.0:1777051274.079292:0:101422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1777051274.079312:0:101422:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7d9cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9351a01-5b0e-4470-97fd-58b9b4b312a2+19:6577:x1863365452524416:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1777051274.079334:0:101422:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051274.079362:0:101422:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99da713e2000/0x85f51a6b96714a98 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x85f51a6b96714a91 expref: -99 pid: 101422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051274.079403:0:101422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99da713e2000/0x85f51a6b96714a98 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x85f51a6b96714a91 expref: 20 pid: 101422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051274.079426:0:101422:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99da713e2000/0x85f51a6b96714a98 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b96714a91 expref: 20 pid: 101422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051274.079472:0:101422:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99da713e2000, rc 0) 00000100:00100000:0.0:1777051274.079564:0:101422:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7d9cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9351a01-5b0e-4470-97fd-58b9b4b312a2+20:6577:x1863365452524416:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 255us (843us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051274.079580:0:101422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1777051274.079665:0:6577:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f9fd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452524416:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1777051274.079694:0:6577:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.146@tcp lock: ffff99d955a98800/0x85f51a6b96714a91 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b96714a98 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051274.079710:0:6577:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.146@tcp lock: ffff99d955a98800/0x85f51a6b96714a91 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x85f51a6b96714a98 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051274.080497:0:6577:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f825c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452524544:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1777051274.080556:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051274.080958:0:6577:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d959876540 going to sleep for 11 seconds 00000100:00100000:3.0:1777051274.081046:0:101424:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452524544 00000100:00100000:3.0:1777051274.081056:0:101424:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452524544 00000100:00100000:3.0:1777051274.081204:0:101424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1777051274.081225:0:101424:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7d9ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9351a01-5b0e-4470-97fd-58b9b4b312a2+20:6577:x1863365452524544:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1777051274.081428:0:101424:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7d9ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9351a01-5b0e-4470-97fd-58b9b4b312a2+20:6577:x1863365452524544:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 209us (870us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051274.081470:0:101424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1777051274.081621:0:6577:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f825c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452524544:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1777051274.082024:0:6577:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f825c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452524672:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1777051274.082103:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051274.082477:0:101425:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452524672 00000100:00100000:1.0:1777051274.082486:0:101425:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452524672 00000100:00100000:1.0:1777051274.082553:0:101425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1777051274.082573:0:101425:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7d9cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9351a01-5b0e-4470-97fd-58b9b4b312a2+20:6577:x1863365452524672:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1777051274.082588:0:6577:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d959876540 going to sleep for 11 seconds 00000100:00100000:0.0:1777051274.083145:0:101425:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7d9cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9351a01-5b0e-4470-97fd-58b9b4b312a2+20:6577:x1863365452524672:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 577us (1039us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051274.083162:0:101425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1777051274.083223:0:6577:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f825c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452524672:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1777051274.084306:0:102648:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f825c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f9351a01-5b0e-4470-97fd-58b9b4b312a2:102648:1863365452524800:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1777051274.084377:0:102648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051274.084519:0:102648:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d9598763c0 going to sleep for 11 seconds 00000100:00100000:0.0:1777051274.084539:0:101422:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452524800 00000100:00100000:0.0:1777051274.084550:0:101422:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452524800 00000100:00100000:0.0:1777051274.084603:0:101422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1777051274.084617:0:101422:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7d9cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9351a01-5b0e-4470-97fd-58b9b4b312a2+20:102648:x1863365452524800:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1777051274.084819:0:101422:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7d9cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9351a01-5b0e-4470-97fd-58b9b4b312a2+20:102648:x1863365452524800:12345-0@lo:502:llog_process_th.0 Request processed in 202us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051274.084832:0:101422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1777051274.084886:0:102648:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f825c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f9351a01-5b0e-4470-97fd-58b9b4b312a2:102648:1863365452524800:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1777051274.084942:0:102648:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1777051274.084958:0:102648:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1777051274.084962:0:102648:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre mdt.lustre-MDT0000.hsm.default_archive_id 00000020:01000000:1.0:1777051274.084975:0:102648:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff99da44f8b000 00000020:00000080:1.0:1777051274.084979:0:102648:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1777051274.085075:0:102648:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1777051274.085084:0:102648:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1777051274.085086:0:102648:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre mdt.lustre-MDT0000.hsm.default_archive_id 00000020:01000000:1.0:1777051274.085092:0:102648:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1777051274.085097:0:102648:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1777051274.085100:0:102648:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre mdt.lustre-MDT0001.hsm.default_archive_id 00000020:01000000:1.0:1777051274.085107:0:102648:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff99da44f8b000 00000020:00000080:1.0:1777051274.085112:0:102648:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1777051274.085180:0:102648:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f825c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f9351a01-5b0e-4470-97fd-58b9b4b312a2:102648:1863365452524928:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1777051274.085248:0:102648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051274.085349:0:102648:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d9598763c0 going to sleep for 11 seconds 00000100:00100000:0.0:1777051274.085533:0:101429:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452524928 00000100:00100000:0.0:1777051274.085543:0:101429:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452524928 00000100:00100000:0.0:1777051274.085625:0:101429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1777051274.085641:0:101429:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942ed7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f9351a01-5b0e-4470-97fd-58b9b4b312a2+20:102648:x1863365452524928:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1777051274.085789:0:101429:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942ed7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f9351a01-5b0e-4470-97fd-58b9b4b312a2+20:102648:x1863365452524928:12345-0@lo:502:llog_process_th.0 Request processed in 150us (540us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051274.085803:0:101429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1777051274.085970:0:102648:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f825c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f9351a01-5b0e-4470-97fd-58b9b4b312a2:102648:1863365452524928:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1777051274.086011:0:102648:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1777051274.086023:0:102648:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1777051274.086027:0:102648:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre mdt.lustre-MDT0001.hsm.default_archive_id 00000040:00080000:1.0:1777051274.086036:0:102648:0:(llog.c:858:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 43 count 43 00000020:01000000:1.0:1777051274.087335:0:6577:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 37-42 (rc=0) 10000000:01000000:1.0:1777051274.087578:0:6577:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.201.146@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1777051274.087595:0:6577:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff99d955a98800/0x85f51a6b96714a91 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b96714a98 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051274.087617:0:6577:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.146@tcp lock: ffff99d955a98800/0x85f51a6b96714a91 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b96714a98 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1777051274.087809:0:6577:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1777051274.087815:0:6577:0:(mgc_request.c:1799:mgc_process_log()) Process log params-ffff99d941839800 from 37 10000000:01000000:0.0:1777051274.087820:0:6577:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1777051274.087860:0:6577:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.146@tcp lock: ffff99da713e3400/0x85f51a6b96714a9f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051274.087876:0:6577:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.146@tcp lock: ffff99da713e3400/0x85f51a6b96714a9f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051274.087893:0:6577:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.146@tcp lock: ffff99da713e3400/0x85f51a6b96714a9f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051274.087923:0:6577:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da46270700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452525056:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1777051274.087984:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051274.088051:0:6577:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da70bd0780 going to sleep for 11 seconds 00000100:00100000:1.0:1777051274.088085:0:101425:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452525056 00000100:00100000:1.0:1777051274.088106:0:101425:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452525056 00000100:00100000:1.0:1777051274.088188:0:101425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1777051274.088206:0:101425:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942ed4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9351a01-5b0e-4470-97fd-58b9b4b312a2+20:6577:x1863365452525056:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1777051274.088224:0:101425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777051274.088247:0:101425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d9442eba00/0x85f51a6b96714aa6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x85f51a6b96714a9f expref: -99 pid: 101425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051274.088285:0:101425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d9442eba00/0x85f51a6b96714aa6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x85f51a6b96714a9f expref: 21 pid: 101425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051274.088307:0:101425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d9442eba00/0x85f51a6b96714aa6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b96714a9f expref: 21 pid: 101425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051274.088323:0:101425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d9442eba00, rc 0) 00000100:00100000:1.0:1777051274.088394:0:101425:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942ed4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9351a01-5b0e-4470-97fd-58b9b4b312a2+21:6577:x1863365452525056:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 192us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051274.088414:0:101425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1777051274.088620:0:6577:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da46270700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452525056:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1777051274.088643:0:6577:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.146@tcp lock: ffff99da713e3400/0x85f51a6b96714a9f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b96714aa6 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051274.088659:0:6577:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.146@tcp lock: ffff99da713e3400/0x85f51a6b96714a9f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x85f51a6b96714aa6 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051274.089313:0:6577:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da46271180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452525184:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1777051274.089374:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051274.089427:0:101422:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452525184 00000100:00100000:1.0:1777051274.089465:0:101422:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452525184 00000100:00100000:1.0:1777051274.089520:0:101422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1777051274.089533:0:101422:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942ed6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9351a01-5b0e-4470-97fd-58b9b4b312a2+21:6577:x1863365452525184:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1777051274.089671:0:101422:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942ed6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9351a01-5b0e-4470-97fd-58b9b4b312a2+21:6577:x1863365452525184:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 138us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051274.089686:0:101422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1777051274.091560:0:6577:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da70bd0d80 going to sleep for 11 seconds 00000100:00100000:0.0:1777051274.091622:0:6577:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da46271180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452525184:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1777051274.092039:0:6577:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da46271180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452525312:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1777051274.092117:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051274.092499:0:101424:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452525312 00000100:00100000:1.0:1777051274.092511:0:101424:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452525312 00000100:00100000:0.0:1777051274.092515:0:6577:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da70bd0d80 going to sleep for 11 seconds 00000100:00100000:1.0:1777051274.092579:0:101424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1777051274.092595:0:101424:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942ed5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9351a01-5b0e-4470-97fd-58b9b4b312a2+21:6577:x1863365452525312:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1777051274.092777:0:101424:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942ed5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9351a01-5b0e-4470-97fd-58b9b4b312a2+21:6577:x1863365452525312:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 182us (656us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051274.092794:0:101424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1777051274.092813:0:6577:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da46271180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452525312:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1777051274.093128:0:102650:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da46271180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f9351a01-5b0e-4470-97fd-58b9b4b312a2:102650:1863365452525440:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1777051274.093209:0:102650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051274.093307:0:101427:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452525440 00000100:00100000:0.0:1777051274.093314:0:101427:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452525440 00000100:00100000:0.0:1777051274.093382:0:101427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1777051274.093398:0:101427:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942ed6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f9351a01-5b0e-4470-97fd-58b9b4b312a2+21:102650:x1863365452525440:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1777051274.093579:0:101427:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942ed6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f9351a01-5b0e-4470-97fd-58b9b4b312a2+21:102650:x1863365452525440:12345-0@lo:502:llog_process_th.0 Request processed in 184us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051274.093593:0:101427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1777051274.093663:0:102650:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da70bd0780 going to sleep for 11 seconds 00000100:00100000:0.0:1777051274.093689:0:102650:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da46271180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f9351a01-5b0e-4470-97fd-58b9b4b312a2:102650:1863365452525440:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1777051274.093727:0:102650:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1777051274.093742:0:102650:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1777051274.093747:0:102650:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre mdt.lustre-MDT0000.hsm.default_archive_id 00000020:01000000:0.0:1777051274.093760:0:102650:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff99d941839800 00000020:00000080:0.0:1777051274.093767:0:102650:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1777051274.093863:0:102650:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1777051274.093873:0:102650:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1777051274.093876:0:102650:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre mdt.lustre-MDT0000.hsm.default_archive_id 00000020:01000000:0.0:1777051274.093884:0:102650:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1777051274.093890:0:102650:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1777051274.093894:0:102650:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre mdt.lustre-MDT0001.hsm.default_archive_id 00000020:01000000:0.0:1777051274.093905:0:102650:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff99d941839800 00000020:00000080:0.0:1777051274.093911:0:102650:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1777051274.093996:0:102650:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da46271180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f9351a01-5b0e-4470-97fd-58b9b4b312a2:102650:1863365452525568:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1777051274.094423:0:102650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051274.097515:0:102650:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da50cb1900 going to sleep for 11 seconds 00000100:00100000:1.0:1777051274.097520:0:101429:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452525568 00000100:00100000:1.0:1777051274.097533:0:101429:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452525568 00000100:00100000:1.0:1777051274.097632:0:101429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1777051274.097653:0:101429:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fca4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f9351a01-5b0e-4470-97fd-58b9b4b312a2+21:102650:x1863365452525568:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1777051274.097836:0:101429:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fca4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f9351a01-5b0e-4470-97fd-58b9b4b312a2+21:102650:x1863365452525568:12345-0@lo:502:llog_process_th.0 Request processed in 189us (3414us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051274.097851:0:101429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1777051274.097910:0:102650:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da46271180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f9351a01-5b0e-4470-97fd-58b9b4b312a2:102650:1863365452525568:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1777051274.097964:0:102650:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1777051274.097976:0:102650:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1777051274.097980:0:102650:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre mdt.lustre-MDT0001.hsm.default_archive_id 00000040:00080000:2.0:1777051274.097988:0:102650:0:(llog.c:858:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 43 count 43 00000020:01000000:2.0:1777051274.098528:0:6577:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 37-42 (rc=0) 10000000:01000000:2.0:1777051274.098567:0:6577:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.201.146@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1777051274.098581:0:6577:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff99da713e3400/0x85f51a6b96714a9f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b96714aa6 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051274.098600:0:6577:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.146@tcp lock: ffff99da713e3400/0x85f51a6b96714a9f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b96714aa6 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1777051274.098617:0:6577:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1777051274.098622:0:6577:0:(mgc_request.c:1799:mgc_process_log()) Process log params-ffff99da44f8d000 from 37 10000000:01000000:2.0:1777051274.098627:0:6577:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1777051274.098668:0:6577:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.146@tcp lock: ffff99d955a98400/0x85f51a6b96714aad lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051274.098684:0:6577:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.146@tcp lock: ffff99d955a98400/0x85f51a6b96714aad lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051274.098701:0:6577:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.146@tcp lock: ffff99d955a98400/0x85f51a6b96714aad lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051274.099078:0:6577:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f9fd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452525696:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1777051274.099144:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051274.099178:0:6577:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d944917e40 going to sleep for 11 seconds 00000100:00100000:2.0:1777051274.099251:0:101424:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452525696 00000100:00100000:2.0:1777051274.099258:0:101424:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452525696 00000100:00100000:2.0:1777051274.099316:0:101424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1777051274.099333:0:101424:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fca5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9351a01-5b0e-4470-97fd-58b9b4b312a2+21:6577:x1863365452525696:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1777051274.099353:0:101424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051274.099374:0:101424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d955a99c00/0x85f51a6b96714ab4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x85f51a6b96714aad expref: -99 pid: 101424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051274.099412:0:101424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d955a99c00/0x85f51a6b96714ab4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x85f51a6b96714aad expref: 22 pid: 101424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051274.099457:0:101424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d955a99c00/0x85f51a6b96714ab4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b96714aad expref: 22 pid: 101424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051274.099476:0:101424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d955a99c00, rc 0) 00000100:00100000:2.0:1777051274.099549:0:101424:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fca5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9351a01-5b0e-4470-97fd-58b9b4b312a2+22:6577:x1863365452525696:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 219us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051274.099563:0:101424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1777051274.099639:0:6577:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f9fd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452525696:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1777051274.099663:0:6577:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.146@tcp lock: ffff99d955a98400/0x85f51a6b96714aad lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b96714ab4 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051274.099683:0:6577:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.146@tcp lock: ffff99d955a98400/0x85f51a6b96714aad lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x85f51a6b96714ab4 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051274.099779:0:6577:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f9fd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452525824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1777051274.099835:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051274.099890:0:6577:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d944917e40 going to sleep for 11 seconds 00000100:00100000:0.0:1777051274.099995:0:101427:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452525824 00000100:00100000:0.0:1777051274.100006:0:101427:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452525824 00000100:00100000:0.0:1777051274.100074:0:101427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1777051274.100091:0:101427:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7f989050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f9351a01-5b0e-4470-97fd-58b9b4b312a2+22:6577:x1863365452525824:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1777051274.100243:0:101427:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7f989050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f9351a01-5b0e-4470-97fd-58b9b4b312a2+22:6577:x1863365452525824:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 154us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051274.100259:0:101427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1777051274.100320:0:6577:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f9fd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452525824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1777051274.100383:0:6577:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f9fd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452525952:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1777051274.100500:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051274.100546:0:101425:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452525952 00000100:00100000:1.0:1777051274.100557:0:101425:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452525952 00000100:00100000:2.0:1777051274.100558:0:6577:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d944917e40 going to sleep for 11 seconds 00000100:00100000:1.0:1777051274.100626:0:101425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1777051274.100643:0:101425:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7f989850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9351a01-5b0e-4470-97fd-58b9b4b312a2+22:6577:x1863365452525952:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1777051274.100789:0:101425:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7f989850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9351a01-5b0e-4470-97fd-58b9b4b312a2+22:6577:x1863365452525952:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 149us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051274.100806:0:101425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1777051274.100851:0:6577:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f9fd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452525952:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1777051274.101134:0:102651:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f9fd880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f9351a01-5b0e-4470-97fd-58b9b4b312a2:102651:1863365452526080:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1777051274.101213:0:102651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051274.101257:0:101424:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452526080 00000100:00100000:2.0:1777051274.101263:0:101424:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452526080 00000100:00100000:2.0:1777051274.101309:0:101424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1777051274.101368:0:101424:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7f988050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9351a01-5b0e-4470-97fd-58b9b4b312a2+22:102651:x1863365452526080:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1777051274.101551:0:101424:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7f988050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9351a01-5b0e-4470-97fd-58b9b4b312a2+22:102651:x1863365452526080:12345-0@lo:502:llog_process_th.0 Request processed in 187us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051274.101565:0:101424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1777051274.101651:0:102651:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d944917480 going to sleep for 11 seconds 00000100:00100000:2.0:1777051274.101680:0:102651:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f9fd880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f9351a01-5b0e-4470-97fd-58b9b4b312a2:102651:1863365452526080:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1777051274.101729:0:102651:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1777051274.101741:0:102651:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1777051274.101745:0:102651:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre mdt.lustre-MDT0000.hsm.default_archive_id 00000020:01000000:2.0:1777051274.101757:0:102651:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff99da44f8d000 00000020:00000080:2.0:1777051274.101765:0:102651:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1777051274.101855:0:102651:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1777051274.101865:0:102651:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1777051274.101869:0:102651:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre mdt.lustre-MDT0000.hsm.default_archive_id 00000020:01000000:2.0:1777051274.101875:0:102651:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1777051274.101881:0:102651:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1777051274.101884:0:102651:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre mdt.lustre-MDT0001.hsm.default_archive_id 00000020:01000000:2.0:1777051274.101893:0:102651:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff99da44f8d000 00000020:00000080:2.0:1777051274.101899:0:102651:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1777051274.101978:0:102651:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f9fd880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f9351a01-5b0e-4470-97fd-58b9b4b312a2:102651:1863365452526208:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1777051274.102052:0:102651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051274.102099:0:102651:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d944917480 going to sleep for 11 seconds 00000100:00100000:0.0:1777051274.102103:0:101427:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452526208 00000100:00100000:0.0:1777051274.102115:0:101427:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452526208 00000100:00100000:0.0:1777051274.102183:0:101427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1777051274.102247:0:101427:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da45722450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f9351a01-5b0e-4470-97fd-58b9b4b312a2+22:102651:x1863365452526208:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1777051274.102414:0:101427:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da45722450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f9351a01-5b0e-4470-97fd-58b9b4b312a2+22:102651:x1863365452526208:12345-0@lo:502:llog_process_th.0 Request processed in 213us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051274.102463:0:101427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1777051274.102478:0:102651:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f9fd880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f9351a01-5b0e-4470-97fd-58b9b4b312a2:102651:1863365452526208:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1777051274.102530:0:102651:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1777051274.102541:0:102651:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1777051274.102545:0:102651:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre mdt.lustre-MDT0001.hsm.default_archive_id 00000040:00080000:2.0:1777051274.102551:0:102651:0:(llog.c:858:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 43 count 43 00000020:01000000:2.0:1777051274.102629:0:6577:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 37-42 (rc=0) 10000000:01000000:2.0:1777051274.102660:0:6577:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.201.146@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1777051274.102670:0:6577:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff99d955a98400/0x85f51a6b96714aad lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b96714ab4 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051274.102687:0:6577:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.146@tcp lock: ffff99d955a98400/0x85f51a6b96714aad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b96714ab4 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1777051274.102704:0:6577:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1777051274.102709:0:6577:0:(mgc_request.c:1799:mgc_process_log()) Process log params-ffff99da57ae9000 from 37 10000000:01000000:2.0:1777051274.102714:0:6577:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1777051274.102749:0:6577:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.146@tcp lock: ffff99d955a98200/0x85f51a6b96714abb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051274.102766:0:6577:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.146@tcp lock: ffff99d955a98200/0x85f51a6b96714abb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051274.102782:0:6577:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.146@tcp lock: ffff99d955a98200/0x85f51a6b96714abb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051274.102809:0:6577:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f9fd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452526336:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1777051274.102881:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051274.102944:0:6577:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d944917480 going to sleep for 11 seconds 00000100:00100000:0.0:1777051274.103917:0:101425:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452526336 00000100:00100000:0.0:1777051274.103928:0:101425:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452526336 00000100:00100000:0.0:1777051274.103984:0:101425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1777051274.103998:0:101425:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942b87050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9351a01-5b0e-4470-97fd-58b9b4b312a2+22:6577:x1863365452526336:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1777051274.104013:0:101425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051274.104032:0:101425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99da713e2400/0x85f51a6b96714ac2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x85f51a6b96714abb expref: -99 pid: 101425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051274.104067:0:101425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99da713e2400/0x85f51a6b96714ac2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x85f51a6b96714abb expref: 23 pid: 101425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051274.104099:0:101425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99da713e2400/0x85f51a6b96714ac2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b96714abb expref: 23 pid: 101425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051274.104115:0:101425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99da713e2400, rc 0) 00000100:00100000:2.0:1777051274.104270:0:6577:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f9fd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452526336:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1777051274.104274:0:101425:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942b87050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9351a01-5b0e-4470-97fd-58b9b4b312a2+23:6577:x1863365452526336:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 201us (1318us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051274.104298:0:101425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00010000:00010000:2.0:1777051274.104298:0:6577:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.146@tcp lock: ffff99d955a98200/0x85f51a6b96714abb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b96714ac2 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051274.104322:0:6577:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.146@tcp lock: ffff99d955a98200/0x85f51a6b96714abb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x85f51a6b96714ac2 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051274.104417:0:6577:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f9fd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452526464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1777051274.104513:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051274.104568:0:6577:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d944917480 going to sleep for 11 seconds 00000100:00100000:2.0:1777051274.104595:0:101429:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452526464 00000100:00100000:2.0:1777051274.104601:0:101429:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452526464 00000100:00100000:2.0:1777051274.104666:0:101429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1777051274.104681:0:101429:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942b85850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f9351a01-5b0e-4470-97fd-58b9b4b312a2+23:6577:x1863365452526464:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1777051274.104829:0:101429:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942b85850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f9351a01-5b0e-4470-97fd-58b9b4b312a2+23:6577:x1863365452526464:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 149us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051274.104843:0:101429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1777051274.104909:0:6577:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f9fd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452526464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1777051274.104963:0:6577:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f9fd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452526592:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1777051274.105038:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051274.105083:0:6577:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d944917480 going to sleep for 11 seconds 00000100:00100000:0.0:1777051274.105214:0:101427:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452526592 00000100:00100000:0.0:1777051274.105225:0:101427:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452526592 00000100:00100000:0.0:1777051274.105302:0:101427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1777051274.105320:0:101427:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942b85050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f9351a01-5b0e-4470-97fd-58b9b4b312a2+23:6577:x1863365452526592:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1777051274.105517:0:101427:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942b85050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f9351a01-5b0e-4470-97fd-58b9b4b312a2+23:6577:x1863365452526592:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 195us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051274.105539:0:101427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1777051274.107598:0:6577:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f9fd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452526592:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1777051274.108550:0:102654:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f9fd880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f9351a01-5b0e-4470-97fd-58b9b4b312a2:102654:1863365452526720:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1777051274.108628:0:102654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051274.108704:0:102654:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da6fddfc00 going to sleep for 11 seconds 00000100:00100000:0.0:1777051274.109170:0:101424:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452526720 00000100:00100000:0.0:1777051274.109181:0:101424:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452526720 00000100:00100000:0.0:1777051274.109300:0:101424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1777051274.109317:0:101424:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5fa2c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9351a01-5b0e-4470-97fd-58b9b4b312a2+23:102654:x1863365452526720:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1777051274.111061:0:101424:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5fa2c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9351a01-5b0e-4470-97fd-58b9b4b312a2+23:102654:x1863365452526720:12345-0@lo:502:llog_process_th.0 Request processed in 1744us (2430us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051274.111077:0:101424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1777051274.111174:0:102654:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f9fd880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f9351a01-5b0e-4470-97fd-58b9b4b312a2:102654:1863365452526720:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1777051274.111301:0:102654:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1777051274.111318:0:102654:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1777051274.111323:0:102654:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre mdt.lustre-MDT0000.hsm.default_archive_id 00000020:01000000:3.0:1777051274.111338:0:102654:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff99da57ae9000 00000020:00000080:3.0:1777051274.111344:0:102654:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1777051274.111486:0:102654:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1777051274.113067:0:102654:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1777051274.113073:0:102654:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre mdt.lustre-MDT0000.hsm.default_archive_id 00000020:01000000:3.0:1777051274.113085:0:102654:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1777051274.113094:0:102654:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1777051274.113097:0:102654:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre mdt.lustre-MDT0001.hsm.default_archive_id 00000020:01000000:3.0:1777051274.113107:0:102654:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff99da57ae9000 00000020:00000080:3.0:1777051274.113472:0:102654:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1777051274.113608:0:102654:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7fd65880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f9351a01-5b0e-4470-97fd-58b9b4b312a2:102654:1863365452526848:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1777051274.113707:0:102654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051274.113771:0:101422:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452526848 00000100:00100000:3.0:1777051274.113781:0:101422:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452526848 00000100:00100000:3.0:1777051274.113850:0:101422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1777051274.113869:0:101422:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5fa2dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9351a01-5b0e-4470-97fd-58b9b4b312a2+23:102654:x1863365452526848:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1777051274.114040:0:101422:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5fa2dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9351a01-5b0e-4470-97fd-58b9b4b312a2+23:102654:x1863365452526848:12345-0@lo:502:llog_process_th.0 Request processed in 175us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051274.114057:0:101422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1777051274.114144:0:102654:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d94ecc3000 going to sleep for 11 seconds 00000100:00100000:3.0:1777051274.114179:0:102654:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7fd65880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f9351a01-5b0e-4470-97fd-58b9b4b312a2:102654:1863365452526848:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1777051274.114264:0:102654:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1777051274.114272:0:102654:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1777051274.114275:0:102654:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre mdt.lustre-MDT0001.hsm.default_archive_id 00000040:00080000:3.0:1777051274.114282:0:102654:0:(llog.c:858:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 43 count 43 00000020:01000000:2.0:1777051274.114413:0:6577:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 37-42 (rc=0) 10000000:01000000:2.0:1777051274.115384:0:6577:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.201.146@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1777051274.115401:0:6577:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff99d955a98200/0x85f51a6b96714abb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b96714ac2 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051274.115424:0:6577:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.146@tcp lock: ffff99d955a98200/0x85f51a6b96714abb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b96714ac2 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051274.328125:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1777051274.518919:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f9fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3678:1863365452526976:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1777051274.519045:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f825c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452527104:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1777051274.519047:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051274.519605:0:8472:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452526976 00000100:00100000:3.0:1777051274.519619:0:8472:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452526976 00000100:00100000:3.0:1777051274.519694:0:8472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5542 00000100:00100000:3.0:1777051274.519711:0:8472:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3678:x1863365452526976:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1777051274.519748:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:3.0:1777051274.519761:0:8472:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 430294336 pending 0 free 3645853696 avail 3414331392 00000100:00100000:3.0:1777051274.519866:0:8472:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3678:x1863365452526976:12345-0@lo:13:osp-pre-1-0.0 Request processed in 155us (828us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051274.519883:0:8472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5542 00000100:00100000:1.0:1777051274.519909:0:8473:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452527104 00000100:00100000:2.0:1777051274.519913:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f9fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3678:1863365452526976:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1777051274.519920:0:8473:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452527104 00000100:00100000:1.0:1777051274.520001:0:8473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5543 00000100:00100000:1.0:1777051274.520020:0:8473:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f825500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3679:x1863365452527104:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1777051274.520055:0:8473:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 440354112 pending 0 free 3862671360 avail 3631149056 00000100:00100000:1.0:1777051274.520148:0:8473:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f825500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3679:x1863365452527104:12345-0@lo:13:osp-pre-0-0.0 Request processed in 132us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051274.520596:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f825c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452527104:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1777051274.521046:0:8473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5543 00000100:00100000:2.0:1777051274.659194:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051274.659353:0:101427:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425861504 00000100:00100000:0.0:1777051274.659373:0:101427:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425861504 00000100:00100000:0.0:1777051274.659491:0:101427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 130 00000100:00100000:0.0:1777051274.659512:0:101427:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5fa2c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:29c4352d-3260-4734-909d-9ea5de9e7fa4+10:6255:x1863365425861504:12345-192.168.201.46@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1777051274.659542:0:101427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051274.659577:0:101427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99da713e3000/0x85f51a6b96714ac9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b5ec4 expref: -99 pid: 101427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051274.659639:0:101427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99da713e3000/0x85f51a6b96714ac9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5ec4 expref: 11 pid: 101427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051274.659659:0:101427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99da713e3000/0x85f51a6b96714ac9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5ec4 expref: 11 pid: 101427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051274.659674:0:101427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99da713e3000, rc 0) 00000100:00100000:0.0:1777051274.659786:0:101427:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5fa2c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:29c4352d-3260-4734-909d-9ea5de9e7fa4+11:6255:x1863365425861504:12345-192.168.201.46@tcp:101:ll_cfg_requeue.0 Request processed in 280us (601us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051274.659796:0:101427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 130 00000100:00100000:0.0:1777051274.664948:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051274.665048:0:101424:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425861632 00000100:00100000:2.0:1777051274.665059:0:101424:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425861632 00000100:00100000:2.0:1777051274.665141:0:101424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 131 00000100:00100000:2.0:1777051274.665154:0:101424:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942f30050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29c4352d-3260-4734-909d-9ea5de9e7fa4+11:6255:x1863365425861632:12345-192.168.201.46@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1777051274.665406:0:101424:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942f30050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29c4352d-3260-4734-909d-9ea5de9e7fa4+11:6255:x1863365425861632:12345-192.168.201.46@tcp:501:ll_cfg_requeue.0 Request processed in 253us (466us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051274.665450:0:101424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 131 00000100:00100000:0.0:1777051274.673504:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051274.673603:0:101425:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425861760 00000100:00100000:2.0:1777051274.673618:0:101425:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425861760 00000100:00100000:2.0:1777051274.673711:0:101425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 132 00000100:00100000:2.0:1777051274.673728:0:101425:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942f33850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29c4352d-3260-4734-909d-9ea5de9e7fa4+11:6255:x1863365425861760:12345-192.168.201.46@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1777051274.673978:0:101425:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942f33850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29c4352d-3260-4734-909d-9ea5de9e7fa4+11:6255:x1863365425861760:12345-192.168.201.46@tcp:503:ll_cfg_requeue.0 Request processed in 253us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051274.673991:0:101425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 132 00000100:00100000:2.0:1777051274.678074:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051274.678504:0:101427:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425861888 00000100:00100000:1.0:1777051274.678520:0:101427:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425861888 00000100:00100000:1.0:1777051274.678621:0:101427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 133 00000100:00100000:1.0:1777051274.678642:0:101427:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942f32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:29c4352d-3260-4734-909d-9ea5de9e7fa4+11:131284:x1863365425861888:12345-192.168.201.46@tcp:502:llog_process_th.0 00000100:00100000:1.0:1777051274.678910:0:101427:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942f32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:29c4352d-3260-4734-909d-9ea5de9e7fa4+11:131284:x1863365425861888:12345-192.168.201.46@tcp:502:llog_process_th.0 Request processed in 255us (823us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051274.678924:0:101427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 133 00000100:00100000:1.0:1777051274.686656:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051274.686786:0:101424:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425862016 00000100:00100000:2.0:1777051274.686803:0:101424:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425862016 00000100:00100000:2.0:1777051274.686905:0:101424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 134 00000100:00100000:2.0:1777051274.686923:0:101424:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942f32450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29c4352d-3260-4734-909d-9ea5de9e7fa4+11:131284:x1863365425862016:12345-192.168.201.46@tcp:502:llog_process_th.0 00000100:00100000:2.0:1777051274.687174:0:101424:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942f32450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29c4352d-3260-4734-909d-9ea5de9e7fa4+11:131284:x1863365425862016:12345-192.168.201.46@tcp:502:llog_process_th.0 Request processed in 256us (530us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051274.687187:0:101424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 134 00000100:00100000:1.0:1777051274.690583:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051274.690736:0:101425:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425862144 00000100:00100000:2.0:1777051274.690747:0:101425:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425862144 00000100:00100000:2.0:1777051274.691662:0:101425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 135 00000100:00100000:2.0:1777051274.691687:0:101425:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942f33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29c4352d-3260-4734-909d-9ea5de9e7fa4+11:6255:x1863365425862144:12345-192.168.201.46@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1777051274.691712:0:101425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051274.691743:0:101425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d955a98c00/0x85f51a6b96714ad0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b5ecb expref: -99 pid: 101425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051274.691787:0:101425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d955a98c00/0x85f51a6b96714ad0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5ecb expref: 12 pid: 101425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051274.691806:0:101425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d955a98c00/0x85f51a6b96714ad0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5ecb expref: 12 pid: 101425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051274.692107:0:101425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d955a98c00, rc 0) 00000100:00100000:2.0:1777051274.692674:0:101425:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942f33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29c4352d-3260-4734-909d-9ea5de9e7fa4+12:6255:x1863365425862144:12345-192.168.201.46@tcp:101:ll_cfg_requeue.0 Request processed in 1001us (2110us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051274.692691:0:101425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 135 00000100:00100000:2.0:1777051274.698666:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051274.698756:0:101427:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425862272 00000100:00100000:1.0:1777051274.698772:0:101427:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425862272 00000100:00100000:1.0:1777051274.698859:0:101427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 136 00000100:00100000:1.0:1777051274.698874:0:101427:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942f30450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:29c4352d-3260-4734-909d-9ea5de9e7fa4+12:6255:x1863365425862272:12345-192.168.201.46@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1777051274.699105:0:101427:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942f30450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:29c4352d-3260-4734-909d-9ea5de9e7fa4+12:6255:x1863365425862272:12345-192.168.201.46@tcp:501:ll_cfg_requeue.0 Request processed in 233us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051274.699119:0:101427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 136 00000100:00100000:1.0:1777051274.703409:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051274.703549:0:101424:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425862400 00000100:00100000:3.0:1777051274.703565:0:101424:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425862400 00000100:00100000:3.0:1777051274.703684:0:101424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 137 00000100:00100000:3.0:1777051274.703702:0:101424:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5fa2e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29c4352d-3260-4734-909d-9ea5de9e7fa4+12:6255:x1863365425862400:12345-192.168.201.46@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1777051274.704274:0:101424:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5fa2e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29c4352d-3260-4734-909d-9ea5de9e7fa4+12:6255:x1863365425862400:12345-192.168.201.46@tcp:503:ll_cfg_requeue.0 Request processed in 567us (860us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051274.704300:0:101424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 137 00000100:00100000:3.0:1777051274.711030:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051274.711100:0:101422:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425862528 00000100:00100000:3.0:1777051274.711109:0:101422:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425862528 00000100:00100000:3.0:1777051274.711627:0:101422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 138 00000100:00100000:3.0:1777051274.711654:0:101422:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942f31050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29c4352d-3260-4734-909d-9ea5de9e7fa4+12:131288:x1863365425862528:12345-192.168.201.46@tcp:502:llog_process_th.0 00000100:00100000:3.0:1777051274.711862:0:101422:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942f31050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29c4352d-3260-4734-909d-9ea5de9e7fa4+12:131288:x1863365425862528:12345-192.168.201.46@tcp:502:llog_process_th.0 Request processed in 217us (845us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051274.711878:0:101422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 138 00000100:00100000:3.0:1777051274.720528:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051274.720608:0:101427:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425862656 00000100:00100000:3.0:1777051274.720622:0:101427:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425862656 00000100:00100000:3.0:1777051274.720710:0:101427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 139 00000100:00100000:3.0:1777051274.721189:0:101427:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942f32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:29c4352d-3260-4734-909d-9ea5de9e7fa4+12:131288:x1863365425862656:12345-192.168.201.46@tcp:502:llog_process_th.0 00000100:00100000:3.0:1777051274.721498:0:101427:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942f32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:29c4352d-3260-4734-909d-9ea5de9e7fa4+12:131288:x1863365425862656:12345-192.168.201.46@tcp:502:llog_process_th.0 Request processed in 766us (971us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051274.721519:0:101427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 139 00000100:00100000:0.0:1777051275.031124:0:3679:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1777051275.031396:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f9fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452527232:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1777051275.031514:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051275.031648:0:8472:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452527232 00000100:00100000:2.0:1777051275.031661:0:8472:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452527232 00000100:00100000:2.0:1777051275.031734:0:8472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5544 00000100:00100000:2.0:1777051275.031751:0:8472:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da46270000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3679:x1863365452527232:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1777051275.031780:0:8472:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 430294336 pending 0 free 3645853696 avail 3414331392 00000100:00100000:2.0:1777051275.031867:0:8472:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da46270000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3679:x1863365452527232:12345-0@lo:13:osp-pre-1-1.0 Request processed in 120us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051275.031878:0:8472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5544 00000100:00100000:0.0:1777051275.032468:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f9fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452527232:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1777051275.350690:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1777051275.424551:0:102736:0:(tgt_mount.c:2015:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:0.0:1777051275.424652:0:102736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.146@tcp lock: ffff99d95595b600/0x85f51a6b967146a1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b967146a8 expref: -99 pid: 101416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051275.424679:0:102736:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff99d95595b600/0x85f51a6b967146a1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x85f51a6b967146a8 expref: -99 pid: 101416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051275.424706:0:102736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff99d95595b600/0x85f51a6b967146a1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x85f51a6b967146a8 expref: -99 pid: 101416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051275.424722:0:102736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.146@tcp lock: ffff99d95595b600/0x85f51a6b967146a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x85f51a6b967146a8 expref: -99 pid: 101416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051275.424777:0:102736:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1777051275.424788:0:102736:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:1.0:1777051275.424804:0:6568:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777051275.424830:0:6568:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.146@tcp lock: ffff99d95595b600/0x85f51a6b967146a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x85f51a6b967146a8 expref: -99 pid: 101416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051275.424849:0:6568:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d95595b600 already unused, calling callback (ffffffffc1208c20) 00000100:00080000:0.0:1777051275.424863:0:102736:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 10000000:00010000:1.0:1777051275.424872:0:6568:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.146@tcp lock: ffff99d95595b600/0x85f51a6b967146a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x85f51a6b967146a8 expref: -99 pid: 101416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051275.424873:0:102736:0:(client.c:3101:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00010000:00010000:1.0:1777051275.424897:0:6568:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.146@tcp lock: ffff99d95595b600/0x85f51a6b967146a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x85f51a6b967146a8 expref: -99 pid: 101416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1777051275.424900:0:102736:0:(pinger.c:396:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 10000000:00010000:1.0:1777051275.424926:0:6568:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.146@tcp lock: ffff99d95595b600/0x85f51a6b967146a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x85f51a6b967146a8 expref: -99 pid: 101416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1777051275.424939:0:6568:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00080000:0.0:1777051275.424949:0:102736:0:(import.c:65:import_set_state_nolock()) ffff99d9410cc800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 10000000:01000000:1.0:1777051275.424958:0:6568:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1777051275.424966:0:6568:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1777051275.425040:0:6568:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.146@tcp lock: ffff99d95595b600/0x85f51a6b967146a1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x85f51a6b967146a8 expref: -99 pid: 101416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051275.425056:0:6568:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1777051275.425115:0:3676:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da46271180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3676:1863365452527360:0@lo:39:umount.0 00000100:00100000:0.0:1777051275.425295:0:3676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051275.425497:0:8492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452527360 00000100:00100000:0.0:1777051275.425509:0:8492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452527360 00000100:00100000:0.0:1777051275.425609:0:8492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111687 00000100:00100000:0.0:1777051275.426113:0:8492:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da46270700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3676:x1863365452527360:12345-0@lo:39:umount.0 00000020:00000080:0.0:1777051275.426163:0:8492:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x85f51a6b967147d5 00000100:00080000:0.0:1777051275.426196:0:8492:0:(import.c:65:import_set_state_nolock()) ffff99d944b18800 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1777051275.426294:0:6568:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.146@tcp lock: ffff99d95595b600/0x85f51a6b967146a1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x85f51a6b967146a8 expref: -99 pid: 101416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051275.426324:0:6568:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.146@tcp lock: ffff99d95595b600/0x85f51a6b967146a1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x85f51a6b967146a8 expref: -99 pid: 101416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051275.426347:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051275.426351:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051275.426365:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051275.426385:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1777051275.426434:0:3678:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1777051275.426461:0:8492:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da46270700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+1:3676:x1863365452527360:12345-0@lo:39:umount.0 Request processed in 314us (1115us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051275.426468:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f827800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3678:1863365452527488:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1777051275.426494:0:8492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111687 00000020:00000080:0.0:1777051275.426528:0:8492:0:(genops.c:906:class_export_put()) final put ffff99d944b1e800/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00100000:1.0:1777051275.426578:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051275.427587:0:6566:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452527488 00000100:00100000:1.0:1777051275.427598:0:6566:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452527488 00000100:00100000:1.0:1777051275.427705:0:6566:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13663 00000100:00100000:1.0:1777051275.428163:0:6566:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f827480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f9351a01-5b0e-4470-97fd-58b9b4b312a2+23:3678:x1863365452527488:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1777051275.428198:0:6566:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1777051275.428269:0:6566:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99da7d506e00/0x85f51a6b967146a8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x85f51a6b967146a1 expref: 23 pid: 101429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051275.428305:0:6566:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1777051275.428390:0:6566:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f827480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f9351a01-5b0e-4470-97fd-58b9b4b312a2+22:3678:x1863365452527488:12345-0@lo:103:ldlm_bl.0 Request processed in 673us (1824us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051275.428415:0:6566:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13663 00000020:00000080:0.0:1777051275.428504:0:84827:0:(genops.c:865:class_export_destroy()) destroying export ffff99d944b1e800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000100:00100000:1.0:1777051275.428553:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f827800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3678:1863365452527488:0@lo:103:ldlm_bl.0 00000020:00000080:0.0:1777051275.428628:0:84827:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99d944b18800 for lustre-MDT0000 00000100:00080000:1.0:1777051275.428683:0:3676:0:(import.c:65:import_set_state_nolock()) ffff99d9410cc800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1777051275.428720:0:3676:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da46271180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3676:1863365452527360:0@lo:39:umount.0 00000100:00080000:0.0:1777051275.428745:0:102736:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1777051275.428755:0:102736:0:(client.c:3101:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1777051275.428774:0:102736:0:(import.c:321:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1777051275.433690:0:102736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.146@tcp lock: ffff99d955a8ea00/0x85f51a6b967145ba lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b967145c1 expref: -99 pid: 101416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051275.433723:0:102736:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff99d955a8ea00/0x85f51a6b967145ba lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x85f51a6b967145c1 expref: -99 pid: 101416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051275.433738:0:102736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff99d955a8ea00/0x85f51a6b967145ba lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x85f51a6b967145c1 expref: -99 pid: 101416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051275.433762:0:102736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.146@tcp lock: ffff99d955a8ea00/0x85f51a6b967145ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x85f51a6b967145c1 expref: -99 pid: 101416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051275.433815:0:102736:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1777051275.433826:0:102736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.146@tcp lock: ffff99da7d506200/0x85f51a6b967146c4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b967146cb expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051275.433843:0:6567:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1777051275.433868:0:102736:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff99da7d506200/0x85f51a6b967146c4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x85f51a6b967146cb expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051275.433872:0:6567:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.146@tcp lock: ffff99d955a8ea00/0x85f51a6b967145ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x85f51a6b967145c1 expref: -99 pid: 101416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051275.433911:0:102736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff99da7d506200/0x85f51a6b967146c4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x85f51a6b967146cb expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051275.433915:0:6567:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d955a8ea00 already unused, calling callback (ffffffffc1208c20) 10000000:00010000:2.0:1777051275.433926:0:6567:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.146@tcp lock: ffff99d955a8ea00/0x85f51a6b967145ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x85f51a6b967145c1 expref: -99 pid: 101416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051275.433949:0:102736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.146@tcp lock: ffff99da7d506200/0x85f51a6b967146c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x85f51a6b967146cb expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051275.433968:0:6567:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.146@tcp lock: ffff99d955a8ea00/0x85f51a6b967145ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x85f51a6b967145c1 expref: -99 pid: 101416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1777051275.434004:0:6567:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.146@tcp lock: ffff99d955a8ea00/0x85f51a6b967145ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x85f51a6b967145c1 expref: -99 pid: 101416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1777051275.434017:0:6567:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1777051275.434022:0:6567:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:0.0:1777051275.434027:0:102736:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1777051275.434052:0:102736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.146@tcp lock: ffff99d955a98800/0x85f51a6b96714a91 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b96714a98 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051275.434070:0:102736:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff99d955a98800/0x85f51a6b96714a91 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x85f51a6b96714a98 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051275.434083:0:6567:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.146@tcp lock: ffff99d955a8ea00/0x85f51a6b967145ba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x85f51a6b967145c1 expref: -99 pid: 101416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051275.434097:0:102736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff99d955a98800/0x85f51a6b96714a91 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x85f51a6b96714a98 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051275.434105:0:6567:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1777051275.434120:0:102736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.146@tcp lock: ffff99d955a98800/0x85f51a6b96714a91 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x85f51a6b96714a98 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051275.434146:0:6567:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.146@tcp lock: ffff99d955a8ea00/0x85f51a6b967145ba lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x85f51a6b967145c1 expref: -99 pid: 101416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051275.434156:0:102736:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1777051275.434174:0:6567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.146@tcp lock: ffff99d955a8ea00/0x85f51a6b967145ba lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x85f51a6b967145c1 expref: -99 pid: 101416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051275.434177:0:102736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.146@tcp lock: ffff99d95595a200/0x85f51a6b967145ac lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b967145b3 expref: -99 pid: 101416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051275.434201:0:102736:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff99d95595a200/0x85f51a6b967145ac lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x85f51a6b967145b3 expref: -99 pid: 101416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051275.434228:0:6567:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1777051275.434248:0:6567:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.146@tcp lock: ffff99da7d506200/0x85f51a6b967146c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x85f51a6b967146cb expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051275.434264:0:6567:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da7d506200 already unused, calling callback (ffffffffc1208c20) 10000000:00010000:2.0:1777051275.434271:0:6567:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.146@tcp lock: ffff99da7d506200/0x85f51a6b967146c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x85f51a6b967146cb expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051275.434296:0:6567:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.146@tcp lock: ffff99da7d506200/0x85f51a6b967146c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x85f51a6b967146cb expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051275.434302:0:102736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff99d95595a200/0x85f51a6b967145ac lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x85f51a6b967145b3 expref: -99 pid: 101416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1777051275.434330:0:6567:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.146@tcp lock: ffff99da7d506200/0x85f51a6b967146c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x85f51a6b967146cb expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051275.434339:0:102736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.146@tcp lock: ffff99d95595a200/0x85f51a6b967145ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x85f51a6b967145b3 expref: -99 pid: 101416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051275.434368:0:102736:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1777051275.434385:0:102736:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:0.0:1777051275.434395:0:102736:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:0.0:1777051275.434488:0:102736:0:(tgt_mount.c:2065:server_put_super()) stopping lustre-MDT0000 00000020:01000000:0.0:1777051275.434507:0:102736:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='FA') 00000020:00000080:0.0:1777051275.434516:0:102736:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:02000400:0.0:1777051275.434526:0:102736:0:(obd_config.c:932:class_cleanup()) Failing over lustre-MDT0000 00010000:00010000:1.0:1777051275.434534:0:13753:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1777051275.434559:0:13753:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.146@tcp lock: ffff99d955a98800/0x85f51a6b96714a91 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x85f51a6b96714a98 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051275.434581:0:13753:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d955a98800 already unused, calling callback (ffffffffc1208c20) 10000000:00010000:1.0:1777051275.434599:0:13753:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.146@tcp lock: ffff99d955a98800/0x85f51a6b96714a91 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x85f51a6b96714a98 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1777051275.434601:0:6567:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1777051275.434622:0:13753:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.146@tcp lock: ffff99d955a98800/0x85f51a6b96714a91 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x85f51a6b96714a98 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1777051275.434622:0:6567:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:2.0:1777051275.434630:0:6567:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 10000000:00010000:1.0:1777051275.434649:0:13753:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.146@tcp lock: ffff99d955a98800/0x85f51a6b96714a91 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x85f51a6b96714a98 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1777051275.435610:0:13753:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1777051275.435616:0:13753:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1777051275.435622:0:13753:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1777051275.435663:0:6567:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.146@tcp lock: ffff99da7d506200/0x85f51a6b967146c4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x85f51a6b967146cb expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051275.435679:0:6567:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1777051275.435696:0:13753:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.146@tcp lock: ffff99d955a98800/0x85f51a6b96714a91 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x85f51a6b96714a98 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051275.435723:0:13753:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1777051275.436217:0:6567:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.146@tcp lock: ffff99da7d506200/0x85f51a6b967146c4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x85f51a6b967146cb expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051275.436255:0:6567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.146@tcp lock: ffff99da7d506200/0x85f51a6b967146c4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x85f51a6b967146cb expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051275.436266:0:13753:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.146@tcp lock: ffff99d955a98800/0x85f51a6b96714a91 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x85f51a6b96714a98 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051275.436289:0:13753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.146@tcp lock: ffff99d955a98800/0x85f51a6b96714a91 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x85f51a6b96714a98 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051275.436289:0:6567:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:3.0:1777051275.436296:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f827800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3680:1863365452527872:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1777051275.436298:0:6567:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.146@tcp lock: ffff99d95595a200/0x85f51a6b967145ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x85f51a6b967145b3 expref: -99 pid: 101416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051275.436339:0:6567:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d95595a200 already unused, calling callback (ffffffffc1208c20) 10000000:00010000:2.0:1777051275.436351:0:6567:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.146@tcp lock: ffff99d95595a200/0x85f51a6b967145ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x85f51a6b967145b3 expref: -99 pid: 101416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051275.436380:0:6567:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.146@tcp lock: ffff99d95595a200/0x85f51a6b967145ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x85f51a6b967145b3 expref: -99 pid: 101416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051275.436385:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051275.436392:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051275.436400:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:00010000:2.0:1777051275.436437:0:6567:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.146@tcp lock: ffff99d95595a200/0x85f51a6b967145ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x85f51a6b967145b3 expref: -99 pid: 101416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051275.436448:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1777051275.436453:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1777051275.436469:0:6567:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1777051275.436478:0:6567:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 00000100:00100000:1.0:1777051275.436487:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f9ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3678:1863365452527616:0@lo:103:ldlm_bl.0 10000000:01000000:2.0:1777051275.436492:0:6567:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:2.0:1777051275.436544:0:6567:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.146@tcp lock: ffff99d95595a200/0x85f51a6b967145ac lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x85f51a6b967145b3 expref: -99 pid: 101416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051275.436559:0:6567:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1777051275.436563:0:3680:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:2.0:1777051275.436586:0:6567:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.146@tcp lock: ffff99d95595a200/0x85f51a6b967145ac lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x85f51a6b967145b3 expref: -99 pid: 101416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051275.436595:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f9fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3680:1863365452527744:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1777051275.436609:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1777051275.436625:0:6567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.146@tcp lock: ffff99d95595a200/0x85f51a6b967145ac lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x85f51a6b967145b3 expref: -99 pid: 101416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051275.436667:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777051275.436672:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777051275.436680:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1777051275.436689:0:3678:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1777051275.436709:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051275.437383:0:24467:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452527872 00000100:00100000:3.0:1777051275.437394:0:24467:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452527872 00000100:00100000:3.0:1777051275.437514:0:24467:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452527616 00000100:00100000:3.0:1777051275.437522:0:24467:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452527616 00000100:00100000:3.0:1777051275.437589:0:24467:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452527744 00000100:00100000:3.0:1777051275.437596:0:24467:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452527744 00000100:00100000:3.0:1777051275.437667:0:24467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13664 00000100:00100000:3.0:1777051275.437689:0:24467:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fd65880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f9351a01-5b0e-4470-97fd-58b9b4b312a2+24:3680:x1863365452527872:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1777051275.437718:0:24467:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777051275.438173:0:24467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99da713e2000/0x85f51a6b96714a98 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x85f51a6b96714a91 expref: 24 pid: 101422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051275.438213:0:24467:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1777051275.438355:0:24467:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fd65880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f9351a01-5b0e-4470-97fd-58b9b4b312a2+23:3680:x1863365452527872:12345-0@lo:103:ldlm_bl.0 Request processed in 674us (1952us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051275.438379:0:24467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13664 00000100:00100000:3.0:1777051275.438468:0:24467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13665 00000100:00100000:3.0:1777051275.438485:0:24467:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f826680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f9351a01-5b0e-4470-97fd-58b9b4b312a2+22:3678:x1863365452527616:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1777051275.438514:0:24467:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777051275.438543:0:24467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d95595ae00/0x85f51a6b967145c1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x85f51a6b967145ba expref: 22 pid: 101425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051275.438565:0:24467:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1777051275.438636:0:24467:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f826680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f9351a01-5b0e-4470-97fd-58b9b4b312a2+21:3678:x1863365452527616:12345-0@lo:103:ldlm_bl.0 Request processed in 155us (2042us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051275.438652:0:24467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13665 00000100:00100000:3.0:1777051275.438692:0:24467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13666 00000100:00100000:3.0:1777051275.438716:0:24467:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da6fd47450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f9351a01-5b0e-4470-97fd-58b9b4b312a2+20:3680:x1863365452527744:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1777051275.438733:0:24467:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777051275.438761:0:24467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d955a8e600/0x85f51a6b967146cb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x85f51a6b967146c4 expref: 20 pid: 101425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051275.438789:0:24467:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1777051275.438840:0:24467:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da6fd47450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f9351a01-5b0e-4470-97fd-58b9b4b312a2+19:3680:x1863365452527744:12345-0@lo:103:ldlm_bl.0 Request processed in 127us (2149us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051275.438853:0:24467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13666 00000100:00100000:1.0:1777051275.438883:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f9fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3678:1863365452528000:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1777051275.439046:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f9fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3680:1863365452527744:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1777051275.439061:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051275.439087:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f827800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3680:1863365452527872:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1777051275.440139:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f9ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3678:1863365452527616:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1777051275.440668:0:47827:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452528000 00000100:00100000:1.0:1777051275.440679:0:47827:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452528000 00000100:00100000:1.0:1777051275.441675:0:47827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13667 00000100:00100000:1.0:1777051275.441708:0:47827:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f826300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:f9351a01-5b0e-4470-97fd-58b9b4b312a2+19:3678:x1863365452528000:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1777051275.441726:0:47827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1777051275.441758:0:47827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d943ebae00/0x85f51a6b967145b3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x85f51a6b967145ac expref: 19 pid: 101425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051275.441792:0:47827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1777051275.441888:0:47827:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f826300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:f9351a01-5b0e-4470-97fd-58b9b4b312a2+18:3678:x1863365452528000:12345-0@lo:103:ldlm_bl.0 Request processed in 198us (2830us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051275.441913:0:47827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13667 00000100:00100000:1.0:1777051275.442045:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f9fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3678:1863365452528000:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1777051275.442089:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00000080:0.0:1777051275.457770:0:102736:0:(mdt_handler.c:8165:mdt_iocontrol()) lustre-MDT0000: cmd=40086672 len=0 karg=0000000000000000 uarg=0000000000000000 00000020:00000080:0.0:1777051275.466707:0:102736:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 6/13 00000020:00080000:0.0:1777051275.466734:0:102736:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff99da45f4e000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1777051275.466748:0:102736:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff99d944c19000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1777051275.466768:0:102736:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff99d944b1b000 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1777051275.466793:0:102736:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff99d950ad8000 c11b6966-0775-44d2-bdc6-c74c26eb2226 192.168.201.46@tcp 13 (0 0 8) 0 0 0 0: 0000000000000000 12884904250 stale:0 00000020:00080000:0.0:1777051275.466815:0:102736:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff99d950adc800 2dd4696c-edce-4cd1-86d2-dbd2ff957fa1 192.168.201.46@tcp 16 (0 0 11) 0 0 0 0: 0000000000000000 12884904249 stale:0 00000020:00080000:0.0:1777051275.466828:0:102736:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff99d950ade800 lustre-MDT0001-mdtlov_UUID 0@lo 6 (0 0 1) 0 0 0 0: 0000000000000000 12884902301 stale:0 00000020:00080000:0.0:1777051275.466839:0:102736:0:(genops.c:1574:class_disconnect_exports()) OBD device 5 (ffff99d94bef8000) has exports, disconnecting them 00000020:00080000:0.0:1777051275.466860:0:102736:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff99da45f4e000), last request at 1777051274 00000020:00000080:0.0:1777051275.466872:0:102736:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x85f51a6b967147ce 00000100:00080000:0.0:1777051275.466896:0:102736:0:(import.c:65:import_set_state_nolock()) ffff99da45f4c000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1777051275.466952:0:102736:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff99da45f4e000): rc 0 00000020:00000080:0.0:1777051275.466959:0:102736:0:(genops.c:906:class_export_put()) final put ffff99da45f4e000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:0.0:1777051275.467003:0:102736:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff99d944c19000), last request at 1777051274 00000020:00000080:0.0:1777051275.467022:0:102736:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x85f51a6b967147c7 00010000:00010000:1.0:1777051275.467022:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1777051275.467034:0:102736:0:(import.c:65:import_set_state_nolock()) ffff99d944c1b000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1777051275.467070:0:102736:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff99d944c19000): rc 0 00000020:00000080:0.0:1777051275.467078:0:102736:0:(genops.c:906:class_export_put()) final put ffff99d944c19000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:2.0:1777051275.467083:0:48457:0:(genops.c:865:class_export_destroy()) destroying export ffff99da45f4e000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00080000:0.0:1777051275.467120:0:102736:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff99d944b1b000), last request at 1777051248 00000020:00000080:0.0:1777051275.467138:0:102736:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x85f51a6b967147c0 00010000:00010000:1.0:1777051275.468063:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1777051275.468073:0:102736:0:(import.c:65:import_set_state_nolock()) ffff99d944b1f000 : changing import state from FULL to CLOSED 00000020:00000080:2.0:1777051275.468081:0:48457:0:(genops.c:865:class_export_destroy()) destroying export ffff99d944c19000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1777051275.468165:0:48457:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99da45f4c000 for lustre-MDT0000 00000020:00080000:1.0:1777051275.468174:0:102736:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff99d944b1b000): rc 0 00000020:00000080:1.0:1777051275.468182:0:102736:0:(genops.c:906:class_export_put()) final put ffff99d944b1b000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:2.0:1777051275.468191:0:48457:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99d944c1b000 for lustre-MDT0000 00010000:00010000:2.0:1777051275.468228:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1777051275.468317:0:102736:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 192.168.201.46@tcp (ffff99d950ad8000), last request at 1777051271 00000020:00000080:1.0:1777051275.468328:0:102736:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x85f51a6b96714615 00000020:00000080:0.0:1777051275.468350:0:48457:0:(genops.c:865:class_export_destroy()) destroying export ffff99d944b1b000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00010000:1.0:1777051275.468353:0:102736:0:(genops.c:1942:obd_stale_export_put()) Put export ffff99d950ad8000: total 1 00000100:00080000:1.0:1777051275.468367:0:102736:0:(import.c:65:import_set_state_nolock()) ffff99d9434a4800 : changing import state from FULL to CLOSED 00000020:00000080:0.0:1777051275.468504:0:48457:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99d944b1f000 for lustre-MDT0000 00000020:00010000:2.0:1777051275.468519:0:6568:0:(genops.c:1928:obd_stale_export_get()) Get export ffff99d950ad8000: total 0 00000020:00080000:1.0:1777051275.468597:0:102736:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.201.46@tcp (ffff99d950ad8000): rc 0 00000020:00080000:1.0:1777051275.468607:0:102736:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 192.168.201.46@tcp (ffff99d950adc800), last request at 1777051271 00000020:00000080:1.0:1777051275.468636:0:102736:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x85f51a6b9671460e 00010000:00010000:2.0:1777051275.468639:0:6568:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff99d950ad8000, canceled 0 locks, left on hash table 8. 00000020:00010000:1.0:1777051275.468651:0:102736:0:(genops.c:1942:obd_stale_export_put()) Put export ffff99d950adc800: total 0 00000100:00080000:1.0:1777051275.468660:0:102736:0:(import.c:65:import_set_state_nolock()) ffff99d9434a0800 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1777051275.469180:0:6568:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d785600/0x85f51a6b96714a28 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5eaf expref: 9 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1777051275.469199:0:102736:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.201.46@tcp (ffff99d950adc800): rc 0 00000020:00010000:0.0:1777051275.469228:0:13753:0:(genops.c:1928:obd_stale_export_get()) Get export ffff99d950adc800: total 0 00000020:00080000:1.0:1777051275.469321:0:102736:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff99d950ade800), last request at 1777051243 00010000:00010000:0.0:1777051275.469345:0:13753:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff99d950adc800, canceled 0 locks, left on hash table 11. 00000020:00000080:1.0:1777051275.469345:0:102736:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x85f51a6b96714607 00000020:00010000:1.0:1777051275.469360:0:102736:0:(genops.c:1942:obd_stale_export_put()) Put export ffff99d950ade800: total 0 00000100:00080000:1.0:1777051275.469370:0:102736:0:(import.c:65:import_set_state_nolock()) ffff99d944c1a800 : changing import state from FULL to CLOSED 00000020:00010000:1.0:1777051275.469453:0:38719:0:(genops.c:1928:obd_stale_export_get()) Get export ffff99d950ade800: total 0 00010000:00010000:0.0:1777051275.469473:0:13753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d955a8e000/0x85f51a6b967147e3 lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0x9d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b50a1 expref: 12 pid: 101457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051275.469476:0:6568:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e9d7200/0x85f51a6b9671483e lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0xb0:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b555c expref: 8 pid: 101457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051275.469579:0:38719:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff99d950ade800, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1777051275.469595:0:6568:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e9d7e00/0x85f51a6b96714837 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b0fbe expref: 7 pid: 101457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051275.469642:0:13753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d955a8ec00/0x85f51a6b967147dc lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0x9f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b50af expref: 11 pid: 101457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051275.469673:0:38719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e9d7000/0x85f51a6b96714845 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x85f51a6b96149c5e expref: 5 pid: 101457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051275.469692:0:6568:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e9d7400/0x85f51a6b96714830 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x96:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b244e expref: 6 pid: 101457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051275.469722:0:38719:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff99d950ade800, canceled 1 locks, left on hash table 0. 00010000:00010000:0.0:1777051275.469742:0:13753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da429d6400/0x85f51a6b967147f8 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x96:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b41c1 expref: 10 pid: 101457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051275.469763:0:6568:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94ffbc600/0x85f51a6b96714822 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xc2:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b4882 expref: 5 pid: 101457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051275.469849:0:13753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da429d7e00/0x85f51a6b96714806 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5d12 expref: 9 pid: 101457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051275.469857:0:6568:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da429d7600/0x85f51a6b9671481b lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xc4:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b4e9b expref: 4 pid: 101457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051275.469949:0:6568:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da429d6600/0x85f51a6b96714814 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xc6:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b54f3 expref: 3 pid: 101457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051275.470024:0:6568:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94ffbda00/0x85f51a6b96714829 lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0x9e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b4ee8 expref: 2 pid: 101457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051275.470042:0:13753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e9d6600/0x85f51a6b9671485a lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0xb0:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5707 expref: 8 pid: 101457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051275.470077:0:6568:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff99d950ad8000, canceled 8 locks, left on hash table 0. 00010000:00010000:0.0:1777051275.470141:0:13753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da429d7c00/0x85f51a6b9671480d lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0xb2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5715 expref: 7 pid: 101457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051275.470185:0:13753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e9d6800/0x85f51a6b96714853 lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0x51:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b445a expref: 6 pid: 101457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051275.470228:0:13753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d955a8f600/0x85f51a6b967147f1 lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0xb5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5731 expref: 5 pid: 101457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051275.470328:0:13753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d955a8fa00/0x85f51a6b967147ea lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x57:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b0bdc expref: 4 pid: 101457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051275.470393:0:13753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da429d6800/0x85f51a6b967147ff lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x96:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b245c expref: 3 pid: 101457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051275.470477:0:13753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e9d6400/0x85f51a6b9671484c lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0xb1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b570e expref: 2 pid: 101457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051275.470521:0:13753:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff99d950adc800, canceled 11 locks, left on hash table 0. 00000020:00080000:3.0:1777051275.476580:0:102736:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff99d950ade800): rc 0 00000004:00000080:3.0:1777051275.476596:0:102736:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffb0894721bae0 00000100:00080000:3.0:1777051275.476636:0:102736:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1777051275.476642:0:102736:0:(client.c:3101:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1777051275.533682:0:102736:0:(pinger.c:396:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1777051275.533733:0:102736:0:(import.c:65:import_set_state_nolock()) ffff99da71c60000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1777051275.533973:0:102736:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1777051275.533982:0:102736:0:(client.c:3101:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968347 gen 3 00000004:00080000:3.0:1777051275.534005:0:102736:0:(osp_dev.c:1629:osp_import_event()) got inactive 00000100:00080000:3.0:1777051275.537617:0:102736:0:(pinger.c:396:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1777051275.537646:0:102736:0:(import.c:65:import_set_state_nolock()) ffff99da7b35c800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1777051275.537663:0:102736:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1777051275.537669:0:102736:0:(client.c:3101:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968350 gen 3 00000004:00080000:3.0:1777051275.537690:0:102736:0:(osp_dev.c:1629:osp_import_event()) got inactive 00000100:00080000:3.0:1777051275.541713:0:102736:0:(pinger.c:396:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1777051275.541743:0:102736:0:(import.c:65:import_set_state_nolock()) ffff99da58bfc800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:3.0:1777051275.541827:0:102736:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff99d94bef8000) has no exports 00000100:00100000:3.0:1777051275.542549:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d942a0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452528512:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1777051275.542641:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051275.542720:0:8473:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452528512 00000100:00100000:3.0:1777051275.542732:0:8473:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452528512 00000100:00100000:3.0:1777051275.542789:0:8473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5545 00000100:00100000:3.0:1777051275.542805:0:8473:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942a0e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3678:x1863365452528512:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1777051275.542838:0:8473:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 440354112 pending 0 free 3862671360 avail 3631149056 00000100:00100000:3.0:1777051275.542906:0:8473:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942a0e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3678:x1863365452528512:12345-0@lo:13:osp-pre-0-1.0 Request processed in 104us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051275.542920:0:8473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5545 00000100:00100000:3.0:1777051275.542996:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d942a0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452528512:0@lo:13:osp-pre-0-1.0 00000020:00080000:3.0:1777051275.543620:0:102736:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff99d94bef8000) has no exports 00000020:00000080:1.0:1777051275.944275:0:38719:0:(genops.c:906:class_export_put()) final put ffff99d950ade800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1777051275.945000:0:84827:0:(genops.c:865:class_export_destroy()) destroying export ffff99d950ade800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:1.0:1777051275.945363:0:84827:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99d944c1a800 for lustre-MDT0000 00010000:00010000:1.0:1777051275.945384:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051275.945388:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051275.945392:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1777051275.945497:0:3676:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7fd67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3676:1863365452528128:0@lo:39:umount.0 00000100:00100000:1.0:1777051275.945578:0:3676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051275.945659:0:3676:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7fd65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3676:1863365452528256:0@lo:9:umount.0 00000100:00100000:1.0:1777051275.945983:0:3676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051275.946029:0:3676:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d942a0c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3676:1863365452528384:0@lo:9:umount.0 00000100:00100000:1.0:1777051275.946063:0:3676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051275.948439:0:27887:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452528256 00000100:00100000:1.0:1777051275.948452:0:27887:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452528256 00000100:00100000:1.0:1777051275.948583:0:27887:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452528384 00000100:00100000:1.0:1777051275.948590:0:27887:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452528384 00000100:00100000:1.0:1777051275.948627:0:27887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7946 00000100:00100000:1.0:1777051275.948640:0:27887:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f827b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3676:x1863365452528256:12345-0@lo:9:umount.0 00000020:00000080:1.0:1777051275.948672:0:27887:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x85f51a6b96714669 00000100:00080000:1.0:1777051275.948685:0:27887:0:(import.c:65:import_set_state_nolock()) ffff99d94119c000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1777051275.949033:0:27887:0:(tgt_lastrcvd.c:732:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294968347 00000100:00100000:1.0:1777051275.949588:0:27887:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f827b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+2:3676:x1863365452528256:12345-0@lo:9:umount.0 Request processed in 947us (3888us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051275.949600:0:27887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7946 00000100:00100000:1.0:1777051275.949626:0:27887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7947 00000100:00100000:1.0:1777051275.949637:0:27887:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f826a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3676:x1863365452528384:12345-0@lo:9:umount.0 00000020:00000080:1.0:1777051275.949656:0:27887:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x85f51a6b9671467e 00000100:00080000:1.0:1777051275.949663:0:27887:0:(import.c:65:import_set_state_nolock()) ffff99d942e07000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1777051275.949698:0:27887:0:(tgt_lastrcvd.c:732:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294968350 00000100:00100000:1.0:1777051275.949821:0:27887:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f826a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+2:3676:x1863365452528384:12345-0@lo:9:umount.0 Request processed in 184us (3754us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051275.949833:0:27887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7947 00000100:00080000:1.0:1777051275.950458:0:3676:0:(import.c:65:import_set_state_nolock()) ffff99da7b35c800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1777051275.950470:0:3676:0:(osp_dev.c:1613:osp_import_event()) got disconnected 00000004:00080000:1.0:1777051275.950473:0:3676:0:(osp_dev.c:1629:osp_import_event()) got inactive 00000100:00100000:1.0:1777051275.950478:0:3676:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7fd65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3676:1863365452528256:0@lo:9:umount.0 00000100:00080000:1.0:1777051275.950494:0:3676:0:(import.c:65:import_set_state_nolock()) ffff99da58bfc800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1777051275.950509:0:3676:0:(osp_dev.c:1613:osp_import_event()) got disconnected 00000004:00080000:1.0:1777051275.950511:0:3676:0:(osp_dev.c:1629:osp_import_event()) got inactive 00000100:00100000:1.0:1777051275.950515:0:3676:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d942a0c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3676:1863365452528384:0@lo:9:umount.0 00010000:00010000:1.0:1777051275.950545:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051275.964955:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1777051275.996665:0:11727:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452528128 00000100:00100000:1.0:1777051275.996684:0:11727:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452528128 00000100:00100000:1.0:1777051275.996765:0:11727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8005 00000100:00100000:1.0:1777051275.996780:0:11727:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f825180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3676:x1863365452528128:12345-0@lo:39:umount.0 00000020:00000080:1.0:1777051275.996825:0:11727:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x85f51a6b96714654 00000100:00080000:1.0:1777051275.996837:0:11727:0:(import.c:65:import_set_state_nolock()) ffff99da7b5fa800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1777051275.996862:0:11727:0:(tgt_lastrcvd.c:732:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294970573 00000100:00100000:1.0:1777051275.997088:0:11727:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f825180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+3:3676:x1863365452528128:12345-0@lo:39:umount.0 Request processed in 309us (51509us total) trans 4294970574 rc 0/0 00000100:00100000:1.0:1777051275.997101:0:11727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8005 00000100:00080000:1.0:1777051275.997185:0:3676:0:(import.c:65:import_set_state_nolock()) ffff99da71c60000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1777051275.997233:0:3676:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7fd67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3676:1863365452528128:0@lo:39:umount.0 00010000:00010000:1.0:1777051275.997262:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1777051275.998767:0:6568:0:(genops.c:906:class_export_put()) final put ffff99d950ad8000/c11b6966-0775-44d2-bdc6-c74c26eb2226 00000020:00000080:2.0:1777051275.998953:0:48457:0:(genops.c:865:class_export_destroy()) destroying export ffff99d950ad8000/c11b6966-0775-44d2-bdc6-c74c26eb2226 for lustre-MDT0000 00000020:00000080:2.0:1777051275.999039:0:48457:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99d9434a4800 for lustre-MDT0000 00010000:00010000:2.0:1777051275.999055:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777051275.999058:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777051275.999061:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1777051276.018441:0:13753:0:(genops.c:906:class_export_put()) final put ffff99d950adc800/2dd4696c-edce-4cd1-86d2-dbd2ff957fa1 00000020:00000080:2.0:1777051276.018533:0:84827:0:(genops.c:865:class_export_destroy()) destroying export ffff99d950adc800/2dd4696c-edce-4cd1-86d2-dbd2ff957fa1 for lustre-MDT0000 00010000:00010000:1.0:1777051276.018595:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051276.018603:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051276.018610:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1777051276.018646:0:84827:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99d9434a0800 for lustre-MDT0000 00000020:00000080:3.0:1777051276.053781:0:102736:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x85f51a6b9671462a 00000020:00000080:3.0:1777051276.053799:0:102736:0:(genops.c:906:class_export_put()) final put ffff99da58bf8800/lustre-QMT0000_UUID 00000020:01000000:3.0:1777051276.053830:0:102736:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:2.0:1777051276.053902:0:84827:0:(genops.c:865:class_export_destroy()) destroying export ffff99da58bf8800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:3.0:1777051276.053938:0:102736:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1777051276.053953:0:102736:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1777051276.053960:0:102736:0:(genops.c:1579:class_disconnect_exports()) OBD device 7 (ffff99d941ce0000) has no exports 00000020:00000080:3.0:1777051276.054383:0:102736:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x85f51a6b96714623 00000020:00000080:3.0:1777051276.054393:0:102736:0:(genops.c:906:class_export_put()) final put ffff99da71c6c000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1777051276.054540:0:102736:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1777051276.054554:0:102736:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1777051276.054559:0:102736:0:(genops.c:906:class_export_put()) final put ffff99d942fb0000/lustre-QMT0000_UUID 00000020:00000080:3.0:1777051276.054565:0:102736:0:(genops.c:865:class_export_destroy()) destroying export ffff99d942fb0000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:3.0:1777051276.054586:0:102736:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:0.0:1777051276.054716:0:84827:0:(genops.c:865:class_export_destroy()) destroying export ffff99da71c6c000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:3.0:1777051276.054805:0:102736:0:(lprocfs_status_server.c:298:lprocfs_free_client_stats()) stat ffff99d95cbf55a0 - data ffff99da70f74d80/ffff99da7fdefc00 00000020:01000000:3.0:1777051276.054995:0:102736:0:(lprocfs_status_server.c:298:lprocfs_free_client_stats()) stat ffff99d943697120 - data ffff99d956c43510/ffff99d95ce2b000 00000100:00080000:0.0:1777051276.107545:0:102736:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1777051276.107555:0:102736:0:(client.c:3101:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1777051276.107576:0:102736:0:(client.c:3139:ptlrpc_free_committed()) @@@ free request with old gen req@ffff99da7fd67800 x1863365452528128/t4294970574(4294970574) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1777051285 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1777051276.107899:0:102736:0:(import.c:321:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:0.0:1777051276.112051:0:102736:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1777051276.112059:0:102736:0:(client.c:3101:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968347 gen 4 00000004:00080000:0.0:1777051276.112083:0:102736:0:(osp_dev.c:1629:osp_import_event()) got inactive 00000100:00100000:0.0:1777051276.112085:0:102736:0:(import.c:321:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1777051276.112463:0:101436:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1777051276.112482:0:101436:0:(llog.c:858:llog_process_thread()) stop processing plain [0x1:0x23:0x0] index 1 count 1 00000040:00080000:1.0:1777051276.112506:0:101436:0:(llog.c:858:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 6 count 2 00000100:00080000:0.0:1777051276.114225:0:102736:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1777051276.114231:0:102736:0:(client.c:3101:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968350 gen 4 00000004:00080000:0.0:1777051276.114270:0:102736:0:(osp_dev.c:1629:osp_import_event()) got inactive 00000100:00100000:0.0:1777051276.114274:0:102736:0:(import.c:321:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1777051276.116168:0:101438:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1777051276.116176:0:101438:0:(llog.c:858:llog_process_thread()) stop processing plain [0x1:0x25:0x0] index 1 count 1 00000040:00080000:2.0:1777051276.116190:0:101438:0:(llog.c:858:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 6 count 2 00000020:00000080:0.0:1777051276.119022:0:102736:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x85f51a6b967145d6 00000020:00000080:0.0:1777051276.119724:0:102736:0:(genops.c:906:class_export_put()) final put ffff99d94405d000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1777051276.120066:0:84827:0:(genops.c:865:class_export_destroy()) destroying export ffff99d94405d000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1777051276.122015:0:102736:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x85f51a6b967145eb 00000020:00000080:0.0:1777051276.122024:0:102736:0:(genops.c:906:class_export_put()) final put ffff99da71c66800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1777051276.122059:0:102736:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:0.0:1777051276.122069:0:102736:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1777051276.122082:0:102736:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1777051276.122089:0:102736:0:(genops.c:1579:class_disconnect_exports()) OBD device 4 (ffff99d94befcd40) has no exports 00000004:01000000:0.0:1777051276.122454:0:102736:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1777051276.122468:0:102736:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x85f51a6b96714677 00000020:00000080:0.0:1777051276.122477:0:102736:0:(genops.c:906:class_export_put()) final put ffff99da45f4b000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1777051276.122489:0:102736:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:0.0:1777051276.122496:0:102736:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1777051276.122509:0:102736:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1777051276.122514:0:102736:0:(genops.c:1579:class_disconnect_exports()) OBD device 22 (ffff99da7ffc8000) has no exports 00000020:00000080:0.0:1777051276.122522:0:102736:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x85f51a6b96714670 00000020:00000080:0.0:1777051276.122538:0:102736:0:(genops.c:906:class_export_put()) final put ffff99da71c67000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1777051276.122687:0:84827:0:(genops.c:865:class_export_destroy()) destroying export ffff99da71c66800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:1.0:1777051276.122707:0:84827:0:(genops.c:865:class_export_destroy()) destroying export ffff99da45f4b000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1777051276.122722:0:84827:0:(genops.c:865:class_export_destroy()) destroying export ffff99da71c67000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1777051276.123294:0:102736:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:0.0:1777051276.123301:0:102736:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1777051276.123307:0:102736:0:(client.c:3101:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968350 gen 5 00000004:00080000:0.0:1777051276.123314:0:102736:0:(osp_dev.c:1629:osp_import_event()) got inactive 00000100:00100000:0.0:1777051276.123318:0:102736:0:(import.c:321:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1777051276.123392:0:102736:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1777051276.123429:0:102736:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1777051276.123441:0:102736:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x85f51a6b9671465b 00000020:00000080:0.0:1777051276.123449:0:102736:0:(genops.c:906:class_export_put()) final put ffff99da71c68000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1777051276.123458:0:102736:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:0.0:1777051276.123465:0:102736:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1777051276.123473:0:102736:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1777051276.123477:0:102736:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff99d941ce3380) has no exports 00000020:00000080:0.0:1777051276.123484:0:102736:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x85f51a6b9671464d 00000020:00000080:0.0:1777051276.123489:0:102736:0:(genops.c:906:class_export_put()) final put ffff99da7b35d000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1777051276.123750:0:84827:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99da58bfc800 for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1777051276.123763:0:84827:0:(genops.c:906:class_export_put()) final put ffff99da71c6e000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1777051276.123769:0:84827:0:(genops.c:865:class_export_destroy()) destroying export ffff99da71c6e000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:1.0:1777051276.123782:0:84827:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1777051276.123932:0:84827:0:(genops.c:865:class_export_destroy()) destroying export ffff99da71c68000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1777051276.123949:0:84827:0:(genops.c:865:class_export_destroy()) destroying export ffff99da7b35d000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1777051276.124299:0:102736:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:0.0:1777051276.124305:0:102736:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1777051276.124309:0:102736:0:(client.c:3101:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968347 gen 5 00000004:00080000:0.0:1777051276.124315:0:102736:0:(osp_dev.c:1629:osp_import_event()) got inactive 00000100:00100000:0.0:1777051276.124318:0:102736:0:(import.c:321:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1777051276.124359:0:102736:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1777051276.124369:0:102736:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:0.0:1777051276.124383:0:102736:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:0.0:1777051276.124390:0:102736:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x85f51a6b9671463f 00000020:00000080:0.0:1777051276.124396:0:102736:0:(genops.c:906:class_export_put()) final put ffff99d944058000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1777051276.124433:0:102736:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:0.0:1777051276.124438:0:102736:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1777051276.124445:0:102736:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1777051276.124449:0:102736:0:(genops.c:1579:class_disconnect_exports()) OBD device 8 (ffff99d941e68000) has no exports 00000020:00000080:0.0:1777051276.124455:0:102736:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x85f51a6b96714638 00000020:00000080:0.0:1777051276.124460:0:102736:0:(genops.c:906:class_export_put()) final put ffff99da71c62000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1777051276.124727:0:84827:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99da7b35c800 for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1777051276.124739:0:84827:0:(genops.c:906:class_export_put()) final put ffff99d94405d800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1777051276.124744:0:84827:0:(genops.c:865:class_export_destroy()) destroying export ffff99d94405d800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:1.0:1777051276.124757:0:84827:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1777051276.124880:0:84827:0:(genops.c:865:class_export_destroy()) destroying export ffff99d944058000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1777051276.124898:0:84827:0:(genops.c:865:class_export_destroy()) destroying export ffff99da71c62000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1777051276.127435:0:102736:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:1.0:1777051276.127443:0:102736:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1777051276.127448:0:102736:0:(client.c:3101:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1777051276.127465:0:102736:0:(import.c:321:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1777051276.127532:0:84827:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99da71c60000 for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1777051276.127542:0:102736:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1777051276.127555:0:102736:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1777051276.127561:0:102736:0:(genops.c:906:class_export_put()) final put ffff99d94405f000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1777051276.127566:0:102736:0:(genops.c:865:class_export_destroy()) destroying export ffff99d94405f000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:1.0:1777051276.127577:0:102736:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1777051276.127719:0:102736:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1777051276.127728:0:102736:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1777051276.127735:0:102736:0:(genops.c:906:class_export_put()) final put ffff99da580b8800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1777051276.127740:0:102736:0:(genops.c:865:class_export_destroy()) destroying export ffff99da580b8800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1777051276.127748:0:102736:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1777051276.129183:0:102736:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x85f51a6b967145f2 00000020:00000080:1.0:1777051276.129194:0:102736:0:(genops.c:906:class_export_put()) final put ffff99da71c61000/lustre-MDD0000_UUID 00000020:01000000:1.0:1777051276.129206:0:102736:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:1.0:1777051276.129214:0:102736:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1777051276.129224:0:102736:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1777051276.129231:0:102736:0:(genops.c:1579:class_disconnect_exports()) OBD device 6 (ffff99d94befb380) has no exports 00000020:00000080:1.0:1777051276.129276:0:102736:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1777051276.129284:0:102736:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:1.0:1777051276.129292:0:102736:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x85f51a6b967145f9 00000020:00000080:1.0:1777051276.129298:0:102736:0:(genops.c:906:class_export_put()) final put ffff99da71c63000/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1777051276.129311:0:102736:0:(tgt_mount.c:185:server_put_mount()) put mount ffff99da44f8b000 from lustre-MDT0000, refs=3 00000020:01000004:1.0:1777051276.129316:0:102736:0:(obd_mount.c:701:lustre_put_lsi()) put ffff99da44f8b000 3 00000020:01000004:1.0:1777051276.129322:0:102736:0:(tgt_mount.c:118:server_deregister_mount()) deregister mount ffff99da44f8b000 from lustre-MDT0000 00000020:00000080:1.0:1777051276.129360:0:102736:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1777051276.129367:0:102736:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:1.0:1777051276.129372:0:102736:0:(genops.c:906:class_export_put()) final put ffff99d94405e800/lustre-MDT0000_UUID 00000020:00000080:1.0:1777051276.129376:0:102736:0:(genops.c:865:class_export_destroy()) destroying export ffff99d94405e800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:1.0:1777051276.129389:0:102736:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:00000080:2.0:1777051276.129502:0:84827:0:(genops.c:865:class_export_destroy()) destroying export ffff99da71c61000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:2.0:1777051276.129511:0:84827:0:(genops.c:906:class_export_put()) final put ffff99d944059000/lustre-MDD0000_UUID 00000020:00000080:2.0:1777051276.129515:0:84827:0:(genops.c:865:class_export_destroy()) destroying export ffff99d944059000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:2.0:1777051276.129540:0:84827:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:01000004:1.0:1777051276.129547:0:102736:0:(obd_mount.c:569:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:1.0:1777051276.129554:0:102736:0:(tgt_mount.c:253:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:1.0:1777051276.129559:0:102736:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:1.0:1777051276.129564:0:102736:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1777051276.129569:0:102736:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 2/5 00000020:00080000:1.0:1777051276.129581:0:102736:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff99d944b1c800 29c4352d-3260-4734-909d-9ea5de9e7fa4 192.168.201.46@tcp 11 (0 0 7) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1777051276.129592:0:102736:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff99d950adf800 f9351a01-5b0e-4470-97fd-58b9b4b312a2 0@lo 17 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1777051276.129599:0:102736:0:(genops.c:1574:class_disconnect_exports()) OBD device 1 (ffff99d94bef99c0) has exports, disconnecting them 00000020:00080000:1.0:1777051276.129609:0:102736:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 192.168.201.46@tcp (ffff99d944b1c800), last request at 1777051245 00000020:00000080:1.0:1777051276.129638:0:102736:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x85f51a6b96714788 00000020:00010000:1.0:1777051276.129647:0:102736:0:(genops.c:1942:obd_stale_export_put()) Put export ffff99d944b1c800: total 2 00000100:00080000:1.0:1777051276.129654:0:102736:0:(import.c:65:import_set_state_nolock()) ffff99d944b1f800 : changing import state from FULL to CLOSED 00000020:00000080:2.0:1777051276.129661:0:84827:0:(genops.c:865:class_export_destroy()) destroying export ffff99da71c63000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00080000:1.0:1777051276.129674:0:102736:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.201.46@tcp (ffff99d944b1c800): rc 0 00000020:00080000:1.0:1777051276.129682:0:102736:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff99d950adf800), last request at 1777051242 00000020:00010000:2.0:1777051276.129880:0:6567:0:(genops.c:1928:obd_stale_export_get()) Get export ffff99d944b1c800: total 0 00010000:00010000:2.0:1777051276.129887:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777051276.129936:0:6567:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff99d944b1c800, canceled 0 locks, left on hash table 7. 00010000:00010000:2.0:1777051276.129983:0:6567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d94ffbdc00/0x85f51a6b9671478f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5e7e expref: 8 pid: 101427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051276.130018:0:6567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d955a98c00/0x85f51a6b96714ad0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5ecb expref: 7 pid: 101425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051276.130041:0:6567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d955a8fc00/0x85f51a6b967147ab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5e9a expref: 6 pid: 101429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051276.130069:0:6567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d955a8e800/0x85f51a6b967147b9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5ea8 expref: 5 pid: 101429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051276.130098:0:6567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99da713e3a00/0x85f51a6b96714796 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5e85 expref: 4 pid: 101425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051276.130126:0:6567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99da713e3000/0x85f51a6b96714ac9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5ec4 expref: 3 pid: 101427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051276.130161:0:6567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d955a8e400/0x85f51a6b967147a4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5e93 expref: 2 pid: 101427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051276.130486:0:6567:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff99d944b1c800, canceled 7 locks, left on hash table 0. 00000020:00000080:2.0:1777051276.130530:0:6567:0:(genops.c:906:class_export_put()) final put ffff99d944b1c800/29c4352d-3260-4734-909d-9ea5de9e7fa4 00000020:00000080:1.0:1777051276.130540:0:102736:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x85f51a6b9671459e 00010000:00010000:2.0:1777051276.130551:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00010000:1.0:1777051276.130552:0:102736:0:(genops.c:1942:obd_stale_export_put()) Put export ffff99d950adf800: total 1 00010000:00010000:2.0:1777051276.130556:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1777051276.130560:0:102736:0:(import.c:65:import_set_state_nolock()) ffff99d950ad8800 : changing import state from FULL to CLOSED 00000020:00010000:2.0:1777051276.130562:0:6567:0:(genops.c:1928:obd_stale_export_get()) Get export ffff99d950adf800: total 1 00000020:00080000:1.0:1777051276.130585:0:102736:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff99d950adf800): rc 0 00000020:00080000:1.0:1777051276.130592:0:102736:0:(genops.c:1579:class_disconnect_exports()) OBD device 1 (ffff99d94bef99c0) has no exports 00010000:00010000:2.0:1777051276.130807:0:6567:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff99d950adf800, canceled 0 locks, left on hash table 13. 00010000:00010000:2.0:1777051276.130845:0:6567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d955a8e200/0x85f51a6b967146d9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x85f51a6b967146d2 expref: 14 pid: 101429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051276.130875:0:6567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d95595be00/0x85f51a6b9671473b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x85f51a6b96714734 expref: 13 pid: 101427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051276.130923:0:6567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d9442eba00/0x85f51a6b96714aa6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x85f51a6b96714a9f expref: 12 pid: 101425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051276.130950:0:6567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d94ffbd400/0x85f51a6b96714749 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x85f51a6b96714742 expref: 11 pid: 101429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051276.130980:0:6567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d955a99c00/0x85f51a6b96714ab4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x85f51a6b96714aad expref: 10 pid: 101424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051276.131007:0:6567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d943ebac00/0x85f51a6b96714757 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x85f51a6b96714750 expref: 9 pid: 101427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051276.131327:0:6567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99da713e2400/0x85f51a6b96714ac2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x85f51a6b96714abb expref: 8 pid: 101425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051276.131354:0:6567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99da7d507800/0x85f51a6b967146e7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x85f51a6b967146e0 expref: 7 pid: 101429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051276.131372:0:6567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d943ebbe00/0x85f51a6b96714765 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x85f51a6b9671475e expref: 6 pid: 101422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051276.131523:0:6567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99da7d507400/0x85f51a6b96714703 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x85f51a6b967146fc expref: 5 pid: 101425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051276.131544:0:6567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d94ffbd200/0x85f51a6b96714781 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x85f51a6b9671477a expref: 4 pid: 101425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051276.131572:0:6567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d95595ac00/0x85f51a6b96714711 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x85f51a6b9671470a expref: 3 pid: 101425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051276.131591:0:6567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d95595b200/0x85f51a6b9671472d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x85f51a6b96714726 expref: 2 pid: 101427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051276.131608:0:6567:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff99d950adf800, canceled 13 locks, left on hash table 0. 00000020:00000080:2.0:1777051276.131636:0:6567:0:(genops.c:906:class_export_put()) final put ffff99d950adf800/f9351a01-5b0e-4470-97fd-58b9b4b312a2 00010000:00010000:2.0:1777051276.131645:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777051276.131648:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777051276.131652:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1777051276.131666:0:84827:0:(genops.c:865:class_export_destroy()) destroying export ffff99d944b1c800/29c4352d-3260-4734-909d-9ea5de9e7fa4 for MGS 00000020:00000080:2.0:1777051276.131707:0:84827:0:(genops.c:865:class_export_destroy()) destroying export ffff99d950adf800/f9351a01-5b0e-4470-97fd-58b9b4b312a2 for MGS 00000020:00000080:2.0:1777051276.131746:0:84827:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99d944b1f800 for MGS 00000020:00000080:2.0:1777051276.131752:0:84827:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99d950ad8800 for MGS 00000100:00100000:2.0:1777051276.131900:0:101429:0:(service.c:3162:ptlrpc_main()) ll_mgs_0004: service thread [ffff99d943690400:101429] 4 exiting: rc = 0 00000100:00100000:2.0:1777051276.132050:0:101422:0:(service.c:3162:ptlrpc_main()) ll_mgs_0000: service thread [ffff99d953725000:101422] 0 exiting: rc = 1 00000100:00100000:2.0:1777051276.132145:0:101424:0:(service.c:3162:ptlrpc_main()) ll_mgs_0001: service thread [ffff99d95688d600:101424] 1 exiting: rc = 0 00000100:00100000:2.0:1777051276.132329:0:101427:0:(service.c:3162:ptlrpc_main()) ll_mgs_0003: service thread [ffff99d953725800:101427] 3 exiting: rc = 0 00010000:00010000:1.0:1777051276.132365:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1777051276.132492:0:101425:0:(service.c:3162:ptlrpc_main()) ll_mgs_0002: service thread [ffff99d95595c400:101425] 2 exiting: rc = 0 00000100:00100000:1.0:1777051276.132721:0:102736:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1777051276.132738:0:102736:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1777051276.132758:0:102736:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1777051276.132786:0:102736:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1777051276.132807:0:102736:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1777051276.132822:0:102736:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1777051276.132839:0:102736:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1777051276.132854:0:102736:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1777051276.132870:0:102736:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1777051276.132886:0:102736:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1777051276.132903:0:102736:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1777051276.132917:0:102736:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1777051276.132935:0:102736:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1777051276.132949:0:102736:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1777051276.132970:0:102736:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1777051276.132994:0:102736:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1777051276.133012:0:102736:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1777051276.133028:0:102736:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1777051276.133051:0:102736:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1777051276.133067:0:102736:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1777051276.133085:0:102736:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1777051276.133110:0:102736:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1777051276.133378:0:102736:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1777051276.133602:0:102736:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1777051276.133629:0:102736:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1777051276.133646:0:102736:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1777051276.133669:0:102736:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1777051276.133694:0:102736:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1777051276.133710:0:102736:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1777051276.133725:0:102736:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1777051276.133742:0:102736:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1777051276.133758:0:102736:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1777051276.133782:0:102736:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1777051276.133795:0:102736:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1777051276.133807:0:102736:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1777051276.133835:0:102736:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1777051276.133859:0:102736:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1777051276.133873:0:102736:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1777051276.133890:0:102736:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1777051276.133907:0:102736:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1777051276.133922:0:102736:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1777051276.133935:0:102736:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1777051276.133950:0:102736:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1777051276.133969:0:102736:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1777051276.133987:0:102736:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1777051276.134010:0:102736:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1777051276.134026:0:102736:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1777051276.134048:0:102736:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1777051276.134070:0:102736:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1777051276.134455:0:102736:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1777051276.134520:0:102736:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1777051276.134540:0:102736:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1777051276.134564:0:102736:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1777051276.134589:0:102736:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1777051276.134618:0:102736:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1777051276.134639:0:102736:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1777051276.134660:0:102736:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1777051276.134680:0:102736:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1777051276.134705:0:102736:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1777051276.134731:0:102736:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1777051276.134758:0:102736:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1777051276.134779:0:102736:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1777051276.134805:0:102736:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1777051276.134827:0:102736:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:1.0:1777051276.137002:0:102736:0:(lprocfs_status_server.c:298:lprocfs_free_client_stats()) stat ffff99da42ae9900 - data ffff99d94a30cd80/ffff99d94c00ac00 00000020:01000000:1.0:1777051276.137284:0:102736:0:(lprocfs_status_server.c:298:lprocfs_free_client_stats()) stat ffff99d95c9ea240 - data ffff99d9417cb438/ffff99d942c00c00 00000020:00000080:1.0:1777051276.139971:0:102736:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x85f51a6b96714597 00000020:00000080:1.0:1777051276.139984:0:102736:0:(genops.c:906:class_export_put()) final put ffff99da7dbef000/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1777051276.140008:0:102736:0:(tgt_mount.c:185:server_put_mount()) put mount ffff99da44f8b000 from MGS, refs=2 00000020:01000004:1.0:1777051276.140014:0:102736:0:(obd_mount.c:701:lustre_put_lsi()) put ffff99da44f8b000 2 00000020:01000004:1.0:1777051276.140019:0:102736:0:(tgt_mount.c:118:server_deregister_mount()) deregister mount ffff99da44f8b000 from MGS 00000020:00000080:2.0:1777051276.140066:0:48457:0:(genops.c:865:class_export_destroy()) destroying export ffff99da7dbef000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1777051276.140069:0:102736:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1777051276.140084:0:102736:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:1.0:1777051276.140090:0:102736:0:(genops.c:906:class_export_put()) final put ffff99da4a377800/MGS 00000020:00000080:1.0:1777051276.140095:0:102736:0:(genops.c:865:class_export_destroy()) destroying export ffff99da4a377800/MGS for MGS 00000020:01000000:1.0:1777051276.140108:0:102736:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:1.0:1777051276.140244:0:102736:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:1.0:1777051276.140251:0:102736:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1777051276.140266:0:102736:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1777051276.140275:0:102736:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff99da499c9800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1777051276.140285:0:102736:0:(genops.c:1574:class_disconnect_exports()) OBD device 28 (ffff99da46203380) has exports, disconnecting them 00000020:00080000:1.0:1777051276.140292:0:102736:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff99da499c9800), last request at 1777051243 00000020:00000080:1.0:1777051276.140297:0:102736:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x85f51a6b967146b6 00000020:00080000:1.0:1777051276.140312:0:102736:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff99da499c9800): rc 0 00000020:00000080:1.0:1777051276.140319:0:102736:0:(genops.c:906:class_export_put()) final put ffff99da499c9800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1777051276.140363:0:48457:0:(genops.c:865:class_export_destroy()) destroying export ffff99da499c9800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1777051276.143551:0:102736:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1777051276.143559:0:102736:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1777051276.143566:0:102736:0:(client.c:3101:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1777051276.143575:0:102736:0:(import.c:321:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1777051276.143738:0:102736:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1777051276.143752:0:102736:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1777051276.143785:0:102736:0:(obd_mount.c:701:lustre_put_lsi()) put ffff99da44f8b000 1 00000020:00000080:0.0:1777051276.143793:0:102736:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x85f51a6b96714589 00000020:00000080:0.0:1777051276.143800:0:102736:0:(genops.c:906:class_export_put()) final put ffff99da4a373800/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1777051276.143810:0:102736:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1777051276.143818:0:102736:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1777051276.143823:0:102736:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1777051276.143827:0:102736:0:(genops.c:1579:class_disconnect_exports()) OBD device 0 (ffff99da7ffccd40) has no exports 00000020:00000080:2.0:1777051276.144350:0:48457:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99d9410cc800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1777051276.144364:0:48457:0:(genops.c:906:class_export_put()) final put ffff99da499cc800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1777051276.144371:0:48457:0:(genops.c:865:class_export_destroy()) destroying export ffff99da499cc800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:2.0:1777051276.144381:0:48457:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:2.0:1777051276.144554:0:48457:0:(genops.c:865:class_export_destroy()) destroying export ffff99da4a373800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000400:00000100:1.0:1777051276.196916:0:3672:0:(lib-move.c:4517:lnet_parse_put()) Dropping PUT from 12345-192.168.201.46@tcp portal 26 match 1863365425862784 offset 0 length 224: 4 00000100:00100000:1.0:1777051276.196987:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051276.197072:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051276.197097:0:46494:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425862912 00000100:00100000:0.0:1777051276.197114:0:46494:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425862912 00000100:00100000:1.0:1777051276.197145:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051276.197208:0:46494:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425863040 00000100:00100000:0.0:1777051276.197539:0:46494:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425863040 00000100:00100000:2.0:1777051276.197556:0:27884:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425863168 00000100:00100000:2.0:1777051276.197570:0:27884:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425863168 00000100:00100000:0.0:1777051276.197998:0:46494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13148 00000100:00100000:0.0:1777051276.198025:0:46494:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f825880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c11b6966-0775-44d2-bdc6-c74c26eb2226+6:2438:x1863365425863040:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:2.0:1777051276.198039:0:27884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10210 00000100:00100000:2.0:1777051276.198064:0:27884:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f824700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+50:2439:x1863365425863168:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:0.0:1777051276.198163:0:46494:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f825880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c11b6966-0775-44d2-bdc6-c74c26eb2226+6:2438:x1863365425863040:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 145us (1017us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051276.198178:0:46494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13148 00000100:00100000:0.0:1777051276.198248:0:46494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111688 00000100:00100000:0.0:1777051276.198259:0:46494:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f827100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:0+-99:2439:x1863365425862912:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:1.0:1777051276.198277:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000020:00080000:0.0:1777051276.198287:0:46494:0:(tgt_handler.c:795:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.201.46@tcp 00000100:00100000:2.0:1777051276.198894:0:27884:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f824700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+50:2439:x1863365425863168:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 836us (1820us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051276.198911:0:27884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10210 00000100:00080000:2.0:1777051276.199106:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1777051276.199119:0:46494:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f827100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:0+-99:2439:x1863365425862912:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 852us (2127us total) trans 0 rc -107/-107 00000100:00080000:2.0:1777051276.199120:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1777051276.199141:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051276.199144:0:27885:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425863424 00000100:00100000:2.0:1777051276.199155:0:27885:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425863424 00000100:00100000:0.0:1777051276.199159:0:46494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111688 00000100:00100000:0.0:1777051276.199211:0:46494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111689 00000100:00100000:1.0:1777051276.199220:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051276.199232:0:46494:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f824a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:0+-99:2439:x1863365425863424:12345-192.168.201.46@tcp:400:kworker.0 00000020:00080000:0.0:1777051276.199247:0:46494:0:(tgt_handler.c:795:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.201.46@tcp 00000100:00100000:1.0:1777051276.199277:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051276.199307:0:46494:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f824a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:0+-99:2439:x1863365425863424:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 72us (2103us total) trans 0 rc -107/-107 00000100:00100000:0.0:1777051276.199321:0:46494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111689 00000100:00100000:0.0:1777051276.199351:0:46494:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425863552 00000100:00100000:0.0:1777051276.199360:0:46494:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425863552 00000100:00100000:1.0:1777051276.199363:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051276.199587:0:46494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13149 00000100:00100000:0.0:1777051276.199601:0:46494:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f824000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+48:2438:x1863365425863552:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:0.0:1777051276.199661:0:46494:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f824000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+48:2438:x1863365425863552:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 60us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051276.199676:0:46494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13149 00000100:00100000:0.0:1777051276.199765:0:8471:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425863296 00000100:00100000:0.0:1777051276.199774:0:8471:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425863296 00000100:00100000:1.0:1777051276.199777:0:13320:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425863680 00000100:00100000:1.0:1777051276.199809:0:13320:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425863680 00000100:00100000:0.0:1777051276.199848:0:8471:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425863808 00000100:00100000:0.0:1777051276.199858:0:8471:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425863808 00000100:00100000:1.0:1777051276.199898:0:13320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10211 00000100:00100000:1.0:1777051276.199919:0:13320:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f826d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+48:2438:x1863365425863296:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:0.0:1777051276.199963:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10212 00000100:00100000:0.0:1777051276.199985:0:8471:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f827800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+50:2439:x1863365425863680:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:1.0:1777051276.199996:0:13320:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f826d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+48:2438:x1863365425863296:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 75us (861us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051276.200014:0:13320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10211 00000100:00100000:1.0:1777051276.200051:0:13320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10213 00000100:00100000:0.0:1777051276.200080:0:8471:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f827800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+50:2439:x1863365425863680:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 93us (861us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051276.200080:0:13320:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f827480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+47:2438:x1863365425863808:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:0.0:1777051276.200512:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10212 00000100:00100000:1.0:1777051276.200521:0:13320:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f827480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+47:2438:x1863365425863808:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 437us (1144us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051276.200545:0:13320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10213 00000100:00080000:2.0:1777051276.201184:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1777051276.201193:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1777051276.201236:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000020:00000080:2.0:1777051276.252101:0:102736:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1777051276.252611:0:102736:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:2.0:1777051276.252621:0:102736:0:(genops.c:906:class_export_put()) final put ffff99da7dbe9800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1777051276.252634:0:102736:0:(genops.c:865:class_export_destroy()) destroying export ffff99da7dbe9800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1777051276.252654:0:102736:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:2.0:1777051276.253157:0:102736:0:(obd_mount.c:659:lustre_free_lsi()) Freeing lsi ffff99da44f8e800 00000020:02000400:2.0:1777051276.253325:0:102736:0:(tgt_mount.c:2134:server_put_super()) server umount lustre-MDT0000 complete 00000100:00100000:3.0:1777051276.265941:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051276.266035:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051276.266105:0:8492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425863936 00000100:00100000:0.0:1777051276.266131:0:8492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425863936 00000100:00100000:1.0:1777051276.266180:0:46497:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425864064 00000100:00100000:1.0:1777051276.266202:0:46497:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425864064 00000100:00100000:1.0:1777051276.266308:0:46497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111690 00000100:00100000:1.0:1777051276.266332:0:46497:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942a0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:0+-99:2435:x1863365425864064:12345-192.168.201.46@tcp:38:ptlrpcd_01_01.0 00000100:00100000:0.0:1777051276.266353:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111691 00000100:00100000:0.0:1777051276.266371:0:6579:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942a0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2435:x1863365425863936:12345-192.168.201.46@tcp:38:ptlrpcd_01_01.0 00010000:00020000:1.0:1777051276.266384:0:46497:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.201.46@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00020000:0.0:1777051276.266438:0:6579:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.201.46@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1777051276.266586:0:46497:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942a0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:0+-99:2435:x1863365425864064:12345-192.168.201.46@tcp:38:ptlrpcd_01_01.0 Request processed in 253us (542us total) trans 0 rc -19/-19 00000100:00100000:0.0:1777051276.266606:0:6579:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942a0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2435:x1863365425863936:12345-192.168.201.46@tcp:38:ptlrpcd_01_01.0 Request processed in 231us (676us total) trans 0 rc -19/-19 00000100:00100000:1.0:1777051276.266618:0:46497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111690 00000100:00100000:0.0:1777051276.266636:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111691 00010000:00010000:2.0:1777051276.375317:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051277.399125:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777051278.422511:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1777051279.127820:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f9fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452528640:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1777051279.127934:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051279.127989:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7fd67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3678:1863365452529024:0@lo:400:kworker.0 00000100:00100000:2.0:1777051279.128027:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f825c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452528896:0@lo:400:kworker.0 00000100:00100000:1.0:1777051279.128052:0:46498:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452528640 00000100:00100000:1.0:1777051279.128067:0:46498:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452528640 00000100:00100000:0.0:1777051279.128068:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7fd65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3679:1863365452529152:0@lo:400:kworker.0 00000100:00100000:3.0:1777051279.128439:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051279.128465:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051279.128482:0:46498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8006 00000100:00100000:1.0:1777051279.128497:0:46498:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da46270380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:0+-99:3679:x1863365452528640:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:1.0:1777051279.128513:0:46498:0:(tgt_handler.c:795:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1777051279.128533:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7d309880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3678:1863365452529536:0@lo:400:kworker.0 00000100:00100000:0.0:1777051279.128564:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051279.128567:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7d30bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452529408:0@lo:400:kworker.0 00000100:00100000:0.0:1777051279.128636:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7d308380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3679:1863365452529664:0@lo:400:kworker.0 00000100:00100000:1.0:1777051279.128772:0:46498:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da46270380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:0+-99:3679:x1863365452528640:12345-0@lo:41:osp-pre-0-1.0 Request processed in 271us (839us total) trans 0 rc -107/-107 00000100:00100000:3.0:1777051279.128776:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051279.128796:0:46498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8006 00000100:00100000:0.0:1777051279.128820:0:46494:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452529024 00000100:00100000:0.0:1777051279.128831:0:46494:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452529024 00000100:00100000:1.0:1777051279.128839:0:46498:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452528896 00000100:00100000:1.0:1777051279.128852:0:46498:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452528896 00000100:00100000:3.0:1777051279.128875:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f826680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3680:1863365452528768:0@lo:400:kworker.0 00000100:00100000:0.0:1777051279.128899:0:46494:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452529152 00000100:00100000:0.0:1777051279.128909:0:46494:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452529152 00000100:00100000:1.0:1777051279.128922:0:46498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8007 00000100:00100000:2.0:1777051279.128924:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000400:00000100:3.0:1777051279.128939:0:3680:0:(lib-move.c:4517:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1863365452528768 offset 0 length 224: 4 00000100:00100000:1.0:1777051279.128944:0:46498:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:0+-99:3677:x1863365452528896:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1777051279.128963:0:46498:0:(tgt_handler.c:795:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1777051279.128972:0:46494:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452529536 00000100:00100000:0.0:1777051279.128981:0:46494:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452529536 00000100:00100000:3.0:1777051279.129008:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7d308a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3680:1863365452529280:0@lo:400:kworker.0 00000100:00100000:0.0:1777051279.129040:0:46494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111692 00000100:00100000:0.0:1777051279.129055:0:46494:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942a0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:0+-99:3678:x1863365452529024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777051279.129069:0:27885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111693 00000020:00080000:0.0:1777051279.129078:0:46494:0:(tgt_handler.c:795:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1777051279.129084:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051279.129096:0:27885:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da46271880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:0+-99:3679:x1863365452529152:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1777051279.129113:0:27885:0:(tgt_handler.c:795:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1777051279.129507:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7d30ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3680:1863365452529792:0@lo:400:kworker.0 00000100:00100000:3.0:1777051279.129582:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051279.129619:0:27885:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da46271880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:0+-99:3679:x1863365452529152:12345-0@lo:400:kworker.0 Request processed in 518us (1051us total) trans 0 rc -107/-107 00000100:00100000:2.0:1777051279.129956:0:27885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111693 00000100:00100000:2.0:1777051279.129995:0:27885:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452529280 00000100:00100000:2.0:1777051279.130004:0:27885:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452529280 00000100:00100000:3.0:1777051279.130008:0:8492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111694 00000100:00100000:3.0:1777051279.130023:0:8492:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942a0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3678:x1863365452529536:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1777051279.130036:0:8492:0:(tgt_handler.c:795:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1777051279.130423:0:27885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13150 00000100:00100000:2.0:1777051279.130445:0:27885:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942a0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:lustre-MDT0001-lwp-OST0000_UUID+5:3680:x1863365452529280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051279.130455:0:8492:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942a0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3678:x1863365452529536:12345-0@lo:400:kworker.0 Request processed in 424us (1676us total) trans 0 rc -107/-107 00000100:00100000:3.0:1777051279.130472:0:8492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111694 00000100:00100000:3.0:1777051279.130553:0:27884:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452529408 00000100:00100000:2.0:1777051279.130557:0:27885:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942a0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:lustre-MDT0001-lwp-OST0000_UUID+5:3680:x1863365452529280:12345-0@lo:400:kworker.0 Request processed in 118us (1486us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051279.130564:0:27884:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452529408 00000100:00100000:2.0:1777051279.130580:0:27885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13150 00000100:00080000:2.0:1777051279.130631:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1777051279.130641:0:27884:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452529792 00000100:00080000:2.0:1777051279.130642:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1777051279.130651:0:27884:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452529792 00000100:00080000:2.0:1777051279.130688:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1777051279.130701:0:46498:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:0+-99:3677:x1863365452528896:12345-0@lo:400:kworker.0 Request processed in 1754us (2235us total) trans 0 rc -107/-107 00000100:00100000:1.0:1777051279.130720:0:46498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8007 00000100:00100000:3.0:1777051279.130731:0:27884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10214 00000100:00080000:2.0:1777051279.130747:0:3677:0:(recover.c:203:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00100000:3.0:1777051279.130757:0:27884:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3677:x1863365452529408:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1777051279.130761:0:3677:0:(import.c:65:import_set_state_nolock()) ffff99da7dbeb000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1777051279.130780:0:3677:0:(import.c:181:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:1.0:1777051279.130797:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10215 00000100:00100000:3.0:1777051279.130838:0:27884:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3677:x1863365452529408:12345-0@lo:400:kworker.0 Request processed in 92us (1921us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051279.130849:0:27884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10214 00000100:00100000:1.0:1777051279.130865:0:8468:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942a0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3680:x1863365452529792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051279.130925:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7d308a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3680:1863365452529280:0@lo:400:kworker.0 00000100:00100000:3.0:1777051279.130966:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7d30ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3680:1863365452529792:0@lo:400:kworker.0 00000100:00100000:1.0:1777051279.130969:0:8468:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942a0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3680:x1863365452529792:12345-0@lo:400:kworker.0 Request processed in 111us (1381us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051279.130990:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10215 00000100:00100000:3.0:1777051279.131111:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1777051279.131145:0:3678:0:(recover.c:203:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1777051279.131153:0:3678:0:(import.c:65:import_set_state_nolock()) ffff99da5f282000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1777051279.131162:0:3678:0:(import.c:181:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:0.0:1777051279.131172:0:46494:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942a0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:0+-99:3678:x1863365452529024:12345-0@lo:400:kworker.0 Request processed in 2108us (2732us total) trans 0 rc -107/-107 00000100:00080000:1.0:1777051279.131176:0:3678:0:(import.c:65:import_set_state_nolock()) ffff99da5f282000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:02020000:3.0:1777051279.131188:0:3679:0:(client.c:1490:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00100000:0.0:1777051279.131200:0:46494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111692 00000100:00080000:1.0:1777051279.131232:0:3678:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 7877 00000100:00100000:0.0:1777051279.131236:0:46494:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452529664 00000100:00100000:0.0:1777051279.131248:0:46494:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452529664 00000100:00080000:1.0:1777051279.131254:0:3678:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff99da5f282000 using connection 192.168.201.146@tcp/0@lo 00000100:00100000:1.0:1777051279.131299:0:3678:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99da7d309c00 x1863365452529920/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1777051279.131337:0:46494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13151 00000100:00100000:1.0:1777051279.131341:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7d309880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3678:1863365452529536:0@lo:400:kworker.0 00000100:00100000:0.0:1777051279.131398:0:46494:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942a0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0001-lwp-OST0001_UUID+5:3679:x1863365452529664:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1777051279.131408:0:3678:0:(recover.c:203:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1777051279.131423:0:3678:0:(import.c:65:import_set_state_nolock()) ffff99da7fa93000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1777051279.131431:0:3678:0:(import.c:181:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1777051279.131438:0:3678:0:(import.c:65:import_set_state_nolock()) ffff99da7fa93000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1777051279.131447:0:3678:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 7877 00000100:00080000:1.0:1777051279.131458:0:3678:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff99da7fa93000 using connection 192.168.201.146@tcp/0@lo 00000100:00100000:0.0:1777051279.131474:0:46494:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942a0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0001-lwp-OST0001_UUID+5:3679:x1863365452529664:12345-0@lo:400:kworker.0 Request processed in 119us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051279.131491:0:3678:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99da7d30ad80 x1863365452530048/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1777051279.131492:0:46494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13151 00000100:00100000:1.0:1777051279.131519:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7fd67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3678:1863365452529024:0@lo:400:kworker.0 00000100:00080000:0.0:1777051279.131539:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1777051279.131584:0:3676:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7d309c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3676:1863365452529920:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:1.0:1777051279.131638:0:3676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051279.131689:0:3676:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7d30ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3676:1863365452530048:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:1.0:1777051279.131731:0:3676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051279.131771:0:8492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452529920 00000100:00100000:0.0:1777051279.131782:0:8492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452529920 00000100:00100000:1.0:1777051279.131831:0:27885:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452530048 00000100:00100000:1.0:1777051279.131841:0:27885:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452530048 00000100:00100000:0.0:1777051279.131843:0:8492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111695 00000100:00100000:0.0:1777051279.131859:0:8492:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7d309880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3676:x1863365452529920:12345-0@lo:38:ptlrpcd_00_01.0 00000100:00100000:1.0:1777051279.131887:0:27885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111696 00010000:00020000:0.0:1777051279.131891:0:8492:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1777051279.131904:0:27885:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7d308a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:0+-99:3676:x1863365452530048:12345-0@lo:38:ptlrpcd_00_01.0 00010000:00020000:1.0:1777051279.131929:0:27885:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1777051279.132041:0:8492:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7d309880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3676:x1863365452529920:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 179us (400us total) trans 0 rc -19/-19 00000100:00100000:0.0:1777051279.132057:0:8492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111695 00000100:00100000:1.0:1777051279.132069:0:27885:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7d308a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:0+-99:3676:x1863365452530048:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 166us (336us total) trans 0 rc -19/-19 00000100:00100000:1.0:1777051279.132085:0:27885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111696 00000100:00080000:0.0:1777051279.132119:0:3676:0:(import.c:65:import_set_state_nolock()) ffff99da5f282000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1777051279.132131:0:3676:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1777051279.132139:0:3676:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7d309c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3676:1863365452529920:0@lo:38:ptlrpcd_00_01.0 00000100:00080000:0.0:1777051279.132162:0:3676:0:(import.c:65:import_set_state_nolock()) ffff99da7fa93000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1777051279.132169:0:3676:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1777051279.132175:0:3676:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7d30ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3676:1863365452530048:0@lo:38:ptlrpcd_00_01.0 00000100:00080000:3.0:1777051279.171621:0:3679:0:(recover.c:203:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1777051279.177521:0:3679:0:(import.c:213:ptlrpc_set_import_discon()) osp: import ffff99da7dbeb000 already not connected (conn 44, was 44): DISCONN 00000100:00080000:2.0:1777051279.177522:0:3677:0:(import.c:65:import_set_state_nolock()) ffff99da7dbeb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1777051279.177538:0:3677:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 7877 00000100:00080000:2.0:1777051279.177554:0:3677:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff99da7dbeb000 using connection 192.168.201.146@tcp/0@lo 00000100:00100000:2.0:1777051279.177628:0:3677:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d95088bb80 x1863365452530176/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1777051279.177688:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f825c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452528896:0@lo:400:kworker.0 00000100:00080000:0.0:1777051279.177731:0:3679:0:(recover.c:203:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1777051279.177745:0:3679:0:(import.c:65:import_set_state_nolock()) ffff99d94183b000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:00100000:2.0:1777051279.177758:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7d30bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452529408:0@lo:400:kworker.0 00000100:02000400:0.0:1777051279.177761:0:3679:0:(import.c:181:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1777051279.177779:0:3679:0:(import.c:65:import_set_state_nolock()) ffff99d94183b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1777051279.177794:0:3679:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 7877 00000100:00080000:0.0:1777051279.177812:0:3679:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff99d94183b000 using connection 192.168.201.146@tcp/0@lo 00000100:00100000:0.0:1777051279.177872:0:3679:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99da46270e00 x1863365452530304/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1777051279.177898:0:3676:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95088bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3676:1863365452530176:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:0.0:1777051279.177912:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7fd65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3679:1863365452529152:0@lo:400:kworker.0 00000100:00100000:0.0:1777051279.177954:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7d308380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3679:1863365452529664:0@lo:400:kworker.0 00000100:00100000:1.0:1777051279.178032:0:3676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051279.178174:0:11727:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452530176 00000100:00100000:2.0:1777051279.178190:0:11727:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452530176 00000100:00100000:1.0:1777051279.178238:0:3676:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da46270e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3676:1863365452530304:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:2.0:1777051279.178302:0:11727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8008 00000100:00100000:2.0:1777051279.178317:0:11727:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7d308380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3676:x1863365452530176:12345-0@lo:38:ptlrpcd_00_00.0 00000100:00100000:1.0:1777051279.178332:0:3676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00020000:2.0:1777051279.178396:0:11727:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1777051279.178532:0:21368:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452530304 00000100:00100000:2.0:1777051279.178550:0:11727:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7d308380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3676:x1863365452530176:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 231us (519us total) trans 0 rc -19/-19 00000100:00100000:0.0:1777051279.178552:0:21368:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452530304 00000100:00080000:1.0:1777051279.178591:0:3676:0:(import.c:65:import_set_state_nolock()) ffff99da7dbeb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:2.0:1777051279.178592:0:11727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8008 00000100:00080000:1.0:1777051279.178617:0:3676:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1777051279.178630:0:3676:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95088bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3676:1863365452530176:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:0.0:1777051279.178676:0:21368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111697 00000100:00100000:0.0:1777051279.178694:0:21368:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7d30bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3676:x1863365452530304:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:0.0:1777051279.178732:0:21368:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1777051279.178829:0:21368:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7d30bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3676:x1863365452530304:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 139us (509us total) trans 0 rc -19/-19 00000100:00100000:0.0:1777051279.178845:0:21368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111697 00000100:00080000:1.0:1777051279.179622:0:3676:0:(import.c:65:import_set_state_nolock()) ffff99d94183b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1777051279.179633:0:3676:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1777051279.179645:0:3676:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da46270e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3676:1863365452530304:0@lo:38:ptlrpcd_00_02.0 00010000:00010000:1.0:1777051279.447705:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1777051280.152447:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d950889500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452530432:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1777051280.152565:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051280.152955:0:8472:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452530432 00000100:00100000:2.0:1777051280.152975:0:8472:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452530432 00000100:00100000:2.0:1777051280.153102:0:8472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5546 00000100:00100000:2.0:1777051280.153123:0:8472:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da46271f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3677:x1863365452530432:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1777051280.153637:0:8472:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 430294336 pending 0 free 3645853696 avail 3414331392 00000100:00100000:2.0:1777051280.153880:0:8472:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da46271f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3677:x1863365452530432:12345-0@lo:13:osp-pre-1-1.0 Request processed in 756us (1308us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051280.153896:0:8472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5546 00000100:00100000:0.0:1777051280.154059:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d950889500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452530432:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1777051280.470939:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1777051280.662818:0:3677:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1777051280.663713:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94f42c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452530560:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1777051280.663809:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051280.664510:0:8473:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452530560 00000100:00100000:3.0:1777051280.664523:0:8473:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452530560 00000100:00100000:3.0:1777051280.664598:0:8473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5547 00000100:00100000:3.0:1777051280.664612:0:8473:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95088ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3677:x1863365452530560:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1777051280.664652:0:8473:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 440354112 pending 0 free 3862671360 avail 3631149056 00000100:00100000:3.0:1777051280.664734:0:8473:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95088ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3677:x1863365452530560:12345-0@lo:13:osp-pre-0-1.0 Request processed in 118us (918us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051280.664746:0:8473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5547 00000100:00100000:2.0:1777051280.664848:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94f42c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452530560:0@lo:13:osp-pre-0-1.0 00000400:00000100:2.0:1777051281.316290:0:3670:0:(lib-move.c:4517:lnet_parse_put()) Dropping PUT from 12345-192.168.201.46@tcp portal 26 match 1863365425864192 offset 0 length 224: 4 00000100:00100000:2.0:1777051281.316413:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051281.316483:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051281.316494:0:8628:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425864576 00000100:00100000:0.0:1777051281.316511:0:8628:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425864576 00000100:00100000:2.0:1777051281.316528:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051281.316607:0:8628:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425864704 00000100:00100000:0.0:1777051281.316616:0:8628:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425864704 00000100:00100000:2.0:1777051281.316617:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051281.316673:0:8628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10216 00000100:00100000:2.0:1777051281.316683:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051281.316704:0:8628:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d950889500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+50:2439:x1863365425864576:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:2.0:1777051281.316736:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051281.316778:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051281.316832:0:8628:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d950889500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+50:2439:x1863365425864576:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 138us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051281.316842:0:8628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10216 00000100:00100000:0.0:1777051281.316868:0:8628:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425865088 00000100:00100000:0.0:1777051281.316874:0:8628:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425865088 00000100:00100000:3.0:1777051281.316902:0:13320:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425865216 00000100:00100000:3.0:1777051281.316914:0:13320:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425865216 00000100:00100000:0.0:1777051281.316934:0:8628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10217 00000100:00100000:0.0:1777051281.316953:0:8628:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f825c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+48:2439:x1863365425864704:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:3.0:1777051281.316983:0:13320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10218 00000100:00100000:1.0:1777051281.317095:0:27882:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425864448 00000100:00100000:1.0:1777051281.317103:0:27882:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425864448 00000100:00100000:1.0:1777051281.317157:0:27882:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425864320 00000100:00100000:1.0:1777051281.317162:0:27882:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425864320 00000100:00100000:1.0:1777051281.317185:0:27882:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425864960 00000100:00100000:1.0:1777051281.317188:0:27882:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425864960 00000100:00100000:1.0:1777051281.317268:0:27882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13152 00000100:00100000:1.0:1777051281.317281:0:27882:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95088bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+6:2439:x1863365425864448:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:0.0:1777051281.317763:0:8628:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f825c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+48:2439:x1863365425864704:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 811us (1231us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051281.317781:0:8628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10217 00000100:00100000:0.0:1777051281.317820:0:8628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10219 00000100:00100000:2.0:1777051281.317823:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051281.317846:0:8628:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da4384ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+47:2439:x1863365425865216:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:0.0:1777051281.317916:0:8628:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da4384ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+47:2439:x1863365425865216:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 67us (1128us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051281.317932:0:8628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10219 00000100:00100000:0.0:1777051281.317989:0:46494:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425864832 00000100:00100000:0.0:1777051281.317997:0:46494:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425864832 00000100:00100000:2.0:1777051281.318007:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13153 00000100:00100000:2.0:1777051281.318027:0:6579:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d951fa3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+48:2439:x1863365425864960:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:0.0:1777051281.318065:0:46494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111698 00000100:00100000:0.0:1777051281.318079:0:46494:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d951fa2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:0+-99:2435:x1863365425864320:12345-192.168.201.46@tcp:38:kworker.0 00000100:00100000:2.0:1777051281.318106:0:6579:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d951fa3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+48:2439:x1863365425864960:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 81us (1426us total) trans 0 rc 0/0 00010000:00020000:0.0:1777051281.318115:0:46494:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.201.46@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1777051281.318174:0:46494:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d951fa2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:0+-99:2435:x1863365425864320:12345-192.168.201.46@tcp:38:kworker.0 Request processed in 92us (1557us total) trans 0 rc -19/-19 00000100:00100000:2.0:1777051281.318194:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13153 00000100:00100000:0.0:1777051281.318240:0:46494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111698 00000100:00100000:2.0:1777051281.318262:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111699 00000100:00100000:2.0:1777051281.318275:0:6579:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da4384c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2435:x1863365425864832:12345-192.168.201.46@tcp:38:kworker.0 00010000:00020000:2.0:1777051281.318301:0:6579:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.201.46@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1777051281.318382:0:6579:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da4384c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2435:x1863365425864832:12345-192.168.201.46@tcp:38:kworker.0 Request processed in 104us (564us total) trans 0 rc -19/-19 00000100:00100000:2.0:1777051281.318407:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111699 00000100:00100000:3.0:1777051281.318520:0:13320:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d951fa0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+50:2438:x1863365425865088:12345-192.168.201.46@tcp:400:kworker.0 00000100:00080000:0.0:1777051281.318555:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1777051281.318566:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1777051281.318572:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1777051281.318674:0:13320:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d951fa0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+50:2438:x1863365425865088:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 1674us (1936us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051281.318687:0:13320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10218 00000100:00100000:1.0:1777051281.325529:0:27882:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95088bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+6:2439:x1863365425864448:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 8238us (9036us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051281.325548:0:27882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13152 00010000:00010000:3.0:1777051281.494956:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1777051281.693812:0:7498:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1777051281.693832:0:7498:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0001: transno 4294970574 is committed 00000020:00000080:1.0:1777051281.693840:0:7498:0:(genops.c:906:class_export_put()) final put ffff99da7b5f8000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1777051281.693946:0:48457:0:(genops.c:865:class_export_destroy()) destroying export ffff99da7b5f8000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000001:00100000:0.0:1777051281.694047:0:9540:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1777051281.694056:0:9540:0:(genops.c:906:class_export_put()) final put ffff99d942e03800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1777051281.694432:0:48457:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99da7b5fa800 for lustre-MDT0001 00000001:00100000:2.0:1777051281.694435:0:8464:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1777051281.694445:0:8464:0:(genops.c:906:class_export_put()) final put ffff99d94119d000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1777051281.694449:0:48457:0:(genops.c:865:class_export_destroy()) destroying export ffff99d942e03800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1777051281.694514:0:48457:0:(genops.c:865:class_export_destroy()) destroying export ffff99d94119d000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1777051281.694546:0:48457:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99d942e07000 for lustre-OST0001 00000020:00000080:3.0:1777051281.694553:0:48457:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99d94119c000 for lustre-OST0000 00010000:00010000:2.0:1777051282.518621:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051283.542664:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1777051284.247489:0:48457:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1777051284.247499:0:48457:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1777051284.247505:0:48457:0:(import.c:65:import_set_state_nolock()) ffff99da7dbeb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1777051284.247517:0:48457:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 7908 00000100:00080000:3.0:1777051284.247527:0:48457:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1777051284.247537:0:48457:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff99da7dbeb000 using connection 192.168.201.146@tcp/0@lo 00000100:00100000:2.0:1777051284.247577:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94f42ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3679:1863365452530688:0@lo:400:kworker.0 00000100:00100000:3.0:1777051284.247579:0:48457:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d94f42e680 x1863365452530816/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1777051284.247626:0:48457:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1777051284.247632:0:48457:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1777051284.247635:0:48457:0:(import.c:65:import_set_state_nolock()) ffff99da7fa93000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1777051284.247640:0:48457:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 7908 00000100:00080000:3.0:1777051284.247913:0:48457:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1777051284.247922:0:48457:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff99da7fa93000 using connection 192.168.201.146@tcp/0@lo 00000100:00100000:1.0:1777051284.247952:0:3676:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94f42e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3676:1863365452530816:0@lo:38:kworker.0 00000400:00000100:2.0:1777051284.247952:0:3679:0:(lib-move.c:4517:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1863365452530688 offset 0 length 224: 4 00000100:00100000:3.0:1777051284.247954:0:48457:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d94f42ce00 x1863365452530944/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1777051284.247982:0:48457:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1777051284.247993:0:48457:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1777051284.247996:0:48457:0:(import.c:65:import_set_state_nolock()) ffff99d94183b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1777051284.248004:0:48457:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 7908 00000100:00080000:3.0:1777051284.248009:0:48457:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1777051284.248015:0:48457:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff99d94183b000 using connection 192.168.201.146@tcp/0@lo 00000100:00100000:3.0:1777051284.248042:0:48457:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d94f42c380 x1863365452531072/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1777051284.248062:0:3676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051284.248122:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94f42c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3680:1863365452531200:0@lo:400:kworker.0 00000100:00100000:1.0:1777051284.248126:0:3676:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94f42ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3676:1863365452530944:0@lo:38:kworker.0 00000100:00080000:3.0:1777051284.248143:0:48457:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1777051284.248151:0:48457:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1777051284.248154:0:48457:0:(import.c:65:import_set_state_nolock()) ffff99da5f282000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1777051284.248161:0:48457:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 7908 00000100:00080000:3.0:1777051284.248167:0:48457:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1777051284.248172:0:48457:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff99da5f282000 using connection 192.168.201.146@tcp/0@lo 00000100:00100000:3.0:1777051284.248244:0:48457:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99da70a33100 x1863365452531456/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1777051284.248248:0:3678:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1777051284.248261:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051284.248303:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da70a32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452531328:0@lo:400:kworker.0 00000100:00100000:0.0:1777051284.248310:0:47208:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452530816 00000100:00100000:0.0:1777051284.248321:0:47208:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452530816 00000100:00100000:2.0:1777051284.248368:0:3680:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1777051284.248389:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da70a32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3680:1863365452531712:0@lo:400:kworker.0 00000100:00100000:1.0:1777051284.248394:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051284.248396:0:47208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8009 00000100:00100000:3.0:1777051284.248405:0:6580:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452531200 00000100:00100000:3.0:1777051284.248416:0:6580:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452531200 00000100:00100000:0.0:1777051284.248418:0:47208:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7d30ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:0+-99:3676:x1863365452530816:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1777051284.248449:0:47208:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1777051284.248459:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da70a30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3678:1863365452531584:0@lo:400:kworker.0 00000100:00100000:2.0:1777051284.248472:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051284.248506:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13154 00000100:00100000:3.0:1777051284.248526:0:6580:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d9418f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3680:x1863365452531200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777051284.248541:0:47208:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7d30ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:0+-99:3676:x1863365452530816:12345-0@lo:38:kworker.0 Request processed in 122us (482us total) trans 0 rc -19/-19 00000100:00100000:1.0:1777051284.248555:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051284.248565:0:47208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8009 00000100:00100000:2.0:1777051284.248611:0:21368:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452531584 00000100:00100000:2.0:1777051284.248620:0:21368:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452531584 00000100:00100000:0.0:1777051284.248622:0:8628:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452531328 00000100:00100000:0.0:1777051284.248630:0:8628:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452531328 00000100:00100000:3.0:1777051284.248642:0:6580:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d9418f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3680:x1863365452531200:12345-0@lo:400:kworker.0 Request processed in 119us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051284.248651:0:8471:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452531712 00000100:00100000:3.0:1777051284.248653:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13154 00000100:00100000:1.0:1777051284.248663:0:8471:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452531712 00000100:00100000:3.0:1777051284.248695:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13155 00000100:00100000:3.0:1777051284.248708:0:6580:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fd65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3678:x1863365452531584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051284.248751:0:6580:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fd65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3678:x1863365452531584:12345-0@lo:400:kworker.0 Request processed in 50us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051284.248947:0:8628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10220 00000100:00100000:0.0:1777051284.248961:0:8628:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7d309c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3678:x1863365452531328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777051284.249017:0:8628:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7d309c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3678:x1863365452531328:12345-0@lo:400:kworker.0 Request processed in 60us (636us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051284.249027:0:8628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10220 00000100:00100000:0.0:1777051284.249055:0:8628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10221 00000100:00100000:0.0:1777051284.249069:0:8628:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d944071500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3680:x1863365452531712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777051284.249094:0:3676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051284.249136:0:3676:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94f42c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3676:1863365452531072:0@lo:38:kworker.0 00000100:00100000:0.0:1777051284.249141:0:8628:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d944071500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3680:x1863365452531712:12345-0@lo:400:kworker.0 Request processed in 71us (675us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051284.249417:0:8628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10221 00000100:00100000:2.0:1777051284.249450:0:21368:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452530944 00000100:00100000:2.0:1777051284.249459:0:21368:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452530944 00000100:00100000:1.0:1777051284.249470:0:3676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051284.249521:0:46494:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452531072 00000100:00100000:0.0:1777051284.249530:0:46494:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452531072 00000100:00100000:2.0:1777051284.249549:0:21368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111700 00000100:00080000:1.0:1777051284.249562:0:3676:0:(import.c:65:import_set_state_nolock()) ffff99da7dbeb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:2.0:1777051284.249571:0:21368:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fd67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3676:x1863365452530944:12345-0@lo:38:kworker.0 00000100:00080000:1.0:1777051284.249580:0:3676:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1777051284.249591:0:3676:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94f42e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3676:1863365452530816:0@lo:38:kworker.0 00000100:00100000:0.0:1777051284.249600:0:46494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111701 00010000:00020000:2.0:1777051284.249600:0:21368:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1777051284.249620:0:46494:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d944e12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:0+-99:3676:x1863365452531072:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1777051284.249637:0:3676:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da70a33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3676:1863365452531456:0@lo:38:kworker.0 00010000:00020000:0.0:1777051284.249645:0:46494:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1777051284.249811:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13155 00000100:00100000:2.0:1777051284.249975:0:21368:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fd67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3676:x1863365452530944:12345-0@lo:38:kworker.0 Request processed in 403us (880us total) trans 0 rc -19/-19 00000100:00100000:0.0:1777051284.249989:0:46494:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d944e12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:0+-99:3676:x1863365452531072:12345-0@lo:38:kworker.0 Request processed in 365us (519us total) trans 0 rc -19/-19 00000100:00100000:3.0:1777051284.249993:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da70a30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3678:1863365452531584:0@lo:400:kworker.0 00000100:00100000:2.0:1777051284.250000:0:21368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111700 00000100:00100000:0.0:1777051284.250022:0:46494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111701 00000100:00100000:3.0:1777051284.250039:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da70a32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452531328:0@lo:400:kworker.0 00000100:00080000:2.0:1777051284.250050:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1777051284.250061:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1777051284.250062:0:3676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1777051284.250070:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1777051284.250402:0:6581:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452531456 00000100:00100000:0.0:1777051284.250411:0:6581:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452531456 00000100:00080000:1.0:1777051284.250465:0:3676:0:(import.c:65:import_set_state_nolock()) ffff99da7fa93000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1777051284.250475:0:3676:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1777051284.250482:0:3676:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94f42ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3676:1863365452530944:0@lo:38:kworker.0 00000100:00100000:0.0:1777051284.250496:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111702 00000100:00080000:1.0:1777051284.250500:0:3676:0:(import.c:65:import_set_state_nolock()) ffff99d94183b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:0.0:1777051284.250510:0:6581:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f42e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3676:x1863365452531456:12345-0@lo:38:kworker.0 00000100:00080000:1.0:1777051284.250515:0:3676:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1777051284.250525:0:3676:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94f42c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3676:1863365452531072:0@lo:38:kworker.0 00010000:00020000:0.0:1777051284.250534:0:6581:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1777051284.250597:0:6581:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f42e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3676:x1863365452531456:12345-0@lo:38:kworker.0 Request processed in 89us (635us total) trans 0 rc -19/-19 00000100:00100000:0.0:1777051284.250611:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111702 00000100:00080000:1.0:1777051284.250620:0:3676:0:(import.c:65:import_set_state_nolock()) ffff99da5f282000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1777051284.250633:0:3676:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1777051284.250639:0:3676:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da70a33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3676:1863365452531456:0@lo:38:kworker.0 00000100:00100000:3.0:1777051284.250942:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da70a32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3680:1863365452531712:0@lo:400:kworker.0 00000100:00100000:3.0:1777051284.250959:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94f42c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3680:1863365452531200:0@lo:400:kworker.0 00010000:00010000:2.0:1777051284.567676:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1777051285.272676:0:3679:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1777051285.272697:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d944070e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452531840:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1777051285.273385:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051285.275355:0:47388:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452531840 00000100:00100000:2.0:1777051285.275368:0:47388:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452531840 00000100:00100000:2.0:1777051285.275451:0:47388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5548 00000100:00100000:2.0:1777051285.275465:0:47388:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da46272d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3679:x1863365452531840:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1777051285.275506:0:47388:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 430294336 pending 0 free 3645853696 avail 3414331392 00000100:00100000:2.0:1777051285.275606:0:47388:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da46272d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3679:x1863365452531840:12345-0@lo:13:osp-pre-1-1.0 Request processed in 141us (2220us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051285.275619:0:47388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5548 00000100:00100000:0.0:1777051285.275709:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d944070e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452531840:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1777051285.590539:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777051285.782984:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da70a32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452531968:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1777051285.783437:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051285.783499:0:10113:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452531968 00000100:00100000:0.0:1777051285.783513:0:10113:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452531968 00000100:00100000:0.0:1777051285.783593:0:10113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5549 00000100:00100000:0.0:1777051285.783609:0:10113:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da70a32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3677:x1863365452531968:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1777051285.783651:0:10113:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 440354112 pending 0 free 3862671360 avail 3631149056 00000100:00100000:0.0:1777051285.783733:0:10113:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da70a32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3677:x1863365452531968:12345-0@lo:13:osp-pre-0-1.0 Request processed in 126us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051285.783745:0:10113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5549 00000100:00100000:3.0:1777051285.785402:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da70a32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452531968:0@lo:13:osp-pre-0-1.0 00000400:00000100:2.0:1777051286.436379:0:3671:0:(lib-move.c:4517:lnet_parse_put()) Dropping PUT from 12345-192.168.201.46@tcp portal 26 match 1863365425865344 offset 0 length 224: 4 00000100:00100000:2.0:1777051286.436454:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051286.436508:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051286.436563:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051286.436582:0:6580:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425865600 00000100:00100000:3.0:1777051286.436601:0:6580:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425865600 00000100:00100000:2.0:1777051286.436613:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051286.436924:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051286.436937:0:24468:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425865856 00000100:00100000:1.0:1777051286.436946:0:24468:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425865856 00000100:00100000:2.0:1777051286.436973:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051286.436985:0:6580:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425866112 00000100:00100000:3.0:1777051286.436992:0:6580:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425866112 00000100:00100000:1.0:1777051286.437016:0:24468:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425865728 00000100:00100000:1.0:1777051286.437024:0:24468:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425865728 00000100:00100000:2.0:1777051286.437045:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051286.437051:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13156 00000100:00100000:3.0:1777051286.437070:0:6580:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d944070e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+6:2439:x1863365425865600:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:1.0:1777051286.437076:0:24468:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425866240 00000100:00100000:1.0:1777051286.437082:0:24468:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425866240 00000100:00100000:2.0:1777051286.437104:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051286.437117:0:24468:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425866368 00000100:00100000:1.0:1777051286.437123:0:24468:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425866368 00000100:00100000:2.0:1777051286.437158:0:8470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10222 00000100:00100000:1.0:1777051286.437536:0:24468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10223 00000100:00100000:1.0:1777051286.437553:0:24468:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da449ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+50:2438:x1863365425865728:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:3.0:1777051286.437561:0:6580:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d944070e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+6:2439:x1863365425865600:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 493us (1102us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051286.437578:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13156 00000100:00100000:2.0:1777051286.437608:0:8470:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da449c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+48:2439:x1863365425865856:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:3.0:1777051286.437609:0:6580:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425865472 00000100:00100000:1.0:1777051286.437618:0:24468:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da449ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+50:2438:x1863365425865728:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 65us (1048us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051286.437618:0:6580:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425865472 00000100:00100000:3.0:1777051286.437649:0:6580:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425865984 00000100:00100000:3.0:1777051286.437654:0:6580:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425865984 00000100:00100000:3.0:1777051286.437678:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13157 00000100:00100000:2.0:1777051286.437686:0:8470:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da449c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+48:2439:x1863365425865856:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 514us (1174us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051286.437934:0:6580:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da449c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+48:2438:x1863365425866112:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:3.0:1777051286.437965:0:6580:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da449c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+48:2438:x1863365425866112:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 37us (1045us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051286.437973:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13157 00000100:00100000:3.0:1777051286.437991:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111703 00000100:00100000:3.0:1777051286.437997:0:6580:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942d22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2435:x1863365425865472:12345-192.168.201.46@tcp:38:kworker.0 00010000:00020000:3.0:1777051286.438029:0:6580:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.201.46@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1777051286.438065:0:6580:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942d22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2435:x1863365425865472:12345-192.168.201.46@tcp:38:kworker.0 Request processed in 66us (1024us total) trans 0 rc -19/-19 00000100:00100000:3.0:1777051286.438075:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111703 00000100:00100000:3.0:1777051286.438089:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111704 00000100:00100000:3.0:1777051286.438093:0:6580:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942d21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2435:x1863365425865984:12345-192.168.201.46@tcp:38:kworker.0 00010000:00020000:3.0:1777051286.438103:0:6580:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.201.46@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1777051286.438122:0:6580:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942d21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2435:x1863365425865984:12345-192.168.201.46@tcp:38:kworker.0 Request processed in 28us (1024us total) trans 0 rc -19/-19 00000100:00100000:3.0:1777051286.438127:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111704 00000100:00080000:3.0:1777051286.438143:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1777051286.438147:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1777051286.438150:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1777051286.438947:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10224 00000100:00100000:0.0:1777051286.438983:0:8468:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da449c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+50:2439:x1863365425866240:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:1.0:1777051286.439006:0:24468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10223 00000100:00100000:0.0:1777051286.439051:0:8468:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da449c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+50:2439:x1863365425866240:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 74us (2438us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051286.439062:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10224 00000100:00100000:0.0:1777051286.439090:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10225 00000100:00100000:0.0:1777051286.439105:0:8468:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da449c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+47:2438:x1863365425866368:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:0.0:1777051286.439149:0:8468:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da449c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+47:2438:x1863365425866368:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 48us (2175us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051286.439491:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10225 00000100:00100000:2.0:1777051286.439916:0:8470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10222 00010000:00010000:2.0:1777051286.615130:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777051287.639053:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051288.663661:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1777051289.366860:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da70a32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3678:1863365452532096:0@lo:400:kworker.0 00000400:00000100:0.0:1777051289.366954:0:3678:0:(lib-move.c:4517:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1863365452532096 offset 0 length 224: 4 00000100:00080000:3.0:1777051289.367082:0:46211:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1777051289.367092:0:46211:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1777051289.367099:0:46211:0:(import.c:65:import_set_state_nolock()) ffff99da7dbeb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1777051289.367110:0:46211:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 7913 00000100:00080000:3.0:1777051289.367120:0:46211:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1777051289.367132:0:46211:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff99da7dbeb000 using connection 192.168.201.146@tcp/0@lo 00000100:00100000:3.0:1777051289.367462:0:46211:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99da70a30a80 x1863365452532224/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1777051289.367538:0:46211:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1777051289.367546:0:46211:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1777051289.367551:0:46211:0:(import.c:65:import_set_state_nolock()) ffff99da7fa93000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1777051289.367561:0:46211:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 7913 00000100:00080000:3.0:1777051289.367568:0:46211:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1777051289.367578:0:46211:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff99da7fa93000 using connection 192.168.201.146@tcp/0@lo 00000100:00100000:3.0:1777051289.367605:0:46211:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99da70a32680 x1863365452532352/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1777051289.367624:0:46211:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1777051289.367630:0:46211:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1777051289.367633:0:46211:0:(import.c:65:import_set_state_nolock()) ffff99d94183b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1777051289.367639:0:46211:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 7913 00000100:00080000:3.0:1777051289.367644:0:46211:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1777051289.367652:0:46211:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff99d94183b000 using connection 192.168.201.146@tcp/0@lo 00000100:00100000:3.0:1777051289.367678:0:46211:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99da70a30700 x1863365452532480/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1777051289.367740:0:46211:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1777051289.367746:0:46211:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1777051289.367913:0:46211:0:(import.c:65:import_set_state_nolock()) ffff99da5f282000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1777051289.367923:0:46211:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 7913 00000100:00080000:3.0:1777051289.367929:0:46211:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1777051289.367936:0:46211:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff99da5f282000 using connection 192.168.201.146@tcp/0@lo 00000100:00100000:3.0:1777051289.367968:0:46211:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99da70a33100 x1863365452532864/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1777051289.368753:0:3678:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1777051289.368769:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da44975c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3678:1863365452532992:0@lo:400:kworker.0 00000100:00100000:0.0:1777051289.368831:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051289.368931:0:27882:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452532992 00000100:00100000:0.0:1777051289.368941:0:27882:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452532992 00000100:00100000:0.0:1777051289.369070:0:27882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13158 00000100:00080000:1.0:1777051289.369392:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1777051289.369413:0:27882:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da46270e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0001_UUID+5:3678:x1863365452532992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777051289.369512:0:27882:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da46270e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0001_UUID+5:3678:x1863365452532992:12345-0@lo:400:kworker.0 Request processed in 113us (680us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051289.369526:0:27882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13158 00000100:00100000:3.0:1777051289.369679:0:3677:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1777051289.369696:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da44977800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452533120:0@lo:400:kworker.0 00000100:00100000:3.0:1777051289.369753:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051289.370171:0:3676:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da70a30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3676:1863365452532224:0@lo:38:kworker.0 00000100:00100000:3.0:1777051289.370290:0:3676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051289.370323:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da44975c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3678:1863365452532992:0@lo:400:kworker.0 00000100:00100000:3.0:1777051289.370348:0:3676:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da70a32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3676:1863365452532352:0@lo:38:kworker.0 00000100:00100000:1.0:1777051289.370379:0:6584:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452532224 00000100:00100000:1.0:1777051289.370388:0:6584:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452532224 00000100:00100000:3.0:1777051289.370400:0:3676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051289.370437:0:3676:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da70a30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3676:1863365452532480:0@lo:38:kworker.0 00000100:00100000:1.0:1777051289.370447:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8010 00000100:00100000:1.0:1777051289.370460:0:6584:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da44974e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3676:x1863365452532224:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1777051289.370475:0:3676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00020000:1.0:1777051289.370487:0:6584:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1777051289.370513:0:3676:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da70a33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3676:1863365452532864:0@lo:38:kworker.0 00000100:00100000:1.0:1777051289.370555:0:6584:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da44974e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3676:x1863365452532224:12345-0@lo:38:kworker.0 Request processed in 93us (264us total) trans 0 rc -19/-19 00000100:00100000:3.0:1777051289.370578:0:3676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051289.370586:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8010 00000100:00100000:1.0:1777051289.370637:0:8492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452532352 00000100:00100000:1.0:1777051289.370648:0:8492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452532352 00000100:00080000:3.0:1777051289.370648:0:3676:0:(import.c:65:import_set_state_nolock()) ffff99da7dbeb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1777051289.370658:0:3676:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1777051289.370666:0:3676:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da70a30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3676:1863365452532224:0@lo:38:kworker.0 00000100:00100000:1.0:1777051289.370694:0:8492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452532480 00000100:00100000:1.0:1777051289.370701:0:8492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452532480 00000100:00100000:3.0:1777051289.370720:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da70a30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3680:1863365452532736:0@lo:400:kworker.0 00000100:00100000:1.0:1777051289.371023:0:8492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452532864 00000100:00100000:1.0:1777051289.371032:0:8492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452532864 00000100:00100000:3.0:1777051289.371056:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051289.371073:0:8492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111705 00000100:00100000:1.0:1777051289.371442:0:8492:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da44976680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3676:x1863365452532352:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1777051289.371463:0:3680:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00020000:1.0:1777051289.371467:0:8492:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1777051289.371484:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da70a30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3680:1863365452532608:0@lo:400:kworker.0 00000100:00100000:1.0:1777051289.371557:0:8492:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da44976680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3676:x1863365452532352:12345-0@lo:38:kworker.0 Request processed in 110us (1152us total) trans 0 rc -19/-19 00000100:00100000:3.0:1777051289.371558:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051289.371573:0:8492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111705 00000100:00100000:1.0:1777051289.371599:0:8492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452532608 00000100:00100000:1.0:1777051289.371607:0:8492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452532608 00000100:00100000:3.0:1777051289.371635:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111706 00000100:00100000:3.0:1777051289.371955:0:6580:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da44975c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3676:x1863365452532480:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1777051289.371981:0:6580:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1777051289.371999:0:8492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13159 00000100:00100000:1.0:1777051289.372017:0:8492:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95fbac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3680:x1863365452532608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051289.372048:0:6580:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da44975c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3676:x1863365452532480:12345-0@lo:38:kworker.0 Request processed in 91us (1571us total) trans 0 rc -19/-19 00000100:00100000:3.0:1777051289.372062:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111706 00000100:00100000:3.0:1777051289.372103:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111707 00000100:00100000:1.0:1777051289.372109:0:8492:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95fbac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3680:x1863365452532608:12345-0@lo:400:kworker.0 Request processed in 95us (557us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051289.372432:0:6580:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95fbadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3676:x1863365452532864:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1777051289.372452:0:8492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13159 00010000:00020000:3.0:1777051289.372463:0:6580:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1777051289.372504:0:24468:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452533120 00000100:00100000:1.0:1777051289.372511:0:24468:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452533120 00000100:00100000:3.0:1777051289.372526:0:6580:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95fbadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3676:x1863365452532864:12345-0@lo:38:kworker.0 Request processed in 98us (1952us total) trans 0 rc -19/-19 00000100:00100000:3.0:1777051289.372542:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111707 00000100:00100000:1.0:1777051289.372553:0:24468:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452532736 00000100:00100000:1.0:1777051289.372557:0:24468:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452532736 00000100:00100000:1.0:1777051289.372592:0:24468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10226 00000100:00100000:1.0:1777051289.372603:0:24468:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da44974380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3677:x1863365452533120:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1777051289.372621:0:3676:0:(import.c:65:import_set_state_nolock()) ffff99da7fa93000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1777051289.372632:0:3676:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1777051289.372641:0:3676:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da70a32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3676:1863365452532352:0@lo:38:kworker.0 00000100:00080000:3.0:1777051289.372666:0:3676:0:(import.c:65:import_set_state_nolock()) ffff99d94183b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:1.0:1777051289.372670:0:24468:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da44974380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3677:x1863365452533120:12345-0@lo:400:kworker.0 Request processed in 67us (2915us total) trans 0 rc 0/0 00000100:00080000:3.0:1777051289.372676:0:3676:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1777051289.372687:0:3676:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da70a30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3676:1863365452532480:0@lo:38:kworker.0 00000100:00100000:1.0:1777051289.372693:0:24468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10226 00000100:00080000:3.0:1777051289.372712:0:3676:0:(import.c:65:import_set_state_nolock()) ffff99da5f282000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1777051289.372720:0:3676:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1777051289.372730:0:24468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10227 00000100:00100000:3.0:1777051289.372731:0:3676:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da70a33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3676:1863365452532864:0@lo:38:kworker.0 00000100:00100000:1.0:1777051289.373055:0:24468:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95fbad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3680:x1863365452532736:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1777051289.373513:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1777051289.373520:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1777051289.373524:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1777051289.373980:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da44977800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452533120:0@lo:400:kworker.0 00000100:00100000:3.0:1777051289.374035:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da70a30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3680:1863365452532608:0@lo:400:kworker.0 00000100:00100000:1.0:1777051289.374377:0:24468:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95fbad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3680:x1863365452532736:12345-0@lo:400:kworker.0 Request processed in 1627us (3319us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051289.374390:0:24468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10227 00000100:00100000:3.0:1777051289.374459:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da70a30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3680:1863365452532736:0@lo:400:kworker.0 00010000:00010000:2.0:1777051289.686506:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1777051290.391010:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da44977800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452533248:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1777051290.391130:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051290.391233:0:8472:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452533248 00000100:00100000:3.0:1777051290.391250:0:8472:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452533248 00000100:00100000:3.0:1777051290.391345:0:8472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5550 00000100:00100000:3.0:1777051290.391361:0:8472:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f42c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3679:x1863365452533248:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1777051290.391410:0:8472:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 430294336 pending 0 free 3645853696 avail 3414331392 00000100:00100000:3.0:1777051290.391495:0:8472:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f42c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3679:x1863365452533248:12345-0@lo:13:osp-pre-1-1.0 Request processed in 136us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051290.391507:0:8472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5550 00000100:00100000:1.0:1777051290.391639:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da44977800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452533248:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1777051290.712157:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1777051290.902963:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da44977800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3680:1863365452533376:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1777051290.903054:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051290.903153:0:8473:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452533376 00000100:00100000:3.0:1777051290.903188:0:8473:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452533376 00000100:00100000:3.0:1777051290.903277:0:8473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5551 00000100:00100000:3.0:1777051290.903294:0:8473:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942d22680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3680:x1863365452533376:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1777051290.903335:0:8473:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 440354112 pending 0 free 3862671360 avail 3631149056 00000100:00100000:3.0:1777051290.904457:0:8473:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942d22680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3680:x1863365452533376:12345-0@lo:13:osp-pre-0-1.0 Request processed in 1166us (1404us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051290.904472:0:8473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5551 00000100:00100000:2.0:1777051290.904661:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da44977800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3680:1863365452533376:0@lo:13:osp-pre-0-1.0 00000400:00000100:0.0:1777051291.554560:0:3672:0:(lib-move.c:4517:lnet_parse_put()) Dropping PUT from 12345-192.168.201.46@tcp portal 26 match 1863365425866496 offset 0 length 224: 4 00000100:00100000:0.0:1777051291.554631:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051291.554708:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051291.554767:0:8628:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425866880 00000100:00100000:1.0:1777051291.554786:0:8628:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425866880 00000100:00100000:0.0:1777051291.554815:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051291.554863:0:6581:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425867264 00000100:00100000:3.0:1777051291.554874:0:6581:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425867264 00000100:00100000:0.0:1777051291.554912:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051291.554926:0:8628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10228 00000100:00100000:3.0:1777051291.554976:0:6581:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425866752 00000100:00100000:3.0:1777051291.554988:0:6581:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425866752 00000100:00100000:1.0:1777051291.554993:0:8628:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da46272a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+50:2437:x1863365425866880:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:0.0:1777051291.555037:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051291.555060:0:6581:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425866624 00000100:00100000:3.0:1777051291.555071:0:6581:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425866624 00000100:00100000:3.0:1777051291.555559:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13160 00000100:00100000:3.0:1777051291.555584:0:6581:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da46271180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+48:2437:x1863365425867264:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:1.0:1777051291.555613:0:8628:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da46272a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+50:2437:x1863365425866880:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 660us (972us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051291.555614:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051291.555640:0:8628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10228 00000100:00100000:3.0:1777051291.555676:0:6581:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da46271180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+48:2437:x1863365425867264:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 96us (964us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051291.555686:0:8628:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425867520 00000100:00100000:1.0:1777051291.555697:0:8628:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425867520 00000100:00100000:3.0:1777051291.555699:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13160 00000100:00100000:3.0:1777051291.556094:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13161 00000100:00100000:3.0:1777051291.556117:0:6581:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95aecc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+6:2436:x1863365425866752:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:1.0:1777051291.556136:0:8628:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425867008 00000100:00100000:1.0:1777051291.556147:0:8628:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425867008 00000100:00100000:0.0:1777051291.556235:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051291.556291:0:6581:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95aecc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+6:2436:x1863365425866752:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 177us (1497us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051291.556311:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13161 00000100:00100000:1.0:1777051291.556336:0:8628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10229 00000100:00100000:3.0:1777051291.556357:0:6581:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425867136 00000100:00100000:1.0:1777051291.556359:0:8628:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da45f75c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+47:2437:x1863365425867520:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:3.0:1777051291.556371:0:6581:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425867136 00000100:00100000:0.0:1777051291.556383:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051291.556439:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111708 00000100:00100000:2.0:1777051291.556462:0:8468:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425867392 00000100:00100000:1.0:1777051291.556465:0:8628:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da45f75c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+47:2437:x1863365425867520:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 102us (1548us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051291.556465:0:6581:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da44496a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2435:x1863365425866624:12345-192.168.201.46@tcp:38:kworker.0 00000100:00100000:2.0:1777051291.556478:0:8468:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425867392 00000100:00100000:1.0:1777051291.556514:0:8628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10229 00010000:00020000:3.0:1777051291.556527:0:6581:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.201.46@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1777051291.556570:0:8628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10230 00000100:00100000:2.0:1777051291.556598:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10231 00000100:00100000:1.0:1777051291.556599:0:8628:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da44495f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+48:2436:x1863365425867008:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:3.0:1777051291.556609:0:6581:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da44496a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2435:x1863365425866624:12345-192.168.201.46@tcp:38:kworker.0 Request processed in 147us (1606us total) trans 0 rc -19/-19 00000100:00080000:0.0:1777051291.556635:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1777051291.556641:0:8468:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955610000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+50:2436:x1863365425867392:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:3.0:1777051291.556641:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111708 00000100:00080000:0.0:1777051291.556649:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1777051291.556660:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1777051291.556695:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111709 00000100:00100000:1.0:1777051291.556708:0:8628:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da44495f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+48:2436:x1863365425867008:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 113us (1104us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051291.556724:0:6581:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da44494380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2435:x1863365425867136:12345-192.168.201.46@tcp:38:kworker.0 00000100:00100000:1.0:1777051291.556746:0:8628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10230 00000100:00100000:2.0:1777051291.556747:0:8468:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955610000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+50:2436:x1863365425867392:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 112us (363us total) trans 0 rc 0/0 00010000:00020000:3.0:1777051291.556760:0:6581:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.201.46@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1777051291.556775:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10231 00000100:00100000:3.0:1777051291.556832:0:6581:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da44494380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2435:x1863365425867136:12345-192.168.201.46@tcp:38:kworker.0 Request processed in 113us (677us total) trans 0 rc -19/-19 00000100:00100000:3.0:1777051291.556847:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111709 00010000:00010000:0.0:1777051291.734501:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1777051292.696672:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051292.696759:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051292.696787:0:24468:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425868032 00000100:00100000:1.0:1777051292.696806:0:24468:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425868032 00000100:00100000:0.0:1777051292.696902:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051292.696911:0:24468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10232 00000100:00100000:1.0:1777051292.696937:0:24468:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955610e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+50:2438:x1863365425868032:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:0.0:1777051292.696966:0:27884:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425868672 00000100:00100000:0.0:1777051292.696978:0:27884:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425868672 00000100:00100000:1.0:1777051292.697067:0:24468:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955610e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+50:2438:x1863365425868032:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 137us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051292.697084:0:24468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10232 00000100:00100000:1.0:1777051292.697123:0:24468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10233 00000100:00100000:1.0:1777051292.697199:0:24468:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955612a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+47:2438:x1863365425868672:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:1.0:1777051292.697270:0:24468:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955612a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+47:2438:x1863365425868672:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 85us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051292.697287:0:24468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10233 00000100:00100000:3.0:1777051292.697304:0:6579:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425868416 00000100:00100000:3.0:1777051292.697318:0:6579:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425868416 00000100:00100000:3.0:1777051292.697401:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13162 00000100:00100000:3.0:1777051292.697421:0:6579:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955613800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+48:2438:x1863365425868416:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:1.0:1777051292.700066:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051292.700093:0:6579:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955613800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+48:2438:x1863365425868416:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 2672us (3333us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051292.700111:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13162 00000100:00100000:3.0:1777051292.700180:0:6579:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425867904 00000100:00100000:3.0:1777051292.700191:0:6579:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425867904 00000100:00100000:1.0:1777051292.700306:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051292.700316:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13163 00000100:00100000:3.0:1777051292.700339:0:6579:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f42ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+6:2438:x1863365425867904:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:0.0:1777051292.700386:0:55805:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425868160 00000100:00100000:1.0:1777051292.700394:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051292.700401:0:55805:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425868160 00000100:00100000:3.0:1777051292.700448:0:6579:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f42ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+6:2438:x1863365425867904:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 113us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051292.700470:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13163 00000100:00100000:0.0:1777051292.700480:0:55805:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425868544 00000100:00100000:0.0:1777051292.700489:0:55805:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425868544 00000400:00000100:1.0:1777051292.700563:0:3670:0:(lib-move.c:4517:lnet_parse_put()) Dropping PUT from 12345-192.168.201.46@tcp portal 26 match 1863365425867648 offset 0 length 520: 4 00000100:00100000:0.0:1777051292.700565:0:55805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10234 00000100:00100000:0.0:1777051292.700592:0:55805:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f42c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c11b6966-0775-44d2-bdc6-c74c26eb2226+48:2438:x1863365425868160:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:3.0:1777051292.700615:0:13320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10235 00000100:00100000:3.0:1777051292.700646:0:13320:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f865180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+50:2438:x1863365425868544:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:1.0:1777051292.700651:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051292.700691:0:55805:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f42c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c11b6966-0775-44d2-bdc6-c74c26eb2226+48:2438:x1863365425868160:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 104us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051292.701026:0:55805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10234 00000100:00100000:3.0:1777051292.701051:0:13320:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f865180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+50:2438:x1863365425868544:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 414us (660us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051292.701070:0:13320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10235 00000100:00100000:1.0:1777051292.701494:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051292.701549:0:21368:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425867776 00000100:00100000:1.0:1777051292.701557:0:21368:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425867776 00000100:00100000:1.0:1777051292.701593:0:21368:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425868288 00000100:00100000:1.0:1777051292.701597:0:21368:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425868288 00000100:00100000:0.0:1777051292.701622:0:8492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111710 00000100:00100000:0.0:1777051292.701637:0:8492:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f866d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2435:x1863365425867776:12345-192.168.201.46@tcp:38:kworker.0 00000100:00100000:1.0:1777051292.701643:0:21368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111711 00000100:00100000:1.0:1777051292.701660:0:21368:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f864380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2435:x1863365425868288:12345-192.168.201.46@tcp:38:kworker.0 00010000:00020000:0.0:1777051292.701686:0:8492:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.201.46@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00020000:1.0:1777051292.701694:0:21368:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.201.46@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1777051292.702490:0:8492:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f866d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2435:x1863365425867776:12345-192.168.201.46@tcp:38:kworker.0 Request processed in 850us (1850us total) trans 0 rc -19/-19 00000100:00100000:0.0:1777051292.702505:0:8492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111710 00000100:00100000:1.0:1777051292.706613:0:21368:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f864380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2435:x1863365425868288:12345-192.168.201.46@tcp:38:kworker.0 Request processed in 4948us (5477us total) trans 0 rc -19/-19 00000100:00100000:1.0:1777051292.706970:0:21368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111711 00010000:00010000:2.0:1777051292.760175:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777051293.782440:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1777051294.487590:0:46211:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1777051294.487600:0:46211:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1777051294.487606:0:46211:0:(import.c:65:import_set_state_nolock()) ffff99da7dbeb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:1.0:1777051294.487612:0:3678:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00080000:3.0:1777051294.487619:0:46211:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 7918 00000100:00080000:3.0:1777051294.487629:0:46211:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 15s 00000100:00100000:1.0:1777051294.487638:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da44977800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3678:1863365452533504:0@lo:400:kworker.0 00000100:00080000:3.0:1777051294.487640:0:46211:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff99da7dbeb000 using connection 192.168.201.146@tcp/0@lo 00000100:00100000:3.0:1777051294.487681:0:46211:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99da70a30e00 x1863365452533632/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1777051294.487709:0:46211:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1777051294.487715:0:46211:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000400:00000100:1.0:1777051294.487719:0:3678:0:(lib-move.c:4517:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1863365452533504 offset 0 length 224: 4 00000100:00080000:3.0:1777051294.487721:0:46211:0:(import.c:65:import_set_state_nolock()) ffff99da7fa93000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:2.0:1777051294.487730:0:3676:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da70a30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3676:1863365452533632:0@lo:38:kworker.0 00000100:00080000:3.0:1777051294.487733:0:46211:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 7918 00000100:00080000:3.0:1777051294.487740:0:46211:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1777051294.487746:0:46211:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff99da7fa93000 using connection 192.168.201.146@tcp/0@lo 00000100:00100000:3.0:1777051294.487767:0:46211:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99da70a30000 x1863365452533760/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1777051294.487784:0:46211:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1777051294.487790:0:46211:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1777051294.487793:0:46211:0:(import.c:65:import_set_state_nolock()) ffff99d94183b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1777051294.487801:0:46211:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 7918 00000100:00080000:3.0:1777051294.487805:0:46211:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 15s 00000100:00100000:2.0:1777051294.487812:0:3676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1777051294.487812:0:46211:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff99d94183b000 using connection 192.168.201.146@tcp/0@lo 00000100:00100000:3.0:1777051294.487836:0:46211:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99da70a33100 x1863365452533888/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1777051294.487866:0:11727:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452533632 00000100:00100000:2.0:1777051294.487870:0:3676:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da70a30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3676:1863365452533760:0@lo:38:kworker.0 00000100:00100000:1.0:1777051294.487879:0:11727:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452533632 00000100:00080000:3.0:1777051294.487903:0:46211:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1777051294.487909:0:46211:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1777051294.487912:0:46211:0:(import.c:65:import_set_state_nolock()) ffff99da5f282000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1777051294.487918:0:46211:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 7918 00000100:00080000:3.0:1777051294.487923:0:46211:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1777051294.487929:0:46211:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff99da5f282000 using connection 192.168.201.146@tcp/0@lo 00000100:00100000:2.0:1777051294.487931:0:3676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051294.487948:0:11727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8011 00000100:00100000:3.0:1777051294.487955:0:46211:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99da70a30a80 x1863365452534272/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1777051294.487968:0:11727:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d944d28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3676:x1863365452533632:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1777051294.487969:0:3676:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da70a33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3676:1863365452533888:0@lo:38:kworker.0 00010000:00020000:1.0:1777051294.488011:0:11727:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1777051294.488026:0:3676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051294.488038:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da70a32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452534144:0@lo:400:kworker.0 00000100:00100000:2.0:1777051294.488061:0:3676:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da70a30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3676:1863365452534272:0@lo:38:kworker.0 00000100:00100000:3.0:1777051294.488095:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051294.488142:0:3676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051294.488163:0:3679:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1777051294.488173:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d9600bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3679:1863365452534400:0@lo:400:kworker.0 00000100:00100000:2.0:1777051294.488189:0:46494:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452533760 00000100:00100000:2.0:1777051294.488232:0:46494:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452533760 00000100:00100000:3.0:1777051294.488247:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051294.488283:0:46494:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452533888 00000100:00100000:2.0:1777051294.488289:0:46494:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452533888 00000100:00100000:3.0:1777051294.488306:0:6581:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452534272 00000100:00100000:3.0:1777051294.488311:0:6581:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452534272 00000100:00100000:2.0:1777051294.488316:0:46494:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452534400 00000100:00100000:2.0:1777051294.488320:0:46494:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452534400 00000100:00100000:3.0:1777051294.488341:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111712 00000100:00100000:3.0:1777051294.488352:0:6581:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d944d28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3676:x1863365452533760:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1777051294.488373:0:6581:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1777051294.488378:0:46494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13164 00000100:00100000:2.0:1777051294.488389:0:46494:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fd62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0001-lwp-OST0001_UUID+5:3679:x1863365452534400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051294.488437:0:6581:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d944d28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3676:x1863365452533760:12345-0@lo:38:kworker.0 Request processed in 84us (505us total) trans 0 rc -19/-19 00000100:00100000:2.0:1777051294.488451:0:46494:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fd62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0001-lwp-OST0001_UUID+5:3679:x1863365452534400:12345-0@lo:400:kworker.0 Request processed in 65us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051294.488455:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111712 00000100:00100000:2.0:1777051294.488461:0:46494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13164 00000100:00100000:3.0:1777051294.488485:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111713 00000100:00100000:2.0:1777051294.488492:0:46494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111714 00000100:00100000:3.0:1777051294.488493:0:6581:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f168380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3676:x1863365452533888:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1777051294.488499:0:46494:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f169880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:0+-99:3676:x1863365452534272:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1777051294.488510:0:6581:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00020000:2.0:1777051294.488514:0:46494:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1777051294.488553:0:46494:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f169880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:0+-99:3676:x1863365452534272:12345-0@lo:38:kworker.0 Request processed in 51us (410us total) trans 0 rc -19/-19 00000100:00100000:3.0:1777051294.488553:0:6581:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f168380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3676:x1863365452533888:12345-0@lo:38:kworker.0 Request processed in 58us (532us total) trans 0 rc -19/-19 00000100:00100000:3.0:1777051294.488564:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111713 00000100:00100000:2.0:1777051294.488575:0:46494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111714 00000100:00100000:3.0:1777051294.488595:0:27887:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452534144 00000100:00100000:3.0:1777051294.488603:0:27887:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452534144 00000100:00080000:2.0:1777051294.488607:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1777051294.488961:0:27887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10236 00000100:00100000:2.0:1777051294.488962:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d9600baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452534528:0@lo:400:kworker.0 00000100:00100000:3.0:1777051294.488978:0:27887:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d9600b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3679:x1863365452534144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777051294.489006:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051294.489029:0:27887:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d9600b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3679:x1863365452534144:12345-0@lo:400:kworker.0 Request processed in 56us (933us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051294.489037:0:3677:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1777051294.489039:0:27887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10236 00000100:00100000:2.0:1777051294.489046:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da70a30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3677:1863365452534016:0@lo:400:kworker.0 00000100:00100000:3.0:1777051294.489058:0:27887:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452534528 00000100:00100000:3.0:1777051294.489063:0:27887:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452534528 00000100:00100000:2.0:1777051294.489082:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051294.489136:0:27887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10237 00000100:00100000:3.0:1777051294.489149:0:27887:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f169500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3677:x1863365452534528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777051294.489160:0:10328:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452534016 00000100:00100000:2.0:1777051294.489165:0:10328:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452534016 00000100:00100000:3.0:1777051294.489250:0:27887:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f169500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3677:x1863365452534528:12345-0@lo:400:kworker.0 Request processed in 104us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051294.489262:0:27887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10237 00000100:00100000:2.0:1777051294.489263:0:10328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13165 00000100:00100000:2.0:1777051294.489274:0:10328:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3677:x1863365452534016:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1777051294.489298:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1777051294.489303:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1777051294.489307:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1777051294.489334:0:10328:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3677:x1863365452534016:12345-0@lo:400:kworker.0 Request processed in 62us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051294.489343:0:10328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13165 00000100:00100000:3.0:1777051294.489348:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d9600bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3679:1863365452534400:0@lo:400:kworker.0 00000100:00100000:3.0:1777051294.489368:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da70a32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452534144:0@lo:400:kworker.0 00000100:00080000:3.0:1777051294.489414:0:3676:0:(import.c:65:import_set_state_nolock()) ffff99da5f282000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1777051294.489422:0:3676:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1777051294.489424:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da70a30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3677:1863365452534016:0@lo:400:kworker.0 00000100:00100000:3.0:1777051294.489427:0:3676:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da70a30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3676:1863365452534272:0@lo:38:kworker.0 00000100:00080000:3.0:1777051294.489440:0:3676:0:(import.c:65:import_set_state_nolock()) ffff99da7fa93000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:2.0:1777051294.489441:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d9600baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452534528:0@lo:400:kworker.0 00000100:00080000:3.0:1777051294.489445:0:3676:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1777051294.489450:0:3676:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da70a30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3676:1863365452533760:0@lo:38:kworker.0 00000100:00080000:3.0:1777051294.489462:0:3676:0:(import.c:65:import_set_state_nolock()) ffff99d94183b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1777051294.489467:0:3676:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1777051294.489472:0:3676:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da70a33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3676:1863365452533888:0@lo:38:kworker.0 00000100:00100000:1.0:1777051294.535627:0:11727:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d944d28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3676:x1863365452533632:12345-0@lo:38:kworker.0 Request processed in 47656us (47808us total) trans 0 rc -19/-19 00000100:00100000:1.0:1777051294.535650:0:11727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8011 00000100:00080000:0.0:1777051294.535870:0:3676:0:(import.c:65:import_set_state_nolock()) ffff99da7dbeb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1777051294.535884:0:3676:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1777051294.535893:0:3676:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da70a30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3676:1863365452533632:0@lo:38:kworker.0 00000020:01000004:0.0:1777051294.640779:0:103158:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:0.0:1777051294.640785:0:103158:0:(obd_mount.c:917:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:0.0:1777051294.640788:0:103158:0:(obd_mount.c:920:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1777051294.640979:0:103158:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff99da5f2be000 00000020:01000004:0.0:1777051294.640999:0:103158:0:(tgt_mount.c:2453:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:0.0:1777051294.641020:0:103158:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1777051294.641039:0:103158:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff99d941ce19c0) 00000020:00000080:0.0:1777051294.641065:0:103158:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1777051294.799560:0:103158:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1777051294.804497:0:103158:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00010000:00010000:2.0:1777051294.807556:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:2.0:1777051294.817963:0:103158:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1777051294.822968:0:103158:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:2.0:1777051294.824510:0:103158:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:2.0:1777051294.825006:0:103158:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:2.0:1777051294.825607:0:103158:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:2.0:1777051294.827002:0:103158:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:2.0:1777051294.827962:0:103158:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1777051294.828805:0:103158:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:2.0:1777051294.829257:0:103158:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1777051294.829681:0:103158:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:2.0:1777051294.830644:0:103158:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:2.0:1777051294.831188:0:103158:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:2.0:1777051294.837756:0:103158:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1777051294.839155:0:103158:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:2.0:1777051294.839670:0:103158:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:2.0:1777051294.840942:0:103158:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:2.0:1777051294.842619:0:103158:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1777051294.843127:0:103158:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1777051294.845344:0:103158:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1777051294.845997:0:103158:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1777051294.846564:0:103158:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:2.0:1777051294.847051:0:103158:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:3.0:1777051294.848141:0:103158:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:3.0:1777051294.848697:0:103158:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:3.0:1777051294.850027:0:103158:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:3.0:1777051294.850581:0:103158:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:3.0:1777051294.851042:0:103158:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:3.0:1777051294.851969:0:103158:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:3.0:1777051294.852884:0:103158:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:3.0:1777051294.853482:0:103158:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:3.0:1777051294.853906:0:103158:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:3.0:1777051294.854457:0:103158:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:3.0:1777051294.855638:0:103158:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:3.0:1777051294.857696:0:103158:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:3.0:1777051294.858250:0:103158:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:0.0:1777051294.859304:0:103158:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:0.0:1777051294.860229:0:103158:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:0.0:1777051294.860775:0:103158:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:0.0:1777051294.861725:0:103158:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:0.0:1777051294.862494:0:103158:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:0.0:1777051294.864135:0:103158:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:0.0:1777051294.864704:0:103158:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:0.0:1777051294.865582:0:103158:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:0.0:1777051294.866441:0:103158:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:0.0:1777051294.871432:0:103158:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:0.0:1777051294.878735:0:103158:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:0.0:1777051294.879908:0:103158:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:0.0:1777051294.880573:0:103158:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:0.0:1777051294.882947:0:103158:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:0.0:1777051294.883766:0:103158:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:0.0:1777051294.884269:0:103158:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:01000000:0.0:1777051294.887819:0:103158:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1777051294.888606:0:103158:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:0.0:1777051294.888622:0:103158:0:(osd_handler.c:8912:osd_obd_connect()) connect #0 00000020:00000080:0.0:1777051294.888643:0:103158:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x85f51a6b96714ade 00000020:01000004:0.0:1777051294.888655:0:103158:0:(tgt_mount.c:2538:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:0.0:1777051294.888676:0:103158:0:(tgt_mount.c:217:server_start_mgs()) Start MGS service MGS 00000020:01000004:0.0:1777051294.888687:0:103158:0:(tgt_mount.c:99:server_register_mount()) register mount ffff99da5f2be000 from MGS 00000020:01000004:0.0:1777051294.888966:0:103158:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:0.0:1777051294.888987:0:103158:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff99d941ce3380) 00000020:00000080:0.0:1777051294.889012:0:103158:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:0.0:1777051294.892943:0:103158:0:(tgt_mount.c:151:server_get_mount()) get mount ffff99da5f2be000 from MGS, refs=2 00080000:01000000:0.0:1777051294.892959:0:103158:0:(osd_handler.c:8912:osd_obd_connect()) connect #1 00000020:00000080:0.0:1777051294.892972:0:103158:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x85f51a6b96714aec 00010000:00010000:0.0:1777051294.893488:0:103158:0:(ldlm_pool.c:924:ldlm_pool_init()) Lock pool ldlm-pool-MGS-3 is initialized 00000040:01000000:1.0:1777051294.915963:0:103158:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:2.0:1777051294.917691:0:103162:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1777051294.917761:0:103158:0:(mgs_nids.c:664:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1777051294.917818:0:103158:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1777051294.919813:0:103158:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1777051294.921235:0:103158:0:(service.c:153:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1777051294.921519:0:103158:0:(service.c:3441:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1777051294.921531:0:103158:0:(service.c:3500:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1777051294.924946:0:103158:0:(service.c:3441:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1777051294.924962:0:103158:0:(service.c:3500:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1777051294.926559:0:103158:0:(service.c:3441:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1777051294.926575:0:103158:0:(service.c:3500:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1777051294.928393:0:103158:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1777051294.928467:0:103158:0:(obd_mount.c:383:lustre_start_mgc()) New MGS with live MGC 00000020:01000004:3.0:1777051294.928472:0:103158:0:(obd_mount.c:394:lustre_start_mgc()) MGC192.168.201.146@tcp:Set MGC reconnect 2 10000000:01000000:3.0:1777051294.928479:0:103158:0:(mgc_request.c:1069:mgc_set_info_async()) InitRecov MGC192.168.201.146@tcp 2/d0:i0:r0:or0:FULL 00000100:00080000:3.0:1777051294.928491:0:103158:0:(import.c:65:import_set_state_nolock()) ffff99da48759800 MGS: changing import state from FULL to DISCONN 00000100:02020000:3.0:1777051294.928504:0:103158:0:(import.c:185:ptlrpc_set_import_discon()) MGC192.168.201.146@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:3.0:1777051294.951520:0:103158:0:(import.c:191:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.201.146@tcp not replayable, auto-deactivating 00000100:00080000:3.0:1777051294.951529:0:103158:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1777051294.951547:0:103158:0:(client.c:3579:ptlrpc_abort_inflight()) @@@ inflight req@ffff99da5f826680 x1863365452528768/t0(0) o400->MGC192.168.201.146@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1777051295 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777051294.951757:0:103158:0:(client.c:3579:ptlrpc_abort_inflight()) @@@ inflight req@ffff99d94f42ca80 x1863365452530688/t0(0) o400->MGC192.168.201.146@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1777051300 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777051294.951798:0:103158:0:(client.c:3579:ptlrpc_abort_inflight()) @@@ inflight req@ffff99da70a32a00 x1863365452532096/t0(0) o400->MGC192.168.201.146@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1777051305 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777051294.951835:0:103158:0:(client.c:3579:ptlrpc_abort_inflight()) @@@ inflight req@ffff99da44977800 x1863365452533504/t0(0) o400->MGC192.168.201.146@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1777051310 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1777051294.951855:0:103158:0:(mgc_request.c:1166:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1777051294.951861:0:103158:0:(pinger.c:192:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1777051294.951865:0:103158:0:(mgc_request.c:1166:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1777051294.951871:0:103158:0:(import.c:321:ptlrpc_invalidate_import()) Sleeping 21s for inflight to error out 00000100:00100000:0.0:1777051294.951901:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94f42ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3679:1863365452530688:0@lo:400:kworker.0 00000100:00100000:1.0:1777051294.951920:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da44977800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3678:1863365452533504:0@lo:400:kworker.0 00000100:00100000:1.0:1777051294.951952:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da70a32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3678:1863365452532096:0@lo:400:kworker.0 00000100:00100000:2.0:1777051294.952454:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f826680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3680:1863365452528768:0@lo:400:kworker.0 10000000:01000000:3.0:1777051294.952538:0:103158:0:(mgc_request.c:1166:mgc_import_event()) import event 0x808003 00010000:00010000:3.0:1777051294.952568:0:103158:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.146@tcp lock: ffff99da7d506000/0x85f51a6b9671475e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x85f51a6b96714765 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1777051294.952588:0:103158:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.146@tcp lock: ffff99da7d506000/0x85f51a6b9671475e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x85f51a6b96714765 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1777051294.952601:0:103158:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1777051294.952641:0:103158:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1777051294.952660:0:103158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.146@tcp lock: ffff99da7d506000/0x85f51a6b9671475e lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x85f51a6b96714765 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051294.952700:0:103158:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.146@tcp lock: ffff99d943eba000/0x85f51a6b967146d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110e400000000 nid: local remote: 0x85f51a6b967146d9 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1777051294.952711:0:103158:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.146@tcp lock: ffff99d943eba000/0x85f51a6b967146d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110f400000000 nid: local remote: 0x85f51a6b967146d9 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1777051294.952721:0:103158:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1777051294.952731:0:103158:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1777051294.952737:0:103158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.146@tcp lock: ffff99d943eba000/0x85f51a6b967146d2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x590f400000000 nid: local remote: 0x85f51a6b967146d9 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051294.952757:0:103158:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.146@tcp lock: ffff99da7d507e00/0x85f51a6b967146e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110e400000000 nid: local remote: 0x85f51a6b967146e7 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1777051294.952769:0:103158:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.146@tcp lock: ffff99da7d507e00/0x85f51a6b967146e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110f400000000 nid: local remote: 0x85f51a6b967146e7 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1777051294.952779:0:103158:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1777051294.952790:0:103158:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1777051294.952800:0:103158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.146@tcp lock: ffff99da7d507e00/0x85f51a6b967146e0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x590f400000000 nid: local remote: 0x85f51a6b967146e7 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051294.952820:0:103158:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.146@tcp lock: ffff99d95595b800/0x85f51a6b967146fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110e400000000 nid: local remote: 0x85f51a6b96714703 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1777051294.952832:0:103158:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.146@tcp lock: ffff99d95595b800/0x85f51a6b967146fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110f400000000 nid: local remote: 0x85f51a6b96714703 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1777051294.952841:0:103158:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1777051294.952849:0:103158:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1777051294.952855:0:103158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.146@tcp lock: ffff99d95595b800/0x85f51a6b967146fc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x590f400000000 nid: local remote: 0x85f51a6b96714703 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051294.952870:0:103158:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.146@tcp lock: ffff99d943eba600/0x85f51a6b9671470a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110e400000000 nid: local remote: 0x85f51a6b96714711 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1777051294.952881:0:103158:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.146@tcp lock: ffff99d943eba600/0x85f51a6b9671470a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110f400000000 nid: local remote: 0x85f51a6b96714711 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1777051294.952891:0:103158:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1777051294.952897:0:103158:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1777051294.952902:0:103158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.146@tcp lock: ffff99d943eba600/0x85f51a6b9671470a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x590f400000000 nid: local remote: 0x85f51a6b96714711 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051294.952918:0:103158:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.146@tcp lock: ffff99da7d507600/0x85f51a6b96714726 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0x85f51a6b9671472d expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1777051294.952925:0:103158:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.146@tcp lock: ffff99da7d507600/0x85f51a6b96714726 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0x85f51a6b9671472d expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1777051294.952931:0:103158:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1777051294.952935:0:103158:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1777051294.952938:0:103158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.146@tcp lock: ffff99da7d507600/0x85f51a6b96714726 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0x85f51a6b9671472d expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051294.952967:0:103158:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.146@tcp lock: ffff99d943ebb400/0x85f51a6b96714742 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0x85f51a6b96714749 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1777051294.952978:0:103158:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.146@tcp lock: ffff99d943ebb400/0x85f51a6b96714742 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0x85f51a6b96714749 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1777051294.952993:0:103158:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1777051294.952999:0:103158:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1777051294.953005:0:103158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.146@tcp lock: ffff99d943ebb400/0x85f51a6b96714742 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0x85f51a6b96714749 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051294.953019:0:103158:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.146@tcp lock: ffff99da7d507a00/0x85f51a6b9671477a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x85f51a6b96714781 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1777051294.953030:0:103158:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.146@tcp lock: ffff99da7d507a00/0x85f51a6b9671477a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x85f51a6b96714781 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1777051294.953041:0:103158:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1777051294.953047:0:103158:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1777051294.953054:0:103158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.146@tcp lock: ffff99da7d507a00/0x85f51a6b9671477a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x85f51a6b96714781 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051294.953077:0:103158:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.146@tcp lock: ffff99d943ebb000/0x85f51a6b96714734 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x85f51a6b9671473b expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1777051294.953089:0:103158:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.146@tcp lock: ffff99d943ebb000/0x85f51a6b96714734 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x85f51a6b9671473b expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1777051294.953122:0:103158:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1777051294.953128:0:103158:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1777051294.953133:0:103158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.146@tcp lock: ffff99d943ebb000/0x85f51a6b96714734 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x85f51a6b9671473b expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051294.953155:0:103158:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.146@tcp lock: ffff99d955a8f000/0x85f51a6b96714750 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x85f51a6b96714757 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1777051294.953174:0:103158:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.146@tcp lock: ffff99d955a8f000/0x85f51a6b96714750 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x85f51a6b96714757 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1777051294.953181:0:103158:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 00010000:00010000:3.0:1777051294.953186:0:103158:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1777051294.953191:0:103158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.146@tcp lock: ffff99d955a8f000/0x85f51a6b96714750 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x85f51a6b96714757 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051294.953209:0:103158:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.146@tcp lock: ffff99da713e3400/0x85f51a6b96714a9f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0x85f51a6b96714aa6 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1777051294.953239:0:103158:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.146@tcp lock: ffff99da713e3400/0x85f51a6b96714a9f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0x85f51a6b96714aa6 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1777051294.953250:0:103158:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1777051294.953257:0:103158:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1777051294.953266:0:103158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.146@tcp lock: ffff99da713e3400/0x85f51a6b96714a9f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0x85f51a6b96714aa6 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051294.953286:0:103158:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.146@tcp lock: ffff99d955a98400/0x85f51a6b96714aad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0x85f51a6b96714ab4 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1777051294.953298:0:103158:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.146@tcp lock: ffff99d955a98400/0x85f51a6b96714aad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0x85f51a6b96714ab4 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1777051294.953309:0:103158:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1777051294.953364:0:103158:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1777051294.953372:0:103158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.146@tcp lock: ffff99d955a98400/0x85f51a6b96714aad lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0x85f51a6b96714ab4 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051294.953403:0:103158:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.146@tcp lock: ffff99d955a98200/0x85f51a6b96714abb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x85f51a6b96714ac2 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1777051294.953416:0:103158:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.146@tcp lock: ffff99d955a98200/0x85f51a6b96714abb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x85f51a6b96714ac2 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1777051294.953427:0:103158:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1777051294.953458:0:103158:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1777051294.953467:0:103158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.146@tcp lock: ffff99d955a98200/0x85f51a6b96714abb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x85f51a6b96714ac2 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1777051294.953511:0:103158:0:(import.c:213:ptlrpc_set_import_discon()) mgc: import ffff99da48759800 already not connected (conn 11, was 0): DISCONN 00000100:00080000:3.0:1777051294.953522:0:103158:0:(import.c:65:import_set_state_nolock()) ffff99da48759800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1777051294.953532:0:103158:0:(import.c:509:import_select_connection()) MGC192.168.201.146@tcp: connect to NID 0@lo last attempt 7872 00000100:00080000:3.0:1777051294.953543:0:103158:0:(import.c:623:import_select_connection()) MGC192.168.201.146@tcp: import ffff99da48759800 using connection 192.168.201.146@tcp/0@lo 00000100:00100000:3.0:1777051294.953592:0:103158:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99da7fd61c00 x1863365452534656/t0(0) o250->MGC192.168.201.146@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1777051294.953706:0:3676:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7fd61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3676:1863365452534656:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1777051294.953823:0:3676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051294.953935:0:103163:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452534656 00000100:00080000:3.0:1777051294.953940:0:103158:0:(recover.c:338:ptlrpc_recover_import()) MGS: recovery started, waiting 20 seconds 00000100:00100000:1.0:1777051294.953951:0:103163:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452534656 00000100:00100000:1.0:1777051294.954027:0:103163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1777051294.954041:0:103163:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94a771050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3676:x1863365452534656:12345-0@lo:250:mount.lustre.0 00010000:00080000:1.0:1777051294.954085:0:103163:0:(ldlm_lib.c:1431:target_handle_connect()) MGS: connection from f9351a01-5b0e-4470-97fd-58b9b4b312a2@0@lo t0 exp 0000000000000000 cur 7924 last 0 00000020:00000080:1.0:1777051294.954167:0:103163:0:(genops.c:1406:class_connect()) connect: client f9351a01-5b0e-4470-97fd-58b9b4b312a2, cookie 0x85f51a6b96714af3 00000100:00080000:1.0:1777051294.954422:0:103163:0:(import.c:65:import_set_state_nolock()) ffff99d958e3f800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1777051294.954522:0:3676:0:(client.c:3101:ptlrpc_free_committed()) MGC192.168.201.146@tcp: committing for last_committed 0 gen 7 00000100:00100000:1.0:1777051294.954527:0:103163:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94a771050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9351a01-5b0e-4470-97fd-58b9b4b312a2+4:3676:x1863365452534656:12345-0@lo:250:mount.lustre.0 Request processed in 482us (700us total) trans 0 rc 0/0 00000100:00080000:0.0:1777051294.954537:0:3676:0:(import.c:1130:ptlrpc_connect_interpret()) MGC192.168.201.146@tcp: connect to target with instance 0 00000100:00100000:1.0:1777051294.954548:0:103163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1777051294.954551:0:3676:0:(import.c:958:ptlrpc_connect_set_flags()) MGC192.168.201.146@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1777051294.954560:0:3676:0:(mgc_request.c:1166:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1777051294.954567:0:3676:0:(import.c:65:import_set_state_nolock()) ffff99da48759800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1777051294.954572:0:3676:0:(mgc_request.c:1166:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1777051294.954620:0:3676:0:(pinger.c:185:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1777051294.954645:0:3676:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7fd61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3676:1863365452534656:0@lo:250:mount.lustre.0 00000100:00080000:1.0:1777051294.954672:0:103158:0:(recover.c:349:ptlrpc_recover_import()) MGS: recovery finished FULL, rc = 0 00000020:01000004:1.0:1777051294.954692:0:103158:0:(tgt_mount.c:1762:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1777051294.954828:0:103158:0:(tgt_mount.c:278:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:1.0:1777051294.954840:0:103158:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.146@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1777051294.955020:0:103158:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.146@tcp ctxt 0 is initialized 00000020:01000000:3.0:1777051294.955046:0:46211:0:(tgt_mount.c:1579:tgt_import_update()) NID #0: 192.168.201.146@tcp 10000000:01000000:3.0:1777051294.955072:0:46211:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-MDT0001 about 1 new NIDs 00000020:01000004:1.0:1777051294.955073:0:103158:0:(tgt_mount.c:1387:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.201.146@tcp, index=0000, flags=0x20005 00000020:01000004:3.0:1777051294.955082:0:46211:0:(tgt_mount.c:1144:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:1.0:1777051294.955084:0:103158:0:(tgt_mount.c:1144:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1777051294.955090:0:46211:0:(tgt_mount.c:1145:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1777051294.955091:0:103158:0:(tgt_mount.c:1145:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1777051294.955131:0:46211:0:(tgt_mount.c:1146:server_mti_print()) fs: lustre 00000020:01000004:3.0:1777051294.955134:0:46211:0:(tgt_mount.c:1147:server_mti_print()) uuid: 00000020:01000004:3.0:1777051294.955136:0:46211:0:(tgt_mount.c:1148:server_mti_print()) ver: 0 00000020:01000004:3.0:1777051294.955138:0:46211:0:(tgt_mount.c:1149:server_mti_print()) flags: 00000020:01000004:3.0:1777051294.955141:0:46211:0:(tgt_mount.c:1151:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1777051294.955145:0:46211:0:(tgt_mount.c:1183:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1777051294.955147:0:46211:0:(tgt_mount.c:1189:server_mti_print()) LDD_F_OPC_READY 00000020:01000004:1.0:1777051294.955494:0:103158:0:(tgt_mount.c:1146:server_mti_print()) fs: lustre 00000020:01000004:1.0:1777051294.955497:0:103158:0:(tgt_mount.c:1147:server_mti_print()) uuid: 00000020:01000004:1.0:1777051294.955499:0:103158:0:(tgt_mount.c:1148:server_mti_print()) ver: 0 00000020:01000004:1.0:1777051294.955502:0:103158:0:(tgt_mount.c:1149:server_mti_print()) flags: 00000020:01000004:1.0:1777051294.955505:0:103158:0:(tgt_mount.c:1151:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1777051294.955508:0:103158:0:(tgt_mount.c:1155:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1777051294.955511:0:103158:0:(tgt_mount.c:1183:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1777051294.955514:0:103158:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1777051294.955520:0:103158:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:1.0:1777051294.955525:0:103158:0:(tgt_mount.c:1144:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1777051294.955528:0:103158:0:(tgt_mount.c:1145:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1777051294.955532:0:103158:0:(tgt_mount.c:1146:server_mti_print()) fs: lustre 00000020:01000004:1.0:1777051294.955534:0:103158:0:(tgt_mount.c:1147:server_mti_print()) uuid: 00000020:01000004:1.0:1777051294.955536:0:103158:0:(tgt_mount.c:1148:server_mti_print()) ver: 0 00000020:01000004:1.0:1777051294.955539:0:103158:0:(tgt_mount.c:1149:server_mti_print()) flags: 00000020:01000004:1.0:1777051294.955542:0:103158:0:(tgt_mount.c:1151:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1777051294.955546:0:103158:0:(tgt_mount.c:1155:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1777051294.955549:0:103158:0:(tgt_mount.c:1183:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1777051294.955552:0:103158:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1777051294.955618:0:103158:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000020:01000000:3.0:1777051294.955643:0:46211:0:(tgt_mount.c:1590:tgt_import_update()) lustre-MDT0001: notify about 1 NIDs, rc = 0 00000100:00100000:1.0:1777051294.955645:0:103158:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95f867b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9351a01-5b0e-4470-97fd-58b9b4b312a2:103158:1863365452534912:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1777051294.955666:0:46211:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0000 about 1 new NIDs 00000020:01000004:3.0:1777051294.955673:0:46211:0:(tgt_mount.c:1144:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:3.0:1777051294.955677:0:46211:0:(tgt_mount.c:1145:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1777051294.955681:0:46211:0:(tgt_mount.c:1146:server_mti_print()) fs: lustre 00000020:01000004:3.0:1777051294.955684:0:46211:0:(tgt_mount.c:1147:server_mti_print()) uuid: 00000020:01000004:3.0:1777051294.955687:0:46211:0:(tgt_mount.c:1148:server_mti_print()) ver: 0 00000020:01000004:3.0:1777051294.955690:0:46211:0:(tgt_mount.c:1149:server_mti_print()) flags: 00000020:01000004:3.0:1777051294.955692:0:46211:0:(tgt_mount.c:1153:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1777051294.955696:0:46211:0:(tgt_mount.c:1183:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1777051294.955699:0:46211:0:(tgt_mount.c:1189:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:1.0:1777051294.955724:0:103158:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:3.0:1777051294.955752:0:46211:0:(tgt_mount.c:1590:tgt_import_update()) lustre-OST0000: notify about 1 NIDs, rc = 0 10000000:01000000:3.0:1777051294.955768:0:46211:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0001 about 1 new NIDs 00000020:01000004:3.0:1777051294.955773:0:46211:0:(tgt_mount.c:1144:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:3.0:1777051294.955776:0:46211:0:(tgt_mount.c:1145:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1777051294.955779:0:46211:0:(tgt_mount.c:1146:server_mti_print()) fs: lustre 00000020:01000004:3.0:1777051294.955782:0:46211:0:(tgt_mount.c:1147:server_mti_print()) uuid: 00000100:00100000:1.0:1777051294.955785:0:103158:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d9594cf3c0 going to sleep for 11 seconds 00000020:01000004:3.0:1777051294.955786:0:46211:0:(tgt_mount.c:1148:server_mti_print()) ver: 0 00000020:01000004:3.0:1777051294.955790:0:46211:0:(tgt_mount.c:1149:server_mti_print()) flags: 00000020:01000004:3.0:1777051294.955796:0:46211:0:(tgt_mount.c:1153:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1777051294.955800:0:46211:0:(tgt_mount.c:1183:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1777051294.955803:0:46211:0:(tgt_mount.c:1189:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:1.0:1777051294.955826:0:103166:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452534912 00000020:01000000:3.0:1777051294.955830:0:46211:0:(tgt_mount.c:1590:tgt_import_update()) lustre-OST0001: notify about 1 NIDs, rc = 0 00000100:00100000:1.0:1777051294.955837:0:103166:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452534912 00000100:00100000:1.0:1777051294.955917:0:103163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1777051294.955931:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7fd61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3680:1863365452535168:0@lo:253:kworker.0 00000100:00100000:1.0:1777051294.955936:0:103163:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94a771450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9351a01-5b0e-4470-97fd-58b9b4b312a2+4:103158:x1863365452534912:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1777051294.956008:0:103163:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1777051294.956017:0:103163:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 00000100:00100000:3.0:1777051294.956018:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 20000000:01000000:1.0:1777051294.956032:0:103163:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 00000100:00100000:2.0:1777051294.956037:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7fd63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3678:1863365452534784:0@lo:253:kworker.0 00000100:00100000:3.0:1777051294.956069:0:3680:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1777051294.956086:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7fd60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3680:1863365452535040:0@lo:253:kworker.0 00000100:00100000:1.0:1777051294.956131:0:103166:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452535168 00000100:00100000:1.0:1777051294.956141:0:103166:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452535168 00000100:00100000:2.0:1777051294.956556:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051294.956566:0:103166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1777051294.956583:0:103166:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94a773050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9351a01-5b0e-4470-97fd-58b9b4b312a2+5:3680:x1863365452535168:12345-0@lo:253:kworker.0 20000000:01000000:1.0:1777051294.956620:0:103166:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 00000100:00100000:1.0:1777051294.956687:0:103165:0:(service.c:3441:ptlrpc_start_thread()) mgs[-1] started 3 min 3 max 32 00000100:00100000:1.0:1777051294.956702:0:103165:0:(service.c:3500:ptlrpc_start_thread()) starting thread 'll_mgs_0003' 10000000:01000000:1.0:1777051294.956949:0:103167:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00000100:00100000:0.0:1777051294.957016:0:103165:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452534784 00000100:00100000:0.0:1777051294.957026:0:103165:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452534784 00000100:00100000:0.0:1777051294.957269:0:103168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1777051294.957285:0:103168:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94a770850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f9351a01-5b0e-4470-97fd-58b9b4b312a2+6:3678:x1863365452534784:12345-0@lo:253:kworker.0 20000000:01000000:0.0:1777051294.957324:0:103168:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 00000100:00100000:3.0:1777051294.957440:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051294.957724:0:103165:0:(service.c:3441:ptlrpc_start_thread()) mgs[-1] started 4 min 3 max 32 00000100:00100000:0.0:1777051294.957738:0:103165:0:(service.c:3500:ptlrpc_start_thread()) starting thread 'll_mgs_0004' 20000000:01000000:1.0:1777051294.957911:0:103163:0:(mgs_nids.c:664:mgs_nidtbl_init_fs()) IR: current version is 26 00000100:00100000:0.0:1777051294.958147:0:103165:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452535040 00000100:00100000:0.0:1777051294.958156:0:103165:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452535040 00000100:00100000:3.0:1777051294.958363:0:103169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1777051294.958380:0:103169:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94a770450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f9351a01-5b0e-4470-97fd-58b9b4b312a2+7:3680:x1863365452535040:12345-0@lo:253:kworker.0 20000000:01000000:3.0:1777051294.958415:0:103169:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1777051294.960842:0:103170:0:(mgs_llog.c:341:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:1.0:1777051294.960851:0:103170:0:(mgs_llog.c:341:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:1.0:1777051294.960857:0:103170:0:(mgs_llog.c:325:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:1.0:1777051294.960862:0:103170:0:(mgs_llog.c:325:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:1.0:1777051294.961492:0:103170:0:(llog.c:858:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64 count 63 20000000:01000000:3.0:1777051294.962027:0:103163:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1777051294.962070:0:103163:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1777051294.962243:0:103166:0:(mgs_nids.c:461:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1777051294.969992:0:103166:0:(mgs_nids.c:813:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1777051294.970017:0:103166:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1777051294.970076:0:103168:0:(mgs_nids.c:461:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1777051294.970081:0:103167:0:(mgs_nids.c:710:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1777051294.970131:0:103167:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00000100:00100000:3.0:1777051294.970181:0:103163:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94a771450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9351a01-5b0e-4470-97fd-58b9b4b312a2+7:103158:x1863365452534912:12345-0@lo:253:mount.lustre.0 Request processed in 14227us (14433us total) trans 0 rc 0/0 00010000:00010000:1.0:1777051294.970200:0:103167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99d9442eb800/0x85f51a6b96714afa lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 103167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051294.970236:0:103167:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d9442eb800/0x85f51a6b96714afa lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 103167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1777051294.970256:0:103167:0:(mgs_nids.c:686:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000164962s 00010000:00010000:1.0:1777051294.970268:0:103167:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99d9442eb800/0x85f51a6b96714afa lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 103167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051294.970280:0:103163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:1.0:1777051294.970297:0:103167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99d9442eb800/0x85f51a6b96714afa lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 103167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051294.970313:0:103167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99d9442eb800/0x85f51a6b96714afa lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 103167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051294.970349:0:103158:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95f867b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9351a01-5b0e-4470-97fd-58b9b4b312a2:103158:1863365452534912:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1777051294.970379:0:103158:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1777051294.970435:0:103158:0:(tgt_mount.c:1144:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1777051294.970439:0:103158:0:(tgt_mount.c:1145:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1777051294.970442:0:103158:0:(tgt_mount.c:1146:server_mti_print()) fs: lustre 00000020:01000004:2.0:1777051294.970445:0:103158:0:(tgt_mount.c:1147:server_mti_print()) uuid: 00000020:01000004:2.0:1777051294.970449:0:103158:0:(tgt_mount.c:1148:server_mti_print()) ver: 0 00000020:01000004:2.0:1777051294.970452:0:103158:0:(tgt_mount.c:1149:server_mti_print()) flags: 00000020:01000004:2.0:1777051294.970456:0:103158:0:(tgt_mount.c:1151:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1777051294.970459:0:103158:0:(tgt_mount.c:1155:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1777051294.970464:0:103158:0:(tgt_mount.c:1183:server_mti_print()) LDD_F_LARGE_NID 00010000:00010000:1.0:1777051294.970468:0:103167:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99d9442eb800/0x85f51a6b96714afa lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 103167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1777051294.970468:0:103158:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_OPC_REG 00010000:00010000:1.0:1777051294.970488:0:103167:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d9442eb800 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:1.0:1777051294.970498:0:103167:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99d9442eb800/0x85f51a6b96714afa lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 103167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051294.970514:0:103167:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99d9442eb800/0x85f51a6b96714afa lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 103167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1777051294.970515:0:103158:0:(tgt_mount.c:99:server_register_mount()) register mount ffff99da5f2be000 from lustre-MDT0000 00010000:00010000:1.0:1777051294.970551:0:103167:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99d9442eb800/0x85f51a6b96714afa lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 103167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1777051294.970567:0:103158:0:(mgc_request.c:1941:mgc_process_config()) parse_log lustre-MDT0000 from 0 00010000:00010000:1.0:1777051294.970569:0:103167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99d9442eb800/0x85f51a6b96714afa lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 103167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1777051294.970573:0:103158:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 00010000:00010000:1.0:1777051294.970590:0:103167:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d9442eb800/0x85f51a6b96714afa lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 103167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1777051294.970592:0:103158:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff99da5f2be000 10000000:01000000:2.0:1777051294.970600:0:103158:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1777051294.970612:0:103158:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff99da5f2be000 10000000:01000000:2.0:1777051294.970616:0:103158:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1777051294.970622:0:103158:0:(mgc_request.c:1799:mgc_process_log()) Process log lustre-barrier-ffff99da5f2be000 from 1 10000000:01000000:2.0:1777051294.970626:0:103158:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1777051294.970673:0:103158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.146@tcp lock: ffff99d955a99e00/0x85f51a6b96714b01 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 103158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051294.970694:0:103158:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.146@tcp lock: ffff99d955a99e00/0x85f51a6b96714b01 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 103158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051294.970708:0:103158:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.146@tcp lock: ffff99d955a99e00/0x85f51a6b96714b01 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 103158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051294.970740:0:103158:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f9bb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9351a01-5b0e-4470-97fd-58b9b4b312a2:103158:1863365452535296:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1777051294.970776:0:103166:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94a773050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9351a01-5b0e-4470-97fd-58b9b4b312a2+6:3680:x1863365452535168:12345-0@lo:253:kworker.0 Request processed in 14193us (14758us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051294.970793:0:103166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000020:01000004:0.0:1777051294.970816:0:3680:0:(tgt_mount.c:1144:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:0.0:1777051294.970822:0:3680:0:(tgt_mount.c:1145:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1777051294.970826:0:3680:0:(tgt_mount.c:1146:server_mti_print()) fs: lustre 00000020:01000004:0.0:1777051294.970829:0:3680:0:(tgt_mount.c:1147:server_mti_print()) uuid: 00000020:01000004:0.0:1777051294.970836:0:3680:0:(tgt_mount.c:1148:server_mti_print()) ver: 0 00000100:00100000:2.0:1777051294.970838:0:103158:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000004:0.0:1777051294.970840:0:3680:0:(tgt_mount.c:1149:server_mti_print()) flags: 00000020:01000004:0.0:1777051294.970847:0:3680:0:(tgt_mount.c:1153:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1777051294.970851:0:3680:0:(tgt_mount.c:1183:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1777051294.970855:0:3680:0:(tgt_mount.c:1189:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:0.0:1777051294.970863:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7fd61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3680:1863365452535168:0@lo:253:kworker.0 00000100:00100000:2.0:1777051294.970925:0:103158:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da4133a9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1777051294.970941:0:103165:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452535296 00000100:00100000:1.0:1777051294.970953:0:103165:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452535296 00000100:00100000:1.0:1777051294.971028:0:103165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1777051294.971044:0:103165:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7d9cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9351a01-5b0e-4470-97fd-58b9b4b312a2+6:103158:x1863365452535296:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1777051294.971069:0:103165:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777051294.971131:0:103165:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d9442eac00/0x85f51a6b96714b08 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x85f51a6b96714b01 expref: -99 pid: 103165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051294.971167:0:103165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d9442eac00/0x85f51a6b96714b08 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x85f51a6b96714b01 expref: 7 pid: 103165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051294.971185:0:103165:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d9442eac00/0x85f51a6b96714b08 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b96714b01 expref: 7 pid: 103165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051294.971199:0:103165:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d9442eac00, rc 0) 00000100:00100000:1.0:1777051294.971272:0:103165:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7d9cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9351a01-5b0e-4470-97fd-58b9b4b312a2+7:103158:x1863365452535296:12345-0@lo:101:mount.lustre.0 Request processed in 231us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051294.971345:0:103158:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f9bb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9351a01-5b0e-4470-97fd-58b9b4b312a2:103158:1863365452535296:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1777051294.971372:0:103158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.146@tcp lock: ffff99d955a99e00/0x85f51a6b96714b01 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b96714b08 expref: -99 pid: 103158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051294.971374:0:103165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:2.0:1777051294.971397:0:103158:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.146@tcp lock: ffff99d955a99e00/0x85f51a6b96714b01 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x85f51a6b96714b08 expref: -99 pid: 103158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1777051294.971427:0:103158:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.201.146@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1777051294.971454:0:103158:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff99d955a99e00/0x85f51a6b96714b01 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b96714b08 expref: -99 pid: 103158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051294.971470:0:103158:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.146@tcp lock: ffff99d955a99e00/0x85f51a6b96714b01 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b96714b08 expref: -99 pid: 103158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1777051294.971481:0:103158:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1777051294.971490:0:103158:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1777051294.971499:0:103158:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff99da5f2be000 10000000:01000000:2.0:1777051294.971506:0:103158:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1777051294.971513:0:103158:0:(mgc_request.c:1799:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1777051294.971517:0:103158:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1777051294.971547:0:103158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.146@tcp lock: ffff99d955a98200/0x85f51a6b96714b0f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 103158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051294.971561:0:103158:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.146@tcp lock: ffff99d955a98200/0x85f51a6b96714b0f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 103158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051294.971574:0:103158:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.146@tcp lock: ffff99d955a98200/0x85f51a6b96714b0f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 103158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051294.971596:0:103158:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f9bb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9351a01-5b0e-4470-97fd-58b9b4b312a2:103158:1863365452535424:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1777051294.971642:0:103158:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051294.971680:0:103158:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da4133a9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1777051294.971786:0:103163:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452535424 00000100:00100000:0.0:1777051294.971795:0:103163:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452535424 00000100:00100000:0.0:1777051294.971958:0:103163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1777051294.971973:0:103163:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7d9cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9351a01-5b0e-4470-97fd-58b9b4b312a2+7:103158:x1863365452535424:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1777051294.971989:0:103163:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051294.972011:0:103163:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99da713e3800/0x85f51a6b96714b16 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x85f51a6b96714b0f expref: -99 pid: 103163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051294.972043:0:103163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99da713e3800/0x85f51a6b96714b16 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x85f51a6b96714b0f expref: 8 pid: 103163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051294.972060:0:103163:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99da713e3800/0x85f51a6b96714b16 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b96714b0f expref: 8 pid: 103163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051294.972431:0:103163:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99da713e3800, rc 0) 00000100:00100000:0.0:1777051294.972509:0:103163:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7d9cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9351a01-5b0e-4470-97fd-58b9b4b312a2+8:103158:x1863365452535424:12345-0@lo:101:mount.lustre.0 Request processed in 539us (864us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051294.972522:0:103163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1777051294.972789:0:103158:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f9bb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9351a01-5b0e-4470-97fd-58b9b4b312a2:103158:1863365452535424:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1777051294.972808:0:103158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.146@tcp lock: ffff99d955a98200/0x85f51a6b96714b0f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b96714b16 expref: -99 pid: 103158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051294.972822:0:103158:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.146@tcp lock: ffff99d955a98200/0x85f51a6b96714b0f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x85f51a6b96714b16 expref: -99 pid: 103158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051294.972922:0:103158:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f9bb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9351a01-5b0e-4470-97fd-58b9b4b312a2:103158:1863365452535552:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1777051294.972966:0:103158:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051294.973009:0:103158:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da4133a9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1777051294.973601:0:103165:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452535552 00000100:00100000:1.0:1777051294.973609:0:103165:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452535552 00000100:00100000:1.0:1777051294.973970:0:103165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1777051294.973986:0:103165:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7d9cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9351a01-5b0e-4470-97fd-58b9b4b312a2+8:103158:x1863365452535552:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1777051294.974257:0:103165:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7d9cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9351a01-5b0e-4470-97fd-58b9b4b312a2+9:103158:x1863365452535552:12345-0@lo:501:mount.lustre.0 Request processed in 272us (1285us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051294.974271:0:103165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1777051294.974320:0:103158:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f9bb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9351a01-5b0e-4470-97fd-58b9b4b312a2:103158:1863365452535552:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1777051294.974378:0:103158:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f9bb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9351a01-5b0e-4470-97fd-58b9b4b312a2:103158:1863365452535680:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1777051294.974456:0:103158:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051294.974507:0:103158:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da4133a9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1777051294.974561:0:103163:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452535680 00000100:00100000:0.0:1777051294.974571:0:103163:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452535680 00000100:00100000:0.0:1777051294.974630:0:103163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1777051294.974643:0:103163:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7d9cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9351a01-5b0e-4470-97fd-58b9b4b312a2+9:103158:x1863365452535680:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1777051294.977065:0:103163:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7d9cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9351a01-5b0e-4470-97fd-58b9b4b312a2+9:103158:x1863365452535680:12345-0@lo:503:mount.lustre.0 Request processed in 2420us (2606us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051294.977091:0:103163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1777051294.977489:0:103158:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f9bb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9351a01-5b0e-4470-97fd-58b9b4b312a2:103158:1863365452535680:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1777051294.978571:0:103171:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7fd61c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f9351a01-5b0e-4470-97fd-58b9b4b312a2:103171:1863365452535808:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1777051294.978638:0:103171:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051294.978682:0:103171:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d94483acc0 going to sleep for 11 seconds 00000100:00100000:1.0:1777051294.978729:0:103165:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452535808 00000100:00100000:1.0:1777051294.978740:0:103165:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452535808 00000100:00100000:1.0:1777051294.978805:0:103165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1777051294.978822:0:103165:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7d9ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9351a01-5b0e-4470-97fd-58b9b4b312a2+9:103171:x1863365452535808:12345-0@lo:502:llog_process_th.0 20000000:01000000:2.0:1777051294.979812:0:103168:0:(mgs_nids.c:813:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1777051294.979828:0:103168:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:3.0:1777051294.979887:0:103169:0:(mgs_nids.c:461:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1777051294.979938:0:103167:0:(mgs_nids.c:710:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1777051294.979947:0:103167:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1777051294.979977:0:103167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99d9442eb800/0x85f51a6b96714b1d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 103167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051294.980015:0:103167:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d9442eb800/0x85f51a6b96714b1d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 103167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1777051294.980039:0:103167:0:(mgs_nids.c:686:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000164962s 00010000:00010000:1.0:1777051294.980052:0:103167:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99d9442eb800/0x85f51a6b96714b1d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 103167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051294.980067:0:103167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99d9442eb800/0x85f51a6b96714b1d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 103167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051294.980082:0:103167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99d9442eb800/0x85f51a6b96714b1d lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 103167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051294.980124:0:103165:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7d9ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9351a01-5b0e-4470-97fd-58b9b4b312a2+9:103171:x1863365452535808:12345-0@lo:502:llog_process_th.0 Request processed in 1267us (1444us total) trans 0 rc 0/0 00010000:00010000:1.0:1777051294.980133:0:103167:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99d9442eb800/0x85f51a6b96714b1d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 103167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051294.980165:0:103171:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7fd61c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f9351a01-5b0e-4470-97fd-58b9b4b312a2:103171:1863365452535808:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1777051294.980168:0:103165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:1.0:1777051294.980169:0:103167:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d9442eb800 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:1.0:1777051294.980185:0:103167:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99d9442eb800/0x85f51a6b96714b1d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 103167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051294.980202:0:103167:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99d9442eb800/0x85f51a6b96714b1d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 103167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051294.980224:0:103167:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99d9442eb800/0x85f51a6b96714b1d lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 103167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000000:3.0:1777051294.980596:0:103171:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1777051294.980618:0:103171:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1777051294.980623:0:103171:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1777051294.980633:0:103171:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1777051294.980639:0:103171:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000100:00100000:2.0:1777051294.980647:0:103168:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94a770850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f9351a01-5b0e-4470-97fd-58b9b4b312a2+8:3678:x1863365452534784:12345-0@lo:253:kworker.0 Request processed in 23365us (24095us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051294.980664:0:103168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000020:00000080:3.0:1777051294.980667:0:103171:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff99da7f9919c0) 00000020:01000004:0.0:1777051294.980688:0:3678:0:(tgt_mount.c:1144:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:0.0:1777051294.980694:0:3678:0:(tgt_mount.c:1145:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1777051294.980697:0:3678:0:(tgt_mount.c:1146:server_mti_print()) fs: lustre 00000020:01000004:0.0:1777051294.980699:0:3678:0:(tgt_mount.c:1147:server_mti_print()) uuid: 00000020:01000004:0.0:1777051294.980701:0:3678:0:(tgt_mount.c:1148:server_mti_print()) ver: 0 00000020:00000080:3.0:1777051294.980704:0:103171:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:01000004:0.0:1777051294.980705:0:3678:0:(tgt_mount.c:1149:server_mti_print()) flags: 00000020:01000004:0.0:1777051294.980711:0:3678:0:(tgt_mount.c:1151:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1777051294.980716:0:3678:0:(tgt_mount.c:1183:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1777051294.980720:0:3678:0:(tgt_mount.c:1189:server_mti_print()) LDD_F_OPC_READY 00000020:00000080:3.0:1777051294.980720:0:103171:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000100:00100000:0.0:1777051294.980731:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7fd63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3678:1863365452534784:0@lo:253:kworker.0 00080000:01000000:3.0:1777051294.981160:0:103171:0:(osd_handler.c:8912:osd_obd_connect()) connect #2 00000020:00000080:3.0:1777051294.981173:0:103171:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x85f51a6b96714b2b 00010000:00010000:1.0:1777051294.981313:0:103167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99d9442eb800/0x85f51a6b96714b1d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 103167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051294.981326:0:103167:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d9442eb800/0x85f51a6b96714b1d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 103167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1777051294.981850:0:103171:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1777051294.981860:0:103171:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1777051294.981868:0:103171:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1777051294.981871:0:103171:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1777051294.981877:0:103171:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1777051294.981884:0:103171:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1777051294.981887:0:103171:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1777051294.981894:0:103171:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1777051294.981909:0:103171:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff99da46203380) 00000020:00000080:2.0:1777051294.981937:0:103171:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1777051294.981948:0:103171:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1777051294.981951:0:103171:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1777051294.981959:0:103171:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1777051294.981970:0:103171:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1777051294.982125:0:103171:0:(tgt_mount.c:151:server_get_mount()) get mount ffff99da5f2be000 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1777051294.982149:0:103171:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff99da46200000) 00000020:00000080:2.0:1777051294.982163:0:103171:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1777051294.982303:0:103171:0:(lod_dev.c:2288:lod_obd_connect()) connect #0 00000020:00000080:2.0:1777051294.982315:0:103171:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x85f51a6b96714b40 00000020:00000080:2.0:1777051294.982707:0:103171:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1777051294.982717:0:103171:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1777051294.982722:0:103171:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x85f51a6b96714b47 00080000:01000000:2.0:1777051294.982729:0:103171:0:(osd_handler.c:8912:osd_obd_connect()) connect #3 00000020:00000080:2.0:1777051294.982734:0:103171:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x85f51a6b96714b4e 20000000:01000000:3.0:1777051294.988643:0:103169:0:(mgs_nids.c:813:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1777051294.988664:0:103169:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1777051294.988739:0:103167:0:(mgs_nids.c:710:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1777051294.988749:0:103167:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1777051294.988778:0:103167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99d9442eb800/0x85f51a6b96714b55 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 103167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051294.988801:0:103167:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d9442eb800/0x85f51a6b96714b55 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 103167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1777051294.988813:0:103167:0:(mgs_nids.c:686:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000164962s 00010000:00010000:1.0:1777051294.988818:0:103167:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99d9442eb800/0x85f51a6b96714b55 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 103167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051294.988828:0:103167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99d9442eb800/0x85f51a6b96714b55 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 103167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051294.988845:0:103167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99d9442eb800/0x85f51a6b96714b55 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 103167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051294.988859:0:103167:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99d9442eb800/0x85f51a6b96714b55 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 103167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051294.988891:0:103167:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d9442eb800 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:1.0:1777051294.988899:0:103167:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99d9442eb800/0x85f51a6b96714b55 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 103167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051294.988914:0:103167:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99d9442eb800/0x85f51a6b96714b55 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 103167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051294.988936:0:103167:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99d9442eb800/0x85f51a6b96714b55 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 103167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051294.988950:0:103167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99d9442eb800/0x85f51a6b96714b55 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 103167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051294.988963:0:103167:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d9442eb800/0x85f51a6b96714b55 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 103167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051294.989654:0:103169:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94a770450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f9351a01-5b0e-4470-97fd-58b9b4b312a2+7:3680:x1863365452535040:12345-0@lo:253:kworker.0 Request processed in 31270us (32208us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051294.989675:0:103169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000020:01000004:0.0:1777051294.990280:0:3680:0:(tgt_mount.c:1144:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:0.0:1777051294.990287:0:3680:0:(tgt_mount.c:1145:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1777051294.990290:0:3680:0:(tgt_mount.c:1146:server_mti_print()) fs: lustre 00000020:01000004:0.0:1777051294.990293:0:3680:0:(tgt_mount.c:1147:server_mti_print()) uuid: 00000020:01000004:0.0:1777051294.990296:0:3680:0:(tgt_mount.c:1148:server_mti_print()) ver: 0 00000020:01000004:0.0:1777051294.990299:0:3680:0:(tgt_mount.c:1149:server_mti_print()) flags: 00000020:01000004:0.0:1777051294.990303:0:3680:0:(tgt_mount.c:1153:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1777051294.990308:0:3680:0:(tgt_mount.c:1183:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1777051294.990312:0:3680:0:(tgt_mount.c:1189:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:0.0:1777051294.990320:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7fd60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3680:1863365452535040:0@lo:253:kworker.0 00010000:00010000:3.0:1777051295.094704:0:103171:0:(ldlm_pool.c:924:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-4 is initialized 00000001:00080000:3.0:1777051295.095610:0:103171:0:(tgt_lastrcvd.c:1758:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0001-mdtlov_UUID idx: 0 lr: 12884902301 srv lr: 25769803776 lx: 0 gen 1 00000001:00080000:3.0:1777051295.095696:0:103171:0:(tgt_lastrcvd.c:1758:tgt_clients_data_init()) RCVRNG CLIENT uuid: 2dd4696c-edce-4cd1-86d2-dbd2ff957fa1 idx: 1 lr: 12884904249 srv lr: 25769803776 lx: 0 gen 9 00000001:00080000:3.0:1777051295.095742:0:103171:0:(tgt_lastrcvd.c:1758:tgt_clients_data_init()) RCVRNG CLIENT uuid: c11b6966-0775-44d2-bdc6-c74c26eb2226 idx: 3 lr: 12884904250 srv lr: 25769803776 lx: 0 gen 10 00000001:00000004:3.0:1777051295.095785:0:103171:0:(tgt_lastrcvd.c:732:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 7, last_transno is 25769803776 00000001:00080000:3.0:1777051295.096340:0:103171:0:(tgt_lastrcvd.c:223:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000001:00080000:3.0:1777051295.096453:0:103171:0:(tgt_lastrcvd.c:2296:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff99d94b77f600: xid 1863365425794688, transno 12884904250, client gen 10, slot idx 0 00000001:00080000:3.0:1777051295.096473:0:103171:0:(tgt_lastrcvd.c:2296:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff99d94b77fcc0: xid 1863365452132608, transno 12884902301, client gen 1, slot idx 1 00000001:00080000:3.0:1777051295.096482:0:103171:0:(tgt_lastrcvd.c:2296:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff99d94b77f900: xid 1863365425793024, transno 12884904249, client gen 9, slot idx 2 00000001:00080000:3.0:1777051295.096487:0:103171:0:(tgt_lastrcvd.c:2296:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff99d94b77f180: xid 1863365425791872, transno 12884904246, client gen 9, slot idx 3 00000001:00080000:3.0:1777051295.096492:0:103171:0:(tgt_lastrcvd.c:2296:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff99d94b77fd80: xid 1863365425791104, transno 12884904237, client gen 10, slot idx 4 00000001:00080000:3.0:1777051295.096497:0:103171:0:(tgt_lastrcvd.c:2296:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff99d94b77fc00: xid 1863365425792128, transno 12884904242, client gen 10, slot idx 5 00000001:00080000:3.0:1777051295.096501:0:103171:0:(tgt_lastrcvd.c:2296:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff99d94b77f9c0: xid 1863365425539328, transno 12884903901, client gen 10, slot idx 6 00000001:00080000:3.0:1777051295.096505:0:103171:0:(tgt_lastrcvd.c:2296:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff99d94b77fb40: xid 1863365425435392, transno 12884903784, client gen 10, slot idx 7 00000001:00080000:3.0:1777051295.096510:0:103171:0:(tgt_lastrcvd.c:2296:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff99d94b77f840: xid 1863365425436032, transno 12884903788, client gen 10, slot idx 8 00000001:00080000:3.0:1777051295.096516:0:103171:0:(tgt_lastrcvd.c:2296:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff99d94b77f540: xid 1863365425435136, transno 12884903781, client gen 10, slot idx 9 00000001:00080000:3.0:1777051295.096524:0:103171:0:(tgt_lastrcvd.c:2296:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff99d94b77f240: xid 1863365425430144, transno 12884903754, client gen 10, slot idx 10 00000001:00080000:3.0:1777051295.096530:0:103171:0:(tgt_lastrcvd.c:2296:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff99d94b77f0c0: xid 1863365425155200, transno 12884903075, client gen 9, slot idx 11 00000001:00080000:3.0:1777051295.096537:0:103171:0:(tgt_lastrcvd.c:2296:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff99d94b77f300: xid 1863365425418240, transno 12884903704, client gen 10, slot idx 12 00000020:00000080:3.0:1777051295.097376:0:103171:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff99da7f994d40) 00000020:00000080:3.0:1777051295.097416:0:103171:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1777051295.097537:0:103171:0:(osd_handler.c:8912:osd_obd_connect()) connect #4 00000020:00000080:3.0:1777051295.097550:0:103171:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x85f51a6b96714b78 00000020:00000080:2.0:1777051295.098553:0:103171:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1777051295.108852:0:103171:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x85f51a6b96714b7f 00000020:00000080:1.0:1777051295.110801:0:103171:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1777051295.110825:0:103171:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1777051295.110838:0:103171:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1777051295.110843:0:103171:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1777051295.110849:0:103171:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1777051295.110854:0:103171:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #9 00000020:01000000:1.0:1777051295.110857:0:103171:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1777051295.110860:0:103171:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1777051295.110862:0:103171:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1777051295.110869:0:103171:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1777051295.110872:0:103171:0:(obd_config.c:1561:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:1.0:1777051295.110876:0:103171:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1777051295.110884:0:103171:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1777051295.110887:0:103171:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1777051295.110895:0:103171:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1777051295.110970:0:103171:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1777051295.111003:0:103171:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1777051295.111009:0:103171:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1777051295.111012:0:103171:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1777051295.111016:0:103171:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1777051295.111021:0:103171:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1777051295.111023:0:103171:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:1.0:1777051295.111028:0:103171:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1777051295.111429:0:103171:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.201.146@tcp to nid 0x20000c0a8c992 (192.168.201.146@tcp) 00000020:00000080:1.0:1777051295.111479:0:103171:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1777051295.111503:0:103171:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff99d941e68000) 00000020:00000080:1.0:1777051295.111539:0:103171:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:1.0:1777051295.111549:0:103171:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1777051295.111664:0:103171:0:(osp_dev.c:1199:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:1.0:1777051295.111675:0:103171:0:(osd_handler.c:8912:osd_obd_connect()) connect #5 00000020:00000080:1.0:1777051295.111689:0:103171:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x85f51a6b96714b8d 00010000:00080000:1.0:1777051295.111756:0:103171:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99da42f4c800@lustre-MDT0001-osp-MDT0000: add connection 192.168.201.146@tcp at head 00010000:00010000:1.0:1777051295.117620:0:103171:0:(ldlm_pool.c:924:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-9 is initialized 00000020:00000080:3.0:1777051295.119691:0:103171:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1777051295.119714:0:103171:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1777051295.119774:0:103171:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:3.0:1777051295.119807:0:103171:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x85f51a6b96714b94 00000100:00080000:3.0:1777051295.119825:0:103171:0:(import.c:509:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1777051295.119835:0:103171:0:(import.c:623:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff99da42f4c800 using connection 192.168.201.146@tcp/0@lo 00000100:00100000:3.0:1777051295.119894:0:103171:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99da7fd61c00 x1863365452535936/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1777051295.119943:0:103171:0:(pinger.c:371:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00100000:0.0:1777051295.120030:0:3676:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7fd61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3676:1863365452535936:0@lo:38:llog_process_th.0 00000100:00080000:1.0:1777051295.120439:0:46211:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1777051295.120450:0:46211:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1777051295.120456:0:46211:0:(import.c:65:import_set_state_nolock()) ffff99da7dbeb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1777051295.120467:0:46211:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 7923 00000100:00080000:1.0:1777051295.120473:0:46211:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1777051295.120481:0:46211:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff99da7dbeb000 using connection 192.168.201.146@tcp/0@lo 00000020:01000000:3.0:1777051295.120483:0:103171:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1777051295.120495:0:103171:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1777051295.120500:0:103171:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:3.0:1777051295.120506:0:103171:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1777051295.120512:0:103171:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #20 00000020:01000000:3.0:1777051295.120514:0:103171:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1777051295.120517:0:103171:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1777051295.120519:0:103171:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1777051295.120525:0:103171:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1777051295.120527:0:103171:0:(obd_config.c:1561:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:3.0:1777051295.120531:0:103171:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1777051295.120539:0:103171:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000100:00100000:1.0:1777051295.120545:0:46211:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d95f867b80 x1863365452536064/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000020:00000080:3.0:1777051295.120549:0:103171:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1777051295.120555:0:103171:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1777051295.120569:0:103171:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1777051295.120581:0:103171:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.201.146@tcp to nid 0x20000c0a8c992 (192.168.201.146@tcp) 00000100:00080000:1.0:1777051295.120595:0:46211:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1777051295.120602:0:46211:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1777051295.120606:0:46211:0:(import.c:65:import_set_state_nolock()) ffff99da7fa93000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1777051295.120614:0:46211:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 7923 00000020:01000000:3.0:1777051295.120615:0:103171:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000100:00080000:1.0:1777051295.120621:0:46211:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000020:00000080:3.0:1777051295.120622:0:103171:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000100:00080000:1.0:1777051295.120632:0:46211:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff99da7fa93000 using connection 192.168.201.146@tcp/0@lo 00000020:00000080:3.0:1777051295.120642:0:103171:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff99da7f990000) 00000100:00100000:1.0:1777051295.120663:0:46211:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99da44977800 x1863365452536192/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000020:00000080:3.0:1777051295.120941:0:103171:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osp with refcount 2 00000020:00000080:3.0:1777051295.120953:0:103171:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000100:00080000:1.0:1777051295.120977:0:46211:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1777051295.120983:0:46211:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1777051295.120987:0:46211:0:(import.c:65:import_set_state_nolock()) ffff99d94183b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1777051295.120995:0:46211:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 7923 00000100:00080000:1.0:1777051295.121000:0:46211:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1777051295.121006:0:46211:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff99d94183b000 using connection 192.168.201.146@tcp/0@lo 00000100:00100000:1.0:1777051295.121034:0:46211:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99da444a0380 x1863365452536320/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000004:00080000:3.0:1777051295.121081:0:103171:0:(osp_dev.c:1199:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1777051295.121121:0:103171:0:(osd_handler.c:8912:osd_obd_connect()) connect #6 00000100:00080000:1.0:1777051295.121138:0:46211:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000080:3.0:1777051295.121139:0:103171:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x85f51a6b96714ba2 00000100:00080000:1.0:1777051295.121150:0:46211:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1777051295.121154:0:46211:0:(import.c:65:import_set_state_nolock()) ffff99da5f282000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1777051295.121162:0:46211:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 7923 00000100:00080000:1.0:1777051295.121167:0:46211:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1777051295.121174:0:46211:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff99da5f282000 using connection 192.168.201.146@tcp/0@lo 00000100:00100000:1.0:1777051295.121238:0:46211:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99da444a0700 x1863365452536704/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00010000:00080000:3.0:1777051295.121240:0:103171:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99d942fb3800@lustre-OST0000-osc-MDT0000: add connection 192.168.201.146@tcp at head 00000100:00100000:0.0:1777051295.121353:0:3676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051295.121412:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da444a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3677:1863365452536448:0@lo:400:kworker.0 00000100:00100000:0.0:1777051295.121476:0:3676:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95f867b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3676:1863365452536064:0@lo:38:kworker.0 00000100:00100000:1.0:1777051295.121493:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051295.121544:0:3677:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1777051295.121556:0:3676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051295.121563:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da444a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452536576:0@lo:400:kworker.0 00000100:00100000:0.0:1777051295.121610:0:3676:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da44977800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3676:1863365452536192:0@lo:38:kworker.0 00000100:00100000:1.0:1777051295.121634:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1777051295.121669:0:103171:0:(ldlm_pool.c:924:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-10 is initialized 00000100:00100000:0.0:1777051295.121685:0:3676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051295.121726:0:3676:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da444a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3676:1863365452536320:0@lo:38:kworker.0 00000100:00100000:0.0:1777051295.121777:0:3676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051295.122063:0:6581:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452536448 00000100:00100000:1.0:1777051295.122076:0:6581:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452536448 00000100:00100000:0.0:1777051295.122085:0:3676:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da444a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3676:1863365452536704:0@lo:38:kworker.0 00000100:00100000:2.0:1777051295.122516:0:46498:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452535936 00000100:00100000:2.0:1777051295.122527:0:46498:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452535936 00000100:00100000:0.0:1777051295.122535:0:3676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051295.122585:0:46498:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452536064 00000100:00100000:2.0:1777051295.122593:0:46498:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452536064 00000100:00100000:0.0:1777051295.122606:0:27884:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452536576 00000100:00100000:0.0:1777051295.122615:0:27884:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452536576 00000100:00100000:0.0:1777051295.122999:0:27884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10238 00000100:00100000:0.0:1777051295.123018:0:27884:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95fae9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3677:x1863365452536576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777051295.123043:0:6581:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452536192 00000100:00100000:1.0:1777051295.123052:0:6581:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452536192 00000100:00100000:2.0:1777051295.123082:0:46498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8012 00000100:00100000:2.0:1777051295.123128:0:46498:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955612300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:0+-99:3676:x1863365452535936:12345-0@lo:38:llog_process_th.0 00000100:00100000:0.0:1777051295.123161:0:27884:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95fae9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3677:x1863365452536576:12345-0@lo:400:kworker.0 Request processed in 144us (1523us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051295.123162:0:6581:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452536320 00000100:00100000:1.0:1777051295.123170:0:6581:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452536320 00010000:00080000:2.0:1777051295.123176:0:46498:0:(ldlm_lib.c:1431:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 7924 last 0 00000100:00100000:0.0:1777051295.123186:0:27884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10238 00000100:00100000:1.0:1777051295.123258:0:6581:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452536704 00000100:00100000:1.0:1777051295.123265:0:6581:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452536704 00000020:00000080:2.0:1777051295.123282:0:46498:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x85f51a6b96714ba9 00000100:00100000:0.0:1777051295.123304:0:46494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13166 00000004:00100000:2.0:1777051295.123313:0:46498:0:(mdt_handler.c:7285:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:0.0:1777051295.123321:0:46494:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95fae9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0001-lwp-OST0000_UUID+5:3677:x1863365452536448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777051295.123329:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111715 00000100:00100000:1.0:1777051295.123341:0:6581:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955613480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3676:x1863365452536192:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1777051295.123408:0:46494:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95fae9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0001-lwp-OST0000_UUID+5:3677:x1863365452536448:12345-0@lo:400:kworker.0 Request processed in 89us (1915us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051295.123423:0:46494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13166 00000100:00100000:1.0:1777051295.123440:0:6581:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955613480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3676:x1863365452536192:12345-0@lo:38:kworker.0 Request processed in 95us (1757us total) trans 0 rc -11/-11 00000100:00100000:1.0:1777051295.123457:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111715 00000100:00100000:0.0:1777051295.123522:0:46494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111716 00000100:00100000:0.0:1777051295.123533:0:46494:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f42ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:0+-99:3676:x1863365452536320:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1777051295.123538:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111717 00000100:00100000:1.0:1777051295.123554:0:6581:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f97ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3676:x1863365452536704:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1777051295.123618:0:46494:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f42ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:0+-99:3676:x1863365452536320:12345-0@lo:38:kworker.0 Request processed in 81us (1838us total) trans 0 rc -11/-11 00000100:00100000:1.0:1777051295.123630:0:6581:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f97ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3676:x1863365452536704:12345-0@lo:38:kworker.0 Request processed in 72us (1092us total) trans 0 rc -11/-11 00000100:00100000:0.0:1777051295.123641:0:46494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111716 00000100:00100000:1.0:1777051295.123653:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111717 00000100:00100000:1.0:1777051295.123708:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8013 00000100:00100000:1.0:1777051295.123718:0:6584:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955612680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3676:x1863365452536064:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1777051295.123750:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da444a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452536576:0@lo:400:kworker.0 00000100:00100000:1.0:1777051295.123784:0:6584:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955612680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3676:x1863365452536064:12345-0@lo:38:kworker.0 Request processed in 64us (2235us total) trans 0 rc -11/-11 00000100:00100000:0.0:1777051295.123791:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da444a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3677:1863365452536448:0@lo:400:kworker.0 00000100:00100000:1.0:1777051295.123799:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8013 00000100:00080000:2.0:1777051295.123873:0:46498:0:(import.c:65:import_set_state_nolock()) ffff99da44f1f000 : changing import state from RECOVER to FULL 00000100:00080000:0.0:1777051295.123884:0:3676:0:(import.c:65:import_set_state_nolock()) ffff99da7dbeb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1777051295.123896:0:3676:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1777051295.123904:0:3676:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95f867b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3676:1863365452536064:0@lo:38:kworker.0 00000100:00080000:0.0:1777051295.123928:0:3676:0:(import.c:65:import_set_state_nolock()) ffff99da7fa93000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:1.0:1777051295.123929:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d943d93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3680:1863365452536960:0@lo:400:kworker.0 00000100:00080000:0.0:1777051295.123948:0:3676:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1777051295.123951:0:46498:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955612300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+6:3676:x1863365452535936:12345-0@lo:38:llog_process_th.0 Request processed in 850us (2600us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051295.123961:0:3676:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da44977800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3676:1863365452536192:0@lo:38:kworker.0 00000100:00100000:2.0:1777051295.123971:0:46498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8012 00000100:00100000:1.0:1777051295.123983:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1777051295.123996:0:3676:0:(import.c:65:import_set_state_nolock()) ffff99d94183b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1777051295.124004:0:3676:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1777051295.124014:0:3676:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da444a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3676:1863365452536320:0@lo:38:kworker.0 00000100:00100000:2.0:1777051295.124029:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da444a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3679:1863365452536832:0@lo:400:kworker.0 00000100:00080000:0.0:1777051295.124039:0:3676:0:(import.c:65:import_set_state_nolock()) ffff99da5f282000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1777051295.124049:0:3676:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1777051295.124058:0:3676:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da444a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3676:1863365452536704:0@lo:38:kworker.0 00000100:00100000:0.0:1777051295.124082:0:3676:0:(client.c:3101:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1777051295.124128:0:3676:0:(import.c:1130:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 1 00000100:00100000:3.0:1777051295.124130:0:8471:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452536960 00000100:00100000:2.0:1777051295.124133:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051295.124144:0:8471:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452536960 00000100:00080000:0.0:1777051295.124147:0:3676:0:(import.c:958:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1777051295.124500:0:3676:0:(import.c:1211:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1777051295.124507:0:3676:0:(import.c:65:import_set_state_nolock()) ffff99da42f4c800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1777051295.124519:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10239 00000100:00100000:3.0:1777051295.124537:0:8471:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95fae9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3680:x1863365452536960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777051295.124539:0:3676:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7fd61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3676:1863365452535936:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1777051295.124539:0:6580:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452536832 00000100:00100000:1.0:1777051295.124552:0:6580:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452536832 00000100:00100000:1.0:1777051295.124625:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13167 00000100:00100000:1.0:1777051295.124640:0:6580:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3679:x1863365452536832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051295.124679:0:8471:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95fae9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3680:x1863365452536960:12345-0@lo:400:kworker.0 Request processed in 145us (698us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051295.124695:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10239 00000100:00100000:2.0:1777051295.124721:0:3678:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1777051295.124737:0:6580:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3679:x1863365452536832:12345-0@lo:400:kworker.0 Request processed in 96us (605us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051295.124742:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f9b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3678:1863365452537088:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1777051295.124757:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13167 00000100:00100000:0.0:1777051295.124783:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d943d93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3680:1863365452536960:0@lo:400:kworker.0 00000100:00100000:2.0:1777051295.124828:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051295.124829:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da444a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3679:1863365452536832:0@lo:400:kworker.0 00000100:00100000:0.0:1777051295.124885:0:47208:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452537088 00000100:00100000:0.0:1777051295.124894:0:47208:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452537088 00000100:00100000:0.0:1777051295.124946:0:47208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8014 00000100:00100000:0.0:1777051295.124959:0:47208:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+6:3678:x1863365452537088:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1777051295.125002:0:47208:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4243456 pending 0 free 1446064128 avail 1299824640 00000100:00100000:0.0:1777051295.125494:0:47208:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+6:3678:x1863365452537088:12345-0@lo:41:osp-pre-1-0.0 Request processed in 535us (666us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051295.125509:0:47208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8014 00000100:00100000:2.0:1777051295.125710:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f9b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3678:1863365452537088:0@lo:41:osp-pre-1-0.0 00000040:01000000:3.0:1777051295.125985:0:103171:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1777051295.127433:0:103171:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1777051295.135294:0:103171:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1777051295.135757:0:103171:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].7, 64 off8640 00000040:00080000:3.0:1777051295.136023:0:103171:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x27:0x0].1, 64 off8256 00000040:00080000:0.0:1777051295.140580:0:103177:0:(llog.c:801:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:0.0:1777051295.140589:0:103177:0:(llog_cat.c:158:llog_cat_process_common()) processing log [0x1:0x27:0x0] at index 7 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1777051295.143539:0:103171:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1777051295.143562:0:103171:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1777051295.143631:0:103171:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1777051295.143673:0:103171:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x85f51a6b96714bb0 00000100:00080000:3.0:1777051295.143691:0:103171:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1777051295.143702:0:103171:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff99d942fb3800 using connection 192.168.201.146@tcp/0@lo 00000100:00100000:3.0:1777051295.143763:0:103171:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99da7fd61c00 x1863365452537216/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1777051295.143810:0:103171:0:(pinger.c:371:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:0.0:1777051295.143877:0:3676:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7fd61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3676:1863365452537216:0@lo:8:llog_process_th.0 00000020:01000000:3.0:1777051295.143924:0:103171:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1777051295.143935:0:103171:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1777051295.143939:0:103171:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1777051295.143946:0:103171:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1777051295.143952:0:103171:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #28 00000020:01000000:3.0:1777051295.143956:0:103171:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1777051295.143959:0:103171:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1777051295.143964:0:103171:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1777051295.143972:0:103171:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1777051295.143975:0:103171:0:(obd_config.c:1561:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:3.0:1777051295.143980:0:103171:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1777051295.143989:0:103171:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1777051295.143995:0:103171:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1777051295.143998:0:103171:0:(obd_config.c:1561:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1777051295.144007:0:103171:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000100:00100000:0.0:1777051295.144015:0:3676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:3.0:1777051295.144023:0:103171:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.201.146@tcp to nid 0x20000c0a8c992 (192.168.201.146@tcp) 00000020:01000000:3.0:1777051295.144087:0:103171:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1777051295.144122:0:103171:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1777051295.144145:0:103171:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff99da7f993380) 00000020:00000080:3.0:1777051295.144181:0:103171:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:3.0:1777051295.144191:0:103171:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000100:00100000:2.0:1777051295.144303:0:8468:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452537216 00000100:00100000:2.0:1777051295.144318:0:8468:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452537216 00000004:00080000:3.0:1777051295.144371:0:103171:0:(osp_dev.c:1199:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1777051295.144384:0:103171:0:(osd_handler.c:8912:osd_obd_connect()) connect #7 00000100:00100000:2.0:1777051295.144391:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7948 00000020:00000080:3.0:1777051295.144395:0:103171:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x85f51a6b96714bbe 00000100:00100000:2.0:1777051295.144409:0:8468:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f97fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3676:x1863365452537216:12345-0@lo:8:llog_process_th.0 00010000:00080000:2.0:1777051295.144457:0:8468:0:(ldlm_lib.c:1431:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 7924 last 0 00010000:00080000:3.0:1777051295.144459:0:103171:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99d944d12800@lustre-OST0001-osc-MDT0000: add connection 192.168.201.146@tcp at head 00000020:00000080:2.0:1777051295.144508:0:8468:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x85f51a6b96714bc5 00002000:00100000:2.0:1777051295.144528:0:8468:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff99da44f1e800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113436 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1777051295.144533:0:8468:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:2.0:1777051295.144537:0:8468:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00010000:00010000:3.0:1777051295.145177:0:103171:0:(ldlm_pool.c:924:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-11 is initialized 00000040:01000000:3.0:1777051295.145353:0:103171:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1777051295.145381:0:103171:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00002000:00080000:2.0:1777051295.145400:0:8468:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1777051295.145440:0:8468:0:(import.c:65:import_set_state_nolock()) ffff99da44f19000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1777051295.145558:0:8468:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f97fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3676:x1863365452537216:12345-0@lo:8:llog_process_th.0 Request processed in 1149us (1546us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051295.145574:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7948 00000100:00100000:0.0:1777051295.145775:0:3676:0:(client.c:3101:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1777051295.145790:0:3676:0:(import.c:1130:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1777051295.145800:0:3676:0:(import.c:958:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1777051295.145808:0:3676:0:(import.c:1211:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1777051295.145812:0:3676:0:(import.c:65:import_set_state_nolock()) ffff99d942fb3800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1777051295.145944:0:3676:0:(osp_dev.c:1643:osp_import_event()) got connected 00000100:00100000:0.0:1777051295.145957:0:3676:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7fd61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3676:1863365452537216:0@lo:8:llog_process_th.0 00000004:00080000:1.0:1777051295.146020:0:103177:0:(osp_sync.c:1044:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1777051295.146147:0:103177:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 7924338948495ns, next at 0ns, rc = 0 00080000:00080000:1.0:1777051295.146162:0:103177:0:(osd_handler.c:2852:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:0.0:1777051295.146189:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f9b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3678:1863365452537344:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1777051295.146280:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051295.146376:0:8472:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452537344 00000100:00100000:3.0:1777051295.146387:0:8472:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452537344 00000100:00100000:3.0:1777051295.146535:0:8472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5552 00000100:00080000:2.0:1777051295.146543:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1777051295.146555:0:8472:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f97e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3678:x1863365452537344:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1777051295.146596:0:8472:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 440354112 pending 0 free 3862671360 avail 3631149056 00000100:00100000:3.0:1777051295.146686:0:8472:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f97e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3678:x1863365452537344:12345-0@lo:13:osp-pre-0-0.0 Request processed in 137us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051295.146700:0:8472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5552 00000100:00100000:0.0:1777051295.146753:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f9b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3678:1863365452537344:0@lo:13:osp-pre-0-0.0 00000040:00080000:2.0:1777051295.152714:0:103171:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:1.0:1777051295.152916:0:103159:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000040:00080000:2.0:1777051295.153253:0:103171:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].7, 64 off8640 00000040:00080000:2.0:1777051295.153543:0:103171:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x29:0x0].1, 64 off8256 00000040:00080000:2.0:1777051295.154629:0:103179:0:(llog.c:801:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:2.0:1777051295.154636:0:103179:0:(llog_cat.c:158:llog_cat_process_common()) processing log [0x1:0x29:0x0] at index 7 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1777051295.157315:0:103171:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1777051295.157336:0:103171:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1777051295.157402:0:103171:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1777051295.157444:0:103171:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x85f51a6b96714bcc 00000100:00080000:2.0:1777051295.157462:0:103171:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1777051295.157474:0:103171:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff99d944d12800 using connection 192.168.201.146@tcp/0@lo 00000100:00100000:2.0:1777051295.157531:0:103171:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99da5f9b8a80 x1863365452537472/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1777051295.157566:0:103171:0:(pinger.c:371:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:0.0:1777051295.158259:0:3676:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f9b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3676:1863365452537472:0@lo:8:llog_process_th.0 00000100:00100000:0.0:1777051295.158259:0:3676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:2.0:1777051295.158259:0:103171:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1777051295.158259:0:103171:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1777051295.158259:0:103171:0:(obd_config.c:1561:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1777051295.158259:0:103171:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1777051295.158259:0:103171:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1777051295.158259:0:103171:0:(obd_config.c:1561:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:2.0:1777051295.158259:0:103171:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1777051295.158259:0:103171:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1777051295.158259:0:103171:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1777051295.158259:0:103171:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1777051295.158259:0:103171:0:(obd_config.c:1561:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:2.0:1777051295.158259:0:103171:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1777051295.158259:0:103171:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1777051295.158259:0:103171:0:(obd_config.c:1561:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1777051295.158259:0:103171:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1777051295.158259:0:103171:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1777051295.158259:0:103171:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1777051295.158259:0:103171:0:(obd_config.c:1561:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000020:01000000:2.0:1777051295.158259:0:103171:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1777051295.158259:0:103171:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #44 00000020:01000000:2.0:1777051295.158259:0:103171:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1777051295.158259:0:103171:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000100:00100000:2.0:1777051295.158259:0:103171:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f826680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f9351a01-5b0e-4470-97fd-58b9b4b312a2:103171:1863365452537600:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1777051295.158344:0:103171:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051295.158395:0:103171:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d94e566240 going to sleep for 11 seconds 00000100:00100000:1.0:1777051295.158579:0:27887:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452537472 00000100:00100000:1.0:1777051295.158590:0:27887:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452537472 00000100:00100000:1.0:1777051295.158642:0:27887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7949 00000100:00100000:1.0:1777051295.158652:0:27887:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d943d93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:0+-99:3676:x1863365452537472:12345-0@lo:8:llog_process_th.0 00010000:00080000:1.0:1777051295.158689:0:27887:0:(ldlm_lib.c:1431:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 7924 last 0 00000020:00000080:1.0:1777051295.158727:0:27887:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x85f51a6b96714bd3 00002000:00100000:1.0:1777051295.158746:0:27887:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff99d942a24000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113436 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1777051295.158752:0:27887:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:1.0:1777051295.158756:0:27887:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1777051295.158836:0:27887:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1777051295.158869:0:27887:0:(import.c:65:import_set_state_nolock()) ffff99d942e06000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1777051295.158959:0:27887:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d943d93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+6:3676:x1863365452537472:12345-0@lo:8:llog_process_th.0 Request processed in 303us (692us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051295.158967:0:103163:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452537600 00000100:00100000:1.0:1777051295.158977:0:27887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7949 00000100:00100000:0.0:1777051295.158979:0:103163:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452537600 00000100:00100000:2.0:1777051295.159048:0:3676:0:(client.c:3101:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00100000:0.0:1777051295.159388:0:103163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1777051295.159411:0:103163:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7d9cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9351a01-5b0e-4470-97fd-58b9b4b312a2+7:103171:x1863365452537600:12345-0@lo:502:llog_process_th.0 00000100:00080000:2.0:1777051295.159431:0:3676:0:(import.c:1130:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1777051295.159445:0:3676:0:(import.c:958:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1777051295.159454:0:3676:0:(import.c:1211:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1777051295.159459:0:3676:0:(import.c:65:import_set_state_nolock()) ffff99d944d12800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1777051295.159485:0:3676:0:(osp_dev.c:1643:osp_import_event()) got connected 00000100:00100000:2.0:1777051295.159495:0:3676:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f9b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3676:1863365452537472:0@lo:8:llog_process_th.0 00000004:00080000:1.0:1777051295.160063:0:103179:0:(osp_sync.c:1044:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1777051295.160175:0:103179:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 7924352976289ns, next at 0ns, rc = 0 00000100:00100000:0.0:1777051295.160182:0:3680:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00080000:00080000:1.0:1777051295.160189:0:103179:0:(osd_handler.c:2852:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:0.0:1777051295.160263:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7fd60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3680:1863365452537728:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1777051295.160325:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051295.160455:0:10113:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452537728 00000100:00100000:1.0:1777051295.160465:0:10113:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452537728 00000100:00100000:1.0:1777051295.160562:0:10113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5553 00000100:00100000:1.0:1777051295.160579:0:10113:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da44977800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3680:x1863365452537728:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1777051295.160615:0:10113:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 430294336 pending 0 free 3645853696 avail 3414331392 00000100:00100000:1.0:1777051295.160695:0:10113:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da44977800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3680:x1863365452537728:12345-0@lo:13:osp-pre-1-0.0 Request processed in 117us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051295.160709:0:10113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5553 00000100:00100000:0.0:1777051295.160776:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7fd60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3680:1863365452537728:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1777051295.160879:0:103163:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7d9cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9351a01-5b0e-4470-97fd-58b9b4b312a2+7:103171:x1863365452537600:12345-0@lo:502:llog_process_th.0 Request processed in 1474us (2533us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051295.160893:0:103163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1777051295.160939:0:103171:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f826680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f9351a01-5b0e-4470-97fd-58b9b4b312a2:103171:1863365452537600:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1777051295.160989:0:103171:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1777051295.161000:0:103171:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1777051295.161004:0:103171:0:(obd_config.c:1561:class_process_config()) marker 44 (0x6) lustre-MDT0000-m new lustre.test_11c 00000020:01000000:2.0:1777051295.161011:0:103171:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1777051295.161017:0:103171:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #47 00000020:01000000:2.0:1777051295.161020:0:103171:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1777051295.161023:0:103171:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1777051295.161026:0:103171:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1777051295.161030:0:103171:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1777051295.161033:0:103171:0:(obd_config.c:1561:class_process_config()) marker 47 (0x6) lustre-MDT0000-m add lustre.test_11c.lustre-OST0001_UUID 00000020:01000000:2.0:1777051295.161037:0:103171:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1777051295.161044:0:103171:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1777051295.161046:0:103171:0:(obd_config.c:1561:class_process_config()) marker 50 (0x1) lustre-MDT0000-m rem lustre.test_11c.lustre-OST0001_UUID 00000020:00000080:2.0:1777051295.161053:0:103171:0:(obd_config.c:1470:class_process_config()) processing cmd: ce022 00000020:01000000:2.0:1777051295.161068:0:103171:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1777051295.161072:0:103171:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1777051295.161074:0:103171:0:(obd_config.c:1561:class_process_config()) marker 50 (0x2) lustre-MDT0000-m rem lustre.test_11c.lustre-OST0001_UUID 00000020:01000000:2.0:1777051295.161079:0:103171:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1777051295.161083:0:103171:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1777051295.161086:0:103171:0:(obd_config.c:1561:class_process_config()) marker 53 (0x1) lustre-MDT0000-m del lustre.test_11c 00000020:00000080:2.0:1777051295.161526:0:103171:0:(obd_config.c:1470:class_process_config()) processing cmd: ce023 00000100:00100000:2.0:1777051295.161572:0:103171:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f826680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f9351a01-5b0e-4470-97fd-58b9b4b312a2:103171:1863365452537856:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1777051295.161637:0:103171:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051295.161670:0:103171:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da586490c0 going to sleep for 11 seconds 00000100:00100000:0.0:1777051295.162707:0:103165:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452537856 00000100:00100000:0.0:1777051295.162716:0:103165:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452537856 00000100:00100000:0.0:1777051295.162767:0:103165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1777051295.162780:0:103165:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7d9cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9351a01-5b0e-4470-97fd-58b9b4b312a2+7:103171:x1863365452537856:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1777051295.162908:0:103165:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7d9cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9351a01-5b0e-4470-97fd-58b9b4b312a2+7:103171:x1863365452537856:12345-0@lo:502:llog_process_th.0 Request processed in 128us (1269us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051295.162921:0:103165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1777051295.163021:0:103171:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f826680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f9351a01-5b0e-4470-97fd-58b9b4b312a2:103171:1863365452537856:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1777051295.163060:0:103171:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1777051295.163070:0:103171:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1777051295.163075:0:103171:0:(obd_config.c:1561:class_process_config()) marker 53 (0x2) lustre-MDT0000-m del lustre.test_11c 00000040:00080000:1.0:1777051295.163084:0:103171:0:(llog.c:858:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 59 count 58 00000100:00080000:3.0:1777051295.163242:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:01000000:2.0:1777051295.163716:0:103158:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-58 (rc=0) 10000000:01000000:2.0:1777051295.163766:0:103158:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.201.146@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1777051295.163800:0:103158:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff99d955a98200/0x85f51a6b96714b0f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b96714b16 expref: -99 pid: 103158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051295.163820:0:103158:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.146@tcp lock: ffff99d955a98200/0x85f51a6b96714b0f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b96714b16 expref: -99 pid: 103158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1777051295.163835:0:103158:0:(mgc_request.c:1799:mgc_process_log()) Process log lustre-mdtir-ffff99da5f2be000 from 1 10000000:01000000:2.0:1777051295.163840:0:103158:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1777051295.163885:0:103158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.146@tcp lock: ffff99d955a99200/0x85f51a6b96714bda lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 103158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051295.163917:0:103158:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.146@tcp lock: ffff99d955a99200/0x85f51a6b96714bda lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 103158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051295.163934:0:103158:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.146@tcp lock: ffff99d955a99200/0x85f51a6b96714bda lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 103158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051295.163961:0:103158:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f826680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9351a01-5b0e-4470-97fd-58b9b4b312a2:103158:1863365452537984:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1777051295.164014:0:103158:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1777051295.164040:0:103159:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:2.0:1777051295.164070:0:103158:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d94e566240 going to sleep for 11 seconds 00000100:00100000:3.0:1777051295.164496:0:103169:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452537984 00000100:00100000:3.0:1777051295.164507:0:103169:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452537984 00000100:00100000:3.0:1777051295.164579:0:103169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1777051295.164593:0:103169:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d943e25c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f9351a01-5b0e-4470-97fd-58b9b4b312a2+7:103158:x1863365452537984:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1777051295.164609:0:103169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777051295.164636:0:103169:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99da7d784200/0x85f51a6b96714be1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x85f51a6b96714bda expref: -99 pid: 103169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051295.164675:0:103169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99da7d784200/0x85f51a6b96714be1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x85f51a6b96714bda expref: 8 pid: 103169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051295.164695:0:103169:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99da7d784200/0x85f51a6b96714be1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b96714bda expref: 8 pid: 103169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051295.164711:0:103169:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99da7d784200, rc 0) 00000100:00100000:3.0:1777051295.164783:0:103169:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d943e25c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f9351a01-5b0e-4470-97fd-58b9b4b312a2+8:103158:x1863365452537984:12345-0@lo:101:mount.lustre.0 Request processed in 192us (770us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051295.164794:0:103169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1777051295.164910:0:103158:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f826680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9351a01-5b0e-4470-97fd-58b9b4b312a2:103158:1863365452537984:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1777051295.164934:0:103158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.146@tcp lock: ffff99d955a99200/0x85f51a6b96714bda lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b96714be1 expref: -99 pid: 103158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051295.164962:0:103158:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.146@tcp lock: ffff99d955a99200/0x85f51a6b96714bda lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x85f51a6b96714be1 expref: -99 pid: 103158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051295.165908:0:103158:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95fae8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9351a01-5b0e-4470-97fd-58b9b4b312a2:103158:1863365452538112:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1777051295.165975:0:103158:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051295.166029:0:103158:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da586490c0 going to sleep for 11 seconds 00000100:00100000:0.0:1777051295.166121:0:103163:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452538112 00000100:00100000:0.0:1777051295.166129:0:103163:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452538112 00000100:00100000:0.0:1777051295.166741:0:103163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1777051295.166776:0:103163:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d943e24450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9351a01-5b0e-4470-97fd-58b9b4b312a2+8:103158:x1863365452538112:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1777051295.166806:0:103163:0:(mgs_nids.c:912:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1777051295.166836:0:103163:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1777051295.166842:0:103163:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1777051295.166848:0:103163:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1777051295.166852:0:103163:0:(mgs_nids.c:316:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 29 00000100:00100000:0.0:1777051295.166993:0:103163:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d943e24450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9351a01-5b0e-4470-97fd-58b9b4b312a2+8:103158:x1863365452538112:12345-0@lo:256:mount.lustre.0 Request processed in 238us (1015us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051295.167009:0:103163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1777051295.167024:0:103158:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95fae8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9351a01-5b0e-4470-97fd-58b9b4b312a2:103158:1863365452538112:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1777051295.169074:0:103158:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.201.146@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1777051295.169504:0:103158:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff99d955a99200/0x85f51a6b96714bda lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b96714be1 expref: -99 pid: 103158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051295.169522:0:103158:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.146@tcp lock: ffff99d955a99200/0x85f51a6b96714bda lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b96714be1 expref: -99 pid: 103158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1777051295.169536:0:103158:0:(mgc_request.c:1799:mgc_process_log()) Process log params-ffff99da5f2be000 from 1 10000000:01000000:1.0:1777051295.169540:0:103158:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1777051295.169573:0:103158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.146@tcp lock: ffff99d9442eb800/0x85f51a6b96714be8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 103158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051295.169584:0:103158:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.146@tcp lock: ffff99d9442eb800/0x85f51a6b96714be8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 103158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051295.169597:0:103158:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.146@tcp lock: ffff99d9442eb800/0x85f51a6b96714be8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 103158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051295.169620:0:103158:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95fae8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9351a01-5b0e-4470-97fd-58b9b4b312a2:103158:1863365452538240:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1777051295.169674:0:103158:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051295.169712:0:103158:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da586490c0 going to sleep for 11 seconds 00000100:00100000:3.0:1777051295.171156:0:103168:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452538240 00000100:00100000:3.0:1777051295.171186:0:103168:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452538240 00000100:00100000:3.0:1777051295.171318:0:103168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1777051295.171331:0:103168:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d943e26450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f9351a01-5b0e-4470-97fd-58b9b4b312a2+8:103158:x1863365452538240:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1777051295.171349:0:103168:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777051295.171369:0:103168:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99da7d785400/0x85f51a6b96714bef lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x85f51a6b96714be8 expref: -99 pid: 103168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051295.171404:0:103168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99da7d785400/0x85f51a6b96714bef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x85f51a6b96714be8 expref: 9 pid: 103168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051295.171421:0:103168:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99da7d785400/0x85f51a6b96714bef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b96714be8 expref: 9 pid: 103168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051295.171438:0:103168:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99da7d785400, rc 0) 00000100:00100000:3.0:1777051295.171513:0:103168:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d943e26450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f9351a01-5b0e-4470-97fd-58b9b4b312a2+9:103158:x1863365452538240:12345-0@lo:101:mount.lustre.0 Request processed in 181us (1836us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051295.171527:0:103168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1777051295.172486:0:103158:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95fae8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9351a01-5b0e-4470-97fd-58b9b4b312a2:103158:1863365452538240:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1777051295.172511:0:103158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.146@tcp lock: ffff99d9442eb800/0x85f51a6b96714be8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b96714bef expref: -99 pid: 103158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051295.172527:0:103158:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.146@tcp lock: ffff99d9442eb800/0x85f51a6b96714be8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x85f51a6b96714bef expref: -99 pid: 103158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051295.172616:0:103158:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95fae8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9351a01-5b0e-4470-97fd-58b9b4b312a2:103158:1863365452538368:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1777051295.172956:0:103158:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051295.173122:0:103158:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da586490c0 going to sleep for 11 seconds 00000100:00100000:2.0:1777051295.173189:0:103166:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452538368 00000100:00100000:2.0:1777051295.173508:0:103166:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452538368 00000100:00100000:2.0:1777051295.173644:0:103166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1777051295.173658:0:103166:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d943e26050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9351a01-5b0e-4470-97fd-58b9b4b312a2+9:103158:x1863365452538368:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1777051295.174540:0:103166:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d943e26050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9351a01-5b0e-4470-97fd-58b9b4b312a2+9:103158:x1863365452538368:12345-0@lo:501:mount.lustre.0 Request processed in 883us (1581us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051295.174554:0:103166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1777051295.174739:0:103158:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95fae8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9351a01-5b0e-4470-97fd-58b9b4b312a2:103158:1863365452538368:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1777051295.174807:0:103158:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7fd63b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9351a01-5b0e-4470-97fd-58b9b4b312a2:103158:1863365452538496:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1777051295.174880:0:103158:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051295.174929:0:103158:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d959a97c00 going to sleep for 11 seconds 00000100:00100000:0.0:1777051295.174992:0:103163:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452538496 00000100:00100000:0.0:1777051295.175001:0:103163:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452538496 00000100:00100000:0.0:1777051295.175084:0:103163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1777051295.175130:0:103163:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d943e25450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9351a01-5b0e-4470-97fd-58b9b4b312a2+9:103158:x1863365452538496:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1777051295.175641:0:103163:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d943e25450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9351a01-5b0e-4470-97fd-58b9b4b312a2+9:103158:x1863365452538496:12345-0@lo:503:mount.lustre.0 Request processed in 516us (760us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051295.175651:0:103163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1777051295.175717:0:103158:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7fd63b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9351a01-5b0e-4470-97fd-58b9b4b312a2:103158:1863365452538496:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1777051295.176526:0:103181:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7fd63b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f9351a01-5b0e-4470-97fd-58b9b4b312a2:103181:1863365452538624:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1777051295.176597:0:103181:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051295.176649:0:103181:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d959a97f00 going to sleep for 11 seconds 00000100:00100000:2.0:1777051295.176697:0:103169:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452538624 00000100:00100000:2.0:1777051295.176705:0:103169:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452538624 00000100:00100000:2.0:1777051295.176749:0:103169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1777051295.176758:0:103169:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d943e27050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f9351a01-5b0e-4470-97fd-58b9b4b312a2+9:103181:x1863365452538624:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1777051295.179954:0:103169:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d943e27050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f9351a01-5b0e-4470-97fd-58b9b4b312a2+9:103181:x1863365452538624:12345-0@lo:502:llog_process_th.0 Request processed in 3188us (3350us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051295.179971:0:103169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1777051295.180443:0:103181:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7fd63b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f9351a01-5b0e-4470-97fd-58b9b4b312a2:103181:1863365452538624:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1777051295.180501:0:103181:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1777051295.180523:0:103181:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1777051295.180529:0:103181:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1777051295.180545:0:103181:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff99da5f2be000 00000020:00000080:3.0:1777051295.180553:0:103181:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1777051295.180569:0:103181:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1777051295.180575:0:103181:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1777051295.180578:0:103181:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1777051295.180582:0:103181:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1777051295.180587:0:103181:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1777051295.180590:0:103181:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1777051295.180596:0:103181:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff99da5f2be000 00000020:00000080:3.0:1777051295.180601:0:103181:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1777051295.181055:0:103181:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1777051295.181063:0:103181:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1777051295.181066:0:103181:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1777051295.181070:0:103181:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1777051295.181074:0:103181:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #4 00000020:01000000:3.0:1777051295.181077:0:103181:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1777051295.181080:0:103181:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1777051295.181083:0:103181:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1777051295.181469:0:103181:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1777051295.181475:0:103181:0:(obd_config.c:1561:class_process_config()) marker 4 (0x6) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1777051295.181484:0:103181:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1777051295.181487:0:103181:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #5 00000020:01000000:3.0:1777051295.181489:0:103181:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1777051295.181492:0:103181:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1777051295.181495:0:103181:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1777051295.181500:0:103181:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1777051295.181502:0:103181:0:(obd_config.c:1561:class_process_config()) marker 5 (0x6) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1777051295.181506:0:103181:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1777051295.181508:0:103181:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #6 00000020:01000000:3.0:1777051295.181510:0:103181:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1777051295.181512:0:103181:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1777051295.181515:0:103181:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1777051295.181518:0:103181:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1777051295.181521:0:103181:0:(obd_config.c:1561:class_process_config()) marker 6 (0x6) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1777051295.181525:0:103181:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1777051295.181528:0:103181:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #7 00000020:01000000:3.0:1777051295.181530:0:103181:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1777051295.184389:0:103181:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1777051295.184395:0:103181:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1777051295.184405:0:103181:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1777051295.184409:0:103181:0:(obd_config.c:1561:class_process_config()) marker 7 (0x6) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1777051295.184416:0:103181:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1777051295.184419:0:103181:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #2 00000020:01000000:3.0:1777051295.184421:0:103181:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1777051295.184424:0:103181:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1777051295.184428:0:103181:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1777051295.184433:0:103181:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1777051295.184435:0:103181:0:(obd_config.c:1561:class_process_config()) marker 2 (0x6) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1777051295.184440:0:103181:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1777051295.184443:0:103181:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #3 00000020:01000000:3.0:1777051295.184445:0:103181:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1777051295.184450:0:103181:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1777051295.184452:0:103181:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1777051295.184457:0:103181:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1777051295.184459:0:103181:0:(obd_config.c:1561:class_process_config()) marker 3 (0x6) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1777051295.184463:0:103181:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1777051295.184468:0:103181:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1777051295.184470:0:103181:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1777051295.184478:0:103181:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff99da5f2be000 00000020:00000080:3.0:1777051295.184483:0:103181:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1777051295.184537:0:103181:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1777051295.184543:0:103181:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1777051295.184546:0:103181:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1777051295.184551:0:103181:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1777051295.184556:0:103181:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1777051295.184558:0:103181:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1777051295.184564:0:103181:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff99da5f2be000 00000020:00000080:3.0:1777051295.184568:0:103181:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1777051295.184598:0:103181:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1777051295.184604:0:103181:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1777051295.184606:0:103181:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1777051295.184610:0:103181:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1777051295.184613:0:103181:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #2 00000020:01000000:3.0:1777051295.184615:0:103181:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1777051295.184618:0:103181:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1777051295.184621:0:103181:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1777051295.184625:0:103181:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1777051295.184628:0:103181:0:(obd_config.c:1561:class_process_config()) marker 2 (0x6) lustre mdt.lustre-MDT0000.hsm.default_archive_id 00000020:01000000:3.0:1777051295.184632:0:103181:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1777051295.184635:0:103181:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #3 00000020:01000000:3.0:1777051295.184638:0:103181:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1777051295.184640:0:103181:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1777051295.184643:0:103181:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1777051295.184646:0:103181:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1777051295.184649:0:103181:0:(obd_config.c:1561:class_process_config()) marker 3 (0x6) lustre mdt.lustre-MDT0001.hsm.default_archive_id 00000020:01000000:3.0:1777051295.184654:0:103181:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1777051295.184658:0:103181:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1777051295.184660:0:103181:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre mdt.lustre-MDT0000.hsm.default_archive_id 00000020:01000000:3.0:1777051295.184667:0:103181:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff99da5f2be000 00000020:00000080:3.0:1777051295.184671:0:103181:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1777051295.184704:0:103181:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1777051295.184709:0:103181:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1777051295.184712:0:103181:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre mdt.lustre-MDT0000.hsm.default_archive_id 00000020:01000000:3.0:1777051295.184717:0:103181:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1777051295.184721:0:103181:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1777051295.184724:0:103181:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre mdt.lustre-MDT0001.hsm.default_archive_id 00000020:01000000:3.0:1777051295.184730:0:103181:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff99da5f2be000 00000020:00000080:3.0:1777051295.184734:0:103181:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1777051295.184818:0:103181:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7fd63b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f9351a01-5b0e-4470-97fd-58b9b4b312a2:103181:1863365452538752:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1777051295.184928:0:103181:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051295.185002:0:103181:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d959a97f00 going to sleep for 11 seconds 00000100:00100000:2.0:1777051295.185085:0:103166:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452538752 00000100:00100000:2.0:1777051295.185130:0:103166:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452538752 00000100:00100000:2.0:1777051295.185285:0:103166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1777051295.185306:0:103166:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d943e26c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9351a01-5b0e-4470-97fd-58b9b4b312a2+9:103181:x1863365452538752:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1777051295.185512:0:103166:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d943e26c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9351a01-5b0e-4470-97fd-58b9b4b312a2+9:103181:x1863365452538752:12345-0@lo:502:llog_process_th.0 Request processed in 212us (582us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051295.185539:0:103166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1777051295.187256:0:103181:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7fd63b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f9351a01-5b0e-4470-97fd-58b9b4b312a2:103181:1863365452538752:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1777051295.187315:0:103181:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1777051295.187326:0:103181:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1777051295.187329:0:103181:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre mdt.lustre-MDT0001.hsm.default_archive_id 00000040:00080000:3.0:1777051295.187335:0:103181:0:(llog.c:858:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 43 count 43 00000020:01000000:2.0:1777051295.187629:0:103158:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-42 (rc=0) 10000000:01000000:2.0:1777051295.187686:0:103158:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.201.146@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1777051295.187721:0:103158:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff99d9442eb800/0x85f51a6b96714be8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b96714bef expref: -99 pid: 103158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051295.187743:0:103158:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.146@tcp lock: ffff99d9442eb800/0x85f51a6b96714be8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b96714bef expref: -99 pid: 103158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1777051295.187908:0:103158:0:(mgc_request.c:1941:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1777051295.187915:0:103158:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff99da5f2be000 10000000:01000000:2.0:1777051295.187921:0:103158:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff99da5f2be000 10000000:01000000:2.0:1777051295.187927:0:103158:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1777051295.187955:0:103158:0:(mgc_request.c:1799:mgc_process_log()) Process log lustre-client-ffff99da5f2be000 from 1 10000000:01000000:2.0:1777051295.187961:0:103158:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1777051295.188013:0:103158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.146@tcp lock: ffff99d955a98a00/0x85f51a6b96714bf6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 103158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051295.188030:0:103158:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.146@tcp lock: ffff99d955a98a00/0x85f51a6b96714bf6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 103158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051295.188048:0:103158:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.146@tcp lock: ffff99d955a98a00/0x85f51a6b96714bf6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 103158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051295.188078:0:103158:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f826680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9351a01-5b0e-4470-97fd-58b9b4b312a2:103158:1863365452538880:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1777051295.188178:0:103158:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051295.188273:0:103158:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da7da32480 going to sleep for 11 seconds 00000100:00100000:1.0:1777051295.188304:0:103163:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452538880 00000100:00100000:1.0:1777051295.188316:0:103163:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452538880 00000100:00100000:1.0:1777051295.188393:0:103163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1777051295.188427:0:103163:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d943e27850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9351a01-5b0e-4470-97fd-58b9b4b312a2+9:103158:x1863365452538880:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1777051295.188446:0:103163:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777051295.188488:0:103163:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d9442ea400/0x85f51a6b96714bfd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x85f51a6b96714bf6 expref: -99 pid: 103163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051295.188544:0:103163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d9442ea400/0x85f51a6b96714bfd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x85f51a6b96714bf6 expref: 10 pid: 103163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051295.188565:0:103163:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d9442ea400/0x85f51a6b96714bfd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b96714bf6 expref: 10 pid: 103163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051295.188582:0:103163:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d9442ea400, rc 0) 00000100:00100000:1.0:1777051295.188659:0:103163:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d943e27850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9351a01-5b0e-4470-97fd-58b9b4b312a2+10:103158:x1863365452538880:12345-0@lo:101:mount.lustre.0 Request processed in 234us (481us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051295.188671:0:103163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1777051295.189262:0:103158:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f826680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9351a01-5b0e-4470-97fd-58b9b4b312a2:103158:1863365452538880:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1777051295.189286:0:103158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.146@tcp lock: ffff99d955a98a00/0x85f51a6b96714bf6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b96714bfd expref: -99 pid: 103158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051295.189303:0:103158:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.146@tcp lock: ffff99d955a98a00/0x85f51a6b96714bf6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x85f51a6b96714bfd expref: -99 pid: 103158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051295.189408:0:103158:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f826680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9351a01-5b0e-4470-97fd-58b9b4b312a2:103158:1863365452539008:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1777051295.189459:0:103158:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051295.189506:0:103158:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da7da32480 going to sleep for 11 seconds 00000100:00100000:1.0:1777051295.189540:0:103169:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452539008 00000100:00100000:1.0:1777051295.189550:0:103169:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452539008 00000100:00100000:1.0:1777051295.189606:0:103169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1777051295.189622:0:103169:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d943e27450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f9351a01-5b0e-4470-97fd-58b9b4b312a2+10:103158:x1863365452539008:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1777051295.189820:0:103169:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d943e27450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f9351a01-5b0e-4470-97fd-58b9b4b312a2+10:103158:x1863365452539008:12345-0@lo:501:mount.lustre.0 Request processed in 201us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051295.189833:0:103169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1777051295.189852:0:103158:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f826680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9351a01-5b0e-4470-97fd-58b9b4b312a2:103158:1863365452539008:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1777051295.189955:0:103158:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f826680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9351a01-5b0e-4470-97fd-58b9b4b312a2:103158:1863365452539136:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1777051295.190021:0:103158:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051295.190076:0:103158:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d941bddf00 going to sleep for 11 seconds 00000100:00100000:1.0:1777051295.190519:0:103168:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452539136 00000100:00100000:1.0:1777051295.190528:0:103168:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452539136 00000100:00100000:1.0:1777051295.190594:0:103168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1777051295.190607:0:103168:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d943e24850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f9351a01-5b0e-4470-97fd-58b9b4b312a2+10:103158:x1863365452539136:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1777051295.190796:0:103168:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d943e24850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f9351a01-5b0e-4470-97fd-58b9b4b312a2+10:103158:x1863365452539136:12345-0@lo:503:mount.lustre.0 Request processed in 189us (772us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051295.190810:0:103168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1777051295.194482:0:103158:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f826680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9351a01-5b0e-4470-97fd-58b9b4b312a2:103158:1863365452539136:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1777051295.195851:0:103183:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7fd63b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f9351a01-5b0e-4470-97fd-58b9b4b312a2:103183:1863365452539264:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1777051295.195954:0:103183:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051295.196018:0:103183:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d959a97cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1777051295.196160:0:103163:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452539264 00000100:00100000:1.0:1777051295.196171:0:103163:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452539264 00000100:00100000:1.0:1777051295.196267:0:103163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1777051295.196293:0:103163:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f3ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9351a01-5b0e-4470-97fd-58b9b4b312a2+10:103183:x1863365452539264:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1777051295.196516:0:103163:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f3ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9351a01-5b0e-4470-97fd-58b9b4b312a2+10:103183:x1863365452539264:12345-0@lo:502:llog_process_th.0 Request processed in 234us (562us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051295.196529:0:103163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1777051295.196584:0:103183:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7fd63b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f9351a01-5b0e-4470-97fd-58b9b4b312a2:103183:1863365452539264:0@lo:502:llog_process_th.0 00000020:01000004:3.0:1777051295.196706:0:103183:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1777051295.196737:0:103183:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff99da44f6b380) 00000020:00000080:3.0:1777051295.196784:0:103183:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:3.0:1777051295.197216:0:103183:0:(tgt_mount.c:151:server_get_mount()) get mount ffff99da5f2be000 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1777051295.197226:0:103183:0:(tgt_mount.c:185:server_put_mount()) put mount ffff99da5f2be000 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1777051295.197231:0:103183:0:(obd_mount.c:701:lustre_put_lsi()) put ffff99da5f2be000 4 00010000:00080000:3.0:1777051295.197328:0:103183:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99da7b5fd000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.201.146@tcp at head 00010000:00010000:2.0:1777051295.203359:0:103183:0:(ldlm_pool.c:924:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-12 is initialized 00000020:00000080:2.0:1777051295.203559:0:103183:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1777051295.203650:0:103183:0:(lwp_dev.c:496:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1777051295.203677:0:103183:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x85f51a6b96714c0b 00000100:00080000:2.0:1777051295.203695:0:103183:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1777051295.203707:0:103183:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff99da7b5fd000 using connection 192.168.201.146@tcp/0@lo 00000100:00100000:2.0:1777051295.204036:0:103183:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99da5f826680 x1863365452539392/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1777051295.204128:0:3676:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f826680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3676:1863365452539392:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1777051295.204290:0:3676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1777051295.204412:0:103183:0:(pinger.c:371:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1777051295.205333:0:46494:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452539392 00000100:00100000:0.0:1777051295.205349:0:46494:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452539392 00000100:00100000:0.0:1777051295.205441:0:46494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111718 00000100:00100000:0.0:1777051295.205453:0:46494:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:0+-99:3676:x1863365452539392:12345-0@lo:38:llog_process_th.0 00000100:00100000:0.0:1777051295.205589:0:46494:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:0+-99:3676:x1863365452539392:12345-0@lo:38:llog_process_th.0 Request processed in 134us (1298us total) trans 0 rc -11/-11 00000100:00100000:0.0:1777051295.205602:0:46494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111718 00000100:00100000:3.0:1777051295.207540:0:3676:0:(client.c:3101:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1777051295.207557:0:3676:0:(import.c:65:import_set_state_nolock()) ffff99da7b5fd000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1777051295.207567:0:3676:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1777051295.207576:0:3676:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f826680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3676:1863365452539392:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1777051295.219028:0:103183:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7fd63b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f9351a01-5b0e-4470-97fd-58b9b4b312a2:103183:1863365452539520:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1777051295.219551:0:103183:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051295.219645:0:103183:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d959a97cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1777051295.220050:0:103169:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452539520 00000100:00100000:0.0:1777051295.220067:0:103169:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452539520 00000100:00100000:0.0:1777051295.220194:0:103169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1777051295.220267:0:103169:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f3dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f9351a01-5b0e-4470-97fd-58b9b4b312a2+10:103183:x1863365452539520:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1777051295.220509:0:103169:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f3dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f9351a01-5b0e-4470-97fd-58b9b4b312a2+10:103183:x1863365452539520:12345-0@lo:502:llog_process_th.0 Request processed in 247us (957us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051295.220524:0:103169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1777051295.221607:0:103183:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7fd63b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f9351a01-5b0e-4470-97fd-58b9b4b312a2:103183:1863365452539520:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1777051295.221767:0:103183:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7fd63b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f9351a01-5b0e-4470-97fd-58b9b4b312a2:103183:1863365452539648:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1777051295.221883:0:103183:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051295.221969:0:103183:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d959a97cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1777051295.222078:0:103165:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452539648 00000100:00100000:0.0:1777051295.222476:0:103165:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452539648 00000100:00100000:0.0:1777051295.222566:0:103165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1777051295.222584:0:103165:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f3dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9351a01-5b0e-4470-97fd-58b9b4b312a2+10:103183:x1863365452539648:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1777051295.222760:0:103165:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f3dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9351a01-5b0e-4470-97fd-58b9b4b312a2+10:103183:x1863365452539648:12345-0@lo:502:llog_process_th.0 Request processed in 178us (876us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051295.222775:0:103165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1777051295.222785:0:103183:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7fd63b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f9351a01-5b0e-4470-97fd-58b9b4b312a2:103183:1863365452539648:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1777051295.222845:0:103183:0:(llog.c:858:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64 count 63 00000020:01000000:0.0:1777051295.223013:0:103158:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-63 (rc=0) 10000000:01000000:0.0:1777051295.223081:0:103158:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.201.146@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1777051295.223164:0:103158:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff99d955a98a00/0x85f51a6b96714bf6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b96714bfd expref: -99 pid: 103158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051295.223190:0:103158:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.146@tcp lock: ffff99d955a98a00/0x85f51a6b96714bf6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b96714bfd expref: -99 pid: 103158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1777051295.223343:0:103158:0:(tgt_mount.c:1144:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1777051295.223349:0:103158:0:(tgt_mount.c:1145:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1777051295.223353:0:103158:0:(tgt_mount.c:1146:server_mti_print()) fs: lustre 00000020:01000004:0.0:1777051295.223358:0:103158:0:(tgt_mount.c:1147:server_mti_print()) uuid: 00000020:01000004:0.0:1777051295.223363:0:103158:0:(tgt_mount.c:1148:server_mti_print()) ver: 0 00000020:01000004:0.0:1777051295.223367:0:103158:0:(tgt_mount.c:1149:server_mti_print()) flags: 00000020:01000004:0.0:1777051295.223371:0:103158:0:(tgt_mount.c:1151:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1777051295.223375:0:103158:0:(tgt_mount.c:1155:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1777051295.223379:0:103158:0:(tgt_mount.c:1183:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1777051295.223382:0:103158:0:(tgt_mount.c:1189:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1777051295.223388:0:103158:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:0.0:1777051295.223394:0:103158:0:(tgt_mount.c:1144:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1777051295.223397:0:103158:0:(tgt_mount.c:1145:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1777051295.223400:0:103158:0:(tgt_mount.c:1146:server_mti_print()) fs: lustre 00000020:01000004:0.0:1777051295.223403:0:103158:0:(tgt_mount.c:1147:server_mti_print()) uuid: 00000020:01000004:0.0:1777051295.223406:0:103158:0:(tgt_mount.c:1148:server_mti_print()) ver: 0 00000020:01000004:0.0:1777051295.223409:0:103158:0:(tgt_mount.c:1149:server_mti_print()) flags: 00000020:01000004:0.0:1777051295.223412:0:103158:0:(tgt_mount.c:1151:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1777051295.223415:0:103158:0:(tgt_mount.c:1155:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1777051295.223417:0:103158:0:(tgt_mount.c:1183:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1777051295.223421:0:103158:0:(tgt_mount.c:1189:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1777051295.223457:0:103158:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1777051295.223485:0:103158:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95f867b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9351a01-5b0e-4470-97fd-58b9b4b312a2:103158:1863365452539776:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1777051295.223552:0:103158:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051295.223620:0:103158:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da50faa9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1777051295.223658:0:103163:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452539776 00000100:00100000:0.0:1777051295.223665:0:103163:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452539776 00000100:00100000:0.0:1777051295.223710:0:103163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1777051295.223719:0:103163:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f3dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9351a01-5b0e-4470-97fd-58b9b4b312a2+10:103158:x1863365452539776:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1777051295.223748:0:103163:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1777051295.223766:0:103163:0:(mgs_nids.c:461:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1777051295.236196:0:103163:0:(mgs_nids.c:813:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1777051295.236227:0:103163:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1777051295.236831:0:103167:0:(mgs_nids.c:710:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1777051295.236847:0:103167:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00000100:00100000:0.0:1777051295.236851:0:103163:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f3dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9351a01-5b0e-4470-97fd-58b9b4b312a2+10:103158:x1863365452539776:12345-0@lo:253:mount.lustre.0 Request processed in 13122us (13292us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051295.236880:0:103163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00010000:1.0:1777051295.236888:0:103167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99d9442eb200/0x85f51a6b96714c12 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 103167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051295.236924:0:103167:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99da7d784200/0x85f51a6b96714be1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b96714bda expref: 9 pid: 103169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051295.236950:0:103167:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99d9442eb200/0x85f51a6b96714c12 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 103167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051295.237021:0:103167:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99da7d784200/0x85f51a6b96714be1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x85f51a6b96714bda expref: 9 pid: 103169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051295.237034:0:103158:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95f867b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9351a01-5b0e-4470-97fd-58b9b4b312a2:103158:1863365452539776:0@lo:253:mount.lustre.0 00010000:00010000:1.0:1777051295.237063:0:103167:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99da7d784200/0x85f51a6b96714be1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x85f51a6b96714bda expref: 9 pid: 103169 timeout: 8024 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1777051295.237068:0:103158:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1777051295.237080:0:103158:0:(tgt_mount.c:1144:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1777051295.237086:0:103158:0:(tgt_mount.c:1145:server_mti_print()) server: lustre-MDT0000 00000100:00100000:1.0:1777051295.237506:0:103167:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95fae8000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:103167:1863365452539904:0@lo:104: 00000020:01000004:0.0:1777051295.237521:0:103158:0:(tgt_mount.c:1146:server_mti_print()) fs: lustre 00000020:01000004:0.0:1777051295.237524:0:103158:0:(tgt_mount.c:1147:server_mti_print()) uuid: 00000020:01000004:0.0:1777051295.237526:0:103158:0:(tgt_mount.c:1148:server_mti_print()) ver: 0 00000020:01000004:0.0:1777051295.237528:0:103158:0:(tgt_mount.c:1149:server_mti_print()) flags: 00000020:01000004:0.0:1777051295.237531:0:103158:0:(tgt_mount.c:1151:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1777051295.237535:0:103158:0:(tgt_mount.c:1155:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1777051295.237539:0:103158:0:(tgt_mount.c:1183:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1777051295.237541:0:103158:0:(tgt_mount.c:1189:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1777051295.237575:0:103158:0:(tgt_mount.c:2642:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:1.0:1777051295.237618:0:103167:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051295.237973:0:99220:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452539904 00000100:00100000:3.0:1777051295.237991:0:99220:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452539904 00000100:00100000:1.0:1777051295.238003:0:103167:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d95ba62900 going to sleep for 11 seconds 00000100:00100000:3.0:1777051295.238600:0:99220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1777051295.238619:0:99220:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f519180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:f9351a01-5b0e-4470-97fd-58b9b4b312a2+3:103167:x1863365452539904:12345-0@lo:104: 00010000:00010000:3.0:1777051295.238648:0:99220:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.146@tcp lock: ffff99d955a99200/0x85f51a6b96714bda lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x85f51a6b96714be1 expref: -99 pid: 103158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051295.239637:0:99220:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1777051295.239650:0:99220:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f519180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:f9351a01-5b0e-4470-97fd-58b9b4b312a2+3:103167:x1863365452539904:12345-0@lo:104: Request processed in 1035us (2040us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051295.239664:0:99220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00010000:00010000:3.0:1777051295.239785:0:38719:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777051295.239798:0:38719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.146@tcp lock: ffff99d955a99200/0x85f51a6b96714bda lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x85f51a6b96714be1 expref: -99 pid: 103158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051295.239814:0:38719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d955a99200 already unused, calling callback (ffffffffc1208c20) 10000000:00010000:3.0:1777051295.239821:0:38719:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.146@tcp lock: ffff99d955a99200/0x85f51a6b96714bda lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x85f51a6b96714be1 expref: -99 pid: 103158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051295.239834:0:103167:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95fae8000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:103167:1863365452539904:0@lo:104: 00010000:00010000:3.0:1777051295.239866:0:38719:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.146@tcp lock: ffff99d955a99200/0x85f51a6b96714bda lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x85f51a6b96714be1 expref: -99 pid: 103158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1777051295.239881:0:38719:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.146@tcp lock: ffff99d955a99200/0x85f51a6b96714bda lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x85f51a6b96714be1 expref: -99 pid: 103158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1777051295.239892:0:38719:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1777051295.239893:0:103167:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99d9442eb200/0x85f51a6b96714c12 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 103167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051295.239972:0:38719:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.146@tcp lock: ffff99d955a99200/0x85f51a6b96714bda lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x85f51a6b96714be1 expref: -99 pid: 103158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051295.239987:0:38719:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1777051295.240055:0:38719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.146@tcp lock: ffff99d955a99200/0x85f51a6b96714bda lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x85f51a6b96714be1 expref: -99 pid: 103158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051295.240078:0:3679:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:3.0:1777051295.240088:0:38719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.146@tcp lock: ffff99d955a99200/0x85f51a6b96714bda lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x85f51a6b96714be1 expref: -99 pid: 103158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051295.240146:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1777051295.240148:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7fd63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3679:1863365452540032:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1777051295.240154:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051295.240162:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1777051295.240283:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051295.240547:0:6565:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452540032 00000100:00100000:3.0:1777051295.240557:0:6565:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452540032 00010000:00010000:3.0:1777051295.240589:0:6565:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99da7d784200/0x85f51a6b96714be1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x85f51a6b96714bda expref: 10 pid: 103169 timeout: 8024 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051295.240644:0:6565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3828 00000100:00100000:3.0:1777051295.240668:0:6565:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955506a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f9351a01-5b0e-4470-97fd-58b9b4b312a2+10:3679:x1863365452540032:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1777051295.240689:0:6565:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777051295.240700:0:6565:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99da7d784200/0x85f51a6b96714be1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x85f51a6b96714bda expref: 10 pid: 103169 timeout: 8024 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051295.240725:0:6565:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99da7d784200/0x85f51a6b96714be1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x85f51a6b96714bda expref: 10 pid: 103169 timeout: 8024 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051295.240752:0:6565:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99da7d784200/0x85f51a6b96714be1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x85f51a6b96714bda expref: 10 pid: 103169 timeout: 8024 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051295.240783:0:6565:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99d9442eb200/0x85f51a6b96714c12 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 103167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051295.240798:0:6565:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d9442eb200/0x85f51a6b96714c12 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 103167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1777051295.240833:0:6565:0:(mgs_nids.c:686:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003988075s 00010000:00010000:3.0:1777051295.240841:0:6565:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99d9442eb200/0x85f51a6b96714c12 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 103167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051295.240854:0:6565:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99d9442eb200/0x85f51a6b96714c12 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 103167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051295.240867:0:6565:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99d9442eb200/0x85f51a6b96714c12 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 103167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051295.240878:0:6565:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99d9442eb200/0x85f51a6b96714c12 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 103167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051295.240888:0:6565:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d9442eb200 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:3.0:1777051295.240897:0:6565:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99d9442eb200/0x85f51a6b96714c12 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 103167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051295.240911:0:6565:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99d9442eb200/0x85f51a6b96714c12 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 103167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051295.240952:0:6565:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99d9442eb200/0x85f51a6b96714c12 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 103167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051295.240971:0:6565:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1777051295.241025:0:103167:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99d9442eb200/0x85f51a6b96714c12 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 103167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051295.241045:0:103167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99d9442eb200/0x85f51a6b96714c12 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 103167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051295.241060:0:6565:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955506a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f9351a01-5b0e-4470-97fd-58b9b4b312a2+9:3679:x1863365452540032:12345-0@lo:103:ldlm_bl.0 Request processed in 401us (774us total) trans 0 rc 0/0 00010000:00010000:1.0:1777051295.241062:0:103167:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d9442eb200/0x85f51a6b96714c12 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 103167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051295.241118:0:6565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3828 00000100:00100000:2.0:1777051295.241137:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7fd63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3679:1863365452540032:0@lo:103:ldlm_bl.0 00000040:00080000:2.0:1777051295.266537:0:103191:0:(llog.c:801:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1777051295.266548:0:103191:0:(llog_cat.c:158:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1777051295.267596:0:103191:0:(llog.c:858:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:2.0:1777051295.267615:0:103191:0:(llog.c:858:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000020:00080000:1.0:1777051295.297985:0:103158:0:(update_trans.c:1477:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8590017025 00000040:01000000:0.0:1777051295.298635:0:103158:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:1.0:1777051295.298930:0:103195:0:(update_trans.c:1520:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8590017025 00000020:00080000:1.0:1777051295.298943:0:103195:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8590017025 00000040:01000000:0.0:1777051295.299358:0:103196:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1777051295.299916:0:103158:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00100000:1.0:1777051295.302389:0:103197:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94f519c00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:103197:1863365452540160:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1777051295.302500:0:103197:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051295.302572:0:6584:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452540160 00000100:00100000:1.0:1777051295.302585:0:6584:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452540160 00000100:00100000:1.0:1777051295.302667:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8015 00000100:00100000:1.0:1777051295.302686:0:6584:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f518e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:103197:x1863365452540160:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1777051295.302836:0:6584:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f518e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:103197:x1863365452540160:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 151us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051295.302854:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8015 00000100:00100000:1.0:1777051295.302910:0:103197:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d95d7c4300 going to sleep for 11 seconds 00000100:00100000:1.0:1777051295.302957:0:103197:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94f519c00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:103197:1863365452540160:0@lo:1000:lod0000_rec0001.0 00000040:01000000:1.0:1777051295.303011:0:103197:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:1.0:1777051295.303119:0:103197:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94f519c00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:103197:1863365452540288:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1777051295.303189:0:103197:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051295.303282:0:103197:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d95d7c4300 going to sleep for 11 seconds 00000100:00100000:0.0:1777051295.303287:0:46498:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452540288 00000100:00100000:0.0:1777051295.303300:0:46498:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452540288 00000040:01000000:2.0:1777051295.304780:0:103158:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000100:00100000:2.0:1777051295.305383:0:46498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8016 00000100:00100000:2.0:1777051295.305407:0:46498:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f518380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+6:103197:x1863365452540288:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1777051295.306042:0:46498:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f518380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+6:103197:x1863365452540288:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 641us (2850us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051295.306060:0:46498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8016 00000004:00000080:0.0:1777051295.306848:0:103158:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1777051295.306869:0:103158:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000100:00100000:2.0:1777051295.307186:0:103197:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94f519c00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:103197:1863365452540288:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1777051295.307389:0:103197:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955506d80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:103197:1863365452540416:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1777051295.307457:0:103197:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051295.307507:0:103197:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da5884e9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1777051295.307621:0:11727:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452540416 00000100:00100000:0.0:1777051295.307634:0:11727:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452540416 00000100:00100000:0.0:1777051295.307702:0:11727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8017 00000100:00100000:0.0:1777051295.307718:0:11727:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955507800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:103197:x1863365452540416:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1777051295.307929:0:11727:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955507800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:103197:x1863365452540416:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 213us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051295.307945:0:11727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8017 00000100:00100000:2.0:1777051295.308045:0:103197:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955506d80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:103197:1863365452540416:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1777051295.308332:0:103197:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955506d80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:103197:1863365452540544:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1777051295.308452:0:103197:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051295.308511:0:6584:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452540544 00000100:00100000:2.0:1777051295.308521:0:6584:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452540544 00000100:00100000:2.0:1777051295.308585:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8018 00000100:00100000:2.0:1777051295.308600:0:6584:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955506300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:103197:x1863365452540544:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1777051295.309351:0:6584:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955506300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:103197:x1863365452540544:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 750us (896us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051295.309367:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8018 00000100:00100000:2.0:1777051295.309422:0:103197:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d95d585900 going to sleep for 11 seconds 00000100:00100000:2.0:1777051295.309451:0:103197:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955506d80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:103197:1863365452540544:0@lo:1000:lod0000_rec0001.0 00000040:00080000:0.0:1777051295.310738:0:103158:0:(llog.c:858:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1777051295.312372:0:103158:0:(llog.c:858:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1777051295.312463:0:103158:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:0.0:1777051295.317449:0:103158:0:(osd_handler.c:5577:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3e:0x0] (8/32) registered 00000040:00080000:2.0:1777051295.320646:0:103197:0:(llog.c:858:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1777051295.320772:0:103197:0:(lod_dev.c:520:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000040:00080000:1.0:1777051295.329431:0:103196:0:(llog.c:858:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1777051295.329568:0:103196:0:(lod_dev.c:520:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1777051295.329579:0:103196:0:(lod_dev.c:544:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00080000:2.0:1777051295.336932:0:103158:0:(ldlm_lib.c:3036:target_recovery_init()) RECOVERY: service lustre-MDT0000, 3 recoverable clients, last_transno 25769803776 00010000:00080000:0.0:1777051295.339693:0:103199:0:(ldlm_lib.c:2839:target_recovery_thread()) lustre-MDT0000: started recovery thread pid 103199 00010000:02000000:0.0:1777051295.339723:0:103199:0:(ldlm_lib.c:2321:target_recovery_overseer()) lustre-MDT0000: in recovery but waiting for the first client to connect 00000020:01000004:2.0:1777051295.340082:0:103158:0:(tgt_mount.c:296:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1777051295.340149:0:103158:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.146@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1777051295.340187:0:103158:0:(tgt_mount.c:2411:server_fill_super_common()) Server sb, dev=47 00000080:00000004:2.0:1777051295.340212:0:103158:0:(super25.c:187:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:2.0:1777051295.342731:0:103158:0:(tgt_mount.c:2297:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1777051295.343391:0:103158:0:(tgt_mount.c:2312:is_cmd_supported()) ioctl cmd=81009431 00010000:00080000:0.0:1777051295.348509:0:103199:0:(ldlm_lib.c:2531:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 3 abort 0 expired 0 00010000:00080000:0.0:1777051295.348518:0:103199:0:(ldlm_lib.c:2531:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 3 abort 0 expired 0 00000100:00100000:2.0:1777051295.512531:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94f519f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452540672:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1777051295.513152:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051295.513773:0:47388:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452540672 00000100:00100000:2.0:1777051295.513788:0:47388:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452540672 00000100:00100000:2.0:1777051295.513874:0:47388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5554 00000100:00100000:2.0:1777051295.513895:0:47388:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955506d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3677:x1863365452540672:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1777051295.513936:0:47388:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 430294336 pending 0 free 3645853696 avail 3414331392 00000100:00100000:2.0:1777051295.514055:0:47388:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955506d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3677:x1863365452540672:12345-0@lo:13:osp-pre-1-1.0 Request processed in 156us (897us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051295.514074:0:47388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5554 00000100:00100000:0.0:1777051295.515632:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94f519f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452540672:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1777051295.834514:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777051296.022752:0:3677:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1777051296.022786:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7fd63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452540800:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1777051296.022888:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051296.023036:0:10113:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452540800 00000100:00100000:3.0:1777051296.023048:0:10113:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452540800 00000100:00100000:3.0:1777051296.023509:0:10113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5555 00000100:00080000:0.0:1777051296.023513:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1777051296.023532:0:10113:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fd60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3677:x1863365452540800:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1777051296.023567:0:10113:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 440354112 pending 0 free 3862671360 avail 3631149056 00000100:00100000:3.0:1777051296.023663:0:10113:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fd60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3677:x1863365452540800:12345-0@lo:13:osp-pre-0-1.0 Request processed in 138us (775us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051296.023678:0:10113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5555 00000100:00100000:0.0:1777051296.023895:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7fd63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452540800:0@lo:13:osp-pre-0-1.0 00000040:00080000:2.0:1777051296.278519:0:103191:0:(llog.c:801:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1777051296.278531:0:103191:0:(llog_cat.c:158:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1777051296.279953:0:103191:0:(llog.c:858:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:2.0:1777051296.279969:0:103191:0:(llog.c:858:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:2.0:1777051296.283542:0:103189:0:(llog.c:858:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:2.0:1777051296.535290:0:6577:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1777051296.535300:0:6577:0:(mgc_request.c:1799:mgc_process_log()) Process log lustre-mdtir-ffff99da5f2be000 from 30 10000000:01000000:2.0:1777051296.535309:0:6577:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1777051296.535370:0:6577:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.146@tcp lock: ffff99d955a99000/0x85f51a6b96714c19 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051296.535391:0:6577:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.146@tcp lock: ffff99d955a99000/0x85f51a6b96714c19 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051296.535409:0:6577:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.146@tcp lock: ffff99d955a99000/0x85f51a6b96714c19 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051296.535447:0:6577:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955505880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452540928:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1777051296.535540:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051296.535623:0:6577:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da5884e540 going to sleep for 11 seconds 00000100:00100000:1.0:1777051296.536234:0:103168:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452540928 00000100:00100000:1.0:1777051296.536246:0:103168:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452540928 00000100:00100000:1.0:1777051296.536323:0:103168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1777051296.536339:0:103168:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f3dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f9351a01-5b0e-4470-97fd-58b9b4b312a2+9:6577:x1863365452540928:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1777051296.536360:0:103168:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777051296.536381:0:103168:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d9442eba00/0x85f51a6b96714c20 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x85f51a6b96714c19 expref: -99 pid: 103168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051296.536424:0:103168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d9442eba00/0x85f51a6b96714c20 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x85f51a6b96714c19 expref: 10 pid: 103168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051296.536443:0:103168:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d9442eba00/0x85f51a6b96714c20 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b96714c19 expref: 10 pid: 103168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051296.536457:0:103168:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d9442eba00, rc 0) 00000100:00100000:1.0:1777051296.536530:0:103168:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f3dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f9351a01-5b0e-4470-97fd-58b9b4b312a2+10:6577:x1863365452540928:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 194us (991us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051296.536543:0:103168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1777051296.536609:0:6577:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955505880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452540928:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1777051296.536967:0:6577:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.146@tcp lock: ffff99d955a99000/0x85f51a6b96714c19 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b96714c20 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051296.536988:0:6577:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.146@tcp lock: ffff99d955a99000/0x85f51a6b96714c19 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x85f51a6b96714c20 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051296.537119:0:6577:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955505880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452541056:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1777051296.537172:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051296.537221:0:6577:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da5884e540 going to sleep for 11 seconds 00000100:00100000:0.0:1777051296.537334:0:103165:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452541056 00000100:00100000:0.0:1777051296.537343:0:103165:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452541056 00000100:00100000:0.0:1777051296.537395:0:103165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1777051296.537406:0:103165:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f3df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9351a01-5b0e-4470-97fd-58b9b4b312a2+10:6577:x1863365452541056:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1777051296.537429:0:103165:0:(mgs_nids.c:912:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1777051296.537454:0:103165:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1777051296.537458:0:103165:0:(mgs_nids.c:316:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 30 00000100:00100000:0.0:1777051296.537568:0:103165:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f3df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9351a01-5b0e-4470-97fd-58b9b4b312a2+10:6577:x1863365452541056:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 164us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051296.537579:0:103165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1777051296.537647:0:6577:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955505880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452541056:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1777051296.537714:0:6577:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.201.146@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1777051296.537725:0:6577:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff99d955a99000/0x85f51a6b96714c19 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b96714c20 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051296.537740:0:6577:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.146@tcp lock: ffff99d955a99000/0x85f51a6b96714c19 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b96714c20 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1777051296.537754:0:6577:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1777051296.537757:0:6577:0:(mgc_request.c:1799:mgc_process_log()) Process log lustre-client-ffff99d941839800 from 64 10000000:01000000:0.0:1777051296.537762:0:6577:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1777051296.537789:0:6577:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.146@tcp lock: ffff99da713e2400/0x85f51a6b96714c27 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051296.537808:0:6577:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.146@tcp lock: ffff99da713e2400/0x85f51a6b96714c27 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051296.537822:0:6577:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.146@tcp lock: ffff99da713e2400/0x85f51a6b96714c27 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051296.537846:0:6577:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95f867b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452541184:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1777051296.537894:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051296.537924:0:103169:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452541184 00000100:00100000:2.0:1777051296.537932:0:103169:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452541184 00000100:00100000:0.0:1777051296.537943:0:6577:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d959b89d80 going to sleep for 11 seconds 00000100:00100000:0.0:1777051296.537991:0:103163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1777051296.538009:0:103163:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f3de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9351a01-5b0e-4470-97fd-58b9b4b312a2+10:6577:x1863365452541184:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1777051296.538023:0:103163:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051296.538039:0:103163:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99da713e3000/0x85f51a6b96714c2e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x85f51a6b96714c27 expref: -99 pid: 103163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051296.538065:0:103163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99da713e3000/0x85f51a6b96714c2e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x85f51a6b96714c27 expref: 11 pid: 103163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051296.538113:0:103163:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99da713e3000/0x85f51a6b96714c2e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b96714c27 expref: 11 pid: 103163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051296.538124:0:103163:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99da713e3000, rc 0) 00000100:00100000:0.0:1777051296.538187:0:103163:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f3de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9351a01-5b0e-4470-97fd-58b9b4b312a2+11:6577:x1863365452541184:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 184us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051296.538225:0:103163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1777051296.538597:0:6577:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95f867b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452541184:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1777051296.538617:0:6577:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.146@tcp lock: ffff99da713e2400/0x85f51a6b96714c27 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b96714c2e expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051296.538632:0:6577:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.146@tcp lock: ffff99da713e2400/0x85f51a6b96714c27 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x85f51a6b96714c2e expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051296.539025:0:6577:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955507100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452541312:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1777051296.539110:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051296.539158:0:6577:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da5884e540 going to sleep for 11 seconds 00000100:00100000:1.0:1777051296.539346:0:103168:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452541312 00000100:00100000:1.0:1777051296.539354:0:103168:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452541312 00000100:00100000:1.0:1777051296.539391:0:103168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1777051296.539401:0:103168:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f3dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f9351a01-5b0e-4470-97fd-58b9b4b312a2+11:6577:x1863365452541312:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1777051296.539565:0:103168:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f3dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f9351a01-5b0e-4470-97fd-58b9b4b312a2+11:6577:x1863365452541312:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 163us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051296.539576:0:103168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1777051296.539907:0:6577:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955507100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452541312:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1777051296.539957:0:6577:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955507100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452541440:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1777051296.540022:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051296.540098:0:6577:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da5884e540 going to sleep for 11 seconds 00000100:00100000:0.0:1777051296.540144:0:103169:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452541440 00000100:00100000:0.0:1777051296.540153:0:103169:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452541440 00000100:00100000:0.0:1777051296.540244:0:103169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1777051296.540262:0:103169:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f3dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f9351a01-5b0e-4470-97fd-58b9b4b312a2+11:6577:x1863365452541440:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1777051296.540492:0:103169:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f3dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f9351a01-5b0e-4470-97fd-58b9b4b312a2+11:6577:x1863365452541440:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 233us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051296.540504:0:103169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1777051296.540632:0:6577:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955507100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452541440:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1777051296.543010:0:103258:0:(llog.c:858:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 63 00000020:01000000:1.0:1777051296.543748:0:6577:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 64-63 (rc=0) 10000000:01000000:1.0:1777051296.543798:0:6577:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.201.146@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1777051296.543810:0:6577:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff99da713e2400/0x85f51a6b96714c27 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b96714c2e expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051296.543827:0:6577:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.146@tcp lock: ffff99da713e2400/0x85f51a6b96714c27 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b96714c2e expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1777051296.543850:0:6577:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:1.0:1777051296.543854:0:6577:0:(mgc_request.c:1799:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:1.0:1777051296.543858:0:6577:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1777051296.543894:0:6577:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.146@tcp lock: ffff99d9442eaa00/0x85f51a6b96714c35 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051296.543907:0:6577:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.146@tcp lock: ffff99d9442eaa00/0x85f51a6b96714c35 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051296.543921:0:6577:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.146@tcp lock: ffff99d9442eaa00/0x85f51a6b96714c35 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051296.543946:0:6577:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94f519f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452541568:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1777051296.544014:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051296.544091:0:6577:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d95d7c4780 going to sleep for 11 seconds 00000100:00100000:1.0:1777051296.544393:0:103163:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452541568 00000100:00100000:1.0:1777051296.544402:0:103163:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452541568 00000100:00100000:1.0:1777051296.544448:0:103163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1777051296.544464:0:103163:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f3de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9351a01-5b0e-4470-97fd-58b9b4b312a2+11:6577:x1863365452541568:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1777051296.544478:0:103163:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777051296.544494:0:103163:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d9442eb400/0x85f51a6b96714c3c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x85f51a6b96714c35 expref: -99 pid: 103163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051296.544523:0:103163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d9442eb400/0x85f51a6b96714c3c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x85f51a6b96714c35 expref: 12 pid: 103163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051296.544539:0:103163:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d9442eb400/0x85f51a6b96714c3c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b96714c35 expref: 12 pid: 103163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051296.544561:0:103163:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d9442eb400, rc 0) 00000100:00100000:1.0:1777051296.544635:0:103163:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f3de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9351a01-5b0e-4470-97fd-58b9b4b312a2+12:6577:x1863365452541568:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 176us (620us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051296.544645:0:103163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1777051296.546364:0:6577:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94f519f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452541568:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1777051296.546389:0:6577:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.146@tcp lock: ffff99d9442eaa00/0x85f51a6b96714c35 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b96714c3c expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051296.546406:0:6577:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.146@tcp lock: ffff99d9442eaa00/0x85f51a6b96714c35 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x85f51a6b96714c3c expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051296.546491:0:6577:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955507100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452541696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1777051296.546538:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051296.546584:0:6577:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da5884e300 going to sleep for 11 seconds 00000100:00100000:1.0:1777051296.547308:0:103165:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452541696 00000100:00100000:1.0:1777051296.547317:0:103165:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452541696 00000100:00100000:1.0:1777051296.547366:0:103165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1777051296.547383:0:103165:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f3dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9351a01-5b0e-4470-97fd-58b9b4b312a2+12:6577:x1863365452541696:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1777051296.548046:0:6577:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955507100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452541696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1777051296.548048:0:103165:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f3dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9351a01-5b0e-4470-97fd-58b9b4b312a2+12:6577:x1863365452541696:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 666us (1504us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051296.548096:0:103165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1777051296.548139:0:6577:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955507100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452541824:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1777051296.548243:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051296.548300:0:103166:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452541824 00000100:00100000:2.0:1777051296.548303:0:6577:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da5884e300 going to sleep for 11 seconds 00000100:00100000:0.0:1777051296.548312:0:103166:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452541824 00000100:00100000:2.0:1777051296.548585:0:103163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1777051296.548604:0:103163:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5cdb4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9351a01-5b0e-4470-97fd-58b9b4b312a2+12:6577:x1863365452541824:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1777051296.551629:0:103163:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5cdb4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9351a01-5b0e-4470-97fd-58b9b4b312a2+12:6577:x1863365452541824:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 3029us (3385us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051296.551646:0:103163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1777051296.551739:0:6577:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955507100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452541824:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1777051296.553663:0:103260:0:(llog.c:858:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 11 00000020:01000000:0.0:1777051296.556242:0:6577:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:0.0:1777051296.556288:0:6577:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.201.146@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1777051296.556301:0:6577:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff99d9442eaa00/0x85f51a6b96714c35 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b96714c3c expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051296.556319:0:6577:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.146@tcp lock: ffff99d9442eaa00/0x85f51a6b96714c35 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b96714c3c expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1777051296.556334:0:6577:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1777051296.556339:0:6577:0:(mgc_request.c:1799:mgc_process_log()) Process log params-ffff99d941839800 from 43 10000000:01000000:0.0:1777051296.556343:0:6577:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1777051296.556388:0:6577:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.146@tcp lock: ffff99da713e3a00/0x85f51a6b96714c43 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051296.556402:0:6577:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.146@tcp lock: ffff99da713e3a00/0x85f51a6b96714c43 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051296.556417:0:6577:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.146@tcp lock: ffff99da713e3a00/0x85f51a6b96714c43 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051296.556448:0:6577:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95f867b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452541952:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1777051296.556529:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051296.556600:0:103168:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452541952 00000100:00100000:2.0:1777051296.556611:0:103168:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452541952 00000100:00100000:0.0:1777051296.556625:0:6577:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da71c1bc00 going to sleep for 11 seconds 00000100:00100000:2.0:1777051296.557740:0:103168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1777051296.557763:0:103168:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7c978050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f9351a01-5b0e-4470-97fd-58b9b4b312a2+12:6577:x1863365452541952:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1777051296.557783:0:103168:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051296.557805:0:103168:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d955a99600/0x85f51a6b96714c4a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x85f51a6b96714c43 expref: -99 pid: 103168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051296.557852:0:103168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d955a99600/0x85f51a6b96714c4a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x85f51a6b96714c43 expref: 13 pid: 103168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051296.557870:0:103168:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d955a99600/0x85f51a6b96714c4a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b96714c43 expref: 13 pid: 103168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051296.557884:0:103168:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d955a99600, rc 0) 00000100:00100000:0.0:1777051296.558035:0:6577:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95f867b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452541952:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1777051296.558060:0:6577:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.146@tcp lock: ffff99da713e3a00/0x85f51a6b96714c43 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b96714c4a expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051296.558114:0:6577:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.146@tcp lock: ffff99da713e3a00/0x85f51a6b96714c43 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x85f51a6b96714c4a expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051296.558206:0:6577:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95f867b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452542080:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1777051296.558213:0:103168:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7c978050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f9351a01-5b0e-4470-97fd-58b9b4b312a2+13:6577:x1863365452541952:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 454us (1683us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051296.558232:0:103168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1777051296.558280:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051296.558343:0:6577:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da71c1bc00 going to sleep for 11 seconds 00000100:00100000:0.0:1777051296.558369:0:103165:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452542080 00000100:00100000:0.0:1777051296.558375:0:103165:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452542080 00000100:00100000:0.0:1777051296.558479:0:103165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1777051296.558490:0:103165:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7c978c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9351a01-5b0e-4470-97fd-58b9b4b312a2+13:6577:x1863365452542080:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1777051296.558628:0:103165:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7c978c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9351a01-5b0e-4470-97fd-58b9b4b312a2+13:6577:x1863365452542080:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 137us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051296.558640:0:103165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1777051296.558698:0:6577:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95f867b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452542080:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1777051296.558746:0:6577:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95f867b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452542208:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1777051296.558811:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051296.558831:0:6577:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da71c1bc00 going to sleep for 11 seconds 00000100:00100000:3.0:1777051296.559169:0:103163:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452542208 00000100:00100000:3.0:1777051296.559178:0:103163:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452542208 00000100:00100000:3.0:1777051296.559226:0:103163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1777051296.559240:0:103163:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7c979450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9351a01-5b0e-4470-97fd-58b9b4b312a2+13:6577:x1863365452542208:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1777051296.559505:0:103163:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7c979450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9351a01-5b0e-4470-97fd-58b9b4b312a2+13:6577:x1863365452542208:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 265us (690us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051296.559520:0:103163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1777051296.559565:0:6577:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95f867b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452542208:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1777051296.561454:0:103261:0:(llog.c:858:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 43 00000020:01000000:0.0:1777051296.561671:0:6577:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 43-42 (rc=0) 10000000:01000000:0.0:1777051296.561716:0:6577:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.201.146@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1777051296.561729:0:6577:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff99da713e3a00/0x85f51a6b96714c43 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b96714c4a expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051296.561752:0:6577:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.146@tcp lock: ffff99da713e3a00/0x85f51a6b96714c43 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b96714c4a expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1777051296.561767:0:6577:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1777051296.561771:0:6577:0:(mgc_request.c:1799:mgc_process_log()) Process log lustre-client-ffff99da44f8d000 from 64 10000000:01000000:0.0:1777051296.561775:0:6577:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1777051296.561810:0:6577:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.146@tcp lock: ffff99da713e2000/0x85f51a6b96714c51 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051296.561824:0:6577:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.146@tcp lock: ffff99da713e2000/0x85f51a6b96714c51 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051296.561836:0:6577:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.146@tcp lock: ffff99da713e2000/0x85f51a6b96714c51 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051296.561856:0:6577:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95f867b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452542336:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1777051296.561913:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051296.561975:0:6577:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da59db0cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1777051296.561999:0:103168:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452542336 00000100:00100000:3.0:1777051296.562009:0:103168:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452542336 00000100:00100000:3.0:1777051296.562406:0:103168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1777051296.562421:0:103168:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7c97b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f9351a01-5b0e-4470-97fd-58b9b4b312a2+13:6577:x1863365452542336:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1777051296.562436:0:103168:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777051296.562453:0:103168:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99da7d784200/0x85f51a6b96714c58 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x85f51a6b96714c51 expref: -99 pid: 103168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051296.562482:0:103168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99da7d784200/0x85f51a6b96714c58 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x85f51a6b96714c51 expref: 14 pid: 103168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051296.562498:0:103168:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99da7d784200/0x85f51a6b96714c58 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b96714c51 expref: 14 pid: 103168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051296.562512:0:103168:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99da7d784200, rc 0) 00000100:00100000:3.0:1777051296.562570:0:103168:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7c97b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f9351a01-5b0e-4470-97fd-58b9b4b312a2+14:6577:x1863365452542336:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 153us (659us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051296.562584:0:103168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1777051296.562619:0:6577:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95f867b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452542336:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1777051296.562642:0:6577:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.146@tcp lock: ffff99da713e2000/0x85f51a6b96714c51 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b96714c58 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051296.562657:0:6577:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.146@tcp lock: ffff99da713e2000/0x85f51a6b96714c51 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x85f51a6b96714c58 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051296.562734:0:6577:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95f867b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452542464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1777051296.562780:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051296.562806:0:6577:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da59db0cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1777051296.562830:0:103166:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452542464 00000100:00100000:0.0:1777051296.562837:0:103166:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452542464 00000100:00100000:0.0:1777051296.562904:0:103166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1777051296.562919:0:103166:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7c979850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9351a01-5b0e-4470-97fd-58b9b4b312a2+14:6577:x1863365452542464:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1777051296.563055:0:103166:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7c979850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9351a01-5b0e-4470-97fd-58b9b4b312a2+14:6577:x1863365452542464:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 138us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051296.563096:0:103166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1777051296.563142:0:6577:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95f867b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452542464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1777051296.563484:0:6577:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7fd61c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452542592:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1777051296.563554:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051296.563588:0:6577:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d959a97900 going to sleep for 11 seconds 00000100:00100000:0.0:1777051296.563649:0:103169:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452542592 00000100:00100000:0.0:1777051296.563658:0:103169:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452542592 00000100:00100000:0.0:1777051296.564028:0:103169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1777051296.564043:0:103169:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7c97a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f9351a01-5b0e-4470-97fd-58b9b4b312a2+14:6577:x1863365452542592:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1777051296.564246:0:103169:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7c97a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f9351a01-5b0e-4470-97fd-58b9b4b312a2+14:6577:x1863365452542592:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 204us (690us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051296.564260:0:6577:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7fd61c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452542592:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1777051296.564262:0:103169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000040:00080000:0.0:1777051296.568001:0:103262:0:(llog.c:858:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 63 00000020:01000000:2.0:1777051296.568145:0:6577:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 64-63 (rc=0) 10000000:01000000:2.0:1777051296.568188:0:6577:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.201.146@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1777051296.568201:0:6577:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff99da713e2000/0x85f51a6b96714c51 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b96714c58 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051296.568218:0:6577:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.146@tcp lock: ffff99da713e2000/0x85f51a6b96714c51 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b96714c58 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1777051296.568233:0:6577:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1777051296.568238:0:6577:0:(mgc_request.c:1799:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:2.0:1777051296.568244:0:6577:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1777051296.568279:0:6577:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.146@tcp lock: ffff99d955a98e00/0x85f51a6b96714c5f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051296.568294:0:6577:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.146@tcp lock: ffff99d955a98e00/0x85f51a6b96714c5f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051296.568310:0:6577:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.146@tcp lock: ffff99d955a98e00/0x85f51a6b96714c5f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051296.568340:0:6577:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955507100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452542720:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1777051296.568397:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051296.568441:0:103165:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452542720 00000100:00100000:3.0:1777051296.568451:0:103165:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452542720 00000100:00100000:2.0:1777051296.568470:0:6577:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da5884e300 going to sleep for 11 seconds 00000100:00100000:3.0:1777051296.568522:0:103165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1777051296.568536:0:103165:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7c97bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9351a01-5b0e-4470-97fd-58b9b4b312a2+14:6577:x1863365452542720:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1777051296.568551:0:103165:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777051296.568569:0:103165:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99da7d785c00/0x85f51a6b96714c66 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x85f51a6b96714c5f expref: -99 pid: 103165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051296.568599:0:103165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99da7d785c00/0x85f51a6b96714c66 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x85f51a6b96714c5f expref: 15 pid: 103165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051296.568614:0:103165:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99da7d785c00/0x85f51a6b96714c66 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b96714c5f expref: 15 pid: 103165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051296.568628:0:103165:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99da7d785c00, rc 0) 00000100:00100000:3.0:1777051296.568688:0:103165:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7c97bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9351a01-5b0e-4470-97fd-58b9b4b312a2+15:6577:x1863365452542720:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 154us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051296.568700:0:103165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1777051296.569034:0:6577:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955507100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452542720:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1777051296.569050:0:6577:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.146@tcp lock: ffff99d955a98e00/0x85f51a6b96714c5f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b96714c66 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051296.569065:0:6577:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.146@tcp lock: ffff99d955a98e00/0x85f51a6b96714c5f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x85f51a6b96714c66 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051296.569171:0:6577:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955507100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452542848:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1777051296.569218:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051296.569263:0:6577:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da5884e300 going to sleep for 11 seconds 00000100:00100000:0.0:1777051296.569294:0:103166:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452542848 00000100:00100000:0.0:1777051296.569304:0:103166:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452542848 00000100:00100000:0.0:1777051296.569367:0:103166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1777051296.569381:0:103166:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94ba5c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9351a01-5b0e-4470-97fd-58b9b4b312a2+15:6577:x1863365452542848:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1777051296.570399:0:103166:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94ba5c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9351a01-5b0e-4470-97fd-58b9b4b312a2+15:6577:x1863365452542848:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1019us (1179us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051296.570414:0:103166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1777051296.570980:0:6577:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955507100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452542848:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1777051296.571030:0:6577:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955507100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452542976:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1777051296.571136:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051296.571182:0:6577:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da5884e300 going to sleep for 11 seconds 00000100:00100000:0.0:1777051296.571246:0:103168:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452542976 00000100:00100000:0.0:1777051296.571255:0:103168:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452542976 00000100:00100000:0.0:1777051296.571314:0:103168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1777051296.571328:0:103168:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94ba5c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f9351a01-5b0e-4470-97fd-58b9b4b312a2+15:6577:x1863365452542976:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1777051296.574141:0:103168:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94ba5c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f9351a01-5b0e-4470-97fd-58b9b4b312a2+15:6577:x1863365452542976:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 2813us (3002us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051296.574157:0:103168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1777051296.574196:0:6577:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955507100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452542976:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1777051296.576551:0:103263:0:(llog.c:858:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 14 00000020:01000000:3.0:1777051296.577141:0:6577:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:3.0:1777051296.577185:0:6577:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.201.146@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1777051296.577213:0:6577:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff99d955a98e00/0x85f51a6b96714c5f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b96714c66 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051296.577232:0:6577:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.146@tcp lock: ffff99d955a98e00/0x85f51a6b96714c5f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b96714c66 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1777051296.577248:0:6577:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1777051296.577252:0:6577:0:(mgc_request.c:1799:mgc_process_log()) Process log params-ffff99da44f8d000 from 43 10000000:01000000:3.0:1777051296.577258:0:6577:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1777051296.577298:0:6577:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.146@tcp lock: ffff99da7d784a00/0x85f51a6b96714c6d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051296.577311:0:6577:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.146@tcp lock: ffff99da7d784a00/0x85f51a6b96714c6d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051296.577326:0:6577:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.146@tcp lock: ffff99da7d784a00/0x85f51a6b96714c6d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051296.577356:0:6577:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7fd61c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452543104:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1777051296.577423:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051296.577484:0:6577:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d959a97540 going to sleep for 11 seconds 00000100:00100000:2.0:1777051296.577630:0:103165:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452543104 00000100:00100000:2.0:1777051296.577640:0:103165:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452543104 00000100:00100000:2.0:1777051296.578007:0:103165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1777051296.578024:0:103165:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94ba5d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9351a01-5b0e-4470-97fd-58b9b4b312a2+15:6577:x1863365452543104:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1777051296.578040:0:103165:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051296.578375:0:103165:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d955a99a00/0x85f51a6b96714c74 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x85f51a6b96714c6d expref: -99 pid: 103165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051296.578412:0:103165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d955a99a00/0x85f51a6b96714c74 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x85f51a6b96714c6d expref: 16 pid: 103165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051296.578438:0:103165:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d955a99a00/0x85f51a6b96714c74 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b96714c6d expref: 16 pid: 103165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051296.578453:0:103165:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d955a99a00, rc 0) 00000100:00100000:2.0:1777051296.578507:0:103165:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94ba5d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9351a01-5b0e-4470-97fd-58b9b4b312a2+16:6577:x1863365452543104:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 489us (1085us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051296.578518:0:103165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1777051296.578702:0:6577:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7fd61c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452543104:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1777051296.578722:0:6577:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.146@tcp lock: ffff99da7d784a00/0x85f51a6b96714c6d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b96714c74 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051296.578736:0:6577:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.146@tcp lock: ffff99da7d784a00/0x85f51a6b96714c6d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x85f51a6b96714c74 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051296.578813:0:6577:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955507100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452543232:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1777051296.578860:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051296.578952:0:6577:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d944d67e40 going to sleep for 11 seconds 00000100:00100000:3.0:1777051296.579014:0:103166:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452543232 00000100:00100000:3.0:1777051296.579021:0:103166:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452543232 00000100:00100000:3.0:1777051296.579157:0:103166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1777051296.579173:0:103166:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94ba5d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9351a01-5b0e-4470-97fd-58b9b4b312a2+16:6577:x1863365452543232:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1777051296.579352:0:103166:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94ba5d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9351a01-5b0e-4470-97fd-58b9b4b312a2+16:6577:x1863365452543232:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 181us (491us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051296.579366:0:103166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1777051296.579478:0:6577:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955507100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452543232:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1777051296.579581:0:6577:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955507100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452543360:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1777051296.579650:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051296.579704:0:6577:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d944d67e40 going to sleep for 11 seconds 00000100:00100000:1.0:1777051296.579754:0:103168:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452543360 00000100:00100000:1.0:1777051296.579764:0:103168:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452543360 00000100:00100000:1.0:1777051296.579832:0:103168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1777051296.579847:0:103168:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94ba5ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f9351a01-5b0e-4470-97fd-58b9b4b312a2+16:6577:x1863365452543360:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1777051296.579985:0:103168:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94ba5ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f9351a01-5b0e-4470-97fd-58b9b4b312a2+16:6577:x1863365452543360:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 141us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051296.579997:0:103168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1777051296.580045:0:6577:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955507100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452543360:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1777051296.581549:0:103264:0:(llog.c:858:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 43 00000020:01000000:3.0:1777051296.581853:0:6577:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 43-42 (rc=0) 10000000:01000000:3.0:1777051296.581891:0:6577:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.201.146@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1777051296.581903:0:6577:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff99da7d784a00/0x85f51a6b96714c6d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b96714c74 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051296.581919:0:6577:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.146@tcp lock: ffff99da7d784a00/0x85f51a6b96714c6d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b96714c74 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1777051296.581935:0:6577:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1777051296.581939:0:6577:0:(mgc_request.c:1799:mgc_process_log()) Process log lustre-client-ffff99da57ae9000 from 64 10000000:01000000:3.0:1777051296.581943:0:6577:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1777051296.581977:0:6577:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.146@tcp lock: ffff99da7d784400/0x85f51a6b96714c7b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051296.581991:0:6577:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.146@tcp lock: ffff99da7d784400/0x85f51a6b96714c7b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051296.582005:0:6577:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.146@tcp lock: ffff99da7d784400/0x85f51a6b96714c7b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051296.582031:0:6577:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7fd61c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452543488:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1777051296.582373:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051296.582440:0:6577:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d959a97540 going to sleep for 11 seconds 00000100:00100000:2.0:1777051296.582533:0:103165:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452543488 00000100:00100000:2.0:1777051296.582542:0:103165:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452543488 00000100:00100000:2.0:1777051296.582611:0:103165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1777051296.582629:0:103165:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94ba5f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9351a01-5b0e-4470-97fd-58b9b4b312a2+16:6577:x1863365452543488:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1777051296.582645:0:103165:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051296.582663:0:103165:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d955a98000/0x85f51a6b96714c82 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x85f51a6b96714c7b expref: -99 pid: 103165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051296.582687:0:103165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d955a98000/0x85f51a6b96714c82 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x85f51a6b96714c7b expref: 17 pid: 103165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051296.582700:0:103165:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d955a98000/0x85f51a6b96714c82 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b96714c7b expref: 17 pid: 103165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051296.582714:0:103165:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d955a98000, rc 0) 00000100:00100000:2.0:1777051296.582779:0:103165:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94ba5f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9351a01-5b0e-4470-97fd-58b9b4b312a2+17:6577:x1863365452543488:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 156us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051296.582794:0:103165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1777051296.582810:0:6577:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7fd61c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452543488:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1777051296.582836:0:6577:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.146@tcp lock: ffff99da7d784400/0x85f51a6b96714c7b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b96714c82 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051296.582851:0:6577:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.146@tcp lock: ffff99da7d784400/0x85f51a6b96714c7b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x85f51a6b96714c82 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051296.582942:0:6577:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7fd61c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452543616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1777051296.582996:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051296.583047:0:6577:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d959a97540 going to sleep for 11 seconds 00000100:00100000:0.0:1777051296.583104:0:103166:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452543616 00000100:00100000:0.0:1777051296.583113:0:103166:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452543616 00000100:00100000:0.0:1777051296.583206:0:103166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1777051296.583224:0:103166:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94ba5cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9351a01-5b0e-4470-97fd-58b9b4b312a2+17:6577:x1863365452543616:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1777051296.583372:0:103166:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94ba5cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9351a01-5b0e-4470-97fd-58b9b4b312a2+17:6577:x1863365452543616:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 151us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051296.583386:0:103166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1777051296.583417:0:6577:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7fd61c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452543616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1777051296.583467:0:6577:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7fd61c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452543744:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1777051296.583537:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051296.583596:0:6577:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d959a97540 going to sleep for 11 seconds 00000100:00100000:0.0:1777051296.584665:0:103168:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452543744 00000100:00100000:0.0:1777051296.584674:0:103168:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452543744 00000100:00100000:0.0:1777051296.584733:0:103168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1777051296.584749:0:103168:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f9351a01-5b0e-4470-97fd-58b9b4b312a2+17:6577:x1863365452543744:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1777051296.584879:0:103168:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f9351a01-5b0e-4470-97fd-58b9b4b312a2+17:6577:x1863365452543744:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 131us (1340us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051296.584892:0:103168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1777051296.584895:0:6577:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7fd61c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452543744:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1777051296.586531:0:103265:0:(llog.c:858:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 63 00000020:01000000:2.0:1777051296.586646:0:6577:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 64-63 (rc=0) 10000000:01000000:2.0:1777051296.586680:0:6577:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.201.146@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1777051296.586692:0:6577:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff99da7d784400/0x85f51a6b96714c7b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b96714c82 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051296.586717:0:6577:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.146@tcp lock: ffff99da7d784400/0x85f51a6b96714c7b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b96714c82 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1777051296.586731:0:6577:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1777051296.586735:0:6577:0:(mgc_request.c:1799:mgc_process_log()) Process log lustre-mdtir-ffff99da57ae9000 from 27 10000000:01000000:2.0:1777051296.586740:0:6577:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1777051296.586773:0:6577:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.146@tcp lock: ffff99d955a99400/0x85f51a6b96714c89 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051296.586787:0:6577:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.146@tcp lock: ffff99d955a99400/0x85f51a6b96714c89 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051296.586800:0:6577:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.146@tcp lock: ffff99d955a99400/0x85f51a6b96714c89 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051296.586824:0:6577:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955507100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452543872:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1777051296.586878:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051296.586942:0:6577:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d94e566c00 going to sleep for 11 seconds 00000100:00100000:3.0:1777051296.586953:0:103165:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452543872 00000100:00100000:3.0:1777051296.586964:0:103165:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452543872 00000100:00100000:3.0:1777051296.587034:0:103165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1777051296.587049:0:103165:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9351a01-5b0e-4470-97fd-58b9b4b312a2+17:6577:x1863365452543872:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1777051296.587064:0:103165:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777051296.587114:0:103165:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99da7d784e00/0x85f51a6b96714c90 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x85f51a6b96714c89 expref: -99 pid: 103165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051296.587146:0:103165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99da7d784e00/0x85f51a6b96714c90 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x85f51a6b96714c89 expref: 18 pid: 103165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051296.587164:0:103165:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99da7d784e00/0x85f51a6b96714c90 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b96714c89 expref: 18 pid: 103165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051296.587178:0:103165:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99da7d784e00, rc 0) 00000100:00100000:3.0:1777051296.587528:0:103165:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9351a01-5b0e-4470-97fd-58b9b4b312a2+18:6577:x1863365452543872:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 482us (648us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051296.587546:0:103165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1777051296.587821:0:6577:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955507100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452543872:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1777051296.587846:0:6577:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.146@tcp lock: ffff99d955a99400/0x85f51a6b96714c89 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b96714c90 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051296.587863:0:6577:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.146@tcp lock: ffff99d955a99400/0x85f51a6b96714c89 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x85f51a6b96714c90 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051296.587941:0:6577:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955507100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452544000:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1777051296.587991:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051296.588568:0:103163:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452544000 00000100:00100000:3.0:1777051296.588577:0:103163:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452544000 00000100:00100000:3.0:1777051296.588634:0:103163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1777051296.588650:0:103163:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9351a01-5b0e-4470-97fd-58b9b4b312a2+18:6577:x1863365452544000:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1777051296.588939:0:103163:0:(mgs_nids.c:912:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1777051296.588982:0:103163:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1777051296.588990:0:103163:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:3.0:1777051296.588996:0:103163:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:3.0:1777051296.589001:0:103163:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:3.0:1777051296.589005:0:103163:0:(mgs_nids.c:316:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 30 00000100:00100000:2.0:1777051296.589463:0:6577:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d94e566c00 going to sleep for 11 seconds 00000100:00100000:2.0:1777051296.589854:0:103163:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9351a01-5b0e-4470-97fd-58b9b4b312a2+18:6577:x1863365452544000:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 1206us (1860us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051296.589867:0:103163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1777051296.589928:0:6577:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955507100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452544000:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1777051296.590098:0:6577:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.201.146@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1777051296.590109:0:6577:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff99d955a99400/0x85f51a6b96714c89 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b96714c90 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051296.590124:0:6577:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.146@tcp lock: ffff99d955a99400/0x85f51a6b96714c89 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b96714c90 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1777051296.590145:0:6577:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:0.0:1777051296.590148:0:6577:0:(mgc_request.c:1799:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 59 10000000:01000000:0.0:1777051296.590152:0:6577:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1777051296.590180:0:6577:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.146@tcp lock: ffff99da713e3200/0x85f51a6b96714c97 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051296.590193:0:6577:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.146@tcp lock: ffff99da713e3200/0x85f51a6b96714c97 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051296.590227:0:6577:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.146@tcp lock: ffff99da713e3200/0x85f51a6b96714c97 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051296.590253:0:6577:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95f867b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452544128:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1777051296.590303:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051296.590342:0:6577:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d9565d4b40 going to sleep for 11 seconds 00000100:00100000:2.0:1777051296.590353:0:103169:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452544128 00000100:00100000:2.0:1777051296.590363:0:103169:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452544128 00000100:00100000:2.0:1777051296.590420:0:103169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1777051296.590434:0:103169:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f9351a01-5b0e-4470-97fd-58b9b4b312a2+18:6577:x1863365452544128:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1777051296.590447:0:103169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051296.590463:0:103169:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d955a98800/0x85f51a6b96714c9e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x85f51a6b96714c97 expref: -99 pid: 103169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051296.590491:0:103169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d955a98800/0x85f51a6b96714c9e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x85f51a6b96714c97 expref: 19 pid: 103169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051296.590507:0:103169:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d955a98800/0x85f51a6b96714c9e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b96714c97 expref: 19 pid: 103169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051296.590518:0:103169:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d955a98800, rc 0) 00000100:00100000:2.0:1777051296.590582:0:103169:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f9351a01-5b0e-4470-97fd-58b9b4b312a2+19:6577:x1863365452544128:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 150us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051296.590596:0:103169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1777051296.591528:0:6577:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95f867b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452544128:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1777051296.591548:0:6577:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.146@tcp lock: ffff99da713e3200/0x85f51a6b96714c97 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b96714c9e expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051296.591564:0:6577:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.146@tcp lock: ffff99da713e3200/0x85f51a6b96714c97 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x85f51a6b96714c9e expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051296.591638:0:6577:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95f867b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452544256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1777051296.591692:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051296.591739:0:103165:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452544256 00000100:00100000:3.0:1777051296.591749:0:103165:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452544256 00000100:00100000:1.0:1777051296.591818:0:6577:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d9565d4b40 going to sleep for 11 seconds 00000100:00100000:3.0:1777051296.591820:0:103165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1777051296.591843:0:103165:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9351a01-5b0e-4470-97fd-58b9b4b312a2+19:6577:x1863365452544256:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1777051296.592021:0:103165:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9351a01-5b0e-4470-97fd-58b9b4b312a2+19:6577:x1863365452544256:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 184us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051296.592033:0:103165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1777051296.592124:0:6577:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95f867b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452544256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1777051296.592174:0:6577:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94f519c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452544384:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1777051296.592239:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051296.592419:0:6577:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d95d7c4300 going to sleep for 11 seconds 00000100:00100000:2.0:1777051296.592442:0:103163:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452544384 00000100:00100000:2.0:1777051296.592453:0:103163:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452544384 00000100:00100000:2.0:1777051296.592504:0:103163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1777051296.592518:0:103163:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942d2ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9351a01-5b0e-4470-97fd-58b9b4b312a2+19:6577:x1863365452544384:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1777051296.594779:0:103163:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942d2ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9351a01-5b0e-4470-97fd-58b9b4b312a2+19:6577:x1863365452544384:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 2261us (2538us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051296.594793:0:103163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1777051296.594937:0:6577:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94f519c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452544384:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1777051296.597525:0:103266:0:(llog.c:858:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 64768 count 58 00000020:01000000:2.0:1777051296.597655:0:6577:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 59-58 (rc=0) 10000000:01000000:2.0:1777051296.597695:0:6577:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.201.146@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1777051296.597707:0:6577:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff99da713e3200/0x85f51a6b96714c97 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b96714c9e expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051296.597724:0:6577:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.146@tcp lock: ffff99da713e3200/0x85f51a6b96714c97 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b96714c9e expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1777051296.597737:0:6577:0:(mgc_request.c:611:do_requeue()) updating log lustre-barrier 10000000:01000000:2.0:1777051296.597741:0:6577:0:(mgc_request.c:1799:mgc_process_log()) Process log lustre-barrier-ffff99da57ae9000 from 1 10000000:01000000:2.0:1777051296.597746:0:6577:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1777051296.598111:0:6577:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.146@tcp lock: ffff99d955a99c00/0x85f51a6b96714ca5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051296.598126:0:6577:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.146@tcp lock: ffff99d955a99c00/0x85f51a6b96714ca5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051296.598437:0:6577:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.146@tcp lock: ffff99d955a99c00/0x85f51a6b96714ca5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051296.598493:0:6577:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955505880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452544512:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1777051296.598544:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051296.598584:0:6577:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d95d7cab40 going to sleep for 11 seconds 00000100:00100000:1.0:1777051296.598990:0:103166:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452544512 00000100:00100000:1.0:1777051296.598999:0:103166:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452544512 00000100:00100000:1.0:1777051296.599040:0:103166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1777051296.599051:0:103166:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942d2b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9351a01-5b0e-4470-97fd-58b9b4b312a2+19:6577:x1863365452544512:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1777051296.599065:0:103166:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777051296.599109:0:103166:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d9442eb600/0x85f51a6b96714cac lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x85f51a6b96714ca5 expref: -99 pid: 103166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051296.599134:0:103166:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d9442eb600/0x85f51a6b96714cac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x85f51a6b96714ca5 expref: 20 pid: 103166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051296.599145:0:103166:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d9442eb600/0x85f51a6b96714cac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b96714ca5 expref: 20 pid: 103166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051296.599155:0:103166:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d9442eb600, rc 0) 00000100:00100000:1.0:1777051296.599257:0:103166:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942d2b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9351a01-5b0e-4470-97fd-58b9b4b312a2+20:6577:x1863365452544512:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 205us (712us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051296.599268:0:103166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1777051296.599502:0:6577:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955505880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452544512:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1777051296.599539:0:6577:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.146@tcp lock: ffff99d955a99c00/0x85f51a6b96714ca5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b96714cac expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051296.599555:0:6577:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.146@tcp lock: ffff99d955a99c00/0x85f51a6b96714ca5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x85f51a6b96714cac expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1777051296.599573:0:6577:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.201.146@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1777051296.599579:0:6577:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff99d955a99c00/0x85f51a6b96714ca5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b96714cac expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051296.599597:0:6577:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.146@tcp lock: ffff99d955a99c00/0x85f51a6b96714ca5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b96714cac expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1777051296.599609:0:6577:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1777051296.599612:0:6577:0:(mgc_request.c:1799:mgc_process_log()) Process log nodemap-ffff99da70a599c0 from 1 10000000:01000000:2.0:1777051296.599616:0:6577:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1777051296.599641:0:6577:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.146@tcp lock: ffff99d955a98c00/0x85f51a6b96714cb3 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051296.599653:0:6577:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.146@tcp lock: ffff99d955a98c00/0x85f51a6b96714cb3 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051296.599665:0:6577:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.146@tcp lock: ffff99d955a98c00/0x85f51a6b96714cb3 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051296.599688:0:6577:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955505880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452544640:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1777051296.599732:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051296.599772:0:6577:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d95d7cab40 going to sleep for 11 seconds 00000100:00100000:3.0:1777051296.599815:0:103165:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452544640 00000100:00100000:3.0:1777051296.599825:0:103165:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452544640 00000100:00100000:3.0:1777051296.599888:0:103165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1777051296.599902:0:103165:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942d2a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9351a01-5b0e-4470-97fd-58b9b4b312a2+20:6577:x1863365452544640:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1777051296.599915:0:103165:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777051296.599931:0:103165:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99da7d785000/0x85f51a6b96714cba lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x85f51a6b96714cb3 expref: -99 pid: 103165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051296.599958:0:103165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99da7d785000/0x85f51a6b96714cba lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x85f51a6b96714cb3 expref: 21 pid: 103165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051296.599973:0:103165:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99da7d785000/0x85f51a6b96714cba lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b96714cb3 expref: 21 pid: 103165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051296.599985:0:103165:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99da7d785000, rc 0) 00000100:00100000:3.0:1777051296.600061:0:103165:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942d2a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9351a01-5b0e-4470-97fd-58b9b4b312a2+21:6577:x1863365452544640:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 162us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051296.600100:0:103165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1777051296.600148:0:6577:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955505880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452544640:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1777051296.600186:0:6577:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.146@tcp lock: ffff99d955a98c00/0x85f51a6b96714cb3 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b96714cba expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051296.600201:0:6577:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.146@tcp lock: ffff99d955a98c00/0x85f51a6b96714cb3 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x85f51a6b96714cba expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1777051296.600222:0:6577:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.201.146@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1777051296.600229:0:6577:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff99d955a98c00/0x85f51a6b96714cb3 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b96714cba expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051296.600241:0:6577:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.146@tcp lock: ffff99d955a98c00/0x85f51a6b96714cb3 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b96714cba expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1777051296.600252:0:6577:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1777051296.600255:0:6577:0:(mgc_request.c:1799:mgc_process_log()) Process log params-ffff99da57ae9000 from 43 10000000:01000000:1.0:1777051296.600259:0:6577:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1777051296.600282:0:6577:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.146@tcp lock: ffff99d9442ea200/0x85f51a6b96714cc1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051296.600304:0:6577:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.146@tcp lock: ffff99d9442ea200/0x85f51a6b96714cc1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051296.600314:0:6577:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.146@tcp lock: ffff99d9442ea200/0x85f51a6b96714cc1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051296.600335:0:6577:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94f519c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452544768:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1777051296.600376:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051296.600408:0:6577:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d9593a1f00 going to sleep for 11 seconds 00000100:00100000:0.0:1777051296.600475:0:103163:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452544768 00000100:00100000:0.0:1777051296.600485:0:103163:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452544768 00000100:00100000:1.0:1777051296.600777:0:103163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1777051296.600791:0:103163:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942d2a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9351a01-5b0e-4470-97fd-58b9b4b312a2+21:6577:x1863365452544768:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1777051296.600804:0:103163:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777051296.600818:0:103163:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d9442ea000/0x85f51a6b96714cc8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x85f51a6b96714cc1 expref: -99 pid: 103163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051296.600842:0:103163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d9442ea000/0x85f51a6b96714cc8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x85f51a6b96714cc1 expref: 22 pid: 103163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051296.600856:0:103163:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d9442ea000/0x85f51a6b96714cc8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b96714cc1 expref: 22 pid: 103163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051296.600867:0:103163:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d9442ea000, rc 0) 00000100:00100000:1.0:1777051296.600930:0:103163:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942d2a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9351a01-5b0e-4470-97fd-58b9b4b312a2+22:6577:x1863365452544768:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 142us (553us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051296.600940:0:103163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1777051296.601097:0:6577:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94f519c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452544768:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1777051296.601115:0:6577:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.146@tcp lock: ffff99d9442ea200/0x85f51a6b96714cc1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b96714cc8 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051296.601128:0:6577:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.146@tcp lock: ffff99d9442ea200/0x85f51a6b96714cc1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x85f51a6b96714cc8 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051296.601430:0:6577:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955505880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452544896:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1777051296.601471:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051296.601518:0:6577:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d95d7cab40 going to sleep for 11 seconds 00000100:00100000:0.0:1777051296.601576:0:103168:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452544896 00000100:00100000:0.0:1777051296.601586:0:103168:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452544896 00000100:00100000:0.0:1777051296.601641:0:103168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1777051296.601653:0:103168:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942d29850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f9351a01-5b0e-4470-97fd-58b9b4b312a2+22:6577:x1863365452544896:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1777051296.601777:0:103168:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942d29850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f9351a01-5b0e-4470-97fd-58b9b4b312a2+22:6577:x1863365452544896:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 125us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051296.601790:0:103168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1777051296.601843:0:6577:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955505880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452544896:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1777051296.601889:0:6577:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955505880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452545024:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1777051296.601949:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051296.601991:0:6577:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d95d7cab40 going to sleep for 11 seconds 00000100:00100000:3.0:1777051296.602027:0:103169:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452545024 00000100:00100000:3.0:1777051296.602035:0:103169:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452545024 00000100:00100000:3.0:1777051296.602114:0:103169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1777051296.602127:0:103169:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942d28c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f9351a01-5b0e-4470-97fd-58b9b4b312a2+22:6577:x1863365452545024:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1777051296.602243:0:103169:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942d28c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f9351a01-5b0e-4470-97fd-58b9b4b312a2+22:6577:x1863365452545024:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 118us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051296.602256:0:103169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1777051296.602380:0:6577:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955505880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452545024:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1777051296.604562:0:103267:0:(llog.c:858:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 43 00000020:01000000:2.0:1777051296.604774:0:6577:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 43-42 (rc=0) 10000000:01000000:2.0:1777051296.604801:0:6577:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.201.146@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1777051296.604811:0:6577:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff99d9442ea200/0x85f51a6b96714cc1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b96714cc8 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051296.604826:0:6577:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.146@tcp lock: ffff99d9442ea200/0x85f51a6b96714cc1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b96714cc8 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1777051296.604838:0:6577:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1777051296.604842:0:6577:0:(mgc_request.c:1799:mgc_process_log()) Process log lustre-sptlrpc-ffff99da70a599c0 from 1 10000000:01000000:2.0:1777051296.604846:0:6577:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1777051296.604874:0:6577:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.146@tcp lock: ffff99d955a99800/0x85f51a6b96714ccf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051296.604887:0:6577:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.146@tcp lock: ffff99d955a99800/0x85f51a6b96714ccf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051296.604900:0:6577:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.146@tcp lock: ffff99d955a99800/0x85f51a6b96714ccf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051296.604923:0:6577:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955505880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452545152:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1777051296.604990:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051296.605037:0:6577:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da50d449c0 going to sleep for 11 seconds 00000100:00100000:1.0:1777051296.605420:0:103163:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452545152 00000100:00100000:1.0:1777051296.605429:0:103163:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452545152 00000100:00100000:1.0:1777051296.605555:0:103163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1777051296.605568:0:103163:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942d28050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9351a01-5b0e-4470-97fd-58b9b4b312a2+22:6577:x1863365452545152:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1777051296.605581:0:103163:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777051296.605594:0:103163:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d9442ea600/0x85f51a6b96714cd6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x85f51a6b96714ccf expref: -99 pid: 103163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051296.605620:0:103163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d9442ea600/0x85f51a6b96714cd6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x85f51a6b96714ccf expref: 23 pid: 103163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051296.605634:0:103163:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d9442ea600/0x85f51a6b96714cd6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b96714ccf expref: 23 pid: 103163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051296.605646:0:103163:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d9442ea600, rc 0) 00000100:00100000:1.0:1777051296.605699:0:103163:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942d28050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9351a01-5b0e-4470-97fd-58b9b4b312a2+23:6577:x1863365452545152:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 134us (709us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051296.605708:0:103163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1777051296.605766:0:6577:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955505880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452545152:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1777051296.605790:0:6577:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.146@tcp lock: ffff99d955a99800/0x85f51a6b96714ccf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b96714cd6 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051296.605809:0:6577:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.146@tcp lock: ffff99d955a99800/0x85f51a6b96714ccf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x85f51a6b96714cd6 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051296.605907:0:6577:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95f867b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452545280:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1777051296.605951:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051296.608692:0:6577:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d94e566c00 going to sleep for 11 seconds 00000100:00100000:3.0:1777051296.609971:0:103165:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452545280 00000100:00100000:3.0:1777051296.609980:0:103165:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452545280 00000100:00100000:3.0:1777051296.610045:0:103165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1777051296.610056:0:103165:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f345450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9351a01-5b0e-4470-97fd-58b9b4b312a2+23:6577:x1863365452545280:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1777051296.610174:0:103165:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f345450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9351a01-5b0e-4470-97fd-58b9b4b312a2+23:6577:x1863365452545280:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 119us (4222us total) trans 0 rc -2/-2 00000100:00100000:3.0:1777051296.610184:0:103165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1777051296.610510:0:6577:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95f867b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452545280:0@lo:501:ll_cfg_requeue.0 10000000:01000000:0.0:1777051296.610582:0:6577:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.201.146@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1777051296.610593:0:6577:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff99d955a99800/0x85f51a6b96714ccf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b96714cd6 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051296.610608:0:6577:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.146@tcp lock: ffff99d955a99800/0x85f51a6b96714ccf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b96714cd6 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051296.854848:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1777051297.304308:0:103189:0:(llog.c:858:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1777051297.700232:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051297.700315:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051297.700383:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051297.700424:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051297.700482:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051297.700503:0:6579:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425868800 00000100:00100000:3.0:1777051297.700520:0:6579:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425868800 00000100:00100000:0.0:1777051297.700539:0:27882:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425869312 00000100:00100000:0.0:1777051297.700552:0:27882:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425869312 00000100:00100000:3.0:1777051297.700584:0:6579:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425869440 00000100:00100000:3.0:1777051297.700592:0:6579:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425869440 00000100:00100000:0.0:1777051297.700621:0:27882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111719 00000100:00100000:0.0:1777051297.700637:0:27882:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f867b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0+-99:2435:x1863365425868800:12345-192.168.201.46@tcp:38:kworker.0 00000100:00100000:3.0:1777051297.700673:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13168 00010000:00080000:0.0:1777051297.700680:0:27882:0:(ldlm_lib.c:926:target_handle_reconnect()) connect export for UUID 'c11b6966-0775-44d2-bdc6-c74c26eb2226' at ffff99d941c41000, cookie 0x85f51a6b96714b6a 00000100:00100000:3.0:1777051297.700695:0:6579:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da444a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+48:2438:x1863365425869440:12345-192.168.201.46@tcp:400:kworker.0 00010000:00080000:0.0:1777051297.700698:0:27882:0:(ldlm_lib.c:1431:target_handle_connect()) lustre-MDT0000: connection from c11b6966-0775-44d2-bdc6-c74c26eb2226@192.168.201.46@tcp recovering/t8590016948 exp ffff99d941c41000 cur 7926 last 1777051295 00010000:02000400:0.0:1777051297.700722:0:27882:0:(ldlm_lib.c:2022:target_start_recovery_timer()) lustre-MDT0000: Will be in recovery for at least 1:00, or until 3 clients reconnect 00000100:00100000:3.0:1777051297.700832:0:6579:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da444a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+48:2438:x1863365425869440:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 143us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051297.700846:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13168 00000100:00100000:3.0:1777051297.700879:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111720 00000100:00100000:3.0:1777051297.700888:0:6579:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da444a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2435:x1863365425869312:12345-192.168.201.46@tcp:38:kworker.0 00010000:00080000:3.0:1777051297.700913:0:6579:0:(ldlm_lib.c:926:target_handle_reconnect()) connect export for UUID '2dd4696c-edce-4cd1-86d2-dbd2ff957fa1' at ffff99d941c41800, cookie 0x85f51a6b96714b63 00010000:00080000:3.0:1777051297.700923:0:6579:0:(ldlm_lib.c:1431:target_handle_connect()) lustre-MDT0000: connection from 2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp recovering/t8590016949 exp ffff99d941c41800 cur 7926 last 1777051295 00010000:00080000:3.0:1777051297.700938:0:6579:0:(ldlm_lib.c:2086:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 70 seconds 00000004:00100000:3.0:1777051297.700974:0:6579:0:(mdt_handler.c:7281:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type b7, return b7 00000100:00080000:2.0:1777051297.701139:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1777051297.701173:0:24468:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425869056 00000100:00100000:2.0:1777051297.701184:0:24468:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425869056 00000100:00100000:2.0:1777051297.701294:0:24468:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425869696 00000100:00100000:2.0:1777051297.701302:0:24468:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425869696 00000100:00080000:3.0:1777051297.701337:0:6579:0:(import.c:65:import_set_state_nolock()) ffff99da7b5fd800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1777051297.701356:0:24468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10240 00000100:00100000:2.0:1777051297.701376:0:24468:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da444a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+50:2438:x1863365425869056:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:3.0:1777051297.701409:0:6579:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da444a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+6:2435:x1863365425869312:12345-192.168.201.46@tcp:38:kworker.0 Request processed in 514us (1090us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051297.701425:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111720 00000100:00100000:2.0:1777051297.701454:0:24468:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da444a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+50:2438:x1863365425869056:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 81us (1067us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051297.701471:0:24468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10240 00000100:00100000:2.0:1777051297.701504:0:24468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10241 00000100:00100000:2.0:1777051297.701522:0:24468:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da444a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+47:2438:x1863365425869696:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:2.0:1777051297.701578:0:24468:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da444a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+47:2438:x1863365425869696:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 61us (1095us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051297.701592:0:24468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10241 00000100:00080000:2.0:1777051297.701640:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1777051297.701649:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1777051297.710128:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051297.710249:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051297.710278:0:21368:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425868928 00000100:00100000:3.0:1777051297.710300:0:21368:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425868928 00000100:00100000:1.0:1777051297.710323:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051297.710378:0:8471:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425869184 00000100:00100000:1.0:1777051297.710389:0:8471:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425869184 00000100:00100000:1.0:1777051297.710471:0:8471:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425869568 00000100:00100000:1.0:1777051297.710477:0:8471:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425869568 00000100:00100000:1.0:1777051297.710515:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10242 00000100:00100000:1.0:1777051297.710529:0:8471:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f519f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+48:2439:x1863365425869184:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:1.0:1777051297.710617:0:8471:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f519f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+48:2439:x1863365425869184:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 88us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051297.710630:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10242 00000100:00100000:1.0:1777051297.710656:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10243 00000100:00100000:1.0:1777051297.710667:0:8471:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95fae8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+50:2439:x1863365425869568:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:1.0:1777051297.710711:0:8471:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95fae8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+50:2439:x1863365425869568:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 44us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051297.710723:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10243 00000100:00080000:1.0:1777051297.710794:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1777051297.710801:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1777051297.710942:0:21368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13169 00000100:00100000:3.0:1777051297.710962:0:21368:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f519c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+6:2439:x1863365425868928:12345-192.168.201.46@tcp:400:kworker.0 00000100:00080000:1.0:1777051297.711022:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1777051297.711130:0:21368:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f519c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+6:2439:x1863365425868928:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 165us (1003us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051297.711145:0:21368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13169 00000100:00100000:1.0:1777051297.719481:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051297.719547:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051297.719596:0:46494:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425869824 00000100:00100000:3.0:1777051297.719612:0:46494:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425869824 00000100:00100000:1.0:1777051297.719624:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051297.719688:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051297.719710:0:46494:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425869952 00000100:00100000:3.0:1777051297.719719:0:46494:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425869952 00000100:00100000:1.0:1777051297.719751:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051297.719780:0:46494:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425870080 00000100:00100000:3.0:1777051297.719788:0:46494:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425870080 00000100:00100000:1.0:1777051297.719813:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051297.719851:0:46494:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425870208 00000100:00100000:3.0:1777051297.719860:0:46494:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425870208 00000100:00100000:1.0:1777051297.719884:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051297.719902:0:46494:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425870336 00000100:00100000:3.0:1777051297.719910:0:46494:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425870336 00000100:00100000:3.0:1777051297.719944:0:46494:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425870464 00000100:00100000:3.0:1777051297.719950:0:46494:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425870464 00000100:00100000:1.0:1777051297.719970:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051297.719981:0:46494:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425870592 00000100:00100000:3.0:1777051297.719987:0:46494:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425870592 00000100:00100000:3.0:1777051297.720020:0:46494:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425870720 00000100:00100000:3.0:1777051297.720024:0:46494:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425870720 00000100:00100000:1.0:1777051297.720041:0:27885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111721 00000100:00100000:1.0:1777051297.720103:0:27885:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94ed2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+13:2435:x1863365425869824:12345-192.168.201.46@tcp:101:ldlm_lock_repla.0 00000100:00100000:3.0:1777051297.720107:0:46494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111722 00000100:00100000:3.0:1777051297.720136:0:46494:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94ed2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+13:2435:x1863365425869952:12345-192.168.201.46@tcp:101:ldlm_lock_repla.0 00010000:00080000:1.0:1777051297.720153:0:27885:0:(ldlm_lib.c:3170:target_queue_recovery_request()) @@@ queue lock replay req req@ffff99d94ed2ea00 x1863365425869824/t0(0) o101->2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp:258/0 lens 328/0 e 0 to 0 dl 1777051308 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00080000:3.0:1777051297.720166:0:46494:0:(ldlm_lib.c:3170:target_queue_recovery_request()) @@@ queue lock replay req req@ffff99d94ed2dc00 x1863365425869952/t0(0) o101->2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp:258/0 lens 328/0 e 0 to 0 dl 1777051308 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1777051297.720252:0:27885:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94ed2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+13:2435:x1863365425869824:12345-192.168.201.46@tcp:101:ldlm_lock_repla.0 Request processed in 113us (734us total) trans 0 rc 0/-999 00000100:00100000:3.0:1777051297.720264:0:46494:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94ed2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+13:2435:x1863365425869952:12345-192.168.201.46@tcp:101:ldlm_lock_repla.0 Request processed in 131us (714us total) trans 0 rc 0/-999 00000100:00100000:1.0:1777051297.720279:0:27885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111721 00000100:00100000:3.0:1777051297.720294:0:46494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111722 00000100:00100000:1.0:1777051297.720315:0:27885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111723 00000100:00100000:3.0:1777051297.720330:0:46494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111724 00000100:00100000:1.0:1777051297.720339:0:27885:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94ed2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+13:2435:x1863365425870080:12345-192.168.201.46@tcp:101:ldlm_lock_repla.0 00000100:00100000:3.0:1777051297.720358:0:46494:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94ed2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+13:2435:x1863365425870208:12345-192.168.201.46@tcp:101:ldlm_lock_repla.0 00010000:00080000:1.0:1777051297.720364:0:27885:0:(ldlm_lib.c:3170:target_queue_recovery_request()) @@@ queue lock replay req req@ffff99d94ed2d880 x1863365425870080/t0(0) o101->2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp:258/0 lens 328/0 e 0 to 0 dl 1777051308 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00080000:3.0:1777051297.720387:0:46494:0:(ldlm_lib.c:3170:target_queue_recovery_request()) @@@ queue lock replay req req@ffff99d94ed2ed80 x1863365425870208/t0(0) o101->2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp:258/0 lens 328/0 e 0 to 0 dl 1777051308 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1777051297.720393:0:27885:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94ed2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+13:2435:x1863365425870080:12345-192.168.201.46@tcp:101:ldlm_lock_repla.0 Request processed in 61us (778us total) trans 0 rc 0/-999 00000100:00100000:1.0:1777051297.720424:0:27885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111723 00000100:00100000:3.0:1777051297.720436:0:46494:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94ed2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+13:2435:x1863365425870208:12345-192.168.201.46@tcp:101:ldlm_lock_repla.0 Request processed in 86us (747us total) trans 0 rc 0/-999 00000100:00100000:1.0:1777051297.720451:0:27885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111725 00000100:00100000:3.0:1777051297.720464:0:46494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111724 00000100:00100000:1.0:1777051297.720471:0:27885:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94ed2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+13:2435:x1863365425870336:12345-192.168.201.46@tcp:101:ldlm_lock_repla.0 00010000:00080000:1.0:1777051297.720493:0:27885:0:(ldlm_lib.c:3170:target_queue_recovery_request()) @@@ queue lock replay req req@ffff99d94ed2fb80 x1863365425870336/t0(0) o101->2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp:258/0 lens 328/0 e 0 to 0 dl 1777051308 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777051297.720506:0:46494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111726 00000100:00100000:1.0:1777051297.720528:0:27885:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94ed2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+13:2435:x1863365425870336:12345-192.168.201.46@tcp:101:ldlm_lock_repla.0 Request processed in 65us (780us total) trans 0 rc 0/-999 00000100:00100000:3.0:1777051297.720537:0:46494:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f65a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+13:2435:x1863365425870464:12345-192.168.201.46@tcp:101:ldlm_lock_repla.0 00000100:00100000:1.0:1777051297.720552:0:27885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111725 00010000:00080000:3.0:1777051297.720565:0:46494:0:(ldlm_lib.c:3170:target_queue_recovery_request()) @@@ queue lock replay req req@ffff99d95f65a300 x1863365425870464/t0(0) o101->2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp:258/0 lens 328/0 e 0 to 0 dl 1777051308 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1777051297.720584:0:27885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111727 00000100:00100000:3.0:1777051297.720595:0:46494:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f65a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+13:2435:x1863365425870464:12345-192.168.201.46@tcp:101:ldlm_lock_repla.0 Request processed in 66us (781us total) trans 0 rc 0/-999 00000100:00100000:1.0:1777051297.720609:0:27885:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f65ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+13:2435:x1863365425870592:12345-192.168.201.46@tcp:101:ldlm_lock_repla.0 00000100:00100000:3.0:1777051297.720614:0:46494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111726 00010000:00080000:1.0:1777051297.720640:0:27885:0:(ldlm_lib.c:3170:target_queue_recovery_request()) @@@ queue lock replay req req@ffff99d95f65ad80 x1863365425870592/t0(0) o101->2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp:258/0 lens 328/0 e 0 to 0 dl 1777051308 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777051297.720648:0:46494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111728 00000100:00100000:3.0:1777051297.720672:0:46494:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d9533bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+13:2435:x1863365425870720:12345-192.168.201.46@tcp:101:ldlm_lock_repla.0 00000100:00100000:1.0:1777051297.720705:0:27885:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f65ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+13:2435:x1863365425870592:12345-192.168.201.46@tcp:101:ldlm_lock_repla.0 Request processed in 104us (821us total) trans 0 rc 0/-999 00010000:00080000:3.0:1777051297.720708:0:46494:0:(ldlm_lib.c:3170:target_queue_recovery_request()) @@@ queue lock replay req req@ffff99d9533bea00 x1863365425870720/t0(0) o101->2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp:258/0 lens 328/0 e 0 to 0 dl 1777051308 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1777051297.720736:0:27885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111727 00000100:00100000:3.0:1777051297.720756:0:46494:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d9533bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+13:2435:x1863365425870720:12345-192.168.201.46@tcp:101:ldlm_lock_repla.0 Request processed in 88us (787us total) trans 0 rc 0/-999 00000100:00100000:3.0:1777051297.720770:0:46494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111728 00010000:00080000:1.0:1777051297.720823:0:103199:0:(ldlm_lib.c:2531:check_for_recovery_ready()) connected 1 stale 0 max_recoverable_clients 3 abort 0 expired 0 00000004:00100000:0.0:1777051297.721118:0:27882:0:(mdt_handler.c:7281:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type b7, return b7 00000100:00080000:0.0:1777051297.721184:0:27882:0:(import.c:65:import_set_state_nolock()) ffff99d944c1a000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1777051297.721328:0:27882:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f867b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+6:2435:x1863365425868800:12345-192.168.201.46@tcp:38:kworker.0 Request processed in 20690us (21133us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051297.721341:0:27882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111719 00000100:00100000:1.0:1777051297.732587:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051297.732664:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051297.733436:0:27885:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425870848 00000100:00100000:3.0:1777051297.733452:0:27885:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425870848 00000100:00100000:3.0:1777051297.733534:0:27885:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425870976 00000100:00100000:3.0:1777051297.733541:0:27885:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425870976 00000100:00100000:3.0:1777051297.733583:0:27885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111729 00000100:00100000:3.0:1777051297.733623:0:27885:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d9533bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c11b6966-0775-44d2-bdc6-c74c26eb2226+7:2435:x1863365425870848:12345-192.168.201.46@tcp:101:ldlm_lock_repla.0 00010000:00080000:3.0:1777051297.733666:0:27885:0:(ldlm_lib.c:3170:target_queue_recovery_request()) @@@ queue lock replay req req@ffff99d9533bc380 x1863365425870848/t0(0) o101->c11b6966-0775-44d2-bdc6-c74c26eb2226@192.168.201.46@tcp:258/0 lens 328/0 e 0 to 0 dl 1777051308 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777051297.733699:0:27885:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d9533bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c11b6966-0775-44d2-bdc6-c74c26eb2226+7:2435:x1863365425870848:12345-192.168.201.46@tcp:101:ldlm_lock_repla.0 Request processed in 105us (1125us total) trans 0 rc 0/-999 00000100:00100000:3.0:1777051297.733711:0:27885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111729 00000100:00100000:3.0:1777051297.733733:0:27885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111730 00000100:00100000:3.0:1777051297.733747:0:27885:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fdf2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c11b6966-0775-44d2-bdc6-c74c26eb2226+7:2435:x1863365425870976:12345-192.168.201.46@tcp:101:ldlm_lock_repla.0 00010000:00080000:3.0:1777051297.733765:0:27885:0:(ldlm_lib.c:3170:target_queue_recovery_request()) @@@ queue lock replay req req@ffff99da7fdf2a00 x1863365425870976/t0(0) o101->c11b6966-0775-44d2-bdc6-c74c26eb2226@192.168.201.46@tcp:258/0 lens 328/0 e 0 to 0 dl 1777051308 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777051297.733786:0:27885:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fdf2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c11b6966-0775-44d2-bdc6-c74c26eb2226+7:2435:x1863365425870976:12345-192.168.201.46@tcp:101:ldlm_lock_repla.0 Request processed in 41us (1123us total) trans 0 rc 0/-999 00000100:00100000:3.0:1777051297.733797:0:27885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111730 00010000:00080000:3.0:1777051297.733829:0:103199:0:(ldlm_lib.c:2531:check_for_recovery_ready()) connected 2 stale 0 max_recoverable_clients 3 abort 0 expired 0 00000100:00100000:1.0:1777051297.733992:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051297.734098:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051297.734164:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051297.734339:0:21368:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425871104 00000100:00100000:3.0:1777051297.734349:0:21368:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425871104 00000100:00100000:1.0:1777051297.734380:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051297.734423:0:21368:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425871232 00000100:00100000:0.0:1777051297.734429:0:46497:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425871360 00000100:00100000:3.0:1777051297.734433:0:21368:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425871232 00000100:00100000:0.0:1777051297.734442:0:46497:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425871360 00000100:00100000:1.0:1777051297.734485:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051297.734490:0:21368:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425871488 00000100:00100000:3.0:1777051297.734499:0:21368:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425871488 00000100:00100000:0.0:1777051297.734526:0:46497:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425871616 00000100:00100000:0.0:1777051297.734537:0:46497:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425871616 00000100:00100000:3.0:1777051297.734563:0:21368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111731 00000100:00100000:3.0:1777051297.734585:0:21368:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fdf2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+12:2435:x1863365425871104:12345-192.168.201.46@tcp:101:ldlm_lock_repla.0 00000100:00100000:1.0:1777051297.734599:0:27882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111732 00010000:00080000:3.0:1777051297.734614:0:21368:0:(ldlm_lib.c:3170:target_queue_recovery_request()) @@@ queue lock replay req req@ffff99da7fdf2300 x1863365425871104/t0(0) o101->c11b6966-0775-44d2-bdc6-c74c26eb2226@192.168.201.46@tcp:258/0 lens 328/0 e 0 to 0 dl 1777051308 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1777051297.734629:0:46497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111733 00000100:00100000:1.0:1777051297.734632:0:27882:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fdf2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+12:2435:x1863365425871232:12345-192.168.201.46@tcp:101:ldlm_lock_repla.0 00000100:00100000:0.0:1777051297.734663:0:46497:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fdf1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:c11b6966-0775-44d2-bdc6-c74c26eb2226+12:2435:x1863365425871360:12345-192.168.201.46@tcp:101:ldlm_lock_repla.0 00010000:00080000:1.0:1777051297.734669:0:27882:0:(ldlm_lib.c:3170:target_queue_recovery_request()) @@@ queue lock replay req req@ffff99da7fdf2680 x1863365425871232/t0(0) o101->c11b6966-0775-44d2-bdc6-c74c26eb2226@192.168.201.46@tcp:258/0 lens 328/0 e 0 to 0 dl 1777051308 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00080000:0.0:1777051297.735044:0:46497:0:(ldlm_lib.c:3170:target_queue_recovery_request()) @@@ queue lock replay req req@ffff99da7fdf1180 x1863365425871360/t0(0) o101->c11b6966-0775-44d2-bdc6-c74c26eb2226@192.168.201.46@tcp:258/0 lens 328/0 e 0 to 0 dl 1777051308 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777051297.735079:0:21368:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fdf2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+12:2435:x1863365425871104:12345-192.168.201.46@tcp:101:ldlm_lock_repla.0 Request processed in 470us (2019us total) trans 0 rc 0/-999 00000100:00100000:3.0:1777051297.735116:0:21368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111731 00000100:00100000:3.0:1777051297.735458:0:21368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111734 00000100:00100000:0.0:1777051297.735464:0:46497:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fdf1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:c11b6966-0775-44d2-bdc6-c74c26eb2226+12:2435:x1863365425871360:12345-192.168.201.46@tcp:101:ldlm_lock_repla.0 Request processed in 804us (1291us total) trans 0 rc 0/-999 00000100:00100000:3.0:1777051297.735482:0:21368:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94c12bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+12:2435:x1863365425871488:12345-192.168.201.46@tcp:101:ldlm_lock_repla.0 00000100:00100000:0.0:1777051297.735486:0:46497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111733 00010000:00080000:3.0:1777051297.735511:0:21368:0:(ldlm_lib.c:3170:target_queue_recovery_request()) @@@ queue lock replay req req@ffff99d94c12bb80 x1863365425871488/t0(0) o101->c11b6966-0775-44d2-bdc6-c74c26eb2226@192.168.201.46@tcp:258/0 lens 328/0 e 0 to 0 dl 1777051308 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1777051297.735528:0:46497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111735 00000100:00100000:0.0:1777051297.735558:0:46497:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7c9a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:c11b6966-0775-44d2-bdc6-c74c26eb2226+12:2435:x1863365425871616:12345-192.168.201.46@tcp:101:ldlm_lock_repla.0 00000100:00100000:3.0:1777051297.735560:0:21368:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94c12bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+12:2435:x1863365425871488:12345-192.168.201.46@tcp:101:ldlm_lock_repla.0 Request processed in 85us (1181us total) trans 0 rc 0/-999 00000100:00100000:3.0:1777051297.735581:0:21368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111734 00010000:00080000:0.0:1777051297.735593:0:46497:0:(ldlm_lib.c:3170:target_queue_recovery_request()) @@@ queue lock replay req req@ffff99da7c9a1f80 x1863365425871616/t0(0) o101->c11b6966-0775-44d2-bdc6-c74c26eb2226@192.168.201.46@tcp:258/0 lens 328/0 e 0 to 0 dl 1777051308 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1777051297.735618:0:46497:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7c9a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:c11b6966-0775-44d2-bdc6-c74c26eb2226+12:2435:x1863365425871616:12345-192.168.201.46@tcp:101:ldlm_lock_repla.0 Request processed in 71us (1138us total) trans 0 rc 0/-999 00010000:00080000:3.0:1777051297.735631:0:103199:0:(ldlm_lib.c:2531:check_for_recovery_ready()) connected 2 stale 0 max_recoverable_clients 3 abort 0 expired 0 00000100:00100000:0.0:1777051297.735635:0:46497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111735 00000100:00100000:1.0:1777051297.736569:0:27882:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fdf2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+12:2435:x1863365425871232:12345-192.168.201.46@tcp:101:ldlm_lock_repla.0 Request processed in 1952us (2472us total) trans 0 rc 0/-999 00000100:00100000:1.0:1777051297.736584:0:27882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111732 00010000:00080000:3.0:1777051297.739447:0:103199:0:(ldlm_lib.c:2531:check_for_recovery_ready()) connected 2 stale 0 max_recoverable_clients 3 abort 0 expired 0 00010000:00010000:1.0:1777051297.880291:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051298.902623:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1777051299.491834:0:103432:0:(debug.c:645:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg146-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1777051299.927142:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1777051300.419963:0:103486:0:(tgt_mount.c:2297:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1777051300.420734:0:103486:0:(tgt_mount.c:2312:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1777051300.631561:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955507100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452545408:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1777051300.631657:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051300.631745:0:3679:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1777051300.631772:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da444a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452545536:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1777051300.631895:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051300.631967:0:46498:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452545408 00000100:00100000:2.0:1777051300.631977:0:46498:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452545408 00000100:00100000:2.0:1777051300.632078:0:46498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8019 00000100:00100000:2.0:1777051300.632099:0:46498:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955505880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+6:3679:x1863365452545408:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1777051300.632147:0:46498:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4243456 pending 0 free 1446064128 avail 1299824640 00000100:00100000:2.0:1777051300.632261:0:46498:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955505880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+6:3679:x1863365452545408:12345-0@lo:41:osp-pre-1-0.0 Request processed in 168us (605us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051300.632275:0:46498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8019 00000100:00100000:2.0:1777051300.632348:0:47388:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452545536 00000100:00100000:2.0:1777051300.632356:0:47388:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452545536 00000100:00100000:2.0:1777051300.632440:0:47388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5556 00000100:00100000:2.0:1777051300.632454:0:47388:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d956128000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3679:x1863365452545536:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1777051300.632486:0:47388:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 430294336 pending 0 free 3645853696 avail 3414331392 00000100:00100000:2.0:1777051300.632548:0:47388:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d956128000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3679:x1863365452545536:12345-0@lo:13:osp-pre-1-1.0 Request processed in 95us (653us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051300.632560:0:47388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5556 00000100:00080000:2.0:1777051300.632606:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1777051300.632837:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da444a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452545536:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1777051300.632860:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955507100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452545408:0@lo:41:osp-pre-1-0.0 00000100:00080000:2.0:1777051300.632961:0:48457:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1777051300.632969:0:48457:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1777051300.632975:0:48457:0:(import.c:65:import_set_state_nolock()) ffff99da7dbeb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1777051300.632989:0:48457:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff99da7dbeb000 using connection 192.168.201.146@tcp/0@lo 00000100:00100000:2.0:1777051300.633424:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d956129c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3677:1863365452545664:0@lo:400:kworker.0 00000100:00100000:2.0:1777051300.633481:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051300.633558:0:103169:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452545664 00000100:00100000:0.0:1777051300.633568:0:103169:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452545664 00000100:00100000:2.0:1777051300.633575:0:48457:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d95612b800 x1863365452545792/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1777051300.633613:0:48457:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1777051300.633620:0:48457:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1777051300.633624:0:48457:0:(import.c:65:import_set_state_nolock()) ffff99da7fa93000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1777051300.633635:0:48457:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff99da7fa93000 using connection 192.168.201.146@tcp/0@lo 00000100:00100000:0.0:1777051300.633640:0:103169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1777051300.633661:0:103169:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f345050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f9351a01-5b0e-4470-97fd-58b9b4b312a2+23:3677:x1863365452545664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777051300.633669:0:48457:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d955507100 x1863365452545920/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1777051300.633689:0:48457:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1777051300.633695:0:48457:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1777051300.633698:0:48457:0:(import.c:65:import_set_state_nolock()) ffff99d94183b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1777051300.633981:0:48457:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff99d94183b000 using connection 192.168.201.146@tcp/0@lo 00000100:00100000:0.0:1777051300.634055:0:103169:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f345050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f9351a01-5b0e-4470-97fd-58b9b4b312a2+23:3677:x1863365452545664:12345-0@lo:400:kworker.0 Request processed in 400us (572us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051300.634069:0:103169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1777051300.634480:0:48457:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99da5f9bd180 x1863365452546048/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1777051300.634555:0:48457:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1777051300.634562:0:48457:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1777051300.634566:0:48457:0:(import.c:65:import_set_state_nolock()) ffff99da5f282000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1777051300.634577:0:48457:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff99da5f282000 using connection 192.168.201.146@tcp/0@lo 00000100:00100000:0.0:1777051300.634589:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f9bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3678:1863365452546176:0@lo:400:kworker.0 00000100:00100000:2.0:1777051300.634640:0:48457:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99da5f9bdf80 x1863365452546432/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1777051300.634660:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051300.634716:0:3678:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00080000:2.0:1777051300.634726:0:48457:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1777051300.634732:0:48457:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1777051300.634736:0:48457:0:(import.c:65:import_set_state_nolock()) ffff99da7b5fd000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1777051300.634745:0:48457:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff99da7b5fd000 using connection 192.168.201.146@tcp/0@lo 00000100:00100000:0.0:1777051300.634767:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f9bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3678:1863365452546816:0@lo:400:kworker.0 00000100:00100000:2.0:1777051300.634768:0:48457:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99da5f9bca80 x1863365452546944/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1777051300.634820:0:3676:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95612b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3676:1863365452545792:0@lo:38:kworker.0 00000100:00100000:0.0:1777051300.634835:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051300.634884:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f9bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3678:1863365452546688:0@lo:400:kworker.0 00000100:00100000:2.0:1777051300.634884:0:3676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051300.634926:0:3676:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955507100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3676:1863365452545920:0@lo:38:kworker.0 00000100:00100000:2.0:1777051300.634985:0:3676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051300.634992:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051300.635064:0:3676:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f9bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3676:1863365452546048:0@lo:38:kworker.0 00000100:00100000:2.0:1777051300.635113:0:3676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051300.635138:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f9bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3680:1863365452546560:0@lo:400:kworker.0 00000100:00100000:0.0:1777051300.635147:0:21368:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452546176 00000100:00100000:0.0:1777051300.635157:0:21368:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452546176 00000100:00100000:2.0:1777051300.635157:0:3676:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f9bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3676:1863365452546432:0@lo:38:kworker.0 00000100:00100000:0.0:1777051300.635234:0:21368:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452545920 00000100:00100000:0.0:1777051300.635242:0:21368:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452545920 00000100:00100000:0.0:1777051300.635271:0:21368:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452546048 00000100:00100000:0.0:1777051300.635277:0:21368:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452546048 00000100:00100000:0.0:1777051300.635359:0:21368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13170 00000100:00100000:0.0:1777051300.635375:0:21368:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da444a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3678:x1863365452546176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777051300.635410:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d956129c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3677:1863365452545664:0@lo:400:kworker.0 00000100:00100000:1.0:1777051300.635485:0:24468:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452546816 00000100:00100000:1.0:1777051300.635491:0:24468:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452546816 00000100:00100000:1.0:1777051300.635528:0:24468:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452546688 00000100:00100000:1.0:1777051300.635531:0:24468:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452546688 00000100:00100000:1.0:1777051300.635561:0:24468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10244 00000100:00100000:1.0:1777051300.635572:0:24468:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d950264380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3678:x1863365452546816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051300.635643:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051300.636516:0:3676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051300.636560:0:3676:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f9bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3676:1863365452546944:0@lo:38:kworker.0 00000100:00100000:0.0:1777051300.636576:0:21368:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da444a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3678:x1863365452546176:12345-0@lo:400:kworker.0 Request processed in 1201us (1920us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051300.636593:0:21368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13170 00000100:00100000:3.0:1777051300.636608:0:3680:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1777051300.636622:0:3676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051300.636627:0:21368:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452546560 00000100:00100000:3.0:1777051300.636628:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f9bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3680:1863365452546304:0@lo:400:kworker.0 00000100:00100000:0.0:1777051300.636636:0:21368:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452546560 00000100:00100000:3.0:1777051300.636694:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051300.636699:0:21368:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452546432 00000100:00100000:0.0:1777051300.636706:0:21368:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452546432 00000100:00100000:0.0:1777051300.636735:0:21368:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452546944 00000100:00100000:0.0:1777051300.636740:0:21368:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452546944 00000100:00100000:2.0:1777051300.636764:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13171 00000100:00100000:0.0:1777051300.636778:0:21368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111736 00000100:00100000:2.0:1777051300.636788:0:6580:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fd61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3680:x1863365452546560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777051300.636797:0:21368:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3676:x1863365452545920:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1777051300.636800:0:27885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111737 00000100:00100000:3.0:1777051300.636817:0:27885:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:0+-99:3676:x1863365452546048:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1777051300.636839:0:21368:0:(ldlm_lib.c:1431:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 7929 last 0 00010000:00080000:3.0:1777051300.636849:0:27885:0:(ldlm_lib.c:1431:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 7929 last 0 00000100:00100000:2.0:1777051300.636897:0:6580:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fd61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3680:x1863365452546560:12345-0@lo:400:kworker.0 Request processed in 118us (1251us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051300.636911:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13171 00000020:00000080:0.0:1777051300.636917:0:21368:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x85f51a6b96714cdd 00000020:00000080:3.0:1777051300.636921:0:27885:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x85f51a6b96714ce4 00000004:00100000:0.0:1777051300.636942:0:21368:0:(mdt_handler.c:7285:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:2.0:1777051300.636949:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111738 00000004:00100000:3.0:1777051300.636953:0:27885:0:(mdt_handler.c:7285:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:2.0:1777051300.636963:0:6580:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3676:x1863365452546432:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1777051300.636991:0:6580:0:(ldlm_lib.c:1431:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 7929 last 0 00000100:00080000:3.0:1777051300.637036:0:27885:0:(import.c:65:import_set_state_nolock()) ffff99da7b5fa800 : changing import state from RECOVER to FULL 00000020:00000080:2.0:1777051300.637095:0:6580:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x85f51a6b96714ceb 00000004:00100000:2.0:1777051300.637116:0:6580:0:(mdt_handler.c:7285:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:3.0:1777051300.637122:0:27885:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000-lwp-OST0000_UUID+5:3676:x1863365452546048:12345-0@lo:38:kworker.0 Request processed in 302us (2005us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051300.637139:0:27885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111737 00000100:00080000:2.0:1777051300.637169:0:6580:0:(import.c:65:import_set_state_nolock()) ffff99d942e02800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1777051300.637182:0:27885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111739 00000100:00100000:3.0:1777051300.637193:0:27885:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:0+-99:3676:x1863365452546944:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1777051300.637243:0:6580:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3676:x1863365452546432:12345-0@lo:38:kworker.0 Request processed in 276us (726us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051300.637259:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111738 00010000:00080000:3.0:1777051300.637267:0:27885:0:(ldlm_lib.c:1431:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 7929 last 0 00000100:00100000:2.0:1777051300.637313:0:55805:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452546304 00000100:00100000:2.0:1777051300.637322:0:55805:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452546304 00000020:00000080:3.0:1777051300.637325:0:27885:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x85f51a6b96714cf2 00000004:00100000:3.0:1777051300.637343:0:27885:0:(mdt_handler.c:7285:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1777051300.637371:0:21368:0:(import.c:65:import_set_state_nolock()) ffff99d944c1c800 : changing import state from RECOVER to FULL 00000100:00080000:3.0:1777051300.637384:0:27885:0:(import.c:65:import_set_state_nolock()) ffff99da7b5fb000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1777051300.637386:0:55805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10245 00000100:00100000:2.0:1777051300.637409:0:55805:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d950266d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:3678:x1863365452546688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777051300.637454:0:21368:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3676:x1863365452545920:12345-0@lo:38:kworker.0 Request processed in 658us (2474us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051300.637469:0:21368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111736 00000100:00100000:3.0:1777051300.637478:0:27885:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000-lwp-MDT0000_UUID+5:3676:x1863365452546944:12345-0@lo:38:kworker.0 Request processed in 282us (857us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051300.637494:0:27885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111739 00000100:00100000:3.0:1777051300.637623:0:13320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10246 00000100:00100000:3.0:1777051300.637942:0:13320:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fd63b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3680:x1863365452546304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051300.638068:0:13320:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fd63b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3680:x1863365452546304:12345-0@lo:400:kworker.0 Request processed in 432us (1376us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051300.638081:0:13320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10246 00000100:00100000:3.0:1777051300.638337:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f9bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3680:1863365452546304:0@lo:400:kworker.0 00000100:00100000:3.0:1777051300.638361:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f9bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3680:1863365452546560:0@lo:400:kworker.0 00000100:00100000:2.0:1777051300.638430:0:55805:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d950266d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:3678:x1863365452546688:12345-0@lo:400:kworker.0 Request processed in 1025us (3449us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051300.638442:0:55805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10245 00000100:00100000:1.0:1777051300.638608:0:24468:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d950264380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3678:x1863365452546816:12345-0@lo:400:kworker.0 Request processed in 3036us (3774us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051300.638631:0:24468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10244 00000100:00100000:1.0:1777051300.638674:0:11727:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452545792 00000100:00100000:1.0:1777051300.638682:0:11727:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452545792 00000100:00100000:1.0:1777051300.638733:0:11727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8020 00000100:00100000:1.0:1777051300.638741:0:11727:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3676:x1863365452545792:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1777051300.638764:0:11727:0:(ldlm_lib.c:926:target_handle_reconnect()) connect export for UUID 'lustre-MDT0001-mdtlov_UUID' at ffff99d941c44800, cookie 0x85f51a6b96714b5c 00010000:00080000:1.0:1777051300.638772:0:11727:0:(ldlm_lib.c:1431:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo recovering/t0 exp ffff99d941c44800 cur 7929 last 1777051295 00000004:00100000:1.0:1777051300.638789:0:11727:0:(mdt_handler.c:7285:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1777051300.638819:0:11727:0:(import.c:65:import_set_state_nolock()) ffff99da499cf000 : changing import state from RECOVER to FULL 00010000:00080000:3.0:1777051300.638936:0:3676:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99d955507100 x1863365452545920/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1777051325 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000001:00100000:0.0:1777051300.638957:0:9540:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00080000:3.0:1777051300.638958:0:3676:0:(import.c:1130:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 7 00000100:00080000:2.0:1777051300.639082:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1777051300.639090:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1777051300.639094:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000001:00100000:2.0:1777051300.639131:0:8464:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1777051300.639191:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f9bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3678:1863365452546688:0@lo:400:kworker.0 00000100:00100000:2.0:1777051300.639260:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f9bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3678:1863365452546176:0@lo:400:kworker.0 00000100:00100000:2.0:1777051300.639303:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f9bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3678:1863365452546816:0@lo:400:kworker.0 00010000:00080000:2.0:1777051300.639384:0:103199:0:(ldlm_lib.c:2531:check_for_recovery_ready()) connected 3 stale 0 max_recoverable_clients 3 abort 0 expired 0 00010000:00080000:2.0:1777051300.639394:0:103199:0:(ldlm_lib.c:2669:replay_request_or_update()) Waiting for transno 25769803777 00000020:00080000:2.0:1777051300.639401:0:103199:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1777051300.639406:0:103199:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 25769803777 00000020:00080000:2.0:1777051300.639413:0:103199:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1777051300.639418:0:103199:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 25769803777 00000001:00100000:2.0:1777051300.640511:0:7498:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1777051300.640671:0:11727:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3676:x1863365452545792:12345-0@lo:38:kworker.0 Request processed in 1926us (5787us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051300.640686:0:11727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8020 00000100:00080000:3.0:1777051300.641629:0:3676:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-MDT0001: lwp recover req@ffff99d955507100 x1863365452545920/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1777051325 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1777051300.641641:0:3676:0:(import.c:65:import_set_state_nolock()) ffff99da7fa93000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:3.0:1777051300.641646:0:3676:0:(import.c:65:import_set_state_nolock()) ffff99da7fa93000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:3.0:1777051300.641650:0:3676:0:(import.c:1737:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:3.0:1777051300.662054:0:3676:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955507100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3676:1863365452545920:0@lo:38:kworker.0 00010000:00080000:1.0:1777051300.662481:0:3676:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99da5f9bd180 x1863365452546048/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1777051325 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1777051300.662509:0:3676:0:(import.c:1130:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 7 00000100:00080000:1.0:1777051300.665255:0:3676:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0000: lwp recover req@ffff99da5f9bd180 x1863365452546048/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1777051325 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1777051300.665273:0:3676:0:(import.c:65:import_set_state_nolock()) ffff99d94183b000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:1.0:1777051300.665281:0:3676:0:(import.c:65:import_set_state_nolock()) ffff99d94183b000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:1.0:1777051300.665306:0:3676:0:(import.c:1737:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0000: Connection restored to 0@lo (at 0@lo) 00000100:00100000:1.0:1777051300.665316:0:3676:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f9bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3676:1863365452546048:0@lo:38:kworker.0 00010000:00080000:2.0:1777051300.665441:0:3676:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99da5f9bdf80 x1863365452546432/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1777051325 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1777051300.665463:0:3676:0:(import.c:1130:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 7 00000100:00080000:2.0:1777051300.666922:0:3676:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0001: lwp recover req@ffff99da5f9bdf80 x1863365452546432/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1777051325 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1777051300.666936:0:3676:0:(import.c:65:import_set_state_nolock()) ffff99da5f282000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:2.0:1777051300.666943:0:3676:0:(import.c:65:import_set_state_nolock()) ffff99da5f282000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:2.0:1777051300.666949:0:3676:0:(import.c:1737:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:2.0:1777051300.666956:0:3676:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f9bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3676:1863365452546432:0@lo:38:kworker.0 00010000:00080000:2.0:1777051300.666989:0:3676:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99da5f9bca80 x1863365452546944/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1777051310 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1777051300.667032:0:3676:0:(import.c:1130:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 7 00000100:00080000:2.0:1777051300.667043:0:3676:0:(import.c:958:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1777051300.667049:0:3676:0:(import.c:1211:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1777051300.667052:0:3676:0:(import.c:65:import_set_state_nolock()) ffff99da7b5fd000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1777051300.667059:0:3676:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f9bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3676:1863365452546944:0@lo:38:kworker.0 00000100:00080000:2.0:1777051300.667119:0:3676:0:(import.c:1130:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 7 00000100:00080000:2.0:1777051300.667130:0:3676:0:(import.c:65:import_set_state_nolock()) ffff99da7dbeb000 lustre-MDT0000_UUID: changing import state from CONNECTING to REPLAY 00000100:00080000:2.0:1777051300.667136:0:3676:0:(import.c:1694:ptlrpc_import_recovery_state_machine()) replay requested by lustre-MDT0000_UUID 00000100:00100000:2.0:1777051300.667140:0:3676:0:(client.c:3101:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 12884902301 gen 2 00000100:00080000:2.0:1777051300.667146:0:3676:0:(recover.c:53:ptlrpc_replay_next()) import ffff99da7dbeb000 from lustre-MDT0000_UUID committed 12884902301 last 0 00000100:00080000:2.0:1777051300.667152:0:3676:0:(import.c:65:import_set_state_nolock()) ffff99da7dbeb000 lustre-MDT0000_UUID: changing import state from REPLAY to REPLAY_LOCKS 00000100:00100000:3.0:1777051300.670081:0:3676:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95612b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3676:1863365452545792:0@lo:38:kworker.0 00010000:00080000:2.0:1777051300.670138:0:103504:0:(ldlm_request.c:2960:ldlm_lock_replay_thread()) lock replay thread lustre-MDT0000-osp-MDT0001 to lustre-MDT0000_UUID@0@lo 00010000:00010000:2.0:1777051300.670426:0:103504:0:(ldlm_request.c:2876:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-MDT0000-osp-MDT0001 (0) 00010000:00010000:2.0:1777051300.670435:0:103504:0:(ldlm_request.c:2889:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-MDT0000-osp-MDT0001 00010000:00010000:2.0:1777051300.671334:0:103504:0:(ldlm_request.c:2848:replay_one_lock()) ### replaying lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d9418d3400/0x85f51a6b96149c5e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x85f51a6b96714845 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:2.0:1777051300.671361:0:103504:0:(ldlm_request.c:2898:lock_can_replay()) check lock replay limit, inflights = 1(512) 00000100:00100000:3.0:1777051300.671818:0:3676:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f9bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3676:1863365452547072:0@lo:101:ldlm_lock_repla.0 00000100:00100000:3.0:1777051300.671911:0:3676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051300.671992:0:6585:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452547072 00000100:00100000:2.0:1777051300.672043:0:6585:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452547072 00000100:00100000:2.0:1777051300.672123:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8021 00000100:00100000:2.0:1777051300.672138:0:6585:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f826680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3676:x1863365452547072:12345-0@lo:101:ldlm_lock_repla.0 00010000:00080000:2.0:1777051300.672167:0:6585:0:(ldlm_lib.c:3170:target_queue_recovery_request()) @@@ queue lock replay req req@ffff99da5f826680 x1863365452547072/t0(0) o101->lustre-MDT0001-mdtlov_UUID@0@lo:261/0 lens 328/0 e 0 to 0 dl 1777051311 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1777051300.672207:0:6585:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f826680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3676:x1863365452547072:12345-0@lo:101:ldlm_lock_repla.0 Request processed in 72us (298us total) trans 0 rc 0/-999 00000100:00100000:2.0:1777051300.672218:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8021 00000020:00080000:0.0:1777051300.672285:0:103199:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1777051300.672293:0:103199:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 3, connected: 3, completed: 3, queue_len: 0, req_transno: 0, next_transno: 25769803777 00010000:00080000:0.0:1777051300.672300:0:103199:0:(ldlm_lib.c:2248:check_for_next_transno()) waking for completed recovery 00000020:00080000:0.0:1777051300.672305:0:103199:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1777051300.672315:0:103199:0:(ldlm_lib.c:2438:target_next_replay_lock()) Waiting for lock 00010000:00080000:0.0:1777051300.672319:0:103199:0:(ldlm_lib.c:2268:check_for_next_lock()) waking for next lock 00010000:00080000:0.0:1777051300.672332:0:103199:0:(ldlm_lib.c:2871:target_recovery_thread()) @@@ processing lock from 192.168.201.46@tcp: req@ffff99d94ed2ea00 x1863365425869824/t0(0) o101->2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp:258/0 lens 328/0 e 0 to 0 dl 1777051308 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1777051300.672360:0:103199:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051300.672399:0:103199:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da713e3c00/0x85f51a6b96714cf9 lrc: 2/0,0 mode: --/PR res: [0x200000bd3:0x9f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b50af expref: -99 pid: 103199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.672461:0:103199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da713e3c00/0x85f51a6b96714cf9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x9f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b50af expref: 14 pid: 103199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.672492:0:103199:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99da713e3c00/0x85f51a6b96714cf9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x9f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b50af expref: 14 pid: 103199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.672510:0:103199:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99da713e3c00, rc 0) 00010000:00080000:0.0:1777051300.672603:0:103199:0:(ldlm_lib.c:2086:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 101 seconds 00010000:00080000:0.0:1777051300.672625:0:103199:0:(ldlm_lib.c:2438:target_next_replay_lock()) Waiting for lock 00010000:00080000:0.0:1777051300.672628:0:103199:0:(ldlm_lib.c:2268:check_for_next_lock()) waking for next lock 00010000:00080000:0.0:1777051300.672639:0:103199:0:(ldlm_lib.c:2871:target_recovery_thread()) @@@ processing lock from 192.168.201.46@tcp: req@ffff99d94ed2dc00 x1863365425869952/t0(0) o101->2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp:258/0 lens 328/0 e 0 to 0 dl 1777051308 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1777051300.672658:0:103199:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051300.672682:0:103199:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da713e2c00/0x85f51a6b96714d00 lrc: 2/0,0 mode: --/PR res: [0x200000bd3:0x9d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b50a1 expref: -99 pid: 103199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.673044:0:103199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da713e2c00/0x85f51a6b96714d00 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x9d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b50a1 expref: 14 pid: 103199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.673064:0:103199:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99da713e2c00/0x85f51a6b96714d00 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x9d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b50a1 expref: 14 pid: 103199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.673079:0:103199:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99da713e2c00, rc 0) 00010000:00080000:0.0:1777051300.673143:0:103199:0:(ldlm_lib.c:2086:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00010000:00080000:0.0:1777051300.673162:0:103199:0:(ldlm_lib.c:2438:target_next_replay_lock()) Waiting for lock 00010000:00080000:0.0:1777051300.673167:0:103199:0:(ldlm_lib.c:2268:check_for_next_lock()) waking for next lock 00010000:00080000:0.0:1777051300.673183:0:103199:0:(ldlm_lib.c:2871:target_recovery_thread()) @@@ processing lock from 192.168.201.46@tcp: req@ffff99d94ed2d880 x1863365425870080/t0(0) o101->2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp:258/0 lens 328/0 e 0 to 0 dl 1777051308 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1777051300.673707:0:103199:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051300.673735:0:103199:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da713e3400/0x85f51a6b96714d07 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x57:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b0bdc expref: -99 pid: 103199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.673782:0:103199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da713e3400/0x85f51a6b96714d07 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x57:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b0bdc expref: 14 pid: 103199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.673803:0:103199:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99da713e3400/0x85f51a6b96714d07 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x57:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b0bdc expref: 14 pid: 103199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.673816:0:103199:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99da713e3400, rc 0) 00010000:00080000:0.0:1777051300.673874:0:103199:0:(ldlm_lib.c:2086:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00010000:00080000:0.0:1777051300.673888:0:103199:0:(ldlm_lib.c:2438:target_next_replay_lock()) Waiting for lock 00010000:00080000:0.0:1777051300.673892:0:103199:0:(ldlm_lib.c:2268:check_for_next_lock()) waking for next lock 00010000:00080000:0.0:1777051300.673906:0:103199:0:(ldlm_lib.c:2871:target_recovery_thread()) @@@ processing lock from 192.168.201.46@tcp: req@ffff99d94ed2ed80 x1863365425870208/t0(0) o101->2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp:258/0 lens 328/0 e 0 to 0 dl 1777051308 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1777051300.673926:0:103199:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051300.673955:0:103199:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da713e2200/0x85f51a6b96714d0e lrc: 2/0,0 mode: --/PR res: [0x200000bd3:0xb5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b5731 expref: -99 pid: 103199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.673984:0:103199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da713e2200/0x85f51a6b96714d0e lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0xb5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5731 expref: 14 pid: 103199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.674033:0:103199:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99da713e2200/0x85f51a6b96714d0e lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0xb5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5731 expref: 14 pid: 103199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.674049:0:103199:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99da713e2200, rc 0) 00010000:00080000:0.0:1777051300.674116:0:103199:0:(ldlm_lib.c:2086:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00010000:00080000:0.0:1777051300.674130:0:103199:0:(ldlm_lib.c:2438:target_next_replay_lock()) Waiting for lock 00010000:00080000:0.0:1777051300.674133:0:103199:0:(ldlm_lib.c:2268:check_for_next_lock()) waking for next lock 00010000:00080000:0.0:1777051300.674144:0:103199:0:(ldlm_lib.c:2871:target_recovery_thread()) @@@ processing lock from 192.168.201.46@tcp: req@ffff99d94ed2fb80 x1863365425870336/t0(0) o101->2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp:258/0 lens 328/0 e 0 to 0 dl 1777051308 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1777051300.674166:0:103199:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051300.674189:0:103199:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da713e2600/0x85f51a6b96714d15 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x96:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b41c1 expref: -99 pid: 103199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.674254:0:103199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da713e2600/0x85f51a6b96714d15 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x96:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b41c1 expref: 14 pid: 103199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.674284:0:103199:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99da713e2600/0x85f51a6b96714d15 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x96:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b41c1 expref: 14 pid: 103199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.674306:0:103199:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99da713e2600, rc 0) 00010000:00080000:0.0:1777051300.674342:0:103199:0:(ldlm_lib.c:2086:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00010000:00080000:0.0:1777051300.674375:0:103199:0:(ldlm_lib.c:2438:target_next_replay_lock()) Waiting for lock 00010000:00080000:0.0:1777051300.674379:0:103199:0:(ldlm_lib.c:2268:check_for_next_lock()) waking for next lock 00010000:00080000:0.0:1777051300.674388:0:103199:0:(ldlm_lib.c:2871:target_recovery_thread()) @@@ processing lock from 192.168.201.46@tcp: req@ffff99d95f65a300 x1863365425870464/t0(0) o101->2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp:258/0 lens 328/0 e 0 to 0 dl 1777051308 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1777051300.674407:0:103199:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051300.674427:0:103199:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e9d7000/0x85f51a6b96714d1c lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x96:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b245c expref: -99 pid: 103199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.674450:0:103199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e9d7000/0x85f51a6b96714d1c lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x96:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b245c expref: 14 pid: 103199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.674475:0:103199:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e9d7000/0x85f51a6b96714d1c lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x96:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b245c expref: 14 pid: 103199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.674487:0:103199:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d94e9d7000, rc 0) 00010000:00080000:0.0:1777051300.674521:0:103199:0:(ldlm_lib.c:2086:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00010000:00080000:0.0:1777051300.674534:0:103199:0:(ldlm_lib.c:2438:target_next_replay_lock()) Waiting for lock 00010000:00080000:0.0:1777051300.674537:0:103199:0:(ldlm_lib.c:2268:check_for_next_lock()) waking for next lock 00010000:00080000:0.0:1777051300.674547:0:103199:0:(ldlm_lib.c:2871:target_recovery_thread()) @@@ processing lock from 192.168.201.46@tcp: req@ffff99d95f65ad80 x1863365425870592/t0(0) o101->2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp:258/0 lens 328/0 e 0 to 0 dl 1777051308 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1777051300.674567:0:103199:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051300.674586:0:103199:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e9d6400/0x85f51a6b96714d23 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b5d12 expref: -99 pid: 103199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.674618:0:103199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e9d6400/0x85f51a6b96714d23 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5d12 expref: 14 pid: 103199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.674635:0:103199:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e9d6400/0x85f51a6b96714d23 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5d12 expref: 14 pid: 103199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.674647:0:103199:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d94e9d6400, rc 0) 00010000:00080000:0.0:1777051300.674956:0:103199:0:(ldlm_lib.c:2086:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00010000:00080000:0.0:1777051300.674970:0:103199:0:(ldlm_lib.c:2438:target_next_replay_lock()) Waiting for lock 00010000:00080000:0.0:1777051300.674974:0:103199:0:(ldlm_lib.c:2268:check_for_next_lock()) waking for next lock 00010000:00080000:0.0:1777051300.674985:0:103199:0:(ldlm_lib.c:2871:target_recovery_thread()) @@@ processing lock from 192.168.201.46@tcp: req@ffff99d9533bea00 x1863365425870720/t0(0) o101->2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp:258/0 lens 328/0 e 0 to 0 dl 1777051308 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1777051300.675972:0:103199:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051300.675993:0:103199:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e9d7400/0x85f51a6b96714d2a lrc: 2/0,0 mode: --/PR res: [0x200000bd3:0xb2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b5715 expref: -99 pid: 103199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.676044:0:103199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e9d7400/0x85f51a6b96714d2a lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0xb2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5715 expref: 14 pid: 103199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.676062:0:103199:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e9d7400/0x85f51a6b96714d2a lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0xb2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5715 expref: 14 pid: 103199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.676075:0:103199:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d94e9d7400, rc 0) 00010000:00080000:0.0:1777051300.676181:0:103199:0:(ldlm_lib.c:2086:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00010000:00080000:0.0:1777051300.676237:0:103199:0:(ldlm_lib.c:2438:target_next_replay_lock()) Waiting for lock 00010000:00080000:0.0:1777051300.676241:0:103199:0:(ldlm_lib.c:2268:check_for_next_lock()) waking for next lock 00010000:00080000:0.0:1777051300.676253:0:103199:0:(ldlm_lib.c:2871:target_recovery_thread()) @@@ processing lock from 192.168.201.46@tcp: req@ffff99d9533bc380 x1863365425870848/t0(0) o101->c11b6966-0775-44d2-bdc6-c74c26eb2226@192.168.201.46@tcp:258/0 lens 328/0 e 0 to 0 dl 1777051308 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1777051300.676274:0:103199:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051300.676293:0:103199:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e9d7e00/0x85f51a6b96714d31 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0xc6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b54f3 expref: -99 pid: 103199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.676316:0:103199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e9d7e00/0x85f51a6b96714d31 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xc6:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b54f3 expref: 13 pid: 103199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.676332:0:103199:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e9d7e00/0x85f51a6b96714d31 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xc6:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b54f3 expref: 13 pid: 103199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.676343:0:103199:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d94e9d7e00, rc 0) 00010000:00080000:0.0:1777051300.676377:0:103199:0:(ldlm_lib.c:2086:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00010000:00080000:0.0:1777051300.676388:0:103199:0:(ldlm_lib.c:2438:target_next_replay_lock()) Waiting for lock 00010000:00080000:0.0:1777051300.676391:0:103199:0:(ldlm_lib.c:2268:check_for_next_lock()) waking for next lock 00010000:00080000:0.0:1777051300.676400:0:103199:0:(ldlm_lib.c:2871:target_recovery_thread()) @@@ processing lock from 192.168.201.46@tcp: req@ffff99da7fdf2a00 x1863365425870976/t0(0) o101->c11b6966-0775-44d2-bdc6-c74c26eb2226@192.168.201.46@tcp:258/0 lens 328/0 e 0 to 0 dl 1777051308 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1777051300.676820:0:103199:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051300.676845:0:103199:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e9d7200/0x85f51a6b96714d38 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0xc4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b4e9b expref: -99 pid: 103199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.676873:0:103199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e9d7200/0x85f51a6b96714d38 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xc4:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b4e9b expref: 13 pid: 103199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.676892:0:103199:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e9d7200/0x85f51a6b96714d38 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xc4:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b4e9b expref: 13 pid: 103199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.676913:0:103199:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d94e9d7200, rc 0) 00010000:00080000:0.0:1777051300.676963:0:103199:0:(ldlm_lib.c:2086:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00010000:00080000:0.0:1777051300.676975:0:103199:0:(ldlm_lib.c:2438:target_next_replay_lock()) Waiting for lock 00010000:00080000:0.0:1777051300.676978:0:103199:0:(ldlm_lib.c:2268:check_for_next_lock()) waking for next lock 00010000:00080000:0.0:1777051300.676988:0:103199:0:(ldlm_lib.c:2871:target_recovery_thread()) @@@ processing lock from 192.168.201.46@tcp: req@ffff99da7fdf2300 x1863365425871104/t0(0) o101->c11b6966-0775-44d2-bdc6-c74c26eb2226@192.168.201.46@tcp:258/0 lens 328/0 e 0 to 0 dl 1777051308 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1777051300.677034:0:103199:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051300.677053:0:103199:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e9d6800/0x85f51a6b96714d3f lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0xc2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b4882 expref: -99 pid: 103199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.677075:0:103199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e9d6800/0x85f51a6b96714d3f lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xc2:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b4882 expref: 13 pid: 103199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.677091:0:103199:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e9d6800/0x85f51a6b96714d3f lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xc2:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b4882 expref: 13 pid: 103199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.677103:0:103199:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d94e9d6800, rc 0) 00010000:00080000:0.0:1777051300.677135:0:103199:0:(ldlm_lib.c:2086:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00010000:00080000:0.0:1777051300.677145:0:103199:0:(ldlm_lib.c:2438:target_next_replay_lock()) Waiting for lock 00010000:00080000:0.0:1777051300.677148:0:103199:0:(ldlm_lib.c:2268:check_for_next_lock()) waking for next lock 00010000:00080000:0.0:1777051300.677156:0:103199:0:(ldlm_lib.c:2871:target_recovery_thread()) @@@ processing lock from 192.168.201.46@tcp: req@ffff99da7fdf1180 x1863365425871360/t0(0) o101->c11b6966-0775-44d2-bdc6-c74c26eb2226@192.168.201.46@tcp:258/0 lens 328/0 e 0 to 0 dl 1777051308 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1777051300.677173:0:103199:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051300.677187:0:103199:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e9d6600/0x85f51a6b96714d46 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x96:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b244e expref: -99 pid: 103199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.677368:0:103199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e9d6600/0x85f51a6b96714d46 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x96:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b244e expref: 13 pid: 103199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.677380:0:103199:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e9d6600/0x85f51a6b96714d46 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x96:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b244e expref: 13 pid: 103199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.677388:0:103199:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d94e9d6600, rc 0) 00010000:00080000:0.0:1777051300.677427:0:103199:0:(ldlm_lib.c:2086:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00010000:00080000:0.0:1777051300.677439:0:103199:0:(ldlm_lib.c:2438:target_next_replay_lock()) Waiting for lock 00010000:00080000:0.0:1777051300.677441:0:103199:0:(ldlm_lib.c:2268:check_for_next_lock()) waking for next lock 00010000:00080000:0.0:1777051300.677449:0:103199:0:(ldlm_lib.c:2871:target_recovery_thread()) @@@ processing lock from 192.168.201.46@tcp: req@ffff99d94c12bb80 x1863365425871488/t0(0) o101->c11b6966-0775-44d2-bdc6-c74c26eb2226@192.168.201.46@tcp:258/0 lens 328/0 e 0 to 0 dl 1777051308 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1777051300.677465:0:103199:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051300.677478:0:103199:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e9d6c00/0x85f51a6b96714d4d lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b0fbe expref: -99 pid: 103199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.677493:0:103199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e9d6c00/0x85f51a6b96714d4d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b0fbe expref: 13 pid: 103199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.677503:0:103199:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e9d6c00/0x85f51a6b96714d4d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b0fbe expref: 13 pid: 103199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.677512:0:103199:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d94e9d6c00, rc 0) 00010000:00080000:0.0:1777051300.677538:0:103199:0:(ldlm_lib.c:2086:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00010000:00080000:0.0:1777051300.677549:0:103199:0:(ldlm_lib.c:2438:target_next_replay_lock()) Waiting for lock 00010000:00080000:0.0:1777051300.677552:0:103199:0:(ldlm_lib.c:2268:check_for_next_lock()) waking for next lock 00010000:00080000:0.0:1777051300.677561:0:103199:0:(ldlm_lib.c:2871:target_recovery_thread()) @@@ processing lock from 192.168.201.46@tcp: req@ffff99da7c9a1f80 x1863365425871616/t0(0) o101->c11b6966-0775-44d2-bdc6-c74c26eb2226@192.168.201.46@tcp:258/0 lens 328/0 e 0 to 0 dl 1777051308 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1777051300.677579:0:103199:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051300.677598:0:103199:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e9d7600/0x85f51a6b96714d54 lrc: 2/0,0 mode: --/PR res: [0x200000bd3:0xb0:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b555c expref: -99 pid: 103199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.677623:0:103199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e9d7600/0x85f51a6b96714d54 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0xb0:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b555c expref: 13 pid: 103199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.677641:0:103199:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e9d7600/0x85f51a6b96714d54 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0xb0:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b555c expref: 13 pid: 103199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.677655:0:103199:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d94e9d7600, rc 0) 00010000:00080000:0.0:1777051300.677787:0:103199:0:(ldlm_lib.c:2086:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00010000:00080000:0.0:1777051300.677800:0:103199:0:(ldlm_lib.c:2438:target_next_replay_lock()) Waiting for lock 00010000:00080000:0.0:1777051300.677804:0:103199:0:(ldlm_lib.c:2268:check_for_next_lock()) waking for next lock 00010000:00080000:0.0:1777051300.677814:0:103199:0:(ldlm_lib.c:2871:target_recovery_thread()) @@@ processing lock from 192.168.201.46@tcp: req@ffff99da7fdf2680 x1863365425871232/t0(0) o101->c11b6966-0775-44d2-bdc6-c74c26eb2226@192.168.201.46@tcp:258/0 lens 328/0 e 0 to 0 dl 1777051308 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1777051300.677828:0:103199:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051300.677844:0:103199:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da429d6600/0x85f51a6b96714d5b lrc: 2/0,0 mode: --/PR res: [0x200000bd3:0x9e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b4ee8 expref: -99 pid: 103199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.677860:0:103199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da429d6600/0x85f51a6b96714d5b lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x9e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b4ee8 expref: 13 pid: 103199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.677870:0:103199:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99da429d6600/0x85f51a6b96714d5b lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x9e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b4ee8 expref: 13 pid: 103199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.677884:0:103199:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99da429d6600, rc 0) 00010000:00080000:0.0:1777051300.677905:0:103199:0:(ldlm_lib.c:2086:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00010000:00080000:0.0:1777051300.677912:0:103199:0:(ldlm_lib.c:2438:target_next_replay_lock()) Waiting for lock 00010000:00080000:0.0:1777051300.677914:0:103199:0:(ldlm_lib.c:2268:check_for_next_lock()) waking for next lock 00010000:00080000:0.0:1777051300.677919:0:103199:0:(ldlm_lib.c:2871:target_recovery_thread()) @@@ processing lock from 0@lo: req@ffff99da5f826680 x1863365452547072/t0(0) o101->lustre-MDT0001-mdtlov_UUID@0@lo:261/0 lens 328/0 e 0 to 0 dl 1777051311 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1777051300.677935:0:103199:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051300.677951:0:103199:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da429d7600/0x85f51a6b96714d62 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x85f51a6b96149c5e expref: -99 pid: 103199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.677972:0:103199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da429d7600/0x85f51a6b96714d62 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x85f51a6b96149c5e expref: 7 pid: 103199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.677988:0:103199:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99da429d7600/0x85f51a6b96714d62 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b96149c5e expref: 7 pid: 103199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.678029:0:103199:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99da429d7600, rc 0) 00010000:00080000:0.0:1777051300.678094:0:103199:0:(ldlm_lib.c:2086:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00010000:00080000:0.0:1777051300.678109:0:103199:0:(ldlm_lib.c:2438:target_next_replay_lock()) Waiting for lock 00000100:00100000:0.0:1777051300.678604:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00010000:00010000:3.0:1777051300.678606:0:3676:0:(ldlm_request.c:2765:replay_lock_interpret()) ### replayed lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d9418d3400/0x85f51a6b96149c5e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x85f51a6b96714d62 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1777051300.678626:0:3676:0:(import.c:65:import_set_state_nolock()) ffff99da7dbeb000 lustre-MDT0000_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000100:00100000:3.0:1777051300.678663:0:3676:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f9bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3676:1863365452547072:0@lo:101:ldlm_lock_repla.0 00000100:00100000:0.0:1777051300.678677:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051300.678699:0:6580:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425871744 00000100:00100000:3.0:1777051300.678700:0:3676:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da70a32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3676:1863365452547200:0@lo:400:ptlrpcd_rcv.0 00000100:00100000:2.0:1777051300.678712:0:6580:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425871744 00000100:00100000:0.0:1777051300.678759:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051300.678779:0:6580:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425871872 00000100:00100000:2.0:1777051300.678786:0:6580:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425871872 00000100:00100000:0.0:1777051300.678820:0:8492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425872000 00000100:00100000:0.0:1777051300.678830:0:8492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425872000 00000100:00100000:2.0:1777051300.678858:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111740 00000100:00100000:2.0:1777051300.678876:0:6580:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d950265500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+16:2435:x1863365425871744:12345-192.168.201.46@tcp:101:ldlm_lock_repla.0 00010000:00080000:2.0:1777051300.678897:0:6580:0:(ldlm_lib.c:3170:target_queue_recovery_request()) @@@ queue lock replay req req@ffff99d950265500 x1863365425871744/t0(0) o101->2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp:261/0 lens 328/0 e 0 to 0 dl 1777051311 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1777051300.678906:0:8492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111741 00000100:00100000:0.0:1777051300.678930:0:8492:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d950266680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+16:2435:x1863365425871872:12345-192.168.201.46@tcp:101:ldlm_lock_repla.0 00000100:00100000:2.0:1777051300.678940:0:6580:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d950265500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+16:2435:x1863365425871744:12345-192.168.201.46@tcp:101:ldlm_lock_repla.0 Request processed in 66us (334us total) trans 0 rc 0/-999 00000100:00100000:2.0:1777051300.678957:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111740 00010000:00080000:0.0:1777051300.678966:0:8492:0:(ldlm_lib.c:3170:target_queue_recovery_request()) @@@ queue lock replay req req@ffff99d950266680 x1863365425871872/t0(0) o101->2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp:261/0 lens 328/0 e 0 to 0 dl 1777051311 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777051300.678970:0:3676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051300.678986:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111742 00000100:00100000:0.0:1777051300.679027:0:8492:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d950266680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+16:2435:x1863365425871872:12345-192.168.201.46@tcp:101:ldlm_lock_repla.0 Request processed in 77us (328us total) trans 0 rc 0/-999 00000100:00100000:0.0:1777051300.679041:0:8492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111741 00000100:00100000:2.0:1777051300.679051:0:6580:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da44579c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+16:2435:x1863365425872000:12345-192.168.201.46@tcp:101:ldlm_lock_repla.0 00010000:00080000:2.0:1777051300.679072:0:6580:0:(ldlm_lib.c:3170:target_queue_recovery_request()) @@@ queue lock replay req req@ffff99da44579c00 x1863365425872000/t0(0) o101->2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp:261/0 lens 328/0 e 0 to 0 dl 1777051311 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1777051300.679090:0:6580:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da44579c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+16:2435:x1863365425872000:12345-192.168.201.46@tcp:101:ldlm_lock_repla.0 Request processed in 56us (337us total) trans 0 rc 0/-999 00000100:00100000:2.0:1777051300.679371:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111742 00010000:00080000:0.0:1777051300.679405:0:103199:0:(ldlm_lib.c:2268:check_for_next_lock()) waking for next lock 00010000:00080000:0.0:1777051300.679420:0:103199:0:(ldlm_lib.c:2871:target_recovery_thread()) @@@ processing lock from 192.168.201.46@tcp: req@ffff99d950265500 x1863365425871744/t0(0) o101->2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp:261/0 lens 328/0 e 0 to 0 dl 1777051311 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1777051300.679430:0:46498:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452547200 00000100:00100000:2.0:1777051300.679439:0:46498:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452547200 00010000:00010000:0.0:1777051300.679442:0:103199:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051300.679469:0:103199:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da429d6800/0x85f51a6b96714d69 lrc: 2/0,0 mode: --/PR res: [0x200000bd3:0xb1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b570e expref: -99 pid: 103199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.679494:0:103199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da429d6800/0x85f51a6b96714d69 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0xb1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b570e expref: 17 pid: 103199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.679513:0:103199:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99da429d6800/0x85f51a6b96714d69 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0xb1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b570e expref: 17 pid: 103199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051300.679526:0:46498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8022 00010000:00010000:0.0:1777051300.679529:0:103199:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99da429d6800, rc 0) 00000100:00100000:2.0:1777051300.679544:0:46498:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da70a30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+7:3676:x1863365452547200:12345-0@lo:400:ptlrpcd_rcv.0 00010000:00080000:2.0:1777051300.679563:0:46498:0:(ldlm_lib.c:3120:target_queue_recovery_request()) @@@ queue final req req@ffff99da70a30e00 x1863365452547200/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:261/0 lens 224/0 e 0 to 0 dl 1777051311 ref 2 fl Interpret:/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00010000:00080000:0.0:1777051300.679577:0:103199:0:(ldlm_lib.c:2086:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000100:00100000:2.0:1777051300.679584:0:46498:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da70a30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+7:3676:x1863365452547200:12345-0@lo:400:ptlrpcd_rcv.0 Request processed in 43us (792us total) trans 0 rc 0/-999 00000100:00100000:2.0:1777051300.679595:0:46498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8022 00010000:00080000:0.0:1777051300.679596:0:103199:0:(ldlm_lib.c:2438:target_next_replay_lock()) Waiting for lock 00010000:00080000:0.0:1777051300.679605:0:103199:0:(ldlm_lib.c:2268:check_for_next_lock()) waking for next lock 00010000:00080000:0.0:1777051300.679620:0:103199:0:(ldlm_lib.c:2871:target_recovery_thread()) @@@ processing lock from 192.168.201.46@tcp: req@ffff99d950266680 x1863365425871872/t0(0) o101->2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp:261/0 lens 328/0 e 0 to 0 dl 1777051311 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1777051300.679639:0:103199:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051300.679659:0:103199:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da429d7c00/0x85f51a6b96714d70 lrc: 2/0,0 mode: --/PR res: [0x200000bd3:0x51:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b445a expref: -99 pid: 103199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.679986:0:103199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da429d7c00/0x85f51a6b96714d70 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x51:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b445a expref: 17 pid: 103199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.680042:0:103199:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99da429d7c00/0x85f51a6b96714d70 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0x51:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b445a expref: 17 pid: 103199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.680057:0:103199:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99da429d7c00, rc 0) 00010000:00080000:0.0:1777051300.680123:0:103199:0:(ldlm_lib.c:2086:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00010000:00080000:0.0:1777051300.680136:0:103199:0:(ldlm_lib.c:2438:target_next_replay_lock()) Waiting for lock 00010000:00080000:0.0:1777051300.680139:0:103199:0:(ldlm_lib.c:2268:check_for_next_lock()) waking for next lock 00010000:00080000:0.0:1777051300.680148:0:103199:0:(ldlm_lib.c:2871:target_recovery_thread()) @@@ processing lock from 192.168.201.46@tcp: req@ffff99da44579c00 x1863365425872000/t0(0) o101->2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp:261/0 lens 328/0 e 0 to 0 dl 1777051311 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1777051300.680167:0:103199:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051300.680186:0:103199:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da429d7e00/0x85f51a6b96714d77 lrc: 2/0,0 mode: --/PR res: [0x200000bd3:0xb0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b5707 expref: -99 pid: 103199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.680676:0:103199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da429d7e00/0x85f51a6b96714d77 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0xb0:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5707 expref: 17 pid: 103199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.680697:0:103199:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99da429d7e00/0x85f51a6b96714d77 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0xb0:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5707 expref: 17 pid: 103199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.680708:0:103199:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99da429d7e00, rc 0) 00010000:00080000:0.0:1777051300.680749:0:103199:0:(ldlm_lib.c:2086:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00010000:00080000:0.0:1777051300.680758:0:103199:0:(ldlm_lib.c:2438:target_next_replay_lock()) Waiting for lock 00000100:00100000:3.0:1777051300.681815:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051300.681916:0:27885:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425872128 00000100:00100000:2.0:1777051300.681926:0:27885:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425872128 00000100:00100000:2.0:1777051300.682046:0:27885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13172 00000100:00100000:2.0:1777051300.682065:0:27885:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da70a33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c11b6966-0775-44d2-bdc6-c74c26eb2226+13:2435:x1863365425872128:12345-192.168.201.46@tcp:400:ptlrpcd_rcv.0 00010000:00080000:2.0:1777051300.682086:0:27885:0:(ldlm_lib.c:3120:target_queue_recovery_request()) @@@ queue final req req@ffff99da70a33100 x1863365425872128/t0(0) o400->c11b6966-0775-44d2-bdc6-c74c26eb2226@192.168.201.46@tcp:261/0 lens 224/0 e 0 to 0 dl 1777051311 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1777051300.682122:0:27885:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da70a33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c11b6966-0775-44d2-bdc6-c74c26eb2226+13:2435:x1863365425872128:12345-192.168.201.46@tcp:400:ptlrpcd_rcv.0 Request processed in 63us (313us total) trans 0 rc 0/-999 00000100:00100000:2.0:1777051300.682134:0:27885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13172 00000100:00100000:2.0:1777051300.685616:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051300.686678:0:6581:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425872256 00000100:00100000:3.0:1777051300.686688:0:6581:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425872256 00000100:00100000:3.0:1777051300.686761:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13173 00000100:00100000:3.0:1777051300.686777:0:6581:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+17:2435:x1863365425872256:12345-192.168.201.46@tcp:400:ptlrpcd_rcv.0 00010000:00080000:3.0:1777051300.686796:0:6581:0:(ldlm_lib.c:3120:target_queue_recovery_request()) @@@ queue final req req@ffff99da5f9bdf80 x1863365425872256/t0(0) o400->2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp:261/0 lens 224/0 e 0 to 0 dl 1777051311 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777051300.686831:0:6581:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+17:2435:x1863365425872256:12345-192.168.201.46@tcp:400:ptlrpcd_rcv.0 Request processed in 59us (1219us total) trans 0 rc 0/-999 00000100:00100000:3.0:1777051300.686842:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13173 00010000:00080000:0.0:1777051300.686884:0:103199:0:(ldlm_lib.c:2271:check_for_next_lock()) waking for completed lock replay 00000001:00000004:0.0:1777051300.687104:0:103199:0:(tgt_lastrcvd.c:732:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 7, last_transno is 30064771072 00000001:00100000:3.0:1777051300.696686:0:103159:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 2dd4696c-edce-4cd1-86d2-dbd2ff957fa1 00000001:00100000:3.0:1777051300.696696:0:103159:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of c11b6966-0775-44d2-bdc6-c74c26eb2226 00000001:00100000:3.0:1777051300.696699:0:103159:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00080000:2.0:1777051300.696808:0:103199:0:(tgt_lastrcvd.c:223:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00010000:00080000:2.0:1777051300.696904:0:103199:0:(ldlm_lib.c:1982:target_cancel_recovery_timer()) lustre-MDT0000: cancel recovery timer 00010000:00080000:2.0:1777051300.696926:0:103199:0:(ldlm_lib.c:2923:target_recovery_thread()) @@@ processing final ping from 0@lo: req@ffff99da70a30e00 x1863365452547200/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:261/0 lens 224/0 e 0 to 0 dl 1777051311 ref 1 fl Complete:/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00010000:00080000:2.0:1777051300.697136:0:103199:0:(ldlm_lib.c:2923:target_recovery_thread()) @@@ processing final ping from 192.168.201.46@tcp: req@ffff99da70a33100 x1863365425872128/t0(0) o400->c11b6966-0775-44d2-bdc6-c74c26eb2226@192.168.201.46@tcp:261/0 lens 224/0 e 0 to 0 dl 1777051311 ref 1 fl Complete:H/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1777051300.697176:0:3676:0:(import.c:65:import_set_state_nolock()) ffff99da7dbeb000 lustre-MDT0000_UUID: changing import state from REPLAY_WAIT to RECOVER 00000100:00080000:3.0:1777051300.697224:0:3676:0:(client.c:3223:ptlrpc_resend_req()) @@@ going to resend req@ffff99da70a32a00 x1863365452547200/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1777051316 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1777051300.697243:0:3676:0:(client.c:3232:ptlrpc_resend_req()) @@@ it has reply, so skip it req@ffff99da70a32a00 x1863365452547200/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1777051316 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00010000:00080000:2.0:1777051300.697254:0:103199:0:(ldlm_lib.c:2923:target_recovery_thread()) @@@ processing final ping from 192.168.201.46@tcp: req@ffff99da5f9bdf80 x1863365425872256/t0(0) o400->2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp:261/0 lens 224/0 e 0 to 0 dl 1777051311 ref 1 fl Complete:H/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1777051300.697260:0:3676:0:(import.c:65:import_set_state_nolock()) ffff99da7dbeb000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:3.0:1777051300.697293:0:3676:0:(import.c:1737:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-osp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00080000:3.0:1777051300.697305:0:3676:0:(recover.c:189:ptlrpc_wake_delayed()) @@@ waking (set 00000000e832489d): req@ffff99da5f9fd880 x1863365452528640/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1777051295 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00010000:02000000:2.0:1777051300.697328:0:103199:0:(ldlm_lib.c:1854:target_finish_recovery()) lustre-MDT0000: Recovery over after 0:03, of 3 clients 3 recovered and 0 were evicted. 00000100:00100000:3.0:1777051300.697334:0:3676:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da70a32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3676:1863365452547200:0@lo:400:ptlrpcd_rcv.0 00000100:00100000:3.0:1777051300.697452:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da70a32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452547328:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1777051300.697513:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051300.697594:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051300.697597:0:6584:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452547328 00000100:00100000:1.0:1777051300.697609:0:6584:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452547328 00000100:00100000:3.0:1777051300.697673:0:11727:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452528640 00000100:00100000:3.0:1777051300.697680:0:11727:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452528640 00000100:00100000:1.0:1777051300.697683:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8023 00000100:00100000:1.0:1777051300.697704:0:6584:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da70a30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:3679:x1863365452547328:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1777051300.697729:0:11727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8024 00000100:00100000:3.0:1777051300.697743:0:11727:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da70a30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:3679:x1863365452528640:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1777051300.697744:0:6584:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4194304 pending 0 free 1441603584 avail 1295364096 00000100:00100000:1.0:1777051300.698147:0:6584:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da70a30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:3679:x1863365452547328:12345-0@lo:41:osp-pre-0-1.0 Request processed in 448us (631us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051300.698160:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8023 00000004:00000024:3.0:1777051300.699692:0:11727:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4194304 pending 0 free 1441603584 avail 1295364096 00000100:00100000:3.0:1777051300.699748:0:11727:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da70a30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:3679:x1863365452528640:12345-0@lo:41:osp-pre-0-1.0 Request processed in 2008us (2156us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051300.699760:0:11727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8024 00000100:00100000:3.0:1777051300.699819:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da70a32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452547328:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1777051300.699835:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f9fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452528640:0@lo:41:osp-pre-0-1.0 00000004:00000080:2.0:1777051300.740515:0:103199:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb08942babe10 00100000:10000000:2.0:1777051300.740538:0:103199:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000004:00080000:3.0:1777051300.742495:0:103178:0:(osp_precreate.c:877:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x15e:0x0] 00000100:00100000:3.0:1777051300.742570:0:103178:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da70a32a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:103178:1863365452547456:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1777051300.742663:0:103178:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1777051300.742680:0:103180:0:(osp_precreate.c:877:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x15e:0x0] 00000100:00100000:2.0:1777051300.742975:0:103180:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f9bd180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:103180:1863365452547584:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1777051300.743524:0:8628:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452547456 00000100:00100000:1.0:1777051300.743536:0:8628:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452547456 00000100:00100000:2.0:1777051300.743596:0:103180:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051300.743608:0:8628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7950 00000100:00100000:1.0:1777051300.743636:0:8628:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da70a30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:103178:x1863365452547456:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1777051300.743650:0:103180:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d95ba62e40 going to sleep for 11 seconds 00002000:00080000:1.0:1777051300.743678:0:8628:0:(ofd_dev.c:1637:ofd_create_hdl()) ofd_last_id() = 481 -> diff = -131 00000100:00100000:2.0:1777051300.743680:0:103178:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da57b3ab40 going to sleep for 11 seconds 00002000:02000040:1.0:1777051300.743688:0:8628:0:(ofd_dev.c:1488:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:351 to 0x280000401:481) 00000100:00100000:3.0:1777051300.744622:0:8468:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452547584 00000100:00100000:3.0:1777051300.744631:0:8468:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452547584 00000100:00100000:3.0:1777051300.745453:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7951 00000100:00100000:3.0:1777051300.745471:0:8468:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:103180:x1863365452547584:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1777051300.745497:0:8468:0:(ofd_dev.c:1637:ofd_create_hdl()) ofd_last_id() = 481 -> diff = -131 00002000:02000040:3.0:1777051300.745503:0:8468:0:(ofd_dev.c:1488:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:351 to 0x2c0000401:481) 00002000:00010000:1.0:1777051300.763056:0:8628:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x1e1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777051300.763073:0:8628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000039d760f0/0x85f51a6b96714d7e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1e1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051300.763097:0:8628:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051300.763108:0:8628:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051300.763116:0:8628:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000039d760f0/0x85f51a6b96714d7e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051300.763137:0:8628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000039d760f0/0x85f51a6b96714d7e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051300.763153:0:8628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000039d760f0/0x85f51a6b96714d7e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051300.763166:0:8628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000039d760f0/0x85f51a6b96714d7e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051300.763244:0:8628:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1777051300.763297:0:13753:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777051300.763311:0:13753:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000039d760f0/0x85f51a6b96714d7e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051300.763330:0:13753:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d9442eb200 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:2.0:1777051300.763337:0:13753:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000039d760f0/0x85f51a6b96714d7e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051300.763355:0:13753:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000039d760f0/0x85f51a6b96714d7e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1777051300.763382:0:8628:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x1e0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1777051300.763386:0:13753:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000039d760f0/0x85f51a6b96714d7e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051300.763397:0:8628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b6f27459/0x85f51a6b96714d85 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1e0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051300.763410:0:13753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000039d760f0/0x85f51a6b96714d7e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051300.763422:0:8628:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051300.763429:0:8628:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051300.763436:0:8628:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6f27459/0x85f51a6b96714d85 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051300.763453:0:8628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6f27459/0x85f51a6b96714d85 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051300.763470:0:8628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b6f27459/0x85f51a6b96714d85 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051300.763475:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777051300.763480:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777051300.763486:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051300.763490:0:8628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b6f27459/0x85f51a6b96714d85 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051300.763524:0:8628:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1777051300.763570:0:6567:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777051300.763579:0:6567:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b6f27459/0x85f51a6b96714d85 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051300.763605:0:6567:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d9442ebe00 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:1.0:1777051300.763612:0:6567:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6f27459/0x85f51a6b96714d85 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051300.763626:0:6567:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6f27459/0x85f51a6b96714d85 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051300.763646:0:6567:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b6f27459/0x85f51a6b96714d85 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051300.763660:0:6567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6f27459/0x85f51a6b96714d85 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051300.763686:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051300.763690:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051300.763693:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1777051300.763762:0:8628:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x1df:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777051300.763773:0:8628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007cef667b/0x85f51a6b96714d8c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1df:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051300.763789:0:8628:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051300.763793:0:8628:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051300.763799:0:8628:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007cef667b/0x85f51a6b96714d8c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051300.763816:0:8628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007cef667b/0x85f51a6b96714d8c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051300.763831:0:8628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007cef667b/0x85f51a6b96714d8c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051300.763844:0:8628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007cef667b/0x85f51a6b96714d8c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051300.763882:0:8628:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1777051300.763941:0:8628:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x1de:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777051300.763950:0:8628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b7f160cd/0x85f51a6b96714d93 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1de:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051300.763963:0:8628:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051300.763966:0:8628:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051300.763972:0:8628:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b7f160cd/0x85f51a6b96714d93 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051300.763987:0:8628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b7f160cd/0x85f51a6b96714d93 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051300.764023:0:8628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b7f160cd/0x85f51a6b96714d93 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051300.764038:0:8628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b7f160cd/0x85f51a6b96714d93 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051300.764078:0:8628:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1777051300.764135:0:8628:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x1dd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777051300.764145:0:8628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d7a33e2b/0x85f51a6b96714d9a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1dd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051300.764160:0:8628:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051300.764162:0:8628:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051300.764167:0:8628:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d7a33e2b/0x85f51a6b96714d9a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051300.764186:0:8628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d7a33e2b/0x85f51a6b96714d9a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.764198:0:38719:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1777051300.764211:0:38719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007cef667b/0x85f51a6b96714d8c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.764235:0:38719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d9442eb000 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:1.0:1777051300.764239:0:8628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d7a33e2b/0x85f51a6b96714d9a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.764244:0:38719:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007cef667b/0x85f51a6b96714d8c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051300.764275:0:8628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d7a33e2b/0x85f51a6b96714d9a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.764280:0:38719:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007cef667b/0x85f51a6b96714d8c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051300.764314:0:8628:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1777051300.764319:0:38719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007cef667b/0x85f51a6b96714d8c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.764335:0:38719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007cef667b/0x85f51a6b96714d8c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.764367:0:38719:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1777051300.764374:0:38719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b7f160cd/0x85f51a6b96714d93 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1777051300.764378:0:8628:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x1dc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777051300.764396:0:8628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c429bca5/0x85f51a6b96714da1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1dc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.764397:0:38719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d9442ea800 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:0.0:1777051300.764408:0:38719:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b7f160cd/0x85f51a6b96714d93 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051300.764421:0:8628:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051300.764426:0:8628:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051300.764434:0:8628:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c429bca5/0x85f51a6b96714da1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.764450:0:38719:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b7f160cd/0x85f51a6b96714d93 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051300.764453:0:8628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c429bca5/0x85f51a6b96714da1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051300.764493:0:8628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c429bca5/0x85f51a6b96714da1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.764498:0:38719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b7f160cd/0x85f51a6b96714d93 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051300.764516:0:8628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c429bca5/0x85f51a6b96714da1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.764525:0:38719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b7f160cd/0x85f51a6b96714d93 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051300.764558:0:8628:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1777051300.764573:0:6567:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1777051300.764582:0:6567:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d7a33e2b/0x85f51a6b96714d9a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051300.764597:0:6567:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d9442eae00 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:2.0:1777051300.764600:0:6568:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777051300.764605:0:6567:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d7a33e2b/0x85f51a6b96714d9a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.764611:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777051300.764612:0:6568:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c429bca5/0x85f51a6b96714da1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.764619:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777051300.764625:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051300.764634:0:6567:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d7a33e2b/0x85f51a6b96714d9a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051300.764640:0:6568:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d95595b800 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:2.0:1777051300.764652:0:6568:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c429bca5/0x85f51a6b96714da1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051300.764664:0:6567:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d7a33e2b/0x85f51a6b96714d9a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051300.764671:0:6568:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c429bca5/0x85f51a6b96714da1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051300.764691:0:6567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d7a33e2b/0x85f51a6b96714d9a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051300.764711:0:6568:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c429bca5/0x85f51a6b96714da1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051300.764722:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777051300.764728:0:6568:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c429bca5/0x85f51a6b96714da1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051300.764729:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051300.764735:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777051300.765374:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777051300.765379:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777051300.765382:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777051300.765394:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1777051300.765441:0:8628:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x1db:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777051300.765452:0:8628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b457160c/0x85f51a6b96714da8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1db:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051300.765467:0:8628:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051300.765470:0:8628:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051300.765476:0:8628:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b457160c/0x85f51a6b96714da8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051300.765493:0:8628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b457160c/0x85f51a6b96714da8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051300.765508:0:8628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b457160c/0x85f51a6b96714da8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051300.765523:0:8628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b457160c/0x85f51a6b96714da8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051300.765565:0:8628:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1777051300.765625:0:8628:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x1da:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777051300.765635:0:8628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c9fbe2bd/0x85f51a6b96714daf lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1da:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051300.765649:0:8628:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051300.765652:0:8628:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051300.765657:0:8628:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c9fbe2bd/0x85f51a6b96714daf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051300.765684:0:8628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c9fbe2bd/0x85f51a6b96714daf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051300.765699:0:8628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c9fbe2bd/0x85f51a6b96714daf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051300.765713:0:8628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c9fbe2bd/0x85f51a6b96714daf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051300.765748:0:8628:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1777051300.765797:0:6567:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1777051300.765808:0:6567:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b457160c/0x85f51a6b96714da8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1777051300.765811:0:8628:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x1d9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777051300.765830:0:8628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006cb02dc1/0x85f51a6b96714db6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1d9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.765833:0:6567:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d95595b200 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:0.0:1777051300.765844:0:6567:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b457160c/0x85f51a6b96714da8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051300.765852:0:8628:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051300.765857:0:8628:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051300.765865:0:8628:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006cb02dc1/0x85f51a6b96714db6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.765868:0:6567:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b457160c/0x85f51a6b96714da8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051300.765903:0:8628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006cb02dc1/0x85f51a6b96714db6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.765911:0:6567:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b457160c/0x85f51a6b96714da8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051300.765922:0:8628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006cb02dc1/0x85f51a6b96714db6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.765932:0:6567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b457160c/0x85f51a6b96714da8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051300.765947:0:8628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006cb02dc1/0x85f51a6b96714db6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051300.765996:0:8628:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1777051300.766036:0:6567:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1777051300.766043:0:6567:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c9fbe2bd/0x85f51a6b96714daf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.766054:0:6567:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d95595ac00 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:0.0:1777051300.766059:0:6567:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c9fbe2bd/0x85f51a6b96714daf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.766071:0:6567:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c9fbe2bd/0x85f51a6b96714daf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.766087:0:6567:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c9fbe2bd/0x85f51a6b96714daf lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.766100:0:6567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c9fbe2bd/0x85f51a6b96714daf lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.766118:0:6567:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1777051300.766123:0:6567:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006cb02dc1/0x85f51a6b96714db6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.766133:0:6567:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d95595be00 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:0.0:1777051300.766138:0:6567:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006cb02dc1/0x85f51a6b96714db6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.766158:0:6567:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006cb02dc1/0x85f51a6b96714db6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.766443:0:6567:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006cb02dc1/0x85f51a6b96714db6 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.766458:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777051300.766461:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777051300.766464:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777051300.767437:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777051300.767445:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051300.768922:0:8628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006cb02dc1/0x85f51a6b96714db6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1777051300.769059:0:8628:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x1d8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777051300.769070:0:8628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006f555381/0x85f51a6b96714dbd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1d8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051300.769085:0:8628:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051300.769088:0:8628:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051300.769119:0:8628:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006f555381/0x85f51a6b96714dbd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051300.769133:0:8628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006f555381/0x85f51a6b96714dbd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051300.769143:0:8628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006f555381/0x85f51a6b96714dbd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051300.769150:0:8628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006f555381/0x85f51a6b96714dbd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051300.769183:0:8628:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1777051300.769268:0:8628:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x1d7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777051300.769277:0:8628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000957ed3e0/0x85f51a6b96714dc4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1d7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051300.769292:0:8628:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051300.769295:0:8628:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051300.769301:0:8628:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000957ed3e0/0x85f51a6b96714dc4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051300.769317:0:8628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000957ed3e0/0x85f51a6b96714dc4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051300.769332:0:8628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000957ed3e0/0x85f51a6b96714dc4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051300.769345:0:8628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000957ed3e0/0x85f51a6b96714dc4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051300.769373:0:8628:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1777051300.769433:0:6567:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00002000:00010000:1.0:1777051300.769434:0:8628:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x1d6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1777051300.769445:0:6567:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006f555381/0x85f51a6b96714dbd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051300.769448:0:8628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a40f0ac0/0x85f51a6b96714dcb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1d6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.769485:0:6567:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d95595ae00 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:1.0:1777051300.769485:0:8628:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051300.769489:0:8628:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777051300.769495:0:6567:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006f555381/0x85f51a6b96714dbd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051300.769497:0:8628:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a40f0ac0/0x85f51a6b96714dcb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.769541:0:6567:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006f555381/0x85f51a6b96714dbd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051300.769562:0:8628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a40f0ac0/0x85f51a6b96714dcb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.769569:0:6567:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006f555381/0x85f51a6b96714dbd lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.769608:0:6567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006f555381/0x85f51a6b96714dbd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051300.769618:0:8628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a40f0ac0/0x85f51a6b96714dcb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051300.769659:0:8628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a40f0ac0/0x85f51a6b96714dcb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.769676:0:6567:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1777051300.769683:0:6567:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000957ed3e0/0x85f51a6b96714dc4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051300.769686:0:8628:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1777051300.769703:0:6567:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d95595a200 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:0.0:1777051300.769709:0:6567:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000957ed3e0/0x85f51a6b96714dc4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.769723:0:6567:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000957ed3e0/0x85f51a6b96714dc4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.769756:0:6567:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000957ed3e0/0x85f51a6b96714dc4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1777051300.769757:0:8628:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x1d5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777051300.769775:0:8628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000035b77175/0x85f51a6b96714dd2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1d5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.769791:0:6567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000957ed3e0/0x85f51a6b96714dc4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051300.769799:0:8628:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051300.769804:0:8628:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051300.769813:0:8628:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000035b77175/0x85f51a6b96714dd2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.769826:0:6567:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1777051300.769833:0:6567:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a40f0ac0/0x85f51a6b96714dcb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051300.769834:0:8628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000035b77175/0x85f51a6b96714dd2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.769866:0:6567:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d95595b600 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:1.0:1777051300.769871:0:8628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000035b77175/0x85f51a6b96714dd2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.769874:0:6567:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a40f0ac0/0x85f51a6b96714dcb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051300.769912:0:8628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000035b77175/0x85f51a6b96714dd2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.769931:0:6567:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a40f0ac0/0x85f51a6b96714dcb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051300.769946:0:8628:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1777051300.769953:0:6567:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a40f0ac0/0x85f51a6b96714dcb lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.769968:0:6567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a40f0ac0/0x85f51a6b96714dcb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.769995:0:6567:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1777051300.770031:0:6567:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000035b77175/0x85f51a6b96714dd2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1777051300.770042:0:8628:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x1d4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1777051300.770340:0:6567:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d95595b400 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:0.0:1777051300.770349:0:6567:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000035b77175/0x85f51a6b96714dd2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051300.770374:0:8628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a3e35a7/0x85f51a6b96714dd9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1d4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.770375:0:6567:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000035b77175/0x85f51a6b96714dd2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051300.770414:0:8628:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051300.770419:0:8628:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777051300.770420:0:6567:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000035b77175/0x85f51a6b96714dd2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051300.770426:0:8628:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a3e35a7/0x85f51a6b96714dd9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.770446:0:6567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000035b77175/0x85f51a6b96714dd2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051300.770461:0:8628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007a3e35a7/0x85f51a6b96714dd9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051300.770498:0:8628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a3e35a7/0x85f51a6b96714dd9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.770505:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777051300.770510:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051300.770514:0:8628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007a3e35a7/0x85f51a6b96714dd9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.770516:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051300.770547:0:8628:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1777051300.770561:0:6567:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1777051300.770570:0:6567:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007a3e35a7/0x85f51a6b96714dd9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.770582:0:6567:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d95595ba00 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:0.0:1777051300.770589:0:6567:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007a3e35a7/0x85f51a6b96714dd9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.770602:0:6567:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007a3e35a7/0x85f51a6b96714dd9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.770621:0:6567:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007a3e35a7/0x85f51a6b96714dd9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1777051300.770621:0:8628:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x1d3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777051300.770635:0:8628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007692fab8/0x85f51a6b96714de0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1d3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.770644:0:6567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007a3e35a7/0x85f51a6b96714dd9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051300.770668:0:8628:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051300.770673:0:8628:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051300.770679:0:8628:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007692fab8/0x85f51a6b96714de0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.770681:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777051300.770687:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777051300.770692:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051300.770705:0:8628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007692fab8/0x85f51a6b96714de0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051300.770720:0:8628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007692fab8/0x85f51a6b96714de0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051300.770732:0:8628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007692fab8/0x85f51a6b96714de0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051300.770762:0:8628:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1777051300.770822:0:8628:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x1d2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777051300.770831:0:8628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ee707457/0x85f51a6b96714de7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1d2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051300.770844:0:8628:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051300.770846:0:8628:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051300.770851:0:8628:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ee707457/0x85f51a6b96714de7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051300.770866:0:8628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ee707457/0x85f51a6b96714de7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051300.770879:0:8628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ee707457/0x85f51a6b96714de7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051300.770893:0:8628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ee707457/0x85f51a6b96714de7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051300.770907:0:8628:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1777051300.770955:0:8628:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x1d1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777051300.770963:0:8628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004eb8931b/0x85f51a6b96714dee lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1d1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051300.770976:0:8628:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051300.770978:0:8628:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051300.770985:0:8628:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004eb8931b/0x85f51a6b96714dee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.770995:0:6567:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1777051300.771027:0:6567:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007692fab8/0x85f51a6b96714de0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051300.771029:0:8628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004eb8931b/0x85f51a6b96714dee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051300.771068:0:8628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004eb8931b/0x85f51a6b96714dee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.771076:0:6567:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d95595aa00 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:0.0:1777051300.771087:0:6567:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007692fab8/0x85f51a6b96714de0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051300.771091:0:8628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004eb8931b/0x85f51a6b96714dee lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.771129:0:6567:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007692fab8/0x85f51a6b96714de0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051300.771132:0:8628:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1777051300.771159:0:6567:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007692fab8/0x85f51a6b96714de0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.771173:0:6567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007692fab8/0x85f51a6b96714de0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.771201:0:6567:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1777051300.771207:0:6567:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ee707457/0x85f51a6b96714de7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.771219:0:6567:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da7d507a00 already unused, calling callback (ffffffffc0bed2d0) 00002000:00010000:1.0:1777051300.771225:0:8628:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x1d0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1777051300.771226:0:6567:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ee707457/0x85f51a6b96714de7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051300.771244:0:8628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000012677ec1/0x85f51a6b96714df5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1d0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.771249:0:6567:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ee707457/0x85f51a6b96714de7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051300.771278:0:8628:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051300.771284:0:8628:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777051300.771285:0:6567:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ee707457/0x85f51a6b96714de7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051300.771290:0:8628:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000012677ec1/0x85f51a6b96714df5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.771320:0:6567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ee707457/0x85f51a6b96714de7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051300.771329:0:8628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012677ec1/0x85f51a6b96714df5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051300.771349:0:8628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000012677ec1/0x85f51a6b96714df5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.771352:0:6567:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777051300.771361:0:8628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000012677ec1/0x85f51a6b96714df5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.771363:0:6567:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004eb8931b/0x85f51a6b96714dee lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.771396:0:6567:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da7d507600 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:1.0:1777051300.771399:0:8628:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1777051300.771402:0:6567:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004eb8931b/0x85f51a6b96714dee lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.771416:0:6567:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004eb8931b/0x85f51a6b96714dee lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.771435:0:6567:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004eb8931b/0x85f51a6b96714dee lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1777051300.771461:0:8628:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x1cf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777051300.771473:0:8628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c2e44b85/0x85f51a6b96714dfc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1cf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.771506:0:6567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004eb8931b/0x85f51a6b96714dee lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051300.771508:0:8628:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051300.771513:0:8628:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051300.771518:0:8628:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c2e44b85/0x85f51a6b96714dfc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051300.771546:0:8628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c2e44b85/0x85f51a6b96714dfc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.771551:0:6567:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1777051300.771560:0:6567:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000012677ec1/0x85f51a6b96714df5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051300.771566:0:8628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c2e44b85/0x85f51a6b96714dfc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.771592:0:6567:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da7d507e00 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:1.0:1777051300.771597:0:8628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c2e44b85/0x85f51a6b96714dfc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.771601:0:6567:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000012677ec1/0x85f51a6b96714df5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051300.771638:0:8628:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1777051300.771639:0:6567:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000012677ec1/0x85f51a6b96714df5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.771662:0:6567:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000012677ec1/0x85f51a6b96714df5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.771675:0:6567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012677ec1/0x85f51a6b96714df5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.771702:0:6567:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00002000:00010000:1.0:1777051300.771702:0:8628:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x1ce:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1777051300.771712:0:6567:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c2e44b85/0x85f51a6b96714dfc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051300.771719:0:8628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eeced5ff/0x85f51a6b96714e03 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1ce:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.771740:0:6567:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da7d506000 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:0.0:1777051300.771749:0:6567:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2e44b85/0x85f51a6b96714dfc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051300.771751:0:8628:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051300.771758:0:8628:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051300.771766:0:8628:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eeced5ff/0x85f51a6b96714e03 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.771770:0:6567:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2e44b85/0x85f51a6b96714dfc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051300.771805:0:8628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eeced5ff/0x85f51a6b96714e03 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.771810:0:6567:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c2e44b85/0x85f51a6b96714dfc lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051300.771839:0:8628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eeced5ff/0x85f51a6b96714e03 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.771841:0:6567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c2e44b85/0x85f51a6b96714dfc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051300.771877:0:8628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000eeced5ff/0x85f51a6b96714e03 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.771887:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777051300.771893:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777051300.771899:0:6567:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777051300.771901:0:8628:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1777051300.771905:0:6567:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000eeced5ff/0x85f51a6b96714e03 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.771919:0:6567:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da7d506a00 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:0.0:1777051300.771924:0:6567:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000eeced5ff/0x85f51a6b96714e03 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.771940:0:6567:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000eeced5ff/0x85f51a6b96714e03 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.771958:0:6567:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000eeced5ff/0x85f51a6b96714e03 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1777051300.771966:0:8628:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x1cd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1777051300.771974:0:6567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eeced5ff/0x85f51a6b96714e03 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051300.771980:0:8628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000002225e38/0x85f51a6b96714e0a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1cd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.772041:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777051300.772043:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777051300.772046:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777051300.772423:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777051300.772459:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777051300.772467:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051300.772535:0:8628:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051300.772537:0:8628:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051300.772543:0:8628:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000002225e38/0x85f51a6b96714e0a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051300.772561:0:8628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000002225e38/0x85f51a6b96714e0a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051300.772576:0:8628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000002225e38/0x85f51a6b96714e0a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051300.772588:0:8628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000002225e38/0x85f51a6b96714e0a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051300.772620:0:8628:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1777051300.772651:0:6567:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1777051300.772661:0:6567:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000002225e38/0x85f51a6b96714e0a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.772683:0:6567:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da7d507400 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:0.0:1777051300.772689:0:6567:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000002225e38/0x85f51a6b96714e0a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.772705:0:6567:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000002225e38/0x85f51a6b96714e0a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.772726:0:6567:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000002225e38/0x85f51a6b96714e0a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.772739:0:6567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000002225e38/0x85f51a6b96714e0a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.772766:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777051300.772771:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777051300.772774:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1777051300.772777:0:8628:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x1cc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777051300.772789:0:8628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a4d735a9/0x85f51a6b96714e11 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1cc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051300.772804:0:8628:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051300.772807:0:8628:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051300.772812:0:8628:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a4d735a9/0x85f51a6b96714e11 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051300.772827:0:8628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a4d735a9/0x85f51a6b96714e11 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051300.772841:0:8628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a4d735a9/0x85f51a6b96714e11 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051300.772853:0:8628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a4d735a9/0x85f51a6b96714e11 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051300.772884:0:8628:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1777051300.772941:0:13753:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777051300.772952:0:13753:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a4d735a9/0x85f51a6b96714e11 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1777051300.772956:0:8628:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x1cb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777051300.772967:0:8628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cd357897/0x85f51a6b96714e18 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1cb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051300.772981:0:8628:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051300.772986:0:8628:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051300.772994:0:8628:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cd357897/0x85f51a6b96714e18 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051300.773024:0:13753:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da7d507800 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:2.0:1777051300.773032:0:13753:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a4d735a9/0x85f51a6b96714e11 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051300.773065:0:13753:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a4d735a9/0x85f51a6b96714e11 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051300.773066:0:8628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cd357897/0x85f51a6b96714e18 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051300.773104:0:8628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cd357897/0x85f51a6b96714e18 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051300.773110:0:13753:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a4d735a9/0x85f51a6b96714e11 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051300.773131:0:8628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cd357897/0x85f51a6b96714e18 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051300.773401:0:13753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a4d735a9/0x85f51a6b96714e11 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051300.773433:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777051300.773438:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777051300.773443:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051300.773476:0:8628:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1777051300.773548:0:8628:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x1ca:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777051300.773560:0:8628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000015756c6a/0x85f51a6b96714e1f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1ca:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051300.773577:0:8628:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051300.773580:0:8628:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051300.773585:0:8628:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000015756c6a/0x85f51a6b96714e1f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.773604:0:38719:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777051300.773604:0:8628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000015756c6a/0x85f51a6b96714e1f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.773617:0:38719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cd357897/0x85f51a6b96714e18 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051300.773626:0:8628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000015756c6a/0x85f51a6b96714e1f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.773644:0:38719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da7d506200 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:0.0:1777051300.773654:0:38719:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cd357897/0x85f51a6b96714e18 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051300.773656:0:8628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000015756c6a/0x85f51a6b96714e1f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.773692:0:38719:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cd357897/0x85f51a6b96714e18 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051300.773701:0:8628:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1777051300.773718:0:38719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cd357897/0x85f51a6b96714e18 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.773732:0:38719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cd357897/0x85f51a6b96714e18 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.773781:0:38719:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00002000:00010000:1.0:1777051300.773787:0:8628:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x1c9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1777051300.773788:0:38719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000015756c6a/0x85f51a6b96714e1f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051300.773806:0:8628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d18d61d/0x85f51a6b96714e26 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1c9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051300.773822:0:8628:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051300.773825:0:8628:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051300.773833:0:8628:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007d18d61d/0x85f51a6b96714e26 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.773837:0:38719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da7d506e00 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:0.0:1777051300.773848:0:38719:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000015756c6a/0x85f51a6b96714e1f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051300.773860:0:8628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007d18d61d/0x85f51a6b96714e26 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.773868:0:38719:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000015756c6a/0x85f51a6b96714e1f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051300.773891:0:8628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d18d61d/0x85f51a6b96714e26 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.773901:0:38719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000015756c6a/0x85f51a6b96714e1f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051300.773913:0:8628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007d18d61d/0x85f51a6b96714e26 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.773924:0:38719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000015756c6a/0x85f51a6b96714e1f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.773961:0:38719:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777051300.773961:0:8628:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1777051300.773969:0:38719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007d18d61d/0x85f51a6b96714e26 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.773984:0:38719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da7d507200 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:0.0:1777051300.773989:0:38719:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007d18d61d/0x85f51a6b96714e26 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.774038:0:38719:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007d18d61d/0x85f51a6b96714e26 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.774058:0:38719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007d18d61d/0x85f51a6b96714e26 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1777051300.774064:0:8628:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x1c8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1777051300.774075:0:38719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007d18d61d/0x85f51a6b96714e26 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051300.774082:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051300.774083:0:8628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000154053d8/0x85f51a6b96714e2d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1c8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051300.774111:0:8628:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051300.774114:0:8628:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777051300.774116:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051300.774120:0:8628:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000154053d8/0x85f51a6b96714e2d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.774122:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777051300.774128:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777051300.774146:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051300.774147:0:8628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000154053d8/0x85f51a6b96714e2d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051300.774164:0:8628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000154053d8/0x85f51a6b96714e2d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051300.774178:0:8628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000154053d8/0x85f51a6b96714e2d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051300.774236:0:8628:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1777051300.774273:0:13753:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777051300.774284:0:13753:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000154053d8/0x85f51a6b96714e2d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1777051300.774309:0:8628:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x1c7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1777051300.774312:0:13753:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da7d507c00 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:2.0:1777051300.774324:0:13753:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000154053d8/0x85f51a6b96714e2d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051300.774327:0:8628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000efd61c8/0x85f51a6b96714e34 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1c7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051300.774366:0:13753:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000154053d8/0x85f51a6b96714e2d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051300.774367:0:8628:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051300.774374:0:8628:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051300.774384:0:8628:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000efd61c8/0x85f51a6b96714e34 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051300.774400:0:13753:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000154053d8/0x85f51a6b96714e2d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051300.774406:0:8628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000efd61c8/0x85f51a6b96714e34 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051300.774431:0:13753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000154053d8/0x85f51a6b96714e2d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051300.774438:0:8628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000efd61c8/0x85f51a6b96714e34 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051300.774470:0:8628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000efd61c8/0x85f51a6b96714e34 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051300.774479:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777051300.774484:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777051300.774492:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777051300.774572:0:8628:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1777051300.774658:0:8628:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x1c6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1777051300.774669:0:8628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000062812b6e/0x85f51a6b96714e3b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1c6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.774684:0:8628:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777051300.774687:0:8628:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777051300.774693:0:8628:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000062812b6e/0x85f51a6b96714e3b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.774717:0:8628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000062812b6e/0x85f51a6b96714e3b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.774731:0:8628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000062812b6e/0x85f51a6b96714e3b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.774743:0:8628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000062812b6e/0x85f51a6b96714e3b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.774780:0:8628:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1777051300.775038:0:6568:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1777051300.775049:0:6568:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000efd61c8/0x85f51a6b96714e34 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051300.775066:0:6568:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d953298000 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:2.0:1777051300.775074:0:6568:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000efd61c8/0x85f51a6b96714e34 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051300.775091:0:6568:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000efd61c8/0x85f51a6b96714e34 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1777051300.775097:0:8628:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x1c5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1777051300.775115:0:8628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005fe8468b/0x85f51a6b96714e42 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1c5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051300.775115:0:38719:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777051300.775126:0:6568:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000efd61c8/0x85f51a6b96714e34 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051300.775131:0:38719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000062812b6e/0x85f51a6b96714e3b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.775396:0:8628:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777051300.775402:0:8628:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777051300.775413:0:8628:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005fe8468b/0x85f51a6b96714e42 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051300.775415:0:6568:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000efd61c8/0x85f51a6b96714e34 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051300.775419:0:38719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da429d7000 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:1.0:1777051300.775430:0:38719:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000062812b6e/0x85f51a6b96714e3b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.775469:0:8628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005fe8468b/0x85f51a6b96714e42 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051300.775478:0:38719:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000062812b6e/0x85f51a6b96714e3b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051300.775494:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777051300.775497:0:8628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005fe8468b/0x85f51a6b96714e42 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051300.775500:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777051300.775507:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777051300.775523:0:8628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005fe8468b/0x85f51a6b96714e42 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051300.775523:0:38719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000062812b6e/0x85f51a6b96714e3b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051300.775568:0:38719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000062812b6e/0x85f51a6b96714e3b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.775589:0:8628:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1777051300.775602:0:6567:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777051300.775605:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777051300.775612:0:6567:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005fe8468b/0x85f51a6b96714e42 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051300.775613:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051300.775622:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777051300.775636:0:6567:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da429d7a00 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:2.0:1777051300.775644:0:6567:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005fe8468b/0x85f51a6b96714e42 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051300.775660:0:6567:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005fe8468b/0x85f51a6b96714e42 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1777051300.775669:0:8628:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x1c4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1777051300.775684:0:8628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000070869722/0x85f51a6b96714e49 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1c4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051300.775685:0:6567:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005fe8468b/0x85f51a6b96714e42 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.775724:0:8628:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777051300.775727:0:6567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005fe8468b/0x85f51a6b96714e42 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.775729:0:8628:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777051300.775740:0:8628:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000070869722/0x85f51a6b96714e49 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.775786:0:8628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000070869722/0x85f51a6b96714e49 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051300.775798:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777051300.775804:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777051300.775808:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777051300.775825:0:8628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000070869722/0x85f51a6b96714e49 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.775841:0:8628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000070869722/0x85f51a6b96714e49 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.775873:0:8628:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1777051300.775936:0:8628:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x1c3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1777051300.775945:0:8628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d4050073/0x85f51a6b96714e50 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1c3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.775958:0:8628:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777051300.775960:0:8628:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777051300.775966:0:8628:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d4050073/0x85f51a6b96714e50 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.775980:0:8628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d4050073/0x85f51a6b96714e50 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.775994:0:8628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d4050073/0x85f51a6b96714e50 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.776037:0:8628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d4050073/0x85f51a6b96714e50 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.776073:0:8628:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1777051300.776132:0:8628:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x1c2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1777051300.776141:0:8628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000062488c71/0x85f51a6b96714e57 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1c2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.776154:0:8628:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777051300.776157:0:8628:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777051300.776162:0:8628:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000062488c71/0x85f51a6b96714e57 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.776175:0:8628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000062488c71/0x85f51a6b96714e57 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.776189:0:8628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000062488c71/0x85f51a6b96714e57 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.776244:0:8628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000062488c71/0x85f51a6b96714e57 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.776264:0:8628:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1777051300.777075:0:38719:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1777051300.777088:0:38719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000070869722/0x85f51a6b96714e49 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051300.777107:0:38719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da429d6200 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:1.0:1777051300.777114:0:38719:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000070869722/0x85f51a6b96714e49 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051300.777133:0:38719:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000070869722/0x85f51a6b96714e49 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051300.777161:0:38719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000070869722/0x85f51a6b96714e49 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051300.777177:0:38719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000070869722/0x85f51a6b96714e49 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051300.777239:0:38719:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1777051300.777247:0:38719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d4050073/0x85f51a6b96714e50 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051300.777262:0:38719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da429d7200 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:1.0:1777051300.777268:0:38719:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d4050073/0x85f51a6b96714e50 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051300.777285:0:38719:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d4050073/0x85f51a6b96714e50 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051300.777307:0:38719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d4050073/0x85f51a6b96714e50 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051300.777324:0:38719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d4050073/0x85f51a6b96714e50 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051300.777349:0:38719:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777051300.777355:0:38719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000062488c71/0x85f51a6b96714e57 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051300.777369:0:38719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da429d6400 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:1.0:1777051300.777394:0:38719:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000062488c71/0x85f51a6b96714e57 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051300.777413:0:38719:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000062488c71/0x85f51a6b96714e57 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051300.777434:0:38719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000062488c71/0x85f51a6b96714e57 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051300.777450:0:38719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000062488c71/0x85f51a6b96714e57 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051300.777477:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051300.777483:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051300.777488:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051300.777499:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:0.0:1777051300.777676:0:8628:0:(ofd_dev.c:1515:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:350 00000100:00100000:0.0:1777051300.777796:0:8628:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da70a30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:103178:x1863365452547456:12345-0@lo:5:osp-pre-0-0.0 Request processed in 34170us (35130us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051300.777813:0:8628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7950 00000100:00100000:1.0:1777051300.777884:0:103178:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da70a32a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:103178:1863365452547456:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1777051300.777906:0:103178:0:(osp_precreate.c:955:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x1e1:0x0] from OST, last_created [0x280000401:0x1e1:0x0]last_used is [0x280000401:0x15e:0x0] 00000100:00100000:1.0:1777051300.778053:0:103178:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d956129c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:103178:1863365452547840:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1777051300.778058:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95612b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3680:1863365452547712:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1777051300.778119:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051300.778178:0:103178:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051300.778190:0:10113:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452547712 00000100:00100000:0.0:1777051300.778200:0:10113:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452547712 00000100:00100000:1.0:1777051300.778226:0:103178:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d959b89000 going to sleep for 11 seconds 00000100:00100000:0.0:1777051300.778266:0:10113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5557 00000100:00100000:1.0:1777051300.778275:0:27884:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452547840 00000100:00100000:0.0:1777051300.778285:0:10113:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da44578700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3680:x1863365452547712:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1777051300.778288:0:27884:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452547840 00000100:00100000:1.0:1777051300.778353:0:27884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7952 00002000:00000024:0.0:1777051300.778367:0:10113:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 440354112 pending 0 free 3862671360 avail 3631149056 00000100:00100000:1.0:1777051300.778375:0:27884:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5fbe0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+6:103178:x1863365452547840:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:1.0:1777051300.778427:0:27884:0:(ofd_dev.c:1745:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 482 00000100:00100000:0.0:1777051300.778445:0:10113:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da44578700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3680:x1863365452547712:12345-0@lo:13:osp-pre-0-0.0 Request processed in 164us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051300.778458:0:10113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5557 00000100:00100000:0.0:1777051300.778526:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95612b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3680:1863365452547712:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1777051300.778721:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1777051300.782616:0:27884:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5fbe0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+6:103178:x1863365452547840:12345-0@lo:5:osp-pre-0-0.0 Request processed in 4248us (4438us total) trans 4294968348 rc 0/0 00000100:00100000:0.0:1777051300.782630:0:27884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7952 00000100:00100000:1.0:1777051300.783057:0:103178:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d956129c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:103178:1863365452547840:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1777051300.783080:0:103178:0:(osp_precreate.c:701:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x1e1:0x0]-[0x280000401:0x201:0x0] 00002000:00010000:2.0:1777051300.783110:0:8468:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x1e1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1777051300.783127:0:8468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005fd34adc/0x85f51a6b96714e5e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1e1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051300.783151:0:8468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777051300.783156:0:8468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777051300.783458:0:8468:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005fd34adc/0x85f51a6b96714e5e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051300.783489:0:8468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005fd34adc/0x85f51a6b96714e5e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051300.783507:0:8468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005fd34adc/0x85f51a6b96714e5e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051300.783522:0:8468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005fd34adc/0x85f51a6b96714e5e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051300.783559:0:8468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1777051300.783587:0:6567:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777051300.783602:0:6567:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005fd34adc/0x85f51a6b96714e5e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051300.783620:0:6567:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d95071bc00 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:1.0:1777051300.783629:0:6567:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005fd34adc/0x85f51a6b96714e5e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051300.783646:0:6567:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005fd34adc/0x85f51a6b96714e5e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051300.783674:0:6567:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005fd34adc/0x85f51a6b96714e5e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1777051300.783674:0:8468:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x1e0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1777051300.783693:0:8468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f1104be4/0x85f51a6b96714e65 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1e0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051300.783699:0:6567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005fd34adc/0x85f51a6b96714e5e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051300.784134:0:8468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777051300.784138:0:8468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777051300.784144:0:8468:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f1104be4/0x85f51a6b96714e65 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051300.784165:0:8468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f1104be4/0x85f51a6b96714e65 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051300.784179:0:8468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f1104be4/0x85f51a6b96714e65 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051300.784193:0:8468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f1104be4/0x85f51a6b96714e65 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051300.784264:0:8468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1777051300.784270:0:6567:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777051300.784281:0:6567:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f1104be4/0x85f51a6b96714e65 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051300.784299:0:6567:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d95071aa00 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:3.0:1777051300.784306:0:6567:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f1104be4/0x85f51a6b96714e65 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051300.784324:0:6567:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f1104be4/0x85f51a6b96714e65 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1777051300.784362:0:8468:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x1df:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1777051300.784376:0:8468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000640e40c3/0x85f51a6b96714e6c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1df:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051300.784393:0:8468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777051300.784396:0:8468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777051300.784402:0:8468:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000640e40c3/0x85f51a6b96714e6c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051300.784418:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777051300.784420:0:8468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000640e40c3/0x85f51a6b96714e6c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051300.784446:0:8468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000640e40c3/0x85f51a6b96714e6c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051300.784459:0:8468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000640e40c3/0x85f51a6b96714e6c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051300.784509:0:8468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1777051300.784533:0:6568:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777051300.784544:0:6568:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000640e40c3/0x85f51a6b96714e6c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051300.784562:0:6568:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d95071b000 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:1.0:1777051300.784569:0:6568:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000640e40c3/0x85f51a6b96714e6c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051300.784583:0:6568:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000640e40c3/0x85f51a6b96714e6c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1777051300.784586:0:8468:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x1de:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1777051300.784610:0:8468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e7e145a4/0x85f51a6b96714e73 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1de:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051300.784622:0:6568:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000640e40c3/0x85f51a6b96714e6c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051300.784629:0:8468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777051300.784636:0:8468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777051300.784645:0:8468:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e7e145a4/0x85f51a6b96714e73 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051300.784955:0:6568:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000640e40c3/0x85f51a6b96714e6c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051300.784979:0:6567:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f1104be4/0x85f51a6b96714e65 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051300.784994:0:8468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e7e145a4/0x85f51a6b96714e73 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051300.784995:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051300.785024:0:6567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f1104be4/0x85f51a6b96714e65 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051300.785059:0:8468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e7e145a4/0x85f51a6b96714e73 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051300.785073:0:8468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e7e145a4/0x85f51a6b96714e73 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051300.785080:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051300.785087:0:6567:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777051300.785095:0:6567:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e7e145a4/0x85f51a6b96714e73 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051300.785107:0:8468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1777051300.785110:0:6567:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d95071be00 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:3.0:1777051300.785119:0:6567:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e7e145a4/0x85f51a6b96714e73 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051300.785134:0:6567:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e7e145a4/0x85f51a6b96714e73 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.785159:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1777051300.785185:0:8468:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x1dd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1777051300.785225:0:8468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b639fb2a/0x85f51a6b96714e7a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1dd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051300.785242:0:8468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777051300.785245:0:8468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777051300.785249:0:8468:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b639fb2a/0x85f51a6b96714e7a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051300.785262:0:8468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b639fb2a/0x85f51a6b96714e7a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051300.785272:0:8468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b639fb2a/0x85f51a6b96714e7a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051300.785283:0:8468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b639fb2a/0x85f51a6b96714e7a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051300.785347:0:6567:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e7e145a4/0x85f51a6b96714e73 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051300.785366:0:6567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e7e145a4/0x85f51a6b96714e73 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.785412:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051300.785416:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777051300.785420:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051300.785424:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051300.785432:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051300.785749:0:8468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1777051300.785830:0:8468:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x1dc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777051300.785841:0:8468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009b978632/0x85f51a6b96714e81 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1dc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051300.785856:0:8468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051300.785859:0:8468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051300.785864:0:8468:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009b978632/0x85f51a6b96714e81 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051300.785892:0:8468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009b978632/0x85f51a6b96714e81 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051300.785905:0:8468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009b978632/0x85f51a6b96714e81 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051300.785918:0:8468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009b978632/0x85f51a6b96714e81 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051300.785950:0:8468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1777051300.786038:0:13753:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00002000:00010000:3.0:1777051300.786046:0:8468:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x1db:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777051300.786057:0:8468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000076fc7672/0x85f51a6b96714e88 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1db:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.786058:0:13753:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b639fb2a/0x85f51a6b96714e7a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051300.786082:0:8468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051300.786087:0:8468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051300.786093:0:8468:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000076fc7672/0x85f51a6b96714e88 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.786097:0:13753:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d95071ac00 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:0.0:1777051300.786109:0:13753:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b639fb2a/0x85f51a6b96714e7a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051300.786122:0:8468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000076fc7672/0x85f51a6b96714e88 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.786133:0:13753:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b639fb2a/0x85f51a6b96714e7a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051300.786146:0:8468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000076fc7672/0x85f51a6b96714e88 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051300.786167:0:8468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000076fc7672/0x85f51a6b96714e88 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.786172:0:13753:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b639fb2a/0x85f51a6b96714e7a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.786201:0:13753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b639fb2a/0x85f51a6b96714e7a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.786231:0:13753:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1777051300.786238:0:13753:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009b978632/0x85f51a6b96714e81 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051300.786249:0:8468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1777051300.786253:0:13753:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da7d785200 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:0.0:1777051300.786262:0:13753:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009b978632/0x85f51a6b96714e81 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.786280:0:13753:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009b978632/0x85f51a6b96714e81 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051300.786328:0:6568:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00002000:00010000:3.0:1777051300.786328:0:8468:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x1da:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1777051300.786333:0:13753:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009b978632/0x85f51a6b96714e81 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051300.786346:0:6568:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000076fc7672/0x85f51a6b96714e88 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051300.786349:0:8468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000060c30f6d/0x85f51a6b96714e8f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1da:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.786362:0:13753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009b978632/0x85f51a6b96714e81 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051300.786397:0:6568:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da7d785600 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:3.0:1777051300.786397:0:8468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051300.786403:0:8468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777051300.786408:0:6568:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000076fc7672/0x85f51a6b96714e88 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051300.786412:0:8468:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000060c30f6d/0x85f51a6b96714e8f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051300.786452:0:6568:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000076fc7672/0x85f51a6b96714e88 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.786456:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051300.786459:0:8468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000060c30f6d/0x85f51a6b96714e8f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.786464:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777051300.786471:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051300.786503:0:8468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000060c30f6d/0x85f51a6b96714e8f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051300.786522:0:6568:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000076fc7672/0x85f51a6b96714e88 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051300.786523:0:8468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000060c30f6d/0x85f51a6b96714e8f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051300.786572:0:6568:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000076fc7672/0x85f51a6b96714e88 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051300.786600:0:8468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1777051300.786605:0:6568:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777051300.786613:0:6568:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000060c30f6d/0x85f51a6b96714e8f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051300.786627:0:6568:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da7d784600 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:2.0:1777051300.786635:0:6568:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000060c30f6d/0x85f51a6b96714e8f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051300.786650:0:6568:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000060c30f6d/0x85f51a6b96714e8f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.786663:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777051300.786674:0:6568:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000060c30f6d/0x85f51a6b96714e8f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1777051300.786675:0:8468:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x1d9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1777051300.786702:0:6568:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000060c30f6d/0x85f51a6b96714e8f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051300.786726:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777051300.786729:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777051300.786733:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051300.787368:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051300.787547:0:8468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002af3bbf5/0x85f51a6b96714e96 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1d9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051300.787563:0:8468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051300.787566:0:8468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051300.787572:0:8468:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002af3bbf5/0x85f51a6b96714e96 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051300.787589:0:8468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002af3bbf5/0x85f51a6b96714e96 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051300.787602:0:8468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002af3bbf5/0x85f51a6b96714e96 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051300.787615:0:8468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002af3bbf5/0x85f51a6b96714e96 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051300.787643:0:8468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1777051300.788104:0:8468:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x1d8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777051300.788115:0:8468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000513568eb/0x85f51a6b96714e9d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1d8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051300.788132:0:8468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051300.788135:0:8468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051300.788140:0:8468:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000513568eb/0x85f51a6b96714e9d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051300.788155:0:8468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000513568eb/0x85f51a6b96714e9d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051300.788168:0:8468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000513568eb/0x85f51a6b96714e9d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051300.788190:0:8468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000513568eb/0x85f51a6b96714e9d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051300.788274:0:8468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1777051300.788316:0:6567:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1777051300.788328:0:6567:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002af3bbf5/0x85f51a6b96714e96 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051300.788346:0:6567:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da7d785e00 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:1.0:1777051300.788353:0:6567:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002af3bbf5/0x85f51a6b96714e96 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1777051300.788357:0:8468:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x1d7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777051300.788377:0:8468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a7f30ece/0x85f51a6b96714ea4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1d7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051300.788380:0:6567:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002af3bbf5/0x85f51a6b96714e96 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051300.788414:0:8468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051300.788418:0:8468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051300.788424:0:8468:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a7f30ece/0x85f51a6b96714ea4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051300.788458:0:6567:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002af3bbf5/0x85f51a6b96714e96 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051300.788458:0:8468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a7f30ece/0x85f51a6b96714ea4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051300.788495:0:8468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a7f30ece/0x85f51a6b96714ea4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051300.788497:0:6567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002af3bbf5/0x85f51a6b96714e96 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051300.788540:0:8468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a7f30ece/0x85f51a6b96714ea4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051300.788559:0:6567:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777051300.788568:0:6567:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000513568eb/0x85f51a6b96714e9d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051300.788573:0:8468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1777051300.788581:0:13753:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777051300.788597:0:6567:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da7d784c00 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:2.0:1777051300.788599:0:13753:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a7f30ece/0x85f51a6b96714ea4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051300.788605:0:6567:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000513568eb/0x85f51a6b96714e9d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051300.788634:0:13753:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da713e2e00 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:2.0:1777051300.788642:0:13753:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a7f30ece/0x85f51a6b96714ea4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1777051300.788647:0:8468:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x1d6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777051300.788672:0:8468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cd6bdc6a/0x85f51a6b96714eab lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1d6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051300.788674:0:6567:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000513568eb/0x85f51a6b96714e9d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051300.788678:0:13753:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a7f30ece/0x85f51a6b96714ea4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051300.788736:0:8468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051300.788740:0:8468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051300.788743:0:6567:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000513568eb/0x85f51a6b96714e9d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051300.788747:0:8468:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cd6bdc6a/0x85f51a6b96714eab lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051300.788748:0:13753:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a7f30ece/0x85f51a6b96714ea4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051300.788798:0:6567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000513568eb/0x85f51a6b96714e9d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051300.788802:0:13753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a7f30ece/0x85f51a6b96714ea4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051300.788805:0:8468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cd6bdc6a/0x85f51a6b96714eab lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051300.788855:0:8468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cd6bdc6a/0x85f51a6b96714eab lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051300.788866:0:8468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cd6bdc6a/0x85f51a6b96714eab lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051300.788873:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051300.788882:0:6567:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777051300.788882:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777051300.788889:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051300.788889:0:8468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1777051300.788893:0:6567:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cd6bdc6a/0x85f51a6b96714eab lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051300.788897:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051300.788912:0:6567:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d955a99200 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:2.0:1777051300.788914:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051300.788924:0:6567:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cd6bdc6a/0x85f51a6b96714eab lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051300.788941:0:6567:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cd6bdc6a/0x85f51a6b96714eab lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1777051300.788948:0:8468:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x1d5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777051300.788963:0:8468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000059ff3362/0x85f51a6b96714eb2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1d5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051300.788973:0:6567:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cd6bdc6a/0x85f51a6b96714eab lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051300.788975:0:8468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051300.788980:0:8468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051300.788987:0:8468:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000059ff3362/0x85f51a6b96714eb2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051300.789039:0:6567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cd6bdc6a/0x85f51a6b96714eab lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051300.789050:0:8468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000059ff3362/0x85f51a6b96714eb2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051300.789072:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051300.789078:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051300.789083:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051300.789086:0:8468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000059ff3362/0x85f51a6b96714eb2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051300.789096:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051300.789103:0:8468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000059ff3362/0x85f51a6b96714eb2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051300.789141:0:8468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1777051300.789211:0:13753:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777051300.789225:0:13753:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000059ff3362/0x85f51a6b96714eb2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051300.789243:0:13753:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d955a8f000 already unused, calling callback (ffffffffc0bed2d0) 00002000:00010000:3.0:1777051300.789250:0:8468:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x1d4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1777051300.789251:0:13753:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000059ff3362/0x85f51a6b96714eb2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051300.789269:0:8468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005c4d4f80/0x85f51a6b96714eb9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1d4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051300.789277:0:13753:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000059ff3362/0x85f51a6b96714eb2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051300.789300:0:8468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051300.789305:0:8468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051300.789312:0:8468:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005c4d4f80/0x85f51a6b96714eb9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051300.789315:0:13753:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000059ff3362/0x85f51a6b96714eb2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051300.789351:0:13753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000059ff3362/0x85f51a6b96714eb2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051300.789353:0:8468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005c4d4f80/0x85f51a6b96714eb9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051300.789394:0:8468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005c4d4f80/0x85f51a6b96714eb9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051300.789403:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051300.789405:0:8468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005c4d4f80/0x85f51a6b96714eb9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051300.789411:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777051300.789418:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051300.789454:0:8468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1777051300.789529:0:8468:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x1d3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777051300.789539:0:8468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003c75feec/0x85f51a6b96714ec0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1d3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051300.789553:0:8468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051300.789555:0:8468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051300.789561:0:8468:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c75feec/0x85f51a6b96714ec0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051300.789578:0:8468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003c75feec/0x85f51a6b96714ec0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051300.789592:0:8468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003c75feec/0x85f51a6b96714ec0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051300.789604:0:8468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003c75feec/0x85f51a6b96714ec0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051300.789647:0:8468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1777051300.789726:0:8468:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x1d2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777051300.789736:0:8468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d6dbcff1/0x85f51a6b96714ec7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1d2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051300.789749:0:8468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051300.789752:0:8468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051300.789758:0:8468:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d6dbcff1/0x85f51a6b96714ec7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051300.789775:0:8468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d6dbcff1/0x85f51a6b96714ec7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051300.789790:0:8468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d6dbcff1/0x85f51a6b96714ec7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051300.789802:0:8468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d6dbcff1/0x85f51a6b96714ec7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051300.789829:0:8468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1777051300.789842:0:38719:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1777051300.789849:0:38719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005c4d4f80/0x85f51a6b96714eb9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051300.789863:0:38719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d955a8e200 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:3.0:1777051300.789868:0:38719:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005c4d4f80/0x85f51a6b96714eb9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051300.789875:0:6567:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1777051300.789879:0:38719:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005c4d4f80/0x85f51a6b96714eb9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051300.789891:0:6568:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777051300.789891:0:6567:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003c75feec/0x85f51a6b96714ec0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051300.789898:0:38719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005c4d4f80/0x85f51a6b96714eb9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051300.789907:0:6568:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d6dbcff1/0x85f51a6b96714ec7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051300.789939:0:6567:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d955a8e400 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:3.0:1777051300.789946:0:38719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005c4d4f80/0x85f51a6b96714eb9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051300.789951:0:6567:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003c75feec/0x85f51a6b96714ec0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051300.789956:0:6568:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d955a8e800 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:1.0:1777051300.789969:0:6568:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d6dbcff1/0x85f51a6b96714ec7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051300.789981:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051300.789988:0:6568:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d6dbcff1/0x85f51a6b96714ec7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051300.789990:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051300.789997:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777051300.790037:0:6567:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003c75feec/0x85f51a6b96714ec0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051300.790054:0:6568:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d6dbcff1/0x85f51a6b96714ec7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051300.790066:0:6567:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003c75feec/0x85f51a6b96714ec0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051300.790074:0:6568:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d6dbcff1/0x85f51a6b96714ec7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1777051300.790105:0:8468:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x1d1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777051300.790130:0:8468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008f2c258c/0x85f51a6b96714ece lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1d1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051300.790133:0:6567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003c75feec/0x85f51a6b96714ec0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051300.790146:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051300.790153:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051300.790161:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051300.790175:0:8468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051300.790181:0:8468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051300.790189:0:8468:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008f2c258c/0x85f51a6b96714ece lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051300.790194:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777051300.790199:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777051300.790202:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051300.790272:0:8468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008f2c258c/0x85f51a6b96714ece lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051300.790289:0:8468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008f2c258c/0x85f51a6b96714ece lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051300.790303:0:8468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008f2c258c/0x85f51a6b96714ece lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051300.790347:0:8468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1777051300.790389:0:13753:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777051300.790398:0:13753:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008f2c258c/0x85f51a6b96714ece lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051300.790412:0:13753:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d955a8fc00 already unused, calling callback (ffffffffc0bed2d0) 00002000:00010000:3.0:1777051300.790416:0:8468:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x1d0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1777051300.790419:0:13753:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008f2c258c/0x85f51a6b96714ece lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051300.790430:0:8468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002e2f0676/0x85f51a6b96714ed5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1d0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051300.790441:0:13753:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008f2c258c/0x85f51a6b96714ece lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051300.790460:0:8468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051300.790466:0:8468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051300.790473:0:8468:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002e2f0676/0x85f51a6b96714ed5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051300.790474:0:13753:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008f2c258c/0x85f51a6b96714ece lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051300.790515:0:13753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008f2c258c/0x85f51a6b96714ece lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051300.790536:0:8468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002e2f0676/0x85f51a6b96714ed5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051300.790549:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051300.790554:0:8468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002e2f0676/0x85f51a6b96714ed5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051300.790556:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777051300.790564:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051300.790576:0:8468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002e2f0676/0x85f51a6b96714ed5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051300.790608:0:8468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1777051300.790630:0:38719:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777051300.790639:0:38719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002e2f0676/0x85f51a6b96714ed5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051300.790656:0:38719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d955a8f800 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:2.0:1777051300.790663:0:38719:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002e2f0676/0x85f51a6b96714ed5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051300.790678:0:38719:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002e2f0676/0x85f51a6b96714ed5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051300.790701:0:38719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002e2f0676/0x85f51a6b96714ed5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1777051300.790701:0:8468:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x1cf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777051300.790725:0:8468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ac6611c9/0x85f51a6b96714edc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1cf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051300.790727:0:38719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002e2f0676/0x85f51a6b96714ed5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051300.790768:0:8468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051300.790774:0:8468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051300.790781:0:8468:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ac6611c9/0x85f51a6b96714edc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051300.790784:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777051300.790791:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777051300.790799:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051300.790809:0:8468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ac6611c9/0x85f51a6b96714edc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051300.790827:0:8468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ac6611c9/0x85f51a6b96714edc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051300.790842:0:8468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ac6611c9/0x85f51a6b96714edc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051300.790880:0:8468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1777051300.790927:0:6568:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777051300.790938:0:6568:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ac6611c9/0x85f51a6b96714edc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051300.790953:0:6568:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d955a8fa00 already unused, calling callback (ffffffffc0bed2d0) 00002000:00010000:3.0:1777051300.790954:0:8468:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x1ce:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1777051300.790961:0:6568:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac6611c9/0x85f51a6b96714edc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051300.790967:0:8468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004640232d/0x85f51a6b96714ee3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1ce:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051300.791031:0:6568:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac6611c9/0x85f51a6b96714edc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051300.791051:0:6568:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ac6611c9/0x85f51a6b96714edc lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051300.791065:0:6568:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ac6611c9/0x85f51a6b96714edc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051300.791092:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777051300.791095:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777051300.791098:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051300.791210:0:8468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051300.791214:0:8468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051300.791221:0:8468:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004640232d/0x85f51a6b96714ee3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051300.791242:0:8468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004640232d/0x85f51a6b96714ee3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051300.791258:0:8468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004640232d/0x85f51a6b96714ee3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051300.791272:0:8468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004640232d/0x85f51a6b96714ee3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051300.791303:0:8468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1777051300.791457:0:8468:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x1cd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777051300.791470:0:8468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e7e9f35d/0x85f51a6b96714eea lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1cd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051300.791486:0:8468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051300.791489:0:8468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051300.791494:0:8468:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e7e9f35d/0x85f51a6b96714eea lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051300.791508:0:8468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e7e9f35d/0x85f51a6b96714eea lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051300.791518:0:8468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e7e9f35d/0x85f51a6b96714eea lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051300.791527:0:8468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e7e9f35d/0x85f51a6b96714eea lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051300.791556:0:8468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1777051300.791611:0:8468:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x1cc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777051300.791622:0:8468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002a403988/0x85f51a6b96714ef1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1cc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051300.791645:0:8468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051300.791648:0:8468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051300.791654:0:8468:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002a403988/0x85f51a6b96714ef1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051300.791673:0:8468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002a403988/0x85f51a6b96714ef1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051300.791688:0:8468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002a403988/0x85f51a6b96714ef1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051300.791693:0:6567:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1777051300.791707:0:6567:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004640232d/0x85f51a6b96714ee3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051300.791721:0:8468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002a403988/0x85f51a6b96714ef1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051300.791741:0:6567:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d955a8f600 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:3.0:1777051300.791756:0:8468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1777051300.791768:0:6567:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004640232d/0x85f51a6b96714ee3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051300.791796:0:6567:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004640232d/0x85f51a6b96714ee3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051300.791823:0:6567:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004640232d/0x85f51a6b96714ee3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1777051300.791843:0:8468:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x1cb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1777051300.791847:0:6567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004640232d/0x85f51a6b96714ee3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051300.791858:0:8468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003c36c963/0x85f51a6b96714ef8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1cb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051300.791885:0:6567:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1777051300.791898:0:6567:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e7e9f35d/0x85f51a6b96714eea lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051300.791900:0:8468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051300.791906:0:8468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051300.791914:0:8468:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c36c963/0x85f51a6b96714ef8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051300.791922:0:6567:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d955a8ec00 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:2.0:1777051300.791933:0:6567:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e7e9f35d/0x85f51a6b96714eea lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051300.791941:0:8468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003c36c963/0x85f51a6b96714ef8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051300.791961:0:6567:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e7e9f35d/0x85f51a6b96714eea lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051300.791967:0:8468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003c36c963/0x85f51a6b96714ef8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051300.791998:0:8468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003c36c963/0x85f51a6b96714ef8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051300.792029:0:6567:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e7e9f35d/0x85f51a6b96714eea lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051300.792049:0:6567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e7e9f35d/0x85f51a6b96714eea lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051300.792052:0:8468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1777051300.792099:0:6567:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1777051300.792107:0:6567:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002a403988/0x85f51a6b96714ef1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051300.792121:0:6567:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d955a8e000 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:2.0:1777051300.792129:0:6567:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002a403988/0x85f51a6b96714ef1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1777051300.792143:0:8468:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x1ca:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1777051300.792145:0:6567:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002a403988/0x85f51a6b96714ef1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051300.792162:0:8468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000096a3a23f/0x85f51a6b96714eff lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1ca:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051300.792174:0:6567:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002a403988/0x85f51a6b96714ef1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051300.792232:0:8468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051300.792236:0:8468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051300.792243:0:8468:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000096a3a23f/0x85f51a6b96714eff lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051300.792268:0:6567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002a403988/0x85f51a6b96714ef1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051300.792276:0:8468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000096a3a23f/0x85f51a6b96714eff lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051300.792302:0:8468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000096a3a23f/0x85f51a6b96714eff lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051300.792308:0:6567:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777051300.792319:0:6567:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003c36c963/0x85f51a6b96714ef8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051300.792320:0:8468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000096a3a23f/0x85f51a6b96714eff lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051300.792360:0:6567:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d955a8e600 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:2.0:1777051300.792367:0:6567:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003c36c963/0x85f51a6b96714ef8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051300.792367:0:8468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1777051300.792387:0:6567:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003c36c963/0x85f51a6b96714ef8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051300.792409:0:6567:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003c36c963/0x85f51a6b96714ef8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051300.792425:0:6567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003c36c963/0x85f51a6b96714ef8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051300.792451:0:6567:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00002000:00010000:3.0:1777051300.792455:0:8468:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x1c9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1777051300.792458:0:6567:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000096a3a23f/0x85f51a6b96714eff lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051300.792468:0:8468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000019ca9e81/0x85f51a6b96714f06 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1c9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051300.792488:0:6567:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d955a8ea00 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:3.0:1777051300.792492:0:8468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777051300.792496:0:6567:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000096a3a23f/0x85f51a6b96714eff lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051300.792496:0:8468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051300.792504:0:8468:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000019ca9e81/0x85f51a6b96714f06 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051300.792535:0:6567:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000096a3a23f/0x85f51a6b96714eff lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051300.792537:0:8468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000019ca9e81/0x85f51a6b96714f06 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051300.792585:0:6567:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000096a3a23f/0x85f51a6b96714eff lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051300.792588:0:8468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000019ca9e81/0x85f51a6b96714f06 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051300.792627:0:6567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000096a3a23f/0x85f51a6b96714eff lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051300.792629:0:8468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000019ca9e81/0x85f51a6b96714f06 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051300.792675:0:8468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1777051300.792680:0:6567:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777051300.792688:0:6567:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000019ca9e81/0x85f51a6b96714f06 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051300.792702:0:6567:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d955a8f200 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:2.0:1777051300.792709:0:6567:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000019ca9e81/0x85f51a6b96714f06 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051300.792735:0:6567:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000019ca9e81/0x85f51a6b96714f06 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1777051300.792740:0:8468:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x1c8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777051300.792760:0:8468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002d5e2d19/0x85f51a6b96714f0d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1c8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051300.792762:0:6567:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000019ca9e81/0x85f51a6b96714f06 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051300.792798:0:8468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777051300.792801:0:6567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000019ca9e81/0x85f51a6b96714f06 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051300.792804:0:8468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051300.792813:0:8468:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002d5e2d19/0x85f51a6b96714f0d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051300.792838:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051300.792838:0:8468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002d5e2d19/0x85f51a6b96714f0d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051300.792846:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777051300.792851:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051300.792865:0:8468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002d5e2d19/0x85f51a6b96714f0d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051300.792868:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777051300.792878:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051300.792880:0:8468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002d5e2d19/0x85f51a6b96714f0d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051300.792904:0:8468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1777051300.792929:0:6567:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777051300.792938:0:6567:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002d5e2d19/0x85f51a6b96714f0d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051300.792952:0:6567:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d955a8f400 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:2.0:1777051300.792959:0:6567:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002d5e2d19/0x85f51a6b96714f0d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1777051300.792963:0:8468:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x1c7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777051300.792983:0:8468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008d6ae8ef/0x85f51a6b96714f14 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1c7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051300.792984:0:6567:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002d5e2d19/0x85f51a6b96714f0d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051300.793035:0:8468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051300.793046:0:8468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051300.793052:0:8468:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008d6ae8ef/0x85f51a6b96714f14 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051300.793053:0:6567:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002d5e2d19/0x85f51a6b96714f0d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051300.793095:0:6567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002d5e2d19/0x85f51a6b96714f0d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051300.793098:0:8468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008d6ae8ef/0x85f51a6b96714f14 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051300.793131:0:8468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008d6ae8ef/0x85f51a6b96714f14 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051300.793137:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777051300.793143:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051300.793147:0:8468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008d6ae8ef/0x85f51a6b96714f14 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051300.793150:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051300.793181:0:8468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1777051300.793253:0:38719:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777051300.793261:0:38719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008d6ae8ef/0x85f51a6b96714f14 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051300.793278:0:38719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d955a8ee00 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:2.0:1777051300.793285:0:38719:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008d6ae8ef/0x85f51a6b96714f14 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1777051300.793299:0:8468:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x1c6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1777051300.793300:0:38719:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008d6ae8ef/0x85f51a6b96714f14 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051300.793319:0:8468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003b0fc921/0x85f51a6b96714f1b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1c6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051300.793331:0:38719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008d6ae8ef/0x85f51a6b96714f14 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051300.793335:0:8468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051300.793342:0:8468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051300.793350:0:8468:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003b0fc921/0x85f51a6b96714f1b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051300.793356:0:38719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008d6ae8ef/0x85f51a6b96714f14 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051300.793389:0:8468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003b0fc921/0x85f51a6b96714f1b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051300.793401:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777051300.793407:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051300.793408:0:8468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003b0fc921/0x85f51a6b96714f1b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051300.793410:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051300.793425:0:8468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003b0fc921/0x85f51a6b96714f1b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051300.793465:0:8468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1777051300.793511:0:13753:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1777051300.793522:0:13753:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003b0fc921/0x85f51a6b96714f1b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.793537:0:13753:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94ffbd200 already unused, calling callback (ffffffffc0bed2d0) 00002000:00010000:3.0:1777051300.793539:0:8468:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x1c5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1777051300.793544:0:13753:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003b0fc921/0x85f51a6b96714f1b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051300.793551:0:8468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000628ef852/0x85f51a6b96714f22 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1c5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.793567:0:13753:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003b0fc921/0x85f51a6b96714f1b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051300.793576:0:8468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051300.793582:0:8468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051300.793591:0:8468:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000628ef852/0x85f51a6b96714f22 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.793600:0:13753:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003b0fc921/0x85f51a6b96714f1b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051300.793615:0:8468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000628ef852/0x85f51a6b96714f22 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.793620:0:13753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003b0fc921/0x85f51a6b96714f1b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051300.793653:0:8468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000628ef852/0x85f51a6b96714f22 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051300.793683:0:8468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000628ef852/0x85f51a6b96714f22 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.793687:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777051300.793692:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777051300.793697:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051300.793725:0:8468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1777051300.793738:0:6567:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1777051300.793746:0:6567:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000628ef852/0x85f51a6b96714f22 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.793761:0:6567:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94ffbd400 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:0.0:1777051300.793767:0:6567:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000628ef852/0x85f51a6b96714f22 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.793782:0:6567:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000628ef852/0x85f51a6b96714f22 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.793801:0:6567:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000628ef852/0x85f51a6b96714f22 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1777051300.793814:0:8468:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x1c4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1777051300.793815:0:6567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000628ef852/0x85f51a6b96714f22 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051300.793834:0:8468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000067e8cdca/0x85f51a6b96714f29 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1c4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.793851:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051300.793853:0:8468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777051300.793860:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051300.793860:0:8468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051300.793866:0:8468:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000067e8cdca/0x85f51a6b96714f29 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.793867:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051300.793888:0:8468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000067e8cdca/0x85f51a6b96714f29 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051300.793901:0:8468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000067e8cdca/0x85f51a6b96714f29 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051300.793914:0:8468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000067e8cdca/0x85f51a6b96714f29 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051300.793953:0:8468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1777051300.794037:0:38719:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1777051300.794051:0:38719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000067e8cdca/0x85f51a6b96714f29 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1777051300.794061:0:8468:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x1c3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777051300.794082:0:8468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d70643ba/0x85f51a6b96714f30 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1c3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.794093:0:38719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94ffbdc00 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:0.0:1777051300.794103:0:38719:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000067e8cdca/0x85f51a6b96714f29 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051300.794108:0:8468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051300.794115:0:8468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051300.794124:0:8468:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d70643ba/0x85f51a6b96714f30 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.794130:0:38719:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000067e8cdca/0x85f51a6b96714f29 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051300.794159:0:8468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d70643ba/0x85f51a6b96714f30 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.794169:0:38719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000067e8cdca/0x85f51a6b96714f29 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051300.794180:0:8468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d70643ba/0x85f51a6b96714f30 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051300.794200:0:38719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000067e8cdca/0x85f51a6b96714f29 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051300.794241:0:8468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d70643ba/0x85f51a6b96714f30 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051300.794265:0:8468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1777051300.794328:0:8468:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x1c2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777051300.794338:0:8468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003000ebea/0x85f51a6b96714f37 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1c2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051300.794341:0:6568:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777051300.794356:0:6568:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d70643ba/0x85f51a6b96714f30 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051300.794360:0:8468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051300.794366:0:8468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051300.794375:0:8468:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003000ebea/0x85f51a6b96714f37 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051300.794384:0:6568:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94ffbda00 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:2.0:1777051300.794396:0:6568:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d70643ba/0x85f51a6b96714f30 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051300.794404:0:8468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003000ebea/0x85f51a6b96714f37 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051300.794426:0:6568:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d70643ba/0x85f51a6b96714f30 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051300.794432:0:8468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003000ebea/0x85f51a6b96714f37 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051300.794467:0:8468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003000ebea/0x85f51a6b96714f37 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051300.794469:0:6568:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d70643ba/0x85f51a6b96714f30 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051300.794502:0:6568:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d70643ba/0x85f51a6b96714f30 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051300.794512:0:8468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1777051300.794532:0:6568:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777051300.794540:0:6568:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003000ebea/0x85f51a6b96714f37 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051300.794554:0:6568:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94ffbc600 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:2.0:1777051300.794561:0:6568:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003000ebea/0x85f51a6b96714f37 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051300.794576:0:6568:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003000ebea/0x85f51a6b96714f37 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051300.794618:0:6568:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003000ebea/0x85f51a6b96714f37 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051300.794632:0:6568:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003000ebea/0x85f51a6b96714f37 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051300.794665:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777051300.794672:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777051300.794677:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777051300.795177:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777051300.795183:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777051300.795187:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777051300.795475:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777051300.795491:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:3.0:1777051300.796743:0:8468:0:(ofd_dev.c:1515:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:350 00000100:00100000:3.0:1777051300.796893:0:8468:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:103180:x1863365452547584:12345-0@lo:5:osp-pre-1-0.0 Request processed in 51423us (53299us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051300.796911:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7951 00000100:00100000:2.0:1777051300.796985:0:103180:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f9bd180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:103180:1863365452547584:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1777051300.797334:0:103180:0:(osp_precreate.c:955:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x1e1:0x0] from OST, last_created [0x2c0000401:0x1e1:0x0]last_used is [0x2c0000401:0x15e:0x0] 00000100:00100000:2.0:1777051300.797461:0:103180:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f9bc000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:103180:1863365452548096:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1777051300.797462:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f9bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3677:1863365452547968:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1777051300.797538:0:103180:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051300.797574:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051300.797625:0:24468:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452548096 00000100:00100000:2.0:1777051300.797627:0:103180:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d95ba62e40 going to sleep for 11 seconds 00000100:00100000:3.0:1777051300.797636:0:24468:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452548096 00000100:00100000:1.0:1777051300.797682:0:47388:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452547968 00000100:00100000:1.0:1777051300.797693:0:47388:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452547968 00000100:00100000:3.0:1777051300.797705:0:24468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7953 00000100:00100000:3.0:1777051300.797729:0:24468:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:103180:x1863365452548096:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1777051300.797788:0:24468:0:(ofd_dev.c:1745:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 482 00000100:00100000:1.0:1777051300.798291:0:47388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5558 00000100:00100000:1.0:1777051300.798311:0:47388:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5fbe2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3677:x1863365452547968:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1777051300.798338:0:47388:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 430294336 pending 896 free 3645853696 avail 3414331392 00000100:00100000:1.0:1777051300.798431:0:47388:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5fbe2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3677:x1863365452547968:12345-0@lo:13:osp-pre-1-0.0 Request processed in 126us (861us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051300.798448:0:47388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5558 00000100:00100000:2.0:1777051300.798642:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f9bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3677:1863365452547968:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1777051300.801509:0:24468:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:103180:x1863365452548096:12345-0@lo:5:osp-pre-1-0.0 Request processed in 3788us (3971us total) trans 4294968351 rc 0/0 00000100:00100000:3.0:1777051300.801524:0:24468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7953 00000100:00100000:2.0:1777051300.801684:0:103180:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f9bc000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:103180:1863365452548096:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1777051300.801705:0:103180:0:(osp_precreate.c:701:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x1e1:0x0]-[0x2c0000401:0x201:0x0] 00010000:00010000:2.0:1777051300.950364:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777051301.143844:0:3677:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1777051301.143877:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da70a32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452548224:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1777051301.143971:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051301.144106:0:10113:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452548224 00000100:00100000:3.0:1777051301.144117:0:10113:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452548224 00000100:00100000:3.0:1777051301.144246:0:10113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5559 00000100:00100000:3.0:1777051301.144264:0:10113:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da70a32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3677:x1863365452548224:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1777051301.144298:0:10113:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 440353216 pending 0 free 3862671360 avail 3631149056 00000100:00100000:3.0:1777051301.144405:0:10113:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da70a32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3677:x1863365452548224:12345-0@lo:13:osp-pre-0-1.0 Request processed in 143us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051301.144493:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da70a32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452548224:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1777051301.146454:0:10113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5559 00000020:00000004:1.0:1777051301.327676:0:103538:0:(tgt_mount.c:2297:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1777051301.329159:0:103538:0:(tgt_mount.c:2312:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1777051301.974646:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777051302.754038:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051302.755551:0:103165:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425872384 00000100:00100000:2.0:1777051302.755567:0:103165:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425872384 00000100:00100000:2.0:1777051302.755642:0:103165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 62 00000100:00100000:2.0:1777051302.755656:0:103165:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d941bf7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2435:x1863365425872384:12345-192.168.201.46@tcp:250:kworker.0 00010000:00080000:2.0:1777051302.755695:0:103165:0:(ldlm_lib.c:1431:target_handle_connect()) MGS: connection from 29c4352d-3260-4734-909d-9ea5de9e7fa4@192.168.201.46@tcp t0 exp 0000000000000000 cur 7931 last 0 00000020:00000080:2.0:1777051302.755731:0:103165:0:(genops.c:1406:class_connect()) connect: client 29c4352d-3260-4734-909d-9ea5de9e7fa4, cookie 0x85f51a6b96714f3e 00000100:00080000:2.0:1777051302.755936:0:103165:0:(import.c:65:import_set_state_nolock()) ffff99d958725800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1777051302.756068:0:103165:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d941bf7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29c4352d-3260-4734-909d-9ea5de9e7fa4+4:2435:x1863365425872384:12345-192.168.201.46@tcp:250:kworker.0 Request processed in 410us (2039us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051302.756082:0:103165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 62 00000100:00100000:1.0:1777051302.757651:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051302.757718:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051302.757787:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051302.757837:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051302.757867:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051302.757897:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051302.757928:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051302.758019:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051302.758495:0:8492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425872512 00000100:00100000:0.0:1777051302.758503:0:8492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425872512 00000100:00100000:0.0:1777051302.758582:0:8492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425872640 00000100:00100000:0.0:1777051302.758588:0:8492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425872640 00000100:00100000:0.0:1777051302.758617:0:8492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425873024 00000100:00100000:0.0:1777051302.758622:0:8492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425873024 00000100:00100000:0.0:1777051302.758653:0:8492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425873152 00000100:00100000:0.0:1777051302.758658:0:8492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425873152 00000100:00100000:0.0:1777051302.758689:0:8492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13174 00000100:00100000:0.0:1777051302.758700:0:8492:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5fbe1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+13:2439:x1863365425872512:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:0.0:1777051302.758770:0:8492:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5fbe1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+13:2439:x1863365425872512:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 69us (1121us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051302.758784:0:8492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13174 00000100:00100000:0.0:1777051302.758817:0:8492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13175 00000100:00100000:0.0:1777051302.758835:0:8492:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5fbe2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+6:2438:x1863365425872640:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:3.0:1777051302.758863:0:8471:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425872768 00000100:00100000:3.0:1777051302.758874:0:8471:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425872768 00000100:00100000:0.0:1777051302.758883:0:8492:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5fbe2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+6:2438:x1863365425872640:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 53us (1163us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051302.758895:0:8492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13175 00000100:00100000:0.0:1777051302.758926:0:8492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13176 00000100:00100000:3.0:1777051302.758936:0:8471:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425872896 00000100:00100000:3.0:1777051302.758944:0:8471:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425872896 00000100:00100000:0.0:1777051302.758945:0:8492:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5fbe1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+17:2439:x1863365425873024:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:3.0:1777051302.759020:0:8471:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425873280 00000100:00100000:3.0:1777051302.759027:0:8471:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425873280 00000100:00100000:0.0:1777051302.759037:0:8492:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5fbe1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+17:2439:x1863365425873024:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 96us (1166us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051302.759051:0:8492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13176 00000100:00100000:3.0:1777051302.759071:0:8471:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425873408 00000100:00100000:3.0:1777051302.759078:0:8471:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425873408 00000100:00100000:0.0:1777051302.759092:0:8492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13177 00000100:00100000:0.0:1777051302.759112:0:8492:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5fbe0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+48:2438:x1863365425873152:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:3.0:1777051302.759128:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10247 00000100:00100000:3.0:1777051302.759146:0:8471:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5fbe1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+50:2439:x1863365425872768:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:0.0:1777051302.759167:0:8492:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5fbe0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+48:2438:x1863365425873152:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 60us (1266us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051302.759181:0:8492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13177 00000100:00100000:3.0:1777051302.759265:0:8471:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5fbe1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+50:2439:x1863365425872768:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 121us (1474us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051302.759277:0:8470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10248 00000100:00100000:0.0:1777051302.759292:0:8470:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5fbe0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+48:2438:x1863365425872896:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:0.0:1777051302.759342:0:8470:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5fbe0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+48:2438:x1863365425872896:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 54us (1504us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051302.759354:0:8470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10248 00000100:00100000:3.0:1777051302.759384:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10247 00000100:00080000:1.0:1777051302.759453:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1777051302.759460:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1777051302.759464:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1777051302.759468:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1777051302.759645:0:8470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10249 00000100:00100000:0.0:1777051302.759661:0:8470:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5fbe0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+50:2439:x1863365425873280:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:0.0:1777051302.759712:0:8470:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5fbe0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+50:2439:x1863365425873280:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 55us (1783us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051302.759724:0:8470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10249 00000100:00100000:0.0:1777051302.759748:0:8470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10250 00000100:00100000:0.0:1777051302.759757:0:8470:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5fbe1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+47:2438:x1863365425873408:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:0.0:1777051302.759786:0:8470:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5fbe1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+47:2438:x1863365425873408:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 32us (1770us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051302.759793:0:8470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10250 00010000:00010000:0.0:1777051302.998684:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1777051303.115867:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051303.115960:0:6581:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425873536 00000100:00100000:3.0:1777051303.116001:0:6581:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425873536 00000100:00100000:3.0:1777051303.116393:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111743 00000100:00100000:3.0:1777051303.116414:0:6581:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da44579180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+13:131550:x1863365425873536:12345-192.168.201.46@tcp:101:lfs.0 00010000:00010000:3.0:1777051303.116441:0:6581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777051303.116472:0:6581:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94ffbd800/0x85f51a6b96714f45 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b5ed2 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1777051303.117559:0:6581:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 1021us 00010000:00010000:0.0:1777051303.129632:0:6581:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d954ea7800/0x85f51a6b96714f4c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051303.129940:0:6581:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d954ea7800/0x85f51a6b96714f4c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051303.129957:0:6581:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d954ea7800/0x85f51a6b96714f4c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1777051303.130060:0:6581:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 12288 00000004:00200000:0.0:1777051303.130066:0:6581:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1777051303.130114:0:6581:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99d954ea7800/0x85f51a6b96714f4c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051303.130160:0:6581:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94ffbd800/0x85f51a6b96714f45 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5ed2 expref: 15 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051303.130186:0:6581:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d954ea7800/0x85f51a6b96714f4c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5ed2 expref: 14 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051303.130230:0:6581:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d941e2ee00) 00010000:00010000:0.0:1777051303.130234:0:6581:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1777051303.130240:0:6581:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d954ea7800, rc 0) 00000100:00100000:0.0:1777051303.130332:0:6581:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da44579180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+14:131550:x1863365425873536:12345-192.168.201.46@tcp:101:lfs.0 Request processed in 13922us (14473us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051303.130346:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111743 00000100:00100000:0.0:1777051303.134504:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051303.134592:0:8492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425873664 00000100:00100000:2.0:1777051303.134611:0:8492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425873664 00000100:00100000:2.0:1777051303.134993:0:8492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111744 00000100:00100000:2.0:1777051303.135010:0:8492:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da44578000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+17:131550:x1863365425873664:12345-192.168.201.46@tcp:41:lfs.0 00000004:00000024:2.0:1777051303.135321:0:8492:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4194304 pending 0 free 1441603584 avail 1295364096 00000100:00100000:2.0:1777051303.135414:0:8492:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da44578000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+17:131550:x1863365425873664:12345-192.168.201.46@tcp:41:lfs.0 Request processed in 406us (911us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051303.135427:0:8492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111744 00000100:00100000:1.0:1777051303.138795:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051303.138880:0:21368:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425873792 00000100:00100000:2.0:1777051303.138888:0:21368:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425873792 00000100:00100000:2.0:1777051303.138946:0:21368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111745 00000100:00100000:2.0:1777051303.138991:0:21368:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5fbe2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+48:131550:x1863365425873792:12345-192.168.201.46@tcp:41:lfs.0 00000004:00000024:2.0:1777051303.139024:0:21368:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4243456 pending 0 free 1446064128 avail 1299824640 00000100:00100000:2.0:1777051303.139099:0:21368:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5fbe2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+48:131550:x1863365425873792:12345-192.168.201.46@tcp:41:lfs.0 Request processed in 140us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051303.139111:0:21368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111745 00000100:00100000:0.0:1777051303.143062:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051303.143141:0:47388:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425873920 00000100:00100000:1.0:1777051303.143416:0:47388:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425873920 00000100:00100000:1.0:1777051303.143484:0:47388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 5560 00000100:00100000:1.0:1777051303.143497:0:47388:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da44578e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+50:131550:x1863365425873920:12345-192.168.201.46@tcp:13:lfs.0 00002000:00000024:1.0:1777051303.143530:0:47388:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 440353216 pending 0 free 3862671360 avail 3631149056 00000100:00100000:1.0:1777051303.143606:0:47388:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da44578e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+50:131550:x1863365425873920:12345-192.168.201.46@tcp:13:lfs.0 Request processed in 110us (547us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051303.143618:0:47388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 5560 00000100:00100000:0.0:1777051303.146300:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051303.146346:0:8473:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425874048 00000100:00100000:3.0:1777051303.146356:0:8473:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425874048 00000100:00100000:3.0:1777051303.146417:0:8473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 5561 00000100:00100000:3.0:1777051303.146430:0:8473:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da44579f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+47:131550:x1863365425874048:12345-192.168.201.46@tcp:13:lfs.0 00002000:00000024:3.0:1777051303.146463:0:8473:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 430293440 pending 0 free 3645853696 avail 3414331392 00000100:00100000:3.0:1777051303.146537:0:8473:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da44579f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+47:131550:x1863365425874048:12345-192.168.201.46@tcp:13:lfs.0 Request processed in 103us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051303.146549:0:8473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 5561 00000100:00100000:3.0:1777051303.906776:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051303.906923:0:103168:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425874176 00000100:00100000:2.0:1777051303.906939:0:103168:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425874176 00000100:00100000:2.0:1777051303.907097:0:103168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 63 00000100:00100000:2.0:1777051303.907122:0:103168:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f2a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:29c4352d-3260-4734-909d-9ea5de9e7fa4+4:6255:x1863365425874176:12345-192.168.201.46@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1777051303.907156:0:103168:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051303.907288:0:103168:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d95071aa00/0x85f51a6b96714f53 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b5ed9 expref: -99 pid: 103168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051303.907343:0:103168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d95071aa00/0x85f51a6b96714f53 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5ed9 expref: 5 pid: 103168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051303.907369:0:103168:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d95071aa00/0x85f51a6b96714f53 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5ed9 expref: 5 pid: 103168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051303.907387:0:103168:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d95071aa00, rc 0) 00000100:00100000:2.0:1777051303.907494:0:103168:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f2a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:29c4352d-3260-4734-909d-9ea5de9e7fa4+5:6255:x1863365425874176:12345-192.168.201.46@tcp:101:ll_cfg_requeue.0 Request processed in 380us (730us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051303.907510:0:103168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 63 00000100:00100000:0.0:1777051303.911158:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051303.911305:0:103169:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425874304 00000100:00100000:1.0:1777051303.911317:0:103169:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425874304 00000100:00100000:1.0:1777051303.911398:0:103169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 64 00000100:00100000:1.0:1777051303.911418:0:103169:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94a771050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:29c4352d-3260-4734-909d-9ea5de9e7fa4+5:6255:x1863365425874304:12345-192.168.201.46@tcp:256:ll_cfg_requeue.0 20000000:01000000:1.0:1777051303.911450:0:103169:0:(mgs_nids.c:912:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 16384. 20000000:01000000:1.0:1777051303.911477:0:103169:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1777051303.911484:0:103169:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:1.0:1777051303.911491:0:103169:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:1.0:1777051303.911497:0:103169:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:1.0:1777051303.911502:0:103169:0:(mgs_nids.c:316:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 30 00000100:00100000:1.0:1777051303.918137:0:103169:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94a771050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:29c4352d-3260-4734-909d-9ea5de9e7fa4+5:6255:x1863365425874304:12345-192.168.201.46@tcp:256:ll_cfg_requeue.0 Request processed in 6715us (6975us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051303.918160:0:103169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 64 00000100:00100000:2.0:1777051303.927172:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051303.927286:0:103165:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425874432 00000100:00100000:0.0:1777051303.927300:0:103165:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425874432 00000100:00100000:0.0:1777051303.927401:0:103165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 65 00000100:00100000:0.0:1777051303.927421:0:103165:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94a773050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29c4352d-3260-4734-909d-9ea5de9e7fa4+5:6255:x1863365425874432:12345-192.168.201.46@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1777051303.927445:0:103165:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051303.927473:0:103165:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d954ea7a00/0x85f51a6b96714f5a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b5ee0 expref: -99 pid: 103165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051303.927521:0:103165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d954ea7a00/0x85f51a6b96714f5a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5ee0 expref: 6 pid: 103165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051303.927551:0:103165:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d954ea7a00/0x85f51a6b96714f5a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5ee0 expref: 6 pid: 103165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051303.927569:0:103165:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d954ea7a00, rc 0) 00000100:00100000:0.0:1777051303.927657:0:103165:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94a773050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29c4352d-3260-4734-909d-9ea5de9e7fa4+6:6255:x1863365425874432:12345-192.168.201.46@tcp:101:ll_cfg_requeue.0 Request processed in 240us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051303.927671:0:103165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 65 00000100:00100000:0.0:1777051303.932889:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051303.933028:0:103168:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425874560 00000100:00100000:2.0:1777051303.933066:0:103168:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425874560 00000100:00100000:2.0:1777051303.933146:0:103168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 66 00000100:00100000:2.0:1777051303.933163:0:103168:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94a771450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:29c4352d-3260-4734-909d-9ea5de9e7fa4+6:6255:x1863365425874560:12345-192.168.201.46@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1777051303.933446:0:103168:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94a771450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:29c4352d-3260-4734-909d-9ea5de9e7fa4+7:6255:x1863365425874560:12345-192.168.201.46@tcp:501:ll_cfg_requeue.0 Request processed in 284us (582us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051303.933462:0:103168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 66 00000100:00100000:1.0:1777051303.937821:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051303.938055:0:103169:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425874688 00000100:00100000:0.0:1777051303.938064:0:103169:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425874688 00000100:00100000:0.0:1777051303.938130:0:103169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 67 00000100:00100000:0.0:1777051303.938147:0:103169:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7d9cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:29c4352d-3260-4734-909d-9ea5de9e7fa4+7:6255:x1863365425874688:12345-192.168.201.46@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1777051303.938387:0:103169:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7d9cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:29c4352d-3260-4734-909d-9ea5de9e7fa4+7:6255:x1863365425874688:12345-192.168.201.46@tcp:503:ll_cfg_requeue.0 Request processed in 241us (570us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051303.938403:0:103169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 67 00000100:00100000:0.0:1777051303.946718:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051303.946872:0:103165:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425874816 00000100:00100000:2.0:1777051303.946887:0:103165:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425874816 00000100:00100000:2.0:1777051303.947005:0:103165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 68 00000100:00100000:2.0:1777051303.947022:0:103165:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7d9cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29c4352d-3260-4734-909d-9ea5de9e7fa4+7:6255:x1863365425874816:12345-192.168.201.46@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1777051303.947044:0:103165:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051303.947071:0:103165:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d95071bc00/0x85f51a6b96714f61 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b5ee7 expref: -99 pid: 103165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051303.947117:0:103165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d95071bc00/0x85f51a6b96714f61 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5ee7 expref: 8 pid: 103165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051303.947142:0:103165:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d95071bc00/0x85f51a6b96714f61 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5ee7 expref: 8 pid: 103165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051303.947480:0:103165:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d95071bc00, rc 0) 00000100:00100000:2.0:1777051303.947561:0:103165:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7d9cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29c4352d-3260-4734-909d-9ea5de9e7fa4+8:6255:x1863365425874816:12345-192.168.201.46@tcp:101:ll_cfg_requeue.0 Request processed in 540us (851us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051303.947576:0:103165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 68 00000100:00100000:2.0:1777051303.953635:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051303.954065:0:103168:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425874944 00000100:00100000:0.0:1777051303.954078:0:103168:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425874944 00000100:00100000:0.0:1777051303.954500:0:103168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 69 00000100:00100000:0.0:1777051303.954521:0:103168:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7d9cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:29c4352d-3260-4734-909d-9ea5de9e7fa4+8:6255:x1863365425874944:12345-192.168.201.46@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1777051303.954717:0:103168:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7d9cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:29c4352d-3260-4734-909d-9ea5de9e7fa4+8:6255:x1863365425874944:12345-192.168.201.46@tcp:501:ll_cfg_requeue.0 Request processed in 200us (1087us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051303.954732:0:103168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 69 00000100:00100000:1.0:1777051303.958459:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051303.958531:0:103169:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425875072 00000100:00100000:0.0:1777051303.958543:0:103169:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425875072 00000100:00100000:0.0:1777051303.958614:0:103169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 70 00000100:00100000:0.0:1777051303.958626:0:103169:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7d9cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:29c4352d-3260-4734-909d-9ea5de9e7fa4+8:6255:x1863365425875072:12345-192.168.201.46@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1777051303.958844:0:103169:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7d9cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:29c4352d-3260-4734-909d-9ea5de9e7fa4+8:6255:x1863365425875072:12345-192.168.201.46@tcp:503:ll_cfg_requeue.0 Request processed in 216us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051303.958857:0:103169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 70 00000100:00100000:2.0:1777051303.965460:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051303.965520:0:103165:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425875200 00000100:00100000:0.0:1777051303.965531:0:103165:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425875200 00000100:00100000:0.0:1777051303.965598:0:103165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 71 00000100:00100000:0.0:1777051303.965614:0:103165:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7d9ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29c4352d-3260-4734-909d-9ea5de9e7fa4+8:6255:x1863365425875200:12345-192.168.201.46@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1777051303.965634:0:103165:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051303.965661:0:103165:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d954ea7400/0x85f51a6b96714f68 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b5eee expref: -99 pid: 103165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051303.965703:0:103165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d954ea7400/0x85f51a6b96714f68 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5eee expref: 9 pid: 103165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051303.965721:0:103165:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d954ea7400/0x85f51a6b96714f68 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5eee expref: 9 pid: 103165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051303.965736:0:103165:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d954ea7400, rc 0) 00000100:00100000:0.0:1777051303.965821:0:103165:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7d9ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29c4352d-3260-4734-909d-9ea5de9e7fa4+9:6255:x1863365425875200:12345-192.168.201.46@tcp:101:ll_cfg_requeue.0 Request processed in 209us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051303.965832:0:103165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 71 00000100:00100000:2.0:1777051303.969432:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051303.969524:0:103168:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425875328 00000100:00100000:0.0:1777051303.969535:0:103168:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425875328 00000100:00100000:0.0:1777051303.969600:0:103168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 72 00000100:00100000:0.0:1777051303.969616:0:103168:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94a770850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:29c4352d-3260-4734-909d-9ea5de9e7fa4+9:6255:x1863365425875328:12345-192.168.201.46@tcp:256:ll_cfg_requeue.0 20000000:01000000:0.0:1777051303.969644:0:103168:0:(mgs_nids.c:912:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 16384. 20000000:01000000:0.0:1777051303.969675:0:103168:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1777051303.969682:0:103168:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:0.0:1777051303.969688:0:103168:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:0.0:1777051303.969693:0:103168:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:0.0:1777051303.969698:0:103168:0:(mgs_nids.c:316:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 30 00000100:00100000:3.0:1777051303.971602:0:103168:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94a770850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:29c4352d-3260-4734-909d-9ea5de9e7fa4+9:6255:x1863365425875328:12345-192.168.201.46@tcp:256:ll_cfg_requeue.0 Request processed in 1985us (2170us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051303.971619:0:103168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 72 00000100:00100000:2.0:1777051303.980345:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051303.980444:0:103169:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425875456 00000100:00100000:0.0:1777051303.980466:0:103169:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425875456 00000100:00100000:0.0:1777051303.980535:0:103169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 73 00000100:00100000:0.0:1777051303.980554:0:103169:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94a770450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:29c4352d-3260-4734-909d-9ea5de9e7fa4+9:6255:x1863365425875456:12345-192.168.201.46@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1777051303.980835:0:103169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051303.980859:0:103169:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d954ea6a00/0x85f51a6b96714f6f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b5ef5 expref: -99 pid: 103169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051303.980895:0:103169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d954ea6a00/0x85f51a6b96714f6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5ef5 expref: 10 pid: 103169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051303.980909:0:103169:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d954ea6a00/0x85f51a6b96714f6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5ef5 expref: 10 pid: 103169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051303.980922:0:103169:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d954ea6a00, rc 0) 00000100:00100000:0.0:1777051303.981072:0:103169:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94a770450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:29c4352d-3260-4734-909d-9ea5de9e7fa4+10:6255:x1863365425875456:12345-192.168.201.46@tcp:101:ll_cfg_requeue.0 Request processed in 520us (736us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051303.981087:0:103169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 73 00000100:00100000:2.0:1777051303.983693:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051303.985101:0:103165:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425875584 00000100:00100000:0.0:1777051303.985112:0:103165:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425875584 00000100:00100000:0.0:1777051303.985182:0:103165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 74 00000100:00100000:0.0:1777051303.985221:0:103165:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7d9cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29c4352d-3260-4734-909d-9ea5de9e7fa4+10:6255:x1863365425875584:12345-192.168.201.46@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1777051303.985400:0:103165:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7d9cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29c4352d-3260-4734-909d-9ea5de9e7fa4+10:6255:x1863365425875584:12345-192.168.201.46@tcp:501:ll_cfg_requeue.0 Request processed in 205us (1709us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051303.985412:0:103165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 74 00000100:00100000:0.0:1777051303.988050:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051303.988487:0:103168:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425875712 00000100:00100000:3.0:1777051303.988496:0:103168:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425875712 00000100:00100000:3.0:1777051303.988643:0:103168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 75 00000100:00100000:3.0:1777051303.989011:0:103168:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7d9cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:29c4352d-3260-4734-909d-9ea5de9e7fa4+10:6255:x1863365425875712:12345-192.168.201.46@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1777051303.989155:0:103168:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7d9cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:29c4352d-3260-4734-909d-9ea5de9e7fa4+10:6255:x1863365425875712:12345-192.168.201.46@tcp:503:ll_cfg_requeue.0 Request processed in 150us (1108us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051303.989167:0:103168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 75 00000100:00100000:3.0:1777051303.993980:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051303.994412:0:103169:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425875840 00000100:00100000:0.0:1777051303.994424:0:103169:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425875840 00000100:00100000:0.0:1777051303.994489:0:103169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 76 00000100:00100000:0.0:1777051303.994535:0:103169:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d943e25c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:29c4352d-3260-4734-909d-9ea5de9e7fa4+10:6255:x1863365425875840:12345-192.168.201.46@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1777051303.994554:0:103169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051303.994578:0:103169:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d954ea7c00/0x85f51a6b96714f76 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b5efc expref: -99 pid: 103169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051303.994616:0:103169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d954ea7c00/0x85f51a6b96714f76 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5efc expref: 11 pid: 103169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051303.994633:0:103169:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d954ea7c00/0x85f51a6b96714f76 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5efc expref: 11 pid: 103169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051303.994648:0:103169:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d954ea7c00, rc 0) 00000100:00100000:0.0:1777051303.995047:0:103169:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d943e25c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:29c4352d-3260-4734-909d-9ea5de9e7fa4+11:6255:x1863365425875840:12345-192.168.201.46@tcp:101:ll_cfg_requeue.0 Request processed in 545us (1096us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051303.995060:0:103169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 76 00000100:00100000:2.0:1777051303.997134:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051303.997245:0:103165:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425875968 00000100:00100000:0.0:1777051303.997255:0:103165:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425875968 00000100:00100000:0.0:1777051303.997323:0:103165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 77 00000100:00100000:0.0:1777051303.997339:0:103165:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d943e24450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29c4352d-3260-4734-909d-9ea5de9e7fa4+11:6255:x1863365425875968:12345-192.168.201.46@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1777051303.997481:0:103165:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d943e24450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29c4352d-3260-4734-909d-9ea5de9e7fa4+11:6255:x1863365425875968:12345-192.168.201.46@tcp:501:ll_cfg_requeue.0 Request processed in 145us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051303.997511:0:103165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 77 00000100:00100000:2.0:1777051304.001117:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051304.001262:0:103168:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425876096 00000100:00100000:3.0:1777051304.001273:0:103168:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425876096 00000100:00100000:3.0:1777051304.001410:0:103168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 78 00000100:00100000:3.0:1777051304.001425:0:103168:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d943e26450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:29c4352d-3260-4734-909d-9ea5de9e7fa4+11:6255:x1863365425876096:12345-192.168.201.46@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1777051304.001631:0:103168:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d943e26450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:29c4352d-3260-4734-909d-9ea5de9e7fa4+11:6255:x1863365425876096:12345-192.168.201.46@tcp:503:ll_cfg_requeue.0 Request processed in 207us (519us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051304.001644:0:103168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 78 00000100:00100000:3.0:1777051304.007445:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051304.007525:0:103169:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425876224 00000100:00100000:0.0:1777051304.007538:0:103169:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425876224 00000100:00100000:0.0:1777051304.007611:0:103169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 79 00000100:00100000:0.0:1777051304.007628:0:103169:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d943e26050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:29c4352d-3260-4734-909d-9ea5de9e7fa4+11:6255:x1863365425876224:12345-192.168.201.46@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1777051304.007647:0:103169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051304.007669:0:103169:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d954ea6e00/0x85f51a6b96714f7d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b5f03 expref: -99 pid: 103169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051304.007705:0:103169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d954ea6e00/0x85f51a6b96714f7d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5f03 expref: 12 pid: 103169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051304.007722:0:103169:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d954ea6e00/0x85f51a6b96714f7d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5f03 expref: 12 pid: 103169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051304.007735:0:103169:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d954ea6e00, rc 0) 00000100:00100000:0.0:1777051304.007802:0:103169:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d943e26050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:29c4352d-3260-4734-909d-9ea5de9e7fa4+12:6255:x1863365425876224:12345-192.168.201.46@tcp:101:ll_cfg_requeue.0 Request processed in 179us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051304.007815:0:103169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 79 00000100:00100000:3.0:1777051304.014379:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051304.014473:0:103165:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425876352 00000100:00100000:1.0:1777051304.014485:0:103165:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425876352 00000100:00100000:1.0:1777051304.014595:0:103165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 80 00000100:00100000:1.0:1777051304.014613:0:103165:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d943e25450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29c4352d-3260-4734-909d-9ea5de9e7fa4+12:6255:x1863365425876352:12345-192.168.201.46@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1777051304.014754:0:103165:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d943e25450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29c4352d-3260-4734-909d-9ea5de9e7fa4+12:6255:x1863365425876352:12345-192.168.201.46@tcp:501:ll_cfg_requeue.0 Request processed in 144us (382us total) trans 0 rc -2/-2 00000100:00100000:1.0:1777051304.014767:0:103165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 80 00010000:00010000:0.0:1777051304.022555:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777051305.046738:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1777051305.750623:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5fbe3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452548352:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1777051305.750720:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051305.750828:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da4457ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3680:1863365452548480:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1777051305.750887:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f9bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3677:1863365452548608:0@lo:400:kworker.0 00000100:00100000:0.0:1777051305.751025:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051305.751043:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051305.751451:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f9bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3677:1863365452549120:0@lo:400:kworker.0 00000100:00100000:3.0:1777051305.751453:0:8472:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452548352 00000100:00100000:0.0:1777051305.751471:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f9be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3680:1863365452548992:0@lo:400:kworker.0 00000100:00100000:3.0:1777051305.751471:0:8472:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452548352 00000100:00100000:1.0:1777051305.751532:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051305.751581:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f9bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452548736:0@lo:400:kworker.0 00000100:00100000:0.0:1777051305.751591:0:46498:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452548480 00000100:00100000:0.0:1777051305.751605:0:46498:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452548480 00000100:00100000:3.0:1777051305.751605:0:8472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5562 00000100:00100000:1.0:1777051305.751617:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f9bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3677:1863365452549632:0@lo:400:kworker.0 00000100:00100000:3.0:1777051305.751637:0:8472:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5fbe3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3679:x1863365452548352:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1777051305.751666:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:3.0:1777051305.752011:0:8472:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 430293440 pending 0 free 3645853696 avail 3414331392 00000100:00100000:1.0:1777051305.752337:0:103168:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452548608 00000100:00100000:1.0:1777051305.752350:0:103168:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452548608 00000100:00100000:2.0:1777051305.752361:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f9bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452549248:0@lo:400:kworker.0 00000100:00100000:0.0:1777051305.752401:0:46498:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452548736 00000100:00100000:0.0:1777051305.752412:0:46498:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452548736 00000100:00100000:1.0:1777051305.752438:0:103168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1777051305.752456:0:103168:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d943e27050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f9351a01-5b0e-4470-97fd-58b9b4b312a2+23:3677:x1863365452548608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051305.752479:0:8472:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5fbe3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3679:x1863365452548352:12345-0@lo:13:osp-pre-1-1.0 Request processed in 849us (1760us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051305.752498:0:46498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8025 00000100:00100000:2.0:1777051305.752498:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051305.752518:0:8472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5562 00000100:00100000:0.0:1777051305.752536:0:46498:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da4457b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3680:x1863365452548480:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1777051305.752549:0:103168:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d943e27050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f9351a01-5b0e-4470-97fd-58b9b4b312a2+23:3677:x1863365452548608:12345-0@lo:400:kworker.0 Request processed in 91us (1518us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051305.752569:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da70a32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452549760:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1777051305.752570:0:103168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00080000:3.0:1777051305.752576:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00000024:0.0:1777051305.752605:0:46498:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4243456 pending 0 free 1446064128 avail 1299824640 00000100:00100000:3.0:1777051305.752625:0:24468:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452549248 00000100:00100000:3.0:1777051305.752638:0:24468:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452549248 00000100:00100000:2.0:1777051305.752650:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051305.752663:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f9bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3679:1863365452548864:0@lo:400:kworker.0 00000100:00100000:0.0:1777051305.752706:0:46498:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da4457b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3680:x1863365452548480:12345-0@lo:41:osp-pre-1-0.0 Request processed in 179us (1688us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051305.752718:0:46498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8025 00000100:00100000:2.0:1777051305.752738:0:3678:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1777051305.752753:0:24468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10251 00000100:00100000:1.0:1777051305.752762:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051305.752766:0:46498:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452549760 00000100:00100000:2.0:1777051305.752768:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7cd9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3678:1863365452550144:0@lo:400:kworker.0 00000100:00100000:0.0:1777051305.752774:0:46498:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452549760 00000100:00100000:3.0:1777051305.752783:0:24468:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7cd9c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3678:x1863365452549248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777051305.752828:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f9bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3679:1863365452549376:0@lo:400:kworker.0 00000100:00100000:0.0:1777051305.752839:0:46498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8026 00000100:00100000:2.0:1777051305.752864:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051305.752866:0:46498:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7cd9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+8:3678:x1863365452548736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051305.752892:0:24468:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7cd9c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3678:x1863365452549248:12345-0@lo:400:kworker.0 Request processed in 121us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051305.752911:0:24468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10251 00000100:00100000:1.0:1777051305.752952:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051305.752987:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f9bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452549248:0@lo:400:kworker.0 00000100:00100000:0.0:1777051305.753011:0:46498:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7cd9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+8:3678:x1863365452548736:12345-0@lo:400:kworker.0 Request processed in 149us (1344us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051305.753021:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955507100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452549888:0@lo:400:kworker.0 00000100:00100000:3.0:1777051305.753025:0:11727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8027 00000100:00100000:2.0:1777051305.753045:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f9bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452548736:0@lo:400:kworker.0 00000100:00100000:0.0:1777051305.753055:0:46498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8026 00000100:00100000:3.0:1777051305.753065:0:11727:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7cd9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:3678:x1863365452549760:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1777051305.753107:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00000024:3.0:1777051305.753119:0:11727:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4194304 pending 0 free 1441603584 avail 1295364096 00000100:00100000:0.0:1777051305.753140:0:6579:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452549120 00000100:00100000:0.0:1777051305.753150:0:6579:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452549120 00000100:00100000:2.0:1777051305.753155:0:27885:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452548864 00000100:00100000:2.0:1777051305.753168:0:27885:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452548864 00000100:00100000:1.0:1777051305.753264:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5fbe3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452548352:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1777051305.753292:0:11727:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7cd9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:3678:x1863365452549760:12345-0@lo:41:osp-pre-0-1.0 Request processed in 242us (646us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051305.753299:0:6579:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452550144 00000100:00100000:0.0:1777051305.753308:0:6579:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452550144 00000100:00100000:1.0:1777051305.753310:0:3679:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1777051305.753317:0:11727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8027 00000100:00100000:2.0:1777051305.753320:0:27885:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452549376 00000100:00100000:2.0:1777051305.753331:0:27885:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452549376 00000100:00100000:1.0:1777051305.753339:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7cd9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452550016:0@lo:400:kworker.0 00000100:00100000:0.0:1777051305.753384:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13178 00000100:00080000:3.0:1777051305.753388:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1777051305.753398:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1777051305.753411:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1777051305.753421:0:6579:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5fbe0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3677:x1863365452549120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777051305.753427:0:27885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13179 00000100:00100000:1.0:1777051305.753433:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051305.753460:0:27885:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5fbe3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000-lwp-MDT0001_UUID+5:3679:x1863365452548864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051305.753477:0:27882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13180 00000100:00100000:3.0:1777051305.753504:0:27882:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7cd9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0000_UUID+5:3678:x1863365452550144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777051305.753543:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13181 00000100:00100000:0.0:1777051305.753546:0:6579:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5fbe0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3677:x1863365452549120:12345-0@lo:400:kworker.0 Request processed in 144us (2017us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051305.753565:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13178 00000100:00100000:1.0:1777051305.753578:0:6580:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5fbe3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3679:x1863365452549376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777051305.753588:0:27885:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5fbe3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000-lwp-MDT0001_UUID+5:3679:x1863365452548864:12345-0@lo:400:kworker.0 Request processed in 131us (837us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051305.753607:0:27882:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7cd9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0000_UUID+5:3678:x1863365452550144:12345-0@lo:400:kworker.0 Request processed in 109us (747us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051305.753612:0:27885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13179 00000100:00100000:3.0:1777051305.753633:0:27882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13180 00000100:00100000:0.0:1777051305.753662:0:8470:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452549888 00000100:00100000:1.0:1777051305.753669:0:6580:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5fbe3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3679:x1863365452549376:12345-0@lo:400:kworker.0 Request processed in 107us (752us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051305.753670:0:8470:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452549888 00000100:00100000:1.0:1777051305.753691:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13181 00000100:00080000:3.0:1777051305.753727:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1777051305.753755:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f9bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3679:1863365452548864:0@lo:400:kworker.0 00000100:00100000:0.0:1777051305.753765:0:8470:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452550016 00000100:00100000:0.0:1777051305.753775:0:8470:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452550016 00000100:00100000:1.0:1777051305.753789:0:27884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10252 00000100:00100000:3.0:1777051305.753815:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7cd9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3678:1863365452550144:0@lo:400:kworker.0 00000100:00100000:2.0:1777051305.753816:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f9bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3679:1863365452549376:0@lo:400:kworker.0 00000100:00100000:1.0:1777051305.753817:0:27884:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5fbe2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+6:3679:x1863365452549888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777051305.753872:0:8470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10253 00000100:00100000:0.0:1777051305.753897:0:8470:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5fbe3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3679:x1863365452550016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051305.753910:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da70a32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452549760:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1777051305.754040:0:27884:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5fbe2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+6:3679:x1863365452549888:12345-0@lo:400:kworker.0 Request processed in 234us (939us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051305.754053:0:27884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10252 00000100:00100000:1.0:1777051305.754099:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1777051305.754126:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1777051305.754163:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f9bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3677:1863365452548608:0@lo:400:kworker.0 00000100:00100000:2.0:1777051305.754180:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955507100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452549888:0@lo:400:kworker.0 00000100:00100000:1.0:1777051305.754219:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f9bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3677:1863365452549120:0@lo:400:kworker.0 00000100:00100000:2.0:1777051305.754277:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051305.754316:0:46498:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452549632 00000100:00100000:2.0:1777051305.754323:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f9bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3680:1863365452549504:0@lo:400:kworker.0 00000100:00100000:1.0:1777051305.754328:0:46498:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452549632 00000100:00100000:1.0:1777051305.754403:0:46498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8028 00000100:00100000:1.0:1777051305.754423:0:46498:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5fbe1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3677:x1863365452549632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777051305.754423:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051305.754498:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da4457ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3680:1863365452548480:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1777051305.754521:0:46498:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5fbe1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3677:x1863365452549632:12345-0@lo:400:kworker.0 Request processed in 103us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051305.754538:0:46498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8028 00000100:00100000:2.0:1777051305.754558:0:21368:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452548992 00000100:00100000:2.0:1777051305.754568:0:21368:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452548992 00000100:00100000:0.0:1777051305.754596:0:8470:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5fbe3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3679:x1863365452550016:12345-0@lo:400:kworker.0 Request processed in 705us (1180us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051305.754606:0:8470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10253 00000100:00100000:1.0:1777051305.754628:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f9bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3677:1863365452549632:0@lo:400:kworker.0 00000100:00100000:2.0:1777051305.754973:0:21368:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452549504 00000100:00100000:2.0:1777051305.754983:0:21368:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452549504 00000100:00100000:2.0:1777051305.755045:0:21368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13182 00000100:00100000:2.0:1777051305.755062:0:21368:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7cd9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3680:x1863365452548992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777051305.755068:0:46494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13183 00000100:00100000:1.0:1777051305.755089:0:46494:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7cd9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0001-lwp-OST0001_UUID+5:3680:x1863365452549504:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1777051305.755502:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1777051305.755510:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1777051305.755569:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7cd9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452550016:0@lo:400:kworker.0 00000100:00100000:2.0:1777051305.755610:0:21368:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7cd9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3680:x1863365452548992:12345-0@lo:400:kworker.0 Request processed in 548us (1329us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051305.755615:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f9be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3680:1863365452548992:0@lo:400:kworker.0 00000100:00100000:2.0:1777051305.755637:0:21368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13182 00000100:00100000:3.0:1777051305.755662:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f9bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3680:1863365452549504:0@lo:400:kworker.0 00000100:00100000:1.0:1777051305.755665:0:46494:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7cd9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0001-lwp-OST0001_UUID+5:3680:x1863365452549504:12345-0@lo:400:kworker.0 Request processed in 530us (1233us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051305.755705:0:46494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13183 00010000:00010000:0.0:1777051306.071468:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1777051306.262845:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da4457b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3678:1863365452550272:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1777051306.262963:0:3680:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1777051306.262972:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051306.262984:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7cd9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3680:1863365452550528:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1777051306.263032:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051306.263483:0:10113:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452550272 00000100:00100000:1.0:1777051306.263496:0:10113:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452550272 00000100:00100000:0.0:1777051306.263514:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5fbeea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452550400:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1777051306.263569:0:10113:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452550528 00000100:00100000:1.0:1777051306.263577:0:10113:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452550528 00000100:00100000:0.0:1777051306.263594:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051306.263875:0:10113:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452550400 00000100:00100000:1.0:1777051306.263883:0:10113:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452550400 00000100:00100000:2.0:1777051306.263899:0:47388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5563 00000100:00100000:2.0:1777051306.263947:0:47388:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da44578a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3678:x1863365452550272:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1777051306.263957:0:10113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5564 00000100:00100000:0.0:1777051306.263978:0:8472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5565 00000100:00100000:1.0:1777051306.263981:0:10113:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7cd9f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3680:x1863365452550528:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1777051306.263994:0:47388:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 440353216 pending 0 free 3862671360 avail 3631149056 00002000:00000024:1.0:1777051306.264010:0:10113:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 430293440 pending 0 free 3645853696 avail 3414331392 00000100:00100000:2.0:1777051306.264090:0:47388:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da44578a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3678:x1863365452550272:12345-0@lo:13:osp-pre-0-0.0 Request processed in 175us (1114us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051306.264104:0:10113:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7cd9f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3680:x1863365452550528:12345-0@lo:13:osp-pre-1-0.0 Request processed in 132us (1070us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051306.264107:0:47388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5563 00000100:00100000:1.0:1777051306.264122:0:10113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5564 00000100:00100000:1.0:1777051306.264192:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7cd9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3680:1863365452550528:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1777051306.264215:0:8472:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da4457bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3678:x1863365452550400:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1777051306.264242:0:8472:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 440353216 pending 0 free 3862671360 avail 3631149056 00000100:00100000:1.0:1777051306.264245:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da4457b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3678:1863365452550272:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1777051306.264304:0:8472:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da4457bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3678:x1863365452550400:12345-0@lo:13:osp-pre-0-1.0 Request processed in 310us (713us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051306.264316:0:8472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5565 00000100:00100000:1.0:1777051306.264345:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5fbeea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452550400:0@lo:13:osp-pre-0-1.0 00000001:02000400:3.0:1777051306.448228:0:103635:0:(debug.c:645:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg146-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid 00000040:00080000:1.0:1777051306.519456:0:103191:0:(llog.c:801:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1777051306.519469:0:103191:0:(llog_cat.c:158:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1777051306.520375:0:103191:0:(llog.c:858:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:1.0:1777051306.520384:0:103191:0:(llog.c:858:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00080000:2.0:1777051306.779059:0:8464:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0000: transno 4294968348 is committed 00000001:00080000:0.0:1777051306.787542:0:9540:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0001: transno 4294968351 is committed 00010000:00010000:1.0:1777051307.094746:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1777051307.543633:0:103189:0:(llog.c:858:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1777051307.945097:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051307.945173:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051307.945240:0:103163:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425876480 00000100:00100000:0.0:1777051307.945258:0:103163:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425876480 00000100:00100000:2.0:1777051307.945280:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051307.945350:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051307.945359:0:103163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 82 00000100:00100000:0.0:1777051307.945384:0:103163:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d943e26c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29c4352d-3260-4734-909d-9ea5de9e7fa4+12:2436:x1863365425876480:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:2.0:1777051307.945411:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051307.945499:0:103163:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d943e26c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29c4352d-3260-4734-909d-9ea5de9e7fa4+12:2436:x1863365425876480:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 122us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051307.945522:0:103163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 82 00000100:00100000:1.0:1777051307.945644:0:27882:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425876608 00000100:00100000:1.0:1777051307.945655:0:27882:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425876608 00000100:00100000:1.0:1777051307.945740:0:27882:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425876736 00000100:00100000:1.0:1777051307.945747:0:27882:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425876736 00000100:00100000:1.0:1777051307.945779:0:27882:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425877120 00000100:00100000:1.0:1777051307.945784:0:27882:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425877120 00000100:00100000:1.0:1777051307.945821:0:27882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13184 00000100:00100000:1.0:1777051307.945834:0:27882:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7cd9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+14:2437:x1863365425876608:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:2.0:1777051307.946252:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051307.946309:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051307.946349:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051307.946405:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051307.946459:0:8492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425877248 00000100:00100000:2.0:1777051307.946467:0:8492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425877248 00000100:00100000:0.0:1777051307.946526:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13185 00000100:00100000:2.0:1777051307.946543:0:8492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13186 00000100:00100000:0.0:1777051307.946552:0:6580:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7cd9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+6:2436:x1863365425876736:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:2.0:1777051307.946573:0:8492:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7cd9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+17:2437:x1863365425877120:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:3.0:1777051307.946831:0:8468:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425876864 00000100:00100000:3.0:1777051307.946840:0:8468:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425876864 00000100:00100000:3.0:1777051307.946932:0:8468:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425876992 00000100:00100000:3.0:1777051307.946939:0:8468:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425876992 00000100:00100000:3.0:1777051307.946980:0:8468:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425877376 00000100:00100000:3.0:1777051307.946986:0:8468:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425877376 00000100:00100000:3.0:1777051307.947282:0:8468:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425877504 00000100:00100000:3.0:1777051307.947289:0:8468:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425877504 00000100:00100000:3.0:1777051307.947339:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10254 00000100:00100000:2.0:1777051307.947464:0:8492:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7cd9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+17:2437:x1863365425877120:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 900us (2052us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051307.947479:0:8492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13186 00000100:00100000:2.0:1777051307.947510:0:8492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13187 00000100:00100000:2.0:1777051307.947525:0:8492:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7cd9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+48:2436:x1863365425877248:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:2.0:1777051307.947578:0:8492:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7cd9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+48:2436:x1863365425877248:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 55us (1228us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051307.947591:0:8492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13187 00000100:00100000:2.0:1777051307.947637:0:13320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10255 00000100:00100000:2.0:1777051307.947651:0:13320:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7cd9e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+48:2436:x1863365425876992:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:0.0:1777051307.947713:0:6580:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7cd9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+6:2436:x1863365425876736:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 1168us (2362us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051307.947728:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13185 00000100:00080000:0.0:1777051307.948111:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1777051307.948119:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1777051307.948123:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1777051307.948127:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1777051307.948158:0:8470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10256 00000100:00100000:0.0:1777051307.948176:0:8470:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7cd9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+50:2437:x1863365425877376:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:0.0:1777051307.948236:0:8470:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7cd9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+50:2437:x1863365425877376:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 65us (1927us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051307.948250:0:8470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10256 00000100:00100000:0.0:1777051307.948280:0:8470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10257 00000100:00100000:0.0:1777051307.948293:0:8470:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da57c84450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+47:2436:x1863365425877504:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:0.0:1777051307.948338:0:8470:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da57c84450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+47:2436:x1863365425877504:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 48us (1934us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051307.948351:0:8470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10257 00000100:00100000:3.0:1777051307.948411:0:8468:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7cd9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+50:2437:x1863365425876864:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:3.0:1777051307.948480:0:8468:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7cd9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+50:2437:x1863365425876864:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 1126us (3201us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051307.948496:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10254 00000100:00100000:2.0:1777051307.949156:0:13320:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7cd9e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+48:2436:x1863365425876992:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 1504us (2902us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051307.949172:0:13320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10255 00000100:00100000:1.0:1777051307.950209:0:27882:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7cd9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+14:2437:x1863365425876608:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 4372us (5031us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051307.950227:0:27882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13184 00000001:02000400:1.0:1777051308.098078:0:103684:0:(debug.c:645:libcfs_debug_mark_buffer()) DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec 00010000:00010000:1.0:1777051308.118853:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777051309.142473:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1777051309.812028:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051309.813135:0:21368:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425877632 00000100:00100000:2.0:1777051309.813152:0:21368:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425877632 00000100:00100000:2.0:1777051309.813604:0:21368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111746 00000100:00100000:2.0:1777051309.813948:0:21368:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da4457b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+17:132000:x1863365425877632:12345-192.168.201.46@tcp:41:lfs.0 00000100:00080000:0.0:1777051309.813956:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00000024:2.0:1777051309.814010:0:21368:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4194304 pending 0 free 1441603584 avail 1295364096 00000100:00100000:2.0:1777051309.814404:0:21368:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da4457b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+17:132000:x1863365425877632:12345-192.168.201.46@tcp:41:lfs.0 Request processed in 781us (2383us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051309.814421:0:21368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111746 00000100:00100000:2.0:1777051309.816990:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051309.817103:0:8492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425877760 00000100:00100000:0.0:1777051309.817111:0:8492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425877760 00000100:00100000:0.0:1777051309.817190:0:8492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111747 00000100:00100000:0.0:1777051309.817262:0:8492:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7cd9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+48:132000:x1863365425877760:12345-192.168.201.46@tcp:41:lfs.0 00000100:00080000:3.0:1777051309.817275:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00000024:0.0:1777051309.817303:0:8492:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4243456 pending 0 free 1446064128 avail 1299824640 00000100:00100000:0.0:1777051309.817376:0:8492:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7cd9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+48:132000:x1863365425877760:12345-192.168.201.46@tcp:41:lfs.0 Request processed in 120us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051309.817388:0:8492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111747 00000100:00100000:3.0:1777051309.821600:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051309.821713:0:47388:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425877888 00000100:00100000:2.0:1777051309.821723:0:47388:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425877888 00000100:00100000:2.0:1777051309.821815:0:47388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 5566 00000100:00100000:2.0:1777051309.821831:0:47388:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da70a32680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+50:132000:x1863365425877888:12345-192.168.201.46@tcp:13:lfs.0 00002000:00000024:2.0:1777051309.821903:0:47388:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 440353216 pending 0 free 3862671360 avail 3631149056 00000100:00100000:2.0:1777051309.821974:0:47388:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da70a32680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+50:132000:x1863365425877888:12345-192.168.201.46@tcp:13:lfs.0 Request processed in 146us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051309.821992:0:47388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 5566 00000100:00080000:3.0:1777051309.822034:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1777051309.825243:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051309.825343:0:8472:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425878016 00000100:00100000:0.0:1777051309.825352:0:8472:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425878016 00000100:00100000:0.0:1777051309.825457:0:8472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 5567 00000100:00080000:3.0:1777051309.825468:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1777051309.825480:0:8472:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da70a30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+47:132000:x1863365425878016:12345-192.168.201.46@tcp:13:lfs.0 00002000:00000024:0.0:1777051309.825518:0:8472:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 430293440 pending 0 free 3645853696 avail 3414331392 00000100:00100000:0.0:1777051309.825618:0:8472:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da70a30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+47:132000:x1863365425878016:12345-192.168.201.46@tcp:13:lfs.0 Request processed in 148us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051309.825629:0:8472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 5567 00010000:00010000:0.0:1777051310.166741:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777051310.870726:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f9fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3677:1863365452550784:0@lo:400:kworker.0 00000100:00100000:3.0:1777051310.870830:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051310.870954:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d9600bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3677:1863365452551296:0@lo:400:kworker.0 00000100:00100000:3.0:1777051310.871014:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051310.871056:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95f97fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452551808:0@lo:400:kworker.0 00000100:00100000:3.0:1777051310.871103:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051310.871150:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d943d93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3677:1863365452552320:0@lo:400:kworker.0 00000100:00100000:3.0:1777051310.871250:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051310.871299:0:3677:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1777051310.871313:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f9fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452550912:0@lo:400:kworker.0 00000100:00100000:3.0:1777051310.871375:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051310.871421:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955610000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452551424:0@lo:400:kworker.0 00000100:00100000:3.0:1777051310.871473:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051310.871508:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94f169500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3677:1863365452551936:0@lo:400:kworker.0 00000100:00100000:3.0:1777051310.871563:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051310.871641:0:6580:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452551296 00000100:00100000:3.0:1777051310.871653:0:6580:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452551296 00000100:00100000:3.0:1777051310.871736:0:6580:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452552320 00000100:00100000:3.0:1777051310.872041:0:6580:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452552320 00000100:00100000:3.0:1777051310.872097:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13188 00000100:00100000:3.0:1777051310.872116:0:6580:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95fae9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3677:x1863365452551296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051310.872249:0:6580:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95fae9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3677:x1863365452551296:12345-0@lo:400:kworker.0 Request processed in 136us (1232us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051310.872264:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13188 00000100:00100000:3.0:1777051310.872297:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13189 00000100:00100000:3.0:1777051310.872314:0:6580:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95fae8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3677:x1863365452552320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051310.872380:0:6580:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95fae8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3677:x1863365452552320:12345-0@lo:400:kworker.0 Request processed in 71us (1184us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051310.872393:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13189 00000100:00100000:3.0:1777051310.872425:0:27887:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452551808 00000100:00100000:3.0:1777051310.872431:0:27887:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452551808 00000100:00100000:3.0:1777051310.872467:0:27887:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452551424 00000100:00100000:3.0:1777051310.872470:0:27887:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452551424 00000100:00100000:3.0:1777051310.872509:0:27887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10258 00000100:00100000:3.0:1777051310.872524:0:27887:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95fae9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3677:x1863365452551808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051310.872607:0:27887:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95fae9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3677:x1863365452551808:12345-0@lo:400:kworker.0 Request processed in 85us (1501us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051310.872619:0:27887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10258 00000100:00100000:3.0:1777051310.872642:0:27887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10259 00000100:00100000:3.0:1777051310.872655:0:27887:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da444a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3677:x1863365452551424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051310.872708:0:27887:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da444a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3677:x1863365452551424:12345-0@lo:400:kworker.0 Request processed in 55us (1235us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051310.872720:0:27887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10259 00000100:00100000:3.0:1777051310.872755:0:11727:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452550912 00000100:00100000:3.0:1777051310.872760:0:11727:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452550912 00000100:00100000:3.0:1777051310.872796:0:11727:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452551936 00000100:00100000:3.0:1777051310.872799:0:11727:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452551936 00000100:00100000:3.0:1777051310.872824:0:11727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8029 00000100:00100000:3.0:1777051310.872834:0:11727:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f519f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:3677:x1863365452550912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051310.872933:0:11727:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f519f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:3677:x1863365452550912:12345-0@lo:400:kworker.0 Request processed in 99us (1558us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051310.872945:0:11727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8029 00000100:00100000:3.0:1777051310.872971:0:11727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8030 00000100:00100000:3.0:1777051310.872984:0:11727:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da444a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3677:x1863365452551936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777051310.873002:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da4457a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3680:1863365452550656:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1777051310.873041:0:11727:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da444a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3677:x1863365452551936:12345-0@lo:400:kworker.0 Request processed in 59us (1477us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051310.873051:0:11727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8030 00000100:00100000:1.0:1777051310.873076:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051310.873096:0:46500:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452550656 00000100:00100000:3.0:1777051310.873103:0:46500:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452550656 00000100:00100000:1.0:1777051310.873114:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d9600baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3680:1863365452551168:0@lo:400:kworker.0 00000100:00100000:3.0:1777051310.873159:0:46500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8031 00000100:00100000:1.0:1777051310.873160:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051310.873172:0:46500:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5fbeea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+5:3680:x1863365452550656:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1777051310.873193:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955612a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3680:1863365452551680:0@lo:400:kworker.0 00000004:00000024:3.0:1777051310.873244:0:46500:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4243456 pending 0 free 1446064128 avail 1299824640 00000100:00100000:1.0:1777051310.873279:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051310.873298:0:46500:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5fbeea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+5:3680:x1863365452550656:12345-0@lo:41:osp-pre-1-0.0 Request processed in 128us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051310.873309:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94f42c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3680:1863365452552192:0@lo:400:kworker.0 00000100:00100000:3.0:1777051310.873310:0:46500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8031 00000100:00080000:3.0:1777051310.873345:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1777051310.873349:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1777051310.873352:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1777051310.873358:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1777051310.873378:0:46497:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452551168 00000100:00100000:3.0:1777051310.873385:0:46497:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452551168 00000100:00100000:1.0:1777051310.873422:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da4457a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3680:1863365452550656:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1777051310.873433:0:46497:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452551680 00000100:00100000:3.0:1777051310.873437:0:46497:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452551680 00000100:00100000:1.0:1777051310.873445:0:3680:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1777051310.873459:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d9600b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3680:1863365452551040:0@lo:400:kworker.0 00000100:00100000:3.0:1777051310.873477:0:46497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13190 00000100:00100000:3.0:1777051310.873489:0:46497:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5fbed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:lustre-MDT0000-lwp-OST0000_UUID+5:3680:x1863365452551168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777051310.873531:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051310.873539:0:46497:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5fbed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:lustre-MDT0000-lwp-OST0000_UUID+5:3680:x1863365452551168:12345-0@lo:400:kworker.0 Request processed in 53us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051310.873551:0:46497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13190 00000100:00100000:3.0:1777051310.873575:0:46497:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452551040 00000100:00100000:1.0:1777051310.873578:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955610e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3680:1863365452551552:0@lo:400:kworker.0 00000100:00100000:3.0:1777051310.873582:0:46497:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452551040 00000100:00100000:2.0:1777051310.873603:0:10328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13191 00000100:00100000:1.0:1777051310.873624:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051310.873632:0:10328:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5fbee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3680:x1863365452551680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777051310.873673:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95f865180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3680:1863365452552064:0@lo:400:kworker.0 00000100:00100000:2.0:1777051310.873744:0:10328:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5fbee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3680:x1863365452551680:12345-0@lo:400:kworker.0 Request processed in 119us (458us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051310.873746:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051310.873757:0:8628:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452552192 00000100:00100000:0.0:1777051310.873769:0:8628:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452552192 00000100:00100000:1.0:1777051310.873804:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d9600baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3680:1863365452551168:0@lo:400:kworker.0 00000100:00100000:0.0:1777051310.873813:0:8628:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452552064 00000100:00100000:0.0:1777051310.873818:0:8628:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452552064 00000100:00100000:1.0:1777051310.873823:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955612a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3680:1863365452551680:0@lo:400:kworker.0 00000100:00100000:0.0:1777051310.873898:0:8628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10260 00000100:00100000:1.0:1777051310.873899:0:103165:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452550784 00000100:00100000:1.0:1777051310.873906:0:103165:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452550784 00000100:00100000:0.0:1777051310.873910:0:8628:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5fbedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3680:x1863365452552192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777051310.873950:0:103165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1777051310.873963:0:103165:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d943e27850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9351a01-5b0e-4470-97fd-58b9b4b312a2+23:3677:x1863365452550784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777051310.873991:0:8628:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5fbedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3680:x1863365452552192:12345-0@lo:400:kworker.0 Request processed in 83us (640us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051310.874003:0:8628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10260 00000100:00100000:1.0:1777051310.874014:0:103165:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d943e27850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9351a01-5b0e-4470-97fd-58b9b4b312a2+23:3677:x1863365452550784:12345-0@lo:400:kworker.0 Request processed in 54us (3187us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051310.874026:0:8628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10261 00000100:00100000:1.0:1777051310.874026:0:103165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1777051310.874038:0:8628:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5fbec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3680:x1863365452552064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777051310.874091:0:8628:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5fbec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3680:x1863365452552064:12345-0@lo:400:kworker.0 Request processed in 54us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051310.874104:0:8628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10261 00000100:00100000:1.0:1777051310.874113:0:6579:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452551552 00000100:00100000:1.0:1777051310.874120:0:6579:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452551552 00000100:00100000:0.0:1777051310.874255:0:3680:0:(client.c:3101:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968348 gen 2 00000100:00100000:0.0:1777051310.874276:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95f865180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3680:1863365452552064:0@lo:400:kworker.0 00000100:00100000:0.0:1777051310.874290:0:3680:0:(client.c:3101:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968351 gen 2 00000100:00100000:0.0:1777051310.874301:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94f42c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3680:1863365452552192:0@lo:400:kworker.0 00000100:00100000:0.0:1777051310.874316:0:3680:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1777051310.874327:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5fbece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3680:1863365452552576:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1777051310.874366:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051310.874427:0:10113:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452552576 00000100:00100000:0.0:1777051310.874433:0:10113:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452552576 00000100:00100000:0.0:1777051310.874470:0:10113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5568 00000100:00100000:0.0:1777051310.874479:0:10113:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da44578380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3680:x1863365452552576:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1777051310.874499:0:10113:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 430293440 pending 0 free 3645853696 avail 3414331392 00000100:00100000:0.0:1777051310.874547:0:10113:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da44578380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3680:x1863365452552576:12345-0@lo:13:osp-pre-1-1.0 Request processed in 68us (180us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051310.874556:0:10113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5568 00000100:00100000:0.0:1777051310.874596:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5fbece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3680:1863365452552576:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1777051310.874697:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f9fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452550912:0@lo:400:kworker.0 00000100:00100000:0.0:1777051310.874712:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955610000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452551424:0@lo:400:kworker.0 00000100:00100000:0.0:1777051310.874725:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94f169500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3677:1863365452551936:0@lo:400:kworker.0 00000100:00100000:0.0:1777051310.874737:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f9fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3677:1863365452550784:0@lo:400:kworker.0 00000100:00100000:0.0:1777051310.874750:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d9600bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3677:1863365452551296:0@lo:400:kworker.0 00000100:00100000:0.0:1777051310.874762:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95f97fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452551808:0@lo:400:kworker.0 00000100:00100000:0.0:1777051310.874781:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d943d93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3677:1863365452552320:0@lo:400:kworker.0 00000100:00100000:0.0:1777051310.874816:0:3677:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1777051310.874824:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da44579880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452552448:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1777051310.874891:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1777051310.874956:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1777051310.874961:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1777051310.874965:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1777051310.874968:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1777051310.875890:0:46497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13192 00000100:00100000:2.0:1777051310.875905:0:10328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13191 00000100:00100000:3.0:1777051310.875911:0:46497:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5fbec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:lustre-MDT0000-lwp-MDT0001_UUID+5:3680:x1863365452551040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051310.875997:0:46497:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5fbec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:lustre-MDT0000-lwp-MDT0001_UUID+5:3680:x1863365452551040:12345-0@lo:400:kworker.0 Request processed in 92us (2464us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051310.876010:0:46497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13192 00000100:00100000:2.0:1777051310.876048:0:11727:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452552448 00000100:00100000:1.0:1777051310.876051:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13193 00000100:00100000:0.0:1777051310.876056:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d9600b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3680:1863365452551040:0@lo:400:kworker.0 00000100:00100000:2.0:1777051310.876057:0:11727:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452552448 00000100:00100000:1.0:1777051310.876090:0:6579:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5fbed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3680:x1863365452551552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777051310.876154:0:11727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8032 00000100:00100000:2.0:1777051310.876175:0:11727:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da4457aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:3677:x1863365452552448:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1777051310.876190:0:6579:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5fbed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3680:x1863365452551552:12345-0@lo:400:kworker.0 Request processed in 122us (2567us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051310.876200:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13193 00000004:00000024:2.0:1777051310.876210:0:11727:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4194304 pending 0 free 1441603584 avail 1295364096 00000100:00100000:3.0:1777051310.876271:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955610e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3680:1863365452551552:0@lo:400:kworker.0 00000100:00100000:2.0:1777051310.876286:0:11727:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da4457aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:3677:x1863365452552448:12345-0@lo:41:osp-pre-0-1.0 Request processed in 117us (1391us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051310.876296:0:11727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8032 00000100:00100000:2.0:1777051310.876387:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da44579880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452552448:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1777051311.192055:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1777051311.383785:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7cd9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3680:1863365452552704:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1777051311.383877:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da44579500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3677:1863365452552832:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1777051311.383961:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051311.383997:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7fd63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452552960:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1777051311.384068:0:8473:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452552704 00000100:00100000:0.0:1777051311.384084:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051311.384087:0:8473:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452552704 00000100:00100000:2.0:1777051311.384168:0:8472:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452552960 00000100:00100000:2.0:1777051311.384180:0:8472:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452552960 00000100:00100000:3.0:1777051311.384202:0:8473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5569 00000100:00100000:0.0:1777051311.384241:0:10113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5570 00000100:00100000:0.0:1777051311.384266:0:10113:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da4457a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3678:x1863365452552960:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1777051311.384309:0:10113:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 440353216 pending 0 free 3862671360 avail 3631149056 00000100:00100000:3.0:1777051311.384340:0:8473:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7cd9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3680:x1863365452552704:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1777051311.384376:0:8473:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 430293440 pending 0 free 3645853696 avail 3414331392 00000100:00100000:3.0:1777051311.384515:0:8473:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7cd9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3680:x1863365452552704:12345-0@lo:13:osp-pre-1-0.0 Request processed in 292us (558us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051311.384530:0:10113:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da4457a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3678:x1863365452552960:12345-0@lo:13:osp-pre-0-1.0 Request processed in 261us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051311.384548:0:8473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5569 00000100:00100000:0.0:1777051311.384564:0:10113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5570 00000100:00100000:2.0:1777051311.384605:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7fd63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452552960:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1777051311.384648:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051311.384682:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7cd9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3680:1863365452552704:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1777051311.384718:0:8472:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452552832 00000100:00100000:2.0:1777051311.385129:0:8472:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452552832 00000100:00100000:2.0:1777051311.385578:0:8472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5571 00000100:00100000:2.0:1777051311.385606:0:8472:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da44579880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3677:x1863365452552832:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1777051311.385638:0:8472:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 440353216 pending 0 free 3862671360 avail 3631149056 00000100:00100000:2.0:1777051311.386445:0:8472:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da44579880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3677:x1863365452552832:12345-0@lo:13:osp-pre-0-0.0 Request processed in 845us (1796us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051311.386465:0:8472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5571 00000100:00100000:0.0:1777051311.387541:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da44579500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3677:1863365452552832:0@lo:13:osp-pre-0-0.0 00000020:01000004:1.0:1777051311.634329:0:103781:0:(tgt_mount.c:2015:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:1.0:1777051311.634412:0:103781:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.146@tcp lock: ffff99da7d784400/0x85f51a6b96714c7b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b96714c82 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051311.634436:0:103781:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff99da7d784400/0x85f51a6b96714c7b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x85f51a6b96714c82 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051311.634452:0:103781:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff99da7d784400/0x85f51a6b96714c7b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x85f51a6b96714c82 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051311.634465:0:103781:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.146@tcp lock: ffff99da7d784400/0x85f51a6b96714c7b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x85f51a6b96714c82 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051311.634510:0:103781:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1777051311.634519:0:103781:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1777051311.634562:0:103781:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00010000:00010000:0.0:1777051311.634568:0:6567:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1777051311.634570:0:103781:0:(client.c:3101:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1777051311.634583:0:103781:0:(pinger.c:396:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00010000:00010000:0.0:1777051311.634587:0:6567:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.146@tcp lock: ffff99da7d784400/0x85f51a6b96714c7b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x85f51a6b96714c82 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051311.634608:0:6567:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da7d784400 already unused, calling callback (ffffffffc1208c20) 10000000:00010000:0.0:1777051311.634616:0:6567:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.146@tcp lock: ffff99da7d784400/0x85f51a6b96714c7b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x85f51a6b96714c82 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1777051311.634622:0:103781:0:(import.c:65:import_set_state_nolock()) ffff99da7fa93000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:0.0:1777051311.634640:0:6567:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.146@tcp lock: ffff99da7d784400/0x85f51a6b96714c7b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x85f51a6b96714c82 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1777051311.634660:0:6567:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.146@tcp lock: ffff99da7d784400/0x85f51a6b96714c7b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x85f51a6b96714c82 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1777051311.634673:0:6567:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1777051311.634679:0:6567:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1777051311.634684:0:6567:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1777051311.634733:0:6567:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.146@tcp lock: ffff99da7d784400/0x85f51a6b96714c7b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x85f51a6b96714c82 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051311.634749:0:6567:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1777051311.634749:0:3676:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5fbedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3676:1863365452553088:0@lo:39:umount.0 00010000:00010000:0.0:1777051311.634814:0:6567:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.146@tcp lock: ffff99da7d784400/0x85f51a6b96714c7b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x85f51a6b96714c82 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051311.634868:0:6567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.146@tcp lock: ffff99da7d784400/0x85f51a6b96714c7b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x85f51a6b96714c82 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051311.634897:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777051311.634906:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1777051311.634908:0:3676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1777051311.634913:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1777051311.634933:0:3680:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1777051311.634957:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da44579500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3680:1863365452553216:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1777051311.635041:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051311.635108:0:8492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452553088 00000100:00100000:1.0:1777051311.635121:0:8492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452553088 00000100:00100000:0.0:1777051311.635225:0:24467:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452553216 00000100:00100000:0.0:1777051311.635236:0:24467:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452553216 00000100:00100000:0.0:1777051311.635349:0:24467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13668 00000100:00100000:0.0:1777051311.635420:0:24467:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da4457a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f9351a01-5b0e-4470-97fd-58b9b4b312a2+23:3680:x1863365452553216:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1777051311.635453:0:24467:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777051311.635485:0:24467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d955a98000/0x85f51a6b96714c82 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x85f51a6b96714c7b expref: 23 pid: 103165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051311.635514:0:24467:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1777051311.635614:0:24467:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da4457a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f9351a01-5b0e-4470-97fd-58b9b4b312a2+22:3680:x1863365452553216:12345-0@lo:103:ldlm_bl.0 Request processed in 247us (572us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051311.635633:0:24467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13668 00000100:00100000:1.0:1777051311.635675:0:8492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111748 00000100:00100000:1.0:1777051311.635699:0:8492:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7cd9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3676:x1863365452553088:12345-0@lo:39:umount.0 00000020:00000080:1.0:1777051311.635733:0:8492:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x85f51a6b96714cdd 00000100:00080000:1.0:1777051311.635761:0:8492:0:(import.c:65:import_set_state_nolock()) ffff99d944c1c800 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1777051311.635765:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da44579500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3680:1863365452553216:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1777051311.635862:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1777051311.635918:0:8492:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7cd9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+1:3676:x1863365452553088:12345-0@lo:39:umount.0 Request processed in 225us (1014us total) trans 0 rc 0/0 00000100:00080000:2.0:1777051311.635937:0:3676:0:(import.c:65:import_set_state_nolock()) ffff99da7fa93000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1777051311.635938:0:8492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111748 00000020:00000080:1.0:1777051311.635982:0:8492:0:(genops.c:906:class_export_put()) final put ffff99d944c18000/lustre-MDT0000-lwp-MDT0001_UUID 00000100:00100000:2.0:1777051311.635982:0:3676:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5fbedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3676:1863365452553088:0@lo:39:umount.0 00000100:00080000:0.0:1777051311.636042:0:103781:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1777051311.636049:0:103781:0:(client.c:3101:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1777051311.636059:0:103781:0:(import.c:321:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1777051311.636121:0:48457:0:(genops.c:865:class_export_destroy()) destroying export ffff99d944c18000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1777051311.636396:0:48457:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99d944c1c800 for lustre-MDT0000 00010000:00010000:0.0:1777051311.638193:0:103781:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.146@tcp lock: ffff99da713e3200/0x85f51a6b96714c97 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b96714c9e expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051311.638386:0:103781:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff99da713e3200/0x85f51a6b96714c97 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x85f51a6b96714c9e expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051311.638401:0:103781:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff99da713e3200/0x85f51a6b96714c97 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x85f51a6b96714c9e expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051311.638415:0:103781:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.146@tcp lock: ffff99da713e3200/0x85f51a6b96714c97 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x85f51a6b96714c9e expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051311.638457:0:103781:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1777051311.638478:0:38719:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1777051311.638489:0:38719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.146@tcp lock: ffff99da713e3200/0x85f51a6b96714c97 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x85f51a6b96714c9e expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051311.638503:0:38719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da713e3200 already unused, calling callback (ffffffffc1208c20) 10000000:00010000:0.0:1777051311.638510:0:38719:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.146@tcp lock: ffff99da713e3200/0x85f51a6b96714c97 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x85f51a6b96714c9e expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051311.638524:0:38719:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.146@tcp lock: ffff99da713e3200/0x85f51a6b96714c97 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x85f51a6b96714c9e expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1777051311.638538:0:38719:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.146@tcp lock: ffff99da713e3200/0x85f51a6b96714c97 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x85f51a6b96714c9e expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1777051311.638549:0:38719:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1777051311.638554:0:38719:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 00010000:00010000:0.0:1777051311.638589:0:38719:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.146@tcp lock: ffff99da713e3200/0x85f51a6b96714c97 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x85f51a6b96714c9e expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051311.638601:0:38719:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1777051311.638638:0:38719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.146@tcp lock: ffff99da713e3200/0x85f51a6b96714c97 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x85f51a6b96714c9e expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051311.638653:0:38719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.146@tcp lock: ffff99da713e3200/0x85f51a6b96714c97 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x85f51a6b96714c9e expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051311.638684:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777051311.638688:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777051311.638696:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1777051311.638719:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da44579500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3680:1863365452553344:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1777051311.638793:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051311.640046:0:47597:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452553344 00000100:00100000:3.0:1777051311.640058:0:47597:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452553344 00000100:00100000:3.0:1777051311.640126:0:47597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13669 00000100:00100000:3.0:1777051311.640146:0:47597:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da4457b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f9351a01-5b0e-4470-97fd-58b9b4b312a2+22:3680:x1863365452553344:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1777051311.640166:0:47597:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777051311.640189:0:47597:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d955a98800/0x85f51a6b96714c9e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x85f51a6b96714c97 expref: 22 pid: 103169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051311.640270:0:47597:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1777051311.640332:0:47597:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da4457b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f9351a01-5b0e-4470-97fd-58b9b4b312a2+21:3680:x1863365452553344:12345-0@lo:103:ldlm_bl.0 Request processed in 193us (1545us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051311.640347:0:47597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13669 00000100:00100000:0.0:1777051311.640647:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da44579500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3680:1863365452553344:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1777051311.640701:0:103781:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.146@tcp lock: ffff99d955a99400/0x85f51a6b96714c89 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b96714c90 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051311.640720:0:103781:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff99d955a99400/0x85f51a6b96714c89 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x85f51a6b96714c90 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051311.640735:0:103781:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff99d955a99400/0x85f51a6b96714c89 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x85f51a6b96714c90 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051311.640748:0:103781:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.146@tcp lock: ffff99d955a99400/0x85f51a6b96714c89 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x85f51a6b96714c90 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051311.640797:0:103781:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1777051311.640854:0:103781:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.146@tcp lock: ffff99d9442ea200/0x85f51a6b96714cc1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b96714cc8 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051311.640876:0:103781:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff99d9442ea200/0x85f51a6b96714cc1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x85f51a6b96714cc8 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051311.640888:0:103781:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff99d9442ea200/0x85f51a6b96714cc1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x85f51a6b96714cc8 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051311.640902:0:103781:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.146@tcp lock: ffff99d9442ea200/0x85f51a6b96714cc1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x85f51a6b96714cc8 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051311.640969:0:13753:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1777051311.640982:0:13753:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.146@tcp lock: ffff99d955a99400/0x85f51a6b96714c89 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x85f51a6b96714c90 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051311.641000:0:13753:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d955a99400 already unused, calling callback (ffffffffc1208c20) 10000000:00010000:3.0:1777051311.641008:0:13753:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.146@tcp lock: ffff99d955a99400/0x85f51a6b96714c89 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x85f51a6b96714c90 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051311.641035:0:13753:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.146@tcp lock: ffff99d955a99400/0x85f51a6b96714c89 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x85f51a6b96714c90 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1777051311.641049:0:13753:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.146@tcp lock: ffff99d955a99400/0x85f51a6b96714c89 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x85f51a6b96714c90 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1777051311.641061:0:13753:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1777051311.641066:0:13753:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:3.0:1777051311.641071:0:13753:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1777051311.641107:0:13753:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.146@tcp lock: ffff99d955a99400/0x85f51a6b96714c89 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x85f51a6b96714c90 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051311.641113:0:103781:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1777051311.641127:0:13753:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1777051311.641136:0:6567:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1777051311.641144:0:6567:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.146@tcp lock: ffff99d9442ea200/0x85f51a6b96714cc1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x85f51a6b96714cc8 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051311.641155:0:6567:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d9442ea200 already unused, calling callback (ffffffffc1208c20) 10000000:00010000:0.0:1777051311.641160:0:6567:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.146@tcp lock: ffff99d9442ea200/0x85f51a6b96714cc1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x85f51a6b96714cc8 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051311.641170:0:6567:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.146@tcp lock: ffff99d9442ea200/0x85f51a6b96714cc1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x85f51a6b96714cc8 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051311.641170:0:13753:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.146@tcp lock: ffff99d955a99400/0x85f51a6b96714c89 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x85f51a6b96714c90 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051311.641206:0:13753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.146@tcp lock: ffff99d955a99400/0x85f51a6b96714c89 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x85f51a6b96714c90 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051311.641229:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:00010000:0.0:1777051311.641230:0:6567:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.146@tcp lock: ffff99d9442ea200/0x85f51a6b96714cc1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x85f51a6b96714cc8 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051311.641235:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1777051311.641245:0:6567:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1777051311.641245:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1777051311.641253:0:6567:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1777051311.641257:0:6567:0:(mgc_request.c:130:config_log_put()) dropping config log params 00000100:00100000:3.0:1777051311.641274:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7fd63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3677:1863365452553472:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1777051311.641293:0:6567:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.146@tcp lock: ffff99d9442ea200/0x85f51a6b96714cc1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x85f51a6b96714cc8 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051311.641308:0:6567:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1777051311.641325:0:6567:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.146@tcp lock: ffff99d9442ea200/0x85f51a6b96714cc1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x85f51a6b96714cc8 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051311.641346:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1777051311.641348:0:6567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.146@tcp lock: ffff99d9442ea200/0x85f51a6b96714cc1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x85f51a6b96714cc8 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051311.641370:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777051311.641376:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777051311.641381:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777051311.641403:0:103781:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.146@tcp lock: ffff99d955a99c00/0x85f51a6b96714ca5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b96714cac expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051311.641416:0:103781:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff99d955a99c00/0x85f51a6b96714ca5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x85f51a6b96714cac expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051311.641429:0:103781:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff99d955a99c00/0x85f51a6b96714ca5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x85f51a6b96714cac expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051311.641440:0:103781:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.146@tcp lock: ffff99d955a99c00/0x85f51a6b96714ca5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x85f51a6b96714cac expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051311.641463:0:103781:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1777051311.641469:0:103781:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 10000000:01000000:0.0:1777051311.641474:0:103781:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00000020:01000004:0.0:1777051311.641523:0:103781:0:(tgt_mount.c:2065:server_put_super()) stopping lustre-MDT0001 00000020:01000000:0.0:1777051311.641530:0:103781:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='FA') 00000020:00000080:0.0:1777051311.641539:0:103781:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:02000400:0.0:1777051311.641548:0:103781:0:(obd_config.c:932:class_cleanup()) Failing over lustre-MDT0001 00000100:00100000:2.0:1777051311.642442:0:6565:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452553472 00000100:00100000:2.0:1777051311.642456:0:6565:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452553472 00000100:00100000:2.0:1777051311.642544:0:6565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13670 00000100:00100000:2.0:1777051311.642563:0:6565:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5fbe0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f9351a01-5b0e-4470-97fd-58b9b4b312a2+21:3677:x1863365452553472:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1777051311.642584:0:6565:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777051311.642611:0:6565:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99da7d784e00/0x85f51a6b96714c90 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x85f51a6b96714c89 expref: 21 pid: 103165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051311.642642:0:6565:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1777051311.642689:0:3677:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1777051311.642710:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da44579500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3677:1863365452553600:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1777051311.642719:0:6565:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5fbe0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f9351a01-5b0e-4470-97fd-58b9b4b312a2+20:3677:x1863365452553472:12345-0@lo:103:ldlm_bl.0 Request processed in 157us (1377us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051311.642746:0:6565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13670 00000100:00100000:3.0:1777051311.642773:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1777051311.642787:0:6568:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777051311.642799:0:6568:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.146@tcp lock: ffff99d955a99c00/0x85f51a6b96714ca5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x85f51a6b96714cac expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051311.642819:0:6568:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d955a99c00 already unused, calling callback (ffffffffc1208c20) 10000000:00010000:2.0:1777051311.642867:0:6568:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.146@tcp lock: ffff99d955a99c00/0x85f51a6b96714ca5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x85f51a6b96714cac expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051311.642883:0:6568:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.146@tcp lock: ffff99d955a99c00/0x85f51a6b96714ca5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x85f51a6b96714cac expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1777051311.642897:0:6568:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.146@tcp lock: ffff99d955a99c00/0x85f51a6b96714ca5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x85f51a6b96714cac expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1777051311.642908:0:6568:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1777051311.642913:0:6568:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:2.0:1777051311.642916:0:6568:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:2.0:1777051311.642948:0:6568:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.146@tcp lock: ffff99d955a99c00/0x85f51a6b96714ca5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x85f51a6b96714cac expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051311.642961:0:6568:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1777051311.642996:0:6568:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.146@tcp lock: ffff99d955a99c00/0x85f51a6b96714ca5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x85f51a6b96714cac expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051311.643010:0:6568:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.146@tcp lock: ffff99d955a99c00/0x85f51a6b96714ca5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x85f51a6b96714cac expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051311.643028:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777051311.643031:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777051311.643036:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1777051311.643049:0:3680:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1777051311.643066:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7cd9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3680:1863365452553728:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1777051311.643128:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051311.643182:0:47827:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452553600 00000100:00100000:2.0:1777051311.643191:0:47827:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452553600 00000100:00100000:2.0:1777051311.643293:0:47827:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452553728 00000100:00100000:2.0:1777051311.643300:0:47827:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452553728 00000100:00100000:2.0:1777051311.643356:0:47827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13671 00000100:00100000:3.0:1777051311.643365:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7fd63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3677:1863365452553472:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1777051311.643377:0:47827:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5fbe0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:f9351a01-5b0e-4470-97fd-58b9b4b312a2+21:3677:x1863365452553600:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1777051311.643405:0:47827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777051311.643430:0:47827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d9442ea000/0x85f51a6b96714cc8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x85f51a6b96714cc1 expref: 21 pid: 103163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051311.643456:0:47827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1777051311.643535:0:47827:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5fbe0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:f9351a01-5b0e-4470-97fd-58b9b4b312a2+20:3677:x1863365452553600:12345-0@lo:103:ldlm_bl.0 Request processed in 163us (762us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051311.643553:0:47827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13671 00000100:00100000:2.0:1777051311.643592:0:47827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13672 00000100:00100000:2.0:1777051311.643610:0:47827:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da6fd44450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:f9351a01-5b0e-4470-97fd-58b9b4b312a2+19:3680:x1863365452553728:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1777051311.643626:0:47827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777051311.643646:0:47827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d9442eb600/0x85f51a6b96714cac lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x85f51a6b96714ca5 expref: 19 pid: 103166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051311.643675:0:47827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1777051311.643739:0:47827:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da6fd44450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:f9351a01-5b0e-4470-97fd-58b9b4b312a2+18:3680:x1863365452553728:12345-0@lo:103:ldlm_bl.0 Request processed in 133us (609us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051311.643753:0:47827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13672 00000100:00100000:3.0:1777051311.643780:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da44579500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3677:1863365452553600:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1777051311.643910:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7cd9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3680:1863365452553728:0@lo:103:ldlm_bl.0 00000004:00000080:0.0:1777051311.648685:0:103781:0:(mdt_handler.c:8165:mdt_iocontrol()) lustre-MDT0001: cmd=40086672 len=0 karg=0000000000000000 uarg=0000000000000000 00000020:00000080:1.0:1777051311.649698:0:103781:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 5/11 00000020:00080000:1.0:1777051311.649709:0:103781:0:(genops.c:1840:print_export_data()) lustre-MDT0001: ACTIVE ffff99d942fdd000 lustre-MDT0000-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1777051311.649721:0:103781:0:(genops.c:1840:print_export_data()) lustre-MDT0001: ACTIVE ffff99da7b5f3000 c11b6966-0775-44d2-bdc6-c74c26eb2226 192.168.201.46@tcp 5 (0 0 1) 0 0 0 0: 0000000000000000 4294970537 stale:0 00000020:00080000:1.0:1777051311.649729:0:103781:0:(genops.c:1840:print_export_data()) lustre-MDT0001: ACTIVE ffff99d944b1a800 2dd4696c-edce-4cd1-86d2-dbd2ff957fa1 192.168.201.46@tcp 47 (0 0 43) 0 0 0 0: 0000000000000000 4294970570 stale:0 00000020:00080000:1.0:1777051311.649735:0:103781:0:(genops.c:1840:print_export_data()) lustre-MDT0001: ACTIVE ffff99d941e57800 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1777051311.649740:0:103781:0:(genops.c:1840:print_export_data()) lustre-MDT0001: ACTIVE ffff99d9410c8800 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1777051311.649746:0:103781:0:(genops.c:1574:class_disconnect_exports()) OBD device 11 (ffff99da5807b380) has exports, disconnecting them 00000020:00080000:1.0:1777051311.649752:0:103781:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff99d942fdd000), last request at 1777051295 00000020:00000080:1.0:1777051311.649759:0:103781:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x85f51a6b96714ba9 00000100:00080000:1.0:1777051311.649767:0:103781:0:(import.c:65:import_set_state_nolock()) ffff99da44f1f000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1777051311.649821:0:103781:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff99d942fdd000): rc 0 00000020:00000080:1.0:1777051311.649861:0:103781:0:(genops.c:906:class_export_put()) final put ffff99d942fdd000/lustre-MDT0000-mdtlov_UUID 00000020:00080000:1.0:1777051311.649895:0:103781:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 192.168.201.46@tcp (ffff99da7b5f3000), last request at 1777051307 00000020:00000080:1.0:1777051311.649903:0:103781:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x85f51a6b96705089 00000020:00010000:1.0:1777051311.649914:0:103781:0:(genops.c:1942:obd_stale_export_put()) Put export ffff99da7b5f3000: total 1 00000100:00080000:1.0:1777051311.649920:0:103781:0:(import.c:65:import_set_state_nolock()) ffff99da5f941800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1777051311.649950:0:103781:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.201.46@tcp (ffff99da7b5f3000): rc 0 00000020:00010000:3.0:1777051311.649977:0:13753:0:(genops.c:1928:obd_stale_export_get()) Get export ffff99da7b5f3000: total 1 00000020:00080000:1.0:1777051311.649981:0:103781:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 192.168.201.46@tcp (ffff99d944b1a800), last request at 1777051309 00000020:00000080:1.0:1777051311.650003:0:103781:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x85f51a6b9615cb48 00000020:00010000:1.0:1777051311.650011:0:103781:0:(genops.c:1942:obd_stale_export_put()) Put export ffff99d944b1a800: total 1 00000100:00080000:1.0:1777051311.650016:0:103781:0:(import.c:65:import_set_state_nolock()) ffff99d944b19800 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1777051311.650381:0:13753:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff99da7b5f3000, canceled 0 locks, left on hash table 1. 00000020:00080000:1.0:1777051311.650404:0:103781:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.201.46@tcp (ffff99d944b1a800): rc 0 00000020:00080000:1.0:1777051311.650412:0:103781:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff99d941e57800), last request at 1777051310 00000020:00000080:1.0:1777051311.650421:0:103781:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x85f51a6b96149787 00000100:00080000:1.0:1777051311.650436:0:103781:0:(import.c:65:import_set_state_nolock()) ffff99d941e54000 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1777051311.650447:0:13753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d953284200/0x85f51a6b967087d3 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x4:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b1e97 expref: 2 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00010000:2.0:1777051311.650474:0:38719:0:(genops.c:1928:obd_stale_export_get()) Get export ffff99d944b1a800: total 1 00010000:00010000:3.0:1777051311.650484:0:13753:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff99da7b5f3000, canceled 1 locks, left on hash table 0. 00000020:00080000:1.0:1777051311.650488:0:103781:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff99d941e57800): rc 0 00010000:00010000:2.0:1777051311.650559:0:38719:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff99d944b1a800, canceled 0 locks, left on hash table 43. 00000020:00000080:1.0:1777051311.650573:0:103781:0:(genops.c:906:class_export_put()) final put ffff99d941e57800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:1.0:1777051311.650583:0:103781:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff99d9410c8800), last request at 1777051310 00000020:00000080:1.0:1777051311.650589:0:103781:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x85f51a6b96149661 00000100:00080000:1.0:1777051311.650597:0:103781:0:(import.c:65:import_set_state_nolock()) ffff99d9410ca800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1777051311.650607:0:103781:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff99d9410c8800): rc 0 00000020:00000080:1.0:1777051311.650610:0:103781:0:(genops.c:906:class_export_put()) final put ffff99d9410c8800/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:1.0:1777051311.650620:0:103781:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffb08941e7bae0 00000100:00080000:1.0:1777051311.650645:0:103781:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00010000:00010000:2.0:1777051311.650650:0:38719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d9533a0e00/0x85f51a6b9618673c lrc: 0/0,0 mode: --/PR res: [0x240000403:0x17a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f64b37ca expref: 44 pid: 11727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051311.650651:0:103781:0:(client.c:3101:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 12884902301 gen 3 00010000:00010000:0.0:1777051311.650696:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777051311.650698:0:38719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d9502da800/0x85f51a6b96184ca1 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x15e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f64b2e46 expref: 43 pid: 11727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051311.650733:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777051311.650758:0:38719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d94f682e00/0x85f51a6b9617cc71 lrc: 0/0,0 mode: --/PR res: [0x240000403:0xd1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f64b00fe expref: 42 pid: 46202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051311.651141:0:38719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d9553e7e00/0x85f51a6b9617bace lrc: 0/0,0 mode: --/PR res: [0x240000403:0xc1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f64afae5 expref: 41 pid: 46202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051311.651237:0:38719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d954ea7200/0x85f51a6b96186b8e lrc: 0/0,0 mode: --/PR res: [0x240000403:0x17f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f64b3928 expref: 40 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051311.651278:0:38719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d94eccd000/0x85f51a6b96185e7c lrc: 0/0,0 mode: --/PR res: [0x240000403:0x173:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f64b34dd expref: 39 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051311.651332:0:38719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61a200/0x85f51a6b9618573d lrc: 0/0,0 mode: --/PR res: [0x240000403:0x16b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f64b329f expref: 38 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051311.651384:0:38719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d953284a00/0x85f51a6b9617a009 lrc: 0/0,0 mode: --/PR res: [0x240000403:0xab:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f64af16f expref: 37 pid: 46202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051311.651435:0:38719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72de00/0x85f51a6b96181821 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x121:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f64b1bca expref: 36 pid: 11727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051311.651467:0:38719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d950711e00/0x85f51a6b961852ac lrc: 0/0,0 mode: --/PR res: [0x240000403:0x161:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f64b30a0 expref: 35 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051311.651501:0:38719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e48bc00/0x85f51a6b9617963f lrc: 0/0,0 mode: --/PR res: [0x240000403:0xa4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f64aee12 expref: 34 pid: 46493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051311.651540:0:38719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d95595a800/0x85f51a6b9617c3db lrc: 0/0,0 mode: --/PR res: [0x240000403:0xc9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f64afe2d expref: 33 pid: 8479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051311.651576:0:38719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d953299800/0x85f51a6b9617c77e lrc: 0/0,0 mode: --/PR res: [0x240000403:0xcd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f64aff8b expref: 32 pid: 8479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051311.651621:0:38719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d94fde6e00/0x85f51a6b961807ce lrc: 0/0,0 mode: --/PR res: [0x240000403:0x111:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f64b15bf expref: 31 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051311.655181:0:103781:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d9418d3400/0x85f51a6b96149c5e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x110e400000000 nid: local remote: 0x85f51a6b96714d62 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1777051311.655207:0:103781:0:(mdt_handler.c:3963:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d9418d3400/0x85f51a6b96149c5e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x110f400000000 nid: local remote: 0x85f51a6b96714d62 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1777051311.655279:0:103781:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:1.0:1777051311.655322:0:103781:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1777051311.655363:0:103781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d9418d3400/0x85f51a6b96149c5e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x590f400000000 nid: local remote: 0x85f51a6b96714d62 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051311.658959:0:38719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e6e7200/0x85f51a6b961846ea lrc: 0/0,0 mode: --/PR res: [0x240000403:0x155:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f64b2ca2 expref: 30 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051311.659177:0:38719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d955919400/0x85f51a6b9617cb8a lrc: 0/0,0 mode: --/PR res: [0x240000403:0xdb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f64b00b8 expref: 29 pid: 8479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051311.659271:0:38719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e9d6200/0x85f51a6b9618a6c1 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x1b1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f64b4e28 expref: 28 pid: 46500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051311.659306:0:38719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d954ebde00/0x85f51a6b96185bab lrc: 0/0,0 mode: --/PR res: [0x240000403:0x16f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f64b33a9 expref: 27 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051311.659346:0:38719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e7e3800/0x85f51a6b96180cc1 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x120:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f64b180b expref: 26 pid: 46498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051311.659379:0:38719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d950afe400/0x85f51a6b9617a3b3 lrc: 0/0,0 mode: --/PR res: [0x240000403:0xaf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f64af279 expref: 25 pid: 8480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051311.659407:0:38719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d785a00/0x85f51a6b9617b30a lrc: 0/0,0 mode: --/PR res: [0x240000403:0xb9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f64af822 expref: 24 pid: 8479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051311.659441:0:38719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d941ad7e00/0x85f51a6b9617a3f2 lrc: 0/0,0 mode: --/PR res: [0x240000403:0xa9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f64af2b8 expref: 23 pid: 46493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051311.659470:0:38719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d950afe800/0x85f51a6b9617acab lrc: 0/0,0 mode: --/PR res: [0x240000403:0xbc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f64af5e4 expref: 22 pid: 46496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051311.659498:0:38719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d94ffbcc00/0x85f51a6b96189ca3 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x1a9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f64b4acb expref: 21 pid: 46500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051311.659525:0:38719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d955a98600/0x85f51a6b96185036 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x162:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f64b2f9d expref: 20 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051311.659558:0:38719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d955a91000/0x85f51a6b96185ad9 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x16e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f64b33b7 expref: 19 pid: 46498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051311.659587:0:38719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d9502da600/0x85f51a6b9618611c lrc: 0/0,0 mode: --/PR res: [0x240000403:0x176:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f64b35c4 expref: 18 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051311.659673:0:38719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d955a83600/0x85f51a6b9617ecae lrc: 0/0,0 mode: --/PR res: [0x240000403:0xfb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f64b0c96 expref: 17 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051311.659704:0:38719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d95071b200/0x85f51a6b96186e20 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x180:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f64b3a8d expref: 16 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051311.659736:0:38719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d950263a00/0x85f51a6b96189882 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x1aa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f64b494a expref: 15 pid: 46498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051311.659764:0:38719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d5ce400/0x85f51a6b96181b00 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x12c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f64b1cb1 expref: 14 pid: 46498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051311.659800:0:38719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d94eb2ac00/0x85f51a6b9618622d lrc: 0/0,0 mode: --/PR res: [0x240000403:0x177:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f64b3611 expref: 13 pid: 11727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051311.659862:0:38719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d94f69b600/0x85f51a6b961892a1 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x1a7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f64b470c expref: 12 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051311.659900:0:38719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72f200/0x85f51a6b961879d4 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x18f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f64b3e76 expref: 11 pid: 11727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051311.659932:0:38719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d955a8fe00/0x85f51a6b9617f33e lrc: 0/0,0 mode: --/PR res: [0x240000403:0x106:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f64b0ef0 expref: 10 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051311.659967:0:38719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d950262600/0x85f51a6b96187781 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x18a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f64b3d96 expref: 9 pid: 11727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051311.660010:0:38719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e48ae00/0x85f51a6b96179bb0 lrc: 0/0,0 mode: --/PR res: [0x240000403:0xa7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f64aefb6 expref: 8 pid: 8479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051311.660055:0:38719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d506800/0x85f51a6b9617e021 lrc: 0/0,0 mode: --/PR res: [0x240000403:0xef:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f64b0867 expref: 7 pid: 11727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051311.660111:0:38719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a3c00/0x85f51a6b96188010 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x18d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f64b4091 expref: 6 pid: 46498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051311.660141:0:38719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d94eb2a200/0x85f51a6b96708858 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x4:0x0].0x0 bits 0x10/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b1ec1 expref: 5 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051311.660176:0:38719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d950ae9e00/0x85f51a6b9617ce0e lrc: 0/0,0 mode: --/PR res: [0x240000403:0xda:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f64b01de expref: 4 pid: 46496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051311.660258:0:38719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d954ea4c00/0x85f51a6b961887b8 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x19a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f64b434d expref: 3 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051311.660294:0:38719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d950704400/0x85f51a6b961812e1 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x124:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f64b19e0 expref: 2 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051311.660429:0:38719:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff99d944b1a800, canceled 43 locks, left on hash table 0. 00000100:00080000:0.0:1777051311.676624:0:103781:0:(pinger.c:396:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1777051311.676748:0:103781:0:(import.c:65:import_set_state_nolock()) ffff99da7dbeb000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1777051311.676880:0:3676:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da4457ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3676:1863365452553856:0@lo:39:umount.0 00000100:00100000:0.0:1777051311.676976:0:3676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1777051311.677039:0:103781:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1777051311.677047:0:103781:0:(client.c:3101:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967899 gen 3 00000004:00080000:1.0:1777051311.677393:0:103781:0:(osp_dev.c:1629:osp_import_event()) got inactive 00000100:00100000:0.0:1777051311.677425:0:46498:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452553856 00000100:00100000:0.0:1777051311.677437:0:46498:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452553856 00000100:00100000:0.0:1777051311.677504:0:46498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8033 00000100:00100000:0.0:1777051311.677519:0:46498:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da44579500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+7:3676:x1863365452553856:12345-0@lo:39:umount.0 00000020:00000080:0.0:1777051311.677557:0:46498:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x85f51a6b96714b5c 00000020:00010000:0.0:1777051311.677574:0:46498:0:(genops.c:1942:obd_stale_export_put()) Put export ffff99d941c44800: total 3 00000100:00080000:0.0:1777051311.677580:0:46498:0:(import.c:65:import_set_state_nolock()) ffff99da499cf000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1777051311.677610:0:46498:0:(tgt_lastrcvd.c:732:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 7, last_transno is 30064771072 00000100:00100000:0.0:1777051311.677878:0:46498:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da44579500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+5:3676:x1863365452553856:12345-0@lo:39:umount.0 Request processed in 359us (902us total) trans 30064771073 rc 0/0 00000100:00100000:0.0:1777051311.677900:0:46498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8033 00000020:00010000:0.0:1777051311.677958:0:6567:0:(genops.c:1928:obd_stale_export_get()) Get export ffff99d941c44800: total 3 00010000:00010000:0.0:1777051311.677965:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777051311.678026:0:6567:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff99d941c44800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1777051311.678076:0:6567:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d941e2ee00) 00010000:00010000:0.0:1777051311.678083:0:6567:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1777051311.678095:0:6567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da429d7600/0x85f51a6b96714d62 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x85f51a6b96149c5e expref: 4 pid: 103199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051311.678139:0:6567:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff99d941c44800, canceled 1 locks, left on hash table 0. 00010000:00010000:0.0:1777051311.678163:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777051311.678167:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777051311.678170:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1777051311.678516:0:3676:0:(import.c:65:import_set_state_nolock()) ffff99da7dbeb000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1777051311.678527:0:3676:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da4457ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3676:1863365452553856:0@lo:39:umount.0 00000020:00000080:0.0:1777051311.678580:0:48457:0:(genops.c:865:class_export_destroy()) destroying export ffff99d942fdd000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:0.0:1777051311.678657:0:48457:0:(genops.c:865:class_export_destroy()) destroying export ffff99d941e57800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:0.0:1777051311.678704:0:48457:0:(genops.c:865:class_export_destroy()) destroying export ffff99d9410c8800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:0.0:1777051311.678745:0:48457:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99da44f1f000 for lustre-MDT0001 00000020:00000080:0.0:1777051311.678751:0:48457:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99d941e54000 for lustre-MDT0001 00000020:00000080:0.0:1777051311.678757:0:48457:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99d9410ca800 for lustre-MDT0001 00000100:00080000:1.0:1777051311.679044:0:103781:0:(pinger.c:396:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1777051311.679064:0:103781:0:(import.c:65:import_set_state_nolock()) ffff99da5f27d000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1777051311.679089:0:103781:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1777051311.679094:0:103781:0:(client.c:3101:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967910 gen 3 00000004:00080000:1.0:1777051311.679109:0:103781:0:(osp_dev.c:1629:osp_import_event()) got inactive 00000100:00100000:0.0:1777051311.679155:0:3676:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5fbeed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3676:1863365452553984:0@lo:9:umount.0 00000100:00100000:0.0:1777051311.679215:0:3676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051311.679543:0:13320:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452553984 00000100:00100000:0.0:1777051311.679552:0:13320:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452553984 00000100:00100000:0.0:1777051311.679598:0:13320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7954 00000100:00100000:0.0:1777051311.679611:0:13320:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da4457a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3676:x1863365452553984:12345-0@lo:9:umount.0 00000020:00000080:0.0:1777051311.679633:0:13320:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x85f51a6b961496ae 00000100:00080000:0.0:1777051311.679642:0:13320:0:(import.c:65:import_set_state_nolock()) ffff99d94183c000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1777051311.679679:0:13320:0:(tgt_lastrcvd.c:732:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294968348 00000100:00100000:0.0:1777051311.679816:0:13320:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da4457a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+2:3676:x1863365452553984:12345-0@lo:9:umount.0 Request processed in 205us (604us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051311.679862:0:13320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7954 00010000:00010000:0.0:1777051311.679892:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1777051311.679924:0:3676:0:(import.c:65:import_set_state_nolock()) ffff99da5f27d000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1777051311.679938:0:3676:0:(osp_dev.c:1613:osp_import_event()) got disconnected 00000004:00080000:0.0:1777051311.679941:0:3676:0:(osp_dev.c:1629:osp_import_event()) got inactive 00000100:00100000:0.0:1777051311.679946:0:3676:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5fbeed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3676:1863365452553984:0@lo:9:umount.0 00000100:00080000:1.0:1777051311.680440:0:103781:0:(pinger.c:396:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1777051311.680456:0:103781:0:(import.c:65:import_set_state_nolock()) ffff99da5f27d800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:1.0:1777051311.680502:0:103781:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffff99da5807b380) has no exports 00000100:00100000:0.0:1777051311.681039:0:3676:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5fbef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3676:1863365452554112:0@lo:9:umount.0 00000040:00080000:1.0:1777051311.681665:0:103781:0:(llog_cat.c:391:llog_cat_set_first_idx()) catlog [0x200000401:0x1:0x0] first idx 0, last_idx 2 00000040:00080000:1.0:1777051311.681720:0:103781:0:(llog_cat.c:391:llog_cat_set_first_idx()) catlog [0x200000401:0x1:0x0] first idx 1, last_idx 2 00000100:00100000:0.0:1777051311.681908:0:3676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:3.0:1777051311.808878:0:13753:0:(genops.c:906:class_export_put()) final put ffff99da7b5f3000/c11b6966-0775-44d2-bdc6-c74c26eb2226 00000100:00100000:3.0:1777051311.808936:0:8470:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452554112 00000100:00100000:3.0:1777051311.808949:0:8470:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452554112 00000020:00000080:0.0:1777051311.808994:0:46211:0:(genops.c:865:class_export_destroy()) destroying export ffff99da7b5f3000/c11b6966-0775-44d2-bdc6-c74c26eb2226 for lustre-MDT0001 00000020:00000080:0.0:1777051311.809074:0:46211:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99da5f941800 for lustre-MDT0001 00000100:00100000:3.0:1777051311.809119:0:8470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7955 00000100:00100000:3.0:1777051311.809137:0:8470:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da4457b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3676:x1863365452554112:12345-0@lo:9:umount.0 00000020:00000080:3.0:1777051311.809172:0:8470:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x85f51a6b961497fe 00000100:00080000:3.0:1777051311.809182:0:8470:0:(import.c:65:import_set_state_nolock()) ffff99d942a23000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1777051311.809242:0:8470:0:(tgt_lastrcvd.c:732:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294968351 00010000:00010000:0.0:1777051311.809288:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777051311.809534:0:8470:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da4457b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+2:3676:x1863365452554112:12345-0@lo:9:umount.0 Request processed in 400us (128432us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051311.809547:0:8470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7955 00000100:00080000:0.0:1777051311.809610:0:3676:0:(import.c:65:import_set_state_nolock()) ffff99da5f27d800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1777051311.809630:0:3676:0:(osp_dev.c:1613:osp_import_event()) got disconnected 00000004:00080000:0.0:1777051311.809633:0:3676:0:(osp_dev.c:1629:osp_import_event()) got inactive 00000100:00100000:0.0:1777051311.809640:0:3676:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5fbef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3676:1863365452554112:0@lo:9:umount.0 00010000:00010000:3.0:1777051311.810434:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051311.810438:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051311.810441:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1777051311.821478:0:38719:0:(genops.c:906:class_export_put()) final put ffff99d944b1a800/2dd4696c-edce-4cd1-86d2-dbd2ff957fa1 00000020:00000080:0.0:1777051311.821530:0:48457:0:(genops.c:865:class_export_destroy()) destroying export ffff99d944b1a800/2dd4696c-edce-4cd1-86d2-dbd2ff957fa1 for lustre-MDT0001 00010000:00010000:3.0:1777051311.821612:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051311.821617:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051311.821621:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1777051311.821673:0:48457:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99d944b19800 for lustre-MDT0001 00000020:00080000:0.0:1777051311.826408:0:103781:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffff99da5807b380) has no exports 00000020:01000000:1.0:1777051311.881233:0:103781:0:(lprocfs_status_server.c:298:lprocfs_free_client_stats()) stat ffff99da43fae480 - data ffff99d941439510/ffff99d942b1bc00 00000020:01000000:1.0:1777051311.881510:0:103781:0:(lprocfs_status_server.c:298:lprocfs_free_client_stats()) stat ffff99da7b5bcb40 - data ffff99da70d6e360/ffff99da7da01800 00000100:00080000:2.0:1777051311.945493:0:103781:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1777051311.945503:0:103781:0:(client.c:3101:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 12884902301 gen 4 00000100:00100000:2.0:1777051311.945521:0:103781:0:(client.c:3139:ptlrpc_free_committed()) @@@ free request with old gen req@ffff99da4457ad80 x1863365452553856/t30064771073(30064771073) o39->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1777051321 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1777051311.945559:0:103781:0:(import.c:321:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1777051311.947629:0:103781:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1777051311.947635:0:103781:0:(client.c:3101:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967899 gen 4 00000004:00080000:2.0:1777051311.947655:0:103781:0:(osp_dev.c:1629:osp_import_event()) got inactive 00000100:00100000:2.0:1777051311.947657:0:103781:0:(import.c:321:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1777051311.948410:0:8618:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1777051311.948417:0:8618:0:(llog.c:858:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 26 count 1 00000040:00080000:3.0:1777051311.948433:0:8618:0:(llog.c:858:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:2.0:1777051311.949502:0:103781:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1777051311.949509:0:103781:0:(client.c:3101:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967910 gen 4 00000004:00080000:2.0:1777051311.949532:0:103781:0:(osp_dev.c:1629:osp_import_event()) got inactive 00000100:00100000:2.0:1777051311.949536:0:103781:0:(import.c:321:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1777051311.950494:0:9685:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1777051311.950500:0:9685:0:(llog.c:858:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 26 count 1 00000040:00080000:3.0:1777051311.950514:0:9685:0:(llog.c:858:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:2.0:1777051311.952067:0:103781:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x85f51a6b961494cb 00000020:00000080:2.0:1777051311.952079:0:103781:0:(genops.c:906:class_export_put()) final put ffff99da4a59a000/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1777051311.952167:0:46211:0:(genops.c:865:class_export_destroy()) destroying export ffff99da4a59a000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:2.0:1777051311.958597:0:103781:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x85f51a6b961494e0 00000020:00000080:2.0:1777051311.958606:0:103781:0:(genops.c:906:class_export_put()) final put ffff99da7dbee800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:2.0:1777051311.958617:0:103781:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:2.0:1777051311.958625:0:103781:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1777051311.958637:0:103781:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1777051311.958643:0:103781:0:(genops.c:1579:class_disconnect_exports()) OBD device 10 (ffff99da58078000) has no exports 00000020:00000080:0.0:1777051311.958677:0:46211:0:(genops.c:865:class_export_destroy()) destroying export ffff99da7dbee800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000004:01000000:2.0:1777051311.959690:0:103781:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1777051311.959703:0:103781:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x85f51a6b961497e9 00000020:00000080:2.0:1777051311.959710:0:103781:0:(genops.c:906:class_export_put()) final put ffff99d941c47000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:2.0:1777051311.959731:0:103781:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:2.0:1777051311.959738:0:103781:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1777051311.959751:0:103781:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1777051311.959756:0:103781:0:(genops.c:1579:class_disconnect_exports()) OBD device 27 (ffff99d941ce4d40) has no exports 00000020:00000080:0.0:1777051311.960042:0:46211:0:(genops.c:865:class_export_destroy()) destroying export ffff99d941c47000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:00000080:2.0:1777051311.960060:0:103781:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x85f51a6b961497e2 00000020:00000080:2.0:1777051311.960067:0:103781:0:(genops.c:906:class_export_put()) final put ffff99d941e64000/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1777051311.960128:0:46211:0:(genops.c:865:class_export_destroy()) destroying export ffff99d941e64000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:2.0:1777051311.961295:0:103781:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:2.0:1777051311.961302:0:103781:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1777051311.961308:0:103781:0:(client.c:3101:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967910 gen 5 00000004:00080000:2.0:1777051311.961315:0:103781:0:(osp_dev.c:1629:osp_import_event()) got inactive 00000100:00100000:2.0:1777051311.961319:0:103781:0:(import.c:321:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1777051311.961381:0:46211:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99da5f27d800 for lustre-OST0001-osc-MDT0001 00000020:00000080:2.0:1777051311.961388:0:103781:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1777051311.961404:0:103781:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1777051311.961410:0:103781:0:(genops.c:906:class_export_put()) final put ffff99d941e62800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1777051311.961415:0:103781:0:(genops.c:865:class_export_destroy()) destroying export ffff99d941e62800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:2.0:1777051311.961425:0:103781:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1777051311.961558:0:103781:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x85f51a6b961496a7 00000020:00000080:2.0:1777051311.961564:0:103781:0:(genops.c:906:class_export_put()) final put ffff99da5f2bb800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:2.0:1777051311.961582:0:103781:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:2.0:1777051311.961586:0:103781:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1777051311.961593:0:103781:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1777051311.961596:0:103781:0:(genops.c:1579:class_disconnect_exports()) OBD device 21 (ffff99da7ffc99c0) has no exports 00000020:00000080:2.0:1777051311.961601:0:103781:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x85f51a6b961496a0 00000020:00000080:2.0:1777051311.961605:0:103781:0:(genops.c:906:class_export_put()) final put ffff99da5f27b000/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1777051311.961625:0:46211:0:(genops.c:865:class_export_destroy()) destroying export ffff99da5f2bb800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:0.0:1777051311.961660:0:46211:0:(genops.c:865:class_export_destroy()) destroying export ffff99da5f27b000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:2.0:1777051311.962614:0:103781:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:2.0:1777051311.962619:0:103781:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1777051311.962623:0:103781:0:(client.c:3101:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967899 gen 5 00000004:00080000:2.0:1777051311.962629:0:103781:0:(osp_dev.c:1629:osp_import_event()) got inactive 00000100:00100000:2.0:1777051311.962632:0:103781:0:(import.c:321:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1777051311.962678:0:103781:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1777051311.962686:0:103781:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:2.0:1777051311.962698:0:103781:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:2.0:1777051311.962705:0:103781:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x85f51a6b96149503 00000020:00000080:0.0:1777051311.962707:0:46211:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99da5f27d000 for lustre-OST0000-osc-MDT0001 00000020:00000080:2.0:1777051311.962712:0:103781:0:(genops.c:906:class_export_put()) final put ffff99da7dbec800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1777051311.962721:0:46211:0:(genops.c:906:class_export_put()) final put ffff99da7fa93800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1777051311.962727:0:46211:0:(genops.c:865:class_export_destroy()) destroying export ffff99da7fa93800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:2.0:1777051311.962733:0:103781:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='') 00000020:01000000:0.0:1777051311.962736:0:46211:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1777051311.962741:0:103781:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1777051311.962751:0:103781:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1777051311.962757:0:103781:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff99da7f86cd40) has no exports 00000020:00000080:2.0:1777051311.962763:0:103781:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x85f51a6b961494fc 00000020:00000080:2.0:1777051311.962771:0:103781:0:(genops.c:906:class_export_put()) final put ffff99da7dbee000/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1777051311.963191:0:46211:0:(genops.c:865:class_export_destroy()) destroying export ffff99da7dbec800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:0.0:1777051311.963204:0:46211:0:(genops.c:865:class_export_destroy()) destroying export ffff99da7dbee000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:3.0:1777051311.967275:0:103781:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:3.0:1777051311.967282:0:103781:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1777051311.967286:0:103781:0:(client.c:3101:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 12884902301 gen 5 00000100:00100000:3.0:1777051311.967295:0:103781:0:(import.c:321:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1777051311.967345:0:46211:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99da7dbeb000 for lustre-MDT0000-osp-MDT0001 00000020:00000080:3.0:1777051311.967381:0:103781:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1777051311.967395:0:103781:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1777051311.967400:0:103781:0:(genops.c:906:class_export_put()) final put ffff99da7dbe8000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1777051311.967405:0:103781:0:(genops.c:865:class_export_destroy()) destroying export ffff99da7dbe8000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:3.0:1777051311.967415:0:103781:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1777051311.967580:0:103781:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1777051311.967588:0:103781:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1777051311.967592:0:103781:0:(genops.c:906:class_export_put()) final put ffff99da7b35f000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1777051311.967595:0:103781:0:(genops.c:865:class_export_destroy()) destroying export ffff99da7b35f000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:3.0:1777051311.967601:0:103781:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1777051311.967716:0:103781:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x85f51a6b961494e7 00000020:00000080:3.0:1777051311.967734:0:103781:0:(genops.c:906:class_export_put()) final put ffff99da7dbed000/lustre-MDD0001_UUID 00000020:01000000:3.0:1777051311.967753:0:103781:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:3.0:1777051311.967760:0:103781:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1777051311.967768:0:46211:0:(genops.c:865:class_export_destroy()) destroying export ffff99da7dbed000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:3.0:1777051311.967769:0:103781:0:(obd_config.c:955:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1777051311.967777:0:103781:0:(genops.c:1579:class_disconnect_exports()) OBD device 12 (ffff99da580799c0) has no exports 00000020:00000080:3.0:1777051311.968401:0:103781:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1777051311.968410:0:103781:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:3.0:1777051311.968415:0:103781:0:(genops.c:906:class_export_put()) final put ffff99da4622a000/lustre-MDD0001_UUID 00000020:00000080:3.0:1777051311.968419:0:103781:0:(genops.c:865:class_export_destroy()) destroying export ffff99da4622a000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:3.0:1777051311.968426:0:103781:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:3.0:1777051311.968500:0:103781:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x85f51a6b961494ee 00000020:00000080:3.0:1777051311.968507:0:103781:0:(genops.c:906:class_export_put()) final put ffff99da7dbe9000/lustre-MDT0001-osd_UUID 00000020:01000004:3.0:1777051311.968529:0:103781:0:(tgt_mount.c:185:server_put_mount()) put mount ffff99da57ae9000 from lustre-MDT0001, refs=2 00000020:01000004:3.0:1777051311.968534:0:103781:0:(obd_mount.c:701:lustre_put_lsi()) put ffff99da57ae9000 2 00000020:00000080:0.0:1777051311.968540:0:46211:0:(genops.c:865:class_export_destroy()) destroying export ffff99da7dbe9000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000004:3.0:1777051311.968540:0:103781:0:(tgt_mount.c:118:server_deregister_mount()) deregister mount ffff99da57ae9000 from lustre-MDT0001 00000020:00000080:3.0:1777051311.968591:0:103781:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1777051311.968602:0:103781:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:3.0:1777051311.968606:0:103781:0:(genops.c:906:class_export_put()) final put ffff99da4a59f000/lustre-MDT0001_UUID 00000020:00000080:3.0:1777051311.968610:0:103781:0:(genops.c:865:class_export_destroy()) destroying export ffff99da4a59f000/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:3.0:1777051311.968625:0:103781:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:3.0:1777051311.968686:0:103781:0:(obd_mount.c:569:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000000:3.0:1777051311.968692:0:103781:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:3.0:1777051311.968697:0:103781:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1777051311.968706:0:103781:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1777051311.968717:0:103781:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff99da7dbc8000 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1777051311.968725:0:103781:0:(genops.c:1574:class_disconnect_exports()) OBD device 14 (ffff99da462019c0) has exports, disconnecting them 00000020:00080000:3.0:1777051311.968734:0:103781:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff99da7dbc8000), last request at 1777044050 00000020:00000080:3.0:1777051311.968739:0:103781:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x85f51a6b96149542 00000020:00080000:3.0:1777051311.968769:0:103781:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff99da7dbc8000): rc 0 00000020:00000080:3.0:1777051311.968775:0:103781:0:(genops.c:906:class_export_put()) final put ffff99da7dbc8000/lustre-MDT0000-lwp-MDT0001 00000020:00000080:0.0:1777051311.968807:0:46211:0:(genops.c:865:class_export_destroy()) destroying export ffff99da7dbc8000/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:2.0:1777051311.970432:0:103781:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:2.0:1777051311.970439:0:103781:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1777051311.970444:0:103781:0:(client.c:3101:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1777051311.970451:0:103781:0:(import.c:321:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1777051311.970508:0:46211:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99da7fa93000 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:2.0:1777051311.970735:0:103781:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1777051311.970746:0:103781:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:2.0:1777051311.970752:0:103781:0:(genops.c:906:class_export_put()) final put ffff99da7fa91000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:2.0:1777051311.970757:0:103781:0:(genops.c:865:class_export_destroy()) destroying export ffff99da7fa91000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:2.0:1777051311.970765:0:103781:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:2.0:1777051311.971649:0:103781:0:(obd_mount.c:701:lustre_put_lsi()) put ffff99da57ae9000 1 00000020:00000080:2.0:1777051311.971666:0:103781:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x85f51a6b9614947e 00000020:00000080:2.0:1777051311.971672:0:103781:0:(genops.c:906:class_export_put()) final put ffff99da7b359000/lustre-MDT0001-osd_UUID 00000020:01000000:2.0:1777051311.971690:0:103781:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:0.0:1777051311.971703:0:46211:0:(genops.c:865:class_export_destroy()) destroying export ffff99da7b359000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:2.0:1777051311.971724:0:103781:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1777051311.971733:0:103781:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1777051311.972426:0:103781:0:(genops.c:1579:class_disconnect_exports()) OBD device 9 (ffff99da7da4b380) has no exports 00000020:00000080:2.0:1777051312.023559:0:103781:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1777051312.023580:0:103781:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:2.0:1777051312.023587:0:103781:0:(genops.c:906:class_export_put()) final put ffff99da57aed800/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1777051312.023593:0:103781:0:(genops.c:865:class_export_destroy()) destroying export ffff99da57aed800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:2.0:1777051312.023602:0:103781:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:2.0:1777051312.024056:0:103781:0:(obd_mount.c:659:lustre_free_lsi()) Freeing lsi ffff99da57aec000 00000020:02000400:2.0:1777051312.024139:0:103781:0:(tgt_mount.c:2134:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:0.0:1777051312.214498:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1777051313.058505:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051313.058573:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051313.058598:0:103169:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425878144 00000100:00100000:1.0:1777051313.058629:0:103169:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425878144 00000100:00100000:0.0:1777051313.058639:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051313.058675:0:27885:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425878272 00000100:00100000:3.0:1777051313.058685:0:27885:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425878272 00000100:00100000:0.0:1777051313.058702:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051313.058721:0:103169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 84 00000100:00100000:1.0:1777051313.058741:0:103169:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d943e27450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:29c4352d-3260-4734-909d-9ea5de9e7fa4+12:2437:x1863365425878144:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:0.0:1777051313.058765:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051313.058775:0:27885:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425878400 00000100:00100000:0.0:1777051313.058867:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051313.058877:0:103169:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d943e27450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:29c4352d-3260-4734-909d-9ea5de9e7fa4+12:2437:x1863365425878144:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 137us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051313.058892:0:103169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 84 00000100:00100000:3.0:1777051313.058933:0:27885:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425878400 00000100:00100000:3.0:1777051313.058984:0:27885:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425878784 00000100:00100000:3.0:1777051313.058991:0:27885:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425878784 00000100:00100000:1.0:1777051313.059003:0:24468:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425878528 00000100:00100000:1.0:1777051313.059013:0:24468:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425878528 00000100:00100000:3.0:1777051313.059059:0:27885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13194 00000100:00100000:3.0:1777051313.059078:0:27885:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da4457ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c11b6966-0775-44d2-bdc6-c74c26eb2226+14:2436:x1863365425878272:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:1.0:1777051313.059088:0:24468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10262 00000100:00100000:1.0:1777051313.059108:0:24468:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f97fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+50:2436:x1863365425878528:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:3.0:1777051313.059163:0:27885:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da4457ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c11b6966-0775-44d2-bdc6-c74c26eb2226+14:2436:x1863365425878272:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 88us (589us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051313.059195:0:24468:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f97fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+50:2436:x1863365425878528:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 72us (475us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051313.059241:0:24468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10262 00000100:00100000:1.0:1777051313.059260:0:24468:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425878656 00000100:00100000:1.0:1777051313.059266:0:24468:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425878656 00000100:00100000:1.0:1777051313.059316:0:24468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10263 00000100:00100000:1.0:1777051313.059326:0:24468:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f169500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+48:2437:x1863365425878656:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:1.0:1777051313.059368:0:24468:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f169500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+48:2437:x1863365425878656:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 42us (607us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051313.059378:0:24468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10263 00000100:00100000:3.0:1777051313.059432:0:27885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13194 00000100:00100000:0.0:1777051313.059467:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13195 00000100:00100000:1.0:1777051313.059483:0:21368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111749 00000100:00100000:0.0:1777051313.059490:0:6580:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+17:2436:x1863365425878784:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:1.0:1777051313.059502:0:21368:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d943d93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2437:x1863365425878400:12345-192.168.201.46@tcp:400:kworker.0 00000100:00080000:3.0:1777051313.059512:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00080000:1.0:1777051313.059513:0:21368:0:(tgt_handler.c:795:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.201.46@tcp 00000100:00080000:3.0:1777051313.059532:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1777051313.059541:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1777051313.059562:0:6580:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+17:2436:x1863365425878784:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 79us (694us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051313.059576:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13195 00000100:00100000:1.0:1777051313.059585:0:21368:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d943d93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2437:x1863365425878400:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 83us (948us total) trans 0 rc -107/-107 00000100:00100000:1.0:1777051313.059597:0:21368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111749 00000100:00100000:0.0:1777051313.060091:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051313.060133:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051313.060185:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051313.060509:0:8468:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425879040 00000100:00100000:0.0:1777051313.060514:0:13320:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425879168 00000100:00100000:1.0:1777051313.060519:0:8468:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425879040 00000100:00100000:0.0:1777051313.060525:0:13320:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425879168 00000100:00100000:1.0:1777051313.060592:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10264 00000100:00100000:1.0:1777051313.060605:0:8468:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f42c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+50:2436:x1863365425879040:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:1.0:1777051313.060664:0:8468:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f42c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+50:2436:x1863365425879040:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 61us (530us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051313.060675:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10264 00000100:00100000:1.0:1777051313.060697:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10265 00000100:00100000:1.0:1777051313.060708:0:8468:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f865180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+47:2437:x1863365425879168:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:1.0:1777051313.060744:0:8468:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f865180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+47:2437:x1863365425879168:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 38us (559us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051313.060753:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10265 00000100:00100000:1.0:1777051313.060891:0:6581:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425878912 00000100:00100000:1.0:1777051313.060898:0:6581:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425878912 00000100:00080000:3.0:1777051313.060909:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1777051313.060916:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1777051313.060946:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111750 00000100:00100000:1.0:1777051313.060954:0:6581:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2437:x1863365425878912:12345-192.168.201.46@tcp:400:kworker.0 00000020:00080000:1.0:1777051313.060963:0:6581:0:(tgt_handler.c:795:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.201.46@tcp 00000100:00100000:1.0:1777051313.061041:0:6581:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2437:x1863365425878912:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 84us (952us total) trans 0 rc -107/-107 00000100:00100000:1.0:1777051313.061051:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111750 00000100:00100000:1.0:1777051313.086701:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051313.086865:0:27882:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425879296 00000100:00100000:2.0:1777051313.086878:0:27882:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425879296 00000100:00100000:2.0:1777051313.086943:0:27882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111751 00000100:00100000:2.0:1777051313.087389:0:27882:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5fbef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0+-99:2435:x1863365425879296:12345-192.168.201.46@tcp:38:ptlrpcd_00_01.0 00010000:00020000:2.0:1777051313.087424:0:27882:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0001: not available for connect from 192.168.201.46@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1777051313.087514:0:27882:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5fbef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0+-99:2435:x1863365425879296:12345-192.168.201.46@tcp:38:ptlrpcd_00_01.0 Request processed in 558us (829us total) trans 0 rc -19/-19 00000100:00100000:2.0:1777051313.087546:0:27882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111751 00000100:00100000:1.0:1777051313.087570:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051313.087710:0:27882:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425879424 00000100:00100000:2.0:1777051313.087717:0:27882:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425879424 00000100:00100000:2.0:1777051313.087762:0:27882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111752 00000100:00100000:2.0:1777051313.087770:0:27882:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5fbeca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0+-99:2435:x1863365425879424:12345-192.168.201.46@tcp:38:ptlrpcd_00_01.0 00010000:00020000:2.0:1777051313.087790:0:27882:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0001: not available for connect from 192.168.201.46@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1777051313.087875:0:27882:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5fbeca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0+-99:2435:x1863365425879424:12345-192.168.201.46@tcp:38:ptlrpcd_00_01.0 Request processed in 101us (308us total) trans 0 rc -19/-19 00000100:00100000:2.0:1777051313.087887:0:27882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111752 00010000:00010000:0.0:1777051313.238517:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051314.265039:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051315.286460:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1777051315.990509:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d956129c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3680:1863365452554368:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1777051315.990509:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5fbefb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3677:1863365452554240:0@lo:400:kworker.0 00000100:00100000:1.0:1777051315.990574:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5fbee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3679:1863365452554624:0@lo:400:kworker.0 00000100:00100000:2.0:1777051315.990655:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051315.990661:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051315.990663:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051315.990787:0:6585:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452554368 00000100:00100000:0.0:1777051315.990801:0:6585:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452554368 00000100:00100000:1.0:1777051315.990801:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5fbeed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452555136:0@lo:400:kworker.0 00000100:00100000:2.0:1777051315.990810:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5fbed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3680:1863365452554752:0@lo:400:kworker.0 00000100:00100000:3.0:1777051315.990822:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5fbec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3677:1863365452554880:0@lo:400:kworker.0 00000100:00100000:1.0:1777051315.990863:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051315.990876:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8034 00000100:00100000:2.0:1777051315.990879:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051315.990893:0:6585:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7cd9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3680:x1863365452554368:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1777051315.990899:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5fbef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3678:1863365452554496:0@lo:400:kworker.0 00000100:00100000:1.0:1777051315.990905:0:3679:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000020:00080000:0.0:1777051315.990910:0:6585:0:(tgt_handler.c:795:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1777051315.990920:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5fbedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452555264:0@lo:400:kworker.0 00000100:00100000:2.0:1777051315.990960:0:46497:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452554624 00000100:00100000:2.0:1777051315.990968:0:46497:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452554624 00000100:00100000:1.0:1777051315.990980:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051315.990997:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051315.991008:0:6585:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7cd9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3680:x1863365452554368:12345-0@lo:41:osp-pre-1-0.0 Request processed in 114us (358us total) trans 0 rc -107/-107 00000100:00100000:2.0:1777051315.991025:0:46497:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452554752 00000100:00100000:2.0:1777051315.991031:0:46497:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452554752 00000100:00100000:1.0:1777051315.991044:0:55805:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452555136 00000100:00100000:0.0:1777051315.991045:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8034 00000100:00100000:3.0:1777051315.991050:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5fbef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3678:1863365452555008:0@lo:400:kworker.0 00000100:00100000:1.0:1777051315.991054:0:55805:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452555136 00000100:00100000:3.0:1777051315.991102:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051315.991107:0:46497:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452554496 00000100:00100000:2.0:1777051315.991114:0:46497:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452554496 00000100:00100000:1.0:1777051315.991521:0:55805:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452555264 00000100:00100000:1.0:1777051315.991529:0:55805:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452555264 00000100:00100000:0.0:1777051315.993583:0:21368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13196 00000100:00100000:1.0:1777051315.993592:0:55805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10266 00000100:00100000:0.0:1777051315.993600:0:21368:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7cd9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3680:x1863365452554752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777051315.993604:0:55805:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955610000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3679:x1863365452555136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051315.993651:0:10328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111753 00000100:00100000:3.0:1777051315.993664:0:10328:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955610e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3679:x1863365452554624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777051315.993667:0:21368:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7cd9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3680:x1863365452554752:12345-0@lo:400:kworker.0 Request processed in 70us (2792us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051315.993667:0:55805:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955610000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3679:x1863365452555136:12345-0@lo:400:kworker.0 Request processed in 64us (2809us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051315.993686:0:55805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10266 00000020:00080000:3.0:1777051315.993686:0:10328:0:(tgt_handler.c:795:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1777051315.993691:0:21368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13196 00000100:00100000:2.0:1777051315.993701:0:46497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13197 00000100:00100000:2.0:1777051315.993719:0:46497:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5fbe0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:lustre-MDT0000-lwp-OST0000_UUID+5:3678:x1863365452554496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777051315.993725:0:55805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10267 00000100:00100000:0.0:1777051315.993733:0:46500:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452555008 00000100:00100000:0.0:1777051315.993739:0:46500:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452555008 00000100:00100000:1.0:1777051315.993742:0:55805:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955612a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3679:x1863365452555264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051315.993752:0:10328:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955610e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3679:x1863365452554624:12345-0@lo:400:kworker.0 Request processed in 85us (3097us total) trans 0 rc -107/-107 00000100:00100000:3.0:1777051315.993791:0:10328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111753 00000100:00100000:0.0:1777051315.993814:0:46500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8035 00000100:00100000:0.0:1777051315.993823:0:46500:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5fbe1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:0+-99:3678:x1863365452555008:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1777051315.993832:0:46500:0:(tgt_handler.c:795:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1777051315.993840:0:103166:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452554240 00000100:00100000:2.0:1777051315.993843:0:46497:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5fbe0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:lustre-MDT0000-lwp-OST0000_UUID+5:3678:x1863365452554496:12345-0@lo:400:kworker.0 Request processed in 128us (2849us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051315.993848:0:103166:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452554240 00000100:00100000:1.0:1777051315.993854:0:55805:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955612a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3679:x1863365452555264:12345-0@lo:400:kworker.0 Request processed in 117us (2870us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051315.993865:0:46497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13197 00000100:00100000:0.0:1777051315.993875:0:46500:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5fbe1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:0+-99:3678:x1863365452555008:12345-0@lo:400:kworker.0 Request processed in 49us (2773us total) trans 0 rc -107/-107 00000100:00100000:1.0:1777051315.993875:0:55805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10267 00000100:00100000:0.0:1777051315.993886:0:46500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8035 00000100:00080000:2.0:1777051315.993923:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1777051315.993929:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1777051315.993934:0:103166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00080000:2.0:1777051315.993937:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1777051315.993953:0:103166:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d943e24850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9351a01-5b0e-4470-97fd-58b9b4b312a2+18:3677:x1863365452554240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777051315.993969:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051315.994002:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5fbedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452555264:0@lo:400:kworker.0 00000100:00100000:0.0:1777051315.994010:0:8492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452554880 00000100:00100000:2.0:1777051315.994016:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5fbece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3677:1863365452555392:0@lo:400:kworker.0 00000100:00100000:0.0:1777051315.994017:0:8492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452554880 00000100:00080000:1.0:1777051315.994024:0:3679:0:(recover.c:203:ptlrpc_request_handle_notconn()) import lustre-MDT0001-lwp-OST0000 of lustre-MDT0001_UUID@0@lo abruptly disconnected: reconnecting 00000100:00100000:3.0:1777051315.994033:0:103166:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d943e24850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9351a01-5b0e-4470-97fd-58b9b4b312a2+18:3677:x1863365452554240:12345-0@lo:400:kworker.0 Request processed in 83us (3382us total) trans 0 rc 0/0 00000100:00080000:1.0:1777051315.994041:0:3679:0:(import.c:65:import_set_state_nolock()) ffff99d941838000 lustre-MDT0001_UUID: changing import state from FULL to DISCONN 00000100:00100000:3.0:1777051315.994051:0:103166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:02000400:1.0:1777051315.994056:0:3679:0:(import.c:181:ptlrpc_set_import_discon()) lustre-MDT0001-lwp-OST0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:0.0:1777051315.994060:0:8492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111754 00000100:00100000:0.0:1777051315.994072:0:8492:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7cd9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3677:x1863365452554880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777051315.994075:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:0.0:1777051315.994087:0:8492:0:(tgt_handler.c:795:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1777051315.994120:0:27885:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452555392 00000100:00100000:3.0:1777051315.994128:0:27885:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452555392 00000100:00100000:2.0:1777051315.994135:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5fbefb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3677:1863365452554240:0@lo:400:kworker.0 00000100:00100000:0.0:1777051315.994567:0:8492:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7cd9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3677:x1863365452554880:12345-0@lo:400:kworker.0 Request processed in 494us (595us total) trans 0 rc -107/-107 00000100:00100000:0.0:1777051315.994579:0:8492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111754 00000100:00100000:3.0:1777051315.994593:0:27885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13198 00000100:00080000:2.0:1777051315.994596:0:3677:0:(recover.c:203:ptlrpc_request_handle_notconn()) import lustre-MDT0001-lwp-OST0001 of lustre-MDT0001_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1777051315.994605:0:3677:0:(import.c:65:import_set_state_nolock()) ffff99d942a20000 lustre-MDT0001_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1777051315.994616:0:3677:0:(import.c:181:ptlrpc_set_import_discon()) lustre-MDT0001-lwp-OST0001: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:3.0:1777051315.994616:0:27885:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7cd9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000-lwp-MDT0000_UUID+5:3677:x1863365452555392:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1777051315.994630:0:3677:0:(import.c:65:import_set_state_nolock()) ffff99d942a20000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1777051315.994639:0:3677:0:(import.c:509:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 804 00000100:00080000:2.0:1777051315.994650:0:3677:0:(import.c:623:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff99d942a20000 using connection 192.168.201.146@tcp/0@lo 00000100:02020000:0.0:1777051315.994667:0:3680:0:(client.c:1490:ptlrpc_check_status()) lustre-MDT0001-osp-MDT0000: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00100000:3.0:1777051315.994678:0:27885:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7cd9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000-lwp-MDT0000_UUID+5:3677:x1863365452555392:12345-0@lo:400:kworker.0 Request processed in 68us (609us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051315.994691:0:3677:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99da7cd9e680 x1863365452555520/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1777051315.994691:0:27885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13198 00000100:00100000:2.0:1777051315.994729:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5fbec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3677:1863365452554880:0@lo:400:kworker.0 00000100:00100000:3.0:1777051315.994751:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5fbef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3678:1863365452554496:0@lo:400:kworker.0 00000100:00100000:2.0:1777051315.994785:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5fbece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3677:1863365452555392:0@lo:400:kworker.0 00000100:00080000:3.0:1777051315.994806:0:3678:0:(recover.c:203:ptlrpc_request_handle_notconn()) import lustre-MDT0001-osp-MDT0000 of lustre-MDT0001_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1777051315.994811:0:3678:0:(import.c:65:import_set_state_nolock()) ffff99da42f4c800 lustre-MDT0001_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1777051315.994817:0:3678:0:(import.c:181:ptlrpc_set_import_discon()) lustre-MDT0001-osp-MDT0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1777051315.994825:0:3678:0:(import.c:65:import_set_state_nolock()) ffff99da42f4c800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1777051315.994831:0:3678:0:(import.c:509:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 7924 00000100:00080000:3.0:1777051315.994839:0:3678:0:(import.c:623:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff99da42f4c800 using connection 192.168.201.146@tcp/0@lo 00000100:00100000:3.0:1777051315.994861:0:3678:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99da5fbe1c00 x1863365452555648/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1777051315.994879:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5fbef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3678:1863365452555008:0@lo:400:kworker.0 00000100:00100000:2.0:1777051315.994922:0:3676:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7cd9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3676:1863365452555520:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:2.0:1777051315.994969:0:3676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051315.995005:0:3676:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5fbe1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3676:1863365452555648:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:2.0:1777051315.995045:0:3676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051315.995048:0:21368:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452555520 00000100:00100000:3.0:1777051315.995056:0:21368:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452555520 00000100:00100000:3.0:1777051315.995097:0:21368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111755 00000100:00100000:3.0:1777051315.995107:0:21368:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7b5e8450 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3676:x1863365452555520:12345-0@lo:38:ptlrpcd_00_00.0 00000100:00100000:2.0:1777051315.995130:0:46498:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452555648 00000100:00100000:2.0:1777051315.995138:0:46498:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452555648 00010000:00020000:3.0:1777051315.995138:0:21368:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1777051315.995180:0:46498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8036 00000100:00100000:2.0:1777051315.995190:0:46498:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5fbef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:0+-99:3676:x1863365452555648:12345-0@lo:38:ptlrpcd_00_01.0 00000100:00100000:3.0:1777051315.995240:0:21368:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7b5e8450 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3676:x1863365452555520:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 129us (266us total) trans 0 rc -19/-19 00010000:00020000:2.0:1777051315.995251:0:46498:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1777051315.995256:0:21368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111755 00000100:00100000:2.0:1777051315.995303:0:46498:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5fbef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:0+-99:3676:x1863365452555648:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 111us (259us total) trans 0 rc -19/-19 00000100:00100000:2.0:1777051315.995314:0:46498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8036 00000100:00080000:2.0:1777051315.995364:0:3676:0:(import.c:65:import_set_state_nolock()) ffff99d942a20000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1777051315.995373:0:3676:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1777051315.995378:0:3676:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7cd9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3676:1863365452555520:0@lo:38:ptlrpcd_00_00.0 00000100:00080000:2.0:1777051315.995390:0:3676:0:(import.c:65:import_set_state_nolock()) ffff99da42f4c800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1777051315.995396:0:3676:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1777051315.995400:0:3676:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5fbe1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3676:1863365452555648:0@lo:38:ptlrpcd_00_01.0 00000100:00080000:1.0:1777051316.009309:0:3679:0:(import.c:65:import_set_state_nolock()) ffff99d941838000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1777051316.009483:0:3679:0:(import.c:509:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 738 00000100:00080000:1.0:1777051316.009505:0:3679:0:(import.c:623:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff99d941838000 using connection 192.168.201.146@tcp/0@lo 00000100:00100000:1.0:1777051316.009573:0:3679:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d955611f80 x1863365452555776/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1777051316.009643:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5fbee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3679:1863365452554624:0@lo:400:kworker.0 00000100:00100000:3.0:1777051316.009713:0:3676:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955611f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3676:1863365452555776:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:1.0:1777051316.009805:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5fbeed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452555136:0@lo:400:kworker.0 00000100:00100000:3.0:1777051316.009948:0:3676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051316.010921:0:46497:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452555776 00000100:00100000:1.0:1777051316.010935:0:46497:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452555776 00000100:00100000:1.0:1777051316.011054:0:46497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111756 00000100:00100000:1.0:1777051316.011064:0:46497:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5fbe1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:0+-99:3676:x1863365452555776:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:1.0:1777051316.011121:0:46497:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1777051316.011279:0:46497:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5fbe1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:0+-99:3676:x1863365452555776:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 209us (1330us total) trans 0 rc -19/-19 00000100:00100000:1.0:1777051316.011299:0:46497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111756 00000100:00080000:3.0:1777051316.011667:0:3676:0:(import.c:65:import_set_state_nolock()) ffff99d941838000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1777051316.011676:0:3676:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1777051316.011681:0:3676:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955611f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3676:1863365452555776:0@lo:38:ptlrpcd_00_02.0 00000100:00080000:0.0:1777051316.022620:0:3680:0:(recover.c:203:ptlrpc_request_handle_notconn()) import lustre-MDT0001-osp-MDT0000 of lustre-MDT0001_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1777051316.022629:0:3680:0:(import.c:213:ptlrpc_set_import_discon()) osp: import ffff99da42f4c800 already not connected (conn 2, was 1): DISCONN 00000100:00100000:0.0:1777051316.023377:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5fbed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3680:1863365452554752:0@lo:400:kworker.0 00010000:00010000:0.0:1777051316.310486:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1777051316.502485:0:3677:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1777051316.502518:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95612b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3677:1863365452555904:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1777051316.502617:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051316.503066:0:8473:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452555904 00000100:00100000:1.0:1777051316.503080:0:8473:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452555904 00000100:00100000:0.0:1777051316.503174:0:3680:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1777051316.503174:0:8473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5572 00000100:00100000:0.0:1777051316.503242:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d956129500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3680:1863365452556032:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1777051316.503255:0:8473:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5fbef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3677:x1863365452555904:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1777051316.503305:0:8473:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 440353216 pending 0 free 3862671360 avail 3631149056 00000100:00100000:0.0:1777051316.503309:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051316.503429:0:47388:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452556032 00000100:00100000:3.0:1777051316.503440:0:47388:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452556032 00000100:00100000:1.0:1777051316.503462:0:8473:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5fbef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3677:x1863365452555904:12345-0@lo:13:osp-pre-0-0.0 Request processed in 268us (842us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051316.503477:0:8473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5572 00000100:00100000:2.0:1777051316.503516:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95612b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3677:1863365452555904:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1777051316.503522:0:47388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5573 00000100:00100000:3.0:1777051316.503547:0:47388:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95612a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3680:x1863365452556032:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1777051316.503582:0:47388:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 430293440 pending 0 free 3645853696 avail 3414331392 00000100:00100000:3.0:1777051316.503674:0:47388:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95612a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3680:x1863365452556032:12345-0@lo:13:osp-pre-1-0.0 Request processed in 131us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051316.503689:0:47388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5573 00000100:00100000:0.0:1777051316.503738:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d956129500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3680:1863365452556032:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1777051317.334485:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1777051317.529242:0:8464:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1777051317.529255:0:8464:0:(genops.c:906:class_export_put()) final put ffff99d94183b800/lustre-MDT0001-mdtlov_UUID 00000001:00100000:3.0:1777051317.529316:0:103159:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00080000:3.0:1777051317.529331:0:103159:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771073 is committed 00000020:00000080:3.0:1777051317.529336:0:103159:0:(genops.c:906:class_export_put()) final put ffff99d941c44800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1777051317.529353:0:48457:0:(genops.c:865:class_export_destroy()) destroying export ffff99d94183b800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1777051317.529436:0:48457:0:(genops.c:865:class_export_destroy()) destroying export ffff99d941c44800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:1.0:1777051317.529571:0:48457:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99d94183c000 for lustre-OST0000 00000020:00000080:1.0:1777051317.529580:0:48457:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99da499cf000 for lustre-MDT0000 00000001:00100000:0.0:1777051317.529970:0:9540:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1777051317.529975:0:9540:0:(genops.c:906:class_export_put()) final put ffff99d942a26000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1777051317.530493:0:48457:0:(genops.c:865:class_export_destroy()) destroying export ffff99d942a26000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1777051317.530576:0:48457:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99d942a23000 for lustre-OST0001 00000040:00080000:3.0:1777051317.783526:0:103189:0:(llog.c:858:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1777051318.177980:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051318.178076:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051318.178108:0:103168:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425879552 00000100:00100000:0.0:1777051318.178126:0:103168:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425879552 00000100:00100000:2.0:1777051318.178250:0:6581:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425879680 00000100:00100000:2.0:1777051318.178288:0:6581:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425879680 00000100:00100000:0.0:1777051318.178309:0:103168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 86 00000100:00100000:0.0:1777051318.178329:0:103168:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f3ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:29c4352d-3260-4734-909d-9ea5de9e7fa4+12:2436:x1863365425879552:12345-192.168.201.46@tcp:400:kworker.0 00000100:00080000:3.0:1777051318.178398:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1777051318.178421:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13199 00000100:00100000:0.0:1777051318.178460:0:103168:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f3ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:29c4352d-3260-4734-909d-9ea5de9e7fa4+12:2436:x1863365425879552:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 128us (483us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051318.178461:0:6581:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955610380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+14:2436:x1863365425879680:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:0.0:1777051318.178487:0:103168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 86 00000100:00100000:2.0:1777051318.178554:0:6581:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955610380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+14:2436:x1863365425879680:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 118us (477us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051318.178569:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13199 00000100:00100000:3.0:1777051318.180451:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051318.180528:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051318.180552:0:8492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425879808 00000100:00100000:0.0:1777051318.180564:0:8492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425879808 00000100:00100000:3.0:1777051318.180599:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051318.180682:0:27884:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425879936 00000100:00100000:1.0:1777051318.180693:0:27884:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425879936 00000100:00100000:0.0:1777051318.180802:0:8492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425880192 00000100:00100000:0.0:1777051318.180810:0:8492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425880192 00000100:00100000:2.0:1777051318.180832:0:46494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111757 00000100:00100000:2.0:1777051318.180849:0:46494:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5fbe2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:0+-99:2435:x1863365425879808:12345-192.168.201.46@tcp:38:kworker.0 00000100:00100000:1.0:1777051318.180857:0:27884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10268 00000100:00100000:1.0:1777051318.180881:0:27884:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5fbe1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+50:2436:x1863365425879936:12345-192.168.201.46@tcp:400:kworker.0 00010000:00020000:2.0:1777051318.180894:0:46494:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0001: not available for connect from 192.168.201.46@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1777051318.180896:0:8492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13200 00000100:00100000:3.0:1777051318.180909:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051318.180927:0:8492:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5fbe0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+17:2436:x1863365425880192:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:1.0:1777051318.181007:0:27884:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5fbe1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+50:2436:x1863365425879936:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 126us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051318.181010:0:46494:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5fbe2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:0+-99:2435:x1863365425879808:12345-192.168.201.46@tcp:38:kworker.0 Request processed in 151us (547us total) trans 0 rc -19/-19 00000100:00100000:0.0:1777051318.181039:0:8492:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5fbe0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+17:2436:x1863365425880192:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 111us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051318.181039:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051318.181050:0:27884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10268 00000100:00100000:2.0:1777051318.181053:0:46494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111757 00000100:00100000:0.0:1777051318.181075:0:8492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13200 00000100:00100000:1.0:1777051318.181096:0:27884:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425880064 00000100:00100000:2.0:1777051318.181102:0:46494:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425880320 00000100:00100000:1.0:1777051318.181107:0:27884:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425880064 00000100:00100000:2.0:1777051318.181114:0:46494:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425880320 00000100:00100000:2.0:1777051318.181173:0:46494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111758 00000100:00100000:2.0:1777051318.181190:0:46494:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5fbe2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:0+-99:2435:x1863365425880320:12345-192.168.201.46@tcp:38:kworker.0 00000100:00100000:1.0:1777051318.181191:0:27884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10269 00010000:00020000:2.0:1777051318.181211:0:46494:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0001: not available for connect from 192.168.201.46@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1777051318.181271:0:27884:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5fbe0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+48:2436:x1863365425880064:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:2.0:1777051318.181307:0:46494:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5fbe2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:0+-99:2435:x1863365425880320:12345-192.168.201.46@tcp:38:kworker.0 Request processed in 118us (403us total) trans 0 rc -19/-19 00000100:00100000:2.0:1777051318.181318:0:46494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111758 00000100:00100000:1.0:1777051318.181343:0:27884:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5fbe0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+48:2436:x1863365425880064:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 75us (315us total) trans 0 rc 0/0 00000100:00080000:0.0:1777051318.181351:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1777051318.181362:0:27884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10269 00000100:00080000:0.0:1777051318.181364:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1777051318.181371:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1777051318.181512:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051318.181641:0:8628:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425880448 00000100:00100000:1.0:1777051318.181653:0:8628:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425880448 00000100:00100000:0.0:1777051318.181678:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051318.181770:0:8628:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425880576 00000100:00100000:1.0:1777051318.181779:0:8628:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425880576 00000100:00100000:0.0:1777051318.181798:0:24468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10270 00000100:00100000:0.0:1777051318.181817:0:24468:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d956129500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+50:2437:x1863365425880448:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:1.0:1777051318.181848:0:8628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10271 00000100:00100000:1.0:1777051318.181868:0:8628:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d956129180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+47:2436:x1863365425880576:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:0.0:1777051318.181880:0:24468:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d956129500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+50:2437:x1863365425880448:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 68us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051318.181890:0:24468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10270 00000100:00100000:1.0:1777051318.181943:0:8628:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d956129180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+47:2436:x1863365425880576:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 78us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051318.181959:0:8628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10271 00000100:00080000:3.0:1777051318.182057:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1777051318.182065:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1777051318.361375:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051319.382839:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777051320.407038:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1777051321.110507:0:48457:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:1.0:1777051321.110507:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95612a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3680:1863365452556160:0@lo:400:kworker.0 00000100:00080000:0.0:1777051321.110521:0:48457:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1777051321.110527:0:48457:0:(import.c:65:import_set_state_nolock()) ffff99d941838000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1777051321.110536:0:48457:0:(import.c:509:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 7945 00000100:00080000:0.0:1777051321.110545:0:48457:0:(import.c:588:import_select_connection()) lustre-MDT0001-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1777051321.110556:0:48457:0:(import.c:623:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff99d941838000 using connection 192.168.201.146@tcp/0@lo 00000100:00100000:3.0:1777051321.110564:0:3678:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1777051321.110594:0:48457:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d95612aa00 x1863365452556416/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1777051321.110596:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d956128700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3678:1863365452556288:0@lo:400:kworker.0 00000100:00100000:1.0:1777051321.110631:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051321.111034:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1777051321.111049:0:48457:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1777051321.111058:0:48457:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1777051321.111062:0:48457:0:(import.c:65:import_set_state_nolock()) ffff99d942a20000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1777051321.111071:0:48457:0:(import.c:509:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 7945 00000100:00080000:0.0:1777051321.111078:0:48457:0:(import.c:588:import_select_connection()) lustre-MDT0001-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1777051321.111087:0:48457:0:(import.c:623:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff99d942a20000 using connection 192.168.201.146@tcp/0@lo 00000100:00100000:1.0:1777051321.111098:0:46497:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452556288 00000100:00100000:2.0:1777051321.111108:0:103163:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452556160 00000100:00100000:1.0:1777051321.111112:0:46497:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452556288 00000100:00100000:3.0:1777051321.111113:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d956128a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3678:1863365452556544:0@lo:400:kworker.0 00000100:00100000:0.0:1777051321.111120:0:48457:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d956128380 x1863365452556672/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1777051321.111121:0:103163:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452556160 00000100:00080000:0.0:1777051321.111146:0:48457:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1777051321.111153:0:48457:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1777051321.111157:0:48457:0:(import.c:65:import_set_state_nolock()) ffff99da42f4c800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:3.0:1777051321.111186:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1777051321.111191:0:48457:0:(import.c:509:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 7945 00000100:00080000:0.0:1777051321.111264:0:48457:0:(import.c:588:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00100000:1.0:1777051321.111270:0:46497:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452556544 00000100:00080000:0.0:1777051321.111274:0:48457:0:(import.c:623:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff99da42f4c800 using connection 192.168.201.146@tcp/0@lo 00000100:00100000:1.0:1777051321.111280:0:46497:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452556544 00000100:00100000:0.0:1777051321.111309:0:48457:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d956128e00 x1863365452556800/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1777051321.111312:0:103163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00080000:3.0:1777051321.111321:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1777051321.111341:0:103163:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f3dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9351a01-5b0e-4470-97fd-58b9b4b312a2+18:3680:x1863365452556160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777051321.111352:0:46497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13201 00000100:00100000:3.0:1777051321.111367:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13202 00000100:00100000:1.0:1777051321.111376:0:46497:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5fbe3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:lustre-MDT0000-lwp-OST0000_UUID+5:3678:x1863365452556288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051321.111388:0:6579:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5fbe3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3678:x1863365452556544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777051321.111448:0:103163:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f3dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9351a01-5b0e-4470-97fd-58b9b4b312a2+18:3680:x1863365452556160:12345-0@lo:400:kworker.0 Request processed in 114us (821us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051321.111462:0:103163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1777051321.111487:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95612b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3680:1863365452557056:0@lo:400:kworker.0 00000100:00100000:1.0:1777051321.111492:0:46497:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5fbe3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:lustre-MDT0000-lwp-OST0000_UUID+5:3678:x1863365452556288:12345-0@lo:400:kworker.0 Request processed in 119us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051321.111499:0:6579:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5fbe3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3678:x1863365452556544:12345-0@lo:400:kworker.0 Request processed in 115us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051321.111522:0:46497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13201 00000100:00100000:2.0:1777051321.111558:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95612ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3677:1863365452557184:0@lo:400:kworker.0 00000100:00100000:0.0:1777051321.111573:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051321.111601:0:3676:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95612aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3676:1863365452556416:0@lo:38:kworker.0 00000100:00100000:2.0:1777051321.111629:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051321.111631:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13202 00000100:00100000:0.0:1777051321.111648:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95612a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3680:1863365452556160:0@lo:400:kworker.0 00000100:00100000:1.0:1777051321.111963:0:3676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051321.111969:0:6579:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452557184 00000100:00100000:3.0:1777051321.111978:0:6579:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452557184 00000100:00100000:0.0:1777051321.112017:0:3680:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1777051321.112017:0:3676:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d956128380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3676:1863365452556672:0@lo:38:kworker.0 00000100:00100000:0.0:1777051321.112039:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95612b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3680:1863365452556928:0@lo:400:kworker.0 00000100:00100000:3.0:1777051321.112057:0:6579:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452556416 00000100:00100000:3.0:1777051321.112378:0:6579:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452556416 00000100:00100000:2.0:1777051321.112399:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d956128a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3678:1863365452556544:0@lo:400:kworker.0 00000100:00100000:1.0:1777051321.112409:0:3676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051321.112436:0:6579:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452556672 00000100:00100000:2.0:1777051321.112447:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d956128700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3678:1863365452556288:0@lo:400:kworker.0 00000100:00100000:3.0:1777051321.112448:0:6579:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452556672 00000100:00100000:0.0:1777051321.112450:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051321.112466:0:3676:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d956128e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3676:1863365452556800:0@lo:38:kworker.0 00000100:00100000:3.0:1777051321.112507:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13203 00000100:00100000:3.0:1777051321.112527:0:6579:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5fbece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3677:x1863365452557184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777051321.112537:0:10328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111759 00000100:00100000:1.0:1777051321.112540:0:3676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051321.112562:0:8492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111760 00000100:00100000:2.0:1777051321.112564:0:10328:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955611880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3676:x1863365452556416:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1777051321.112578:0:8492:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955610a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3676:x1863365452556672:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1777051321.112609:0:8492:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00020000:2.0:1777051321.112620:0:10328:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1777051321.112633:0:6579:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5fbece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3677:x1863365452557184:12345-0@lo:400:kworker.0 Request processed in 111us (1004us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051321.112648:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13203 00000100:00100000:1.0:1777051321.112662:0:6585:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452556800 00000100:00100000:1.0:1777051321.112695:0:6585:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452556800 00000100:00100000:0.0:1777051321.112725:0:8492:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955610a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3676:x1863365452556672:12345-0@lo:38:kworker.0 Request processed in 144us (320us total) trans 0 rc -19/-19 00000100:00100000:3.0:1777051321.112730:0:8470:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452557056 00000100:00100000:2.0:1777051321.112731:0:10328:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955611880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3676:x1863365452556416:12345-0@lo:38:kworker.0 Request processed in 172us (1058us total) trans 0 rc -19/-19 00000100:00100000:3.0:1777051321.112743:0:8470:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452557056 00000100:00100000:1.0:1777051321.112751:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8037 00000100:00100000:0.0:1777051321.112754:0:8492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111760 00000100:00100000:2.0:1777051321.112774:0:10328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111759 00000100:00100000:1.0:1777051321.112775:0:6585:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955610700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3676:x1863365452556800:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1777051321.112803:0:6585:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1777051321.112829:0:8470:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452556928 00000100:00100000:3.0:1777051321.112837:0:8470:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452556928 00000100:00100000:0.0:1777051321.112845:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10272 00000100:00100000:2.0:1777051321.112864:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95612ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3677:1863365452557184:0@lo:400:kworker.0 00000100:00100000:1.0:1777051321.112869:0:6585:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955610700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3676:x1863365452556800:12345-0@lo:38:kworker.0 Request processed in 97us (335us total) trans 0 rc -19/-19 00000100:00100000:0.0:1777051321.112873:0:8468:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d956129880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3680:x1863365452557056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777051321.112894:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8037 00000100:00100000:3.0:1777051321.112902:0:8470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10273 00000100:00100000:3.0:1777051321.112926:0:8470:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95612a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3680:x1863365452556928:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1777051321.112955:0:3676:0:(import.c:65:import_set_state_nolock()) ffff99d941838000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1777051321.112966:0:3676:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1777051321.112967:0:8468:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d956129880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3680:x1863365452557056:12345-0@lo:400:kworker.0 Request processed in 104us (1393us total) trans 0 rc 0/0 00000100:00080000:2.0:1777051321.112978:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1777051321.112983:0:3676:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95612aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3676:1863365452556416:0@lo:38:kworker.0 00000100:00080000:2.0:1777051321.112990:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1777051321.112994:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10272 00000100:00100000:3.0:1777051321.113016:0:8470:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95612a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3680:x1863365452556928:12345-0@lo:400:kworker.0 Request processed in 96us (569us total) trans 0 rc 0/0 00000100:00080000:1.0:1777051321.113024:0:3676:0:(import.c:65:import_set_state_nolock()) ffff99d942a20000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:3.0:1777051321.113036:0:8470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10273 00000100:00080000:1.0:1777051321.113040:0:3676:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1777051321.113051:0:3676:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d956128380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3676:1863365452556672:0@lo:38:kworker.0 00000100:00080000:1.0:1777051321.113081:0:3676:0:(import.c:65:import_set_state_nolock()) ffff99da42f4c800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:0.0:1777051321.113085:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95612b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3680:1863365452556928:0@lo:400:kworker.0 00000100:00080000:1.0:1777051321.113093:0:3676:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1777051321.113105:0:3676:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d956128e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3676:1863365452556800:0@lo:38:kworker.0 00000100:00100000:0.0:1777051321.113126:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95612b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3680:1863365452557056:0@lo:400:kworker.0 00010000:00010000:0.0:1777051321.430405:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1777051321.622805:0:3677:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1777051321.622851:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95612b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3677:1863365452557312:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1777051321.622982:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051321.623125:0:10113:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452557312 00000100:00100000:3.0:1777051321.623141:0:10113:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452557312 00000100:00100000:1.0:1777051321.623282:0:8473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5574 00000100:00100000:1.0:1777051321.623305:0:8473:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955611c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3677:x1863365452557312:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1777051321.623350:0:8473:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 430293440 pending 0 free 3645853696 avail 3414331392 00000100:00100000:1.0:1777051321.623437:0:8473:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955611c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3677:x1863365452557312:12345-0@lo:13:osp-pre-1-0.0 Request processed in 138us (456us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051321.623452:0:8473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5574 00000100:00100000:1.0:1777051321.623553:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95612b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3677:1863365452557312:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1777051321.624521:0:3680:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1777051321.624539:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95612b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3680:1863365452557440:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1777051321.624590:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051321.624731:0:8472:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452557440 00000100:00100000:3.0:1777051321.625045:0:8472:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452557440 00000100:00100000:3.0:1777051321.625147:0:8472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5575 00000100:00100000:3.0:1777051321.625162:0:8472:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955613100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3680:x1863365452557440:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1777051321.625246:0:8472:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 440353216 pending 0 free 3862671360 avail 3631149056 00000100:00100000:3.0:1777051321.625347:0:8472:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955613100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3680:x1863365452557440:12345-0@lo:13:osp-pre-0-0.0 Request processed in 186us (754us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051321.625361:0:8472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5575 00000100:00100000:1.0:1777051321.625456:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95612b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3680:1863365452557440:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1777051322.454925:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777051323.299603:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051323.299825:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051323.299873:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051323.299921:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051323.299972:0:6580:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425880960 00000100:00100000:3.0:1777051323.299984:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051323.299991:0:6580:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425880960 00000100:00100000:3.0:1777051323.300035:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051323.300081:0:6580:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425880832 00000100:00100000:2.0:1777051323.300091:0:6580:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425880832 00000100:00100000:3.0:1777051323.300094:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051323.300442:0:27884:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425881088 00000100:00100000:1.0:1777051323.300453:0:27884:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425881088 00000100:00100000:3.0:1777051323.300476:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051323.300543:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051323.300615:0:6579:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425881472 00000100:00100000:1.0:1777051323.300617:0:27884:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425881216 00000100:00100000:3.0:1777051323.300626:0:6579:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425881472 00000100:00100000:1.0:1777051323.300629:0:27884:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425881216 00000100:00100000:3.0:1777051323.300713:0:6579:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425881344 00000100:00100000:3.0:1777051323.300721:0:6579:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425881344 00000100:00100000:1.0:1777051323.300731:0:27884:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425881600 00000100:00100000:1.0:1777051323.300742:0:27884:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425881600 00000100:00100000:3.0:1777051323.300785:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13204 00000100:00100000:1.0:1777051323.300807:0:27884:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425881728 00000100:00100000:3.0:1777051323.300811:0:6579:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5fbe0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+17:2439:x1863365425881344:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:1.0:1777051323.300816:0:27884:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425881728 00000100:00100000:2.0:1777051323.300895:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13205 00000100:00100000:2.0:1777051323.300923:0:6580:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5fbe3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+14:2438:x1863365425880832:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:1.0:1777051323.300938:0:27884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10274 00000100:00100000:1.0:1777051323.300963:0:27884:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5fbe2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+50:2439:x1863365425881088:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:3.0:1777051323.300975:0:6579:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5fbe0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+17:2439:x1863365425881344:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 166us (877us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051323.300994:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13204 00000100:00100000:2.0:1777051323.301017:0:6580:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5fbe3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+14:2438:x1863365425880832:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 101us (1089us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051323.301036:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13205 00000100:00100000:1.0:1777051323.301053:0:27884:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5fbe2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+50:2439:x1863365425881088:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 96us (1172us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051323.301063:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111761 00000100:00100000:1.0:1777051323.301083:0:27884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10274 00000100:00100000:2.0:1777051323.301094:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111762 00000100:00100000:3.0:1777051323.301097:0:6579:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5fbe0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2435:x1863365425880960:12345-192.168.201.46@tcp:38:kworker.0 00000100:00100000:2.0:1777051323.301114:0:6580:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5fbe1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2435:x1863365425881472:12345-192.168.201.46@tcp:38:kworker.0 00000100:00100000:1.0:1777051323.301133:0:27884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10275 00000100:00100000:1.0:1777051323.301153:0:27884:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5fbe0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+48:2438:x1863365425881216:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:0.0:1777051323.301195:0:103166:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425880704 00000100:00100000:0.0:1777051323.301207:0:103166:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425880704 00000100:00100000:1.0:1777051323.301255:0:27884:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5fbe0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+48:2438:x1863365425881216:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 106us (1218us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051323.301273:0:27884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10275 00000100:00100000:0.0:1777051323.301282:0:103166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 88 00000100:00100000:0.0:1777051323.301303:0:103166:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f3dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29c4352d-3260-4734-909d-9ea5de9e7fa4+12:2439:x1863365425880704:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:1.0:1777051323.301318:0:27884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10276 00000100:00100000:1.0:1777051323.301340:0:27884:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94e625500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+50:2438:x1863365425881600:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:0.0:1777051323.301381:0:103166:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f3dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29c4352d-3260-4734-909d-9ea5de9e7fa4+12:2439:x1863365425880704:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 82us (1785us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051323.301397:0:103166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 88 00000100:00100000:1.0:1777051323.301411:0:27884:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94e625500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+50:2438:x1863365425881600:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 74us (933us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051323.301427:0:27884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10276 00000100:00100000:1.0:1777051323.301464:0:27884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10277 00000100:00100000:1.0:1777051323.301481:0:27884:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94e624e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+47:2439:x1863365425881728:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:1.0:1777051323.301538:0:27884:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94e624e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+47:2439:x1863365425881728:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 59us (994us total) trans 0 rc 0/0 00010000:00020000:2.0:1777051323.301545:0:6580:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0001: not available for connect from 192.168.201.46@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1777051323.301563:0:27884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10277 00000100:00100000:2.0:1777051323.301696:0:6580:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5fbe1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2435:x1863365425881472:12345-192.168.201.46@tcp:38:kworker.0 Request processed in 580us (1711us total) trans 0 rc -19/-19 00000100:00100000:2.0:1777051323.301713:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111762 00000100:00080000:2.0:1777051323.301765:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1777051323.301776:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1777051323.301783:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00020000:3.0:1777051323.301988:0:6579:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0001: not available for connect from 192.168.201.46@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1777051323.302118:0:6579:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5fbe0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2435:x1863365425880960:12345-192.168.201.46@tcp:38:kworker.0 Request processed in 1032us (2289us total) trans 0 rc -19/-19 00000100:00100000:3.0:1777051323.302133:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111761 00010000:00010000:1.0:1777051323.478483:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777051324.502425:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051325.527459:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1777051326.230505:0:48457:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1777051326.230514:0:48457:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1777051326.230521:0:48457:0:(import.c:65:import_set_state_nolock()) ffff99d941838000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1777051326.230535:0:48457:0:(import.c:509:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 7950 00000100:00080000:3.0:1777051326.230546:0:48457:0:(import.c:588:import_select_connection()) lustre-MDT0001-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00100000:2.0:1777051326.230554:0:3679:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1777051326.230577:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94e626680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3677:1863365452557696:0@lo:400:kworker.0 00000100:00100000:2.0:1777051326.230585:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94e625880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3679:1863365452557568:0@lo:400:kworker.0 00000100:00100000:2.0:1777051326.230731:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051326.230844:0:103169:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452557568 00000100:00100000:1.0:1777051326.230862:0:103169:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452557568 00000100:00100000:1.0:1777051326.231211:0:103169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1777051326.231233:0:103169:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f3dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f9351a01-5b0e-4470-97fd-58b9b4b312a2+18:3679:x1863365452557568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777051326.231442:0:103169:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f3dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f9351a01-5b0e-4470-97fd-58b9b4b312a2+18:3679:x1863365452557568:12345-0@lo:400:kworker.0 Request processed in 215us (710us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051326.231458:0:103169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1777051326.231545:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94e625880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3679:1863365452557568:0@lo:400:kworker.0 00000100:00080000:3.0:1777051326.232622:0:48457:0:(import.c:623:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff99d941838000 using connection 192.168.201.146@tcp/0@lo 00000100:00100000:0.0:1777051326.232630:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051326.232678:0:48457:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d94e624a80 x1863365452557824/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1777051326.233034:0:21368:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452557696 00000100:00100000:2.0:1777051326.233047:0:21368:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452557696 00000100:00080000:3.0:1777051326.233081:0:48457:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1777051326.233089:0:48457:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1777051326.233094:0:48457:0:(import.c:65:import_set_state_nolock()) ffff99d942a20000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1777051326.233102:0:48457:0:(import.c:509:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 7950 00000100:00080000:3.0:1777051326.233109:0:48457:0:(import.c:588:import_select_connection()) lustre-MDT0001-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1777051326.233117:0:48457:0:(import.c:623:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff99d942a20000 using connection 192.168.201.146@tcp/0@lo 00000100:00100000:1.0:1777051326.233140:0:3676:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94e624a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3676:1863365452557824:0@lo:38:kworker.0 00000100:00100000:0.0:1777051326.233148:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94e627480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3678:1863365452557952:0@lo:400:kworker.0 00000100:00100000:3.0:1777051326.233148:0:48457:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d94e624380 x1863365452558080/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1777051326.233282:0:21368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13206 00000100:00080000:3.0:1777051326.233306:0:48457:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:2.0:1777051326.233325:0:21368:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95612b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3677:x1863365452557696:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1777051326.233326:0:48457:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00100000:1.0:1777051326.233328:0:3676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1777051326.233334:0:48457:0:(import.c:65:import_set_state_nolock()) ffff99da42f4c800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1777051326.233349:0:48457:0:(import.c:509:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 7950 00000100:00080000:3.0:1777051326.233353:0:48457:0:(import.c:588:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1777051326.233359:0:48457:0:(import.c:623:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff99da42f4c800 using connection 192.168.201.146@tcp/0@lo 00000100:00100000:0.0:1777051326.233416:0:8492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452557824 00000100:00100000:1.0:1777051326.233427:0:3676:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94e624380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3676:1863365452558080:0@lo:38:kworker.0 00000100:00100000:0.0:1777051326.233430:0:8492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452557824 00000100:00100000:3.0:1777051326.233441:0:48457:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d94e624700 x1863365452558208/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1777051326.233487:0:21368:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95612b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3677:x1863365452557696:12345-0@lo:400:kworker.0 Request processed in 178us (891us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051326.233505:0:8492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111763 00000100:00100000:1.0:1777051326.233510:0:3676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051326.233533:0:21368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13206 00000100:00100000:0.0:1777051326.233534:0:8492:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955613800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3676:x1863365452557824:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1777051326.233542:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94e627100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452558336:0@lo:400:kworker.0 00000100:00100000:1.0:1777051326.233577:0:3676:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94e624700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3676:1863365452558208:0@lo:38:kworker.0 00010000:00020000:0.0:1777051326.233579:0:8492:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1777051326.233587:0:21368:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452558080 00000100:00100000:2.0:1777051326.233624:0:21368:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452558080 00000100:00100000:2.0:1777051326.233673:0:21368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111764 00000100:00100000:2.0:1777051326.233680:0:21368:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955613480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3676:x1863365452558080:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1777051326.233708:0:21368:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1777051326.234291:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051326.234308:0:8492:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955613800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3676:x1863365452557824:12345-0@lo:38:kworker.0 Request processed in 782us (991us total) trans 0 rc -19/-19 00000100:00100000:0.0:1777051326.234327:0:8492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111763 00000100:00100000:2.0:1777051326.234338:0:21368:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955613480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3676:x1863365452558080:12345-0@lo:38:kworker.0 Request processed in 647us (830us total) trans 0 rc -19/-19 00000100:00100000:1.0:1777051326.234360:0:3676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051326.234361:0:21368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111764 00000100:00100000:3.0:1777051326.234389:0:8470:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452558336 00000100:00100000:3.0:1777051326.234401:0:8470:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452558336 00000100:00080000:2.0:1777051326.234413:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1777051326.234505:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94e626680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3677:1863365452557696:0@lo:400:kworker.0 00000100:00080000:1.0:1777051326.234525:0:3676:0:(import.c:65:import_set_state_nolock()) ffff99d942a20000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:3.0:1777051326.234531:0:8470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10278 00000100:00080000:1.0:1777051326.234547:0:3676:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1777051326.234555:0:8470:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94e627800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3679:x1863365452558336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777051326.234559:0:3676:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94e624380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3676:1863365452558080:0@lo:38:kworker.0 00000100:00100000:0.0:1777051326.234574:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5fbefb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3677:1863365452558592:0@lo:400:kworker.0 00000100:00080000:2.0:1777051326.234583:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1777051326.234625:0:3676:0:(import.c:65:import_set_state_nolock()) ffff99d941838000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1777051326.234637:0:3676:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1777051326.234645:0:3676:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94e624a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3676:1863365452557824:0@lo:38:kworker.0 00000100:00100000:3.0:1777051326.234677:0:8470:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94e627800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3679:x1863365452558336:12345-0@lo:400:kworker.0 Request processed in 127us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051326.234692:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051326.234699:0:8470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10278 00000100:00100000:1.0:1777051326.234742:0:46497:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452558592 00000100:00100000:1.0:1777051326.234752:0:46497:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452558592 00000100:00100000:2.0:1777051326.235065:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94e627100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452558336:0@lo:400:kworker.0 00000100:00100000:2.0:1777051326.235098:0:3679:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1777051326.235115:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5fbec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452558464:0@lo:400:kworker.0 00000100:00100000:0.0:1777051326.235133:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051326.235158:0:46497:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452557952 00000100:00100000:1.0:1777051326.235168:0:46497:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452557952 00000100:00100000:3.0:1777051326.235192:0:27885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13207 00000100:00100000:2.0:1777051326.235202:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051326.235248:0:27885:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95612b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000-lwp-MDT0000_UUID+5:3677:x1863365452558592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777051326.235312:0:46497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13208 00000100:00100000:1.0:1777051326.235332:0:46497:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d956128e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:lustre-MDT0000-lwp-OST0001_UUID+5:3678:x1863365452557952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051326.235363:0:27885:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95612b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000-lwp-MDT0000_UUID+5:3677:x1863365452558592:12345-0@lo:400:kworker.0 Request processed in 120us (675us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051326.235365:0:11727:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452558208 00000100:00100000:0.0:1777051326.235377:0:11727:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452558208 00000100:00100000:3.0:1777051326.235386:0:27885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13207 00000100:00100000:2.0:1777051326.235411:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5fbefb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3677:1863365452558592:0@lo:400:kworker.0 00000100:00100000:0.0:1777051326.235454:0:11727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8038 00000100:00100000:1.0:1777051326.235459:0:46497:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d956128e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:lustre-MDT0000-lwp-OST0001_UUID+5:3678:x1863365452557952:12345-0@lo:400:kworker.0 Request processed in 131us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051326.235473:0:11727:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955610e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3676:x1863365452558208:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1777051326.235485:0:46497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13208 00010000:00020000:0.0:1777051326.235505:0:11727:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1777051326.235513:0:24468:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452558464 00000100:00100000:3.0:1777051326.235525:0:24468:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452558464 00000100:00100000:0.0:1777051326.235617:0:11727:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955610e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3676:x1863365452558208:12345-0@lo:38:kworker.0 Request processed in 119us (1244us total) trans 0 rc -19/-19 00000100:00100000:3.0:1777051326.235635:0:24468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10279 00000100:00100000:0.0:1777051326.235648:0:11727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8038 00000100:00100000:1.0:1777051326.235648:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94e627480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3678:1863365452557952:0@lo:400:kworker.0 00000100:00100000:3.0:1777051326.235662:0:24468:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5fbed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3679:x1863365452558464:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1777051326.235701:0:3676:0:(import.c:65:import_set_state_nolock()) ffff99da42f4c800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1777051326.235709:0:3676:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1777051326.235717:0:3676:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94e624700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3676:1863365452558208:0@lo:38:kworker.0 00000100:00080000:0.0:1777051326.235735:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1777051326.236018:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1777051326.236043:0:24468:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5fbed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3679:x1863365452558464:12345-0@lo:400:kworker.0 Request processed in 390us (840us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051326.236059:0:24468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10279 00000100:00100000:1.0:1777051326.236102:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5fbec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452558464:0@lo:400:kworker.0 00010000:00010000:3.0:1777051326.551731:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1777051326.742541:0:3680:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1777051326.742573:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d956128380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3680:1863365452558848:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1777051326.742619:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955611f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3678:1863365452558720:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1777051326.742779:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051326.742895:0:8473:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452558848 00000100:00100000:1.0:1777051326.742907:0:8473:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452558848 00000100:00100000:1.0:1777051326.743022:0:8473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5576 00000100:00100000:1.0:1777051326.743044:0:8473:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95612aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3680:x1863365452558848:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1777051326.743087:0:8473:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 440353216 pending 0 free 3862671360 avail 3631149056 00000100:00100000:2.0:1777051326.743122:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051326.743206:0:8473:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95612aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3680:x1863365452558848:12345-0@lo:13:osp-pre-0-0.0 Request processed in 165us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051326.743221:0:8473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5576 00000100:00100000:0.0:1777051326.743232:0:47388:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452558720 00000100:00100000:0.0:1777051326.743242:0:47388:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452558720 00000100:00100000:2.0:1777051326.743337:0:8472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5577 00000100:00100000:1.0:1777051326.743351:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d956128380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3680:1863365452558848:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1777051326.743363:0:8472:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5fbefb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3678:x1863365452558720:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1777051326.743400:0:8472:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 430293440 pending 0 free 3645853696 avail 3414331392 00000100:00100000:2.0:1777051326.743480:0:8472:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5fbefb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3678:x1863365452558720:12345-0@lo:13:osp-pre-1-0.0 Request processed in 126us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051326.743496:0:8472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5577 00000100:00100000:1.0:1777051326.743512:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955611f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3678:1863365452558720:0@lo:13:osp-pre-1-0.0 00000040:00080000:1.0:1777051327.001100:0:103189:0:(llog.c:858:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1777051327.574518:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1777051328.422418:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051328.422530:0:103165:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425881856 00000100:00100000:0.0:1777051328.422545:0:103165:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425881856 00000100:00100000:0.0:1777051328.422663:0:103165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 90 00000100:00100000:0.0:1777051328.422681:0:103165:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f3dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29c4352d-3260-4734-909d-9ea5de9e7fa4+12:2437:x1863365425881856:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:0.0:1777051328.422790:0:103165:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f3dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29c4352d-3260-4734-909d-9ea5de9e7fa4+12:2437:x1863365425881856:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 113us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051328.422804:0:103165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 90 00000100:00100000:1.0:1777051328.423493:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051328.423598:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051328.423655:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051328.423717:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051328.423770:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051328.423792:0:8492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425881984 00000100:00100000:0.0:1777051328.423802:0:8492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425881984 00000100:00100000:1.0:1777051328.423839:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051328.423882:0:27887:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425882240 00000100:00100000:3.0:1777051328.423894:0:27887:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425882240 00000100:00100000:0.0:1777051328.423914:0:8492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425882496 00000100:00100000:1.0:1777051328.423920:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051328.423927:0:8492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425882496 00000100:00100000:0.0:1777051328.423989:0:8492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425882112 00000100:00100000:0.0:1777051328.423996:0:8492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425882112 00000100:00100000:3.0:1777051328.424002:0:27887:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425882880 00000100:00100000:3.0:1777051328.424012:0:27887:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425882880 00000100:00100000:1.0:1777051328.424044:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051328.424050:0:8492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13209 00000100:00100000:3.0:1777051328.424076:0:27887:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425882368 00000100:00100000:3.0:1777051328.424087:0:27887:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425882368 00000100:00100000:1.0:1777051328.424093:0:27882:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425882624 00000100:00100000:1.0:1777051328.424104:0:27882:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425882624 00000100:00100000:3.0:1777051328.424131:0:27887:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425882752 00000100:00100000:3.0:1777051328.424140:0:27887:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425882752 00000100:00100000:3.0:1777051328.424185:0:27887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10280 00000100:00100000:3.0:1777051328.424201:0:27887:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d9600ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c11b6966-0775-44d2-bdc6-c74c26eb2226+50:2437:x1863365425882240:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:3.0:1777051328.424288:0:27887:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d9600ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c11b6966-0775-44d2-bdc6-c74c26eb2226+50:2437:x1863365425882240:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 92us (694us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051328.424298:0:27887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10280 00000100:00100000:3.0:1777051328.424316:0:27887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10281 00000100:00100000:3.0:1777051328.424324:0:27887:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d9600bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+47:2437:x1863365425882880:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:3.0:1777051328.424352:0:27887:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d9600bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+47:2437:x1863365425882880:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 28us (638us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051328.424363:0:27887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10281 00000100:00100000:3.0:1777051328.424381:0:27887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10282 00000100:00100000:3.0:1777051328.424394:0:27887:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d9600bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c11b6966-0775-44d2-bdc6-c74c26eb2226+48:2436:x1863365425882368:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:0.0:1777051328.424418:0:8492:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955611f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+14:2437:x1863365425881984:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:1.0:1777051328.424432:0:27882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13210 00000100:00100000:3.0:1777051328.424453:0:27887:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d9600bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c11b6966-0775-44d2-bdc6-c74c26eb2226+48:2436:x1863365425882368:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 57us (680us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051328.424463:0:27882:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d9600b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+17:2437:x1863365425882496:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:3.0:1777051328.424479:0:27887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10282 00000100:00100000:0.0:1777051328.424495:0:8492:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955611f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+14:2437:x1863365425881984:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 88us (1003us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051328.424511:0:8492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13209 00000100:00100000:3.0:1777051328.424519:0:27887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10283 00000100:00100000:1.0:1777051328.424534:0:27882:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d9600b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+17:2437:x1863365425882496:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 88us (878us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051328.424541:0:27887:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d9600b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+50:2436:x1863365425882752:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:1.0:1777051328.424608:0:27882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13210 00000100:00100000:3.0:1777051328.424646:0:27887:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d9600b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+50:2436:x1863365425882752:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 106us (726us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051328.424979:0:27887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10283 00000100:00100000:0.0:1777051328.424985:0:8492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111765 00000100:00100000:0.0:1777051328.425015:0:8492:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d9600b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2435:x1863365425882112:12345-192.168.201.46@tcp:38:kworker.0 00000100:00100000:1.0:1777051328.425015:0:27882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111766 00000100:00100000:1.0:1777051328.425038:0:27882:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d9600bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0+-99:2435:x1863365425882624:12345-192.168.201.46@tcp:38:kworker.0 00010000:00020000:0.0:1777051328.425056:0:8492:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0001: not available for connect from 192.168.201.46@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00020000:1.0:1777051328.425067:0:27882:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0001: not available for connect from 192.168.201.46@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1777051328.425438:0:8492:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d9600b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2435:x1863365425882112:12345-192.168.201.46@tcp:38:kworker.0 Request processed in 427us (1601us total) trans 0 rc -19/-19 00000100:00100000:1.0:1777051328.425455:0:27882:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d9600bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0+-99:2435:x1863365425882624:12345-192.168.201.46@tcp:38:kworker.0 Request processed in 412us (1411us total) trans 0 rc -19/-19 00000100:00100000:0.0:1777051328.425458:0:8492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111765 00000100:00100000:1.0:1777051328.425483:0:27882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111766 00000100:00080000:0.0:1777051328.425507:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1777051328.425516:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1777051328.425521:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1777051328.598739:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1777051329.041276:0:104204:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:1.0:1777051329.041282:0:104204:0:(obd_mount.c:917:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:1.0:1777051329.041285:0:104204:0:(obd_mount.c:920:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:1.0:1777051329.041584:0:104204:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff99da7dbcc000 00000020:01000004:1.0:1777051329.041608:0:104204:0:(tgt_mount.c:2453:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:1.0:1777051329.041630:0:104204:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1777051329.041651:0:104204:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff99d941e699c0) 00000020:00000080:1.0:1777051329.041680:0:104204:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1777051329.162386:0:104204:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1777051329.162841:0:104204:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:1.0:1777051329.165336:0:104204:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:1.0:1777051329.166089:0:104204:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:1.0:1777051329.167631:0:104204:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:1.0:1777051329.168254:0:104204:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:1.0:1777051329.168760:0:104204:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1777051329.169289:0:104204:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:1.0:1777051329.170740:0:104204:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:1.0:1777051329.171741:0:104204:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:1.0:1777051329.172244:0:104204:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:1.0:1777051329.173249:0:104204:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:1.0:1777051329.174015:0:104204:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:1.0:1777051329.174736:0:104204:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:1.0:1777051329.178749:0:104204:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:1.0:1777051329.179238:0:104204:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:1.0:1777051329.180053:0:104204:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:1.0:1777051329.180859:0:104204:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:1.0:1777051329.181573:0:104204:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:1.0:1777051329.182971:0:104204:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:1.0:1777051329.183719:0:104204:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:1.0:1777051329.184164:0:104204:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:1.0:1777051329.185731:0:104204:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:1.0:1777051329.186154:0:104204:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:1.0:1777051329.186892:0:104204:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:1.0:1777051329.187352:0:104204:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:1.0:1777051329.187840:0:104204:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:1.0:1777051329.188313:0:104204:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:1.0:1777051329.188800:0:104204:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:1.0:1777051329.189592:0:104204:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:1.0:1777051329.190287:0:104204:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:0.0:1777051329.190884:0:104204:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:0.0:1777051329.192308:0:104204:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:0.0:1777051329.193083:0:104204:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:0.0:1777051329.193679:0:104204:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:0.0:1777051329.194189:0:104204:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:0.0:1777051329.194659:0:104204:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:0.0:1777051329.195673:0:104204:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:0.0:1777051329.196535:0:104204:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:0.0:1777051329.198307:0:104204:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:0.0:1777051329.199051:0:104204:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:0.0:1777051329.199594:0:104204:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:0.0:1777051329.200006:0:104204:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:0.0:1777051329.200464:0:104204:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:0.0:1777051329.200899:0:104204:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:0.0:1777051329.201339:0:104204:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00080000:01000000:0.0:1777051329.206628:0:104204:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1777051329.206967:0:104204:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:0.0:1777051329.206985:0:104204:0:(osd_handler.c:8912:osd_obd_connect()) connect #0 00000020:00000080:0.0:1777051329.207004:0:104204:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x85f51a6b96714f8b 00000020:01000004:0.0:1777051329.207014:0:104204:0:(tgt_mount.c:2538:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:0.0:1777051329.207044:0:104204:0:(obd_mount.c:394:lustre_start_mgc()) MGC192.168.201.146@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1777051329.207048:0:104204:0:(mgc_request.c:1069:mgc_set_info_async()) InitRecov MGC192.168.201.146@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1777051329.207056:0:104204:0:(tgt_mount.c:1762:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:0.0:1777051329.207089:0:104204:0:(tgt_mount.c:278:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:0.0:1777051329.207094:0:104204:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.146@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:2.0:1777051329.216525:0:104204:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.146@tcp ctxt 0 is initialized 00000020:01000004:2.0:1777051329.216619:0:104204:0:(tgt_mount.c:1387:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.201.146@tcp, index=0001, flags=0x20001 00000020:01000004:2.0:1777051329.216628:0:104204:0:(tgt_mount.c:1144:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1777051329.216631:0:104204:0:(tgt_mount.c:1145:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1777051329.216634:0:104204:0:(tgt_mount.c:1146:server_mti_print()) fs: lustre 00000020:01000004:2.0:1777051329.216636:0:104204:0:(tgt_mount.c:1147:server_mti_print()) uuid: 00000020:01000004:2.0:1777051329.216639:0:104204:0:(tgt_mount.c:1148:server_mti_print()) ver: 0 00000020:01000004:2.0:1777051329.216640:0:104204:0:(tgt_mount.c:1149:server_mti_print()) flags: 00000020:01000004:2.0:1777051329.216642:0:104204:0:(tgt_mount.c:1151:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1777051329.216645:0:104204:0:(tgt_mount.c:1183:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1777051329.216647:0:104204:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1777051329.216651:0:104204:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:2.0:1777051329.216654:0:104204:0:(tgt_mount.c:1144:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1777051329.216656:0:104204:0:(tgt_mount.c:1145:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1777051329.216657:0:104204:0:(tgt_mount.c:1146:server_mti_print()) fs: lustre 00000020:01000004:2.0:1777051329.216659:0:104204:0:(tgt_mount.c:1147:server_mti_print()) uuid: 00000020:01000004:2.0:1777051329.216660:0:104204:0:(tgt_mount.c:1148:server_mti_print()) ver: 0 00000020:01000004:2.0:1777051329.216662:0:104204:0:(tgt_mount.c:1149:server_mti_print()) flags: 00000020:01000004:2.0:1777051329.216663:0:104204:0:(tgt_mount.c:1151:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1777051329.216665:0:104204:0:(tgt_mount.c:1183:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1777051329.216667:0:104204:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1777051329.216699:0:104204:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1777051329.216723:0:104204:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5fbeed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9351a01-5b0e-4470-97fd-58b9b4b312a2:104204:1863365452558976:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1777051329.216801:0:104204:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051329.216860:0:104204:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d955a45540 going to sleep for 11 seconds 00000100:00100000:1.0:1777051329.216947:0:103168:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452558976 00000100:00100000:1.0:1777051329.216962:0:103168:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452558976 00000100:00100000:1.0:1777051329.217046:0:103168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1777051329.217062:0:103168:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f3df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f9351a01-5b0e-4470-97fd-58b9b4b312a2+18:104204:x1863365452558976:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1777051329.217114:0:103168:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1777051329.217122:0:103168:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:1.0:1777051329.217269:0:103168:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:1.0:1777051329.217823:0:103168:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f3df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f9351a01-5b0e-4470-97fd-58b9b4b312a2+18:104204:x1863365452558976:12345-0@lo:253:mount.lustre.0 Request processed in 762us (1016us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051329.217839:0:103168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1777051329.217939:0:104204:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5fbeed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9351a01-5b0e-4470-97fd-58b9b4b312a2:104204:1863365452558976:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1777051329.217958:0:104204:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1777051329.217962:0:104204:0:(tgt_mount.c:1144:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1777051329.217965:0:104204:0:(tgt_mount.c:1145:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1777051329.217968:0:104204:0:(tgt_mount.c:1146:server_mti_print()) fs: lustre 00000020:01000004:2.0:1777051329.217970:0:104204:0:(tgt_mount.c:1147:server_mti_print()) uuid: 00000020:01000004:2.0:1777051329.217972:0:104204:0:(tgt_mount.c:1148:server_mti_print()) ver: 0 00000020:01000004:2.0:1777051329.217974:0:104204:0:(tgt_mount.c:1149:server_mti_print()) flags: 00000020:01000004:2.0:1777051329.217977:0:104204:0:(tgt_mount.c:1151:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1777051329.217980:0:104204:0:(tgt_mount.c:1183:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1777051329.217982:0:104204:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1777051329.218012:0:104204:0:(tgt_mount.c:99:server_register_mount()) register mount ffff99da7dbcc000 from lustre-MDT0001 10000000:01000000:2.0:1777051329.218048:0:104204:0:(mgc_request.c:1941:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:2.0:1777051329.218053:0:104204:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1777051329.218066:0:104204:0:(mgc_request_server.c:870:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff99da70a599c0 local copy 00010000:00010000:2.0:1777051329.218396:0:104204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.146@tcp lock: ffff99d955a99800/0x85f51a6b96714ccf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b96714cd6 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051329.218518:0:104204:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5fbeed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9351a01-5b0e-4470-97fd-58b9b4b312a2:104204:1863365452559104:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1777051329.218601:0:104204:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051329.218656:0:104204:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d955a45780 going to sleep for 11 seconds 00000100:00100000:1.0:1777051329.218704:0:103169:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452559104 00000100:00100000:1.0:1777051329.218714:0:103169:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452559104 00000100:00100000:1.0:1777051329.218774:0:103169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1777051329.219085:0:103169:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f3de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f9351a01-5b0e-4470-97fd-58b9b4b312a2+18:104204:x1863365452559104:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1777051329.219248:0:103169:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f3de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f9351a01-5b0e-4470-97fd-58b9b4b312a2+18:104204:x1863365452559104:12345-0@lo:501:mount.lustre.0 Request processed in 459us (644us total) trans 0 rc -2/-2 00000100:00100000:1.0:1777051329.219263:0:103169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1777051329.219338:0:104204:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5fbeed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9351a01-5b0e-4470-97fd-58b9b4b312a2:104204:1863365452559104:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1777051329.219388:0:104204:0:(mgc_request_server.c:763:mgc_llog_local_copy()) MGC192.168.201.146@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1777051329.219420:0:104204:0:(mgc_request_server.c:893:mgc_get_local_copy()) MGC192.168.201.146@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1777051329.219431:0:104204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff99d955a99800/0x85f51a6b96714ccf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b96714cd6 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051329.219449:0:104204:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.146@tcp lock: ffff99d955a99800/0x85f51a6b96714ccf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b96714cd6 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1777051329.219486:0:104204:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff99da7dbcc000 10000000:01000000:2.0:1777051329.219493:0:104204:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1777051329.219500:0:104204:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff99da7dbcc000 10000000:01000000:2.0:1777051329.219504:0:104204:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1777051329.219510:0:104204:0:(mgc_request.c:1799:mgc_process_log()) Process log lustre-barrier-ffff99da7dbcc000 from 1 10000000:01000000:2.0:1777051329.219516:0:104204:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1777051329.219579:0:104204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.146@tcp lock: ffff99d95071b000/0x85f51a6b96714f92 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 104204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051329.219595:0:104204:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.146@tcp lock: ffff99d95071b000/0x85f51a6b96714f92 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 104204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051329.219611:0:104204:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.146@tcp lock: ffff99d95071b000/0x85f51a6b96714f92 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 104204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051329.219636:0:104204:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5fbeed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9351a01-5b0e-4470-97fd-58b9b4b312a2:104204:1863365452559232:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1777051329.219683:0:104204:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051329.219735:0:104204:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d955a45780 going to sleep for 11 seconds 00000100:00100000:3.0:1777051329.219812:0:103166:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452559232 00000100:00100000:3.0:1777051329.219822:0:103166:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452559232 00000100:00100000:3.0:1777051329.219887:0:103166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1777051329.219902:0:103166:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f3dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9351a01-5b0e-4470-97fd-58b9b4b312a2+18:104204:x1863365452559232:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1777051329.219919:0:103166:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777051329.219982:0:103166:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d94ffbc600/0x85f51a6b96714f99 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x85f51a6b96714f92 expref: -99 pid: 103166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051329.220020:0:103166:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d94ffbc600/0x85f51a6b96714f99 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x85f51a6b96714f92 expref: 19 pid: 103166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051329.220034:0:103166:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d94ffbc600/0x85f51a6b96714f99 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b96714f92 expref: 19 pid: 103166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051329.220045:0:103166:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d94ffbc600, rc 0) 00000100:00100000:3.0:1777051329.220116:0:103166:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f3dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9351a01-5b0e-4470-97fd-58b9b4b312a2+19:104204:x1863365452559232:12345-0@lo:101:mount.lustre.0 Request processed in 216us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051329.220128:0:103166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1777051329.220223:0:104204:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5fbeed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9351a01-5b0e-4470-97fd-58b9b4b312a2:104204:1863365452559232:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1777051329.220249:0:104204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.146@tcp lock: ffff99d95071b000/0x85f51a6b96714f92 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b96714f99 expref: -99 pid: 104204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051329.220267:0:104204:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.146@tcp lock: ffff99d95071b000/0x85f51a6b96714f92 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x85f51a6b96714f99 expref: -99 pid: 104204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1777051329.220291:0:104204:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.201.146@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1777051329.220320:0:104204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff99d95071b000/0x85f51a6b96714f92 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b96714f99 expref: -99 pid: 104204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051329.220334:0:104204:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.146@tcp lock: ffff99d95071b000/0x85f51a6b96714f92 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b96714f99 expref: -99 pid: 104204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1777051329.220347:0:104204:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:0.0:1777051329.220356:0:104204:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1777051329.220365:0:104204:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff99da7dbcc000 10000000:01000000:0.0:1777051329.220373:0:104204:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1777051329.220377:0:104204:0:(mgc_request.c:1799:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:0.0:1777051329.220383:0:104204:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1777051329.220415:0:104204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.146@tcp lock: ffff99d954ea6600/0x85f51a6b96714fa0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 104204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051329.220462:0:104204:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.146@tcp lock: ffff99d954ea6600/0x85f51a6b96714fa0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 104204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051329.220480:0:104204:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.146@tcp lock: ffff99d954ea6600/0x85f51a6b96714fa0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 104204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051329.220502:0:104204:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95612ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9351a01-5b0e-4470-97fd-58b9b4b312a2:104204:1863365452559360:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1777051329.220583:0:104204:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051329.220631:0:104204:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da57b3ab40 going to sleep for 11 seconds 00000100:00100000:1.0:1777051329.220702:0:103168:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452559360 00000100:00100000:1.0:1777051329.220711:0:103168:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452559360 00000100:00100000:1.0:1777051329.220776:0:103168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1777051329.220789:0:103168:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f3dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f9351a01-5b0e-4470-97fd-58b9b4b312a2+19:104204:x1863365452559360:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1777051329.220804:0:103168:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777051329.220820:0:103168:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d953298800/0x85f51a6b96714fa7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x85f51a6b96714fa0 expref: -99 pid: 103168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051329.220846:0:103168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d953298800/0x85f51a6b96714fa7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x85f51a6b96714fa0 expref: 20 pid: 103168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051329.220861:0:103168:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d953298800/0x85f51a6b96714fa7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b96714fa0 expref: 20 pid: 103168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051329.220883:0:103168:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d953298800, rc 0) 00000100:00100000:1.0:1777051329.220957:0:103168:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f3dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f9351a01-5b0e-4470-97fd-58b9b4b312a2+20:104204:x1863365452559360:12345-0@lo:101:mount.lustre.0 Request processed in 169us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051329.220970:0:103168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1777051329.221156:0:104204:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95612ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9351a01-5b0e-4470-97fd-58b9b4b312a2:104204:1863365452559360:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1777051329.221178:0:104204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.146@tcp lock: ffff99d954ea6600/0x85f51a6b96714fa0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b96714fa7 expref: -99 pid: 104204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051329.221193:0:104204:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.146@tcp lock: ffff99d954ea6600/0x85f51a6b96714fa0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x85f51a6b96714fa7 expref: -99 pid: 104204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1777051329.226578:0:104204:0:(llog.c:858:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000040:00080000:0.0:1777051329.227840:0:104204:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1777051329.236401:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1777051329.236451:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:0.0:1777051329.236466:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:0.0:1777051329.236481:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:0.0:1777051329.236494:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 00000040:00080000:0.0:1777051329.236507:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 00000040:00080000:0.0:1777051329.236520:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 00000040:00080000:0.0:1777051329.236533:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:0.0:1777051329.236588:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:0.0:1777051329.236609:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 00000040:00080000:0.0:1777051329.236624:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 00000040:00080000:0.0:1777051329.236641:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 00000040:00080000:0.0:1777051329.236654:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 00000040:00080000:0.0:1777051329.236667:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:0.0:1777051329.236680:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:0.0:1777051329.236693:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 00000040:00080000:0.0:1777051329.236706:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:0.0:1777051329.236719:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:0.0:1777051329.236732:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 00000040:00080000:0.0:1777051329.236745:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:0.0:1777051329.236758:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:0.0:1777051329.236770:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:0.0:1777051329.236783:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:0.0:1777051329.236809:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 00000040:00080000:0.0:1777051329.236817:0:104204:0:(llog.c:858:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 24 count 25 00000100:00100000:0.0:1777051329.236956:0:104204:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95612ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9351a01-5b0e-4470-97fd-58b9b4b312a2:104204:1863365452559488:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1777051329.237022:0:104204:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051329.238918:0:104204:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da57b3a000 going to sleep for 11 seconds 00000100:00100000:2.0:1777051329.238994:0:103165:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452559488 00000100:00100000:2.0:1777051329.239008:0:103165:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452559488 00000100:00100000:2.0:1777051329.239113:0:103165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1777051329.239129:0:103165:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f3de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9351a01-5b0e-4470-97fd-58b9b4b312a2+20:104204:x1863365452559488:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1777051329.239342:0:103165:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f3de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9351a01-5b0e-4470-97fd-58b9b4b312a2+20:104204:x1863365452559488:12345-0@lo:501:mount.lustre.0 Request processed in 216us (2316us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051329.239357:0:103165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1777051329.239408:0:104204:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95612ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9351a01-5b0e-4470-97fd-58b9b4b312a2:104204:1863365452559488:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1777051329.239474:0:104204:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95612ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9351a01-5b0e-4470-97fd-58b9b4b312a2:104204:1863365452559616:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1777051329.239536:0:104204:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051329.239604:0:104204:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da57b3a000 going to sleep for 11 seconds 00000100:00100000:2.0:1777051329.239651:0:103163:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452559616 00000100:00100000:2.0:1777051329.239660:0:103163:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452559616 00000100:00100000:2.0:1777051329.239718:0:103163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1777051329.239732:0:103163:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f3dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9351a01-5b0e-4470-97fd-58b9b4b312a2+20:104204:x1863365452559616:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1777051329.239896:0:103163:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f3dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9351a01-5b0e-4470-97fd-58b9b4b312a2+20:104204:x1863365452559616:12345-0@lo:503:mount.lustre.0 Request processed in 163us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051329.239910:0:103163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1777051329.240080:0:104204:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95612ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9351a01-5b0e-4470-97fd-58b9b4b312a2:104204:1863365452559616:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1777051329.241100:0:104204:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1777051329.241241:0:104204:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d9600ba680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9351a01-5b0e-4470-97fd-58b9b4b312a2:104204:1863365452559744:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1777051329.241326:0:104204:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051329.241386:0:104204:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da70a7d9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1777051329.241411:0:103168:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452559744 00000100:00100000:0.0:1777051329.241423:0:103168:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452559744 00000100:00100000:0.0:1777051329.241515:0:103168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1777051329.241530:0:103168:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5cdb4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f9351a01-5b0e-4470-97fd-58b9b4b312a2+20:104204:x1863365452559744:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1777051329.243046:0:103168:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5cdb4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f9351a01-5b0e-4470-97fd-58b9b4b312a2+20:104204:x1863365452559744:12345-0@lo:502:mount.lustre.0 Request processed in 1516us (1718us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051329.243062:0:103168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1777051329.243133:0:104204:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d9600ba680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9351a01-5b0e-4470-97fd-58b9b4b312a2:104204:1863365452559744:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1777051329.243493:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1777051329.244301:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 136 off8552 00000040:00080000:1.0:1777051329.244355:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 176 off8728 00000040:00080000:1.0:1777051329.244387:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8952 00000040:00080000:1.0:1777051329.244416:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9176 00000040:00080000:1.0:1777051329.244441:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9296 00000040:00080000:1.0:1777051329.244467:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 112 off9408 00000040:00080000:1.0:1777051329.244492:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 160 off9568 00000040:00080000:1.0:1777051329.244517:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9792 00000040:00080000:1.0:1777051329.244584:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off10016 00000040:00080000:1.0:1777051329.244617:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 88 off10104 00000040:00080000:1.0:1777051329.244643:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 144 off10248 00000040:00080000:1.0:1777051329.244673:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 152 off10400 00000040:00080000:1.0:1777051329.244699:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 168 off10568 00000040:00080000:1.0:1777051329.244723:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 224 off10792 00000040:00080000:1.0:1777051329.244749:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 224 off11016 00000040:00080000:1.0:1777051329.245448:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 80 off11096 00000040:00080000:1.0:1777051329.245487:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11320 00000040:00080000:1.0:1777051329.245513:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 224 off11544 00000040:00080000:1.0:1777051329.245573:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 160 off11704 00000040:00080000:1.0:1777051329.245605:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11928 00000040:00080000:1.0:1777051329.245629:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 224 off12152 00000040:00080000:1.0:1777051329.245652:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 80 off12232 00000040:00080000:1.0:1777051329.245967:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 224 off12456 00000040:00080000:1.0:1777051329.246004:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 224 off12680 00000040:00080000:1.0:1777051329.246031:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 88 off12768 00000040:00080000:1.0:1777051329.246059:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 144 off12912 00000040:00080000:1.0:1777051329.246089:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 152 off13064 00000040:00080000:1.0:1777051329.246117:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 136 off13200 00000040:00080000:1.0:1777051329.246143:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13424 00000040:00080000:1.0:1777051329.246168:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 224 off13648 00000040:00080000:1.0:1777051329.246228:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 80 off13728 00000040:00080000:1.0:1777051329.246271:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 224 off13952 00000040:00080000:1.0:1777051329.246313:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 224 off14176 00000040:00080000:1.0:1777051329.246352:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 88 off14264 00000040:00080000:1.0:1777051329.246386:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 144 off14408 00000040:00080000:1.0:1777051329.246413:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 152 off14560 00000040:00080000:1.0:1777051329.246440:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 136 off14696 00000040:00080000:1.0:1777051329.246467:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14920 00000040:00080000:1.0:1777051329.246493:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 224 off15144 00000040:00080000:1.0:1777051329.246517:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 80 off15224 00000040:00080000:1.0:1777051329.246582:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 224 off15448 00000040:00080000:1.0:1777051329.246613:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 224 off15672 00000040:00080000:1.0:1777051329.246634:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 120 off15792 00000040:00080000:1.0:1777051329.246658:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off16016 00000040:00080000:1.0:1777051329.246680:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].46, 224 off16240 00000040:00080000:1.0:1777051329.246704:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].47, 120 off16360 00000040:00080000:1.0:1777051329.246727:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].48, 24 off16384 00000100:00100000:1.0:1777051329.246788:0:104204:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d9600ba680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9351a01-5b0e-4470-97fd-58b9b4b312a2:104204:1863365452559872:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1777051329.246852:0:104204:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051329.246893:0:104204:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da70a7d9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1777051329.246949:0:103165:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452559872 00000100:00100000:2.0:1777051329.246960:0:103165:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452559872 00000100:00100000:2.0:1777051329.247020:0:103165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1777051329.247034:0:103165:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7c978050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9351a01-5b0e-4470-97fd-58b9b4b312a2+20:104204:x1863365452559872:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1777051329.247730:0:103165:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7c978050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9351a01-5b0e-4470-97fd-58b9b4b312a2+20:104204:x1863365452559872:12345-0@lo:502:mount.lustre.0 Request processed in 696us (874us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051329.247741:0:103165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1777051329.247829:0:104204:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d9600ba680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9351a01-5b0e-4470-97fd-58b9b4b312a2:104204:1863365452559872:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1777051329.248069:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].49, 224 off16608 00000040:00080000:1.0:1777051329.248114:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].50, 224 off16832 00000040:00080000:1.0:1777051329.248141:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].51, 144 off16976 00000040:00080000:1.0:1777051329.248167:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].52, 224 off17200 00000040:00080000:1.0:1777051329.248191:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].53, 224 off17424 00000040:00080000:1.0:1777051329.248214:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].54, 144 off17568 00000040:00080000:1.0:1777051329.248239:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].55, 224 off17792 00000040:00080000:1.0:1777051329.248261:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].56, 224 off18016 00000040:00080000:1.0:1777051329.248281:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].57, 120 off18136 00000100:00100000:1.0:1777051329.248317:0:104204:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d9600ba680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9351a01-5b0e-4470-97fd-58b9b4b312a2:104204:1863365452560000:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1777051329.248388:0:104204:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051329.248444:0:104204:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da70a7d9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1777051329.248507:0:103163:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452560000 00000100:00100000:2.0:1777051329.248519:0:103163:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452560000 00000100:00100000:2.0:1777051329.248621:0:103163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1777051329.248644:0:103163:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7c978c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9351a01-5b0e-4470-97fd-58b9b4b312a2+20:104204:x1863365452560000:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1777051329.249146:0:103163:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7c978c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9351a01-5b0e-4470-97fd-58b9b4b312a2+20:104204:x1863365452560000:12345-0@lo:502:mount.lustre.0 Request processed in 510us (756us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051329.249160:0:103163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1777051329.249423:0:104204:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d9600ba680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9351a01-5b0e-4470-97fd-58b9b4b312a2:104204:1863365452560000:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1777051329.249502:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].58, 224 off18360 00000040:00080000:1.0:1777051329.249518:0:104204:0:(llog.c:858:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 58 count 58 00000020:01000000:1.0:1777051329.251219:0:104208:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1777051329.251237:0:104208:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1777051329.251242:0:104208:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1777051329.251251:0:104208:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:1.0:1777051329.251256:0:104208:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1777051329.251274:0:104208:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff99d941e6b380) 00000020:00000080:1.0:1777051329.251309:0:104208:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lod with refcount 2 00000020:00000080:1.0:1777051329.251318:0:104208:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1777051329.251473:0:104208:0:(osd_handler.c:8912:osd_obd_connect()) connect #1 00000020:00000080:1.0:1777051329.251485:0:104208:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x85f51a6b96714fb5 00000020:00000080:1.0:1777051329.252133:0:104208:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:1.0:1777051329.252142:0:104208:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1777051329.252149:0:104208:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1777051329.252152:0:104208:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1777051329.252230:0:104208:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1777051329.252240:0:104208:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1777051329.252243:0:104208:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:1.0:1777051329.252250:0:104208:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1777051329.252265:0:104208:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff99d94bef99c0) 00000020:00000080:1.0:1777051329.252290:0:104208:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type mdt with refcount 2 00000020:00000080:1.0:1777051329.252298:0:104208:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1777051329.252302:0:104208:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:1.0:1777051329.252306:0:104208:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:1.0:1777051329.252317:0:104208:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1777051329.252401:0:104208:0:(tgt_mount.c:151:server_get_mount()) get mount ffff99da7dbcc000 from lustre-MDT0001, refs=2 00000020:00000080:1.0:1777051329.252420:0:104208:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff99d94befb380) 00000020:00000080:1.0:1777051329.252440:0:104208:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type mdd with refcount 2 00000004:01000000:1.0:1777051329.252525:0:104208:0:(lod_dev.c:2288:lod_obd_connect()) connect #0 00000020:00000080:1.0:1777051329.252532:0:104208:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x85f51a6b96714fca 00000020:00000080:1.0:1777051329.252699:0:104208:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:1.0:1777051329.252712:0:104208:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1777051329.252721:0:104208:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x85f51a6b96714fd1 00080000:01000000:1.0:1777051329.252732:0:104208:0:(osd_handler.c:8912:osd_obd_connect()) connect #2 00000020:00000080:1.0:1777051329.252738:0:104208:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x85f51a6b96714fd8 00010000:00010000:1.0:1777051329.350400:0:104208:0:(ldlm_pool.c:924:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-4 is initialized 00000001:00080000:1.0:1777051329.351031:0:104208:0:(tgt_lastrcvd.c:1758:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0000-mdtlov_UUID idx: 0 lr: 0 srv lr: 4294970573 lx: 0 gen 14 00000001:00080000:1.0:1777051329.351362:0:104208:0:(tgt_lastrcvd.c:1758:tgt_clients_data_init()) RCVRNG CLIENT uuid: c11b6966-0775-44d2-bdc6-c74c26eb2226 idx: 1 lr: 0 srv lr: 4294970573 lx: 0 gen 8 00000001:00080000:1.0:1777051329.351399:0:104208:0:(tgt_lastrcvd.c:1758:tgt_clients_data_init()) RCVRNG CLIENT uuid: 2dd4696c-edce-4cd1-86d2-dbd2ff957fa1 idx: 3 lr: 0 srv lr: 4294970573 lx: 0 gen 5 00000001:00000004:1.0:1777051329.351432:0:104208:0:(tgt_lastrcvd.c:732:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 4294970573 00000001:00080000:1.0:1777051329.352043:0:104208:0:(tgt_lastrcvd.c:223:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000001:00080000:1.0:1777051329.352140:0:104208:0:(tgt_lastrcvd.c:2296:tgt_reply_data_init()) lustre-MDT0001: restore reply ffff99d9596fa600: xid 1863365424767232, transno 4294970537, client gen 8, slot idx 0 00000001:00080000:1.0:1777051329.352158:0:104208:0:(tgt_lastrcvd.c:2296:tgt_reply_data_init()) lustre-MDT0001: restore reply ffff99d9596fa480: xid 1863365424795520, transno 4294970570, client gen 5, slot idx 1 00000020:00000080:1.0:1777051329.356262:0:104208:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:1.0:1777051329.356279:0:104208:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1777051329.356289:0:104208:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1777051329.356293:0:104208:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:1.0:1777051329.356298:0:104208:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1777051329.356306:0:104208:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1777051329.356309:0:104208:0:(obd_config.c:1561:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:1.0:1777051329.356315:0:104208:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1777051329.356323:0:104208:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.201.146@tcp to nid 0x20000c0a8c992 (192.168.201.146@tcp) 00000020:00000080:1.0:1777051329.356361:0:104208:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1777051329.356382:0:104208:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff99d94bef8000) 00000020:00000080:1.0:1777051329.356416:0:104208:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:1.0:1777051329.356425:0:104208:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1777051329.356612:0:104208:0:(osp_dev.c:1199:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:1.0:1777051329.356625:0:104208:0:(osd_handler.c:8912:osd_obd_connect()) connect #3 00000020:00000080:1.0:1777051329.356637:0:104208:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x85f51a6b96714ffb 00010000:00080000:1.0:1777051329.356693:0:104208:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99da5f3d6000@lustre-MDT0000-osp-MDT0001: add connection 192.168.201.146@tcp at head 00010000:00010000:1.0:1777051329.360622:0:104208:0:(ldlm_pool.c:924:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-9 is initialized 00000020:00000080:1.0:1777051329.362668:0:104208:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1777051329.362685:0:104208:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1777051329.362741:0:104208:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:1.0:1777051329.362771:0:104208:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x85f51a6b96715002 00000100:00080000:1.0:1777051329.362787:0:104208:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1777051329.362796:0:104208:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff99da5f3d6000 using connection 192.168.201.146@tcp/0@lo 00000100:00100000:1.0:1777051329.362845:0:104208:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d9600ba680 x1863365452560128/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1777051329.362889:0:104208:0:(pinger.c:371:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1777051329.362971:0:3676:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d9600ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3676:1863365452560128:0@lo:38:llog_process_th.0 00000020:01000000:1.0:1777051329.362983:0:104208:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1777051329.362993:0:104208:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1777051329.362997:0:104208:0:(obd_config.c:1561:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:1.0:1777051329.363004:0:104208:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1777051329.363008:0:104208:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #14 00000020:01000000:1.0:1777051329.363011:0:104208:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1777051329.363015:0:104208:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1777051329.363019:0:104208:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1777051329.363026:0:104208:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1777051329.363029:0:104208:0:(obd_config.c:1561:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:1.0:1777051329.363033:0:104208:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1777051329.363043:0:104208:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1777051329.363047:0:104208:0:(obd_config.c:1561:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:1.0:1777051329.363053:0:104208:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1777051329.363071:0:3676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:01000000:1.0:1777051329.363108:0:104208:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00080000:3.0:1777051329.363397:0:48457:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1777051329.363406:0:48457:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1777051329.363411:0:48457:0:(import.c:65:import_set_state_nolock()) ffff99d941838000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1777051329.363420:0:48457:0:(import.c:509:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 7955 00000100:00080000:3.0:1777051329.363429:0:48457:0:(import.c:588:import_select_connection()) lustre-MDT0001-lwp-OST0000: tried all connections, increasing latency to 15s 00000020:01000000:1.0:1777051329.363435:0:104208:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000100:00080000:3.0:1777051329.363438:0:48457:0:(import.c:623:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff99d941838000 using connection 192.168.201.146@tcp/0@lo 00000100:00100000:2.0:1777051329.363439:0:47208:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452560128 00000020:00000080:1.0:1777051329.363444:0:104208:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1777051329.363450:0:104208:0:(obd_config.c:1561:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000100:00100000:2.0:1777051329.363453:0:47208:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452560128 00000020:01000000:1.0:1777051329.363456:0:104208:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1777051329.363462:0:104208:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #18 00000020:01000000:1.0:1777051329.363465:0:104208:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1777051329.363467:0:104208:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1777051329.363470:0:104208:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1777051329.363477:0:104208:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000100:00100000:3.0:1777051329.363477:0:48457:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d94e625f80 x1863365452560384/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000020:00000080:1.0:1777051329.363482:0:104208:0:(obd_config.c:1561:class_process_config()) marker 18 (0x6) lustre sys.timeout 00000020:01000000:1.0:1777051329.363492:0:104208:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1777051329.363503:0:104208:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:1.0:1777051329.363511:0:104208:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000100:00100000:2.0:1777051329.363513:0:47208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8039 00000020:00000080:1.0:1777051329.363516:0:104208:0:(obd_config.c:1561:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1777051329.363526:0:104208:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000100:00100000:2.0:1777051329.363531:0:47208:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5fbee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:0+-99:3676:x1863365452560128:12345-0@lo:38:llog_process_th.0 00000020:00000080:1.0:1777051329.363536:0:104208:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.201.146@tcp to nid 0x20000c0a8c992 (192.168.201.146@tcp) 00000020:01000000:1.0:1777051329.363595:0:104208:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:1.0:1777051329.363603:0:104208:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1777051329.363626:0:104208:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff99d94befcd40) 00000100:00080000:3.0:1777051329.363919:0:48457:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1777051329.363927:0:48457:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1777051329.363935:0:48457:0:(import.c:65:import_set_state_nolock()) ffff99d942a20000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00010000:00080000:2.0:1777051329.363942:0:47208:0:(ldlm_lib.c:1431:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 7958 last 0 00000100:00080000:3.0:1777051329.363949:0:48457:0:(import.c:509:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 7955 00000100:00100000:1.0:1777051329.363951:0:3678:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1777051329.363961:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94e625180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3680:1863365452560256:0@lo:400:kworker.0 00000100:00080000:3.0:1777051329.363962:0:48457:0:(import.c:588:import_select_connection()) lustre-MDT0001-lwp-OST0001: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1777051329.363978:0:48457:0:(import.c:623:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff99d942a20000 using connection 192.168.201.146@tcp/0@lo 00000100:00100000:1.0:1777051329.363980:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94e624700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3678:1863365452560512:0@lo:400:kworker.0 00000100:00100000:3.0:1777051329.364012:0:48457:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d94e627480 x1863365452560640/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000020:00000080:2.0:1777051329.364018:0:47208:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x85f51a6b96715009 00000100:00080000:3.0:1777051329.364036:0:48457:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1777051329.364041:0:48457:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1777051329.364047:0:48457:0:(import.c:65:import_set_state_nolock()) ffff99da42f4c800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000004:00100000:2.0:1777051329.364048:0:47208:0:(mdt_handler.c:7285:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:0.0:1777051329.364052:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1777051329.364063:0:48457:0:(import.c:509:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 7955 00000100:00080000:3.0:1777051329.364068:0:48457:0:(import.c:588:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1777051329.364076:0:48457:0:(import.c:623:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff99da42f4c800 using connection 192.168.201.146@tcp/0@lo 00000020:00000080:1.0:1777051329.364080:0:104208:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osp with refcount 2 00000100:00100000:3.0:1777051329.364101:0:48457:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d94e627100 x1863365452560768/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1777051329.364118:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051329.364159:0:27885:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452560256 00000100:00100000:0.0:1777051329.364169:0:27885:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452560256 00000100:00100000:1.0:1777051329.364180:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94e624a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3678:1863365452560896:0@lo:400:kworker.0 00000100:00080000:2.0:1777051329.364512:0:47208:0:(import.c:65:import_set_state_nolock()) ffff99d9410cc800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1777051329.364582:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051329.364601:0:27885:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452560512 00000100:00100000:3.0:1777051329.364601:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94e624380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452561024:0@lo:400:kworker.0 00000100:00100000:0.0:1777051329.364611:0:27885:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452560512 00000100:00100000:2.0:1777051329.364644:0:47208:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5fbee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+6:3676:x1863365452560128:12345-0@lo:38:llog_process_th.0 Request processed in 1112us (1572us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051329.364659:0:47208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8039 00000100:00100000:3.0:1777051329.364677:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051329.364684:0:27885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13211 00000100:00100000:1.0:1777051329.364700:0:46497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13212 00000100:00100000:0.0:1777051329.364703:0:27885:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95612ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000-lwp-OST0000_UUID+5:3680:x1863365452560256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777051329.364991:0:46497:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d9600bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:lustre-MDT0000-lwp-OST0001_UUID+5:3678:x1863365452560512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777051329.365001:0:3676:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94e625f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3676:1863365452560384:0@lo:38:kworker.0 00000100:00100000:3.0:1777051329.365011:0:3679:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1777051329.365029:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94e626680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3679:1863365452561152:0@lo:400:kworker.0 00000100:00100000:0.0:1777051329.365045:0:27885:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95612ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000-lwp-OST0000_UUID+5:3680:x1863365452560256:12345-0@lo:400:kworker.0 Request processed in 346us (999us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051329.365059:0:27885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13211 00000100:00100000:2.0:1777051329.365082:0:3676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051329.365104:0:46497:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d9600bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:lustre-MDT0000-lwp-OST0001_UUID+5:3678:x1863365452560512:12345-0@lo:400:kworker.0 Request processed in 387us (988us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051329.365119:0:27885:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452560384 00000100:00100000:1.0:1777051329.365121:0:46497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13212 00000100:00100000:3.0:1777051329.365126:0:27887:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452560896 00000100:00100000:0.0:1777051329.365129:0:27885:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452560384 00000100:00100000:3.0:1777051329.365136:0:27887:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452560896 00000100:00100000:2.0:1777051329.365156:0:3676:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94e627480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3676:1863365452560640:0@lo:38:kworker.0 00000100:00100000:1.0:1777051329.365166:0:46497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111767 00000100:00100000:1.0:1777051329.365178:0:46497:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5fbedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:0+-99:3676:x1863365452560384:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1777051329.365259:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94e625180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3680:1863365452560256:0@lo:400:kworker.0 00000100:00100000:3.0:1777051329.365261:0:27887:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452561024 00000100:00100000:3.0:1777051329.365272:0:27887:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452561024 00000100:00100000:2.0:1777051329.365284:0:3676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051329.365293:0:46497:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5fbedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:0+-99:3676:x1863365452560384:12345-0@lo:38:kworker.0 Request processed in 111us (210us total) trans 0 rc -11/-11 00000100:00100000:1.0:1777051329.365308:0:46497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111767 00000100:00080000:0.0:1777051329.365322:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1777051329.365335:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1777051329.365338:0:3676:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94e627100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3676:1863365452560768:0@lo:38:kworker.0 00000100:00080000:0.0:1777051329.365343:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1777051329.365343:0:46497:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452560640 00000100:00100000:3.0:1777051329.365346:0:27887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10284 00000100:00100000:1.0:1777051329.365353:0:46497:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452560640 00000100:00100000:3.0:1777051329.365374:0:27887:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d9600b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3678:x1863365452560896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777051329.365416:0:46497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111768 00000100:00100000:2.0:1777051329.365418:0:3676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051329.365433:0:46497:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5fbed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:0+-99:3676:x1863365452560640:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1777051329.365463:0:27887:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d9600b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3678:x1863365452560896:12345-0@lo:400:kworker.0 Request processed in 98us (883us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051329.365477:0:27887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10284 00000100:00100000:2.0:1777051329.365482:0:3676:0:(client.c:3101:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1777051329.365492:0:3676:0:(import.c:1130:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 7 00000100:00080000:2.0:1777051329.365502:0:3676:0:(import.c:958:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1777051329.365509:0:3676:0:(import.c:1211:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1777051329.365516:0:3676:0:(import.c:65:import_set_state_nolock()) ffff99da5f3d6000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1777051329.365518:0:46497:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5fbed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:0+-99:3676:x1863365452560640:12345-0@lo:38:kworker.0 Request processed in 79us (233us total) trans 0 rc -11/-11 00000100:00100000:3.0:1777051329.365518:0:27887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10285 00000100:00100000:2.0:1777051329.365536:0:3676:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d9600ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3676:1863365452560128:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1777051329.365568:0:46497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111768 00000100:00100000:3.0:1777051329.365571:0:27887:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94e625880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3679:x1863365452561024:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1777051329.365632:0:3676:0:(import.c:65:import_set_state_nolock()) ffff99d941838000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1777051329.365644:0:3676:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1777051329.365652:0:3676:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94e625f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3676:1863365452560384:0@lo:38:kworker.0 00000100:00100000:1.0:1777051329.365668:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94e624a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3678:1863365452560896:0@lo:400:kworker.0 00000100:00100000:3.0:1777051329.365673:0:27887:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94e625880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3679:x1863365452561024:12345-0@lo:400:kworker.0 Request processed in 133us (997us total) trans 0 rc 0/0 00000100:00080000:2.0:1777051329.365686:0:3676:0:(import.c:65:import_set_state_nolock()) ffff99d942a20000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:3.0:1777051329.365687:0:27887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10285 00000100:00080000:2.0:1777051329.365700:0:3676:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1777051329.365708:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94e624700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3678:1863365452560512:0@lo:400:kworker.0 00000100:00100000:2.0:1777051329.365713:0:3676:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94e627480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3676:1863365452560640:0@lo:38:kworker.0 00000020:00000080:1.0:1777051329.365771:0:104208:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000100:00100000:1.0:1777051329.365800:0:3678:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1777051329.365818:0:6584:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452560768 00000100:00100000:1.0:1777051329.365819:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94e624a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452561280:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1777051329.365828:0:6584:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452560768 00000100:00100000:3.0:1777051329.365843:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051329.365886:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8040 00000100:00100000:2.0:1777051329.365900:0:6584:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5fbee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3676:x1863365452560768:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1777051329.365902:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051329.365922:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94e624380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452561024:0@lo:400:kworker.0 00000100:00100000:1.0:1777051329.365991:0:6581:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452561152 00000100:00100000:1.0:1777051329.366000:0:6581:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452561152 00000100:00100000:2.0:1777051329.366002:0:6584:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5fbee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3676:x1863365452560768:12345-0@lo:38:kworker.0 Request processed in 100us (586us total) trans 0 rc -11/-11 00000100:00100000:3.0:1777051329.366016:0:46500:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452561280 00000100:00100000:2.0:1777051329.366020:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8040 00000100:00100000:3.0:1777051329.366027:0:46500:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452561280 00000100:00100000:1.0:1777051329.366076:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13213 00000100:00080000:2.0:1777051329.366089:0:3676:0:(import.c:65:import_set_state_nolock()) ffff99da42f4c800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:1.0:1777051329.366096:0:6581:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94e625180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3679:x1863365452561152:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1777051329.366101:0:3676:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1777051329.366114:0:3676:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94e627100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3676:1863365452560768:0@lo:38:kworker.0 00000100:00100000:3.0:1777051329.366123:0:46500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8041 00000100:00100000:3.0:1777051329.366143:0:46500:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d9600b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+6:3678:x1863365452561280:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1777051329.366182:0:46500:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4194304 pending 0 free 1441603584 avail 1295364096 00000100:00100000:1.0:1777051329.366242:0:6581:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94e625180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3679:x1863365452561152:12345-0@lo:400:kworker.0 Request processed in 109us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051329.366257:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13213 00000004:00080000:1.0:1777051329.366399:0:104208:0:(osp_dev.c:1199:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:1.0:1777051329.366407:0:104208:0:(osd_handler.c:8912:osd_obd_connect()) connect #4 00000020:00000080:1.0:1777051329.366418:0:104208:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x85f51a6b96715017 00000100:00100000:3.0:1777051329.366500:0:46500:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d9600b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+6:3678:x1863365452561280:12345-0@lo:41:osp-pre-0-1.0 Request processed in 360us (600us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051329.366521:0:46500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8041 00000100:00100000:1.0:1777051329.366531:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94e624a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452561280:0@lo:41:osp-pre-0-1.0 00010000:00080000:1.0:1777051329.366594:0:104208:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99da48d37000@lustre-OST0000-osc-MDT0001: add connection 192.168.201.146@tcp at head 00010000:00010000:1.0:1777051329.367572:0:104208:0:(ldlm_pool.c:924:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-10 is initialized 00000100:00100000:2.0:1777051329.367828:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94e626680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3679:1863365452561152:0@lo:400:kworker.0 00000040:01000000:1.0:1777051329.371158:0:104208:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1777051329.372406:0:104208:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:1.0:1777051329.378143:0:104208:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1777051329.378506:0:104208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:1.0:1777051329.379001:0:104208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 64 off8256 00000040:00080000:1.0:1777051329.379509:0:104213:0:(llog.c:801:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1777051329.379517:0:104213:0:(llog_cat.c:158:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1777051329.380804:0:104208:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1777051329.380820:0:104208:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1777051329.380870:0:104208:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1777051329.380896:0:104208:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x85f51a6b9671501e 00000100:00080000:1.0:1777051329.380908:0:104208:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1777051329.380915:0:104208:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff99da48d37000 using connection 192.168.201.146@tcp/0@lo 00000100:00100000:1.0:1777051329.380955:0:104208:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d9600b9f80 x1863365452561408/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1777051329.380996:0:104208:0:(pinger.c:371:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:2.0:1777051329.381066:0:3676:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d9600b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3676:1863365452561408:0@lo:8:llog_process_th.0 00000020:01000000:1.0:1777051329.381081:0:104208:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1777051329.381089:0:104208:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1777051329.381355:0:104208:0:(obd_config.c:1561:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1777051329.381365:0:104208:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1777051329.381370:0:104208:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #25 00000020:01000000:1.0:1777051329.381373:0:104208:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1777051329.381376:0:104208:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1777051329.381379:0:104208:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1777051329.381383:0:104208:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1777051329.381387:0:104208:0:(obd_config.c:1561:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:1.0:1777051329.381392:0:104208:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1777051329.381399:0:104208:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:1.0:1777051329.381404:0:104208:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1777051329.381407:0:104208:0:(obd_config.c:1561:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1777051329.381413:0:104208:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1777051329.381419:0:104208:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.201.146@tcp to nid 0x20000c0a8c992 (192.168.201.146@tcp) 00000100:00100000:2.0:1777051329.381425:0:3676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:1.0:1777051329.381443:0:104208:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:1.0:1777051329.381448:0:104208:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1777051329.381464:0:104208:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff99da7ffc99c0) 00000020:00000080:1.0:1777051329.381491:0:104208:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:1.0:1777051329.381501:0:104208:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000100:00100000:3.0:1777051329.381504:0:8470:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452561408 00000100:00100000:3.0:1777051329.381514:0:8470:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452561408 00000100:00100000:3.0:1777051329.381585:0:8470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7956 00000100:00100000:3.0:1777051329.381595:0:8470:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5fbec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3676:x1863365452561408:12345-0@lo:8:llog_process_th.0 00010000:00080000:3.0:1777051329.381630:0:8470:0:(ldlm_lib.c:1431:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 7958 last 0 00000004:00080000:1.0:1777051329.381632:0:104208:0:(osp_dev.c:1199:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:1.0:1777051329.381646:0:104208:0:(osd_handler.c:8912:osd_obd_connect()) connect #5 00000020:00000080:1.0:1777051329.381660:0:104208:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x85f51a6b96715033 00000020:00000080:3.0:1777051329.381677:0:8470:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x85f51a6b9671502c 00002000:00100000:3.0:1777051329.381699:0:8470:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff99d941e61800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113436 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:3.0:1777051329.381707:0:8470:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00010000:00080000:1.0:1777051329.381710:0:104208:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99da57aea800@lustre-OST0001-osc-MDT0001: add connection 192.168.201.146@tcp at head 00002000:00100000:3.0:1777051329.381712:0:8470:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1777051329.382095:0:8470:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:3.0:1777051329.382135:0:8470:0:(import.c:65:import_set_state_nolock()) ffff99d94405c000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1777051329.382281:0:8470:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5fbec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3676:x1863365452561408:12345-0@lo:8:llog_process_th.0 Request processed in 680us (850us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051329.382297:0:8470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7956 00000100:00100000:0.0:1777051329.382331:0:3676:0:(client.c:3101:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1777051329.382345:0:3676:0:(import.c:1130:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 1 00000100:00080000:0.0:1777051329.382356:0:3676:0:(import.c:958:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1777051329.382366:0:3676:0:(import.c:1211:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1777051329.382372:0:3676:0:(import.c:65:import_set_state_nolock()) ffff99da48d37000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00010000:00010000:1.0:1777051329.382400:0:104208:0:(ldlm_pool.c:924:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-11 is initialized 00000004:00080000:0.0:1777051329.382401:0:3676:0:(osp_dev.c:1643:osp_import_event()) got connected 00000100:00100000:0.0:1777051329.382414:0:3676:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d9600b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3676:1863365452561408:0@lo:8:llog_process_th.0 00000100:00100000:2.0:1777051329.382488:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5fbed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452561536:0@lo:13:osp-pre-0-1.0 00000004:00080000:0.0:1777051329.382494:0:104213:0:(osp_sync.c:1044:osp_sync_process_record()) processed all old entries 00000040:01000000:1.0:1777051329.382516:0:104208:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1777051329.382535:0:104208:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000100:00100000:2.0:1777051329.382571:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1777051329.382609:0:104213:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 7958575409923ns, next at 0ns, rc = 0 00080000:00080000:0.0:1777051329.382625:0:104213:0:(osd_handler.c:2852:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:2.0:1777051329.382642:0:10113:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452561536 00000100:00100000:2.0:1777051329.382650:0:10113:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452561536 00000100:00100000:2.0:1777051329.382999:0:10113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5578 00000100:00100000:2.0:1777051329.383016:0:10113:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5fbef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3678:x1863365452561536:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1777051329.383046:0:10113:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 440353216 pending 0 free 3862671360 avail 3631149056 00000100:00080000:0.0:1777051329.383072:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1777051329.383460:0:10113:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5fbef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3678:x1863365452561536:12345-0@lo:13:osp-pre-0-1.0 Request processed in 445us (911us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051329.383476:0:10113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5578 00000100:00100000:1.0:1777051329.383602:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5fbed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452561536:0@lo:13:osp-pre-0-1.0 00000040:00080000:2.0:1777051329.387380:0:104208:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:1.0:1777051329.387782:0:104205:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000040:00080000:2.0:1777051329.387978:0:104208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:2.0:1777051329.388581:0:104208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].1, 64 off8256 00000040:00080000:2.0:1777051329.389173:0:104215:0:(llog.c:801:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1777051329.389181:0:104215:0:(llog_cat.c:158:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1777051329.390582:0:104208:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1777051329.390598:0:104208:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1777051329.390649:0:104208:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1777051329.391165:0:104208:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x85f51a6b9671503a 00000100:00080000:1.0:1777051329.391177:0:104208:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1777051329.391184:0:104208:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff99da57aea800 using connection 192.168.201.146@tcp/0@lo 00000100:00100000:1.0:1777051329.391221:0:104208:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d9600b8700 x1863365452561664/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1777051329.391261:0:104208:0:(pinger.c:371:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:0.0:1777051329.391303:0:3676:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d9600b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3676:1863365452561664:0@lo:8:llog_process_th.0 00000020:01000000:1.0:1777051329.391371:0:104208:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1777051329.391381:0:104208:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1777051329.391386:0:104208:0:(obd_config.c:1561:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000100:00100000:0.0:1777051329.391398:0:3676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:1.0:1777051329.391399:0:104208:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1777051329.391409:0:104208:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1777051329.391412:0:104208:0:(obd_config.c:1561:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:1.0:1777051329.391419:0:104208:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1777051329.391422:0:104208:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1777051329.391427:0:104208:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1777051329.391431:0:104208:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1777051329.391435:0:104208:0:(obd_config.c:1561:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:1.0:1777051329.391441:0:104208:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1777051329.391448:0:104208:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1777051329.391450:0:104208:0:(obd_config.c:1561:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1777051329.391459:0:104208:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1777051329.391469:0:104208:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1777051329.391474:0:104208:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1777051329.391478:0:104208:0:(obd_config.c:1561:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000100:00100000:2.0:1777051329.391483:0:13320:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452561664 00000020:01000000:1.0:1777051329.391484:0:104208:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1777051329.391494:0:104208:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #45 00000100:00100000:2.0:1777051329.391497:0:13320:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452561664 00000020:01000000:1.0:1777051329.391498:0:104208:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1777051329.391504:0:104208:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1777051329.391528:0:104208:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1777051329.391535:0:104208:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1777051329.391564:0:104208:0:(obd_config.c:1561:class_process_config()) marker 45 (0x6) lustre-MDT0001-m new lustre.test_11c 00000020:01000000:1.0:1777051329.391572:0:104208:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1777051329.391578:0:104208:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #48 00000020:01000000:1.0:1777051329.391581:0:104208:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1777051329.391586:0:104208:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000100:00100000:2.0:1777051329.391588:0:13320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7957 00000020:01000000:1.0:1777051329.391592:0:104208:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1777051329.391600:0:104208:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000100:00100000:2.0:1777051329.391604:0:13320:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d956128700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3676:x1863365452561664:12345-0@lo:8:llog_process_th.0 00000020:00000080:1.0:1777051329.391606:0:104208:0:(obd_config.c:1561:class_process_config()) marker 48 (0x6) lustre-MDT0001-m add lustre.test_11c.lustre-OST0001_UUID 00000020:01000000:1.0:1777051329.391616:0:104208:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1777051329.391623:0:104208:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1777051329.391627:0:104208:0:(obd_config.c:1561:class_process_config()) marker 51 (0x1) lustre-MDT0001-m rem lustre.test_11c.lustre-OST0001_UUID 00000020:00000080:1.0:1777051329.391639:0:104208:0:(obd_config.c:1470:class_process_config()) processing cmd: ce022 00010000:00080000:2.0:1777051329.391668:0:13320:0:(ldlm_lib.c:1431:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 7958 last 0 00000020:00000080:2.0:1777051329.391701:0:13320:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x85f51a6b96715041 00002000:00100000:2.0:1777051329.391718:0:13320:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff99da5f280000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113436 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:2.0:1777051329.391725:0:13320:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:2.0:1777051329.391729:0:13320:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1777051329.391799:0:13320:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:2.0:1777051329.391828:0:13320:0:(import.c:65:import_set_state_nolock()) ffff99da48b2c000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1777051329.391906:0:13320:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d956128700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:3676:x1863365452561664:12345-0@lo:8:llog_process_th.0 Request processed in 303us (515us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051329.391921:0:13320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7957 00000020:01000000:1.0:1777051329.391931:0:104208:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1777051329.391940:0:104208:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1777051329.391943:0:104208:0:(obd_config.c:1561:class_process_config()) marker 51 (0x2) lustre-MDT0001-m rem lustre.test_11c.lustre-OST0001_UUID 00000020:01000000:1.0:1777051329.391949:0:104208:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1777051329.391954:0:104208:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1777051329.391957:0:104208:0:(obd_config.c:1561:class_process_config()) marker 54 (0x1) lustre-MDT0001-m del lustre.test_11c 00000020:00000080:1.0:1777051329.391962:0:104208:0:(obd_config.c:1470:class_process_config()) processing cmd: ce023 00000100:00100000:0.0:1777051329.391974:0:3676:0:(client.c:3101:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000020:01000000:1.0:1777051329.391984:0:104208:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000100:00080000:0.0:1777051329.391988:0:3676:0:(import.c:1130:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 1 00000020:00000080:1.0:1777051329.391992:0:104208:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1777051329.391997:0:104208:0:(obd_config.c:1561:class_process_config()) marker 54 (0x2) lustre-MDT0001-m del lustre.test_11c 00000100:00080000:0.0:1777051329.392001:0:3676:0:(import.c:958:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000040:00080000:1.0:1777051329.392003:0:104208:0:(llog.c:858:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 59 count 58 00000100:00080000:0.0:1777051329.392013:0:3676:0:(import.c:1211:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1777051329.392019:0:3676:0:(import.c:65:import_set_state_nolock()) ffff99da57aea800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1777051329.392068:0:3676:0:(osp_dev.c:1643:osp_import_event()) got connected 00000100:00100000:0.0:1777051329.392079:0:3676:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d9600b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3676:1863365452561664:0@lo:8:llog_process_th.0 00000020:01000000:2.0:1777051329.392108:0:104204:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-58 (rc=0) 00000004:00080000:3.0:1777051329.392136:0:104215:0:(osp_sync.c:1044:osp_sync_process_record()) processed all old entries 10000000:01000000:2.0:1777051329.392169:0:104204:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.201.146@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1777051329.392203:0:104204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff99d954ea6600/0x85f51a6b96714fa0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b96714fa7 expref: -99 pid: 104204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051329.392225:0:104204:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.146@tcp lock: ffff99d954ea6600/0x85f51a6b96714fa0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b96714fa7 expref: -99 pid: 104204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1777051329.392240:0:104204:0:(mgc_request.c:1799:mgc_process_log()) Process log lustre-mdtir-ffff99da7dbcc000 from 1 10000000:01000000:2.0:1777051329.392247:0:104204:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00000004:00080000:3.0:1777051329.392278:0:104215:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 7958585078356ns, next at 0ns, rc = 0 00080000:00080000:3.0:1777051329.392294:0:104215:0:(osd_handler.c:2852:osd_commit_async()) lustre-MDT0001: async commit OSD 00010000:00010000:2.0:1777051329.392352:0:104204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.146@tcp lock: ffff99d95071b200/0x85f51a6b96715048 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 104204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051329.392368:0:104204:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.146@tcp lock: ffff99d95071b200/0x85f51a6b96715048 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 104204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051329.392388:0:104204:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.146@tcp lock: ffff99d95071b200/0x85f51a6b96715048 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 104204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051329.392420:0:104204:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5fbeca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9351a01-5b0e-4470-97fd-58b9b4b312a2:104204:1863365452561792:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1777051329.392454:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94e624380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452561920:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1777051329.392485:0:104204:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051329.392535:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051329.392567:0:104204:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d955a45240 going to sleep for 11 seconds 00000100:00100000:3.0:1777051329.392619:0:103168:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452561792 00000100:00100000:3.0:1777051329.392628:0:103168:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452561792 00000100:00100000:3.0:1777051329.392699:0:103168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1777051329.392705:0:47388:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452561920 00000100:00100000:0.0:1777051329.392718:0:47388:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452561920 00000100:00100000:3.0:1777051329.392718:0:103168:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7c979450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f9351a01-5b0e-4470-97fd-58b9b4b312a2+20:104204:x1863365452561792:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1777051329.393066:0:103168:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:2.0:1777051329.393075:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1777051329.393091:0:103168:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d94ffbda00/0x85f51a6b9671504f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x85f51a6b96715048 expref: -99 pid: 103168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051329.393110:0:47388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5579 00000100:00100000:0.0:1777051329.393127:0:47388:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d956128a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3679:x1863365452561920:12345-0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1777051329.393138:0:103168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d94ffbda00/0x85f51a6b9671504f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x85f51a6b96715048 expref: 21 pid: 103168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00000024:0.0:1777051329.393163:0:47388:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 430293440 pending 0 free 3645853696 avail 3414331392 00010000:00010000:3.0:1777051329.393163:0:103168:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d94ffbda00/0x85f51a6b9671504f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b96715048 expref: 21 pid: 103168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051329.393184:0:103168:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d94ffbda00, rc 0) 00000100:00100000:0.0:1777051329.393247:0:47388:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d956128a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3679:x1863365452561920:12345-0@lo:13:osp-pre-1-1.0 Request processed in 122us (715us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051329.393262:0:47388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5579 00000100:00100000:3.0:1777051329.393316:0:103168:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7c979450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f9351a01-5b0e-4470-97fd-58b9b4b312a2+21:104204:x1863365452561792:12345-0@lo:101:mount.lustre.0 Request processed in 602us (830us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051329.393331:0:103168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1777051329.393357:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94e624380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452561920:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1777051329.393421:0:104204:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5fbeca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9351a01-5b0e-4470-97fd-58b9b4b312a2:104204:1863365452561792:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1777051329.393442:0:104204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.146@tcp lock: ffff99d95071b200/0x85f51a6b96715048 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b9671504f expref: -99 pid: 104204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051329.393457:0:104204:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.146@tcp lock: ffff99d95071b200/0x85f51a6b96715048 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x85f51a6b9671504f expref: -99 pid: 104204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051329.395695:0:104204:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5fbeca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9351a01-5b0e-4470-97fd-58b9b4b312a2:104204:1863365452562048:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1777051329.395747:0:104204:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051329.396086:0:104204:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d955a45240 going to sleep for 11 seconds 00000100:00100000:0.0:1777051329.396118:0:103165:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452562048 00000100:00100000:0.0:1777051329.396153:0:103165:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452562048 00000100:00100000:0.0:1777051329.396224:0:103165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1777051329.396237:0:103165:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7c97b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9351a01-5b0e-4470-97fd-58b9b4b312a2+21:104204:x1863365452562048:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1777051329.396260:0:103165:0:(mgs_nids.c:912:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1777051329.396287:0:103165:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1777051329.396293:0:103165:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1777051329.396298:0:103165:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1777051329.396303:0:103165:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1777051329.396308:0:103165:0:(mgs_nids.c:316:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 30 00000100:00100000:0.0:1777051329.396468:0:103165:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7c97b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9351a01-5b0e-4470-97fd-58b9b4b312a2+21:104204:x1863365452562048:12345-0@lo:256:mount.lustre.0 Request processed in 229us (715us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051329.396483:0:104204:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5fbeca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9351a01-5b0e-4470-97fd-58b9b4b312a2:104204:1863365452562048:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1777051329.396484:0:103165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000004:00080000:1.0:1777051329.397619:0:104205:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 10000000:01000000:2.0:1777051329.398081:0:104204:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.201.146@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1777051329.398177:0:104204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff99d95071b200/0x85f51a6b96715048 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b9671504f expref: -99 pid: 104204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051329.398189:0:104204:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.146@tcp lock: ffff99d95071b200/0x85f51a6b96715048 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b9671504f expref: -99 pid: 104204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1777051329.398198:0:104204:0:(mgc_request.c:1799:mgc_process_log()) Process log params-ffff99da7dbcc000 from 1 10000000:01000000:2.0:1777051329.398201:0:104204:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1777051329.398225:0:104204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.146@tcp lock: ffff99d95071ac00/0x85f51a6b96715056 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 104204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051329.398238:0:104204:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.146@tcp lock: ffff99d95071ac00/0x85f51a6b96715056 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 104204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051329.398297:0:104204:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.146@tcp lock: ffff99d95071ac00/0x85f51a6b96715056 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 104204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051329.398323:0:104204:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5fbeca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9351a01-5b0e-4470-97fd-58b9b4b312a2:104204:1863365452562176:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1777051329.398374:0:104204:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051329.398418:0:104204:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d955a45240 going to sleep for 11 seconds 00000100:00100000:1.0:1777051329.398448:0:103163:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452562176 00000100:00100000:1.0:1777051329.398456:0:103163:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452562176 00000100:00100000:1.0:1777051329.398503:0:103163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1777051329.398512:0:103163:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7c979850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9351a01-5b0e-4470-97fd-58b9b4b312a2+21:104204:x1863365452562176:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1777051329.398523:0:103163:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777051329.398536:0:103163:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d953299400/0x85f51a6b9671505d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x85f51a6b96715056 expref: -99 pid: 103163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051329.398596:0:103163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d953299400/0x85f51a6b9671505d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x85f51a6b96715056 expref: 22 pid: 103163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051329.398614:0:103163:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d953299400/0x85f51a6b9671505d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b96715056 expref: 22 pid: 103163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051329.398623:0:103163:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d953299400, rc 0) 00000100:00100000:1.0:1777051329.398669:0:103163:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7c979850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9351a01-5b0e-4470-97fd-58b9b4b312a2+22:104204:x1863365452562176:12345-0@lo:101:mount.lustre.0 Request processed in 157us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051329.398683:0:103163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1777051329.398706:0:104204:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5fbeca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9351a01-5b0e-4470-97fd-58b9b4b312a2:104204:1863365452562176:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1777051329.398726:0:104204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.146@tcp lock: ffff99d95071ac00/0x85f51a6b96715056 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b9671505d expref: -99 pid: 104204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051329.398736:0:104204:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.146@tcp lock: ffff99d95071ac00/0x85f51a6b96715056 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x85f51a6b9671505d expref: -99 pid: 104204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1777051329.398874:0:104204:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1777051329.398938:0:104204:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5fbeca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9351a01-5b0e-4470-97fd-58b9b4b312a2:104204:1863365452562304:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1777051329.398991:0:104204:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051329.399019:0:104204:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d955a45000 going to sleep for 11 seconds 00000100:00100000:3.0:1777051329.399101:0:103168:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452562304 00000100:00100000:3.0:1777051329.399110:0:103168:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452562304 00000100:00100000:3.0:1777051329.399459:0:103168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1777051329.399472:0:103168:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7c97a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f9351a01-5b0e-4470-97fd-58b9b4b312a2+22:104204:x1863365452562304:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1777051329.399649:0:103168:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7c97a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f9351a01-5b0e-4470-97fd-58b9b4b312a2+22:104204:x1863365452562304:12345-0@lo:501:mount.lustre.0 Request processed in 177us (656us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051329.399660:0:103168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1777051329.399729:0:104204:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5fbeca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9351a01-5b0e-4470-97fd-58b9b4b312a2:104204:1863365452562304:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1777051329.399786:0:104204:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5fbeca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9351a01-5b0e-4470-97fd-58b9b4b312a2:104204:1863365452562432:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1777051329.399837:0:104204:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051329.399868:0:104204:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d955a45000 going to sleep for 11 seconds 00000100:00100000:3.0:1777051329.399916:0:103166:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452562432 00000100:00100000:3.0:1777051329.399924:0:103166:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452562432 00000100:00100000:3.0:1777051329.399970:0:103166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1777051329.399981:0:103166:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7c97bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9351a01-5b0e-4470-97fd-58b9b4b312a2+22:104204:x1863365452562432:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1777051329.400118:0:103166:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7c97bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9351a01-5b0e-4470-97fd-58b9b4b312a2+22:104204:x1863365452562432:12345-0@lo:503:mount.lustre.0 Request processed in 137us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051329.400127:0:103166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1777051329.400161:0:104204:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5fbeca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9351a01-5b0e-4470-97fd-58b9b4b312a2:104204:1863365452562432:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1777051329.400662:0:104204:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1777051329.400744:0:104204:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5fbeca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9351a01-5b0e-4470-97fd-58b9b4b312a2:104204:1863365452562560:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1777051329.400799:0:104204:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051329.400842:0:104204:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d955a45240 going to sleep for 11 seconds 00000100:00100000:1.0:1777051329.400877:0:103163:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452562560 00000100:00100000:1.0:1777051329.400886:0:103163:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452562560 00000100:00100000:1.0:1777051329.400960:0:103163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1777051329.400972:0:103163:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94ba5c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9351a01-5b0e-4470-97fd-58b9b4b312a2+22:104204:x1863365452562560:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1777051329.401154:0:103163:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94ba5c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9351a01-5b0e-4470-97fd-58b9b4b312a2+22:104204:x1863365452562560:12345-0@lo:502:mount.lustre.0 Request processed in 182us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051329.401166:0:103163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1777051329.401205:0:104204:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5fbeca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9351a01-5b0e-4470-97fd-58b9b4b312a2:104204:1863365452562560:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1777051329.401455:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1777051329.401572:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 112 off8528 00000040:00080000:2.0:1777051329.401596:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 224 off8752 00000040:00080000:2.0:1777051329.401609:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8976 00000040:00080000:2.0:1777051329.401632:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 112 off9088 00000040:00080000:2.0:1777051329.401644:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 224 off9312 00000040:00080000:2.0:1777051329.401662:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9536 00000040:00080000:2.0:1777051329.401684:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 128 off9664 00000040:00080000:2.0:1777051329.401704:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1777051329.401722:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off10112 00000040:00080000:2.0:1777051329.401743:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 128 off10240 00000040:00080000:2.0:1777051329.401765:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10464 00000040:00080000:2.0:1777051329.401788:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 224 off10688 00000040:00080000:2.0:1777051329.401808:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10816 00000040:00080000:2.0:1777051329.401829:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 224 off11040 00000040:00080000:2.0:1777051329.401850:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 224 off11264 00000040:00080000:2.0:1777051329.401869:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 128 off11392 00000040:00080000:2.0:1777051329.401891:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11616 00000040:00080000:2.0:1777051329.401912:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 224 off11840 00000040:00080000:2.0:1777051329.401932:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 128 off11968 00000040:00080000:2.0:1777051329.401951:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off12192 00000040:00080000:2.0:1777051329.401973:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 224 off12416 00000040:00080000:2.0:1777051329.401997:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12544 00000040:00080000:2.0:1777051329.402018:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 224 off12768 00000040:00080000:2.0:1777051329.402039:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 224 off12992 00000040:00080000:2.0:1777051329.402062:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 128 off13120 00000040:00080000:2.0:1777051329.402086:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off13344 00000040:00080000:2.0:1777051329.402110:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 224 off13568 00000040:00080000:2.0:1777051329.402130:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 128 off13696 00000040:00080000:2.0:1777051329.402150:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13920 00000040:00080000:2.0:1777051329.402182:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 224 off14144 00000040:00080000:2.0:1777051329.402237:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 136 off14280 00000040:00080000:2.0:1777051329.402268:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 224 off14504 00000040:00080000:2.0:1777051329.402291:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 224 off14728 00000040:00080000:2.0:1777051329.402314:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 136 off14864 00000040:00080000:2.0:1777051329.402332:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off15088 00000040:00080000:2.0:1777051329.402353:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 224 off15312 00000040:00080000:2.0:1777051329.402375:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 136 off15448 00000040:00080000:2.0:1777051329.402396:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off15672 00000040:00080000:2.0:1777051329.402418:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 224 off15896 00000040:00080000:2.0:1777051329.402438:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 136 off16032 00000100:00100000:2.0:1777051329.402475:0:104204:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5fbeca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9351a01-5b0e-4470-97fd-58b9b4b312a2:104204:1863365452562688:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1777051329.402594:0:104204:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051329.402651:0:104204:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d955a45240 going to sleep for 11 seconds 00000100:00100000:3.0:1777051329.402705:0:103168:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452562688 00000100:00100000:3.0:1777051329.402712:0:103168:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452562688 00000100:00100000:3.0:1777051329.402758:0:103168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1777051329.402769:0:103168:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94ba5c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f9351a01-5b0e-4470-97fd-58b9b4b312a2+22:104204:x1863365452562688:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1777051329.402887:0:103168:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94ba5c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f9351a01-5b0e-4470-97fd-58b9b4b312a2+22:104204:x1863365452562688:12345-0@lo:502:mount.lustre.0 Request processed in 117us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051329.402898:0:103168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1777051329.402906:0:104204:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5fbeca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9351a01-5b0e-4470-97fd-58b9b4b312a2:104204:1863365452562688:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1777051329.402963:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 224 off16256 00000040:00080000:2.0:1777051329.402975:0:104204:0:(llog.c:858:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 42 count 43 00000020:01000000:2.0:1777051329.403695:0:104217:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1777051329.403708:0:104217:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1777051329.403712:0:104217:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1777051329.403722:0:104217:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff99da7dbcc000 00000020:00000080:2.0:1777051329.403726:0:104217:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1777051329.403736:0:104217:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1777051329.403742:0:104217:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1777051329.403744:0:104217:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1777051329.403747:0:104217:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1777051329.403751:0:104217:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1777051329.403753:0:104217:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1777051329.403758:0:104217:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff99da7dbcc000 00000020:00000080:2.0:1777051329.403762:0:104217:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1777051329.403839:0:104217:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1777051329.403845:0:104217:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1777051329.403848:0:104217:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1777051329.403852:0:104217:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1777051329.403855:0:104217:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #4 00000020:01000000:2.0:1777051329.403857:0:104217:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1777051329.403860:0:104217:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1777051329.403862:0:104217:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1777051329.403865:0:104217:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1777051329.403868:0:104217:0:(obd_config.c:1561:class_process_config()) marker 4 (0x6) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1777051329.403873:0:104217:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1777051329.403877:0:104217:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #5 00000020:01000000:2.0:1777051329.403880:0:104217:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1777051329.403883:0:104217:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1777051329.403887:0:104217:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1777051329.403892:0:104217:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1777051329.403894:0:104217:0:(obd_config.c:1561:class_process_config()) marker 5 (0x6) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1777051329.403900:0:104217:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1777051329.403903:0:104217:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #6 00000020:01000000:2.0:1777051329.403906:0:104217:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1777051329.403908:0:104217:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1777051329.403910:0:104217:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1777051329.403914:0:104217:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1777051329.403917:0:104217:0:(obd_config.c:1561:class_process_config()) marker 6 (0x6) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1777051329.403921:0:104217:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1777051329.403924:0:104217:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #7 00000020:01000000:2.0:1777051329.403926:0:104217:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1777051329.403928:0:104217:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1777051329.403931:0:104217:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1777051329.403935:0:104217:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1777051329.403937:0:104217:0:(obd_config.c:1561:class_process_config()) marker 7 (0x6) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1777051329.403941:0:104217:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1777051329.403944:0:104217:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #2 00000020:01000000:2.0:1777051329.403947:0:104217:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1777051329.403949:0:104217:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1777051329.403952:0:104217:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1777051329.403956:0:104217:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1777051329.403958:0:104217:0:(obd_config.c:1561:class_process_config()) marker 2 (0x6) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1777051329.403962:0:104217:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1777051329.403965:0:104217:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #3 00000020:01000000:2.0:1777051329.403968:0:104217:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1777051329.403970:0:104217:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1777051329.403973:0:104217:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1777051329.403977:0:104217:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1777051329.403979:0:104217:0:(obd_config.c:1561:class_process_config()) marker 3 (0x6) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1777051329.403984:0:104217:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1777051329.403989:0:104217:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1777051329.403991:0:104217:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1777051329.403999:0:104217:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff99da7dbcc000 00000020:00000080:2.0:1777051329.404002:0:104217:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1777051329.404364:0:104217:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1777051329.404371:0:104217:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1777051329.404373:0:104217:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1777051329.404379:0:104217:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1777051329.404383:0:104217:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1777051329.404386:0:104217:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1777051329.404392:0:104217:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff99da7dbcc000 00000020:00000080:2.0:1777051329.404396:0:104217:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1777051329.404428:0:104217:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1777051329.404433:0:104217:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1777051329.404435:0:104217:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1777051329.404440:0:104217:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1777051329.404444:0:104217:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #2 00000020:01000000:2.0:1777051329.404446:0:104217:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1777051329.404448:0:104217:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1777051329.404451:0:104217:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1777051329.404454:0:104217:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1777051329.404456:0:104217:0:(obd_config.c:1561:class_process_config()) marker 2 (0x6) lustre mdt.lustre-MDT0000.hsm.default_archive_id 00000020:01000000:2.0:1777051329.404460:0:104217:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1777051329.404463:0:104217:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #3 00000020:01000000:2.0:1777051329.404465:0:104217:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1777051329.404467:0:104217:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1777051329.404470:0:104217:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1777051329.404473:0:104217:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1777051329.404476:0:104217:0:(obd_config.c:1561:class_process_config()) marker 3 (0x6) lustre mdt.lustre-MDT0001.hsm.default_archive_id 00000020:01000000:2.0:1777051329.404480:0:104217:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1777051329.404484:0:104217:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1777051329.404487:0:104217:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre mdt.lustre-MDT0000.hsm.default_archive_id 00000020:01000000:2.0:1777051329.404492:0:104217:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff99da7dbcc000 00000020:00000080:2.0:1777051329.404496:0:104217:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1777051329.404526:0:104217:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1777051329.404531:0:104217:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1777051329.404533:0:104217:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre mdt.lustre-MDT0000.hsm.default_archive_id 00000020:01000000:2.0:1777051329.404566:0:104217:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1777051329.404573:0:104217:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1777051329.404575:0:104217:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre mdt.lustre-MDT0001.hsm.default_archive_id 00000020:01000000:2.0:1777051329.404581:0:104217:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff99da7dbcc000 00000020:00000080:2.0:1777051329.404585:0:104217:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1777051329.404627:0:104217:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1777051329.404631:0:104217:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1777051329.404634:0:104217:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre mdt.lustre-MDT0001.hsm.default_archive_id 00000040:00080000:2.0:1777051329.404638:0:104217:0:(llog.c:858:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 43 count 43 00000020:01000000:0.0:1777051329.405062:0:104204:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-42 (rc=0) 10000000:01000000:0.0:1777051329.405105:0:104204:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.201.146@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1777051329.405143:0:104204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff99d95071ac00/0x85f51a6b96715056 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b9671505d expref: -99 pid: 104204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051329.405162:0:104204:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.146@tcp lock: ffff99d95071ac00/0x85f51a6b96715056 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b9671505d expref: -99 pid: 104204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1777051329.405531:0:104204:0:(mgc_request.c:1941:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1777051329.405537:0:104204:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff99da7dbcc000 10000000:01000000:0.0:1777051329.405569:0:104204:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff99da7dbcc000 10000000:01000000:0.0:1777051329.405577:0:104204:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1777051329.405587:0:104204:0:(mgc_request.c:1799:mgc_process_log()) Process log lustre-client-ffff99da7dbcc000 from 1 10000000:01000000:0.0:1777051329.405591:0:104204:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1777051329.405628:0:104204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.146@tcp lock: ffff99d954ea6400/0x85f51a6b96715064 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 104204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051329.405642:0:104204:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.146@tcp lock: ffff99d954ea6400/0x85f51a6b96715064 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 104204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051329.405658:0:104204:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.146@tcp lock: ffff99d954ea6400/0x85f51a6b96715064 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 104204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051329.405692:0:104204:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95612b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9351a01-5b0e-4470-97fd-58b9b4b312a2:104204:1863365452562816:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1777051329.405747:0:104204:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051329.405795:0:104204:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da57b3a780 going to sleep for 11 seconds 00000100:00100000:1.0:1777051329.405832:0:103166:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452562816 00000100:00100000:1.0:1777051329.405840:0:103166:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452562816 00000100:00100000:1.0:1777051329.405888:0:103166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1777051329.405899:0:103166:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94ba5d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9351a01-5b0e-4470-97fd-58b9b4b312a2+22:104204:x1863365452562816:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1777051329.405910:0:103166:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777051329.405942:0:103166:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d953298a00/0x85f51a6b9671506b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x85f51a6b96715064 expref: -99 pid: 103166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051329.405978:0:103166:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d953298a00/0x85f51a6b9671506b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x85f51a6b96715064 expref: 23 pid: 103166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051329.405994:0:103166:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d953298a00/0x85f51a6b9671506b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b96715064 expref: 23 pid: 103166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051329.406016:0:103166:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d953298a00, rc 0) 00000100:00100000:1.0:1777051329.406352:0:103166:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94ba5d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9351a01-5b0e-4470-97fd-58b9b4b312a2+23:104204:x1863365452562816:12345-0@lo:101:mount.lustre.0 Request processed in 451us (601us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051329.406364:0:103166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1777051329.406475:0:104204:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95612b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9351a01-5b0e-4470-97fd-58b9b4b312a2:104204:1863365452562816:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1777051329.406498:0:104204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.146@tcp lock: ffff99d954ea6400/0x85f51a6b96715064 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b9671506b expref: -99 pid: 104204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051329.406512:0:104204:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.146@tcp lock: ffff99d954ea6400/0x85f51a6b96715064 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x85f51a6b9671506b expref: -99 pid: 104204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1777051329.409758:0:104204:0:(llog.c:858:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:2.0:1777051329.410161:0:104204:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1777051329.410473:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:2.0:1777051329.410509:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 120 off8536 00000040:00080000:2.0:1777051329.410572:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 168 off8704 00000040:00080000:2.0:1777051329.410623:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8928 00000040:00080000:2.0:1777051329.410663:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9152 00000040:00080000:2.0:1777051329.410721:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 120 off9272 00000040:00080000:2.0:1777051329.410765:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 168 off9440 00000040:00080000:2.0:1777051329.410811:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9664 00000040:00080000:2.0:1777051329.410858:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 224 off9888 00000040:00080000:2.0:1777051329.410908:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 120 off10008 00000040:00080000:2.0:1777051329.410954:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10232 00000040:00080000:2.0:1777051329.410992:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 224 off10456 00000040:00080000:2.0:1777051329.411037:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 88 off10544 00000040:00080000:2.0:1777051329.411072:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].14, 128 off10672 00000040:00080000:2.0:1777051329.411114:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].15, 144 off10816 00000040:00080000:2.0:1777051329.411164:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].16, 160 off10976 00000040:00080000:2.0:1777051329.411209:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].17, 224 off11200 00000040:00080000:2.0:1777051329.411301:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].18, 224 off11424 00000040:00080000:2.0:1777051329.411342:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].19, 80 off11504 00000040:00080000:2.0:1777051329.411383:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].20, 224 off11728 00000040:00080000:2.0:1777051329.411423:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].21, 224 off11952 00000040:00080000:2.0:1777051329.411454:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].22, 88 off12040 00000040:00080000:2.0:1777051329.411489:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].23, 128 off12168 00000040:00080000:2.0:1777051329.411536:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].24, 144 off12312 00000040:00080000:2.0:1777051329.411612:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].25, 160 off12472 00000040:00080000:2.0:1777051329.411652:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].26, 224 off12696 00000040:00080000:2.0:1777051329.411693:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].27, 224 off12920 00000040:00080000:2.0:1777051329.411728:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].28, 80 off13000 00000040:00080000:2.0:1777051329.411779:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].29, 224 off13224 00000040:00080000:2.0:1777051329.411793:0:104204:0:(llog.c:858:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:2.0:1777051329.411906:0:104204:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5fbeca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9351a01-5b0e-4470-97fd-58b9b4b312a2:104204:1863365452562944:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1777051329.411986:0:104204:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051329.412045:0:103163:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452562944 00000100:00100000:2.0:1777051329.412055:0:103163:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452562944 00000100:00100000:2.0:1777051329.412128:0:103163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1777051329.412145:0:103163:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94ba5d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9351a01-5b0e-4470-97fd-58b9b4b312a2+23:104204:x1863365452562944:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1777051329.412360:0:103163:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94ba5d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9351a01-5b0e-4470-97fd-58b9b4b312a2+23:104204:x1863365452562944:12345-0@lo:501:mount.lustre.0 Request processed in 217us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051329.412375:0:103163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1777051329.412454:0:104204:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d955a45000 going to sleep for 11 seconds 00000100:00100000:2.0:1777051329.412487:0:104204:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5fbeca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9351a01-5b0e-4470-97fd-58b9b4b312a2:104204:1863365452562944:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1777051329.412724:0:104204:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5fbeca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9351a01-5b0e-4470-97fd-58b9b4b312a2:104204:1863365452563072:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1777051329.412799:0:104204:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051329.412845:0:103168:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452563072 00000100:00100000:2.0:1777051329.412852:0:103168:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452563072 00000100:00100000:2.0:1777051329.412905:0:103168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1777051329.412919:0:103168:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94ba5ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f9351a01-5b0e-4470-97fd-58b9b4b312a2+23:104204:x1863365452563072:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1777051329.413047:0:103168:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94ba5ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f9351a01-5b0e-4470-97fd-58b9b4b312a2+23:104204:x1863365452563072:12345-0@lo:503:mount.lustre.0 Request processed in 130us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051329.413060:0:103168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1777051329.413421:0:104204:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d955a45000 going to sleep for 11 seconds 00000100:00100000:2.0:1777051329.413450:0:104204:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5fbeca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9351a01-5b0e-4470-97fd-58b9b4b312a2:104204:1863365452563072:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1777051329.414059:0:104204:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1777051329.414143:0:104204:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5fbeca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9351a01-5b0e-4470-97fd-58b9b4b312a2:104204:1863365452563200:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1777051329.414269:0:104204:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051329.414312:0:104204:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d955a45000 going to sleep for 11 seconds 00000100:00100000:1.0:1777051329.414319:0:103166:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452563200 00000100:00100000:1.0:1777051329.414330:0:103166:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452563200 00000100:00100000:1.0:1777051329.414394:0:103166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1777051329.414409:0:103166:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94ba5f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9351a01-5b0e-4470-97fd-58b9b4b312a2+23:104204:x1863365452563200:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1777051329.414613:0:103166:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94ba5f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9351a01-5b0e-4470-97fd-58b9b4b312a2+23:104204:x1863365452563200:12345-0@lo:502:mount.lustre.0 Request processed in 206us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051329.414628:0:103166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1777051329.414697:0:104204:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5fbeca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9351a01-5b0e-4470-97fd-58b9b4b312a2:104204:1863365452563200:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1777051329.415068:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:2.0:1777051329.415128:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 120 off8536 00000040:00080000:2.0:1777051329.415176:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 168 off8704 00000040:00080000:2.0:1777051329.415204:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8928 00000040:00080000:2.0:1777051329.415224:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9152 00000040:00080000:2.0:1777051329.415248:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 120 off9272 00000040:00080000:2.0:1777051329.415280:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 168 off9440 00000040:00080000:2.0:1777051329.415309:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9664 00000040:00080000:2.0:1777051329.415341:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 224 off9888 00000040:00080000:2.0:1777051329.415386:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 120 off10008 00000040:00080000:2.0:1777051329.415446:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10232 00000040:00080000:2.0:1777051329.415478:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 224 off10456 00000040:00080000:2.0:1777051329.415499:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 88 off10544 00000040:00080000:2.0:1777051329.415523:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].14, 128 off10672 00000040:00080000:2.0:1777051329.415579:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].15, 144 off10816 00000040:00080000:2.0:1777051329.415620:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].16, 160 off10976 00000040:00080000:2.0:1777051329.415664:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].17, 224 off11200 00000040:00080000:2.0:1777051329.415978:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].18, 224 off11424 00000040:00080000:2.0:1777051329.416024:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].19, 80 off11504 00000040:00080000:2.0:1777051329.416055:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].20, 224 off11728 00000040:00080000:2.0:1777051329.416086:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].21, 224 off11952 00000040:00080000:2.0:1777051329.416118:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].22, 88 off12040 00000040:00080000:2.0:1777051329.416150:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].23, 128 off12168 00000040:00080000:2.0:1777051329.416233:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].24, 144 off12312 00000040:00080000:2.0:1777051329.416275:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].25, 160 off12472 00000040:00080000:2.0:1777051329.416303:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].26, 224 off12696 00000040:00080000:2.0:1777051329.416333:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].27, 224 off12920 00000040:00080000:2.0:1777051329.416361:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].28, 80 off13000 00000040:00080000:2.0:1777051329.416391:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].29, 224 off13224 00000040:00080000:2.0:1777051329.416431:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].30, 224 off13448 00000040:00080000:2.0:1777051329.416469:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].31, 88 off13536 00000040:00080000:2.0:1777051329.416506:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].32, 128 off13664 00000040:00080000:2.0:1777051329.416568:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].33, 144 off13808 00000040:00080000:2.0:1777051329.416611:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].34, 128 off13936 00000040:00080000:2.0:1777051329.416648:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].35, 224 off14160 00000040:00080000:2.0:1777051329.416689:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].36, 224 off14384 00000040:00080000:2.0:1777051329.416735:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].37, 80 off14464 00000040:00080000:2.0:1777051329.416781:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].38, 224 off14688 00000040:00080000:2.0:1777051329.416815:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].39, 224 off14912 00000040:00080000:2.0:1777051329.416846:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].40, 88 off15000 00000040:00080000:2.0:1777051329.416885:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].41, 128 off15128 00000040:00080000:2.0:1777051329.416921:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].42, 144 off15272 00000040:00080000:2.0:1777051329.416962:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].43, 128 off15400 00000040:00080000:2.0:1777051329.417002:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].44, 224 off15624 00000040:00080000:2.0:1777051329.417040:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].45, 224 off15848 00000040:00080000:2.0:1777051329.417084:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].46, 80 off15928 00000040:00080000:2.0:1777051329.417128:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].47, 224 off16152 00000040:00080000:2.0:1777051329.417168:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].48, 232 off16384 00000100:00100000:2.0:1777051329.417317:0:104204:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5fbeca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9351a01-5b0e-4470-97fd-58b9b4b312a2:104204:1863365452563328:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1777051329.417405:0:104204:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051329.417460:0:104204:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d955a45000 going to sleep for 11 seconds 00000100:00100000:3.0:1777051329.417726:0:103169:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452563328 00000100:00100000:3.0:1777051329.417736:0:103169:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452563328 00000100:00100000:3.0:1777051329.417805:0:103169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1777051329.417821:0:103169:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94ba5cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f9351a01-5b0e-4470-97fd-58b9b4b312a2+23:104204:x1863365452563328:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1777051329.417992:0:103169:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94ba5cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f9351a01-5b0e-4470-97fd-58b9b4b312a2+23:104204:x1863365452563328:12345-0@lo:502:mount.lustre.0 Request processed in 162us (578us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051329.418008:0:103169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1777051329.418069:0:104204:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5fbeca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9351a01-5b0e-4470-97fd-58b9b4b312a2:104204:1863365452563328:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1777051329.418422:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].49, 224 off16608 00000040:00080000:2.0:1777051329.418503:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].50, 120 off16728 00000040:00080000:2.0:1777051329.418574:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].51, 224 off16952 00000040:00080000:2.0:1777051329.418617:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].52, 224 off17176 00000040:00080000:2.0:1777051329.418654:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].53, 112 off17288 00000040:00080000:2.0:1777051329.418691:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].54, 224 off17512 00000040:00080000:2.0:1777051329.418726:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].55, 224 off17736 00000040:00080000:2.0:1777051329.418762:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].56, 136 off17872 00000040:00080000:2.0:1777051329.418798:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].57, 224 off18096 00000040:00080000:2.0:1777051329.418835:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].58, 224 off18320 00000040:00080000:2.0:1777051329.418871:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].59, 136 off18456 00000040:00080000:2.0:1777051329.418906:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].60, 224 off18680 00000040:00080000:2.0:1777051329.418937:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].61, 224 off18904 00000040:00080000:2.0:1777051329.418963:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].62, 112 off19016 00000100:00100000:2.0:1777051329.419005:0:104204:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5fbeca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9351a01-5b0e-4470-97fd-58b9b4b312a2:104204:1863365452563456:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1777051329.419079:0:104204:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051329.419167:0:104204:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d955a45000 going to sleep for 11 seconds 00000100:00100000:3.0:1777051329.419188:0:103165:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452563456 00000100:00100000:3.0:1777051329.419231:0:103165:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452563456 00000100:00100000:2.0:1777051329.419327:0:103163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1777051329.419349:0:103163:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9351a01-5b0e-4470-97fd-58b9b4b312a2+23:104204:x1863365452563456:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1777051329.419694:0:103163:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9351a01-5b0e-4470-97fd-58b9b4b312a2+23:104204:x1863365452563456:12345-0@lo:502:mount.lustre.0 Request processed in 352us (614us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051329.419709:0:103163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1777051329.419888:0:104204:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5fbeca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9351a01-5b0e-4470-97fd-58b9b4b312a2:104204:1863365452563456:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1777051329.419970:0:104204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].63, 224 off19240 00000040:00080000:3.0:1777051329.419984:0:104204:0:(llog.c:858:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 63 count 63 00000020:01000004:3.0:1777051329.424455:0:104222:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:3.0:1777051329.424474:0:104222:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff99da44f699c0) 00000020:00000080:3.0:1777051329.424510:0:104222:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:3.0:1777051329.425533:0:104222:0:(tgt_mount.c:151:server_get_mount()) get mount ffff99da7dbcc000 from lustre-MDT0001, refs=3 00000020:01000004:3.0:1777051329.425574:0:104222:0:(tgt_mount.c:185:server_put_mount()) put mount ffff99da7dbcc000 from lustre-MDT0001, refs=3 00000020:01000004:3.0:1777051329.425579:0:104222:0:(obd_mount.c:701:lustre_put_lsi()) put ffff99da7dbcc000 3 00010000:00080000:3.0:1777051329.425629:0:104222:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99da7dbe9000@lustre-MDT0000-lwp-MDT0001: add connection 192.168.201.146@tcp at head 00010000:00010000:3.0:1777051329.431464:0:104222:0:(ldlm_pool.c:924:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-12 is initialized 00000020:00000080:3.0:1777051329.431961:0:104222:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:3.0:1777051329.432026:0:104222:0:(lwp_dev.c:496:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1777051329.432047:0:104222:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x85f51a6b96715079 00000100:00080000:3.0:1777051329.432061:0:104222:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1777051329.432070:0:104222:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff99da7dbe9000 using connection 192.168.201.146@tcp/0@lo 00000100:00100000:3.0:1777051329.432365:0:104222:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d94e624380 x1863365452563584/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1777051329.432421:0:104222:0:(pinger.c:371:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1777051329.432565:0:3676:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94e624380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3676:1863365452563584:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1777051329.432671:0:3676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051329.432764:0:27885:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452563584 00000100:00100000:0.0:1777051329.432775:0:27885:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452563584 00000100:00100000:0.0:1777051329.432835:0:27885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111769 00000100:00100000:0.0:1777051329.432846:0:27885:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95612b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:0+-99:3676:x1863365452563584:12345-0@lo:38:llog_process_th.0 00000040:00080000:3.0:1777051329.432881:0:104222:0:(llog.c:858:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 64 count 63 00010000:00080000:0.0:1777051329.432882:0:27885:0:(ldlm_lib.c:1431:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 7958 last 0 00000020:00000080:0.0:1777051329.432951:0:27885:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x85f51a6b96715080 00000004:00100000:0.0:1777051329.432973:0:27885:0:(mdt_handler.c:7285:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000020:01000000:2.0:1777051329.432992:0:104204:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-63 (rc=0) 00000100:00080000:0.0:1777051329.433024:0:27885:0:(import.c:65:import_set_state_nolock()) ffff99d950add000 : changing import state from RECOVER to FULL 10000000:01000000:2.0:1777051329.433062:0:104204:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.201.146@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1777051329.433091:0:104204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff99d954ea6400/0x85f51a6b96715064 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b9671506b expref: -99 pid: 104204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051329.433111:0:27885:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95612b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000-lwp-MDT0001_UUID+5:3676:x1863365452563584:12345-0@lo:38:llog_process_th.0 Request processed in 264us (443us total) trans 0 rc 0/0 00010000:00010000:2.0:1777051329.433112:0:104204:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.146@tcp lock: ffff99d954ea6400/0x85f51a6b96715064 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b9671506b expref: -99 pid: 104204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051329.433128:0:27885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111769 00000020:01000004:2.0:1777051329.433247:0:104204:0:(tgt_mount.c:1144:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1777051329.433251:0:104204:0:(tgt_mount.c:1145:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1777051329.433254:0:104204:0:(tgt_mount.c:1146:server_mti_print()) fs: lustre 00000020:01000004:2.0:1777051329.433257:0:104204:0:(tgt_mount.c:1147:server_mti_print()) uuid: 00000020:01000004:2.0:1777051329.433260:0:104204:0:(tgt_mount.c:1148:server_mti_print()) ver: 0 00000020:01000004:2.0:1777051329.433264:0:104204:0:(tgt_mount.c:1149:server_mti_print()) flags: 00000020:01000004:2.0:1777051329.433267:0:104204:0:(tgt_mount.c:1151:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1777051329.433270:0:104204:0:(tgt_mount.c:1183:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1777051329.433272:0:104204:0:(tgt_mount.c:1189:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1777051329.433278:0:104204:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:2.0:1777051329.433282:0:104204:0:(tgt_mount.c:1144:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1777051329.433316:0:104204:0:(tgt_mount.c:1145:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1777051329.433318:0:104204:0:(tgt_mount.c:1146:server_mti_print()) fs: lustre 00000020:01000004:2.0:1777051329.433321:0:104204:0:(tgt_mount.c:1147:server_mti_print()) uuid: 00000020:01000004:2.0:1777051329.433323:0:104204:0:(tgt_mount.c:1148:server_mti_print()) ver: 0 00000020:01000004:2.0:1777051329.433326:0:104204:0:(tgt_mount.c:1149:server_mti_print()) flags: 00000020:01000004:2.0:1777051329.433328:0:104204:0:(tgt_mount.c:1151:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1777051329.433330:0:104204:0:(tgt_mount.c:1183:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1777051329.433333:0:104204:0:(tgt_mount.c:1189:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1777051329.433358:0:104204:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1777051329.433378:0:104204:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5fbeca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9351a01-5b0e-4470-97fd-58b9b4b312a2:104204:1863365452563712:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1777051329.433440:0:104204:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051329.433483:0:104204:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d9565d4540 going to sleep for 11 seconds 00000100:00100000:0.0:1777051329.433692:0:3676:0:(client.c:3101:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1777051329.433706:0:3676:0:(import.c:1130:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 7 00000100:00080000:0.0:1777051329.433717:0:3676:0:(import.c:958:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1777051329.433726:0:3676:0:(import.c:1211:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1777051329.433731:0:3676:0:(import.c:65:import_set_state_nolock()) ffff99da7dbe9000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1777051329.433744:0:3676:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94e624380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3676:1863365452563584:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1777051329.434153:0:103166:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452563712 00000100:00100000:1.0:1777051329.434163:0:103166:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452563712 00000100:00100000:1.0:1777051329.434289:0:103166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1777051329.434310:0:103166:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9351a01-5b0e-4470-97fd-58b9b4b312a2+23:104204:x1863365452563712:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1777051329.434354:0:103166:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1777051329.434371:0:103166:0:(mgs_nids.c:461:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:2.0:1777051329.438932:0:103159:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:1.0:1777051329.439239:0:103166:0:(mgs_nids.c:813:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1777051329.439267:0:103166:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:2.0:1777051329.439373:0:103167:0:(mgs_nids.c:710:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1777051329.439382:0:103167:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1777051329.439408:0:103167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99d95071be00/0x85f51a6b96715087 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 103167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051329.439437:0:103167:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99d9442eba00/0x85f51a6b96714c20 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b96714c19 expref: 23 pid: 103168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051329.439456:0:103167:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99d95071aa00/0x85f51a6b96714f53 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5ed9 expref: 11 pid: 103168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051329.439471:0:103167:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99d954ea7400/0x85f51a6b96714f68 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5eee expref: 11 pid: 103165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051329.439485:0:103167:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99d94ffbda00/0x85f51a6b9671504f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b96715048 expref: 23 pid: 103168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051329.439498:0:103167:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99d95071be00/0x85f51a6b96715087 lrc: 7/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 103167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051329.439583:0:103167:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99d94ffbda00/0x85f51a6b9671504f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x85f51a6b96715048 expref: 23 pid: 103168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051329.439677:0:103167:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99d94ffbda00/0x85f51a6b9671504f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x85f51a6b96715048 expref: 23 pid: 103168 timeout: 8058 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051329.439698:0:103167:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5fbed180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:103167:1863365452563840:0@lo:104: 00000100:00100000:2.0:1777051329.440343:0:103167:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051329.440345:0:103166:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9351a01-5b0e-4470-97fd-58b9b4b312a2+23:104204:x1863365452563712:12345-0@lo:253:mount.lustre.0 Request processed in 6036us (6898us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051329.440367:0:103166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1777051329.440437:0:104204:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5fbeca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9351a01-5b0e-4470-97fd-58b9b4b312a2:104204:1863365452563712:0@lo:253:mount.lustre.0 00010000:00010000:2.0:1777051329.440449:0:103167:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99d954ea7400/0x85f51a6b96714f68 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5eee expref: 11 pid: 103165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1777051329.440463:0:104204:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:0.0:1777051329.440470:0:104204:0:(tgt_mount.c:1144:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1777051329.440474:0:104204:0:(tgt_mount.c:1145:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1777051329.440478:0:104204:0:(tgt_mount.c:1146:server_mti_print()) fs: lustre 00000020:01000004:0.0:1777051329.440482:0:104204:0:(tgt_mount.c:1147:server_mti_print()) uuid: 00000020:01000004:0.0:1777051329.440488:0:104204:0:(tgt_mount.c:1148:server_mti_print()) ver: 0 00000020:01000004:0.0:1777051329.440494:0:104204:0:(tgt_mount.c:1149:server_mti_print()) flags: 00000020:01000004:0.0:1777051329.440497:0:104204:0:(tgt_mount.c:1151:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1777051329.440500:0:104204:0:(tgt_mount.c:1183:server_mti_print()) LDD_F_LARGE_NID 00010000:00010000:2.0:1777051329.440504:0:103167:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99d954ea7400/0x85f51a6b96714f68 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5eee expref: 11 pid: 103165 timeout: 8058 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1777051329.440505:0:104204:0:(tgt_mount.c:1189:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:2.0:1777051329.440524:0:103167:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5fbec380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:103167:1863365452563968:192.168.201.46@tcp:104: 00000020:02000000:0.0:1777051329.440534:0:104204:0:(tgt_mount.c:2642:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:2.0:1777051329.440659:0:103167:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99d95071aa00/0x85f51a6b96714f53 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5ed9 expref: 11 pid: 103168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051329.440677:0:103167:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99d95071aa00/0x85f51a6b96714f53 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5ed9 expref: 11 pid: 103168 timeout: 8058 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051329.440961:0:103167:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5fbeca80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:103167:1863365452564096:192.168.201.46@tcp:104: 00010000:00010000:2.0:1777051329.441043:0:103167:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99d9442eba00/0x85f51a6b96714c20 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x85f51a6b96714c19 expref: 22 pid: 103168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051329.441059:0:103167:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99d9442eba00/0x85f51a6b96714c20 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x85f51a6b96714c19 expref: 22 pid: 103168 timeout: 8058 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051329.441086:0:103167:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7cd9c000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:103167:1863365452564224:0@lo:104: 00000100:00100000:2.0:1777051329.441153:0:103167:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051329.441193:0:103167:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d9565d4480 going to sleep for 11 seconds 00000100:00100000:2.0:1777051329.441288:0:6562:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452563840 00000100:00100000:2.0:1777051329.441296:0:6562:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452563840 00000100:00100000:2.0:1777051329.441349:0:6562:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452564224 00000100:00100000:2.0:1777051329.441354:0:6562:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452564224 00000100:00100000:2.0:1777051329.441394:0:6562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1777051329.441431:0:6562:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5fbeed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f9351a01-5b0e-4470-97fd-58b9b4b312a2+4:103167:x1863365452563840:12345-0@lo:104: 00010000:00010000:2.0:1777051329.441452:0:6562:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.146@tcp lock: ffff99d95071b200/0x85f51a6b96715048 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x85f51a6b9671504f expref: -99 pid: 104204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051329.441566:0:6562:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1777051329.441579:0:6562:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5fbeed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f9351a01-5b0e-4470-97fd-58b9b4b312a2+4:103167:x1863365452563840:12345-0@lo:104: Request processed in 173us (1244us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051329.441595:0:6563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1777051329.441607:0:6562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1777051329.441619:0:6563:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7cd9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f9351a01-5b0e-4470-97fd-58b9b4b312a2+4:103167:x1863365452564224:12345-0@lo:104: 00010000:00010000:1.0:1777051329.441639:0:6563:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.146@tcp lock: ffff99d955a99000/0x85f51a6b96714c19 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x85f51a6b96714c20 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051329.441663:0:6567:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777051329.441674:0:6567:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.146@tcp lock: ffff99d95071b200/0x85f51a6b96715048 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x85f51a6b9671504f expref: -99 pid: 104204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051329.441702:0:6567:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d95071b200 already unused, calling callback (ffffffffc1208c20) 10000000:00010000:2.0:1777051329.441709:0:6567:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.146@tcp lock: ffff99d95071b200/0x85f51a6b96715048 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x85f51a6b9671504f expref: -99 pid: 104204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051329.441723:0:6567:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.146@tcp lock: ffff99d95071b200/0x85f51a6b96715048 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x85f51a6b9671504f expref: -99 pid: 104204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051329.441733:0:6563:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 10000000:00010000:2.0:1777051329.441736:0:6567:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.146@tcp lock: ffff99d95071b200/0x85f51a6b96715048 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x85f51a6b9671504f expref: -99 pid: 104204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051329.441746:0:6563:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7cd9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f9351a01-5b0e-4470-97fd-58b9b4b312a2+3:103167:x1863365452564224:12345-0@lo:104: Request processed in 135us (594us total) trans 0 rc 0/0 10000000:01000000:2.0:1777051329.441769:0:6567:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000100:00100000:1.0:1777051329.441778:0:6563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00010000:00010000:1.0:1777051329.441822:0:13753:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777051329.441823:0:6567:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.146@tcp lock: ffff99d95071b200/0x85f51a6b96715048 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x85f51a6b9671504f expref: -99 pid: 104204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051329.441833:0:13753:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.146@tcp lock: ffff99d955a99000/0x85f51a6b96714c19 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x85f51a6b96714c20 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051329.441841:0:6567:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1777051329.441859:0:13753:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d955a99000 already unused, calling callback (ffffffffc1208c20) 10000000:00010000:1.0:1777051329.441866:0:13753:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.146@tcp lock: ffff99d955a99000/0x85f51a6b96714c19 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x85f51a6b96714c20 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051329.441878:0:6567:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.146@tcp lock: ffff99d95071b200/0x85f51a6b96715048 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x85f51a6b9671504f expref: -99 pid: 104204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051329.441882:0:13753:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.146@tcp lock: ffff99d955a99000/0x85f51a6b96714c19 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x85f51a6b96714c20 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051329.441913:0:6567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.146@tcp lock: ffff99d95071b200/0x85f51a6b96715048 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x85f51a6b9671504f expref: -99 pid: 104204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1777051329.441916:0:13753:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.146@tcp lock: ffff99d955a99000/0x85f51a6b96714c19 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x85f51a6b96714c20 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1777051329.441951:0:13753:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1777051329.441961:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777051329.441967:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777051329.441971:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051329.441985:0:13753:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.146@tcp lock: ffff99d955a99000/0x85f51a6b96714c19 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x85f51a6b96714c20 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051329.441995:0:13753:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1777051329.442012:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7cd9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3680:1863365452564352:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1777051329.442038:0:13753:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.146@tcp lock: ffff99d955a99000/0x85f51a6b96714c19 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x85f51a6b96714c20 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051329.442054:0:13753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.146@tcp lock: ffff99d955a99000/0x85f51a6b96714c19 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x85f51a6b96714c20 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051329.442071:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051329.442093:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d9600b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3677:1863365452564480:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1777051329.442103:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051329.442109:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051329.442114:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777051329.442158:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051329.442227:0:6565:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452564352 00000100:00100000:2.0:1777051329.442237:0:6565:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452564352 00010000:00010000:2.0:1777051329.442271:0:6565:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99d94ffbda00/0x85f51a6b9671504f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x85f51a6b96715048 expref: 23 pid: 103168 timeout: 8058 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051329.442344:0:6565:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452564480 00000100:00100000:2.0:1777051329.442351:0:6565:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452564480 00010000:00010000:2.0:1777051329.442373:0:6565:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99d9442eba00/0x85f51a6b96714c20 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x85f51a6b96714c19 expref: 24 pid: 103168 timeout: 8058 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051329.442399:0:6565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3829 00000100:00100000:2.0:1777051329.442407:0:6565:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7cd9f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f9351a01-5b0e-4470-97fd-58b9b4b312a2+24:3680:x1863365452564352:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1777051329.442421:0:6565:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777051329.442430:0:6565:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99d94ffbda00/0x85f51a6b9671504f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x85f51a6b96715048 expref: 24 pid: 103168 timeout: 8058 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051329.442451:0:6565:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99d94ffbda00/0x85f51a6b9671504f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x85f51a6b96715048 expref: 24 pid: 103168 timeout: 8058 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051329.442479:0:6565:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1777051329.442502:0:6564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3830 00000100:00100000:1.0:1777051329.442522:0:6564:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94e626680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f9351a01-5b0e-4470-97fd-58b9b4b312a2+24:3677:x1863365452564480:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1777051329.442568:0:6564:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1777051329.442576:0:6565:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7cd9f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f9351a01-5b0e-4470-97fd-58b9b4b312a2+24:3680:x1863365452564352:12345-0@lo:103:ldlm_bl.0 Request processed in 132us (475us total) trans 0 rc 0/0 00010000:00010000:1.0:1777051329.442584:0:6564:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99d9442eba00/0x85f51a6b96714c20 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x85f51a6b96714c19 expref: 24 pid: 103168 timeout: 8058 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051329.442602:0:6565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3829 00010000:00010000:1.0:1777051329.442618:0:6564:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99d9442eba00/0x85f51a6b96714c20 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x85f51a6b96714c19 expref: 24 pid: 103168 timeout: 8058 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051329.442641:0:6564:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1777051329.442704:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7cd9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3680:1863365452564352:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1777051329.442709:0:6564:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94e626680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f9351a01-5b0e-4470-97fd-58b9b4b312a2+23:3677:x1863365452564480:12345-0@lo:103:ldlm_bl.0 Request processed in 189us (549us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051329.442730:0:6564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3830 00010000:00010000:2.0:1777051329.442782:0:103167:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d94ffbda00/0x85f51a6b9671504f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x85f51a6b96715048 expref: 22 pid: 103168 timeout: 8058 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051329.442810:0:103167:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5fbed180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:103167:1863365452563840:0@lo:104: 00010000:00010000:2.0:1777051329.442849:0:103167:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d9442eba00/0x85f51a6b96714c20 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x85f51a6b96714c19 expref: 21 pid: 103168 timeout: 8058 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051329.442851:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d9600b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3677:1863365452564480:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1777051329.442883:0:103167:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7cd9c000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:103167:1863365452564224:0@lo:104: 00000100:00100000:1.0:1777051329.443843:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051329.443843:0:103167:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5fbec380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:103167:1863365452563968:192.168.201.46@tcp:104: 00000100:00100000:1.0:1777051329.443922:0:9550:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425883008 00000100:00100000:1.0:1777051329.443932:0:9550:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425883008 00010000:00010000:1.0:1777051329.443990:0:9550:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99d954ea7400/0x85f51a6b96714f68 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5eee expref: 12 pid: 103165 timeout: 8058 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051329.444039:0:9550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3831 00000100:00100000:1.0:1777051329.444055:0:9550:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d9600b9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:29c4352d-3260-4734-909d-9ea5de9e7fa4+12:2436:x1863365425883008:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1777051329.444074:0:9550:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1777051329.444085:0:9550:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99d954ea7400/0x85f51a6b96714f68 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5eee expref: 12 pid: 103165 timeout: 8058 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051329.444113:0:9550:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99d954ea7400/0x85f51a6b96714f68 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5eee expref: 12 pid: 103165 timeout: 8058 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051329.444136:0:9550:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d954ea7400/0x85f51a6b96714f68 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5eee expref: 12 pid: 103165 timeout: 8058 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051329.444155:0:9550:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1777051329.444211:0:9550:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d9600b9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:29c4352d-3260-4734-909d-9ea5de9e7fa4+11:2436:x1863365425883008:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 158us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051329.444226:0:9550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3831 00000100:00100000:3.0:1777051329.445474:0:103167:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5fbeca80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:103167:1863365452564096:192.168.201.46@tcp:104: 00000100:00100000:1.0:1777051329.445529:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051329.445613:0:47597:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425883136 00000100:00100000:1.0:1777051329.445620:0:47597:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425883136 00010000:00010000:3.0:1777051329.445636:0:103167:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99d95071be00/0x85f51a6b96715087 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 103167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051329.446418:0:47597:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99d95071aa00/0x85f51a6b96714f53 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5ed9 expref: 11 pid: 103168 timeout: 8058 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051329.446480:0:47597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3832 00000100:00100000:1.0:1777051329.446500:0:47597:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d9600bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:29c4352d-3260-4734-909d-9ea5de9e7fa4+11:2437:x1863365425883136:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1777051329.446517:0:47597:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1777051329.446527:0:47597:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99d95071aa00/0x85f51a6b96714f53 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5ed9 expref: 11 pid: 103168 timeout: 8058 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051329.446590:0:47597:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99d95071aa00/0x85f51a6b96714f53 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5ed9 expref: 11 pid: 103168 timeout: 8058 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051329.446617:0:47597:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d95071aa00/0x85f51a6b96714f53 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5ed9 expref: 11 pid: 103168 timeout: 8058 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051329.446650:0:47597:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99d95071be00/0x85f51a6b96715087 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 103167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051329.446664:0:47597:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d95071be00/0x85f51a6b96715087 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 103167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1777051329.446691:0:47597:0:(mgs_nids.c:686:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.007310115s 00010000:00010000:1.0:1777051329.446700:0:47597:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99d95071be00/0x85f51a6b96715087 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 103167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051329.446713:0:47597:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99d95071be00/0x85f51a6b96715087 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 103167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051329.446726:0:47597:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99d95071be00/0x85f51a6b96715087 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 103167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051329.446738:0:47597:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99d95071be00/0x85f51a6b96715087 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 103167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051329.446749:0:47597:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d95071be00 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:1.0:1777051329.446755:0:47597:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99d95071be00/0x85f51a6b96715087 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 103167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051329.446764:0:47597:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99d95071be00/0x85f51a6b96715087 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 103167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051329.446789:0:47597:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99d95071be00/0x85f51a6b96715087 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 103167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051329.446801:0:47597:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1777051329.446840:0:103167:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99d95071be00/0x85f51a6b96715087 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 103167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051329.446859:0:47597:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d9600bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:29c4352d-3260-4734-909d-9ea5de9e7fa4+10:2437:x1863365425883136:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 361us (1328us total) trans 0 rc 0/0 00010000:00010000:3.0:1777051329.446864:0:103167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99d95071be00/0x85f51a6b96715087 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 103167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051329.446885:0:47597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3832 00010000:00010000:3.0:1777051329.446890:0:103167:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d95071be00/0x85f51a6b96715087 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 103167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1777051329.463573:0:104204:0:(update_trans.c:1477:distribute_txn_commit_batchid_init()) lustre-MDT0001: committed batchid 56 00000040:01000000:0.0:1777051329.464274:0:104204:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:1.0:1777051329.464304:0:104230:0:(update_trans.c:1520:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 56 00000020:00080000:1.0:1777051329.464313:0:104230:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 56 00000040:01000000:0.0:1777051329.465592:0:104231:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1777051329.466095:0:104204:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:1.0:1777051329.467280:0:104232:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d9600baa00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:104232:1863365452564608:0@lo:1000:lod0001_rec0000.0 00000040:01000000:0.0:1777051329.467361:0:104204:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000100:00100000:1.0:1777051329.467378:0:104232:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051329.467431:0:104232:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da50e93f00 going to sleep for 11 seconds 00000100:00100000:3.0:1777051329.467476:0:6585:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452564608 00000100:00100000:3.0:1777051329.467489:0:6585:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452564608 00000100:00100000:3.0:1777051329.467598:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8042 00000100:00100000:3.0:1777051329.467615:0:6585:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d9600b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:104232:x1863365452564608:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1777051329.468394:0:6585:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d9600b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:104232:x1863365452564608:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 781us (1016us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051329.468410:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8042 00000100:00100000:3.0:1777051329.468510:0:104232:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d9600baa00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:104232:1863365452564608:0@lo:1000:lod0001_rec0000.0 00000040:01000000:3.0:1777051329.468588:0:104232:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1777051329.468639:0:104232:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94e624a80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:104232:1863365452564736:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1777051329.468705:0:104232:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051329.468747:0:104232:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da50e93300 going to sleep for 11 seconds 00000100:00100000:2.0:1777051329.468756:0:6584:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452564736 00000100:00100000:2.0:1777051329.468768:0:6584:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452564736 00000100:00100000:2.0:1777051329.468833:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8043 00000100:00100000:2.0:1777051329.468846:0:6584:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94e627100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:104232:x1863365452564736:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1777051329.469007:0:6584:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94e627100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:104232:x1863365452564736:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 163us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051329.469018:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8043 00000100:00100000:3.0:1777051329.469045:0:104232:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94e624a80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:104232:1863365452564736:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1777051329.469128:0:104232:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94e624a80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:104232:1863365452564864:0@lo:900:lod0001_rec0000.0 00000100:00100000:3.0:1777051329.469188:0:104232:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051329.469292:0:6590:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452564864 00000100:00100000:3.0:1777051329.469300:0:6590:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452564864 00000100:00100000:3.0:1777051329.469365:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1777051329.469379:0:6590:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94e627480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:104232:x1863365452564864:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:3.0:1777051329.469475:0:6590:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94e627480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:104232:x1863365452564864:12345-0@lo:900:lod0001_rec0000.0 Request processed in 99us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051329.469487:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1777051329.469517:0:104232:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da50e93300 going to sleep for 11 seconds 00000100:00100000:3.0:1777051329.469570:0:104232:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94e624a80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:104232:1863365452564864:0@lo:900:lod0001_rec0000.0 00000100:00100000:3.0:1777051329.469637:0:104232:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94e624a80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:104232:1863365452564992:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1777051329.469690:0:104232:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051329.469733:0:104232:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da50e93f00 going to sleep for 11 seconds 00000100:00100000:2.0:1777051329.469748:0:46498:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452564992 00000100:00100000:2.0:1777051329.469758:0:46498:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452564992 00000100:00100000:2.0:1777051329.469812:0:46498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8044 00000100:00100000:2.0:1777051329.469827:0:46498:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94e624700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+5:104232:x1863365452564992:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1777051329.469918:0:46498:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94e624700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+5:104232:x1863365452564992:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 92us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051329.469931:0:46498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8044 00000100:00100000:3.0:1777051329.469983:0:104232:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94e624a80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:104232:1863365452564992:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1777051329.470093:0:104232:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94e624a80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:104232:1863365452565120:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1777051329.470194:0:104232:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051329.470240:0:104232:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da50e93f00 going to sleep for 11 seconds 00000004:00000080:1.0:1777051329.470290:0:104204:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1777051329.470304:0:104204:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000100:00100000:0.0:1777051329.470362:0:6585:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452565120 00000100:00100000:0.0:1777051329.470370:0:6585:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452565120 00000100:00100000:0.0:1777051329.470425:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8045 00000100:00100000:0.0:1777051329.470442:0:6585:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94e625f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:104232:x1863365452565120:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1777051329.480534:0:6585:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94e625f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:104232:x1863365452565120:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 10091us (10333us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051329.480585:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8045 00000100:00100000:2.0:1777051329.482340:0:104232:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94e624a80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:104232:1863365452565120:0@lo:1000:lod0001_rec0000.0 00000040:00080000:2.0:1777051329.482420:0:104232:0:(llog_cat.c:391:llog_cat_set_first_idx()) catlog [0x200000401:0x1:0x0] first idx 0, last_idx 2 00000100:00100000:2.0:1777051329.482594:0:104232:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7cd9df80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:104232:1863365452565248:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1777051329.482686:0:104232:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051329.483038:0:6584:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452565248 00000100:00100000:2.0:1777051329.483047:0:6584:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452565248 00000100:00100000:2.0:1777051329.483096:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8046 00000100:00100000:2.0:1777051329.483108:0:6584:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7cd9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:104232:x1863365452565248:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1777051329.483620:0:104232:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da50018300 going to sleep for 11 seconds 00000100:00100000:2.0:1777051329.484687:0:6584:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7cd9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:104232:x1863365452565248:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 1579us (1998us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051329.484700:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8046 00000100:00100000:2.0:1777051329.484743:0:104232:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7cd9df80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:104232:1863365452565248:0@lo:1000:lod0001_rec0000.0 00000040:00080000:2.0:1777051329.484791:0:104232:0:(llog.c:801:llog_process_thread()) index: 1, lh_last_idx: 2 synced_idx: 0 lgh_last_idx: 2 00000040:00080000:2.0:1777051329.484797:0:104232:0:(llog_cat.c:158:llog_cat_process_common()) processing log [0x200000401:0x2:0x0] at index 1 of catalog [0x200000401:0x1:0x0] 00000100:00100000:2.0:1777051329.484935:0:104232:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7cd9df80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:104232:1863365452565376:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1777051329.485462:0:104232:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051329.485494:0:104232:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d95a2a8780 going to sleep for 11 seconds 00000100:00100000:0.0:1777051329.485604:0:46500:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452565376 00000100:00100000:0.0:1777051329.485614:0:46500:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452565376 00000100:00100000:0.0:1777051329.485673:0:46500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8047 00000100:00100000:0.0:1777051329.485689:0:46500:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7cd9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+5:104232:x1863365452565376:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1777051329.486301:0:46500:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7cd9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+5:104232:x1863365452565376:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 615us (839us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051329.486311:0:46500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8047 00000100:00100000:2.0:1777051329.486351:0:104232:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7cd9df80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:104232:1863365452565376:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1777051329.486451:0:104232:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7cd9df80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:104232:1863365452565504:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1777051329.486518:0:104232:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051329.486581:0:104232:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d95a2a89c0 going to sleep for 11 seconds 00000100:00100000:0.0:1777051329.486619:0:47208:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452565504 00000100:00100000:0.0:1777051329.486627:0:47208:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452565504 00000100:00100000:0.0:1777051329.486683:0:47208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8048 00000100:00100000:0.0:1777051329.486698:0:47208:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7cd9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+5:104232:x1863365452565504:12345-0@lo:1000:lod0001_rec0000.0 00000040:00080000:3.0:1777051329.489955:0:104204:0:(llog.c:858:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000100:00100000:0.0:1777051329.491264:0:47208:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7cd9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+5:104232:x1863365452565504:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 4566us (4741us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051329.491282:0:47208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8048 00000100:00100000:2.0:1777051329.491305:0:104232:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7cd9df80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:104232:1863365452565504:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1777051329.491427:0:104232:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7cd9df80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:104232:1863365452565632:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1777051329.491474:0:104232:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051329.491510:0:104232:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d95a2a8cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1777051329.491576:0:11727:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452565632 00000100:00100000:0.0:1777051329.491585:0:11727:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452565632 00000100:00100000:0.0:1777051329.491630:0:11727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8049 00000100:00100000:0.0:1777051329.491642:0:11727:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7cd9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:104232:x1863365452565632:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1777051329.491745:0:11727:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7cd9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:104232:x1863365452565632:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 103us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051329.491759:0:11727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8049 00000100:00100000:2.0:1777051329.491767:0:104232:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7cd9df80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:104232:1863365452565632:0@lo:1000:lod0001_rec0000.0 00000004:00080000:2.0:1777051329.491836:0:104232:0:(osp_trans.c:1582:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff99d95a2a8600 with version 1 00000040:00080000:2.0:1777051329.491873:0:104232:0:(llog_cat.c:391:llog_cat_set_first_idx()) catlog [0x200000401:0x1:0x0] first idx 1, last_idx 2 00000004:00080000:2.0:1777051329.491891:0:104232:0:(osp_trans.c:1582:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff99d95a2a89c0 with version 2 00000040:00080000:2.0:1777051329.491898:0:104232:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x200000401:0x2:0x0] at index 1 of catalog [0x200000401:0x1:0x0] 00000004:00080000:0.0:1777051329.491902:0:104211:0:(osp_trans.c:1330:osp_get_next_request()) ou ffff99d9596fa9c0 version 1 rpc_version 1 00000020:00100000:0.0:1777051329.491933:0:104211:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1777051329.491947:0:104211:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff99d956128380 x1863365452565888/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 416/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1777051329.491997:0:104211:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d956128380 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:104211:1863365452565888:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1777051329.492057:0:104211:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051329.492085:0:104211:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da5077b900 going to sleep for 11 seconds 00000100:00100000:0.0:1777051329.492110:0:46500:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452565888 00000100:00100000:0.0:1777051329.492117:0:46500:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452565888 00000100:00100000:0.0:1777051329.492157:0:46500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8050 00000100:00100000:0.0:1777051329.492165:0:46500:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955505c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+5:104211:x1863365452565888:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1777051329.492467:0:46500:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955505c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+6:104211:x1863365452565888:12345-0@lo:1000:osp_up0-1.0 Request processed in 301us (409us total) trans 30064771074 rc 0/0 00000100:00100000:0.0:1777051329.492476:0:46500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8050 00000100:00100000:0.0:1777051329.492568:0:104211:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d956128380 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:104211:1863365452565888:0@lo:1000:osp_up0-1.0 00000004:00080000:0.0:1777051329.492584:0:104211:0:(osp_trans.c:1330:osp_get_next_request()) ou ffff99d9596fa9c0 version 2 rpc_version 2 00000020:00100000:0.0:1777051329.492605:0:104211:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1777051329.492616:0:104211:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff99d955505f80 x1863365452566144/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 744/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1777051329.492643:0:104211:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955505f80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:104211:1863365452566144:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1777051329.492698:0:104211:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051329.492731:0:104211:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da5077b900 going to sleep for 11 seconds 00000100:00100000:0.0:1777051329.492755:0:6585:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452566144 00000100:00100000:0.0:1777051329.492761:0:6585:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452566144 00000100:00100000:0.0:1777051329.492812:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8051 00000100:00100000:0.0:1777051329.492825:0:6585:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955507480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:104211:x1863365452566144:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1777051329.493016:0:6585:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955507480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:104211:x1863365452566144:12345-0@lo:1000:osp_up0-1.0 Request processed in 191us (316us total) trans 30064771075 rc 0/0 00000100:00100000:0.0:1777051329.493030:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8051 00000100:00100000:0.0:1777051329.493121:0:104211:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955505f80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:104211:1863365452566144:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1777051329.493161:0:104232:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7cd9df80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:104232:1863365452566272:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1777051329.493277:0:104232:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051329.493302:0:104232:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d95a2a8240 going to sleep for 11 seconds 00000100:00100000:0.0:1777051329.493319:0:11727:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452566272 00000100:00100000:0.0:1777051329.493327:0:11727:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452566272 00000100:00100000:0.0:1777051329.493373:0:11727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8052 00000100:00100000:0.0:1777051329.493386:0:11727:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7cd9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:104232:x1863365452566272:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1777051329.493611:0:11727:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7cd9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:104232:x1863365452566272:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 227us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051329.493615:0:104232:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7cd9df80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:104232:1863365452566272:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1777051329.493628:0:11727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8052 00000040:00080000:2.0:1777051329.493679:0:104232:0:(llog.c:801:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1777051329.493685:0:104232:0:(llog_cat.c:158:llog_cat_process_common()) processing log [0x200000401:0x3:0x0] at index 2 of catalog [0x200000401:0x1:0x0] 00000100:00100000:2.0:1777051329.493730:0:104232:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7cd9df80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:104232:1863365452566400:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1777051329.493772:0:104232:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051329.493809:0:104232:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d95a2a8840 going to sleep for 11 seconds 00000100:00100000:0.0:1777051329.493853:0:46500:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452566400 00000100:00100000:0.0:1777051329.493864:0:46500:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452566400 00000100:00100000:0.0:1777051329.493943:0:46500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8053 00000100:00100000:0.0:1777051329.493958:0:46500:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7cd9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+7:104232:x1863365452566400:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1777051329.494072:0:46500:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7cd9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+7:104232:x1863365452566400:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 114us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051329.494087:0:46500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8053 00000100:00100000:2.0:1777051329.494096:0:104232:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7cd9df80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:104232:1863365452566400:0@lo:1000:lod0001_rec0000.0 00000040:00080000:2.0:1777051329.494156:0:104232:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:2.0:1777051329.494193:0:104232:0:(osp_trans.c:1582:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff99d95a2a8a80 with version 3 00000004:00080000:0.0:1777051329.494286:0:104211:0:(osp_trans.c:1330:osp_get_next_request()) ou ffff99d9596fa9c0 version 3 rpc_version 3 00000004:00080000:2.0:1777051329.494291:0:104232:0:(osp_trans.c:1582:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff99d95a2a8240 with version 4 00000040:00080000:2.0:1777051329.494300:0:104232:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x200000401:0x3:0x0] at index 2 of catalog [0x200000401:0x1:0x0] 00000020:00100000:0.0:1777051329.494312:0:104211:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1777051329.494322:0:104211:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff99d955507b80 x1863365452566656/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 416/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000040:00080000:2.0:1777051329.494325:0:104232:0:(llog.c:858:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 2 count 1 00000100:00100000:0.0:1777051329.494351:0:104211:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955507b80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:104211:1863365452566656:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1777051329.494397:0:104211:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1777051329.494424:0:104232:0:(lod_dev.c:520:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000100:00100000:0.0:1777051329.494429:0:104211:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da5077bc00 going to sleep for 11 seconds 00000100:00100000:0.0:1777051329.494459:0:6585:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452566656 00000100:00100000:0.0:1777051329.494700:0:6585:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452566656 00000100:00100000:0.0:1777051329.494758:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8054 00000100:00100000:0.0:1777051329.494774:0:6585:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955504700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:104211:x1863365452566656:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1777051329.494980:0:6585:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955504700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:104211:x1863365452566656:12345-0@lo:1000:osp_up0-1.0 Request processed in 208us (582us total) trans 30064771076 rc 0/0 00000100:00100000:0.0:1777051329.494996:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8054 00000100:00100000:0.0:1777051329.495074:0:104211:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955507b80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:104211:1863365452566656:0@lo:1000:osp_up0-1.0 00000004:00080000:0.0:1777051329.495095:0:104211:0:(osp_trans.c:1330:osp_get_next_request()) ou ffff99d9596fa9c0 version 4 rpc_version 4 00000020:00100000:0.0:1777051329.495118:0:104211:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1777051329.495127:0:104211:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff99d955505500 x1863365452566912/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 744/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1777051329.495153:0:104211:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955505500 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:104211:1863365452566912:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1777051329.495201:0:104211:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051329.495237:0:104211:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da5077bc00 going to sleep for 11 seconds 00000100:00100000:0.0:1777051329.495268:0:11727:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452566912 00000100:00100000:0.0:1777051329.495274:0:11727:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452566912 00000100:00100000:0.0:1777051329.495317:0:11727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8055 00000100:00100000:0.0:1777051329.495331:0:11727:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955504000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:104211:x1863365452566912:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1777051329.495688:0:11727:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955504000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:104211:x1863365452566912:12345-0@lo:1000:osp_up0-1.0 Request processed in 356us (481us total) trans 30064771077 rc 0/0 00000100:00100000:0.0:1777051329.495702:0:11727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8055 00000100:00100000:0.0:1777051329.495783:0:104211:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955505500 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:104211:1863365452566912:0@lo:1000:osp_up0-1.0 00000040:00080000:3.0:1777051329.500633:0:104204:0:(llog.c:858:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1777051329.501124:0:104204:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:1.0:1777051329.501742:0:104231:0:(llog.c:858:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1777051329.501836:0:104231:0:(lod_dev.c:520:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1777051329.501845:0:104231:0:(lod_dev.c:544:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00080000:10000000:2.0:1777051329.504268:0:104204:0:(osd_handler.c:5577:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x2f:0x0] (8/32) registered 00010000:00080000:2.0:1777051329.508299:0:104204:0:(ldlm_lib.c:3036:target_recovery_init()) RECOVERY: service lustre-MDT0001, 3 recoverable clients, last_transno 4294970573 00010000:00080000:1.0:1777051329.514069:0:104234:0:(ldlm_lib.c:2839:target_recovery_thread()) lustre-MDT0001: started recovery thread pid 104234 00010000:02000000:1.0:1777051329.514096:0:104234:0:(ldlm_lib.c:2321:target_recovery_overseer()) lustre-MDT0001: in recovery but waiting for the first client to connect 00000020:01000004:2.0:1777051329.514387:0:104204:0:(tgt_mount.c:296:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1777051329.514429:0:104204:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.146@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1777051329.514452:0:104204:0:(tgt_mount.c:2411:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1777051329.514471:0:104204:0:(super25.c:187:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:2.0:1777051329.517468:0:104204:0:(tgt_mount.c:2297:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1777051329.518184:0:104204:0:(tgt_mount.c:2312:is_cmd_supported()) ioctl cmd=81009431 00010000:00080000:1.0:1777051329.531186:0:104234:0:(ldlm_lib.c:2531:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 3 abort 0 expired 0 00010000:00080000:1.0:1777051329.531195:0:104234:0:(ldlm_lib.c:2531:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 3 abort 0 expired 0 00010000:00010000:2.0:1777051329.622484:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1777051330.458499:0:104226:0:(llog.c:858:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1777051330.646436:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1777051330.966340:0:6577:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1777051330.966351:0:6577:0:(mgc_request.c:1799:mgc_process_log()) Process log lustre-mdtir-ffff99da7dbcc000 from 31 10000000:01000000:2.0:1777051330.966360:0:6577:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1777051330.966451:0:6577:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.146@tcp lock: ffff99d95071b600/0x85f51a6b9671508e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051330.966475:0:6577:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.146@tcp lock: ffff99d95071b600/0x85f51a6b9671508e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051330.966499:0:6577:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.146@tcp lock: ffff99d95071b600/0x85f51a6b9671508e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051330.966581:0:6577:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7cd9df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452567040:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1777051330.966687:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051330.966781:0:6577:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d94e801e40 going to sleep for 11 seconds 00000100:00100000:3.0:1777051330.966818:0:103169:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452567040 00000100:00100000:3.0:1777051330.966834:0:103169:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452567040 00000100:00100000:3.0:1777051330.966929:0:103169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1777051330.966950:0:103169:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f9351a01-5b0e-4470-97fd-58b9b4b312a2+21:6577:x1863365452567040:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1777051330.966974:0:103169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777051330.967002:0:103169:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d94ffbdc00/0x85f51a6b96715095 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x85f51a6b9671508e expref: -99 pid: 103169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051330.967046:0:103169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d94ffbdc00/0x85f51a6b96715095 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x85f51a6b9671508e expref: 22 pid: 103169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051330.967069:0:103169:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d94ffbdc00/0x85f51a6b96715095 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b9671508e expref: 22 pid: 103169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051330.967086:0:103169:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d94ffbdc00, rc 0) 00000100:00100000:3.0:1777051330.967181:0:103169:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f9351a01-5b0e-4470-97fd-58b9b4b312a2+22:6577:x1863365452567040:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 236us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051330.967196:0:103169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1777051330.967627:0:6577:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7cd9df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452567040:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1777051330.967669:0:6577:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.146@tcp lock: ffff99d95071b600/0x85f51a6b9671508e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b96715095 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051330.967692:0:6577:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.146@tcp lock: ffff99d95071b600/0x85f51a6b9671508e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x85f51a6b96715095 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051330.967805:0:6577:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7cd9df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452567168:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1777051330.967880:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051330.967955:0:6577:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d94e801e40 going to sleep for 11 seconds 00000100:00100000:3.0:1777051330.967995:0:103165:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452567168 00000100:00100000:3.0:1777051330.968007:0:103165:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452567168 00000100:00100000:3.0:1777051330.968070:0:103165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1777051330.968084:0:103165:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9351a01-5b0e-4470-97fd-58b9b4b312a2+22:6577:x1863365452567168:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1777051330.968111:0:103165:0:(mgs_nids.c:912:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1777051330.968496:0:103165:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1777051330.968505:0:103165:0:(mgs_nids.c:316:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 31 00000100:00100000:2.0:1777051330.968783:0:103165:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9351a01-5b0e-4470-97fd-58b9b4b312a2+22:6577:x1863365452567168:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 696us (900us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051330.968800:0:103165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1777051330.969344:0:6577:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7cd9df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452567168:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1777051330.969422:0:6577:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.201.146@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1777051330.969432:0:6577:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff99d95071b600/0x85f51a6b9671508e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b96715095 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051330.969447:0:6577:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.146@tcp lock: ffff99d95071b600/0x85f51a6b9671508e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b96715095 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1777051330.969461:0:6577:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1777051330.969464:0:6577:0:(mgc_request.c:1799:mgc_process_log()) Process log lustre-mdtir-ffff99da5f2be000 from 31 10000000:01000000:3.0:1777051330.969468:0:6577:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1777051330.969502:0:6577:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.146@tcp lock: ffff99d94ffbd400/0x85f51a6b9671509c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051330.969546:0:6577:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.146@tcp lock: ffff99d94ffbd400/0x85f51a6b9671509c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051330.969566:0:6577:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.146@tcp lock: ffff99d94ffbd400/0x85f51a6b9671509c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051330.969597:0:6577:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94e624a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452567296:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1777051330.969659:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051330.969717:0:6577:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d95d7c4600 going to sleep for 11 seconds 00000100:00100000:0.0:1777051330.969735:0:103166:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452567296 00000100:00100000:0.0:1777051330.969745:0:103166:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452567296 00000100:00100000:0.0:1777051330.969813:0:103166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1777051330.969831:0:103166:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9351a01-5b0e-4470-97fd-58b9b4b312a2+22:6577:x1863365452567296:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1777051330.969848:0:103166:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051330.969888:0:103166:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d954ea6c00/0x85f51a6b967150a3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x85f51a6b9671509c expref: -99 pid: 103166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051330.969932:0:103166:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d954ea6c00/0x85f51a6b967150a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x85f51a6b9671509c expref: 23 pid: 103166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051330.969953:0:103166:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d954ea6c00/0x85f51a6b967150a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b9671509c expref: 23 pid: 103166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051330.969969:0:103166:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d954ea6c00, rc 0) 00000100:00100000:0.0:1777051330.970044:0:103166:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9351a01-5b0e-4470-97fd-58b9b4b312a2+23:6577:x1863365452567296:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 217us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051330.970058:0:103166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1777051330.970131:0:6577:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94e624a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452567296:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1777051330.970157:0:6577:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.146@tcp lock: ffff99d94ffbd400/0x85f51a6b9671509c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b967150a3 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051330.970176:0:6577:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.146@tcp lock: ffff99d94ffbd400/0x85f51a6b9671509c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x85f51a6b967150a3 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051330.970265:0:6577:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94e624a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452567424:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1777051330.970431:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051330.970480:0:103169:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452567424 00000100:00100000:2.0:1777051330.970486:0:6577:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d95d7c4600 going to sleep for 11 seconds 00000100:00100000:3.0:1777051330.970506:0:103169:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452567424 00000100:00100000:3.0:1777051330.970632:0:103169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1777051330.970657:0:103169:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942d2ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f9351a01-5b0e-4470-97fd-58b9b4b312a2+23:6577:x1863365452567424:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1777051330.970684:0:103169:0:(mgs_nids.c:912:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1777051330.970711:0:103169:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1777051330.971077:0:103169:0:(mgs_nids.c:316:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 31 00000100:00100000:3.0:1777051330.971318:0:103169:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942d2ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f9351a01-5b0e-4470-97fd-58b9b4b312a2+23:6577:x1863365452567424:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 664us (887us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051330.971336:0:103169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1777051330.971456:0:6577:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94e624a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452567424:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1777051330.971604:0:6577:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.201.146@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1777051330.971619:0:6577:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff99d94ffbd400/0x85f51a6b9671509c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b967150a3 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051330.971637:0:6577:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.146@tcp lock: ffff99d94ffbd400/0x85f51a6b9671509c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b967150a3 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051331.235831:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051331.235932:0:103165:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425883264 00000100:00100000:2.0:1777051331.235948:0:103165:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425883264 00000100:00100000:2.0:1777051331.236040:0:103165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 118 00000100:00100000:2.0:1777051331.236059:0:103165:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942d2b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29c4352d-3260-4734-909d-9ea5de9e7fa4+10:6255:x1863365425883264:12345-192.168.201.46@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1777051331.236085:0:103165:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051331.236112:0:103165:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d95071ba00/0x85f51a6b967150aa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b5f0a expref: -99 pid: 103165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051331.236158:0:103165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d95071ba00/0x85f51a6b967150aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5f0a expref: 11 pid: 103165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051331.236178:0:103165:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d95071ba00/0x85f51a6b967150aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5f0a expref: 11 pid: 103165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051331.236205:0:103165:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d95071ba00, rc 0) 00000100:00100000:2.0:1777051331.236335:0:103165:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942d2b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29c4352d-3260-4734-909d-9ea5de9e7fa4+11:6255:x1863365425883264:12345-192.168.201.46@tcp:101:ll_cfg_requeue.0 Request processed in 279us (535us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051331.236354:0:103165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 118 00000100:00100000:0.0:1777051331.238901:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051331.238972:0:103166:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425883392 00000100:00100000:1.0:1777051331.238982:0:103166:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425883392 00000100:00100000:1.0:1777051331.239057:0:103166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 119 00000100:00100000:1.0:1777051331.239072:0:103166:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942d2a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29c4352d-3260-4734-909d-9ea5de9e7fa4+11:6255:x1863365425883392:12345-192.168.201.46@tcp:256:ll_cfg_requeue.0 20000000:01000000:1.0:1777051331.239097:0:103166:0:(mgs_nids.c:912:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 16384. 20000000:01000000:1.0:1777051331.239130:0:103166:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1777051331.239137:0:103166:0:(mgs_nids.c:316:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 31 00000100:00100000:0.0:1777051331.241731:0:103166:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942d2a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29c4352d-3260-4734-909d-9ea5de9e7fa4+11:6255:x1863365425883392:12345-192.168.201.46@tcp:256:ll_cfg_requeue.0 Request processed in 2657us (2830us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051331.241749:0:103166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 119 00000100:00100000:1.0:1777051331.246663:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051331.246774:0:6580:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425883520 00000100:00100000:3.0:1777051331.246789:0:6580:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425883520 00000100:00100000:1.0:1777051331.246815:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051331.246872:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111770 00000100:00100000:3.0:1777051331.246887:0:6580:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d9600b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2435:x1863365425883520:12345-192.168.201.46@tcp:38:ll_cfg_requeue.0 00010000:00080000:3.0:1777051331.246929:0:6580:0:(ldlm_lib.c:926:target_handle_reconnect()) connect export for UUID '2dd4696c-edce-4cd1-86d2-dbd2ff957fa1' at ffff99da4622a000, cookie 0x85f51a6b96714fed 00010000:00080000:3.0:1777051331.246940:0:6580:0:(ldlm_lib.c:1431:target_handle_connect()) lustre-MDT0001: connection from 2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp recovering/t0 exp ffff99da4622a000 cur 7960 last 1777051329 00010000:02000400:3.0:1777051331.246958:0:6580:0:(ldlm_lib.c:2022:target_start_recovery_timer()) lustre-MDT0001: Will be in recovery for at least 1:00, or until 3 clients reconnect 00000100:00100000:2.0:1777051331.250874:0:103169:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425883648 00000100:00100000:2.0:1777051331.250884:0:103169:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425883648 00000100:00100000:2.0:1777051331.250948:0:103169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 120 00000100:00100000:2.0:1777051331.250965:0:103169:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942d2a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:29c4352d-3260-4734-909d-9ea5de9e7fa4+11:6255:x1863365425883648:12345-192.168.201.46@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1777051331.250987:0:103169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051331.251013:0:103169:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d95071a600/0x85f51a6b967150b1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b5f11 expref: -99 pid: 103169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051331.251056:0:103169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d95071a600/0x85f51a6b967150b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5f11 expref: 12 pid: 103169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051331.251077:0:103169:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d95071a600/0x85f51a6b967150b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5f11 expref: 12 pid: 103169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051331.251094:0:103169:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d95071a600, rc 0) 00000100:00100000:2.0:1777051331.251187:0:103169:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942d2a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:29c4352d-3260-4734-909d-9ea5de9e7fa4+12:6255:x1863365425883648:12345-192.168.201.46@tcp:101:ll_cfg_requeue.0 Request processed in 225us (4373us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051331.251240:0:103169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 120 00010000:00080000:3.0:1777051331.259544:0:6580:0:(ldlm_lib.c:2086:extend_recovery_timer()) lustre-MDT0001: recovery timer will expire in 70 seconds 00000004:00100000:3.0:1777051331.259713:0:6580:0:(mdt_handler.c:7281:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type b7, return b7 00000100:00100000:2.0:1777051331.260400:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051331.260590:0:103163:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425883776 00000100:00100000:0.0:1777051331.260605:0:103163:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425883776 00000100:00100000:0.0:1777051331.260692:0:103163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 121 00000100:00080000:3.0:1777051331.260696:0:6580:0:(import.c:65:import_set_state_nolock()) ffff99da7dbeb800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1777051331.260715:0:103163:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942d29850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29c4352d-3260-4734-909d-9ea5de9e7fa4+12:6255:x1863365425883776:12345-192.168.201.46@tcp:256:ll_cfg_requeue.0 20000000:01000000:0.0:1777051331.260743:0:103163:0:(mgs_nids.c:912:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 16384. 20000000:01000000:0.0:1777051331.261087:0:103163:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1777051331.261094:0:103163:0:(mgs_nids.c:316:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 31 00000100:00100000:3.0:1777051331.261114:0:6580:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d9600b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+6:2435:x1863365425883520:12345-192.168.201.46@tcp:38:ll_cfg_requeue.0 Request processed in 14222us (14456us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051331.261133:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111770 00000100:00100000:2.0:1777051331.264897:0:103163:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942d29850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29c4352d-3260-4734-909d-9ea5de9e7fa4+12:6255:x1863365425883776:12345-192.168.201.46@tcp:256:ll_cfg_requeue.0 Request processed in 4185us (4498us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051331.264916:0:103163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 121 00000100:00100000:1.0:1777051331.269214:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051331.269268:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051331.269316:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051331.269359:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051331.269579:0:21368:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425883904 00000100:00100000:3.0:1777051331.269592:0:21368:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425883904 00000100:00100000:1.0:1777051331.269626:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051331.269679:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051331.269739:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051331.269789:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051331.269860:0:27885:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425884032 00000100:00100000:1.0:1777051331.269863:0:8492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425884160 00000100:00100000:0.0:1777051331.269873:0:27885:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425884032 00000100:00100000:1.0:1777051331.269874:0:8492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425884160 00000100:00100000:3.0:1777051331.269906:0:21368:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425884288 00000100:00100000:3.0:1777051331.269917:0:21368:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425884288 00000100:00100000:0.0:1777051331.269941:0:27885:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425884416 00000100:00100000:0.0:1777051331.269951:0:27885:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425884416 00000100:00100000:1.0:1777051331.269951:0:8492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425884544 00000100:00100000:1.0:1777051331.269962:0:8492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425884544 00000100:00100000:3.0:1777051331.269973:0:21368:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425884672 00000100:00100000:3.0:1777051331.269982:0:21368:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425884672 00000100:00100000:0.0:1777051331.270001:0:27885:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425884800 00000100:00100000:0.0:1777051331.270010:0:27885:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425884800 00000100:00100000:1.0:1777051331.270019:0:8492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111771 00000100:00100000:1.0:1777051331.270042:0:8492:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d9600b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+13:2435:x1863365425883904:12345-192.168.201.46@tcp:101:ldlm_lock_repla.0 00000100:00100000:3.0:1777051331.270056:0:21368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111772 00010000:00080000:1.0:1777051331.270073:0:8492:0:(ldlm_lib.c:3170:target_queue_recovery_request()) @@@ queue lock replay req req@ffff99d9600b9f80 x1863365425883904/t0(0) o101->2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp:292/0 lens 328/0 e 0 to 0 dl 1777051342 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777051331.270080:0:21368:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d9600ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+13:2435:x1863365425884032:12345-192.168.201.46@tcp:101:ldlm_lock_repla.0 00000100:00100000:0.0:1777051331.270084:0:27885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111773 00000100:00100000:0.0:1777051331.270112:0:27885:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d9600baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+13:2435:x1863365425884160:12345-192.168.201.46@tcp:101:ldlm_lock_repla.0 00000100:00100000:1.0:1777051331.270125:0:8492:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d9600b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+13:2435:x1863365425883904:12345-192.168.201.46@tcp:101:ldlm_lock_repla.0 Request processed in 87us (912us total) trans 0 rc 0/-999 00000100:00100000:1.0:1777051331.270139:0:8492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111771 00010000:00080000:0.0:1777051331.270145:0:27885:0:(ldlm_lib.c:3170:target_queue_recovery_request()) @@@ queue lock replay req req@ffff99d9600baa00 x1863365425884160/t0(0) o101->2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp:292/0 lens 328/0 e 0 to 0 dl 1777051342 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1777051331.270166:0:8492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111774 00000100:00100000:0.0:1777051331.270175:0:27885:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d9600baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+13:2435:x1863365425884160:12345-192.168.201.46@tcp:101:ldlm_lock_repla.0 Request processed in 68us (856us total) trans 0 rc 0/-999 00000100:00100000:1.0:1777051331.270188:0:8492:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+13:2435:x1863365425884288:12345-192.168.201.46@tcp:101:ldlm_lock_repla.0 00010000:00080000:1.0:1777051331.270210:0:8492:0:(ldlm_lib.c:3170:target_queue_recovery_request()) @@@ queue lock replay req req@ffff99da5f9be300 x1863365425884288/t0(0) o101->2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp:292/0 lens 328/0 e 0 to 0 dl 1777051342 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1777051331.270245:0:27885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111773 00010000:00080000:3.0:1777051331.270262:0:21368:0:(ldlm_lib.c:3170:target_queue_recovery_request()) @@@ queue lock replay req req@ffff99d9600ba680 x1863365425884032/t0(0) o101->2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp:292/0 lens 328/0 e 0 to 0 dl 1777051342 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1777051331.270275:0:8492:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+13:2435:x1863365425884288:12345-192.168.201.46@tcp:101:ldlm_lock_repla.0 Request processed in 87us (909us total) trans 0 rc 0/-999 00000100:00100000:0.0:1777051331.270278:0:27885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111775 00000100:00100000:0.0:1777051331.270301:0:27885:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+13:2435:x1863365425884416:12345-192.168.201.46@tcp:101:ldlm_lock_repla.0 00000100:00100000:1.0:1777051331.270319:0:8492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111774 00010000:00080000:0.0:1777051331.270326:0:27885:0:(ldlm_lib.c:3170:target_queue_recovery_request()) @@@ queue lock replay req req@ffff99da5f9bd880 x1863365425884416/t0(0) o101->2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp:292/0 lens 328/0 e 0 to 0 dl 1777051342 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1777051331.270351:0:8492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111776 00000100:00100000:0.0:1777051331.270366:0:27885:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+13:2435:x1863365425884416:12345-192.168.201.46@tcp:101:ldlm_lock_repla.0 Request processed in 70us (743us total) trans 0 rc 0/-999 00000100:00100000:1.0:1777051331.270380:0:8492:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+13:2435:x1863365425884544:12345-192.168.201.46@tcp:101:ldlm_lock_repla.0 00000100:00100000:3.0:1777051331.270384:0:21368:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d9600ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+13:2435:x1863365425884032:12345-192.168.201.46@tcp:101:ldlm_lock_repla.0 Request processed in 289us (1092us total) trans 0 rc 0/-999 00000100:00100000:0.0:1777051331.270393:0:27885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111775 00010000:00080000:1.0:1777051331.270409:0:8492:0:(ldlm_lib.c:3170:target_queue_recovery_request()) @@@ queue lock replay req req@ffff99da5f9bf800 x1863365425884544/t0(0) o101->2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp:292/0 lens 328/0 e 0 to 0 dl 1777051342 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777051331.270417:0:21368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111772 00000100:00100000:0.0:1777051331.270451:0:27885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111777 00000100:00100000:3.0:1777051331.270465:0:21368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111778 00000100:00100000:0.0:1777051331.270475:0:27885:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+13:2435:x1863365425884672:12345-192.168.201.46@tcp:101:ldlm_lock_repla.0 00010000:00080000:0.0:1777051331.270495:0:27885:0:(ldlm_lib.c:3170:target_queue_recovery_request()) @@@ queue lock replay req req@ffff99da5f9bc380 x1863365425884672/t0(0) o101->2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp:292/0 lens 328/0 e 0 to 0 dl 1777051342 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777051331.270532:0:21368:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+13:2435:x1863365425884800:12345-192.168.201.46@tcp:101:ldlm_lock_repla.0 00000100:00100000:0.0:1777051331.270557:0:27885:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+13:2435:x1863365425884672:12345-192.168.201.46@tcp:101:ldlm_lock_repla.0 Request processed in 94us (822us total) trans 0 rc 0/-999 00010000:00080000:3.0:1777051331.270567:0:21368:0:(ldlm_lib.c:3170:target_queue_recovery_request()) @@@ queue lock replay req req@ffff99da5f9bdf80 x1863365425884800/t0(0) o101->2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp:292/0 lens 328/0 e 0 to 0 dl 1777051342 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1777051331.270575:0:27885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111777 00000100:00100000:2.0:1777051331.270601:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051331.270612:0:21368:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+13:2435:x1863365425884800:12345-192.168.201.46@tcp:101:ldlm_lock_repla.0 Request processed in 129us (819us total) trans 0 rc 0/-999 00000100:00100000:3.0:1777051331.270625:0:21368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111778 00000100:00100000:0.0:1777051331.270642:0:6580:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425884928 00000100:00100000:0.0:1777051331.270652:0:6580:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425884928 00000100:00100000:0.0:1777051331.270696:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111779 00000100:00100000:0.0:1777051331.270707:0:6580:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7cd9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2435:x1863365425884928:12345-192.168.201.46@tcp:38:ll_cfg_requeue.0 00010000:00080000:0.0:1777051331.270743:0:6580:0:(ldlm_lib.c:926:target_handle_reconnect()) connect export for UUID 'c11b6966-0775-44d2-bdc6-c74c26eb2226' at ffff99da4622d800, cookie 0x85f51a6b96714fe6 00010000:00080000:0.0:1777051331.270753:0:6580:0:(ldlm_lib.c:1431:target_handle_connect()) lustre-MDT0001: connection from c11b6966-0775-44d2-bdc6-c74c26eb2226@192.168.201.46@tcp recovering/t0 exp ffff99da4622d800 cur 7960 last 1777051329 00000100:00100000:1.0:1777051331.270776:0:8492:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+13:2435:x1863365425884544:12345-192.168.201.46@tcp:101:ldlm_lock_repla.0 Request processed in 404us (1093us total) trans 0 rc 0/-999 00000004:00100000:0.0:1777051331.270781:0:6580:0:(mdt_handler.c:7281:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type b7, return b7 00000100:00100000:1.0:1777051331.270797:0:8492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111776 00010000:00080000:1.0:1777051331.270834:0:104234:0:(ldlm_lib.c:2531:check_for_recovery_ready()) connected 1 stale 0 max_recoverable_clients 3 abort 0 expired 0 00000100:00080000:0.0:1777051331.270841:0:6580:0:(import.c:65:import_set_state_nolock()) ffff99da71c6c000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1777051331.270929:0:6580:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7cd9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+6:2435:x1863365425884928:12345-192.168.201.46@tcp:38:ll_cfg_requeue.0 Request processed in 218us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051331.270943:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111779 00000100:00100000:3.0:1777051331.274708:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051331.274808:0:6579:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425885056 00000100:00100000:2.0:1777051331.274819:0:6579:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425885056 00000100:00100000:2.0:1777051331.274909:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13214 00000100:00100000:2.0:1777051331.274930:0:6579:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94e624a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+6:2435:x1863365425885056:12345-192.168.201.46@tcp:400:ldlm_lock_repla.0 00010000:00080000:2.0:1777051331.274955:0:6579:0:(ldlm_lib.c:3120:target_queue_recovery_request()) @@@ queue final req req@ffff99d94e624a80 x1863365425885056/t0(0) o400->c11b6966-0775-44d2-bdc6-c74c26eb2226@192.168.201.46@tcp:292/0 lens 224/0 e 0 to 0 dl 1777051342 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1777051331.274995:0:6579:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94e624a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+6:2435:x1863365425885056:12345-192.168.201.46@tcp:400:ldlm_lock_repla.0 Request processed in 75us (291us total) trans 0 rc 0/-999 00000100:00100000:2.0:1777051331.275008:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13214 00010000:00080000:0.0:1777051331.275059:0:104234:0:(ldlm_lib.c:2531:check_for_recovery_ready()) connected 2 stale 0 max_recoverable_clients 3 abort 0 expired 0 00000040:00080000:2.0:1777051331.479435:0:104226:0:(llog.c:858:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1777051331.671599:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1777051331.862776:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955504a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3678:1863365452567552:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1777051331.862778:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f9bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452567680:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1777051331.862885:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051331.862949:0:8473:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452567680 00000100:00100000:1.0:1777051331.862962:0:8473:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452567680 00000100:00100000:0.0:1777051331.863006:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051331.863062:0:8473:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452567552 00000100:00100000:1.0:1777051331.863071:0:8473:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452567552 00000100:00100000:0.0:1777051331.863089:0:10113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5580 00000100:00100000:0.0:1777051331.863401:0:10113:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955505180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3679:x1863365452567680:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1777051331.863418:0:8473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5581 00000100:00100000:1.0:1777051331.863436:0:8473:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955506a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3678:x1863365452567552:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1777051331.863449:0:10113:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 430293440 pending 0 free 3645853696 avail 3414331392 00002000:00000024:1.0:1777051331.863476:0:8473:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 440353216 pending 0 free 3862671360 avail 3631149056 00000100:00100000:0.0:1777051331.863570:0:10113:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955505180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3679:x1863365452567680:12345-0@lo:13:osp-pre-1-0.0 Request processed in 462us (680us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051331.863586:0:10113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5580 00000100:00100000:1.0:1777051331.863607:0:8473:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955506a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3678:x1863365452567552:12345-0@lo:13:osp-pre-0-0.0 Request processed in 173us (600us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051331.863622:0:8473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5581 00000100:00080000:1.0:1777051331.863671:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1777051331.863679:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1777051331.863692:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955504a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3678:1863365452567552:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1777051331.864419:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f9bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452567680:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1777051332.695451:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1777051333.068754:0:104458:0:(debug.c:645:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg146-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:2.0:1777051333.540349:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051333.540501:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051333.540577:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051333.540602:0:27885:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425885312 00000100:00100000:1.0:1777051333.540619:0:27885:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425885312 00000100:00100000:0.0:1777051333.540622:0:103166:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425885184 00000100:00100000:2.0:1777051333.540633:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051333.540636:0:103166:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425885184 00000100:00100000:2.0:1777051333.540691:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051333.540727:0:27885:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425885696 00000100:00100000:1.0:1777051333.540738:0:27885:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425885696 00000100:00100000:0.0:1777051333.540741:0:103166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 122 00000100:00100000:2.0:1777051333.541043:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051333.541054:0:103166:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942d28c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29c4352d-3260-4734-909d-9ea5de9e7fa4+12:2436:x1863365425885184:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:1.0:1777051333.541093:0:27885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13215 00000100:00100000:1.0:1777051333.541121:0:27885:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7cd9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c11b6966-0775-44d2-bdc6-c74c26eb2226+14:2437:x1863365425885312:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:2.0:1777051333.541122:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051333.541186:0:103166:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942d28c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29c4352d-3260-4734-909d-9ea5de9e7fa4+12:2436:x1863365425885184:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 424us (1114us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051333.541196:0:27885:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7cd9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c11b6966-0775-44d2-bdc6-c74c26eb2226+14:2437:x1863365425885312:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 87us (722us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051333.541208:0:27885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13215 00000100:00100000:1.0:1777051333.541244:0:27885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13216 00000100:00100000:0.0:1777051333.541253:0:103166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 122 00000100:00100000:1.0:1777051333.541264:0:27885:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7cd9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+17:2436:x1863365425885696:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:0.0:1777051333.541336:0:8628:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425885568 00000100:00100000:0.0:1777051333.541344:0:8628:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425885568 00000100:00100000:2.0:1777051333.541388:0:27887:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425885440 00000100:00100000:2.0:1777051333.541397:0:27887:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425885440 00000100:00100000:1.0:1777051333.541398:0:27885:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7cd9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+17:2436:x1863365425885696:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 138us (706us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051333.541415:0:8628:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425885824 00000100:00100000:1.0:1777051333.541417:0:27885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13216 00000100:00100000:0.0:1777051333.541425:0:8628:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425885824 00000100:00100000:2.0:1777051333.541454:0:27887:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425885952 00000100:00100000:2.0:1777051333.541461:0:27887:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425885952 00000100:00100000:1.0:1777051333.541527:0:24468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10286 00000100:00100000:0.0:1777051333.541545:0:8628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10287 00000100:00100000:1.0:1777051333.541555:0:24468:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7cd9e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+48:2437:x1863365425885568:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:0.0:1777051333.541572:0:8628:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7cd9df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+50:2436:x1863365425885440:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:2.0:1777051333.541574:0:27887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10288 00000100:00100000:2.0:1777051333.541602:0:27887:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d944e13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+50:2437:x1863365425885824:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:1.0:1777051333.541638:0:24468:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7cd9e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+48:2437:x1863365425885568:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 94us (1061us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051333.541653:0:8628:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7cd9df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+50:2436:x1863365425885440:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 88us (1019us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051333.541660:0:24468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10286 00000100:00100000:2.0:1777051333.541674:0:27887:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d944e13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+50:2437:x1863365425885824:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 79us (631us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051333.541698:0:8628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10287 00000100:00100000:2.0:1777051333.541712:0:27887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10288 00000100:00100000:1.0:1777051333.541724:0:24468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10289 00000100:00100000:1.0:1777051333.541743:0:24468:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d944e10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+47:2436:x1863365425885952:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:1.0:1777051333.541790:0:24468:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d944e10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+47:2436:x1863365425885952:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 54us (677us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051333.541803:0:24468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10289 00000100:00080000:1.0:1777051333.541851:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1777051333.541860:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1777051333.541865:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1777051333.718812:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1777051333.771444:0:104510:0:(tgt_mount.c:2297:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1777051333.772978:0:104510:0:(tgt_mount.c:2312:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1777051334.422945:0:3679:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1777051334.422981:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94e624380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452567808:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1777051334.423081:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051334.423755:0:46500:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452567808 00000100:00100000:0.0:1777051334.423769:0:46500:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452567808 00000100:00100000:0.0:1777051334.423861:0:46500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8056 00000100:00100000:0.0:1777051334.423878:0:46500:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+9:3679:x1863365452567808:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1777051334.423935:0:46500:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4194304 pending 0 free 1441644544 avail 1295405056 00000100:00100000:0.0:1777051334.424067:0:46500:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+9:3679:x1863365452567808:12345-0@lo:41:osp-pre-0-1.0 Request processed in 191us (985us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051334.424082:0:46500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8056 00000100:00100000:1.0:1777051334.424167:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94e624380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452567808:0@lo:41:osp-pre-0-1.0 00000020:00000004:2.0:1777051334.648415:0:104560:0:(tgt_mount.c:2297:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1777051334.648836:0:104560:0:(tgt_mount.c:2312:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1777051334.742539:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1777051334.934748:0:48457:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1777051334.934756:0:48457:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1777051334.934763:0:48457:0:(import.c:65:import_set_state_nolock()) ffff99d941838000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1777051334.934781:0:48457:0:(import.c:623:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff99d941838000 using connection 192.168.201.146@tcp/0@lo 00000100:00100000:3.0:1777051334.934815:0:48457:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99da5fbec380 x1863365452568192/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1777051334.934878:0:48457:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1777051334.934885:0:48457:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1777051334.934889:0:48457:0:(import.c:65:import_set_state_nolock()) ffff99d942a20000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1777051334.934900:0:48457:0:(import.c:623:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff99d942a20000 using connection 192.168.201.146@tcp/0@lo 00000100:00100000:1.0:1777051334.934916:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5fbed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3679:1863365452568320:0@lo:400:kworker.0 00000100:00100000:3.0:1777051334.934928:0:48457:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d96040ad80 x1863365452568448/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1777051334.934946:0:48457:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1777051334.934952:0:48457:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1777051334.934956:0:48457:0:(import.c:65:import_set_state_nolock()) ffff99da42f4c800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1777051334.934964:0:48457:0:(import.c:623:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff99da42f4c800 using connection 192.168.201.146@tcp/0@lo 00000100:00100000:3.0:1777051334.934988:0:48457:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d96040b100 x1863365452568576/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1777051334.935029:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051334.935141:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d960409f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452569088:0@lo:400:kworker.0 00000100:00100000:1.0:1777051334.935253:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051334.935301:0:3679:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1777051334.935317:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d96040a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452568704:0@lo:400:kworker.0 00000100:00100000:3.0:1777051334.935325:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94e624380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3677:1863365452567936:0@lo:400:kworker.0 00000100:00100000:3.0:1777051334.935386:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051334.935423:0:3676:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5fbec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3676:1863365452568192:0@lo:38:kworker.0 00000100:00100000:3.0:1777051334.935438:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d960408700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3677:1863365452568832:0@lo:400:kworker.0 00000100:00100000:1.0:1777051334.935518:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051334.935521:0:6585:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452569088 00000100:00100000:0.0:1777051334.935534:0:6585:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452569088 00000100:00100000:2.0:1777051334.935546:0:3676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051334.935561:0:103165:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452567936 00000100:00100000:3.0:1777051334.935571:0:103165:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452567936 00000100:00100000:1.0:1777051334.935599:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d96040b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452569216:0@lo:400:kworker.0 00000100:00100000:2.0:1777051334.935607:0:3676:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d96040ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3676:1863365452568448:0@lo:38:kworker.0 00000100:00100000:0.0:1777051334.935618:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8057 00000100:00100000:0.0:1777051334.935639:0:6585:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:3679:x1863365452569088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051334.935646:0:103165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1777051334.935662:0:103165:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942d28050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9351a01-5b0e-4470-97fd-58b9b4b312a2+23:3677:x1863365452567936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777051334.935676:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051334.935835:0:3676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051334.935930:0:27882:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452568320 00000100:00100000:1.0:1777051334.935939:0:27882:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452568320 00000100:00100000:2.0:1777051334.935942:0:3676:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d96040b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3676:1863365452568576:0@lo:38:kworker.0 00000100:00100000:3.0:1777051334.935961:0:103165:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942d28050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9351a01-5b0e-4470-97fd-58b9b4b312a2+23:3677:x1863365452567936:12345-0@lo:400:kworker.0 Request processed in 299us (570us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051334.935976:0:6585:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:3679:x1863365452569088:12345-0@lo:400:kworker.0 Request processed in 339us (717us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051334.935984:0:103165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1777051334.936004:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8057 00000100:00100000:2.0:1777051334.936009:0:3676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051334.936014:0:27882:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452568192 00000100:00100000:1.0:1777051334.936022:0:27882:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452568192 00000100:00100000:0.0:1777051334.936049:0:6585:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452568576 00000100:00100000:0.0:1777051334.936059:0:6585:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452568576 00000100:00100000:1.0:1777051334.936076:0:27882:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452568448 00000100:00100000:1.0:1777051334.936085:0:27882:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452568448 00000100:00100000:3.0:1777051334.936087:0:46497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13217 00000100:00100000:2.0:1777051334.936092:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5fbeca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3678:1863365452568064:0@lo:400:kworker.0 00000100:00100000:3.0:1777051334.936110:0:46497:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:lustre-MDT0000-lwp-OST0001_UUID+5:3679:x1863365452568320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777051334.936117:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8058 00000100:00100000:0.0:1777051334.936130:0:6585:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d944e10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3676:x1863365452568576:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1777051334.936148:0:27882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111780 00000100:00100000:2.0:1777051334.936150:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1777051334.936161:0:6585:0:(ldlm_lib.c:926:target_handle_reconnect()) connect export for UUID 'lustre-MDT0000-mdtlov_UUID' at ffff99da4622c800, cookie 0x85f51a6b96714fdf 00010000:00080000:0.0:1777051334.936173:0:6585:0:(ldlm_lib.c:1431:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo recovering/t0 exp ffff99da4622c800 cur 7964 last 1777051329 00000100:00100000:1.0:1777051334.936190:0:27882:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d944e11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0+-99:3676:x1863365452568192:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1777051334.936234:0:46497:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:lustre-MDT0000-lwp-OST0001_UUID+5:3679:x1863365452568320:12345-0@lo:400:kworker.0 Request processed in 94us (1169us total) trans 0 rc 0/0 00000004:00100000:0.0:1777051334.936250:0:6585:0:(mdt_handler.c:7285:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:3.0:1777051334.936258:0:46497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13217 00000100:00100000:2.0:1777051334.936260:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d960408000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3678:1863365452568960:0@lo:400:kworker.0 00010000:00080000:1.0:1777051334.936275:0:27882:0:(ldlm_lib.c:1431:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 7964 last 0 00000100:00100000:3.0:1777051334.936298:0:46497:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452568064 00000100:00100000:3.0:1777051334.936307:0:46497:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452568064 00000100:00100000:2.0:1777051334.936326:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:1.0:1777051334.936361:0:27882:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x85f51a6b967150b8 00000100:00100000:2.0:1777051334.936363:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d96040aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3678:1863365452569472:0@lo:400:kworker.0 00000100:00100000:3.0:1777051334.936373:0:46497:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452568960 00000100:00100000:3.0:1777051334.936379:0:46497:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452568960 00000004:00100000:1.0:1777051334.936387:0:27882:0:(mdt_handler.c:7285:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:2.0:1777051334.936424:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051334.936436:0:46497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13218 00000100:00080000:1.0:1777051334.936484:0:27882:0:(import.c:65:import_set_state_nolock()) ffff99da7fb79800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1777051334.936484:0:46497:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d944e11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:lustre-MDT0000-lwp-OST0000_UUID+5:3678:x1863365452568064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777051334.936504:0:46494:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452569472 00000100:00100000:2.0:1777051334.936512:0:46494:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452569472 00000100:00100000:2.0:1777051334.936561:0:46494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13219 00000100:00100000:2.0:1777051334.936576:0:46494:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d944e10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000-lwp-MDT0000_UUID+5:3678:x1863365452568960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051334.936592:0:46497:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d944e11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:lustre-MDT0000-lwp-OST0000_UUID+5:3678:x1863365452568064:12345-0@lo:400:kworker.0 Request processed in 141us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051334.936606:0:27882:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d944e11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0000_UUID+5:3676:x1863365452568192:12345-0@lo:38:kworker.0 Request processed in 440us (1059us total) trans 0 rc 0/0 00000100:00080000:0.0:1777051334.936612:0:6585:0:(import.c:65:import_set_state_nolock()) ffff99da71c6d000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1777051334.936612:0:46497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13218 00000100:00100000:1.0:1777051334.936635:0:27882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111780 00000100:00100000:2.0:1777051334.936641:0:46494:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d944e10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000-lwp-MDT0000_UUID+5:3678:x1863365452568960:12345-0@lo:400:kworker.0 Request processed in 66us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051334.936653:0:46494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13219 00000100:00100000:3.0:1777051334.936665:0:46497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13220 00000100:00100000:3.0:1777051334.936681:0:46497:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d944e12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:lustre-MDT0000-lwp-MDT0001_UUID+5:3678:x1863365452569472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777051334.936689:0:27882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111781 00000100:00100000:1.0:1777051334.936703:0:27882:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d944e13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0+-99:3676:x1863365452568448:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1777051334.936729:0:6585:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d944e10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3676:x1863365452568576:12345-0@lo:38:kworker.0 Request processed in 593us (725us total) trans 0 rc 0/0 00010000:00080000:1.0:1777051334.936735:0:27882:0:(ldlm_lib.c:1431:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 7964 last 0 00000100:00100000:2.0:1777051334.936758:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5fbeca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3678:1863365452568064:0@lo:400:kworker.0 00000100:00100000:0.0:1777051334.936759:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8058 00000100:00100000:3.0:1777051334.936763:0:46497:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d944e12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:lustre-MDT0000-lwp-MDT0001_UUID+5:3678:x1863365452569472:12345-0@lo:400:kworker.0 Request processed in 86us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051334.936781:0:46497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13220 00000020:00000080:1.0:1777051334.936798:0:27882:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x85f51a6b967150bf 00000100:00100000:2.0:1777051334.936804:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d960408000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3678:1863365452568960:0@lo:400:kworker.0 00000004:00100000:1.0:1777051334.936819:0:27882:0:(mdt_handler.c:7285:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:3.0:1777051334.936829:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051334.936835:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d96040aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3678:1863365452569472:0@lo:400:kworker.0 00000100:00100000:0.0:1777051334.936849:0:8628:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452568704 00000100:00100000:0.0:1777051334.936859:0:8628:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452568704 00000100:00080000:1.0:1777051334.936874:0:27882:0:(import.c:65:import_set_state_nolock()) ffff99d9588e5000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1777051334.936875:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d960409500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452569344:0@lo:400:kworker.0 00000100:00100000:3.0:1777051334.936932:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051334.936934:0:8628:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452569216 00000100:00100000:0.0:1777051334.936942:0:8628:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452569216 00000100:00100000:1.0:1777051334.936982:0:27882:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d944e13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0001_UUID+5:3676:x1863365452568448:12345-0@lo:38:kworker.0 Request processed in 276us (1145us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051334.937001:0:8628:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452568832 00000100:00100000:1.0:1777051334.937001:0:27882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111781 00000100:00100000:3.0:1777051334.937001:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94e624380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3677:1863365452567936:0@lo:400:kworker.0 00000100:00100000:0.0:1777051334.937011:0:8628:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452568832 00000100:00100000:1.0:1777051334.937078:0:13320:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452569344 00000100:00100000:1.0:1777051334.937087:0:13320:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452569344 00000100:00100000:0.0:1777051334.937089:0:8628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10290 00000100:00100000:3.0:1777051334.937106:0:27887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10291 00000100:00100000:0.0:1777051334.937114:0:8628:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3679:x1863365452568704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777051334.937127:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10292 00000100:00100000:3.0:1777051334.937416:0:27887:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+6:3679:x1863365452569216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777051334.937428:0:8471:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d96040b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3677:x1863365452568832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777051334.937724:0:13320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10293 00000100:00100000:0.0:1777051334.937742:0:8628:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3679:x1863365452568704:12345-0@lo:400:kworker.0 Request processed in 635us (2226us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051334.937748:0:13320:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d960409c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:3677:x1863365452569344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777051334.937767:0:8628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10290 00000100:00100000:1.0:1777051334.937834:0:13320:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d960409c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:3677:x1863365452569344:12345-0@lo:400:kworker.0 Request processed in 92us (900us total) trans 0 rc 0/0 00010000:00080000:0.0:1777051334.937841:0:104234:0:(ldlm_lib.c:2531:check_for_recovery_ready()) connected 3 stale 0 max_recoverable_clients 3 abort 0 expired 0 00010000:00080000:0.0:1777051334.937851:0:104234:0:(ldlm_lib.c:2669:replay_request_or_update()) Waiting for transno 4294970574 00000100:00100000:1.0:1777051334.937851:0:13320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10293 00000020:00080000:0.0:1777051334.937861:0:104234:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0001: Next update transno 0 00010000:00080000:0.0:1777051334.937867:0:104234:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294970574 00000020:00080000:0.0:1777051334.937872:0:104234:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0001: Next update transno 0 00010000:00080000:0.0:1777051334.937876:0:104234:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294970574 00000100:00080000:1.0:1777051334.937907:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1777051334.937914:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1777051334.937918:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1777051334.938382:0:3676:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99da5fbec380 x1863365452568192/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1777051359 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1777051334.938406:0:3676:0:(import.c:1130:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 2 00000100:00100000:0.0:1777051334.938630:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d96040a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452568704:0@lo:400:kworker.0 00000100:00100000:0.0:1777051334.938726:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d960409f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452569088:0@lo:400:kworker.0 00000100:00100000:0.0:1777051334.938745:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5fbed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3679:1863365452568320:0@lo:400:kworker.0 00000100:00100000:3.0:1777051334.938911:0:27887:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+6:3679:x1863365452569216:12345-0@lo:400:kworker.0 Request processed in 1788us (3242us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051334.938922:0:27887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10291 00000100:00100000:3.0:1777051334.938969:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d960409500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452569344:0@lo:400:kworker.0 00000100:00100000:0.0:1777051334.939186:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d96040b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452569216:0@lo:400:kworker.0 00000001:00100000:0.0:1777051334.940426:0:9540:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00080000:1.0:1777051334.940623:0:3676:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0001-lwp-OST0000: lwp recover req@ffff99da5fbec380 x1863365452568192/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1777051359 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1777051334.940638:0:3676:0:(import.c:65:import_set_state_nolock()) ffff99d941838000 lustre-MDT0001_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:1.0:1777051334.940647:0:3676:0:(import.c:65:import_set_state_nolock()) ffff99d941838000 lustre-MDT0001_UUID: changing import state from RECOVER to FULL 00000100:00100000:2.0:1777051334.940649:0:8471:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d96040b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3677:x1863365452568832:12345-0@lo:400:kworker.0 Request processed in 3227us (3818us total) trans 0 rc 0/0 00000100:02000000:1.0:1777051334.940962:0:3676:0:(import.c:1737:ptlrpc_import_recovery_state_machine()) lustre-MDT0001-lwp-OST0000: Connection restored to 0@lo (at 0@lo) 00000100:00100000:2.0:1777051334.940967:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10292 00000100:00100000:3.0:1777051334.941018:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d960408700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3677:1863365452568832:0@lo:400:kworker.0 00000001:00080000:0.0:1777051334.943370:0:103159:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771077 is committed 00000100:00100000:1.0:1777051334.963025:0:3676:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5fbec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3676:1863365452568192:0@lo:38:kworker.0 00010000:00080000:0.0:1777051334.963515:0:3676:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99d96040ad80 x1863365452568448/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1777051359 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1777051334.963542:0:3676:0:(import.c:1130:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 2 00000001:00100000:1.0:1777051334.965076:0:8464:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00080000:0.0:1777051334.965386:0:3676:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0001-lwp-OST0001: lwp recover req@ffff99d96040ad80 x1863365452568448/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1777051359 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1777051334.965402:0:3676:0:(import.c:65:import_set_state_nolock()) ffff99d942a20000 lustre-MDT0001_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:0.0:1777051334.965409:0:3676:0:(import.c:65:import_set_state_nolock()) ffff99d942a20000 lustre-MDT0001_UUID: changing import state from RECOVER to FULL 00000100:02000000:0.0:1777051334.965414:0:3676:0:(import.c:1737:ptlrpc_import_recovery_state_machine()) lustre-MDT0001-lwp-OST0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:0.0:1777051334.965419:0:3676:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d96040ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3676:1863365452568448:0@lo:38:kworker.0 00000100:00080000:0.0:1777051334.965448:0:3676:0:(import.c:1130:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1777051334.965486:0:3676:0:(import.c:65:import_set_state_nolock()) ffff99da42f4c800 lustre-MDT0001_UUID: changing import state from CONNECTING to REPLAY 00000100:00080000:0.0:1777051334.965493:0:3676:0:(import.c:1694:ptlrpc_import_recovery_state_machine()) replay requested by lustre-MDT0001_UUID 00000100:00080000:0.0:1777051334.965498:0:3676:0:(recover.c:53:ptlrpc_replay_next()) import ffff99da42f4c800 from lustre-MDT0001_UUID committed 0 last 0 00000100:00080000:0.0:1777051334.965503:0:3676:0:(import.c:65:import_set_state_nolock()) ffff99da42f4c800 lustre-MDT0001_UUID: changing import state from REPLAY to REPLAY_LOCKS 00000100:00100000:1.0:1777051334.966075:0:3676:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d96040b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3676:1863365452568576:0@lo:38:kworker.0 00010000:00080000:0.0:1777051334.966152:0:104572:0:(ldlm_request.c:2960:ldlm_lock_replay_thread()) lock replay thread lustre-MDT0001-osp-MDT0000 to lustre-MDT0001_UUID@0@lo 00010000:00010000:0.0:1777051334.966160:0:104572:0:(ldlm_request.c:2876:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-MDT0001-osp-MDT0000 (0) 00010000:00010000:0.0:1777051334.966168:0:104572:0:(ldlm_request.c:2889:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-MDT0001-osp-MDT0000 00000100:00080000:0.0:1777051334.967648:0:104572:0:(import.c:65:import_set_state_nolock()) ffff99da42f4c800 lustre-MDT0001_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000100:00100000:1.0:1777051334.967774:0:3676:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955504a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3676:1863365452569600:0@lo:400:ldlm_lock_repla.0 00000100:00100000:1.0:1777051334.967854:0:3676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051334.967985:0:46500:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452569600 00000100:00100000:0.0:1777051334.967996:0:46500:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452569600 00000100:00100000:0.0:1777051334.968371:0:46500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8059 00000100:00100000:0.0:1777051334.968390:0:46500:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+6:3676:x1863365452569600:12345-0@lo:400:ldlm_lock_repla.0 00010000:00080000:0.0:1777051334.968416:0:46500:0:(ldlm_lib.c:3120:target_queue_recovery_request()) @@@ queue final req req@ffff99da5f9bce00 x1863365452569600/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:295/0 lens 224/0 e 0 to 0 dl 1777051345 ref 2 fl Interpret:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1777051334.968485:0:46500:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+6:3676:x1863365452569600:12345-0@lo:400:ldlm_lock_repla.0 Request processed in 100us (631us total) trans 0 rc 0/-999 00000100:00100000:0.0:1777051334.968499:0:46500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8059 00000020:00080000:2.0:1777051334.968524:0:104234:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0001: Next update transno 0 00010000:00080000:2.0:1777051334.968532:0:104234:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 3, connected: 3, completed: 3, queue_len: 0, req_transno: 0, next_transno: 4294970574 00010000:00080000:2.0:1777051334.968539:0:104234:0:(ldlm_lib.c:2248:check_for_next_transno()) waking for completed recovery 00000020:00080000:2.0:1777051334.968543:0:104234:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0001: Next update transno 0 00010000:00080000:2.0:1777051334.968583:0:104234:0:(ldlm_lib.c:2438:target_next_replay_lock()) Waiting for lock 00010000:00080000:2.0:1777051334.968588:0:104234:0:(ldlm_lib.c:2268:check_for_next_lock()) waking for next lock 00010000:00080000:2.0:1777051334.968604:0:104234:0:(ldlm_lib.c:2871:target_recovery_thread()) @@@ processing lock from 192.168.201.46@tcp: req@ffff99d9600b9f80 x1863365425883904/t0(0) o101->2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp:292/0 lens 328/0 e 0 to 0 dl 1777051342 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1777051334.968629:0:104234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051334.968659:0:104234:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d95071a400/0x85f51a6b967150c6 lrc: 2/0,0 mode: --/PR res: [0x240000403:0xbc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f64af5e4 expref: -99 pid: 104234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051334.968691:0:104234:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d95071a400/0x85f51a6b967150c6 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0xbc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f64af5e4 expref: 14 pid: 104234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051334.968716:0:104234:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99d95071a400/0x85f51a6b967150c6 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0xbc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f64af5e4 expref: 14 pid: 104234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051334.968740:0:104234:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d95071a400, rc 0) 00010000:00080000:2.0:1777051334.968818:0:104234:0:(ldlm_lib.c:2086:extend_recovery_timer()) lustre-MDT0001: recovery timer will expire in 100 seconds 00010000:00080000:2.0:1777051334.968835:0:104234:0:(ldlm_lib.c:2438:target_next_replay_lock()) Waiting for lock 00010000:00080000:2.0:1777051334.968839:0:104234:0:(ldlm_lib.c:2268:check_for_next_lock()) waking for next lock 00010000:00080000:2.0:1777051334.968848:0:104234:0:(ldlm_lib.c:2871:target_recovery_thread()) @@@ processing lock from 192.168.201.46@tcp: req@ffff99d9600baa00 x1863365425884160/t0(0) o101->2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp:292/0 lens 328/0 e 0 to 0 dl 1777051342 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1777051334.968870:0:104234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051334.968895:0:104234:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d95071a200/0x85f51a6b967150cd lrc: 2/0,0 mode: --/PR res: [0x240000403:0xdb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f64b00b8 expref: -99 pid: 104234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051334.968920:0:104234:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d95071a200/0x85f51a6b967150cd lrc: 3/0,0 mode: PR/PR res: [0x240000403:0xdb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f64b00b8 expref: 14 pid: 104234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051334.968937:0:104234:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99d95071a200/0x85f51a6b967150cd lrc: 3/0,0 mode: PR/PR res: [0x240000403:0xdb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f64b00b8 expref: 14 pid: 104234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051334.968952:0:104234:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d95071a200, rc 0) 00010000:00080000:2.0:1777051334.968999:0:104234:0:(ldlm_lib.c:2086:extend_recovery_timer()) lustre-MDT0001: recovery timer will expire in 100 seconds 00010000:00080000:2.0:1777051334.969015:0:104234:0:(ldlm_lib.c:2438:target_next_replay_lock()) Waiting for lock 00010000:00080000:2.0:1777051334.969019:0:104234:0:(ldlm_lib.c:2268:check_for_next_lock()) waking for next lock 00010000:00080000:2.0:1777051334.969030:0:104234:0:(ldlm_lib.c:2871:target_recovery_thread()) @@@ processing lock from 192.168.201.46@tcp: req@ffff99da5f9be300 x1863365425884288/t0(0) o101->2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp:292/0 lens 328/0 e 0 to 0 dl 1777051342 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1777051334.969049:0:104234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051334.969086:0:104234:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d95071a800/0x85f51a6b967150d4 lrc: 2/0,0 mode: --/PR res: [0x240000403:0x19a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f64b434d expref: -99 pid: 104234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051334.969118:0:104234:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d95071a800/0x85f51a6b967150d4 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x19a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f64b434d expref: 14 pid: 104234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051334.969135:0:104234:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99d95071a800/0x85f51a6b967150d4 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x19a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f64b434d expref: 14 pid: 104234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051334.969148:0:104234:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d95071a800, rc 0) 00010000:00080000:2.0:1777051334.969493:0:104234:0:(ldlm_lib.c:2086:extend_recovery_timer()) lustre-MDT0001: recovery timer will expire in 100 seconds 00010000:00080000:2.0:1777051334.969508:0:104234:0:(ldlm_lib.c:2438:target_next_replay_lock()) Waiting for lock 00010000:00080000:2.0:1777051334.969511:0:104234:0:(ldlm_lib.c:2268:check_for_next_lock()) waking for next lock 00010000:00080000:2.0:1777051334.969521:0:104234:0:(ldlm_lib.c:2871:target_recovery_thread()) @@@ processing lock from 192.168.201.46@tcp: req@ffff99d9600ba680 x1863365425884032/t0(0) o101->2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp:292/0 lens 328/0 e 0 to 0 dl 1777051342 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1777051334.969548:0:104234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051334.969568:0:104234:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d95071b400/0x85f51a6b967150db lrc: 2/0,0 mode: --/PR res: [0x240000403:0xfb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f64b0c96 expref: -99 pid: 104234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051334.969592:0:104234:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d95071b400/0x85f51a6b967150db lrc: 3/0,0 mode: PR/PR res: [0x240000403:0xfb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f64b0c96 expref: 14 pid: 104234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051334.969607:0:104234:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99d95071b400/0x85f51a6b967150db lrc: 3/0,0 mode: PR/PR res: [0x240000403:0xfb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f64b0c96 expref: 14 pid: 104234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051334.969619:0:104234:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d95071b400, rc 0) 00010000:00080000:2.0:1777051334.969648:0:104234:0:(ldlm_lib.c:2086:extend_recovery_timer()) lustre-MDT0001: recovery timer will expire in 100 seconds 00010000:00080000:2.0:1777051334.969662:0:104234:0:(ldlm_lib.c:2438:target_next_replay_lock()) Waiting for lock 00010000:00080000:2.0:1777051334.969665:0:104234:0:(ldlm_lib.c:2268:check_for_next_lock()) waking for next lock 00010000:00080000:2.0:1777051334.969677:0:104234:0:(ldlm_lib.c:2871:target_recovery_thread()) @@@ processing lock from 192.168.201.46@tcp: req@ffff99da5f9bd880 x1863365425884416/t0(0) o101->2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp:292/0 lens 328/0 e 0 to 0 dl 1777051342 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1777051334.969695:0:104234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051334.969714:0:104234:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d95071aa00/0x85f51a6b967150e2 lrc: 2/0,0 mode: --/PR res: [0x240000403:0x17a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f64b37ca expref: -99 pid: 104234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051334.970038:0:104234:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d95071aa00/0x85f51a6b967150e2 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x17a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f64b37ca expref: 14 pid: 104234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051334.970059:0:104234:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99d95071aa00/0x85f51a6b967150e2 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x17a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f64b37ca expref: 14 pid: 104234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051334.970074:0:104234:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d95071aa00, rc 0) 00010000:00080000:2.0:1777051334.970112:0:104234:0:(ldlm_lib.c:2086:extend_recovery_timer()) lustre-MDT0001: recovery timer will expire in 100 seconds 00010000:00080000:2.0:1777051334.970129:0:104234:0:(ldlm_lib.c:2438:target_next_replay_lock()) Waiting for lock 00010000:00080000:2.0:1777051334.970133:0:104234:0:(ldlm_lib.c:2268:check_for_next_lock()) waking for next lock 00010000:00080000:2.0:1777051334.970143:0:104234:0:(ldlm_lib.c:2871:target_recovery_thread()) @@@ processing lock from 192.168.201.46@tcp: req@ffff99da5f9bc380 x1863365425884672/t0(0) o101->2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp:292/0 lens 328/0 e 0 to 0 dl 1777051342 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1777051334.970162:0:104234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051334.970182:0:104234:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d95071be00/0x85f51a6b967150e9 lrc: 2/0,0 mode: --/PR res: [0x240000403:0xb9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f64af822 expref: -99 pid: 104234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051334.970233:0:104234:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d95071be00/0x85f51a6b967150e9 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0xb9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f64af822 expref: 14 pid: 104234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051334.970249:0:104234:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99d95071be00/0x85f51a6b967150e9 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0xb9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f64af822 expref: 14 pid: 104234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051334.970271:0:104234:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d95071be00, rc 0) 00010000:00080000:2.0:1777051334.970312:0:104234:0:(ldlm_lib.c:2086:extend_recovery_timer()) lustre-MDT0001: recovery timer will expire in 100 seconds 00010000:00080000:2.0:1777051334.970324:0:104234:0:(ldlm_lib.c:2438:target_next_replay_lock()) Waiting for lock 00010000:00080000:2.0:1777051334.970326:0:104234:0:(ldlm_lib.c:2268:check_for_next_lock()) waking for next lock 00010000:00080000:2.0:1777051334.970334:0:104234:0:(ldlm_lib.c:2871:target_recovery_thread()) @@@ processing lock from 192.168.201.46@tcp: req@ffff99da5f9bdf80 x1863365425884800/t0(0) o101->2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp:292/0 lens 328/0 e 0 to 0 dl 1777051342 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1777051334.970348:0:104234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051334.970370:0:104234:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d95071b200/0x85f51a6b967150f0 lrc: 2/0,0 mode: --/PR res: [0x240000403:0x177:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f64b3611 expref: -99 pid: 104234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051334.970395:0:104234:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d95071b200/0x85f51a6b967150f0 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x177:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f64b3611 expref: 14 pid: 104234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051334.970412:0:104234:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99d95071b200/0x85f51a6b967150f0 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x177:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f64b3611 expref: 14 pid: 104234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051334.970425:0:104234:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d95071b200, rc 0) 00010000:00080000:2.0:1777051334.970484:0:104234:0:(ldlm_lib.c:2086:extend_recovery_timer()) lustre-MDT0001: recovery timer will expire in 100 seconds 00010000:00080000:2.0:1777051334.970499:0:104234:0:(ldlm_lib.c:2438:target_next_replay_lock()) Waiting for lock 00010000:00080000:2.0:1777051334.970502:0:104234:0:(ldlm_lib.c:2268:check_for_next_lock()) waking for next lock 00010000:00080000:2.0:1777051334.970513:0:104234:0:(ldlm_lib.c:2871:target_recovery_thread()) @@@ processing lock from 192.168.201.46@tcp: req@ffff99da5f9bf800 x1863365425884544/t0(0) o101->2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp:292/0 lens 328/0 e 0 to 0 dl 1777051342 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1777051334.970532:0:104234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051334.970553:0:104234:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e9d6200/0x85f51a6b967150f7 lrc: 2/0,0 mode: --/PR res: [0x240000403:0xda:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f64b01de expref: -99 pid: 104234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051334.970586:0:104234:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e9d6200/0x85f51a6b967150f7 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0xda:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f64b01de expref: 14 pid: 104234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051334.970602:0:104234:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e9d6200/0x85f51a6b967150f7 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0xda:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f64b01de expref: 14 pid: 104234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051334.970614:0:104234:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d94e9d6200, rc 0) 00010000:00080000:2.0:1777051334.970663:0:104234:0:(ldlm_lib.c:2086:extend_recovery_timer()) lustre-MDT0001: recovery timer will expire in 100 seconds 00010000:00080000:2.0:1777051334.970674:0:104234:0:(ldlm_lib.c:2438:target_next_replay_lock()) Waiting for lock 00000100:00100000:1.0:1777051334.974389:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051334.974446:0:46494:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425886080 00000100:00100000:2.0:1777051334.974488:0:46494:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425886080 00000100:00100000:2.0:1777051334.974558:0:46494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111782 00000100:00100000:2.0:1777051334.974574:0:46494:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+14:2435:x1863365425886080:12345-192.168.201.46@tcp:101:ldlm_lock_repla.0 00010000:00080000:2.0:1777051334.974593:0:46494:0:(ldlm_lib.c:3170:target_queue_recovery_request()) @@@ queue lock replay req req@ffff99da5f9bdc00 x1863365425886080/t0(0) o101->2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp:295/0 lens 328/0 e 0 to 0 dl 1777051345 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1777051334.974625:0:46494:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+14:2435:x1863365425886080:12345-192.168.201.46@tcp:101:ldlm_lock_repla.0 Request processed in 56us (246us total) trans 0 rc 0/-999 00000100:00100000:2.0:1777051334.974635:0:46494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111782 00010000:00080000:1.0:1777051334.974686:0:104234:0:(ldlm_lib.c:2268:check_for_next_lock()) waking for next lock 00010000:00080000:1.0:1777051334.974701:0:104234:0:(ldlm_lib.c:2871:target_recovery_thread()) @@@ processing lock from 192.168.201.46@tcp: req@ffff99da5f9bdc00 x1863365425886080/t0(0) o101->2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp:295/0 lens 328/0 e 0 to 0 dl 1777051345 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1777051334.974725:0:104234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777051334.974752:0:104234:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d953298c00/0x85f51a6b967150fe lrc: 2/0,0 mode: --/PR res: [0x240000403:0x176:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f64b35c4 expref: -99 pid: 104234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051334.974781:0:104234:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d953298c00/0x85f51a6b967150fe lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x176:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f64b35c4 expref: 15 pid: 104234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051334.974801:0:104234:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99d953298c00/0x85f51a6b967150fe lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x176:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f64b35c4 expref: 15 pid: 104234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051334.974814:0:104234:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d953298c00, rc 0) 00010000:00080000:1.0:1777051334.974871:0:104234:0:(ldlm_lib.c:2086:extend_recovery_timer()) lustre-MDT0001: recovery timer will expire in 100 seconds 00010000:00080000:1.0:1777051334.974885:0:104234:0:(ldlm_lib.c:2438:target_next_replay_lock()) Waiting for lock 00000100:00100000:0.0:1777051334.975005:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051334.975087:0:27882:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425886208 00000100:00100000:1.0:1777051334.975095:0:27882:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425886208 00000100:00100000:1.0:1777051334.975157:0:27882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111783 00000100:00100000:1.0:1777051334.975170:0:27882:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955507100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+15:2435:x1863365425886208:12345-192.168.201.46@tcp:101:ldlm_lock_repla.0 00000100:00100000:3.0:1777051334.975178:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00010000:00080000:1.0:1777051334.975190:0:27882:0:(ldlm_lib.c:3170:target_queue_recovery_request()) @@@ queue lock replay req req@ffff99d955507100 x1863365425886208/t0(0) o101->2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp:295/0 lens 328/0 e 0 to 0 dl 1777051345 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1777051334.975257:0:27882:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955507100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+15:2435:x1863365425886208:12345-192.168.201.46@tcp:101:ldlm_lock_repla.0 Request processed in 87us (254us total) trans 0 rc 0/-999 00000100:00100000:2.0:1777051334.975258:0:6580:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425886336 00000100:00100000:2.0:1777051334.975269:0:6580:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425886336 00000100:00100000:1.0:1777051334.975278:0:27882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111783 00010000:00080000:1.0:1777051334.975305:0:104234:0:(ldlm_lib.c:2268:check_for_next_lock()) waking for next lock 00010000:00080000:1.0:1777051334.975315:0:104234:0:(ldlm_lib.c:2871:target_recovery_thread()) @@@ processing lock from 192.168.201.46@tcp: req@ffff99d955507100 x1863365425886208/t0(0) o101->2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp:295/0 lens 328/0 e 0 to 0 dl 1777051345 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1777051334.975334:0:104234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777051334.975357:0:104234:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d953298200/0x85f51a6b96715105 lrc: 2/0,0 mode: --/PR res: [0x240000403:0x155:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f64b2ca2 expref: -99 pid: 104234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051334.975365:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111784 00000100:00100000:2.0:1777051334.975388:0:6580:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d960408700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+17:2435:x1863365425886336:12345-192.168.201.46@tcp:101:ldlm_lock_repla.0 00010000:00010000:1.0:1777051334.975400:0:104234:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d953298200/0x85f51a6b96715105 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x155:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f64b2ca2 expref: 17 pid: 104234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:2.0:1777051334.975413:0:6580:0:(ldlm_lib.c:3170:target_queue_recovery_request()) @@@ queue lock replay req req@ffff99d960408700 x1863365425886336/t0(0) o101->2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp:295/0 lens 328/0 e 0 to 0 dl 1777051345 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1777051334.975426:0:104234:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99d953298200/0x85f51a6b96715105 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x155:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f64b2ca2 expref: 17 pid: 104234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051334.975499:0:104234:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d953298200, rc 0) 00000100:00100000:2.0:1777051334.975500:0:6580:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d960408700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+17:2435:x1863365425886336:12345-192.168.201.46@tcp:101:ldlm_lock_repla.0 Request processed in 120us (324us total) trans 0 rc 0/-999 00000100:00100000:2.0:1777051334.975512:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111784 00000100:00100000:3.0:1777051334.975679:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051334.975734:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051334.976556:0:6579:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425886464 00000100:00100000:0.0:1777051334.976560:0:8492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425886592 00000100:00100000:1.0:1777051334.976565:0:6579:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425886464 00000100:00100000:0.0:1777051334.976571:0:8492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425886592 00010000:00080000:2.0:1777051334.976574:0:104234:0:(ldlm_lib.c:2086:extend_recovery_timer()) lustre-MDT0001: recovery timer will expire in 100 seconds 00000100:00100000:3.0:1777051334.976586:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00010000:00080000:2.0:1777051334.976607:0:104234:0:(ldlm_lib.c:2438:target_next_replay_lock()) Waiting for lock 00010000:00080000:2.0:1777051334.976613:0:104234:0:(ldlm_lib.c:2268:check_for_next_lock()) waking for next lock 00010000:00080000:2.0:1777051334.976627:0:104234:0:(ldlm_lib.c:2871:target_recovery_thread()) @@@ processing lock from 192.168.201.46@tcp: req@ffff99d960408700 x1863365425886336/t0(0) o101->2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp:295/0 lens 328/0 e 0 to 0 dl 1777051345 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1777051334.976632:0:6579:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425886720 00010000:00010000:2.0:1777051334.976904:0:104234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1777051334.976922:0:6579:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425886720 00010000:00010000:2.0:1777051334.976931:0:104234:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d955a8fe00/0x85f51a6b9671510c lrc: 2/0,0 mode: --/PR res: [0x240000403:0x173:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f64b34dd expref: -99 pid: 104234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051334.976944:0:8492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111785 00010000:00010000:2.0:1777051334.976971:0:104234:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d955a8fe00/0x85f51a6b9671510c lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x173:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f64b34dd expref: 20 pid: 104234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051334.976991:0:104234:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99d955a8fe00/0x85f51a6b9671510c lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x173:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f64b34dd expref: 20 pid: 104234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051334.977005:0:104234:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d955a8fe00, rc 0) 00000100:00100000:3.0:1777051334.977016:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00010000:00080000:2.0:1777051334.977055:0:104234:0:(ldlm_lib.c:2086:extend_recovery_timer()) lustre-MDT0001: recovery timer will expire in 100 seconds 00010000:00080000:2.0:1777051334.977067:0:104234:0:(ldlm_lib.c:2438:target_next_replay_lock()) Waiting for lock 00000100:00100000:3.0:1777051334.977395:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051334.977438:0:27885:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425886848 00000100:00100000:3.0:1777051334.977447:0:27885:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425886848 00000100:00100000:0.0:1777051334.977475:0:8492:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d960409500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+19:2435:x1863365425886464:12345-192.168.201.46@tcp:101:ldlm_lock_repla.0 00000100:00100000:1.0:1777051334.977488:0:6579:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425886976 00000100:00100000:1.0:1777051334.977496:0:6579:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425886976 00010000:00080000:0.0:1777051334.977503:0:8492:0:(ldlm_lib.c:3170:target_queue_recovery_request()) @@@ queue lock replay req req@ffff99d960409500 x1863365425886464/t0(0) o101->2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp:295/0 lens 328/0 e 0 to 0 dl 1777051345 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1777051334.977532:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111786 00000100:00100000:0.0:1777051334.977545:0:8492:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d960409500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+21:2435:x1863365425886464:12345-192.168.201.46@tcp:101:ldlm_lock_repla.0 Request processed in 101us (1864us total) trans 0 rc 0/-999 00000100:00100000:3.0:1777051334.977549:0:27885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111787 00000100:00100000:2.0:1777051334.977559:0:6580:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d960408e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+21:2435:x1863365425886592:12345-192.168.201.46@tcp:101:ldlm_lock_repla.0 00000100:00100000:1.0:1777051334.977570:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111788 00000100:00100000:3.0:1777051334.977575:0:27885:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d96040bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+21:2435:x1863365425886720:12345-192.168.201.46@tcp:101:ldlm_lock_repla.0 00000100:00100000:0.0:1777051334.977587:0:8492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111785 00010000:00080000:2.0:1777051334.977589:0:6580:0:(ldlm_lib.c:3170:target_queue_recovery_request()) @@@ queue lock replay req req@ffff99d960408e00 x1863365425886592/t0(0) o101->2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp:295/0 lens 328/0 e 0 to 0 dl 1777051345 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1777051334.977590:0:6579:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d960409880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+21:2435:x1863365425886848:12345-192.168.201.46@tcp:101:ldlm_lock_repla.0 00010000:00080000:3.0:1777051334.977604:0:27885:0:(ldlm_lib.c:3170:target_queue_recovery_request()) @@@ queue lock replay req req@ffff99d96040bb80 x1863365425886720/t0(0) o101->2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp:295/0 lens 328/0 e 0 to 0 dl 1777051345 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00080000:1.0:1777051334.977617:0:6579:0:(ldlm_lib.c:3170:target_queue_recovery_request()) @@@ queue lock replay req req@ffff99d960409880 x1863365425886848/t0(0) o101->2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp:295/0 lens 328/0 e 0 to 0 dl 1777051345 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1777051334.977622:0:8492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111789 00000100:00100000:0.0:1777051334.977651:0:8492:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d960408a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+21:2435:x1863365425886976:12345-192.168.201.46@tcp:101:ldlm_lock_repla.0 00000100:00100000:3.0:1777051334.977663:0:27885:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d96040bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+21:2435:x1863365425886720:12345-192.168.201.46@tcp:101:ldlm_lock_repla.0 Request processed in 91us (1081us total) trans 0 rc 0/-999 00000100:00100000:1.0:1777051334.977670:0:6579:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d960409880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+21:2435:x1863365425886848:12345-192.168.201.46@tcp:101:ldlm_lock_repla.0 Request processed in 86us (655us total) trans 0 rc 0/-999 00000100:00100000:2.0:1777051334.977683:0:6580:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d960408e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+21:2435:x1863365425886592:12345-192.168.201.46@tcp:101:ldlm_lock_repla.0 Request processed in 131us (1942us total) trans 0 rc 0/-999 00000100:00100000:1.0:1777051334.977693:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111788 00000100:00100000:2.0:1777051334.977708:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111786 00010000:00080000:0.0:1777051334.977721:0:8492:0:(ldlm_lib.c:3170:target_queue_recovery_request()) @@@ queue lock replay req req@ffff99d960408a80 x1863365425886976/t0(0) o101->2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp:295/0 lens 328/0 e 0 to 0 dl 1777051345 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1777051334.977742:0:8492:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d960408a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+21:2435:x1863365425886976:12345-192.168.201.46@tcp:101:ldlm_lock_repla.0 Request processed in 103us (674us total) trans 0 rc 0/-999 00000100:00100000:0.0:1777051334.977756:0:8492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111789 00010000:00080000:2.0:1777051334.977758:0:104234:0:(ldlm_lib.c:2268:check_for_next_lock()) waking for next lock 00010000:00080000:2.0:1777051334.977774:0:104234:0:(ldlm_lib.c:2871:target_recovery_thread()) @@@ processing lock from 192.168.201.46@tcp: req@ffff99d960409500 x1863365425886464/t0(0) o101->2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp:295/0 lens 328/0 e 0 to 0 dl 1777051345 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1777051334.977795:0:104234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051334.977817:0:104234:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d955a8f400/0x85f51a6b96715113 lrc: 2/0,0 mode: --/PR res: [0x240000403:0x1b1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f64b4e28 expref: -99 pid: 104234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051334.977844:0:104234:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d955a8f400/0x85f51a6b96715113 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x1b1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f64b4e28 expref: 22 pid: 104234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051334.977862:0:104234:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99d955a8f400/0x85f51a6b96715113 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x1b1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f64b4e28 expref: 22 pid: 104234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051334.977875:0:104234:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d955a8f400, rc 0) 00000100:00100000:3.0:1777051334.977906:0:27885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111787 00010000:00080000:2.0:1777051334.977934:0:104234:0:(ldlm_lib.c:2086:extend_recovery_timer()) lustre-MDT0001: recovery timer will expire in 100 seconds 00010000:00080000:2.0:1777051334.977951:0:104234:0:(ldlm_lib.c:2438:target_next_replay_lock()) Waiting for lock 00010000:00080000:2.0:1777051334.977954:0:104234:0:(ldlm_lib.c:2268:check_for_next_lock()) waking for next lock 00010000:00080000:2.0:1777051334.977966:0:104234:0:(ldlm_lib.c:2871:target_recovery_thread()) @@@ processing lock from 192.168.201.46@tcp: req@ffff99d96040bb80 x1863365425886720/t0(0) o101->2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp:295/0 lens 328/0 e 0 to 0 dl 1777051345 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1777051334.977986:0:104234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051334.978006:0:104234:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d955a8f200/0x85f51a6b9671511a lrc: 2/0,0 mode: --/PR res: [0x240000403:0xd1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f64b00fe expref: -99 pid: 104234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051334.978039:0:104234:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d955a8f200/0x85f51a6b9671511a lrc: 3/0,0 mode: PR/PR res: [0x240000403:0xd1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f64b00fe expref: 22 pid: 104234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051334.978056:0:104234:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99d955a8f200/0x85f51a6b9671511a lrc: 3/0,0 mode: PR/PR res: [0x240000403:0xd1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f64b00fe expref: 22 pid: 104234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051334.978069:0:104234:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d955a8f200, rc 0) 00010000:00080000:2.0:1777051334.978120:0:104234:0:(ldlm_lib.c:2086:extend_recovery_timer()) lustre-MDT0001: recovery timer will expire in 100 seconds 00010000:00080000:2.0:1777051334.978131:0:104234:0:(ldlm_lib.c:2438:target_next_replay_lock()) Waiting for lock 00010000:00080000:2.0:1777051334.978134:0:104234:0:(ldlm_lib.c:2268:check_for_next_lock()) waking for next lock 00010000:00080000:2.0:1777051334.978143:0:104234:0:(ldlm_lib.c:2871:target_recovery_thread()) @@@ processing lock from 192.168.201.46@tcp: req@ffff99d960409880 x1863365425886848/t0(0) o101->2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp:295/0 lens 328/0 e 0 to 0 dl 1777051345 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1777051334.978435:0:104234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051334.978481:0:104234:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d955a8ea00/0x85f51a6b96715121 lrc: 2/0,0 mode: --/PR res: [0x240000403:0x18f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f64b3e76 expref: -99 pid: 104234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051334.978514:0:104234:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d955a8ea00/0x85f51a6b96715121 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x18f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f64b3e76 expref: 22 pid: 104234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051334.978532:0:104234:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99d955a8ea00/0x85f51a6b96715121 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x18f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f64b3e76 expref: 22 pid: 104234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051334.978546:0:104234:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d955a8ea00, rc 0) 00010000:00080000:2.0:1777051334.978584:0:104234:0:(ldlm_lib.c:2086:extend_recovery_timer()) lustre-MDT0001: recovery timer will expire in 100 seconds 00010000:00080000:2.0:1777051334.978597:0:104234:0:(ldlm_lib.c:2438:target_next_replay_lock()) Waiting for lock 00010000:00080000:2.0:1777051334.978601:0:104234:0:(ldlm_lib.c:2268:check_for_next_lock()) waking for next lock 00010000:00080000:2.0:1777051334.978613:0:104234:0:(ldlm_lib.c:2871:target_recovery_thread()) @@@ processing lock from 192.168.201.46@tcp: req@ffff99d960408e00 x1863365425886592/t0(0) o101->2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp:295/0 lens 328/0 e 0 to 0 dl 1777051345 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1777051334.978630:0:104234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051334.978648:0:104234:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d955a8e600/0x85f51a6b96715128 lrc: 2/0,0 mode: --/PR res: [0x240000403:0x111:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f64b15bf expref: -99 pid: 104234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051334.978670:0:104234:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d955a8e600/0x85f51a6b96715128 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x111:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f64b15bf expref: 22 pid: 104234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051334.978685:0:104234:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99d955a8e600/0x85f51a6b96715128 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x111:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f64b15bf expref: 22 pid: 104234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051334.978697:0:104234:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d955a8e600, rc 0) 00010000:00080000:2.0:1777051334.978725:0:104234:0:(ldlm_lib.c:2086:extend_recovery_timer()) lustre-MDT0001: recovery timer will expire in 100 seconds 00010000:00080000:2.0:1777051334.978736:0:104234:0:(ldlm_lib.c:2438:target_next_replay_lock()) Waiting for lock 00010000:00080000:2.0:1777051334.978739:0:104234:0:(ldlm_lib.c:2268:check_for_next_lock()) waking for next lock 00010000:00080000:2.0:1777051334.978745:0:104234:0:(ldlm_lib.c:2871:target_recovery_thread()) @@@ processing lock from 192.168.201.46@tcp: req@ffff99d960408a80 x1863365425886976/t0(0) o101->2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp:295/0 lens 328/0 e 0 to 0 dl 1777051345 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1777051334.978761:0:104234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051334.978777:0:104234:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d955a8e000/0x85f51a6b9671512f lrc: 2/0,0 mode: --/PR res: [0x240000403:0x16f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f64b33a9 expref: -99 pid: 104234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051334.978801:0:104234:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d955a8e000/0x85f51a6b9671512f lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x16f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f64b33a9 expref: 22 pid: 104234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051334.978817:0:104234:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99d955a8e000/0x85f51a6b9671512f lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x16f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f64b33a9 expref: 22 pid: 104234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051334.978838:0:104234:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d955a8e000, rc 0) 00010000:00080000:2.0:1777051334.978870:0:104234:0:(ldlm_lib.c:2086:extend_recovery_timer()) lustre-MDT0001: recovery timer will expire in 100 seconds 00010000:00080000:2.0:1777051334.978880:0:104234:0:(ldlm_lib.c:2438:target_next_replay_lock()) Waiting for lock 00000100:00100000:3.0:1777051334.979559:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051334.979686:0:6579:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425887104 00000100:00100000:1.0:1777051334.979694:0:6579:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425887104 00000100:00100000:1.0:1777051334.981004:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111790 00000100:00100000:1.0:1777051334.981019:0:6579:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d96040a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+22:2435:x1863365425887104:12345-192.168.201.46@tcp:101:ldlm_lock_repla.0 00010000:00080000:1.0:1777051334.981038:0:6579:0:(ldlm_lib.c:3170:target_queue_recovery_request()) @@@ queue lock replay req req@ffff99d96040a300 x1863365425887104/t0(0) o101->2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp:295/0 lens 328/0 e 0 to 0 dl 1777051345 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1777051334.981071:0:6579:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d96040a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+22:2435:x1863365425887104:12345-192.168.201.46@tcp:101:ldlm_lock_repla.0 Request processed in 57us (1514us total) trans 0 rc 0/-999 00000100:00100000:1.0:1777051334.981082:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111790 00010000:00080000:3.0:1777051334.981141:0:104234:0:(ldlm_lib.c:2268:check_for_next_lock()) waking for next lock 00010000:00080000:3.0:1777051334.981156:0:104234:0:(ldlm_lib.c:2871:target_recovery_thread()) @@@ processing lock from 192.168.201.46@tcp: req@ffff99d96040a300 x1863365425887104/t0(0) o101->2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp:295/0 lens 328/0 e 0 to 0 dl 1777051345 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1777051334.981179:0:104234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1777051334.981227:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00010000:00010000:3.0:1777051334.981227:0:104234:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d94ffbcc00/0x85f51a6b96715136 lrc: 2/0,0 mode: --/PR res: [0x240000403:0xef:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f64b0867 expref: -99 pid: 104234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051334.981254:0:104234:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d94ffbcc00/0x85f51a6b96715136 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0xef:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f64b0867 expref: 23 pid: 104234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051334.981275:0:104234:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94ffbcc00/0x85f51a6b96715136 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0xef:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f64b0867 expref: 23 pid: 104234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051334.981290:0:104234:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d94ffbcc00, rc 0) 00000100:00100000:1.0:1777051334.981330:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00010000:00080000:3.0:1777051334.981337:0:104234:0:(ldlm_lib.c:2086:extend_recovery_timer()) lustre-MDT0001: recovery timer will expire in 100 seconds 00010000:00080000:3.0:1777051334.981351:0:104234:0:(ldlm_lib.c:2438:target_next_replay_lock()) Waiting for lock 00000100:00100000:2.0:1777051334.982531:0:46494:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425887232 00000100:00100000:2.0:1777051334.982540:0:46494:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425887232 00000100:00100000:2.0:1777051334.982594:0:46494:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425887360 00000100:00100000:2.0:1777051334.982599:0:46494:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425887360 00000100:00100000:2.0:1777051334.982635:0:46494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111791 00000100:00100000:2.0:1777051334.982647:0:46494:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+24:2435:x1863365425887232:12345-192.168.201.46@tcp:101:ldlm_lock_repla.0 00010000:00080000:2.0:1777051334.982664:0:46494:0:(ldlm_lib.c:3170:target_queue_recovery_request()) @@@ queue lock replay req req@ffff99da5f9bd180 x1863365425887232/t0(0) o101->2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp:295/0 lens 328/0 e 0 to 0 dl 1777051345 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1777051334.982690:0:46494:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+24:2435:x1863365425887232:12345-192.168.201.46@tcp:101:ldlm_lock_repla.0 Request processed in 46us (1533us total) trans 0 rc 0/-999 00000100:00100000:2.0:1777051334.982704:0:46494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111791 00000100:00100000:2.0:1777051334.982726:0:46494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111792 00000100:00100000:2.0:1777051334.983006:0:46494:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+24:2435:x1863365425887360:12345-192.168.201.46@tcp:101:ldlm_lock_repla.0 00010000:00080000:2.0:1777051334.983026:0:46494:0:(ldlm_lib.c:3170:target_queue_recovery_request()) @@@ queue lock replay req req@ffff99da5f9bca80 x1863365425887360/t0(0) o101->2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp:295/0 lens 328/0 e 0 to 0 dl 1777051345 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1777051334.983047:0:46494:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+24:2435:x1863365425887360:12345-192.168.201.46@tcp:101:ldlm_lock_repla.0 Request processed in 46us (1717us total) trans 0 rc 0/-999 00000100:00100000:2.0:1777051334.983060:0:46494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111792 00010000:00080000:3.0:1777051334.984331:0:104234:0:(ldlm_lib.c:2268:check_for_next_lock()) waking for next lock 00010000:00080000:3.0:1777051334.984349:0:104234:0:(ldlm_lib.c:2871:target_recovery_thread()) @@@ processing lock from 192.168.201.46@tcp: req@ffff99da5f9bd180 x1863365425887232/t0(0) o101->2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp:295/0 lens 328/0 e 0 to 0 dl 1777051345 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1777051334.984373:0:104234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1777051334.984383:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00010000:00010000:3.0:1777051334.984399:0:104234:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d94ffbd200/0x85f51a6b9671513d lrc: 2/0,0 mode: --/PR res: [0x240000403:0xaf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f64af279 expref: -99 pid: 104234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051334.984431:0:104234:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d94ffbd200/0x85f51a6b9671513d lrc: 3/0,0 mode: PR/PR res: [0x240000403:0xaf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f64af279 expref: 25 pid: 104234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051334.984492:0:104234:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94ffbd200/0x85f51a6b9671513d lrc: 3/0,0 mode: PR/PR res: [0x240000403:0xaf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f64af279 expref: 25 pid: 104234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051334.984508:0:104234:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d94ffbd200, rc 0) 00000100:00100000:2.0:1777051334.984513:0:46497:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425887488 00000100:00100000:2.0:1777051334.984523:0:46497:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425887488 00010000:00080000:3.0:1777051334.984568:0:104234:0:(ldlm_lib.c:2086:extend_recovery_timer()) lustre-MDT0001: recovery timer will expire in 100 seconds 00010000:00080000:3.0:1777051334.984586:0:104234:0:(ldlm_lib.c:2438:target_next_replay_lock()) Waiting for lock 00010000:00080000:3.0:1777051334.984591:0:104234:0:(ldlm_lib.c:2268:check_for_next_lock()) waking for next lock 00000100:00100000:2.0:1777051334.984598:0:46497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111793 00010000:00080000:3.0:1777051334.984608:0:104234:0:(ldlm_lib.c:2871:target_recovery_thread()) @@@ processing lock from 192.168.201.46@tcp: req@ffff99da5f9bca80 x1863365425887360/t0(0) o101->2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp:295/0 lens 328/0 e 0 to 0 dl 1777051345 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1777051334.984622:0:46497:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95a582300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+25:2435:x1863365425887488:12345-192.168.201.46@tcp:101:ldlm_lock_repla.0 00010000:00010000:3.0:1777051334.984634:0:104234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777051334.984654:0:104234:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d955a91000/0x85f51a6b96715144 lrc: 2/0,0 mode: --/PR res: [0x240000403:0x16e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f64b33b7 expref: -99 pid: 104234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:2.0:1777051334.984670:0:46497:0:(ldlm_lib.c:3170:target_queue_recovery_request()) @@@ queue lock replay req req@ffff99d95a582300 x1863365425887488/t0(0) o101->2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp:295/0 lens 328/0 e 0 to 0 dl 1777051345 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1777051334.984686:0:104234:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d955a91000/0x85f51a6b96715144 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x16e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f64b33b7 expref: 26 pid: 104234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051334.984697:0:46497:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95a582300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+26:2435:x1863365425887488:12345-192.168.201.46@tcp:101:ldlm_lock_repla.0 Request processed in 81us (318us total) trans 0 rc 0/-999 00000100:00100000:2.0:1777051334.984722:0:46497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111793 00010000:00010000:3.0:1777051334.984730:0:104234:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99d955a91000/0x85f51a6b96715144 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x16e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f64b33b7 expref: 26 pid: 104234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051334.984745:0:104234:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d955a91000, rc 0) 00010000:00080000:3.0:1777051334.984775:0:104234:0:(ldlm_lib.c:2086:extend_recovery_timer()) lustre-MDT0001: recovery timer will expire in 100 seconds 00010000:00080000:3.0:1777051334.984783:0:104234:0:(ldlm_lib.c:2438:target_next_replay_lock()) Waiting for lock 00010000:00080000:3.0:1777051334.984785:0:104234:0:(ldlm_lib.c:2268:check_for_next_lock()) waking for next lock 00010000:00080000:3.0:1777051334.984791:0:104234:0:(ldlm_lib.c:2871:target_recovery_thread()) @@@ processing lock from 192.168.201.46@tcp: req@ffff99d95a582300 x1863365425887488/t0(0) o101->2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp:295/0 lens 328/0 e 0 to 0 dl 1777051345 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1777051334.984805:0:104234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777051334.984822:0:104234:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d955a91e00/0x85f51a6b9671514b lrc: 2/0,0 mode: --/PR res: [0x240000403:0x18d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f64b4091 expref: -99 pid: 104234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051334.984844:0:104234:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d955a91e00/0x85f51a6b9671514b lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x18d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f64b4091 expref: 26 pid: 104234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051334.984860:0:104234:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99d955a91e00/0x85f51a6b9671514b lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x18d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f64b4091 expref: 26 pid: 104234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051334.984874:0:104234:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d955a91e00, rc 0) 00010000:00080000:3.0:1777051334.984932:0:104234:0:(ldlm_lib.c:2086:extend_recovery_timer()) lustre-MDT0001: recovery timer will expire in 100 seconds 00010000:00080000:3.0:1777051334.984945:0:104234:0:(ldlm_lib.c:2438:target_next_replay_lock()) Waiting for lock 00000100:00100000:3.0:1777051334.986811:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051334.986861:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051334.986923:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051334.986926:0:10328:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425887616 00000100:00100000:1.0:1777051334.986936:0:10328:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425887616 00000100:00100000:1.0:1777051334.986998:0:10328:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425887744 00000100:00100000:1.0:1777051334.987004:0:10328:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425887744 00000100:00100000:1.0:1777051334.987032:0:10328:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425887872 00000100:00100000:1.0:1777051334.987036:0:10328:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425887872 00000100:00100000:1.0:1777051334.987066:0:10328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111794 00000100:00100000:1.0:1777051334.987082:0:10328:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d96040b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+28:2435:x1863365425887616:12345-192.168.201.46@tcp:101:ldlm_lock_repla.0 00010000:00080000:1.0:1777051334.987112:0:10328:0:(ldlm_lib.c:3170:target_queue_recovery_request()) @@@ queue lock replay req req@ffff99d96040b100 x1863365425887616/t0(0) o101->2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp:295/0 lens 328/0 e 0 to 0 dl 1777051345 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1777051334.987120:0:21368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111795 00000100:00100000:2.0:1777051334.987156:0:21368:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d96040ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+28:2435:x1863365425887744:12345-192.168.201.46@tcp:101:ldlm_lock_repla.0 00000100:00100000:1.0:1777051334.987160:0:10328:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d96040b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+28:2435:x1863365425887616:12345-192.168.201.46@tcp:101:ldlm_lock_repla.0 Request processed in 77us (347us total) trans 0 rc 0/-999 00000100:00100000:0.0:1777051334.987481:0:27885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111796 00010000:00080000:2.0:1777051334.987504:0:21368:0:(ldlm_lib.c:3170:target_queue_recovery_request()) @@@ queue lock replay req req@ffff99d96040ad80 x1863365425887744/t0(0) o101->2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp:295/0 lens 328/0 e 0 to 0 dl 1777051345 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1777051334.987508:0:10328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111794 00000100:00100000:0.0:1777051334.987509:0:27885:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d96040b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+28:2435:x1863365425887872:12345-192.168.201.46@tcp:101:ldlm_lock_repla.0 00000100:00100000:2.0:1777051334.987543:0:21368:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d96040ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+28:2435:x1863365425887744:12345-192.168.201.46@tcp:101:ldlm_lock_repla.0 Request processed in 396us (681us total) trans 0 rc 0/-999 00010000:00080000:0.0:1777051334.987561:0:27885:0:(ldlm_lib.c:3170:target_queue_recovery_request()) @@@ queue lock replay req req@ffff99d96040b480 x1863365425887872/t0(0) o101->2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp:295/0 lens 328/0 e 0 to 0 dl 1777051345 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1777051334.987561:0:21368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111795 00000100:00100000:0.0:1777051334.987589:0:27885:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d96040b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+28:2435:x1863365425887872:12345-192.168.201.46@tcp:101:ldlm_lock_repla.0 Request processed in 93us (667us total) trans 0 rc 0/-999 00000100:00100000:0.0:1777051334.987602:0:27885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111796 00010000:00080000:2.0:1777051334.987625:0:104234:0:(ldlm_lib.c:2268:check_for_next_lock()) waking for next lock 00010000:00080000:2.0:1777051334.987641:0:104234:0:(ldlm_lib.c:2871:target_recovery_thread()) @@@ processing lock from 192.168.201.46@tcp: req@ffff99d96040b100 x1863365425887616/t0(0) o101->2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp:295/0 lens 328/0 e 0 to 0 dl 1777051345 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1777051334.987664:0:104234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051334.987689:0:104234:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d955a8ec00/0x85f51a6b96715152 lrc: 2/0,0 mode: --/PR res: [0x240000403:0xcd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f64aff8b expref: -99 pid: 104234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051334.987711:0:104234:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d955a8ec00/0x85f51a6b96715152 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0xcd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f64aff8b expref: 29 pid: 104234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051334.987725:0:104234:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99d955a8ec00/0x85f51a6b96715152 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0xcd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f64aff8b expref: 29 pid: 104234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051334.988027:0:104234:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d955a8ec00, rc 0) 00010000:00080000:2.0:1777051334.988093:0:104234:0:(ldlm_lib.c:2086:extend_recovery_timer()) lustre-MDT0001: recovery timer will expire in 100 seconds 00010000:00080000:2.0:1777051334.988106:0:104234:0:(ldlm_lib.c:2438:target_next_replay_lock()) Waiting for lock 00010000:00080000:2.0:1777051334.988109:0:104234:0:(ldlm_lib.c:2268:check_for_next_lock()) waking for next lock 00010000:00080000:2.0:1777051334.988118:0:104234:0:(ldlm_lib.c:2871:target_recovery_thread()) @@@ processing lock from 192.168.201.46@tcp: req@ffff99d96040ad80 x1863365425887744/t0(0) o101->2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp:295/0 lens 328/0 e 0 to 0 dl 1777051345 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1777051334.988137:0:104234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051334.988155:0:104234:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d955a8f600/0x85f51a6b96715159 lrc: 2/0,0 mode: --/PR res: [0x240000403:0x12c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f64b1cb1 expref: -99 pid: 104234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051334.988178:0:104234:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d955a8f600/0x85f51a6b96715159 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x12c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f64b1cb1 expref: 29 pid: 104234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051334.988193:0:104234:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99d955a8f600/0x85f51a6b96715159 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x12c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f64b1cb1 expref: 29 pid: 104234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051334.988259:0:104234:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d955a8f600, rc 0) 00010000:00080000:2.0:1777051334.988293:0:104234:0:(ldlm_lib.c:2086:extend_recovery_timer()) lustre-MDT0001: recovery timer will expire in 100 seconds 00010000:00080000:2.0:1777051334.988304:0:104234:0:(ldlm_lib.c:2438:target_next_replay_lock()) Waiting for lock 00010000:00080000:2.0:1777051334.988307:0:104234:0:(ldlm_lib.c:2268:check_for_next_lock()) waking for next lock 00010000:00080000:2.0:1777051334.988315:0:104234:0:(ldlm_lib.c:2871:target_recovery_thread()) @@@ processing lock from 192.168.201.46@tcp: req@ffff99d96040b480 x1863365425887872/t0(0) o101->2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp:295/0 lens 328/0 e 0 to 0 dl 1777051345 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1777051334.988334:0:104234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051334.988353:0:104234:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d955a8e800/0x85f51a6b96715160 lrc: 2/0,0 mode: --/PR res: [0x240000403:0x16b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f64b329f expref: -99 pid: 104234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051334.988388:0:104234:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d955a8e800/0x85f51a6b96715160 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x16b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f64b329f expref: 29 pid: 104234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051334.988405:0:104234:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99d955a8e800/0x85f51a6b96715160 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x16b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f64b329f expref: 29 pid: 104234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051334.988418:0:104234:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d955a8e800, rc 0) 00010000:00080000:2.0:1777051334.988477:0:104234:0:(ldlm_lib.c:2086:extend_recovery_timer()) lustre-MDT0001: recovery timer will expire in 100 seconds 00010000:00080000:2.0:1777051334.988491:0:104234:0:(ldlm_lib.c:2438:target_next_replay_lock()) Waiting for lock 00000100:00100000:3.0:1777051334.988706:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051334.988747:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051334.988786:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051334.988813:0:6580:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425888000 00000100:00100000:2.0:1777051334.988824:0:6580:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425888000 00000100:00100000:1.0:1777051334.988838:0:46497:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425888128 00000100:00100000:1.0:1777051334.988848:0:46497:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425888128 00000100:00100000:2.0:1777051334.988887:0:6580:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425888256 00000100:00100000:2.0:1777051334.988896:0:6580:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425888256 00000100:00100000:1.0:1777051334.988933:0:46497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111797 00000100:00100000:1.0:1777051334.988955:0:46497:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d960409f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+31:2435:x1863365425888000:12345-192.168.201.46@tcp:101:ldlm_lock_repla.0 00010000:00080000:1.0:1777051334.988978:0:46497:0:(ldlm_lib.c:3170:target_queue_recovery_request()) @@@ queue lock replay req req@ffff99d960409f80 x1863365425888000/t0(0) o101->2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp:295/0 lens 328/0 e 0 to 0 dl 1777051345 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1777051334.988990:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111798 00000100:00100000:0.0:1777051334.989013:0:27882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111799 00000100:00100000:2.0:1777051334.989015:0:6580:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d96040a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+31:2435:x1863365425888128:12345-192.168.201.46@tcp:101:ldlm_lock_repla.0 00000100:00100000:1.0:1777051334.989029:0:46497:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d960409f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+31:2435:x1863365425888000:12345-192.168.201.46@tcp:101:ldlm_lock_repla.0 Request processed in 76us (317us total) trans 0 rc 0/-999 00000100:00100000:0.0:1777051334.989040:0:27882:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d96040aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+31:2435:x1863365425888256:12345-192.168.201.46@tcp:101:ldlm_lock_repla.0 00000100:00100000:1.0:1777051334.989053:0:46497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111797 00010000:00080000:2.0:1777051334.989056:0:6580:0:(ldlm_lib.c:3170:target_queue_recovery_request()) @@@ queue lock replay req req@ffff99d96040a680 x1863365425888128/t0(0) o101->2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp:295/0 lens 328/0 e 0 to 0 dl 1777051345 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00080000:0.0:1777051334.989069:0:27882:0:(ldlm_lib.c:3170:target_queue_recovery_request()) @@@ queue lock replay req req@ffff99d96040aa00 x1863365425888256/t0(0) o101->2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp:295/0 lens 328/0 e 0 to 0 dl 1777051345 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1777051334.989089:0:6580:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d96040a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+31:2435:x1863365425888128:12345-192.168.201.46@tcp:101:ldlm_lock_repla.0 Request processed in 77us (334us total) trans 0 rc 0/-999 00000100:00100000:0.0:1777051334.989419:0:27882:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d96040aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+31:2435:x1863365425888256:12345-192.168.201.46@tcp:101:ldlm_lock_repla.0 Request processed in 73us (315us total) trans 0 rc 0/-999 00000100:00100000:2.0:1777051334.989422:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111798 00010000:00080000:1.0:1777051334.989428:0:104234:0:(ldlm_lib.c:2268:check_for_next_lock()) waking for next lock 00000100:00100000:0.0:1777051334.989475:0:27882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111799 00010000:00080000:1.0:1777051334.989488:0:104234:0:(ldlm_lib.c:2871:target_recovery_thread()) @@@ processing lock from 192.168.201.46@tcp: req@ffff99d960409f80 x1863365425888000/t0(0) o101->2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp:295/0 lens 328/0 e 0 to 0 dl 1777051345 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1777051334.989514:0:104234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1777051334.989672:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051334.990064:0:46494:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425888384 00000100:00100000:3.0:1777051334.990074:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051334.990076:0:46494:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425888384 00010000:00010000:1.0:1777051334.990442:0:104234:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d953298600/0x85f51a6b96715167 lrc: 2/0,0 mode: --/PR res: [0x240000403:0xab:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f64af16f expref: -99 pid: 104234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051334.990502:0:104234:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d953298600/0x85f51a6b96715167 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0xab:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f64af16f expref: 33 pid: 104234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051334.990525:0:6579:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425888512 00000100:00100000:0.0:1777051334.990535:0:6579:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425888512 00010000:00010000:1.0:1777051334.990536:0:104234:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99d953298600/0x85f51a6b96715167 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0xab:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f64af16f expref: 33 pid: 104234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051334.990555:0:104234:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d953298600, rc 0) 00000100:00100000:2.0:1777051334.990555:0:46494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111800 00000100:00100000:2.0:1777051334.990582:0:46494:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d960408000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+34:2435:x1863365425888384:12345-192.168.201.46@tcp:101:ldlm_lock_repla.0 00000100:00100000:3.0:1777051334.990585:0:21368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111801 00010000:00080000:2.0:1777051334.990612:0:46494:0:(ldlm_lib.c:3170:target_queue_recovery_request()) @@@ queue lock replay req req@ffff99d960408000 x1863365425888384/t0(0) o101->2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp:295/0 lens 328/0 e 0 to 0 dl 1777051345 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777051334.990614:0:21368:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94e624380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+34:2435:x1863365425888512:12345-192.168.201.46@tcp:101:ldlm_lock_repla.0 00010000:00080000:1.0:1777051334.990631:0:104234:0:(ldlm_lib.c:2086:extend_recovery_timer()) lustre-MDT0001: recovery timer will expire in 100 seconds 00010000:00080000:3.0:1777051334.990645:0:21368:0:(ldlm_lib.c:3170:target_queue_recovery_request()) @@@ queue lock replay req req@ffff99d94e624380 x1863365425888512/t0(0) o101->2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp:295/0 lens 328/0 e 0 to 0 dl 1777051345 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00080000:1.0:1777051334.990651:0:104234:0:(ldlm_lib.c:2438:target_next_replay_lock()) Waiting for lock 00000100:00100000:2.0:1777051334.990654:0:46494:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d960408000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+33:2435:x1863365425888384:12345-192.168.201.46@tcp:101:ldlm_lock_repla.0 Request processed in 75us (977us total) trans 0 rc 0/-999 00010000:00080000:1.0:1777051334.990659:0:104234:0:(ldlm_lib.c:2268:check_for_next_lock()) waking for next lock 00010000:00080000:1.0:1777051334.990683:0:104234:0:(ldlm_lib.c:2871:target_recovery_thread()) @@@ processing lock from 192.168.201.46@tcp: req@ffff99d96040a680 x1863365425888128/t0(0) o101->2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp:295/0 lens 328/0 e 0 to 0 dl 1777051345 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1777051334.990685:0:46494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111800 00000100:00100000:3.0:1777051334.990698:0:21368:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94e624380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+33:2435:x1863365425888512:12345-192.168.201.46@tcp:101:ldlm_lock_repla.0 Request processed in 89us (623us total) trans 0 rc 0/-999 00000100:00100000:3.0:1777051334.990725:0:21368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111801 00010000:00010000:1.0:1777051334.990729:0:104234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777051334.991035:0:104234:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d953299200/0x85f51a6b9671516e lrc: 2/0,0 mode: --/PR res: [0x240000403:0x1aa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f64b494a expref: -99 pid: 104234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051334.991488:0:104234:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d953299200/0x85f51a6b9671516e lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x1aa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f64b494a expref: 34 pid: 104234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051334.991515:0:104234:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99d953299200/0x85f51a6b9671516e lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x1aa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f64b494a expref: 34 pid: 104234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051334.991531:0:104234:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d953299200, rc 0) 00010000:00080000:3.0:1777051334.991572:0:104234:0:(ldlm_lib.c:2086:extend_recovery_timer()) lustre-MDT0001: recovery timer will expire in 100 seconds 00010000:00080000:3.0:1777051334.991584:0:104234:0:(ldlm_lib.c:2438:target_next_replay_lock()) Waiting for lock 00010000:00080000:3.0:1777051334.991587:0:104234:0:(ldlm_lib.c:2268:check_for_next_lock()) waking for next lock 00010000:00080000:3.0:1777051334.991595:0:104234:0:(ldlm_lib.c:2871:target_recovery_thread()) @@@ processing lock from 192.168.201.46@tcp: req@ffff99d96040aa00 x1863365425888256/t0(0) o101->2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp:295/0 lens 328/0 e 0 to 0 dl 1777051345 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1777051334.991614:0:104234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777051334.991634:0:104234:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d955a90e00/0x85f51a6b96715175 lrc: 2/0,0 mode: --/PR res: [0x240000403:0x18a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f64b3d96 expref: -99 pid: 104234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051334.991658:0:104234:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d955a90e00/0x85f51a6b96715175 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x18a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f64b3d96 expref: 34 pid: 104234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051334.991670:0:104234:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99d955a90e00/0x85f51a6b96715175 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x18a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f64b3d96 expref: 34 pid: 104234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051334.991679:0:104234:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d955a90e00, rc 0) 00010000:00080000:2.0:1777051334.993811:0:104234:0:(ldlm_lib.c:2086:extend_recovery_timer()) lustre-MDT0001: recovery timer will expire in 100 seconds 00010000:00080000:2.0:1777051334.993824:0:104234:0:(ldlm_lib.c:2438:target_next_replay_lock()) Waiting for lock 00010000:00080000:2.0:1777051334.993826:0:104234:0:(ldlm_lib.c:2268:check_for_next_lock()) waking for next lock 00010000:00080000:2.0:1777051334.993834:0:104234:0:(ldlm_lib.c:2871:target_recovery_thread()) @@@ processing lock from 192.168.201.46@tcp: req@ffff99d960408000 x1863365425888384/t0(0) o101->2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp:295/0 lens 328/0 e 0 to 0 dl 1777051345 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1777051334.993851:0:104234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051334.993869:0:104234:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d955a8fa00/0x85f51a6b9671517c lrc: 2/0,0 mode: --/PR res: [0x240000403:0x1a9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f64b4acb expref: -99 pid: 104234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051334.993891:0:104234:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d955a8fa00/0x85f51a6b9671517c lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x1a9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f64b4acb expref: 34 pid: 104234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051334.993903:0:104234:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99d955a8fa00/0x85f51a6b9671517c lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x1a9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f64b4acb expref: 34 pid: 104234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051334.993913:0:104234:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d955a8fa00, rc 0) 00010000:00080000:2.0:1777051334.994111:0:104234:0:(ldlm_lib.c:2086:extend_recovery_timer()) lustre-MDT0001: recovery timer will expire in 100 seconds 00010000:00080000:2.0:1777051334.994128:0:104234:0:(ldlm_lib.c:2438:target_next_replay_lock()) Waiting for lock 00010000:00080000:2.0:1777051334.994133:0:104234:0:(ldlm_lib.c:2268:check_for_next_lock()) waking for next lock 00010000:00080000:2.0:1777051334.994146:0:104234:0:(ldlm_lib.c:2871:target_recovery_thread()) @@@ processing lock from 192.168.201.46@tcp: req@ffff99d94e624380 x1863365425888512/t0(0) o101->2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp:295/0 lens 328/0 e 0 to 0 dl 1777051345 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1777051334.994168:0:104234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051334.994192:0:104234:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d955a8f800/0x85f51a6b96715183 lrc: 2/0,0 mode: --/PR res: [0x240000403:0xc9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f64afe2d expref: -99 pid: 104234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051334.994287:0:104234:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d955a8f800/0x85f51a6b96715183 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0xc9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f64afe2d expref: 34 pid: 104234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051334.994307:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00010000:00010000:2.0:1777051334.994308:0:104234:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99d955a8f800/0x85f51a6b96715183 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0xc9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f64afe2d expref: 34 pid: 104234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051334.994324:0:104234:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d955a8f800, rc 0) 00000100:00100000:0.0:1777051334.994360:0:46497:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425888640 00000100:00100000:0.0:1777051334.994368:0:46497:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425888640 00010000:00080000:2.0:1777051334.994374:0:104234:0:(ldlm_lib.c:2086:extend_recovery_timer()) lustre-MDT0001: recovery timer will expire in 100 seconds 00000100:00100000:1.0:1777051334.994387:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00010000:00080000:2.0:1777051334.994393:0:104234:0:(ldlm_lib.c:2438:target_next_replay_lock()) Waiting for lock 00000100:00100000:0.0:1777051334.994436:0:46497:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425888768 00000100:00100000:0.0:1777051334.994444:0:46497:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425888768 00000100:00100000:0.0:1777051334.994540:0:46497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111802 00000100:00100000:0.0:1777051334.994559:0:46497:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+35:2435:x1863365425888640:12345-192.168.201.46@tcp:101:ldlm_lock_repla.0 00000100:00100000:1.0:1777051334.994575:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00010000:00080000:0.0:1777051334.994583:0:46497:0:(ldlm_lib.c:3170:target_queue_recovery_request()) @@@ queue lock replay req req@ffff99da5f9bd500 x1863365425888640/t0(0) o101->2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp:295/0 lens 328/0 e 0 to 0 dl 1777051345 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1777051334.994613:0:10328:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425888896 00000100:00100000:0.0:1777051334.994623:0:46497:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+35:2435:x1863365425888640:12345-192.168.201.46@tcp:101:ldlm_lock_repla.0 Request processed in 69us (325us total) trans 0 rc 0/-999 00000100:00100000:1.0:1777051334.994624:0:10328:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425888896 00000100:00100000:0.0:1777051334.994637:0:46497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111802 00000100:00100000:0.0:1777051334.994658:0:46497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111803 00000100:00100000:0.0:1777051334.994675:0:46497:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+36:2435:x1863365425888768:12345-192.168.201.46@tcp:101:ldlm_lock_repla.0 00010000:00080000:0.0:1777051334.994693:0:46497:0:(ldlm_lib.c:3170:target_queue_recovery_request()) @@@ queue lock replay req req@ffff99da5f9bea00 x1863365425888768/t0(0) o101->2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp:295/0 lens 328/0 e 0 to 0 dl 1777051345 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1777051334.994709:0:10328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111804 00000100:00100000:0.0:1777051334.994716:0:46497:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+36:2435:x1863365425888768:12345-192.168.201.46@tcp:101:ldlm_lock_repla.0 Request processed in 44us (330us total) trans 0 rc 0/-999 00000100:00100000:0.0:1777051334.994733:0:46497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111803 00000100:00100000:1.0:1777051334.994736:0:10328:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+36:2435:x1863365425888896:12345-192.168.201.46@tcp:101:ldlm_lock_repla.0 00010000:00080000:1.0:1777051334.995030:0:10328:0:(ldlm_lib.c:3170:target_queue_recovery_request()) @@@ queue lock replay req req@ffff99da5f9bc700 x1863365425888896/t0(0) o101->2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp:295/0 lens 328/0 e 0 to 0 dl 1777051345 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1777051334.995072:0:10328:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+36:2435:x1863365425888896:12345-192.168.201.46@tcp:101:ldlm_lock_repla.0 Request processed in 343us (501us total) trans 0 rc 0/-999 00000100:00100000:1.0:1777051334.995083:0:10328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111804 00010000:00080000:2.0:1777051334.995140:0:104234:0:(ldlm_lib.c:2268:check_for_next_lock()) waking for next lock 00010000:00080000:2.0:1777051334.995158:0:104234:0:(ldlm_lib.c:2871:target_recovery_thread()) @@@ processing lock from 192.168.201.46@tcp: req@ffff99da5f9bd500 x1863365425888640/t0(0) o101->2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp:295/0 lens 328/0 e 0 to 0 dl 1777051345 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1777051334.995182:0:104234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051334.995252:0:104234:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d955a8fc00/0x85f51a6b9671518a lrc: 2/0,0 mode: --/PR res: [0x240000403:0xa9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f64af2b8 expref: -99 pid: 104234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051334.995286:0:104234:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d955a8fc00/0x85f51a6b9671518a lrc: 3/0,0 mode: PR/PR res: [0x240000403:0xa9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f64af2b8 expref: 37 pid: 104234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051334.995293:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00010000:00010000:2.0:1777051334.995317:0:104234:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99d955a8fc00/0x85f51a6b9671518a lrc: 3/0,0 mode: PR/PR res: [0x240000403:0xa9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f64af2b8 expref: 37 pid: 104234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051334.995328:0:104234:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d955a8fc00, rc 0) 00010000:00080000:2.0:1777051334.995372:0:104234:0:(ldlm_lib.c:2086:extend_recovery_timer()) lustre-MDT0001: recovery timer will expire in 100 seconds 00010000:00080000:2.0:1777051334.995390:0:104234:0:(ldlm_lib.c:2438:target_next_replay_lock()) Waiting for lock 00010000:00080000:2.0:1777051334.995394:0:104234:0:(ldlm_lib.c:2268:check_for_next_lock()) waking for next lock 00010000:00080000:2.0:1777051334.995406:0:104234:0:(ldlm_lib.c:2871:target_recovery_thread()) @@@ processing lock from 192.168.201.46@tcp: req@ffff99da5f9bea00 x1863365425888768/t0(0) o101->2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp:295/0 lens 328/0 e 0 to 0 dl 1777051345 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777051334.995411:0:6579:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425889024 00000100:00100000:3.0:1777051334.995424:0:6579:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425889024 00010000:00010000:2.0:1777051334.995430:0:104234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051334.995479:0:104234:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d955a8e200/0x85f51a6b96715191 lrc: 2/0,0 mode: --/PR res: [0x240000403:0x1a7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f64b470c expref: -99 pid: 104234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051334.995509:0:104234:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d955a8e200/0x85f51a6b96715191 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x1a7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f64b470c expref: 38 pid: 104234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051334.995528:0:104234:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99d955a8e200/0x85f51a6b96715191 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x1a7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f64b470c expref: 38 pid: 104234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051334.995540:0:104234:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d955a8e200, rc 0) 00010000:00080000:2.0:1777051334.995582:0:104234:0:(ldlm_lib.c:2086:extend_recovery_timer()) lustre-MDT0001: recovery timer will expire in 100 seconds 00010000:00080000:2.0:1777051334.995594:0:104234:0:(ldlm_lib.c:2438:target_next_replay_lock()) Waiting for lock 00010000:00080000:2.0:1777051334.995597:0:104234:0:(ldlm_lib.c:2268:check_for_next_lock()) waking for next lock 00010000:00080000:2.0:1777051334.995606:0:104234:0:(ldlm_lib.c:2871:target_recovery_thread()) @@@ processing lock from 192.168.201.46@tcp: req@ffff99da5f9bc700 x1863365425888896/t0(0) o101->2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp:295/0 lens 328/0 e 0 to 0 dl 1777051345 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1777051334.995625:0:104234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051334.995643:0:104234:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d955a8e400/0x85f51a6b96715198 lrc: 2/0,0 mode: --/PR res: [0x240000403:0xa7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f64aefb6 expref: -99 pid: 104234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051334.995664:0:104234:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d955a8e400/0x85f51a6b96715198 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0xa7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f64aefb6 expref: 38 pid: 104234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051334.995679:0:104234:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99d955a8e400/0x85f51a6b96715198 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0xa7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f64aefb6 expref: 38 pid: 104234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051334.995701:0:104234:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d955a8e400, rc 0) 00010000:00080000:2.0:1777051334.996040:0:104234:0:(ldlm_lib.c:2086:extend_recovery_timer()) lustre-MDT0001: recovery timer will expire in 100 seconds 00010000:00080000:2.0:1777051334.996051:0:104234:0:(ldlm_lib.c:2438:target_next_replay_lock()) Waiting for lock 00000100:00100000:3.0:1777051334.996840:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111805 00000100:00100000:2.0:1777051334.997005:0:6579:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942a0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+37:2435:x1863365425889024:12345-192.168.201.46@tcp:101:ldlm_lock_repla.0 00010000:00080000:2.0:1777051334.997026:0:6579:0:(ldlm_lib.c:3170:target_queue_recovery_request()) @@@ queue lock replay req req@ffff99d942a0f100 x1863365425889024/t0(0) o101->2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp:295/0 lens 328/0 e 0 to 0 dl 1777051345 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1777051334.997064:0:6579:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942a0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+37:2435:x1863365425889024:12345-192.168.201.46@tcp:101:ldlm_lock_repla.0 Request processed in 210us (1781us total) trans 0 rc 0/-999 00000100:00100000:2.0:1777051334.997075:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111805 00010000:00080000:0.0:1777051334.997125:0:104234:0:(ldlm_lib.c:2268:check_for_next_lock()) waking for next lock 00010000:00080000:0.0:1777051334.997140:0:104234:0:(ldlm_lib.c:2871:target_recovery_thread()) @@@ processing lock from 192.168.201.46@tcp: req@ffff99d942a0f100 x1863365425889024/t0(0) o101->2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp:295/0 lens 328/0 e 0 to 0 dl 1777051345 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1777051334.997165:0:104234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051334.997189:0:104234:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d954ea6000/0x85f51a6b9671519f lrc: 2/0,0 mode: --/PR res: [0x240000403:0x106:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f64b0ef0 expref: -99 pid: 104234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051334.997242:0:104234:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d954ea6000/0x85f51a6b9671519f lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x106:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f64b0ef0 expref: 38 pid: 104234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051334.997257:0:104234:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99d954ea6000/0x85f51a6b9671519f lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x106:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f64b0ef0 expref: 38 pid: 104234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051334.997268:0:104234:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d954ea6000, rc 0) 00010000:00080000:0.0:1777051334.997317:0:104234:0:(ldlm_lib.c:2086:extend_recovery_timer()) lustre-MDT0001: recovery timer will expire in 100 seconds 00010000:00080000:0.0:1777051334.997333:0:104234:0:(ldlm_lib.c:2438:target_next_replay_lock()) Waiting for lock 00000100:00100000:1.0:1777051334.997409:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051334.997543:0:46494:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425889152 00000100:00100000:2.0:1777051334.997553:0:46494:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425889152 00000100:00100000:1.0:1777051334.997584:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051334.997618:0:46494:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425889280 00000100:00100000:2.0:1777051334.997628:0:46494:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425889280 00000100:00100000:3.0:1777051334.997647:0:21368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111806 00000100:00100000:3.0:1777051334.997668:0:21368:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942a0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+39:2435:x1863365425889152:12345-192.168.201.46@tcp:101:ldlm_lock_repla.0 00000100:00100000:2.0:1777051334.997687:0:46494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111807 00000100:00100000:2.0:1777051334.997705:0:46494:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942a0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+39:2435:x1863365425889280:12345-192.168.201.46@tcp:101:ldlm_lock_repla.0 00010000:00080000:2.0:1777051334.997841:0:46494:0:(ldlm_lib.c:3170:target_queue_recovery_request()) @@@ queue lock replay req req@ffff99d942a0dc00 x1863365425889280/t0(0) o101->2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp:295/0 lens 328/0 e 0 to 0 dl 1777051345 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00080000:3.0:1777051334.997841:0:21368:0:(ldlm_lib.c:3170:target_queue_recovery_request()) @@@ queue lock replay req req@ffff99d942a0d180 x1863365425889152/t0(0) o101->2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp:295/0 lens 328/0 e 0 to 0 dl 1777051345 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1777051334.997893:0:46494:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942a0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+39:2435:x1863365425889280:12345-192.168.201.46@tcp:101:ldlm_lock_repla.0 Request processed in 193us (311us total) trans 0 rc 0/-999 00000100:00100000:2.0:1777051334.997903:0:46494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111807 00010000:00080000:0.0:1777051334.997961:0:104234:0:(ldlm_lib.c:2268:check_for_next_lock()) waking for next lock 00010000:00080000:0.0:1777051334.997975:0:104234:0:(ldlm_lib.c:2871:target_recovery_thread()) @@@ processing lock from 192.168.201.46@tcp: req@ffff99d942a0dc00 x1863365425889280/t0(0) o101->2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp:295/0 lens 328/0 e 0 to 0 dl 1777051345 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1777051334.997998:0:104234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051334.998020:0:104234:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d954ea7e00/0x85f51a6b967151a6 lrc: 2/0,0 mode: --/PR res: [0x240000403:0xa4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f64aee12 expref: -99 pid: 104234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051334.998045:0:104234:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d954ea7e00/0x85f51a6b967151a6 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0xa4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f64aee12 expref: 40 pid: 104234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051334.998062:0:104234:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99d954ea7e00/0x85f51a6b967151a6 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0xa4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f64aee12 expref: 40 pid: 104234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051334.998076:0:104234:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d954ea7e00, rc 0) 00000100:00100000:3.0:1777051334.998436:0:21368:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942a0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+40:2435:x1863365425889152:12345-192.168.201.46@tcp:101:ldlm_lock_repla.0 Request processed in 773us (1027us total) trans 0 rc 0/-999 00000100:00100000:3.0:1777051334.998480:0:21368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111806 00010000:00080000:0.0:1777051334.998598:0:104234:0:(ldlm_lib.c:2086:extend_recovery_timer()) lustre-MDT0001: recovery timer will expire in 100 seconds 00010000:00080000:0.0:1777051334.998614:0:104234:0:(ldlm_lib.c:2438:target_next_replay_lock()) Waiting for lock 00010000:00080000:0.0:1777051334.998617:0:104234:0:(ldlm_lib.c:2268:check_for_next_lock()) waking for next lock 00010000:00080000:0.0:1777051334.998627:0:104234:0:(ldlm_lib.c:2871:target_recovery_thread()) @@@ processing lock from 192.168.201.46@tcp: req@ffff99d942a0d180 x1863365425889152/t0(0) o101->2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp:295/0 lens 328/0 e 0 to 0 dl 1777051345 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1777051334.998647:0:104234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051334.998666:0:104234:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d954ea7000/0x85f51a6b967151ad lrc: 2/0,0 mode: --/PR res: [0x240000403:0x124:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f64b19e0 expref: -99 pid: 104234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051334.998691:0:104234:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d954ea7000/0x85f51a6b967151ad lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x124:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f64b19e0 expref: 40 pid: 104234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051334.998707:0:104234:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99d954ea7000/0x85f51a6b967151ad lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x124:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f64b19e0 expref: 40 pid: 104234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051334.998720:0:104234:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d954ea7000, rc 0) 00010000:00080000:0.0:1777051334.999048:0:104234:0:(ldlm_lib.c:2086:extend_recovery_timer()) lustre-MDT0001: recovery timer will expire in 100 seconds 00010000:00080000:0.0:1777051334.999060:0:104234:0:(ldlm_lib.c:2438:target_next_replay_lock()) Waiting for lock 00000100:00100000:3.0:1777051334.999442:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051334.999572:0:27882:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425889408 00000100:00100000:0.0:1777051334.999582:0:27882:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425889408 00000100:00100000:0.0:1777051334.999637:0:27882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111808 00000100:00100000:0.0:1777051334.999650:0:27882:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d9418f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+40:2435:x1863365425889408:12345-192.168.201.46@tcp:101:ldlm_lock_repla.0 00010000:00080000:0.0:1777051334.999667:0:27882:0:(ldlm_lib.c:3170:target_queue_recovery_request()) @@@ queue lock replay req req@ffff99d9418f4e00 x1863365425889408/t0(0) o101->2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp:295/0 lens 328/0 e 0 to 0 dl 1777051345 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1777051334.999700:0:27882:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d9418f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+40:2435:x1863365425889408:12345-192.168.201.46@tcp:101:ldlm_lock_repla.0 Request processed in 53us (263us total) trans 0 rc 0/-999 00000100:00100000:0.0:1777051334.999711:0:27882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111808 00010000:00080000:2.0:1777051334.999775:0:104234:0:(ldlm_lib.c:2268:check_for_next_lock()) waking for next lock 00010000:00080000:2.0:1777051334.999790:0:104234:0:(ldlm_lib.c:2871:target_recovery_thread()) @@@ processing lock from 192.168.201.46@tcp: req@ffff99d9418f4e00 x1863365425889408/t0(0) o101->2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp:295/0 lens 328/0 e 0 to 0 dl 1777051345 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1777051334.999823:0:104234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051334.999847:0:104234:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d955a8f000/0x85f51a6b967151b4 lrc: 2/0,0 mode: --/PR res: [0x240000403:0x162:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f64b2f9d expref: -99 pid: 104234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051334.999876:0:104234:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d955a8f000/0x85f51a6b967151b4 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x162:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f64b2f9d expref: 41 pid: 104234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051334.999897:0:104234:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99d955a8f000/0x85f51a6b967151b4 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x162:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f64b2f9d expref: 41 pid: 104234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051334.999912:0:104234:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d955a8f000, rc 0) 00010000:00080000:2.0:1777051334.999993:0:104234:0:(ldlm_lib.c:2086:extend_recovery_timer()) lustre-MDT0001: recovery timer will expire in 100 seconds 00010000:00080000:2.0:1777051335.000009:0:104234:0:(ldlm_lib.c:2438:target_next_replay_lock()) Waiting for lock 00000100:00100000:1.0:1777051335.000062:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051335.000233:0:8492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425889536 00000100:00100000:2.0:1777051335.000240:0:8492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425889536 00000100:00100000:2.0:1777051335.000282:0:8492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111809 00000100:00100000:2.0:1777051335.000296:0:8492:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942a0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+41:2435:x1863365425889536:12345-192.168.201.46@tcp:101:ldlm_lock_repla.0 00010000:00080000:2.0:1777051335.000316:0:8492:0:(ldlm_lib.c:3170:target_queue_recovery_request()) @@@ queue lock replay req req@ffff99d942a0d880 x1863365425889536/t0(0) o101->2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp:296/0 lens 328/0 e 0 to 0 dl 1777051346 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1777051335.000353:0:8492:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942a0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+41:2435:x1863365425889536:12345-192.168.201.46@tcp:101:ldlm_lock_repla.0 Request processed in 61us (296us total) trans 0 rc 0/-999 00000100:00100000:2.0:1777051335.000364:0:8492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111809 00000100:00100000:0.0:1777051335.000504:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00010000:00080000:3.0:1777051335.000543:0:104234:0:(ldlm_lib.c:2268:check_for_next_lock()) waking for next lock 00000100:00100000:0.0:1777051335.000551:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051335.000606:0:27885:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425889664 00000100:00100000:0.0:1777051335.000608:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051335.000618:0:27885:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425889664 00000100:00100000:0.0:1777051335.000653:0:46497:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425889792 00000100:00100000:0.0:1777051335.000660:0:46497:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425889792 00000100:00100000:1.0:1777051335.000993:0:27885:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425889920 00000100:00100000:1.0:1777051335.001003:0:27885:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425889920 00010000:00080000:3.0:1777051335.001012:0:104234:0:(ldlm_lib.c:2871:target_recovery_thread()) @@@ processing lock from 192.168.201.46@tcp: req@ffff99d942a0d880 x1863365425889536/t0(0) o101->2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp:296/0 lens 328/0 e 0 to 0 dl 1777051346 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1777051335.001029:0:46497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111810 00010000:00010000:3.0:1777051335.001041:0:104234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1777051335.001048:0:46497:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95a580700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+44:2435:x1863365425889664:12345-192.168.201.46@tcp:101:ldlm_lock_repla.0 00010000:00010000:3.0:1777051335.001068:0:104234:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d955a90a00/0x85f51a6b967151bb lrc: 2/0,0 mode: --/PR res: [0x240000403:0x161:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f64b30a0 expref: -99 pid: 104234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:0.0:1777051335.001069:0:46497:0:(ldlm_lib.c:3170:target_queue_recovery_request()) @@@ queue lock replay req req@ffff99d95a580700 x1863365425889664/t0(0) o101->2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp:296/0 lens 328/0 e 0 to 0 dl 1777051346 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1777051335.001101:0:27885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111811 00000100:00100000:0.0:1777051335.001113:0:46497:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95a580700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+45:2435:x1863365425889664:12345-192.168.201.46@tcp:101:ldlm_lock_repla.0 Request processed in 70us (608us total) trans 0 rc 0/-999 00000100:00100000:1.0:1777051335.001128:0:27885:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95a581880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+45:2435:x1863365425889792:12345-192.168.201.46@tcp:101:ldlm_lock_repla.0 00000100:00100000:0.0:1777051335.001131:0:46497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111810 00010000:00080000:1.0:1777051335.001157:0:27885:0:(ldlm_lib.c:3170:target_queue_recovery_request()) @@@ queue lock replay req req@ffff99d95a581880 x1863365425889792/t0(0) o101->2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp:296/0 lens 328/0 e 0 to 0 dl 1777051346 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1777051335.001177:0:27885:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95a581880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+45:2435:x1863365425889792:12345-192.168.201.46@tcp:101:ldlm_lock_repla.0 Request processed in 61us (628us total) trans 0 rc 0/-999 00000100:00100000:3.0:1777051335.001289:0:21368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111812 00000100:00100000:3.0:1777051335.001307:0:21368:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95a580e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+45:2435:x1863365425889920:12345-192.168.201.46@tcp:101:ldlm_lock_repla.0 00010000:00080000:3.0:1777051335.001325:0:21368:0:(ldlm_lib.c:3170:target_queue_recovery_request()) @@@ queue lock replay req req@ffff99d95a580e00 x1863365425889920/t0(0) o101->2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp:296/0 lens 328/0 e 0 to 0 dl 1777051346 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777051335.001383:0:21368:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95a580e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+45:2435:x1863365425889920:12345-192.168.201.46@tcp:101:ldlm_lock_repla.0 Request processed in 80us (777us total) trans 0 rc 0/-999 00000100:00100000:3.0:1777051335.001395:0:21368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111812 00010000:00010000:3.0:1777051335.001430:0:104234:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d955a90a00/0x85f51a6b967151bb lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x161:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f64b30a0 expref: 45 pid: 104234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051335.001484:0:104234:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99d955a90a00/0x85f51a6b967151bb lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x161:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f64b30a0 expref: 45 pid: 104234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051335.001501:0:104234:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d955a90a00, rc 0) 00010000:00080000:3.0:1777051335.001548:0:104234:0:(ldlm_lib.c:2086:extend_recovery_timer()) lustre-MDT0001: recovery timer will expire in 100 seconds 00010000:00080000:3.0:1777051335.001567:0:104234:0:(ldlm_lib.c:2438:target_next_replay_lock()) Waiting for lock 00000100:00100000:1.0:1777051335.001670:0:27885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111811 00010000:00080000:3.0:1777051335.001690:0:104234:0:(ldlm_lib.c:2268:check_for_next_lock()) waking for next lock 00010000:00080000:3.0:1777051335.001708:0:104234:0:(ldlm_lib.c:2871:target_recovery_thread()) @@@ processing lock from 192.168.201.46@tcp: req@ffff99d95a580700 x1863365425889664/t0(0) o101->2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp:296/0 lens 328/0 e 0 to 0 dl 1777051346 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1777051335.001731:0:104234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777051335.002170:0:104234:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d955a90600/0x85f51a6b967151c2 lrc: 2/0,0 mode: --/PR res: [0x240000403:0x121:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f64b1bca expref: -99 pid: 104234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051335.002207:0:104234:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d955a90600/0x85f51a6b967151c2 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x121:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f64b1bca expref: 45 pid: 104234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051335.002228:0:104234:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99d955a90600/0x85f51a6b967151c2 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x121:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f64b1bca expref: 45 pid: 104234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051335.002243:0:104234:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d955a90600, rc 0) 00010000:00080000:3.0:1777051335.002300:0:104234:0:(ldlm_lib.c:2086:extend_recovery_timer()) lustre-MDT0001: recovery timer will expire in 100 seconds 00000100:00100000:1.0:1777051335.002327:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00010000:00080000:3.0:1777051335.002351:0:104234:0:(ldlm_lib.c:2438:target_next_replay_lock()) Waiting for lock 00010000:00080000:3.0:1777051335.002356:0:104234:0:(ldlm_lib.c:2268:check_for_next_lock()) waking for next lock 00010000:00080000:3.0:1777051335.002371:0:104234:0:(ldlm_lib.c:2871:target_recovery_thread()) @@@ processing lock from 192.168.201.46@tcp: req@ffff99d95a581880 x1863365425889792/t0(0) o101->2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp:296/0 lens 328/0 e 0 to 0 dl 1777051346 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1777051335.002393:0:104234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777051335.002418:0:104234:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d94ffbda00/0x85f51a6b967151c9 lrc: 2/0,0 mode: --/PR res: [0x240000403:0xc1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f64afae5 expref: -99 pid: 104234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051335.002485:0:104234:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d94ffbda00/0x85f51a6b967151c9 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0xc1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f64afae5 expref: 45 pid: 104234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051335.002541:0:104234:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94ffbda00/0x85f51a6b967151c9 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0xc1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f64afae5 expref: 45 pid: 104234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051335.002549:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00010000:00010000:3.0:1777051335.002564:0:104234:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d94ffbda00, rc 0) 00000100:00100000:1.0:1777051335.002629:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00010000:00080000:3.0:1777051335.002639:0:104234:0:(ldlm_lib.c:2086:extend_recovery_timer()) lustre-MDT0001: recovery timer will expire in 100 seconds 00010000:00080000:3.0:1777051335.002661:0:104234:0:(ldlm_lib.c:2438:target_next_replay_lock()) Waiting for lock 00010000:00080000:3.0:1777051335.002693:0:104234:0:(ldlm_lib.c:2268:check_for_next_lock()) waking for next lock 00010000:00080000:3.0:1777051335.002709:0:104234:0:(ldlm_lib.c:2871:target_recovery_thread()) @@@ processing lock from 192.168.201.46@tcp: req@ffff99d95a580e00 x1863365425889920/t0(0) o101->2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp:296/0 lens 328/0 e 0 to 0 dl 1777051346 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1777051335.002726:0:10328:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425890048 00010000:00010000:3.0:1777051335.002732:0:104234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1777051335.002736:0:10328:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425890048 00010000:00010000:3.0:1777051335.002765:0:104234:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d95d339600/0x85f51a6b967151d0 lrc: 2/0,0 mode: --/PR res: [0x240000403:0x180:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f64b3a8d expref: -99 pid: 104234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051335.002795:0:104234:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d95d339600/0x85f51a6b967151d0 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x180:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f64b3a8d expref: 46 pid: 104234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051335.002805:0:10328:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425890176 00000100:00100000:1.0:1777051335.002813:0:10328:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425890176 00010000:00010000:3.0:1777051335.002818:0:104234:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99d95d339600/0x85f51a6b967151d0 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x180:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f64b3a8d expref: 46 pid: 104234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051335.002834:0:104234:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d95d339600, rc 0) 00000100:00100000:1.0:1777051335.002870:0:10328:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425890304 00000100:00100000:1.0:1777051335.002891:0:10328:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425890304 00010000:00080000:3.0:1777051335.002894:0:104234:0:(ldlm_lib.c:2086:extend_recovery_timer()) lustre-MDT0001: recovery timer will expire in 100 seconds 00010000:00080000:3.0:1777051335.002931:0:104234:0:(ldlm_lib.c:2438:target_next_replay_lock()) Waiting for lock 00000100:00100000:1.0:1777051335.003288:0:10328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111813 00000100:00100000:1.0:1777051335.003308:0:10328:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942a0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+47:2435:x1863365425890048:12345-192.168.201.46@tcp:101:ldlm_lock_repla.0 00010000:00080000:1.0:1777051335.003331:0:10328:0:(ldlm_lib.c:3170:target_queue_recovery_request()) @@@ queue lock replay req req@ffff99d942a0c700 x1863365425890048/t0(0) o101->2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp:296/0 lens 328/0 e 0 to 0 dl 1777051346 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777051335.003350:0:21368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111814 00000100:00100000:1.0:1777051335.003373:0:10328:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942a0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+47:2435:x1863365425890048:12345-192.168.201.46@tcp:101:ldlm_lock_repla.0 Request processed in 69us (1050us total) trans 0 rc 0/-999 00000100:00100000:3.0:1777051335.003376:0:21368:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942a0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+47:2435:x1863365425890176:12345-192.168.201.46@tcp:101:ldlm_lock_repla.0 00000100:00100000:1.0:1777051335.003401:0:10328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111813 00010000:00080000:3.0:1777051335.003407:0:21368:0:(ldlm_lib.c:3170:target_queue_recovery_request()) @@@ queue lock replay req req@ffff99d942a0df80 x1863365425890176/t0(0) o101->2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp:296/0 lens 328/0 e 0 to 0 dl 1777051346 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777051335.003431:0:21368:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942a0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+47:2435:x1863365425890176:12345-192.168.201.46@tcp:101:ldlm_lock_repla.0 Request processed in 65us (895us total) trans 0 rc 0/-999 00000100:00100000:1.0:1777051335.003442:0:10328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111815 00000100:00100000:1.0:1777051335.003487:0:10328:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942a0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+47:2435:x1863365425890304:12345-192.168.201.46@tcp:101:ldlm_lock_repla.0 00000100:00100000:3.0:1777051335.003495:0:21368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111814 00010000:00080000:3.0:1777051335.003539:0:104234:0:(ldlm_lib.c:2268:check_for_next_lock()) waking for next lock 00010000:00080000:1.0:1777051335.003555:0:10328:0:(ldlm_lib.c:3170:target_queue_recovery_request()) @@@ queue lock replay req req@ffff99d942a0c380 x1863365425890304/t0(0) o101->2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp:296/0 lens 328/0 e 0 to 0 dl 1777051346 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00080000:3.0:1777051335.003558:0:104234:0:(ldlm_lib.c:2871:target_recovery_thread()) @@@ processing lock from 192.168.201.46@tcp: req@ffff99d942a0c700 x1863365425890048/t0(0) o101->2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp:296/0 lens 328/0 e 0 to 0 dl 1777051346 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1777051335.003598:0:10328:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942a0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+47:2435:x1863365425890304:12345-192.168.201.46@tcp:101:ldlm_lock_repla.0 Request processed in 113us (973us total) trans 0 rc 0/-999 00010000:00010000:3.0:1777051335.003601:0:104234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1777051335.003617:0:10328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111815 00010000:00010000:3.0:1777051335.003629:0:104234:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d95d339000/0x85f51a6b967151d7 lrc: 2/0,0 mode: --/PR res: [0x240000403:0x120:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f64b180b expref: -99 pid: 104234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051335.003663:0:104234:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d95d339000/0x85f51a6b967151d7 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x120:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f64b180b expref: 48 pid: 104234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051335.003684:0:104234:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99d95d339000/0x85f51a6b967151d7 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x120:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f64b180b expref: 48 pid: 104234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051335.004146:0:104234:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d95d339000, rc 0) 00010000:00080000:3.0:1777051335.004204:0:104234:0:(ldlm_lib.c:2086:extend_recovery_timer()) lustre-MDT0001: recovery timer will expire in 100 seconds 00010000:00080000:3.0:1777051335.004218:0:104234:0:(ldlm_lib.c:2438:target_next_replay_lock()) Waiting for lock 00010000:00080000:3.0:1777051335.004222:0:104234:0:(ldlm_lib.c:2268:check_for_next_lock()) waking for next lock 00010000:00080000:3.0:1777051335.004234:0:104234:0:(ldlm_lib.c:2871:target_recovery_thread()) @@@ processing lock from 192.168.201.46@tcp: req@ffff99d942a0df80 x1863365425890176/t0(0) o101->2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp:296/0 lens 328/0 e 0 to 0 dl 1777051346 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1777051335.004254:0:104234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777051335.004278:0:104234:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d95d339800/0x85f51a6b967151de lrc: 2/0,0 mode: --/PR res: [0x240000403:0x17f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f64b3928 expref: -99 pid: 104234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051335.004308:0:104234:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d95d339800/0x85f51a6b967151de lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x17f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f64b3928 expref: 48 pid: 104234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051335.004329:0:104234:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99d95d339800/0x85f51a6b967151de lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x17f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f64b3928 expref: 48 pid: 104234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051335.004343:0:104234:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d95d339800, rc 0) 00010000:00080000:3.0:1777051335.004403:0:104234:0:(ldlm_lib.c:2086:extend_recovery_timer()) lustre-MDT0001: recovery timer will expire in 100 seconds 00010000:00080000:3.0:1777051335.004421:0:104234:0:(ldlm_lib.c:2438:target_next_replay_lock()) Waiting for lock 00010000:00080000:3.0:1777051335.004506:0:104234:0:(ldlm_lib.c:2268:check_for_next_lock()) waking for next lock 00010000:00080000:3.0:1777051335.004518:0:104234:0:(ldlm_lib.c:2871:target_recovery_thread()) @@@ processing lock from 192.168.201.46@tcp: req@ffff99d942a0c380 x1863365425890304/t0(0) o101->2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp:296/0 lens 328/0 e 0 to 0 dl 1777051346 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1777051335.004538:0:104234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051335.004935:0:104234:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d955a8ee00/0x85f51a6b967151e5 lrc: 2/0,0 mode: --/PR res: [0x240000403:0x15e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f64b2e46 expref: -99 pid: 104234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051335.004969:0:104234:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d955a8ee00/0x85f51a6b967151e5 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x15e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f64b2e46 expref: 48 pid: 104234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051335.004989:0:104234:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99d955a8ee00/0x85f51a6b967151e5 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x15e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f64b2e46 expref: 48 pid: 104234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051335.005002:0:104234:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d955a8ee00, rc 0) 00010000:00080000:2.0:1777051335.005052:0:104234:0:(ldlm_lib.c:2086:extend_recovery_timer()) lustre-MDT0001: recovery timer will expire in 100 seconds 00010000:00080000:2.0:1777051335.005066:0:104234:0:(ldlm_lib.c:2438:target_next_replay_lock()) Waiting for lock 00000100:00100000:3.0:1777051335.007369:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051335.007537:0:27885:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425890432 00000100:00100000:1.0:1777051335.007546:0:27885:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425890432 00000100:00100000:1.0:1777051335.007609:0:27885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13221 00000100:00100000:1.0:1777051335.007628:0:27885:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d9418f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+48:2435:x1863365425890432:12345-192.168.201.46@tcp:400:ptlrpcd_rcv.0 00010000:00080000:1.0:1777051335.007647:0:27885:0:(ldlm_lib.c:3120:target_queue_recovery_request()) @@@ queue final req req@ffff99d9418f4a80 x1863365425890432/t0(0) o400->2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp:296/0 lens 224/0 e 0 to 0 dl 1777051346 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1777051335.008021:0:27885:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d9418f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+48:2435:x1863365425890432:12345-192.168.201.46@tcp:400:ptlrpcd_rcv.0 Request processed in 399us (655us total) trans 0 rc 0/-999 00000100:00100000:1.0:1777051335.008299:0:27885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13221 00010000:00080000:3.0:1777051335.008374:0:104234:0:(ldlm_lib.c:2271:check_for_next_lock()) waking for completed lock replay 00000001:00000004:3.0:1777051335.008564:0:104234:0:(tgt_lastrcvd.c:732:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000001:00100000:0.0:1777051335.017265:0:104205:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 2dd4696c-edce-4cd1-86d2-dbd2ff957fa1 00000001:00100000:0.0:1777051335.017279:0:104205:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1777051335.017285:0:104205:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of c11b6966-0775-44d2-bdc6-c74c26eb2226 00000001:00080000:3.0:1777051335.017431:0:104234:0:(tgt_lastrcvd.c:223:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00010000:00080000:3.0:1777051335.017527:0:104234:0:(ldlm_lib.c:1982:target_cancel_recovery_timer()) lustre-MDT0001: cancel recovery timer 00010000:00080000:3.0:1777051335.017549:0:104234:0:(ldlm_lib.c:2923:target_recovery_thread()) @@@ processing final ping from 192.168.201.46@tcp: req@ffff99d94e624a80 x1863365425885056/t0(0) o400->c11b6966-0775-44d2-bdc6-c74c26eb2226@192.168.201.46@tcp:292/0 lens 224/0 e 0 to 0 dl 1777051342 ref 1 fl Complete:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00080000:3.0:1777051335.017678:0:104234:0:(ldlm_lib.c:2923:target_recovery_thread()) @@@ processing final ping from 0@lo: req@ffff99da5f9bce00 x1863365452569600/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:295/0 lens 224/0 e 0 to 0 dl 1777051345 ref 1 fl Complete:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00080000:3.0:1777051335.017787:0:104234:0:(ldlm_lib.c:2923:target_recovery_thread()) @@@ processing final ping from 192.168.201.46@tcp: req@ffff99d9418f4a80 x1863365425890432/t0(0) o400->2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp:296/0 lens 224/0 e 0 to 0 dl 1777051346 ref 1 fl Complete:H/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1777051335.017864:0:3676:0:(import.c:65:import_set_state_nolock()) ffff99da42f4c800 lustre-MDT0001_UUID: changing import state from REPLAY_WAIT to RECOVER 00010000:02000000:3.0:1777051335.017868:0:104234:0:(ldlm_lib.c:1854:target_finish_recovery()) lustre-MDT0001: Recovery over after 0:04, of 3 clients 3 recovered and 0 were evicted. 00000100:00080000:1.0:1777051335.017885:0:3676:0:(client.c:3223:ptlrpc_resend_req()) @@@ going to resend req@ffff99d955504a80 x1863365452569600/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1777051350 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1777051335.017903:0:3676:0:(client.c:3232:ptlrpc_resend_req()) @@@ it has reply, so skip it req@ffff99d955504a80 x1863365452569600/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1777051350 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1777051335.017918:0:3676:0:(import.c:65:import_set_state_nolock()) ffff99da42f4c800 lustre-MDT0001_UUID: changing import state from RECOVER to FULL 00000100:02000000:1.0:1777051335.017945:0:3676:0:(import.c:1737:ptlrpc_import_recovery_state_machine()) lustre-MDT0001-osp-MDT0000: Connection restored to 0@lo (at 0@lo) 00000100:00080000:1.0:1777051335.017955:0:3676:0:(recover.c:189:ptlrpc_wake_delayed()) @@@ waking (set 00000000fc12b4e1): req@ffff99d956129c00 x1863365452554368/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1777051331 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1777051335.017984:0:3676:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955504a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3676:1863365452569600:0@lo:400:ldlm_lock_repla.0 00000100:00100000:1.0:1777051335.018103:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95a581500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452569728:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1777051335.018118:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051335.018184:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051335.018259:0:6585:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452554368 00000100:00100000:2.0:1777051335.018267:0:11727:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452569728 00000100:00100000:0.0:1777051335.018271:0:6585:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452554368 00000100:00100000:2.0:1777051335.018279:0:11727:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452569728 00000100:00100000:0.0:1777051335.018367:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8060 00000100:00100000:2.0:1777051335.018386:0:11727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8061 00000100:00100000:0.0:1777051335.018389:0:6585:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d944e10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:3680:x1863365452554368:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1777051335.018409:0:11727:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942a0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:3679:x1863365452569728:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1777051335.018430:0:6585:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4194304 pending 0 free 1446219776 avail 1299980288 00000004:00000024:2.0:1777051335.018437:0:11727:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4194304 pending 0 free 1446219776 avail 1299980288 00000100:00100000:0.0:1777051335.018577:0:6585:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d944e10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:3680:x1863365452554368:12345-0@lo:41:osp-pre-1-0.0 Request processed in 196us (466us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051335.018583:0:11727:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942a0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:3679:x1863365452569728:12345-0@lo:41:osp-pre-1-0.0 Request processed in 178us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051335.018599:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8060 00000100:00100000:2.0:1777051335.018610:0:11727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8061 00000100:00100000:2.0:1777051335.018999:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95a581500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452569728:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1777051335.019072:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d956129c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3680:1863365452554368:0@lo:41:osp-pre-1-0.0 00000004:00000080:2.0:1777051335.067109:0:104234:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffb08947edfe10 00100000:10000000:2.0:1777051335.067128:0:104234:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000004:00080000:1.0:1777051335.068917:0:104214:0:(osp_precreate.c:877:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0xe3:0x0] 00000004:00080000:3.0:1777051335.068918:0:104216:0:(osp_precreate.c:877:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0xe3:0x0] 00000100:00100000:1.0:1777051335.068987:0:104214:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d942a0f800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:104214:1863365452569984:0@lo:5:osp-pre-0-1.0 00000100:00100000:3.0:1777051335.069015:0:104216:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d9418f6d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:104216:1863365452569856:0@lo:5:osp-pre-1-1.0 00000100:00100000:3.0:1777051335.069095:0:104216:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051335.069146:0:8470:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452569856 00000100:00100000:3.0:1777051335.069152:0:104216:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d9598763c0 going to sleep for 11 seconds 00000100:00100000:1.0:1777051335.069158:0:8470:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452569856 00000100:00100000:1.0:1777051335.069285:0:8470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7958 00000100:00100000:1.0:1777051335.069307:0:8470:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d9418f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:104216:x1863365452569856:12345-0@lo:5:osp-pre-1-1.0 00000100:00100000:2.0:1777051335.069332:0:104214:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00080000:1.0:1777051335.069350:0:8470:0:(ofd_dev.c:1637:ofd_create_hdl()) ofd_last_id() = 257 -> diff = -30 00002000:02000040:1.0:1777051335.069360:0:8470:0:(ofd_dev.c:1488:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x2c0000400:228 to 0x2c0000400:257) 00000100:00100000:2.0:1777051335.069385:0:104214:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d944ac0240 going to sleep for 11 seconds 00000100:00100000:0.0:1777051335.069390:0:13320:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452569984 00000100:00100000:0.0:1777051335.069399:0:13320:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452569984 00000100:00100000:0.0:1777051335.069484:0:13320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7959 00000100:00100000:0.0:1777051335.069499:0:13320:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5fbec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:104214:x1863365452569984:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:0.0:1777051335.069524:0:13320:0:(ofd_dev.c:1637:ofd_create_hdl()) ofd_last_id() = 257 -> diff = -30 00002000:02000040:0.0:1777051335.069531:0:13320:0:(ofd_dev.c:1488:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:228 to 0x280000400:257) 00002000:00010000:1.0:1777051335.089991:0:8470:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x101:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777051335.090009:0:8470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e94bbe71/0x85f51a6b967151ec lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x101:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.090035:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051335.090040:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051335.090048:0:8470:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e94bbe71/0x85f51a6b967151ec lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x101:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.090086:0:8470:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e94bbe71/0x85f51a6b967151ec lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x101:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.090114:0:8470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e94bbe71/0x85f51a6b967151ec lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x101:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.090130:0:8470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e94bbe71/0x85f51a6b967151ec lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x101:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.090166:0:8470:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1777051335.090487:0:6567:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777051335.090501:0:6567:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e94bbe71/0x85f51a6b967151ec lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x101:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051335.090520:0:6567:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d953299800 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:2.0:1777051335.090548:0:6567:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e94bbe71/0x85f51a6b967151ec lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x101:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051335.090566:0:6567:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e94bbe71/0x85f51a6b967151ec lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x101:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051335.090593:0:6567:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e94bbe71/0x85f51a6b967151ec lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x101:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051335.090608:0:6567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e94bbe71/0x85f51a6b967151ec lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x101:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051335.090640:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777051335.090646:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777051335.090650:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1777051335.090658:0:8470:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x100:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777051335.090671:0:8470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000efd61c8/0x85f51a6b967151f3 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x100:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.090687:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051335.090689:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051335.090695:0:8470:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000efd61c8/0x85f51a6b967151f3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x100:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.090720:0:8470:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000efd61c8/0x85f51a6b967151f3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x100:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.090734:0:8470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000efd61c8/0x85f51a6b967151f3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x100:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.090747:0:8470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000efd61c8/0x85f51a6b967151f3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x100:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.090781:0:8470:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1777051335.090863:0:8470:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0xff:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777051335.090871:0:8470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003a6ac3f9/0x85f51a6b967151fa lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xff:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.090885:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051335.090888:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051335.090893:0:8470:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003a6ac3f9/0x85f51a6b967151fa lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.090908:0:8470:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003a6ac3f9/0x85f51a6b967151fa lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.090921:0:8470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003a6ac3f9/0x85f51a6b967151fa lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.090934:0:8470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003a6ac3f9/0x85f51a6b967151fa lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.090956:0:8470:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1777051335.091038:0:8470:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0xfe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777051335.091048:0:8470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e959e0e6/0x85f51a6b96715201 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xfe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.091062:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051335.091064:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051335.091070:0:8470:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e959e0e6/0x85f51a6b96715201 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xfe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.091085:0:8470:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e959e0e6/0x85f51a6b96715201 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xfe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.091102:0:8470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e959e0e6/0x85f51a6b96715201 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xfe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051335.091107:0:13753:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1777051335.091123:0:8470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e959e0e6/0x85f51a6b96715201 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xfe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051335.091123:0:13753:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000efd61c8/0x85f51a6b967151f3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x100:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051335.091438:0:13753:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d953298000 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:2.0:1777051335.091466:0:13753:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000efd61c8/0x85f51a6b967151f3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x100:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051335.091493:0:13753:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000efd61c8/0x85f51a6b967151f3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x100:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.091505:0:8470:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1777051335.091515:0:13753:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000efd61c8/0x85f51a6b967151f3 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x100:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1777051335.091569:0:8470:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0xfd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1777051335.091570:0:13753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000efd61c8/0x85f51a6b967151f3 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x100:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.091583:0:8470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008889c7d5/0x85f51a6b96715208 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xfd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.091604:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051335.091607:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051335.091614:0:8470:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008889c7d5/0x85f51a6b96715208 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xfd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.091637:0:8470:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008889c7d5/0x85f51a6b96715208 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xfd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051335.091648:0:13753:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1777051335.091653:0:8470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008889c7d5/0x85f51a6b96715208 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xfd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051335.091655:0:13753:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003a6ac3f9/0x85f51a6b967151fa lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.092006:0:8470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008889c7d5/0x85f51a6b96715208 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xfd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.092033:0:8470:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1777051335.092052:0:38719:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1777051335.092065:0:38719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e959e0e6/0x85f51a6b96715201 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xfe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051335.092084:0:38719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d953299600 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:3.0:1777051335.092090:0:38719:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e959e0e6/0x85f51a6b96715201 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xfe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051335.092098:0:13753:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d953298e00 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:2.0:1777051335.092110:0:13753:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003a6ac3f9/0x85f51a6b967151fa lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1777051335.092113:0:8470:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0xfc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777051335.092113:0:38719:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e959e0e6/0x85f51a6b96715201 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xfe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.092405:0:8470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aa6fe782/0x85f51a6b9671520f lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xfc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051335.092408:0:13753:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003a6ac3f9/0x85f51a6b967151fa lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.092476:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051335.092481:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051335.092488:0:8470:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aa6fe782/0x85f51a6b9671520f lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xfc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051335.092488:0:38719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e959e0e6/0x85f51a6b96715201 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0xfe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051335.092491:0:13753:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003a6ac3f9/0x85f51a6b967151fa lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0xff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051335.092532:0:38719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e959e0e6/0x85f51a6b96715201 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xfe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.092536:0:8470:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aa6fe782/0x85f51a6b9671520f lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xfc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051335.092538:0:13753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003a6ac3f9/0x85f51a6b967151fa lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.092586:0:8470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aa6fe782/0x85f51a6b9671520f lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xfc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051335.092599:0:38719:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777051335.092603:0:8470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000aa6fe782/0x85f51a6b9671520f lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xfc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051335.092608:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051335.092609:0:38719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008889c7d5/0x85f51a6b96715208 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xfd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051335.092616:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777051335.092623:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777051335.092637:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051335.092652:0:38719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d953299e00 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:1.0:1777051335.092658:0:8470:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1777051335.092660:0:38719:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008889c7d5/0x85f51a6b96715208 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xfd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051335.092668:0:13753:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777051335.092681:0:13753:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000aa6fe782/0x85f51a6b9671520f lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xfc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051335.092684:0:38719:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008889c7d5/0x85f51a6b96715208 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xfd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051335.092725:0:13753:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d953299000 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:3.0:1777051335.092734:0:38719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008889c7d5/0x85f51a6b96715208 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0xfd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051335.092735:0:13753:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000aa6fe782/0x85f51a6b9671520f lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xfc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1777051335.092751:0:8470:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0xfb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777051335.092773:0:8470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000075ed02f0/0x85f51a6b96715216 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xfb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051335.092775:0:38719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008889c7d5/0x85f51a6b96715208 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xfd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051335.092780:0:13753:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000aa6fe782/0x85f51a6b9671520f lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xfc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051335.092829:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051335.092835:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051335.092843:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051335.092845:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777051335.092849:0:13753:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000aa6fe782/0x85f51a6b9671520f lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0xfc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.092851:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051335.092861:0:8470:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000075ed02f0/0x85f51a6b96715216 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xfb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051335.092872:0:13753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aa6fe782/0x85f51a6b9671520f lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xfc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051335.092874:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051335.092891:0:8470:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000075ed02f0/0x85f51a6b96715216 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xfb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051335.092905:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051335.092909:0:8470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000075ed02f0/0x85f51a6b96715216 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xfb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051335.092910:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777051335.092916:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051335.092930:0:8470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000075ed02f0/0x85f51a6b96715216 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xfb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.092958:0:8470:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1777051335.092985:0:6567:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777051335.092994:0:6567:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000075ed02f0/0x85f51a6b96715216 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xfb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051335.093009:0:6567:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d953299a00 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:2.0:1777051335.093016:0:6567:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000075ed02f0/0x85f51a6b96715216 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xfb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1777051335.093019:0:8470:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0xfa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777051335.093040:0:8470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000bda7984/0x85f51a6b9671521d lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xfa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051335.093042:0:6567:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000075ed02f0/0x85f51a6b96715216 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xfb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.093074:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051335.093079:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777051335.093083:0:6567:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000075ed02f0/0x85f51a6b96715216 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0xfb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.093085:0:8470:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000bda7984/0x85f51a6b9671521d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xfa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051335.093128:0:6567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000075ed02f0/0x85f51a6b96715216 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xfb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.093134:0:8470:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000bda7984/0x85f51a6b9671521d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xfa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051335.093168:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777051335.093173:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051335.093176:0:8470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000bda7984/0x85f51a6b9671521d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xfa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051335.093178:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051335.093195:0:8470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000bda7984/0x85f51a6b9671521d lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xfa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.093251:0:8470:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1777051335.093316:0:8470:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0xf9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777051335.093325:0:8470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e529f81b/0x85f51a6b96715224 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xf9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.093338:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051335.093341:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051335.093346:0:8470:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e529f81b/0x85f51a6b96715224 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xf9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.093361:0:8470:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e529f81b/0x85f51a6b96715224 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xf9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.093374:0:8470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e529f81b/0x85f51a6b96715224 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xf9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.093387:0:8470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e529f81b/0x85f51a6b96715224 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xf9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.093418:0:8470:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1777051335.093492:0:6568:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1777051335.093503:0:6568:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000bda7984/0x85f51a6b9671521d lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xfa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051335.093521:0:6568:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d953298400 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:2.0:1777051335.093530:0:6568:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000bda7984/0x85f51a6b9671521d lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xfa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1777051335.093544:0:8470:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0xf8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1777051335.093545:0:6568:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000bda7984/0x85f51a6b9671521d lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xfa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051335.093547:0:38719:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777051335.093564:0:8470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009b2eedcb/0x85f51a6b9671522b lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xf8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051335.093576:0:38719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e529f81b/0x85f51a6b96715224 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xf9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051335.093578:0:6568:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000bda7984/0x85f51a6b9671521d lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0xfa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.093584:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051335.093591:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051335.093600:0:8470:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009b2eedcb/0x85f51a6b9671522b lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xf8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051335.093624:0:6568:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000bda7984/0x85f51a6b9671521d lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xfa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051335.093628:0:38719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d955a99000 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:3.0:1777051335.093641:0:38719:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e529f81b/0x85f51a6b96715224 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xf9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.093645:0:8470:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009b2eedcb/0x85f51a6b9671522b lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xf8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051335.093941:0:38719:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e529f81b/0x85f51a6b96715224 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xf9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.093968:0:8470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009b2eedcb/0x85f51a6b9671522b lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xf8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051335.093978:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777051335.093984:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051335.093987:0:8470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009b2eedcb/0x85f51a6b9671522b lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xf8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051335.093989:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051335.093991:0:38719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e529f81b/0x85f51a6b96715224 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0xf9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051335.094026:0:38719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e529f81b/0x85f51a6b96715224 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xf9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.094037:0:8470:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1777051335.094066:0:13753:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777051335.094077:0:13753:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009b2eedcb/0x85f51a6b9671522b lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xf8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051335.094093:0:13753:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d955a98600 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:3.0:1777051335.094096:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777051335.094103:0:13753:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009b2eedcb/0x85f51a6b9671522b lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xf8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051335.094103:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051335.094108:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1777051335.094114:0:8470:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0xf7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777051335.094135:0:8470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009bc4e541/0x85f51a6b96715232 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xf7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051335.094136:0:13753:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009b2eedcb/0x85f51a6b9671522b lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xf8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.094178:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051335.094184:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777051335.094186:0:13753:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009b2eedcb/0x85f51a6b9671522b lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0xf8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.094190:0:8470:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009bc4e541/0x85f51a6b96715232 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xf7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051335.094251:0:13753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009b2eedcb/0x85f51a6b9671522b lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xf8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.094263:0:8470:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009bc4e541/0x85f51a6b96715232 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xf7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.094283:0:8470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009bc4e541/0x85f51a6b96715232 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xf7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051335.094283:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777051335.094288:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777051335.094295:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051335.094307:0:8470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009bc4e541/0x85f51a6b96715232 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xf7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.094335:0:8470:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1777051335.094350:0:6567:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777051335.094359:0:6567:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009bc4e541/0x85f51a6b96715232 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xf7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051335.094386:0:6567:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d955a99400 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:2.0:1777051335.094393:0:6567:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009bc4e541/0x85f51a6b96715232 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xf7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051335.094407:0:6567:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009bc4e541/0x85f51a6b96715232 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xf7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1777051335.094416:0:8470:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0xf6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777051335.094433:0:8470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d0dfae23/0x85f51a6b96715239 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xf6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051335.094433:0:6567:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009bc4e541/0x85f51a6b96715232 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0xf7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.094482:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051335.094488:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051335.094498:0:8470:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d0dfae23/0x85f51a6b96715239 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xf6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051335.094498:0:6567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009bc4e541/0x85f51a6b96715232 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xf7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.094541:0:8470:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d0dfae23/0x85f51a6b96715239 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xf6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051335.094549:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777051335.094554:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777051335.094559:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051335.094562:0:8470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d0dfae23/0x85f51a6b96715239 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xf6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.094577:0:8470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d0dfae23/0x85f51a6b96715239 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xf6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.094602:0:8470:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1777051335.094618:0:6568:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777051335.094626:0:6568:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d0dfae23/0x85f51a6b96715239 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xf6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051335.094639:0:6568:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d955a98800 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:2.0:1777051335.094645:0:6568:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d0dfae23/0x85f51a6b96715239 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xf6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051335.094660:0:6568:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d0dfae23/0x85f51a6b96715239 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xf6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1777051335.094676:0:8470:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0xf5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1777051335.094680:0:6568:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d0dfae23/0x85f51a6b96715239 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0xf6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.094688:0:8470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004c52e686/0x85f51a6b96715240 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xf5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051335.094708:0:6568:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d0dfae23/0x85f51a6b96715239 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xf6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.094719:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051335.094725:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051335.094733:0:8470:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004c52e686/0x85f51a6b96715240 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xf5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051335.094739:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777051335.094744:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777051335.095037:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051335.095054:0:8470:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004c52e686/0x85f51a6b96715240 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xf5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.095070:0:8470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004c52e686/0x85f51a6b96715240 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xf5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.095080:0:8470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004c52e686/0x85f51a6b96715240 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xf5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.095111:0:8470:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1777051335.095159:0:38719:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777051335.095168:0:38719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004c52e686/0x85f51a6b96715240 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xf5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1777051335.095175:0:8470:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0xf4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777051335.095193:0:38719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d955a99c00 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:3.0:1777051335.095198:0:38719:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004c52e686/0x85f51a6b96715240 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xf5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051335.095211:0:38719:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004c52e686/0x85f51a6b96715240 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xf5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.095224:0:8470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000079b92f21/0x85f51a6b96715247 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xf4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051335.095225:0:38719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004c52e686/0x85f51a6b96715240 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0xf5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051335.095263:0:38719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004c52e686/0x85f51a6b96715240 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xf5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.095269:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051335.095275:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051335.095283:0:8470:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000079b92f21/0x85f51a6b96715247 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xf4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.095311:0:8470:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000079b92f21/0x85f51a6b96715247 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xf4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.095326:0:8470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000079b92f21/0x85f51a6b96715247 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xf4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.095340:0:8470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000079b92f21/0x85f51a6b96715247 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xf4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.095367:0:8470:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1777051335.095379:0:38719:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777051335.095387:0:38719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000079b92f21/0x85f51a6b96715247 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xf4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051335.095397:0:38719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d955a98000 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:2.0:1777051335.095402:0:38719:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000079b92f21/0x85f51a6b96715247 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xf4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051335.095411:0:38719:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000079b92f21/0x85f51a6b96715247 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xf4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051335.095429:0:38719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000079b92f21/0x85f51a6b96715247 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0xf4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051335.095441:0:38719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000079b92f21/0x85f51a6b96715247 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xf4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1777051335.095498:0:8470:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0xf3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777051335.095498:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777051335.095504:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777051335.095510:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051335.095514:0:8470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cd6bdc6a/0x85f51a6b9671524e lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xf3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051335.095516:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051335.095533:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051335.095536:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051335.095554:0:8470:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cd6bdc6a/0x85f51a6b9671524e lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xf3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.095571:0:8470:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cd6bdc6a/0x85f51a6b9671524e lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xf3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.095584:0:8470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cd6bdc6a/0x85f51a6b9671524e lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xf3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.095596:0:8470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cd6bdc6a/0x85f51a6b9671524e lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xf3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.095630:0:8470:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1777051335.095905:0:6567:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777051335.095915:0:6567:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cd6bdc6a/0x85f51a6b9671524e lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xf3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051335.095929:0:6567:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d955a99200 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:2.0:1777051335.095936:0:6567:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cd6bdc6a/0x85f51a6b9671524e lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xf3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051335.095950:0:6567:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cd6bdc6a/0x85f51a6b9671524e lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xf3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051335.095971:0:6567:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cd6bdc6a/0x85f51a6b9671524e lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0xf3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1777051335.095976:0:8470:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0xf2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1777051335.095995:0:6567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cd6bdc6a/0x85f51a6b9671524e lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xf3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.095997:0:8470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006fb857ee/0x85f51a6b96715255 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xf2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051335.096031:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051335.096034:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777051335.096036:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051335.096040:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777051335.096042:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051335.096048:0:8470:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006fb857ee/0x85f51a6b96715255 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xf2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.096066:0:8470:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006fb857ee/0x85f51a6b96715255 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xf2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.096088:0:8470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006fb857ee/0x85f51a6b96715255 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xf2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.096102:0:8470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006fb857ee/0x85f51a6b96715255 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xf2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.096126:0:8470:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1777051335.096147:0:6568:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777051335.096156:0:6568:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006fb857ee/0x85f51a6b96715255 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xf2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051335.096181:0:6568:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da429d7600 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:2.0:1777051335.096187:0:6568:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006fb857ee/0x85f51a6b96715255 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xf2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051335.096230:0:6568:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006fb857ee/0x85f51a6b96715255 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xf2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051335.096250:0:6568:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006fb857ee/0x85f51a6b96715255 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0xf2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1777051335.096252:0:8470:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0xf1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1777051335.096268:0:6568:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006fb857ee/0x85f51a6b96715255 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xf2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.096284:0:8470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005fe8468b/0x85f51a6b9671525c lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xf1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051335.096298:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051335.096301:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777051335.096303:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051335.096307:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777051335.096309:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051335.096315:0:8470:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005fe8468b/0x85f51a6b9671525c lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xf1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.096345:0:8470:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005fe8468b/0x85f51a6b9671525c lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xf1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.096358:0:8470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005fe8468b/0x85f51a6b9671525c lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xf1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.096370:0:8470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005fe8468b/0x85f51a6b9671525c lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xf1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.096408:0:8470:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1777051335.096479:0:13753:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777051335.096488:0:13753:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005fe8468b/0x85f51a6b9671525c lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xf1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051335.096506:0:13753:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da429d7a00 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:3.0:1777051335.096514:0:13753:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005fe8468b/0x85f51a6b9671525c lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xf1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051335.096529:0:13753:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005fe8468b/0x85f51a6b9671525c lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xf1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1777051335.096546:0:8470:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0xf0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777051335.096558:0:8470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000062488c71/0x85f51a6b96715263 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xf0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051335.096566:0:13753:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005fe8468b/0x85f51a6b9671525c lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0xf1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.096572:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051335.096578:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051335.096590:0:13753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005fe8468b/0x85f51a6b9671525c lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xf1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.096596:0:8470:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000062488c71/0x85f51a6b96715263 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xf0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.096637:0:8470:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000062488c71/0x85f51a6b96715263 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xf0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051335.096644:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051335.096649:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051335.096654:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051335.096668:0:8470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000062488c71/0x85f51a6b96715263 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xf0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.096682:0:8470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000062488c71/0x85f51a6b96715263 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xf0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.096727:0:8470:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1777051335.096761:0:38719:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777051335.096769:0:38719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000062488c71/0x85f51a6b96715263 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xf0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051335.096779:0:38719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da429d6400 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:2.0:1777051335.096783:0:38719:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000062488c71/0x85f51a6b96715263 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xf0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1777051335.096791:0:8470:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0xef:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1777051335.096794:0:38719:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000062488c71/0x85f51a6b96715263 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xf0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.096803:0:8470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d4050073/0x85f51a6b9671526a lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xef:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051335.096815:0:38719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000062488c71/0x85f51a6b96715263 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0xf0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.096822:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051335.096829:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777051335.096834:0:38719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000062488c71/0x85f51a6b96715263 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xf0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.096838:0:8470:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d4050073/0x85f51a6b9671526a lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.096874:0:8470:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d4050073/0x85f51a6b9671526a lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051335.096874:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777051335.096878:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777051335.096883:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051335.096896:0:8470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d4050073/0x85f51a6b9671526a lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.096910:0:8470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d4050073/0x85f51a6b9671526a lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.096935:0:8470:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1777051335.096954:0:6567:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777051335.096963:0:6567:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d4050073/0x85f51a6b9671526a lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051335.096977:0:6567:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da429d7200 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:2.0:1777051335.096983:0:6567:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d4050073/0x85f51a6b9671526a lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1777051335.096991:0:8470:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0xee:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1777051335.096997:0:6567:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d4050073/0x85f51a6b9671526a lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.097004:0:8470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000070869722/0x85f51a6b96715271 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xee:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051335.097018:0:6567:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d4050073/0x85f51a6b9671526a lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0xef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.097024:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051335.097030:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777051335.097037:0:6567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d4050073/0x85f51a6b9671526a lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.097040:0:8470:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000070869722/0x85f51a6b96715271 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.097085:0:8470:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000070869722/0x85f51a6b96715271 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051335.097098:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051335.097102:0:8470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000070869722/0x85f51a6b96715271 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051335.097104:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777051335.097110:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051335.097124:0:8470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000070869722/0x85f51a6b96715271 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.097151:0:8470:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1777051335.097167:0:6568:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777051335.097176:0:6568:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000070869722/0x85f51a6b96715271 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051335.097189:0:6568:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da429d6200 already unused, calling callback (ffffffffc0bed2d0) 00002000:00010000:1.0:1777051335.097254:0:8470:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0xed:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1777051335.097254:0:6568:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000070869722/0x85f51a6b96715271 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.097273:0:8470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000062812b6e/0x85f51a6b96715278 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xed:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051335.097282:0:6568:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000070869722/0x85f51a6b96715271 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.097294:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051335.097300:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051335.097308:0:8470:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000062812b6e/0x85f51a6b96715278 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051335.097317:0:6568:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000070869722/0x85f51a6b96715271 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0xee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.097332:0:8470:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000062812b6e/0x85f51a6b96715278 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051335.097336:0:6568:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000070869722/0x85f51a6b96715271 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.097366:0:8470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000062812b6e/0x85f51a6b96715278 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051335.097379:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051335.097382:0:8470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000062812b6e/0x85f51a6b96715278 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051335.097386:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777051335.097391:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051335.097426:0:8470:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1777051335.097516:0:8470:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0xec:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777051335.097525:0:8470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002abffc1a/0x85f51a6b9671527f lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xec:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.097538:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051335.097541:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051335.097546:0:8470:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002abffc1a/0x85f51a6b9671527f lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.097563:0:8470:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002abffc1a/0x85f51a6b9671527f lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051335.097565:0:13753:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777051335.097580:0:13753:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000062812b6e/0x85f51a6b96715278 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.097585:0:8470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002abffc1a/0x85f51a6b9671527f lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051335.097622:0:13753:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da429d7000 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:1.0:1777051335.097625:0:8470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002abffc1a/0x85f51a6b9671527f lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051335.097631:0:13753:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000062812b6e/0x85f51a6b96715278 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051335.097666:0:13753:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000062812b6e/0x85f51a6b96715278 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.097679:0:8470:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1777051335.097687:0:13753:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000062812b6e/0x85f51a6b96715278 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0xed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051335.097701:0:13753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000062812b6e/0x85f51a6b96715278 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051335.097733:0:38719:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00002000:00010000:1.0:1777051335.098044:0:8470:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0xeb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777051335.098054:0:8470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000411d5ce8/0x85f51a6b96715286 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xeb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051335.098059:0:38719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002abffc1a/0x85f51a6b9671527f lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.098073:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051335.098078:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051335.098086:0:8470:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000411d5ce8/0x85f51a6b96715286 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xeb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051335.098115:0:38719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94f682e00 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:1.0:1777051335.098116:0:8470:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000411d5ce8/0x85f51a6b96715286 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xeb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051335.098126:0:38719:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002abffc1a/0x85f51a6b9671527f lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.098144:0:8470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000411d5ce8/0x85f51a6b96715286 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xeb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051335.098151:0:38719:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002abffc1a/0x85f51a6b9671527f lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.098168:0:8470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000411d5ce8/0x85f51a6b96715286 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xeb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051335.098184:0:38719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002abffc1a/0x85f51a6b9671527f lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0xec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051335.098199:0:38719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002abffc1a/0x85f51a6b9671527f lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.098225:0:8470:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1777051335.098234:0:38719:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777051335.098241:0:38719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000411d5ce8/0x85f51a6b96715286 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xeb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051335.098252:0:38719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94f683600 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:2.0:1777051335.098259:0:38719:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000411d5ce8/0x85f51a6b96715286 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xeb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051335.098271:0:38719:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000411d5ce8/0x85f51a6b96715286 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xeb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051335.098291:0:38719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000411d5ce8/0x85f51a6b96715286 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0xeb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1777051335.098294:0:8470:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0xea:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777051335.098312:0:8470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000df56773e/0x85f51a6b9671528d lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xea:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051335.098314:0:38719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000411d5ce8/0x85f51a6b96715286 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xeb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.098328:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051335.098334:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051335.098343:0:8470:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000df56773e/0x85f51a6b9671528d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051335.098354:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777051335.098357:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777051335.098362:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777051335.098375:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051335.098383:0:8470:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000df56773e/0x85f51a6b9671528d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051335.098385:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051335.098392:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051335.098398:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051335.098406:0:8470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000df56773e/0x85f51a6b9671528d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.098429:0:8470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000df56773e/0x85f51a6b9671528d lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.098488:0:8470:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1777051335.098569:0:6568:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777051335.098578:0:6568:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000df56773e/0x85f51a6b9671528d lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051335.098591:0:6568:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94f683200 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:2.0:1777051335.098598:0:6568:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000df56773e/0x85f51a6b9671528d lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1777051335.098604:0:8470:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0xe9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1777051335.098622:0:6568:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000df56773e/0x85f51a6b9671528d lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.098624:0:8470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007f0f2531/0x85f51a6b96715294 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xe9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051335.098657:0:6568:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000df56773e/0x85f51a6b9671528d lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0xea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.098664:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051335.098670:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051335.098678:0:8470:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007f0f2531/0x85f51a6b96715294 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xe9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051335.098682:0:6568:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000df56773e/0x85f51a6b9671528d lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.098716:0:8470:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007f0f2531/0x85f51a6b96715294 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xe9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051335.098719:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777051335.098725:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777051335.098733:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051335.098738:0:8470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007f0f2531/0x85f51a6b96715294 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xe9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.098761:0:8470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007f0f2531/0x85f51a6b96715294 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xe9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.098787:0:8470:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1777051335.098797:0:38719:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777051335.098803:0:38719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007f0f2531/0x85f51a6b96715294 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xe9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051335.098812:0:38719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94f683e00 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:2.0:1777051335.098817:0:38719:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007f0f2531/0x85f51a6b96715294 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xe9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051335.098830:0:38719:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007f0f2531/0x85f51a6b96715294 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xe9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051335.098852:0:38719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007f0f2531/0x85f51a6b96715294 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0xe9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1777051335.098859:0:8470:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0xe8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1777051335.098868:0:38719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007f0f2531/0x85f51a6b96715294 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xe9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.098891:0:8470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005384d42f/0x85f51a6b9671529b lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xe8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051335.098897:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777051335.098903:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051335.098909:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777051335.098909:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051335.098916:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051335.098924:0:8470:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005384d42f/0x85f51a6b9671529b lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xe8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.098951:0:8470:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005384d42f/0x85f51a6b9671529b lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xe8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.098964:0:8470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005384d42f/0x85f51a6b9671529b lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xe8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.098977:0:8470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005384d42f/0x85f51a6b9671529b lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xe8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.099003:0:8470:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1777051335.099045:0:6567:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777051335.099052:0:6567:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005384d42f/0x85f51a6b9671529b lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xe8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051335.099061:0:6567:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94f682c00 already unused, calling callback (ffffffffc0bed2d0) 00002000:00010000:1.0:1777051335.099065:0:8470:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0xe7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1777051335.099065:0:6567:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005384d42f/0x85f51a6b9671529b lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xe8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.099085:0:8470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006b0bc321/0x85f51a6b967152a2 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xe7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051335.099102:0:6567:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005384d42f/0x85f51a6b9671529b lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xe8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.099112:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051335.099117:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777051335.099123:0:6567:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005384d42f/0x85f51a6b9671529b lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0xe8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.099124:0:8470:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006b0bc321/0x85f51a6b967152a2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xe7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051335.099155:0:6567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005384d42f/0x85f51a6b9671529b lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xe8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.099164:0:8470:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006b0bc321/0x85f51a6b967152a2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xe7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051335.099174:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777051335.099178:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777051335.099181:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051335.099183:0:8470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006b0bc321/0x85f51a6b967152a2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xe7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.099231:0:8470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006b0bc321/0x85f51a6b967152a2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xe7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.099260:0:8470:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1777051335.099304:0:13753:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777051335.099315:0:13753:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006b0bc321/0x85f51a6b967152a2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xe7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051335.099330:0:13753:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94f682800 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:3.0:1777051335.099337:0:13753:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006b0bc321/0x85f51a6b967152a2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xe7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1777051335.099351:0:8470:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0xe6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777051335.099352:0:13753:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006b0bc321/0x85f51a6b967152a2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xe7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.099371:0:8470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000061f3c88a/0x85f51a6b967152a9 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xe6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051335.099383:0:13753:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006b0bc321/0x85f51a6b967152a2 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0xe7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.099388:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051335.099393:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051335.099400:0:8470:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000061f3c88a/0x85f51a6b967152a9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xe6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051335.099433:0:13753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006b0bc321/0x85f51a6b967152a2 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xe7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.099435:0:8470:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000061f3c88a/0x85f51a6b967152a9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xe6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.099497:0:8470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000061f3c88a/0x85f51a6b967152a9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xe6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.099513:0:8470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000061f3c88a/0x85f51a6b967152a9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xe6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051335.099513:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051335.099519:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051335.099524:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051335.099552:0:8470:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1777051335.099590:0:6568:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777051335.099599:0:6568:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000061f3c88a/0x85f51a6b967152a9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xe6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051335.099614:0:6568:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94f683000 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:2.0:1777051335.099620:0:6568:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000061f3c88a/0x85f51a6b967152a9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xe6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051335.099635:0:6568:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000061f3c88a/0x85f51a6b967152a9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xe6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1777051335.099642:0:8470:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0xe5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777051335.099656:0:8470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000e711329/0x85f51a6b967152b0 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xe5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051335.099658:0:6568:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000061f3c88a/0x85f51a6b967152a9 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0xe6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.099685:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051335.099691:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051335.099699:0:8470:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000e711329/0x85f51a6b967152b0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xe5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051335.099707:0:6568:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000061f3c88a/0x85f51a6b967152a9 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xe6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.099724:0:8470:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000e711329/0x85f51a6b967152b0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xe5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051335.099735:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777051335.099739:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051335.099742:0:8470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000e711329/0x85f51a6b967152b0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xe5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051335.099742:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051335.099759:0:8470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000e711329/0x85f51a6b967152b0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xe5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.099787:0:8470:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1777051335.099802:0:38719:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777051335.099811:0:38719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000e711329/0x85f51a6b967152b0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xe5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051335.099826:0:38719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94f682a00 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:2.0:1777051335.099832:0:38719:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000e711329/0x85f51a6b967152b0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xe5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051335.099847:0:38719:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000e711329/0x85f51a6b967152b0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xe5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1777051335.099850:0:8470:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0xe4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777051335.099866:0:8470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000025581c0a/0x85f51a6b967152b7 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xe4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051335.099876:0:38719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000e711329/0x85f51a6b967152b0 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0xe5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.099883:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051335.099889:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051335.099897:0:8470:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000025581c0a/0x85f51a6b967152b7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xe4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051335.099899:0:38719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000e711329/0x85f51a6b967152b0 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xe5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.099938:0:8470:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000025581c0a/0x85f51a6b967152b7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xe4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051335.099946:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777051335.099951:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777051335.099955:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051335.099957:0:8470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000025581c0a/0x85f51a6b967152b7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xe4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.099972:0:8470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000025581c0a/0x85f51a6b967152b7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xe4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.099997:0:8470:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1777051335.100013:0:6567:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777051335.100022:0:6567:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000025581c0a/0x85f51a6b967152b7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xe4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051335.100037:0:6567:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94f682000 already unused, calling callback (ffffffffc0bed2d0) 00002000:00080000:1.0:1777051335.100045:0:8470:0:(ofd_dev.c:1515:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000400:227 00010000:00010000:2.0:1777051335.100045:0:6567:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000025581c0a/0x85f51a6b967152b7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xe4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051335.100063:0:6567:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000025581c0a/0x85f51a6b967152b7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xe4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051335.100083:0:6567:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000025581c0a/0x85f51a6b967152b7 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0xe4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051335.100096:0:6567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000025581c0a/0x85f51a6b967152b7 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xe4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051335.100117:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777051335.100121:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777051335.100126:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1777051335.100172:0:8470:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d9418f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:104216:x1863365452569856:12345-0@lo:5:osp-pre-1-1.0 Request processed in 30868us (31075us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051335.100189:0:8470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7958 00000100:00100000:3.0:1777051335.100243:0:104216:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d9418f6d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:104216:1863365452569856:0@lo:5:osp-pre-1-1.0 00000004:00080000:3.0:1777051335.100264:0:104216:0:(osp_precreate.c:955:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x101:0x0] from OST, last_created [0x2c0000400:0x101:0x0]last_used is [0x2c0000400:0xe3:0x0] 00000100:00100000:2.0:1777051335.100359:0:3679:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1777051335.100366:0:104216:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d9418f6300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:104216:1863365452570240:0@lo:5:osp-pre-1-1.0 00000100:00100000:2.0:1777051335.100387:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d9418f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452570112:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1777051335.100434:0:104216:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051335.100482:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051335.100530:0:104216:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d9598763c0 going to sleep for 11 seconds 00000100:00100000:2.0:1777051335.100555:0:10113:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452570112 00000100:00100000:2.0:1777051335.100566:0:10113:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452570112 00000100:00100000:2.0:1777051335.100638:0:10113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5582 00000100:00100000:2.0:1777051335.100655:0:10113:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5fbed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3679:x1863365452570112:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1777051335.100691:0:10113:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 430293440 pending 0 free 3645853696 avail 3414331392 00000100:00100000:1.0:1777051335.100725:0:27884:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452570240 00000100:00100000:1.0:1777051335.100735:0:27884:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452570240 00000100:00100000:2.0:1777051335.100773:0:10113:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5fbed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3679:x1863365452570112:12345-0@lo:13:osp-pre-1-1.0 Request processed in 121us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051335.100790:0:10113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5582 00000100:00100000:1.0:1777051335.100792:0:27884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7960 00000100:00100000:1.0:1777051335.100812:0:27884:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d9418f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:104216:x1863365452570240:12345-0@lo:5:osp-pre-1-1.0 00000100:00100000:3.0:1777051335.100837:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d9418f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452570112:0@lo:13:osp-pre-1-1.0 00002000:00080000:1.0:1777051335.100856:0:27884:0:(ofd_dev.c:1745:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 258 00000100:00100000:2.0:1777051335.104370:0:27884:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d9418f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+6:104216:x1863365452570240:12345-0@lo:5:osp-pre-1-1.0 Request processed in 3560us (3934us total) trans 4294968352 rc 0/0 00000100:00100000:2.0:1777051335.104383:0:27884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7960 00000100:00100000:3.0:1777051335.104640:0:104216:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d9418f6300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:104216:1863365452570240:0@lo:5:osp-pre-1-1.0 00000004:00080000:3.0:1777051335.104656:0:104216:0:(osp_precreate.c:701:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x101:0x0]-[0x2c0000400:0x121:0x0] 00000100:00100000:3.0:1777051335.104696:0:104216:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d9418f6d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:104216:1863365452570368:0@lo:900:osp-pre-1-1.0 00000100:00100000:3.0:1777051335.104739:0:104216:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051335.104776:0:104216:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d9598763c0 going to sleep for 11 seconds 00000100:00100000:1.0:1777051335.104836:0:6591:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452570368 00000100:00100000:1.0:1777051335.104844:0:6591:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452570368 00000100:00100000:3.0:1777051335.104964:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1777051335.104988:0:6590:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d9418f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:104216:x1863365452570368:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:3.0:1777051335.105072:0:6590:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d9418f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:104216:x1863365452570368:12345-0@lo:900:osp-pre-1-1.0 Request processed in 96us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051335.105094:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1777051335.105143:0:104216:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d9418f6d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:104216:1863365452570368:0@lo:900:osp-pre-1-1.0 00002000:00010000:1.0:1777051335.107217:0:13320:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x101:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777051335.107232:0:13320:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ce6e2e2f/0x85f51a6b967152be lrc: 3/0,1 mode: --/PW res: [0x280000400:0x101:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.107255:0:13320:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051335.107260:0:13320:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051335.107267:0:13320:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ce6e2e2f/0x85f51a6b967152be lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x101:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.107293:0:13320:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ce6e2e2f/0x85f51a6b967152be lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x101:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.107309:0:13320:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ce6e2e2f/0x85f51a6b967152be lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x101:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.107323:0:13320:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ce6e2e2f/0x85f51a6b967152be lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x101:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.107366:0:13320:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1777051335.107405:0:13753:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777051335.107416:0:13753:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ce6e2e2f/0x85f51a6b967152be lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x101:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051335.107434:0:13753:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94f682600 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:3.0:1777051335.107442:0:13753:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ce6e2e2f/0x85f51a6b967152be lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x101:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051335.107483:0:13753:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ce6e2e2f/0x85f51a6b967152be lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x101:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1777051335.107492:0:13320:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x100:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777051335.107507:0:13320:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b6313c21/0x85f51a6b967152c5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x100:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051335.107511:0:13753:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ce6e2e2f/0x85f51a6b967152be lrc: 1/0,0 mode: --/PW res: [0x280000400:0x101:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.107542:0:13320:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051335.107546:0:13753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ce6e2e2f/0x85f51a6b967152be lrc: 0/0,0 mode: --/PW res: [0x280000400:0x101:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.107548:0:13320:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051335.107557:0:13320:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6313c21/0x85f51a6b967152c5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x100:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.107581:0:13320:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6313c21/0x85f51a6b967152c5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x100:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051335.107584:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051335.107589:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051335.107595:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051335.107599:0:13320:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b6313c21/0x85f51a6b967152c5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x100:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.107610:0:13320:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b6313c21/0x85f51a6b967152c5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x100:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.107631:0:13320:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1777051335.107683:0:6568:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00002000:00010000:1.0:1777051335.107692:0:13320:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0xff:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1777051335.107694:0:6568:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b6313c21/0x85f51a6b967152c5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x100:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.107710:0:13320:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006ddcd6db/0x85f51a6b967152cc lrc: 3/0,1 mode: --/PW res: [0x280000400:0xff:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051335.107717:0:6568:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94f683400 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:2.0:1777051335.107728:0:6568:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6313c21/0x85f51a6b967152c5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x100:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.107734:0:13320:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051335.107740:0:13320:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051335.107749:0:13320:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006ddcd6db/0x85f51a6b967152cc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051335.107751:0:6568:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6313c21/0x85f51a6b967152c5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x100:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.107793:0:13320:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006ddcd6db/0x85f51a6b967152cc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051335.107799:0:6568:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b6313c21/0x85f51a6b967152c5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x100:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.107819:0:13320:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006ddcd6db/0x85f51a6b967152cc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051335.107824:0:6568:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6313c21/0x85f51a6b967152c5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x100:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.107833:0:13320:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006ddcd6db/0x85f51a6b967152cc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.107879:0:13320:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1777051335.107942:0:38719:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00002000:00010000:1.0:1777051335.107943:0:13320:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0xfe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777051335.107955:0:38719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006ddcd6db/0x85f51a6b967152cc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051335.107972:0:38719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94f683a00 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:1.0:1777051335.107975:0:13320:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c43d2af4/0x85f51a6b967152d3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xfe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051335.107979:0:38719:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006ddcd6db/0x85f51a6b967152cc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051335.107984:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777051335.107991:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777051335.107997:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051335.108019:0:13320:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051335.108024:0:13320:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051335.108031:0:38719:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006ddcd6db/0x85f51a6b967152cc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.108032:0:13320:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c43d2af4/0x85f51a6b967152d3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xfe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.108073:0:13320:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c43d2af4/0x85f51a6b967152d3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xfe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051335.108077:0:38719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006ddcd6db/0x85f51a6b967152cc lrc: 1/0,0 mode: --/PW res: [0x280000400:0xff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.108093:0:13320:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c43d2af4/0x85f51a6b967152d3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xfe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051335.108386:0:38719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006ddcd6db/0x85f51a6b967152cc lrc: 0/0,0 mode: --/PW res: [0x280000400:0xff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051335.108414:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051335.108420:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051335.108425:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051335.108431:0:13320:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c43d2af4/0x85f51a6b967152d3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xfe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.108487:0:13320:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1777051335.108515:0:6567:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777051335.108528:0:6567:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c43d2af4/0x85f51a6b967152d3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xfe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051335.108545:0:6567:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d943ebb000 already unused, calling callback (ffffffffc0bed2d0) 00002000:00010000:1.0:1777051335.108548:0:13320:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0xfd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777051335.108556:0:13320:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f4222aed/0x85f51a6b967152da lrc: 3/0,1 mode: --/PW res: [0x280000400:0xfd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051335.108567:0:6567:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c43d2af4/0x85f51a6b967152d3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xfe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.108571:0:13320:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051335.108575:0:13320:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051335.108581:0:13320:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f4222aed/0x85f51a6b967152da lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xfd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051335.108600:0:6567:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c43d2af4/0x85f51a6b967152d3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xfe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.108604:0:13320:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f4222aed/0x85f51a6b967152da lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xfd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.108636:0:13320:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f4222aed/0x85f51a6b967152da lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xfd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051335.108654:0:6567:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c43d2af4/0x85f51a6b967152d3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xfe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.108655:0:13320:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f4222aed/0x85f51a6b967152da lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xfd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051335.108692:0:6567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c43d2af4/0x85f51a6b967152d3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xfe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.108713:0:13320:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1777051335.108720:0:6567:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777051335.108728:0:6567:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f4222aed/0x85f51a6b967152da lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xfd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051335.108742:0:6567:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d943ebb400 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:2.0:1777051335.108749:0:6567:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4222aed/0x85f51a6b967152da lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xfd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051335.108752:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777051335.108767:0:6567:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4222aed/0x85f51a6b967152da lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xfd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1777051335.108775:0:13320:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0xfc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777051335.108793:0:13320:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a197a73e/0x85f51a6b967152e1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xfc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051335.108807:0:6567:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f4222aed/0x85f51a6b967152da lrc: 1/0,0 mode: --/PW res: [0x280000400:0xfd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.108835:0:13320:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777051335.108838:0:6567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f4222aed/0x85f51a6b967152da lrc: 0/0,0 mode: --/PW res: [0x280000400:0xfd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.108840:0:13320:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051335.108848:0:13320:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a197a73e/0x85f51a6b967152e1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xfc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.108874:0:13320:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a197a73e/0x85f51a6b967152e1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xfc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051335.108880:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777051335.108885:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777051335.108891:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051335.108892:0:13320:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a197a73e/0x85f51a6b967152e1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xfc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.108908:0:13320:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a197a73e/0x85f51a6b967152e1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xfc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.108937:0:13320:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1777051335.108972:0:6568:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777051335.108981:0:6568:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a197a73e/0x85f51a6b967152e1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xfc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1777051335.108991:0:13320:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0xfb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1777051335.109002:0:6568:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d943eba600 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:1.0:1777051335.109005:0:13320:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000028056c80/0x85f51a6b967152e8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xfb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051335.109011:0:6568:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a197a73e/0x85f51a6b967152e1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xfc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.109021:0:13320:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051335.109026:0:13320:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051335.109034:0:13320:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000028056c80/0x85f51a6b967152e8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xfb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051335.109037:0:6568:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a197a73e/0x85f51a6b967152e1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xfc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.109071:0:13320:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000028056c80/0x85f51a6b967152e8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xfb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051335.109076:0:6568:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a197a73e/0x85f51a6b967152e1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xfc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.109105:0:13320:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000028056c80/0x85f51a6b967152e8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xfb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051335.109112:0:6568:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a197a73e/0x85f51a6b967152e1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xfc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.109131:0:13320:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000028056c80/0x85f51a6b967152e8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xfb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051335.109180:0:6568:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777051335.109186:0:6568:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000028056c80/0x85f51a6b967152e8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xfb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.109191:0:13320:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1777051335.109203:0:6568:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d943eba000 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:2.0:1777051335.109210:0:6568:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000028056c80/0x85f51a6b967152e8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xfb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051335.109267:0:6568:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000028056c80/0x85f51a6b967152e8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xfb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1777051335.109278:0:13320:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0xfa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777051335.109292:0:13320:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a15a4472/0x85f51a6b967152ef lrc: 3/0,1 mode: --/PW res: [0x280000400:0xfa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051335.109297:0:6568:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000028056c80/0x85f51a6b967152e8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xfb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.109302:0:13320:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051335.109307:0:13320:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051335.109315:0:13320:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a15a4472/0x85f51a6b967152ef lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xfa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051335.109320:0:6568:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000028056c80/0x85f51a6b967152e8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xfb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.109336:0:13320:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a15a4472/0x85f51a6b967152ef lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xfa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.109347:0:13320:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a15a4472/0x85f51a6b967152ef lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xfa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051335.109353:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051335.109356:0:13320:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a15a4472/0x85f51a6b967152ef lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xfa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051335.109360:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777051335.109367:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051335.109381:0:13320:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1777051335.109443:0:13320:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0xf9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777051335.109483:0:13320:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005b70166e/0x85f51a6b967152f6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.109496:0:13320:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051335.109500:0:13320:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051335.109506:0:13320:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005b70166e/0x85f51a6b967152f6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051335.109515:0:13753:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777051335.109524:0:13320:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005b70166e/0x85f51a6b967152f6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051335.109528:0:13753:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a15a4472/0x85f51a6b967152ef lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xfa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051335.109550:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051335.109560:0:13320:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005b70166e/0x85f51a6b967152f6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051335.109562:0:13753:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d943ebbe00 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:0.0:1777051335.109574:0:13753:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a15a4472/0x85f51a6b967152ef lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xfa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.109583:0:13320:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005b70166e/0x85f51a6b967152f6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051335.109609:0:13753:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a15a4472/0x85f51a6b967152ef lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xfa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.109634:0:13320:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1777051335.109636:0:13753:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a15a4472/0x85f51a6b967152ef lrc: 1/0,0 mode: --/PW res: [0x280000400:0xfa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051335.109651:0:13753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a15a4472/0x85f51a6b967152ef lrc: 0/0,0 mode: --/PW res: [0x280000400:0xfa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051335.109683:0:13753:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1777051335.109690:0:13753:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005b70166e/0x85f51a6b967152f6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051335.109700:0:13753:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d943ebac00 already unused, calling callback (ffffffffc0bed2d0) 00002000:00010000:1.0:1777051335.109702:0:13320:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0xf8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1777051335.109705:0:13753:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005b70166e/0x85f51a6b967152f6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.109720:0:13320:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d293ee4e/0x85f51a6b967152fd lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051335.109721:0:13753:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005b70166e/0x85f51a6b967152f6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051335.109737:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777051335.109759:0:13753:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005b70166e/0x85f51a6b967152f6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.109761:0:13320:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051335.109767:0:13320:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051335.109776:0:13320:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d293ee4e/0x85f51a6b967152fd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051335.109782:0:13753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005b70166e/0x85f51a6b967152f6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.109810:0:13320:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d293ee4e/0x85f51a6b967152fd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051335.109819:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777051335.109824:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777051335.109830:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051335.109832:0:13320:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d293ee4e/0x85f51a6b967152fd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.109846:0:13320:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d293ee4e/0x85f51a6b967152fd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.109877:0:13320:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1777051335.109923:0:6568:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777051335.109933:0:6568:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d293ee4e/0x85f51a6b967152fd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1777051335.109944:0:13320:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0xf7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1777051335.109946:0:6568:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d943ebae00 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:2.0:1777051335.109957:0:6568:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d293ee4e/0x85f51a6b967152fd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.109962:0:13320:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004fdfbf86/0x85f51a6b96715304 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051335.109990:0:6568:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d293ee4e/0x85f51a6b967152fd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.109993:0:13320:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051335.110000:0:13320:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051335.110008:0:13320:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004fdfbf86/0x85f51a6b96715304 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051335.110020:0:6568:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d293ee4e/0x85f51a6b967152fd lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.110028:0:13320:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004fdfbf86/0x85f51a6b96715304 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.110052:0:13320:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004fdfbf86/0x85f51a6b96715304 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051335.110053:0:6568:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d293ee4e/0x85f51a6b967152fd lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.110090:0:13320:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004fdfbf86/0x85f51a6b96715304 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051335.110101:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777051335.110106:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051335.110124:0:13320:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1777051335.110128:0:6568:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777051335.110138:0:6568:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004fdfbf86/0x85f51a6b96715304 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051335.110150:0:6568:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d943ebbc00 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:2.0:1777051335.110157:0:6568:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004fdfbf86/0x85f51a6b96715304 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051335.110172:0:6568:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004fdfbf86/0x85f51a6b96715304 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051335.110172:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777051335.110197:0:6568:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004fdfbf86/0x85f51a6b96715304 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051335.110220:0:6568:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004fdfbf86/0x85f51a6b96715304 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1777051335.110235:0:13320:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0xf6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777051335.110248:0:13320:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000867be76e/0x85f51a6b9671530b lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051335.110252:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777051335.110259:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777051335.110268:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051335.110270:0:13320:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051335.110278:0:13320:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051335.110283:0:13320:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000867be76e/0x85f51a6b9671530b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.110300:0:13320:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000867be76e/0x85f51a6b9671530b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.110313:0:13320:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000867be76e/0x85f51a6b9671530b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.110327:0:13320:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000867be76e/0x85f51a6b9671530b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051335.110410:0:13320:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1777051335.110508:0:13320:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0xf5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777051335.110515:0:13320:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006d80926d/0x85f51a6b96715312 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051335.110527:0:13320:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051335.110529:0:13320:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051335.110533:0:13320:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006d80926d/0x85f51a6b96715312 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051335.110547:0:13320:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006d80926d/0x85f51a6b96715312 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051335.110570:0:13320:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006d80926d/0x85f51a6b96715312 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051335.110583:0:13320:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006d80926d/0x85f51a6b96715312 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051335.110614:0:13320:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1777051335.110659:0:13753:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1777051335.110667:0:13753:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000867be76e/0x85f51a6b9671530b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1777051335.110676:0:13320:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0xf4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1777051335.110677:0:13753:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d943ebaa00 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:0.0:1777051335.110685:0:13753:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000867be76e/0x85f51a6b9671530b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051335.110692:0:13320:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005e4db57a/0x85f51a6b96715319 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051335.110699:0:13753:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000867be76e/0x85f51a6b9671530b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051335.110724:0:13320:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051335.110729:0:13320:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777051335.110732:0:13753:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000867be76e/0x85f51a6b9671530b lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051335.110735:0:13320:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005e4db57a/0x85f51a6b96715319 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051335.110752:0:6567:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777051335.110767:0:6567:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006d80926d/0x85f51a6b96715312 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051335.110774:0:13753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000867be76e/0x85f51a6b9671530b lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051335.110780:0:13320:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005e4db57a/0x85f51a6b96715319 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051335.110799:0:6567:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d95d339a00 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:2.0:1777051335.110812:0:6567:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006d80926d/0x85f51a6b96715312 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051335.110824:0:13320:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005e4db57a/0x85f51a6b96715319 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051335.110835:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777051335.110838:0:6567:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006d80926d/0x85f51a6b96715312 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051335.110843:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051335.110848:0:13320:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005e4db57a/0x85f51a6b96715319 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051335.110849:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777051335.110875:0:6567:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006d80926d/0x85f51a6b96715312 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051335.110903:0:6567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006d80926d/0x85f51a6b96715312 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051335.110930:0:6567:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777051335.110934:0:13320:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1777051335.110937:0:6567:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005e4db57a/0x85f51a6b96715319 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051335.110952:0:6567:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d95d338800 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:2.0:1777051335.110959:0:6567:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005e4db57a/0x85f51a6b96715319 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051335.110975:0:6567:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005e4db57a/0x85f51a6b96715319 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051335.110981:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777051335.110999:0:6567:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005e4db57a/0x85f51a6b96715319 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1777051335.111009:0:13320:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0xf3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1777051335.111013:0:6567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005e4db57a/0x85f51a6b96715319 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051335.111020:0:13320:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b6e0044/0x85f51a6b96715320 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051335.111048:0:13320:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051335.111051:0:13320:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777051335.111053:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051335.111057:0:13320:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b6e0044/0x85f51a6b96715320 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051335.111058:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777051335.111064:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051335.111081:0:13320:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006b6e0044/0x85f51a6b96715320 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051335.111091:0:13320:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b6e0044/0x85f51a6b96715320 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051335.111098:0:13320:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006b6e0044/0x85f51a6b96715320 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051335.111117:0:13320:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1777051335.111162:0:13320:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0xf2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777051335.111170:0:13320:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c7a51b7/0x85f51a6b96715327 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051335.111181:0:13320:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051335.111183:0:13320:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051335.111188:0:13320:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c7a51b7/0x85f51a6b96715327 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051335.111201:0:13320:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c7a51b7/0x85f51a6b96715327 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051335.111214:0:13320:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c7a51b7/0x85f51a6b96715327 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051335.111225:0:13320:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001c7a51b7/0x85f51a6b96715327 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051335.111250:0:13320:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1777051335.111285:0:13753:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1777051335.111292:0:13753:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006b6e0044/0x85f51a6b96715320 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051335.111302:0:13753:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d95d339e00 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:0.0:1777051335.111306:0:13753:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006b6e0044/0x85f51a6b96715320 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051335.111317:0:13753:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006b6e0044/0x85f51a6b96715320 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051335.111332:0:13753:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006b6e0044/0x85f51a6b96715320 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051335.111340:0:13753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b6e0044/0x85f51a6b96715320 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051335.111359:0:13753:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00002000:00010000:3.0:1777051335.111362:0:13320:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0xf1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1777051335.111363:0:13753:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001c7a51b7/0x85f51a6b96715327 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051335.111382:0:13753:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d95d338e00 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:3.0:1777051335.111382:0:13320:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009fca5e10/0x85f51a6b9671532e lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051335.111391:0:13753:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001c7a51b7/0x85f51a6b96715327 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051335.111403:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051335.111416:0:13320:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777051335.111417:0:13753:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001c7a51b7/0x85f51a6b96715327 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051335.111421:0:13320:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051335.111431:0:13320:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009fca5e10/0x85f51a6b9671532e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051335.111436:0:13753:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001c7a51b7/0x85f51a6b96715327 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051335.111490:0:13320:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009fca5e10/0x85f51a6b9671532e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051335.111491:0:13753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c7a51b7/0x85f51a6b96715327 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051335.111523:0:13320:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009fca5e10/0x85f51a6b9671532e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051335.111545:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051335.111547:0:13320:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009fca5e10/0x85f51a6b9671532e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051335.111549:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777051335.111554:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051335.111589:0:13320:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1777051335.111617:0:38719:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1777051335.111623:0:38719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009fca5e10/0x85f51a6b9671532e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051335.111632:0:38719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d95d338c00 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:0.0:1777051335.111636:0:38719:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009fca5e10/0x85f51a6b9671532e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051335.111646:0:38719:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009fca5e10/0x85f51a6b9671532e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1777051335.111649:0:13320:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0xf0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777051335.111661:0:13320:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008f4e2bdb/0x85f51a6b96715335 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051335.111670:0:38719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009fca5e10/0x85f51a6b9671532e lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051335.111675:0:13320:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051335.111680:0:13320:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051335.111688:0:13320:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008f4e2bdb/0x85f51a6b96715335 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051335.111693:0:38719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009fca5e10/0x85f51a6b9671532e lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051335.111717:0:13320:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008f4e2bdb/0x85f51a6b96715335 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051335.111728:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777051335.111733:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051335.111733:0:13320:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008f4e2bdb/0x85f51a6b96715335 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051335.111740:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051335.111752:0:13320:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008f4e2bdb/0x85f51a6b96715335 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051335.111783:0:13320:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1777051335.111829:0:6567:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777051335.111841:0:6567:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008f4e2bdb/0x85f51a6b96715335 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1777051335.111849:0:13320:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0xef:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1777051335.111861:0:6567:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d95d338400 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:2.0:1777051335.111869:0:6567:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008f4e2bdb/0x85f51a6b96715335 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051335.111875:0:13320:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002dda27db/0x85f51a6b9671533c lrc: 3/0,1 mode: --/PW res: [0x280000400:0xef:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051335.111890:0:13320:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051335.111896:0:13320:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051335.111903:0:13320:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002dda27db/0x85f51a6b9671533c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051335.111930:0:13320:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002dda27db/0x85f51a6b9671533c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051335.111936:0:6567:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008f4e2bdb/0x85f51a6b96715335 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051335.111962:0:13320:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002dda27db/0x85f51a6b9671533c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051335.111974:0:6567:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008f4e2bdb/0x85f51a6b96715335 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051335.111977:0:13320:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002dda27db/0x85f51a6b9671533c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051335.112015:0:6567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008f4e2bdb/0x85f51a6b96715335 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051335.112285:0:6567:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777051335.112293:0:6567:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002dda27db/0x85f51a6b9671533c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051335.112306:0:6567:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d955a90400 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:2.0:1777051335.112313:0:6567:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002dda27db/0x85f51a6b9671533c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051335.112320:0:13320:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1777051335.112333:0:6567:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002dda27db/0x85f51a6b9671533c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051335.112359:0:6567:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002dda27db/0x85f51a6b9671533c lrc: 1/0,0 mode: --/PW res: [0x280000400:0xef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051335.112374:0:6567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002dda27db/0x85f51a6b9671533c lrc: 0/0,0 mode: --/PW res: [0x280000400:0xef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051335.112397:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1777051335.112400:0:13320:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0xee:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1777051335.112407:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777051335.112413:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051335.112413:0:13320:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e5a89e36/0x85f51a6b96715343 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xee:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051335.112420:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051335.112436:0:13320:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051335.112439:0:13320:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051335.112443:0:13320:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e5a89e36/0x85f51a6b96715343 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051335.112483:0:13320:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e5a89e36/0x85f51a6b96715343 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051335.112493:0:13320:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e5a89e36/0x85f51a6b96715343 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051335.112501:0:13320:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e5a89e36/0x85f51a6b96715343 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051335.112521:0:13320:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1777051335.112572:0:13753:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00002000:00010000:3.0:1777051335.112578:0:13320:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0xed:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1777051335.112583:0:13753:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e5a89e36/0x85f51a6b96715343 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051335.112590:0:13320:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000051eb6e5f/0x85f51a6b9671534a lrc: 3/0,1 mode: --/PW res: [0x280000400:0xed:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051335.112618:0:13753:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da40030000 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:3.0:1777051335.112625:0:13320:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777051335.112628:0:13753:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e5a89e36/0x85f51a6b96715343 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051335.112629:0:13320:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051335.112638:0:13320:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000051eb6e5f/0x85f51a6b9671534a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051335.112662:0:13753:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e5a89e36/0x85f51a6b96715343 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051335.112668:0:13320:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000051eb6e5f/0x85f51a6b9671534a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051335.113004:0:13320:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000051eb6e5f/0x85f51a6b9671534a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051335.113013:0:13753:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e5a89e36/0x85f51a6b96715343 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051335.113018:0:13320:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000051eb6e5f/0x85f51a6b9671534a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051335.113055:0:13753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e5a89e36/0x85f51a6b96715343 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051335.113080:0:13320:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1777051335.113087:0:13753:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1777051335.113095:0:13753:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000051eb6e5f/0x85f51a6b9671534a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051335.113107:0:13753:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da40030c00 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:0.0:1777051335.113115:0:13753:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000051eb6e5f/0x85f51a6b9671534a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051335.113131:0:13753:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000051eb6e5f/0x85f51a6b9671534a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.113131:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1777051335.113152:0:13320:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0xec:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1777051335.113156:0:13753:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000051eb6e5f/0x85f51a6b9671534a lrc: 1/0,0 mode: --/PW res: [0x280000400:0xed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051335.113164:0:13320:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000098661a52/0x85f51a6b96715351 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xec:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051335.113170:0:13753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000051eb6e5f/0x85f51a6b9671534a lrc: 0/0,0 mode: --/PW res: [0x280000400:0xed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051335.113209:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777051335.113213:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777051335.113216:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051335.113254:0:13320:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051335.113258:0:13320:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051335.113264:0:13320:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000098661a52/0x85f51a6b96715351 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051335.113283:0:13320:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000098661a52/0x85f51a6b96715351 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051335.113298:0:13320:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000098661a52/0x85f51a6b96715351 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051335.113311:0:13320:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000098661a52/0x85f51a6b96715351 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051335.113359:0:13320:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1777051335.113382:0:6568:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1777051335.113390:0:6568:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000098661a52/0x85f51a6b96715351 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051335.113401:0:6568:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da40031600 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:0.0:1777051335.113406:0:6568:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000098661a52/0x85f51a6b96715351 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1777051335.113412:0:13320:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0xeb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1777051335.113416:0:6568:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000098661a52/0x85f51a6b96715351 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051335.113421:0:13320:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000afd84ae/0x85f51a6b96715358 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xeb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051335.113441:0:13320:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051335.113444:0:13320:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051335.113478:0:13320:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000afd84ae/0x85f51a6b96715358 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xeb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051335.113487:0:6568:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000098661a52/0x85f51a6b96715351 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051335.113490:0:13320:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000afd84ae/0x85f51a6b96715358 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xeb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051335.113526:0:6568:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000098661a52/0x85f51a6b96715351 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051335.113527:0:13320:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000afd84ae/0x85f51a6b96715358 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xeb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051335.113565:0:13320:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000afd84ae/0x85f51a6b96715358 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xeb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051335.113573:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777051335.113578:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777051335.113583:0:6568:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777051335.113599:0:13320:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1777051335.113603:0:6568:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000afd84ae/0x85f51a6b96715358 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xeb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051335.113617:0:6568:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da40030400 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:0.0:1777051335.113623:0:6568:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000afd84ae/0x85f51a6b96715358 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xeb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051335.113637:0:6568:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000afd84ae/0x85f51a6b96715358 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xeb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051335.113658:0:6568:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000afd84ae/0x85f51a6b96715358 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xeb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051335.113661:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1777051335.113666:0:13320:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0xea:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1777051335.113682:0:6568:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000afd84ae/0x85f51a6b96715358 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xeb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051335.113683:0:13320:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d51c47e4/0x85f51a6b9671535f lrc: 3/0,1 mode: --/PW res: [0x280000400:0xea:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051335.113723:0:13320:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051335.113726:0:13320:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777051335.113733:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051335.113733:0:13320:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d51c47e4/0x85f51a6b9671535f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051335.113738:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777051335.113744:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051335.113757:0:13320:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d51c47e4/0x85f51a6b9671535f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051335.114369:0:13320:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d51c47e4/0x85f51a6b9671535f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051335.114383:0:13320:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d51c47e4/0x85f51a6b9671535f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051335.114405:0:13320:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1777051335.114538:0:38719:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777051335.114548:0:38719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d51c47e4/0x85f51a6b9671535f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.114562:0:38719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d941ad7e00 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:1.0:1777051335.114567:0:38719:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d51c47e4/0x85f51a6b9671535f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.114580:0:38719:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d51c47e4/0x85f51a6b9671535f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.114600:0:38719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d51c47e4/0x85f51a6b9671535f lrc: 1/0,0 mode: --/PW res: [0x280000400:0xea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.114611:0:38719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d51c47e4/0x85f51a6b9671535f lrc: 0/0,0 mode: --/PW res: [0x280000400:0xea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.114633:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051335.114636:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051335.114638:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1777051335.116562:0:13320:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0xe9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777051335.116572:0:13320:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000026ade6d4/0x85f51a6b96715366 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051335.116586:0:13320:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051335.116589:0:13320:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051335.116594:0:13320:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000026ade6d4/0x85f51a6b96715366 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051335.116610:0:13320:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000026ade6d4/0x85f51a6b96715366 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051335.116624:0:13320:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000026ade6d4/0x85f51a6b96715366 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051335.116636:0:13320:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000026ade6d4/0x85f51a6b96715366 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051335.116668:0:13320:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1777051335.116703:0:13753:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1777051335.116714:0:13753:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000026ade6d4/0x85f51a6b96715366 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051335.116729:0:13753:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d941ad6200 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:0.0:1777051335.116734:0:13753:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000026ade6d4/0x85f51a6b96715366 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1777051335.116744:0:13320:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0xe8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1777051335.116763:0:13753:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000026ade6d4/0x85f51a6b96715366 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051335.116765:0:13320:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000854d280c/0x85f51a6b9671536d lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051335.116796:0:13320:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777051335.116797:0:13753:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000026ade6d4/0x85f51a6b96715366 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051335.116801:0:13320:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051335.116810:0:13320:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000854d280c/0x85f51a6b9671536d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051335.116811:0:13753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000026ade6d4/0x85f51a6b96715366 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051335.116853:0:13320:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000854d280c/0x85f51a6b9671536d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051335.116868:0:13320:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000854d280c/0x85f51a6b9671536d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051335.116879:0:13320:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000854d280c/0x85f51a6b9671536d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051335.116929:0:13320:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1777051335.116985:0:6567:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777051335.116996:0:6567:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000854d280c/0x85f51a6b9671536d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1777051335.116998:0:13320:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0xe7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777051335.117018:0:13320:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b0f7a638/0x85f51a6b96715374 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051335.117023:0:6567:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d941ad7200 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:2.0:1777051335.117035:0:6567:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000854d280c/0x85f51a6b9671536d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051335.117040:0:13320:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051335.117046:0:13320:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051335.117053:0:13320:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b0f7a638/0x85f51a6b96715374 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051335.117072:0:13320:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b0f7a638/0x85f51a6b96715374 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051335.117076:0:6567:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000854d280c/0x85f51a6b9671536d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051335.117103:0:13320:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b0f7a638/0x85f51a6b96715374 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051335.117116:0:6567:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000854d280c/0x85f51a6b9671536d lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051335.117119:0:13320:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b0f7a638/0x85f51a6b96715374 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051335.117151:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777051335.117157:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777051335.117159:0:6567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000854d280c/0x85f51a6b9671536d lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051335.117161:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051335.117185:0:13320:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1777051335.117193:0:6567:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777051335.117201:0:6567:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b0f7a638/0x85f51a6b96715374 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051335.117215:0:6567:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d941ad6e00 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:2.0:1777051335.117221:0:6567:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b0f7a638/0x85f51a6b96715374 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051335.117230:0:6567:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b0f7a638/0x85f51a6b96715374 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051335.117245:0:6567:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b0f7a638/0x85f51a6b96715374 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051335.117256:0:6567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b0f7a638/0x85f51a6b96715374 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051335.117277:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777051335.117281:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1777051335.117281:0:13320:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0xe6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1777051335.117284:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051335.117292:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051335.117294:0:13320:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bf6ac44a/0x85f51a6b9671537b lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051335.117309:0:13320:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051335.117312:0:13320:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051335.117317:0:13320:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bf6ac44a/0x85f51a6b9671537b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051335.117331:0:13320:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bf6ac44a/0x85f51a6b9671537b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051335.117344:0:13320:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bf6ac44a/0x85f51a6b9671537b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051335.117356:0:13320:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bf6ac44a/0x85f51a6b9671537b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051335.117382:0:13320:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1777051335.117430:0:13320:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0xe5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777051335.117432:0:38719:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777051335.117477:0:38719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bf6ac44a/0x85f51a6b9671537b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051335.117481:0:13320:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a8efa856/0x85f51a6b96715382 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.117509:0:38719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d941ad7c00 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:3.0:1777051335.117513:0:13320:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051335.117519:0:38719:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bf6ac44a/0x85f51a6b9671537b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051335.117519:0:13320:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051335.117526:0:13320:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a8efa856/0x85f51a6b96715382 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.117554:0:38719:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bf6ac44a/0x85f51a6b9671537b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051335.117557:0:13320:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a8efa856/0x85f51a6b96715382 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051335.117590:0:13320:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a8efa856/0x85f51a6b96715382 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.117596:0:38719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bf6ac44a/0x85f51a6b9671537b lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051335.117607:0:13320:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a8efa856/0x85f51a6b96715382 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.117626:0:38719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bf6ac44a/0x85f51a6b9671537b lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051335.117655:0:13320:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1777051335.117667:0:38719:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777051335.117675:0:38719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a8efa856/0x85f51a6b96715382 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.117689:0:38719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d941ad6800 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:1.0:1777051335.117696:0:38719:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a8efa856/0x85f51a6b96715382 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.117710:0:38719:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a8efa856/0x85f51a6b96715382 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1777051335.117716:0:13320:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0xe4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777051335.117730:0:13320:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000021992211/0x85f51a6b96715389 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.117732:0:38719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a8efa856/0x85f51a6b96715382 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051335.117770:0:13320:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051335.117772:0:38719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a8efa856/0x85f51a6b96715382 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051335.117778:0:13320:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051335.117789:0:13320:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000021992211/0x85f51a6b96715389 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.117803:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051335.117809:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051335.117810:0:13320:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000021992211/0x85f51a6b96715389 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051335.117814:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051335.117829:0:13320:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000021992211/0x85f51a6b96715389 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051335.117842:0:13320:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000021992211/0x85f51a6b96715389 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051335.117873:0:13320:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:3.0:1777051335.117916:0:13320:0:(ofd_dev.c:1515:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000400:227 00010000:00010000:2.0:1777051335.117933:0:6567:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777051335.117944:0:6567:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000021992211/0x85f51a6b96715389 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051335.117959:0:6567:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d941ad6000 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:2.0:1777051335.117966:0:6567:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000021992211/0x85f51a6b96715389 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051335.117982:0:6567:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000021992211/0x85f51a6b96715389 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051335.118005:0:6567:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000021992211/0x85f51a6b96715389 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051335.118020:0:6567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000021992211/0x85f51a6b96715389 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051335.118030:0:13320:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5fbec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:104214:x1863365452569984:12345-0@lo:5:osp-pre-0-1.0 Request processed in 48529us (48764us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051335.118054:0:13320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7959 00010000:00010000:2.0:1777051335.118066:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777051335.118072:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777051335.118077:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1777051335.118101:0:104214:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d942a0f800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:104214:1863365452569984:0@lo:5:osp-pre-0-1.0 00000004:00080000:1.0:1777051335.118124:0:104214:0:(osp_precreate.c:955:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x101:0x0] from OST, last_created [0x280000400:0x101:0x0]last_used is [0x280000400:0xe3:0x0] 00010000:00010000:0.0:1777051335.118173:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1777051335.118224:0:104214:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d942a0ca80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:104214:1863365452570624:0@lo:5:osp-pre-0-1.0 00000100:00100000:1.0:1777051335.118278:0:104214:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051335.118279:0:3678:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1777051335.118306:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d942a0f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452570496:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1777051335.118362:0:8468:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452570624 00000100:00100000:1.0:1777051335.118364:0:104214:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d9444b1240 going to sleep for 11 seconds 00000100:00100000:0.0:1777051335.118372:0:8468:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452570624 00000100:00100000:2.0:1777051335.118380:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051335.118441:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7961 00000100:00100000:0.0:1777051335.118492:0:8468:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942a0c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:104214:x1863365452570624:12345-0@lo:5:osp-pre-0-1.0 00000100:00100000:3.0:1777051335.118509:0:8473:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452570496 00000100:00100000:3.0:1777051335.118520:0:8473:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452570496 00002000:00080000:0.0:1777051335.118534:0:8468:0:(ofd_dev.c:1745:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 258 00000100:00100000:3.0:1777051335.118585:0:8473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5583 00000100:00100000:3.0:1777051335.118601:0:8473:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5fbeca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3678:x1863365452570496:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1777051335.118627:0:8473:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 440353216 pending 896 free 3862671360 avail 3631149056 00000100:00100000:3.0:1777051335.118704:0:8473:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5fbeca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3678:x1863365452570496:12345-0@lo:13:osp-pre-0-1.0 Request processed in 106us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051335.118718:0:8473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5583 00000100:00100000:2.0:1777051335.118774:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d942a0f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452570496:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1777051335.122114:0:8468:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942a0c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:104214:x1863365452570624:12345-0@lo:5:osp-pre-0-1.0 Request processed in 3628us (3836us total) trans 4294968349 rc 0/0 00000100:00100000:0.0:1777051335.122129:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7961 00000100:00100000:1.0:1777051335.122657:0:104214:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d942a0ca80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:104214:1863365452570624:0@lo:5:osp-pre-0-1.0 00000004:00080000:1.0:1777051335.122678:0:104214:0:(osp_precreate.c:701:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x101:0x0]-[0x280000400:0x121:0x0] 00000100:00100000:1.0:1777051335.122723:0:104214:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d942a0d500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:104214:1863365452570752:0@lo:900:osp-pre-0-1.0 00000100:00100000:1.0:1777051335.122777:0:104214:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051335.122842:0:104214:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d9444b1240 going to sleep for 11 seconds 00000100:00100000:0.0:1777051335.122870:0:6591:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452570752 00000100:00100000:0.0:1777051335.122880:0:6591:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452570752 00000100:00100000:0.0:1777051335.123025:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1777051335.123040:0:6591:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942a0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:104214:x1863365452570752:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:0.0:1777051335.123130:0:6591:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942a0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:104214:x1863365452570752:12345-0@lo:900:osp-pre-0-1.0 Request processed in 93us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051335.123144:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1777051335.123222:0:104214:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d942a0d500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:104214:1863365452570752:0@lo:900:osp-pre-0-1.0 00010000:00010000:1.0:1777051335.766485:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1777051336.410886:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051336.410981:0:21368:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425890560 00000100:00100000:3.0:1777051336.410994:0:21368:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425890560 00000100:00100000:3.0:1777051336.411090:0:21368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111816 00000100:00100000:3.0:1777051336.411104:0:21368:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942a0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+17:132311:x1863365425890560:12345-192.168.201.46@tcp:41:lfs.0 00000100:00080000:2.0:1777051336.411128:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00000024:3.0:1777051336.411148:0:21368:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4194304 pending 0 free 1441644544 avail 1295405056 00000100:00100000:3.0:1777051336.411275:0:21368:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942a0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+17:132311:x1863365425890560:12345-192.168.201.46@tcp:41:lfs.0 Request processed in 174us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051336.411284:0:21368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111816 00000100:00100000:2.0:1777051336.414076:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051336.414163:0:6580:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425890688 00000100:00100000:1.0:1777051336.414170:0:6580:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425890688 00000100:00080000:2.0:1777051336.414263:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1777051336.414275:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111817 00000100:00100000:1.0:1777051336.414293:0:6580:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f299500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+48:132311:x1863365425890688:12345-192.168.201.46@tcp:41:lfs.0 00000004:00000024:1.0:1777051336.414325:0:6580:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4194304 pending 0 free 1446219776 avail 1299980288 00000100:00100000:1.0:1777051336.414416:0:6580:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f299500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+48:132311:x1863365425890688:12345-192.168.201.46@tcp:41:lfs.0 Request processed in 127us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051336.414450:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111817 00000100:00100000:0.0:1777051336.417765:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051336.417862:0:47388:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425890816 00000100:00100000:3.0:1777051336.417871:0:47388:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425890816 00000100:00080000:2.0:1777051336.417965:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1777051336.417975:0:47388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 5584 00000100:00100000:3.0:1777051336.417994:0:47388:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95a583100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+50:132311:x1863365425890816:12345-192.168.201.46@tcp:13:lfs.0 00002000:00000024:3.0:1777051336.418020:0:47388:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 440352320 pending 0 free 3862671360 avail 3631149056 00000100:00100000:3.0:1777051336.418093:0:47388:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95a583100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+50:132311:x1863365425890816:12345-192.168.201.46@tcp:13:lfs.0 Request processed in 104us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051336.418106:0:47388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 5584 00000100:00100000:2.0:1777051336.422379:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051336.422499:0:8472:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425890944 00000100:00100000:1.0:1777051336.422508:0:8472:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425890944 00000100:00100000:1.0:1777051336.422582:0:8472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 5585 00000100:00080000:2.0:1777051336.422590:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1777051336.422601:0:8472:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f298700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+47:132311:x1863365425890944:12345-192.168.201.46@tcp:13:lfs.0 00002000:00000024:1.0:1777051336.422625:0:8472:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 430292544 pending 0 free 3645853696 avail 3414331392 00000100:00100000:1.0:1777051336.422693:0:8472:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f298700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+47:132311:x1863365425890944:12345-192.168.201.46@tcp:13:lfs.0 Request processed in 98us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051336.422703:0:8472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 5585 00000100:00100000:2.0:1777051336.547415:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051336.547526:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051336.547568:0:103163:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425891072 00000100:00100000:0.0:1777051336.547581:0:103163:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425891072 00000100:00100000:2.0:1777051336.547607:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051336.547661:0:8492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425891200 00000100:00100000:0.0:1777051336.547673:0:103163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 124 00000100:00100000:3.0:1777051336.547675:0:8492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425891200 00000100:00100000:0.0:1777051336.547708:0:103163:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f345450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29c4352d-3260-4734-909d-9ea5de9e7fa4+12:2438:x1863365425891072:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:2.0:1777051336.547715:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051336.547735:0:8471:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425891456 00000100:00100000:1.0:1777051336.547745:0:8471:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425891456 00000100:00100000:3.0:1777051336.547790:0:8492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425891328 00000100:00100000:3.0:1777051336.547801:0:8492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425891328 00000100:00100000:2.0:1777051336.547811:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051336.547826:0:103163:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f345450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29c4352d-3260-4734-909d-9ea5de9e7fa4+12:2438:x1863365425891072:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 130us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051336.547833:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10294 00000100:00100000:0.0:1777051336.547855:0:103163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 124 00000100:00100000:1.0:1777051336.547865:0:8471:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f29b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+50:2439:x1863365425891456:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:3.0:1777051336.547878:0:8492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13222 00000100:00100000:3.0:1777051336.547903:0:8492:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f299c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+14:2439:x1863365425891200:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:0.0:1777051336.547933:0:46497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13223 00000100:00100000:1.0:1777051336.547943:0:8471:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f29b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+50:2439:x1863365425891456:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 84us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051336.547964:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10294 00000100:00100000:0.0:1777051336.547985:0:46497:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f29a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:c11b6966-0775-44d2-bdc6-c74c26eb2226+6:2438:x1863365425891328:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:1.0:1777051336.547996:0:8471:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425891584 00000100:00100000:1.0:1777051336.548004:0:8471:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425891584 00000100:00100000:3.0:1777051336.548018:0:8492:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f299c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+14:2439:x1863365425891200:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 122us (489us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051336.548035:0:8492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13222 00000100:00100000:0.0:1777051336.548065:0:46497:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f29a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:c11b6966-0775-44d2-bdc6-c74c26eb2226+6:2438:x1863365425891328:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 108us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051336.548090:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10295 00000100:00100000:0.0:1777051336.548091:0:46497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13223 00000100:00100000:1.0:1777051336.548121:0:8471:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f298e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+48:2438:x1863365425891584:12345-192.168.201.46@tcp:400:kworker.0 00000100:00080000:3.0:1777051336.548135:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1777051336.548147:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1777051336.548156:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1777051336.548283:0:8471:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f298e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+48:2438:x1863365425891584:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 171us (477us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051336.548294:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10295 00010000:00010000:1.0:1777051336.790551:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777051336.983083:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95a581c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452571008:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1777051336.983479:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d956129c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3678:1863365452570880:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1777051336.983521:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051336.984339:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051336.984610:0:47388:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452571008 00000100:00100000:1.0:1777051336.984624:0:47388:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452571008 00000100:00080000:3.0:1777051336.984723:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1777051336.984724:0:47388:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452570880 00000100:00100000:1.0:1777051336.984733:0:47388:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452570880 00000100:00080000:3.0:1777051336.984773:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1777051336.984791:0:47388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5586 00000100:00100000:1.0:1777051336.984811:0:47388:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d9418f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3679:x1863365452571008:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1777051336.984823:0:8472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5587 00000100:00100000:3.0:1777051336.984840:0:8472:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f299f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3678:x1863365452570880:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1777051336.984860:0:47388:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 440352320 pending 0 free 3862671360 avail 3631149056 00002000:00000024:3.0:1777051336.984877:0:8472:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 430292544 pending 0 free 3645853696 avail 3414331392 00000100:00100000:1.0:1777051336.985708:0:47388:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d9418f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3679:x1863365452571008:12345-0@lo:13:osp-pre-0-0.0 Request processed in 900us (2188us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051336.985723:0:47388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5586 00000100:00100000:3.0:1777051336.985831:0:8472:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f299f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3678:x1863365452570880:12345-0@lo:13:osp-pre-1-0.0 Request processed in 994us (1491us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051336.985848:0:8472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5587 00000100:00100000:2.0:1777051336.985898:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95a581c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452571008:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1777051336.985979:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d956129c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3678:1863365452570880:0@lo:13:osp-pre-1-0.0 00000040:00080000:3.0:1777051337.239572:0:103189:0:(llog.c:858:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1777051337.816070:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777051338.838581:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1777051339.448952:0:104659:0:(debug.c:645:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg146-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0001-mdc-*.mds_server_uuid 00000100:00100000:3.0:1777051339.543424:0:3679:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1777051339.543462:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d9418f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452571136:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1777051339.543574:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051339.543701:0:46498:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452571136 00000100:00100000:3.0:1777051339.543714:0:46498:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452571136 00000100:00100000:3.0:1777051339.543797:0:46498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8062 00000100:00100000:3.0:1777051339.543813:0:46498:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d9418f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+5:3679:x1863365452571136:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1777051339.543871:0:46498:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4194304 pending 0 free 1441644544 avail 1295405056 00000100:00100000:3.0:1777051339.543957:0:46498:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d9418f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+5:3679:x1863365452571136:12345-0@lo:41:osp-pre-0-1.0 Request processed in 146us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051339.543975:0:46498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8062 00000100:00100000:1.0:1777051339.544025:0:3679:0:(client.c:3101:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 30064771077 gen 2 00000004:00080000:1.0:1777051339.544038:0:3679:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 30064771074 committed transno 30064771077 00000004:00080000:1.0:1777051339.544071:0:3679:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 30064771075 committed transno 30064771077 00000004:00080000:1.0:1777051339.544087:0:3679:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 30064771076 committed transno 30064771077 00000004:00080000:1.0:1777051339.544101:0:3679:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 30064771077 committed transno 30064771077 00000100:00100000:1.0:1777051339.544131:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d9418f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452571136:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1777051339.862805:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1777051340.055122:0:3678:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1777051340.055542:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95a580380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3678:1863365452571264:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1777051340.055668:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051340.055753:0:6584:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452571264 00000100:00100000:2.0:1777051340.055766:0:6584:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452571264 00000100:00100000:0.0:1777051340.055792:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d956128380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3678:1863365452571392:0@lo:400:kworker.0 00000100:00100000:0.0:1777051340.055863:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051340.055871:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8063 00000100:00100000:2.0:1777051340.055891:0:6584:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95a581180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3678:x1863365452571264:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1777051340.055913:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955505f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3678:1863365452571904:0@lo:400:kworker.0 00000004:00000024:2.0:1777051340.055951:0:6584:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4194304 pending 0 free 1446219776 avail 1299980288 00000100:00100000:3.0:1777051340.055956:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955505500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3680:1863365452571648:0@lo:400:kworker.0 00000100:00100000:0.0:1777051340.055975:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051340.056027:0:103169:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452571392 00000100:00100000:1.0:1777051340.056036:0:103169:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452571392 00000100:00100000:0.0:1777051340.056045:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95088b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452572416:0@lo:400:kworker.0 00000100:00100000:3.0:1777051340.056054:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051340.056063:0:6584:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95a581180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3678:x1863365452571264:12345-0@lo:41:osp-pre-1-0.0 Request processed in 176us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051340.056077:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8063 00000100:00100000:1.0:1777051340.056106:0:103169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1777051340.056113:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051340.056130:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d950889880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3680:1863365452572160:0@lo:400:kworker.0 00000100:00100000:1.0:1777051340.056132:0:103169:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f345050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f9351a01-5b0e-4470-97fd-58b9b4b312a2+23:3678:x1863365452571392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777051340.056134:0:6581:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452571904 00000100:00100000:2.0:1777051340.056144:0:6581:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452571904 00000100:00100000:0.0:1777051340.056192:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95a580380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3678:1863365452571264:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1777051340.056263:0:103169:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f345050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f9351a01-5b0e-4470-97fd-58b9b4b312a2+23:3678:x1863365452571392:12345-0@lo:400:kworker.0 Request processed in 138us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051340.056267:0:6581:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452571648 00000100:00100000:3.0:1777051340.056267:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051340.056276:0:6581:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452571648 00000100:00100000:0.0:1777051340.056285:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d956128380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3678:1863365452571392:0@lo:400:kworker.0 00000100:00100000:1.0:1777051340.056286:0:103169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1777051340.056316:0:3678:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1777051340.056317:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d950889c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3680:1863365452572672:0@lo:400:kworker.0 00000100:00100000:0.0:1777051340.056335:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955507b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3678:1863365452571776:0@lo:400:kworker.0 00000100:00100000:2.0:1777051340.056344:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13224 00000100:00100000:1.0:1777051340.056361:0:27885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13225 00000100:00100000:2.0:1777051340.056363:0:6581:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95a582680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3678:x1863365452571904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051340.056406:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051340.056413:0:27885:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d9418f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:lustre-MDT0001-lwp-OST0000_UUID+5:3680:x1863365452571648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777051340.056423:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051340.056541:0:3680:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1777051340.056557:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d956129c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3680:1863365452571520:0@lo:400:kworker.0 00000100:00100000:0.0:1777051340.056559:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d950888380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3678:1863365452572288:0@lo:400:kworker.0 00000100:00100000:2.0:1777051340.056566:0:6581:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95a582680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3678:x1863365452571904:12345-0@lo:400:kworker.0 Request processed in 206us (587us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051340.056577:0:27885:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d9418f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:lustre-MDT0001-lwp-OST0000_UUID+5:3680:x1863365452571648:12345-0@lo:400:kworker.0 Request processed in 169us (523us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051340.056588:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13224 00000100:00100000:1.0:1777051340.056599:0:27885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13225 00000100:00100000:2.0:1777051340.056619:0:6581:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452571776 00000100:00100000:2.0:1777051340.056627:0:6581:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452571776 00000100:00100000:1.0:1777051340.056648:0:55805:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452572160 00000100:00100000:1.0:1777051340.056655:0:55805:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452572160 00000100:00100000:2.0:1777051340.056683:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13226 00000100:00100000:2.0:1777051340.056701:0:6581:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95a580380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3678:x1863365452571776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777051340.056707:0:55805:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452572672 00000100:00100000:3.0:1777051340.056711:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051340.056715:0:55805:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452572672 00000100:00100000:0.0:1777051340.056744:0:6580:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452571520 00000100:00100000:1.0:1777051340.056752:0:55805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10296 00000100:00100000:0.0:1777051340.056753:0:6580:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452571520 00000100:00100000:1.0:1777051340.056766:0:55805:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d9418f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3680:x1863365452572160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051340.056774:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955504a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3680:1863365452572032:0@lo:400:kworker.0 00000100:00100000:2.0:1777051340.056791:0:6581:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95a580380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3678:x1863365452571776:12345-0@lo:400:kworker.0 Request processed in 95us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051340.056804:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13226 00000100:00100000:0.0:1777051340.056819:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13227 00000100:00100000:0.0:1777051340.056841:0:6580:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d9418f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3680:x1863365452571520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777051340.056841:0:55805:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d9418f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3680:x1863365452572160:12345-0@lo:400:kworker.0 Request processed in 78us (581us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051340.056848:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051340.056849:0:11727:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452572416 00000100:00100000:2.0:1777051340.056859:0:11727:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452572416 00000100:00100000:1.0:1777051340.056865:0:55805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10296 00000100:00100000:1.0:1777051340.056892:0:55805:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452572032 00000100:00100000:1.0:1777051340.056898:0:55805:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452572032 00000100:00100000:3.0:1777051340.056902:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d950888a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3680:1863365452572544:0@lo:400:kworker.0 00000100:00100000:2.0:1777051340.056920:0:11727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8064 00000100:00100000:0.0:1777051340.056931:0:6580:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d9418f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3680:x1863365452571520:12345-0@lo:400:kworker.0 Request processed in 101us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051340.056938:0:11727:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95a583800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3678:x1863365452572416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777051340.056949:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13227 00000100:00100000:1.0:1777051340.056953:0:55805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10297 00000100:00100000:1.0:1777051340.056971:0:55805:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d9418f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+6:3680:x1863365452572672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051340.056975:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051340.057007:0:11727:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95a583800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3678:x1863365452572416:12345-0@lo:400:kworker.0 Request processed in 75us (904us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051340.057011:0:8468:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452572544 00000100:00100000:0.0:1777051340.057022:0:8468:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452572544 00000100:00100000:2.0:1777051340.057027:0:11727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8064 00000100:00100000:1.0:1777051340.057048:0:55805:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d9418f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+6:3680:x1863365452572672:12345-0@lo:400:kworker.0 Request processed in 80us (642us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051340.057048:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955505500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3680:1863365452571648:0@lo:400:kworker.0 00000100:00080000:2.0:1777051340.057066:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1777051340.057070:0:55805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10297 00000100:00080000:2.0:1777051340.057076:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1777051340.057085:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1777051340.057087:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d950889880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3680:1863365452572160:0@lo:400:kworker.0 00000100:00100000:0.0:1777051340.057093:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10298 00000100:00080000:2.0:1777051340.057093:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1777051340.057110:0:55805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10299 00000100:00100000:0.0:1777051340.057117:0:8468:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d9418f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3680:x1863365452572032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051340.057125:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d950889c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3680:1863365452572672:0@lo:400:kworker.0 00000100:00100000:1.0:1777051340.057127:0:55805:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fd65500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+6:3680:x1863365452572544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051340.057189:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d956129c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3680:1863365452571520:0@lo:400:kworker.0 00000100:00100000:3.0:1777051340.057650:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955504a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3680:1863365452572032:0@lo:400:kworker.0 00000100:00100000:3.0:1777051340.057672:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d950888a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3680:1863365452572544:0@lo:400:kworker.0 00000100:00100000:2.0:1777051340.057683:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051340.057738:0:6579:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452572288 00000100:00100000:3.0:1777051340.057746:0:6579:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452572288 00000100:00100000:3.0:1777051340.057791:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13228 00000100:00100000:3.0:1777051340.057801:0:6579:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f29ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3678:x1863365452572288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777051340.060394:0:55805:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fd65500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+6:3680:x1863365452572544:12345-0@lo:400:kworker.0 Request processed in 3248us (3401us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051340.060411:0:55805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10299 00000100:00100000:2.0:1777051340.060415:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95088b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3678:1863365452572800:0@lo:400:kworker.0 00000100:00100000:3.0:1777051340.060440:0:6579:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f29ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3678:x1863365452572288:12345-0@lo:400:kworker.0 Request processed in 2635us (2757us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051340.060456:0:8468:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d9418f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3680:x1863365452572032:12345-0@lo:400:kworker.0 Request processed in 3344us (3616us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051340.060456:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13228 00000100:00100000:2.0:1777051340.060473:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051340.060495:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10298 00000100:00100000:1.0:1777051340.060510:0:27885:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452572800 00000100:00100000:1.0:1777051340.060519:0:27885:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452572800 00000100:00100000:2.0:1777051340.060524:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95088b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452572416:0@lo:400:kworker.0 00000100:00100000:2.0:1777051340.060542:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955505f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3678:1863365452571904:0@lo:400:kworker.0 00000100:00100000:2.0:1777051340.060569:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955507b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3678:1863365452571776:0@lo:400:kworker.0 00000100:00100000:1.0:1777051340.060582:0:27885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13229 00000100:00100000:2.0:1777051340.060586:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d950888380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3678:1863365452572288:0@lo:400:kworker.0 00000100:00100000:1.0:1777051340.060603:0:27885:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f298380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000-lwp-MDT0001_UUID+5:3678:x1863365452572800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777051340.060671:0:27885:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f298380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000-lwp-MDT0001_UUID+5:3678:x1863365452572800:12345-0@lo:400:kworker.0 Request processed in 77us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051340.060681:0:27885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13229 00000100:00100000:2.0:1777051340.060728:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95088b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3678:1863365452572800:0@lo:400:kworker.0 00000100:00100000:3.0:1777051340.571459:0:3680:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1777051340.571468:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95088a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452573056:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1777051340.571496:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7fd67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3680:1863365452572928:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1777051340.571610:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051340.571627:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051340.571762:0:10113:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452573056 00000100:00100000:2.0:1777051340.572043:0:10113:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452573056 00000100:00100000:2.0:1777051340.572134:0:10113:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452572928 00000100:00100000:2.0:1777051340.572141:0:10113:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452572928 00000100:00100000:2.0:1777051340.572298:0:10113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5588 00000100:00100000:2.0:1777051340.572318:0:10113:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da57e96850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3678:x1863365452573056:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1777051340.572388:0:10113:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 440352320 pending 0 free 3862671360 avail 3631149056 00000100:00100000:2.0:1777051340.572486:0:10113:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da57e96850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3678:x1863365452573056:12345-0@lo:13:osp-pre-0-1.0 Request processed in 174us (877us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051340.572504:0:10113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5588 00000100:00100000:1.0:1777051340.573129:0:8473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5589 00000100:00100000:1.0:1777051340.573147:0:8473:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fd66d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3680:x1863365452572928:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1777051340.573240:0:8473:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 430292544 pending 0 free 3645853696 avail 3414331392 00000100:00100000:1.0:1777051340.573323:0:8473:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fd66d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3680:x1863365452572928:12345-0@lo:13:osp-pre-1-1.0 Request processed in 180us (1709us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051340.573344:0:8473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5589 00000100:00100000:3.0:1777051340.573461:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95088a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452573056:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1777051340.573916:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7fd67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3680:1863365452572928:0@lo:13:osp-pre-1-1.0 00000001:00080000:3.0:1777051340.575334:0:8464:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0000: transno 4294968349 is committed 00000001:00080000:2.0:1777051340.575710:0:9540:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0001: transno 4294968352 is committed 00000001:02000400:0.0:1777051340.887181:0:104707:0:(debug.c:645:libcfs_debug_mark_buffer()) DEBUG MARKER: mdc.lustre-MDT0001-mdc-*.mds_server_uuid in FULL state after 0 sec 00010000:00010000:2.0:1777051340.896133:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1777051341.719437:0:104226:0:(llog.c:858:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1777051341.730123:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051341.730498:0:103168:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425891712 00000100:00100000:0.0:1777051341.730513:0:103168:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425891712 00000100:00100000:2.0:1777051341.730517:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051341.730585:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051341.730594:0:103168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 126 00000100:00100000:0.0:1777051341.730613:0:103168:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d941bf7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:29c4352d-3260-4734-909d-9ea5de9e7fa4+12:2437:x1863365425891712:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:2.0:1777051341.730637:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051341.730679:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051341.730723:0:103168:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d941bf7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:29c4352d-3260-4734-909d-9ea5de9e7fa4+12:2437:x1863365425891712:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 115us (628us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051341.730736:0:103168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 126 00000100:00100000:0.0:1777051341.730798:0:46497:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425891840 00000100:00100000:0.0:1777051341.730804:0:46497:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425891840 00000100:00100000:0.0:1777051341.730854:0:46497:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425891968 00000100:00100000:0.0:1777051341.730859:0:46497:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425891968 00000100:00100000:0.0:1777051341.730893:0:46497:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425892352 00000100:00100000:0.0:1777051341.730897:0:46497:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425892352 00000100:00100000:0.0:1777051341.730930:0:46497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13230 00000100:00100000:0.0:1777051341.730940:0:46497:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f298700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:c11b6966-0775-44d2-bdc6-c74c26eb2226+14:2436:x1863365425891840:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:3.0:1777051341.732021:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13231 00000100:00100000:2.0:1777051341.732302:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051341.732400:0:6580:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f29a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+6:2437:x1863365425891968:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:3.0:1777051341.732475:0:6580:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f29a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+6:2437:x1863365425891968:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 440us (1837us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051341.732487:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13231 00000100:00100000:2.0:1777051341.732506:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051341.732518:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13232 00000100:00100000:3.0:1777051341.732529:0:6580:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f29bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+17:2436:x1863365425892352:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:3.0:1777051341.732571:0:6580:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f29bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+17:2436:x1863365425892352:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 46us (1894us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051341.732578:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13232 00000100:00100000:2.0:1777051341.732587:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051341.732631:0:8471:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425892096 00000100:00100000:2.0:1777051341.732638:0:8471:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425892096 00000100:00100000:2.0:1777051341.732700:0:8471:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425892224 00000100:00100000:2.0:1777051341.732706:0:8471:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425892224 00000100:00100000:3.0:1777051341.732714:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051341.733023:0:8471:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425892608 00000100:00100000:2.0:1777051341.733029:0:8471:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425892608 00000100:00100000:3.0:1777051341.733032:0:24468:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425892736 00000100:00100000:3.0:1777051341.733042:0:24468:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425892736 00000100:00100000:2.0:1777051341.733076:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10300 00000100:00100000:1.0:1777051341.733149:0:27882:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425892480 00000100:00100000:1.0:1777051341.733157:0:27882:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425892480 00000100:00100000:1.0:1777051341.733211:0:27882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13233 00000100:00100000:1.0:1777051341.733224:0:27882:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f298000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+48:2437:x1863365425892480:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:0.0:1777051341.733234:0:46497:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f298700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:c11b6966-0775-44d2-bdc6-c74c26eb2226+14:2436:x1863365425891840:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 2288us (3045us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051341.733248:0:46497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13230 00000100:00100000:1.0:1777051341.733283:0:27882:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f298000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+48:2437:x1863365425892480:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 58us (695us total) trans 0 rc 0/0 00000100:00080000:0.0:1777051341.733293:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1777051341.733298:0:27882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13233 00000100:00080000:0.0:1777051341.733301:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1777051341.733307:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1777051341.733366:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1777051341.733475:0:8628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10301 00000100:00100000:2.0:1777051341.733483:0:8471:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f299f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+50:2436:x1863365425892096:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:3.0:1777051341.733501:0:24468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10302 00000100:00100000:0.0:1777051341.733502:0:8628:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f299180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+48:2437:x1863365425892224:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:3.0:1777051341.733524:0:24468:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f298a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+50:2436:x1863365425892608:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:2.0:1777051341.733541:0:8471:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f299f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+50:2436:x1863365425892096:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 67us (2956us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051341.733553:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10300 00000100:00100000:0.0:1777051341.733578:0:8628:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f299180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+48:2437:x1863365425892224:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 83us (1274us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051341.733589:0:24468:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f298a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+50:2436:x1863365425892608:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 72us (1084us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051341.733596:0:8628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10301 00000100:00100000:3.0:1777051341.733611:0:24468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10302 00000100:00100000:2.0:1777051341.733624:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10303 00000100:00100000:2.0:1777051341.733640:0:8471:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fd67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+47:2437:x1863365425892736:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:2.0:1777051341.733687:0:8471:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fd67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+47:2437:x1863365425892736:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 51us (975us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051341.733705:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10303 00010000:00010000:3.0:1777051341.910636:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777051342.103485:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95a580000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3680:1863365452573184:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1777051342.103570:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051342.103670:0:8472:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452573184 00000100:00100000:0.0:1777051342.103683:0:8472:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452573184 00000100:00100000:2.0:1777051342.103746:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95088aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3677:1863365452573312:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1777051342.103782:0:8472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5590 00000100:00080000:3.0:1777051342.103796:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1777051342.103811:0:8472:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fd64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3680:x1863365452573184:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1777051342.103816:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051342.104116:0:10113:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452573312 00000100:00100000:3.0:1777051342.104126:0:10113:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452573312 00002000:00000024:0.0:1777051342.104139:0:8472:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 440352320 pending 0 free 3862671360 avail 3631149056 00000100:00100000:3.0:1777051342.104247:0:10113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5591 00000100:00100000:0.0:1777051342.104255:0:8472:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fd64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3680:x1863365452573184:12345-0@lo:13:osp-pre-0-0.0 Request processed in 457us (682us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051342.104268:0:10113:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f299880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3677:x1863365452573312:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1777051342.104276:0:8472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5590 00002000:00000024:3.0:1777051342.104305:0:10113:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 430292544 pending 0 free 3645853696 avail 3414331392 00000100:00100000:0.0:1777051342.104378:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95a580000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3680:1863365452573184:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1777051342.104409:0:10113:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f299880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3677:x1863365452573312:12345-0@lo:13:osp-pre-1-0.0 Request processed in 147us (599us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051342.104422:0:10113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5591 00000100:00100000:2.0:1777051342.104489:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95088aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3677:1863365452573312:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1777051342.104806:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1777051342.489163:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051342.489261:0:6581:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425892864 00000100:00100000:2.0:1777051342.489273:0:6581:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425892864 00000100:00100000:2.0:1777051342.489374:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111818 00000100:00100000:2.0:1777051342.489390:0:6581:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fd64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+17:132757:x1863365425892864:12345-192.168.201.46@tcp:41:lfs.0 00000004:00000024:2.0:1777051342.489436:0:6581:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4194304 pending 0 free 1441644544 avail 1295405056 00000100:00100000:2.0:1777051342.489527:0:6581:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fd64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+17:132757:x1863365425892864:12345-192.168.201.46@tcp:41:lfs.0 Request processed in 140us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051342.489537:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111818 00000100:00100000:1.0:1777051342.492270:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051342.492362:0:6580:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425892992 00000100:00100000:3.0:1777051342.492368:0:6580:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425892992 00000100:00100000:3.0:1777051342.492422:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111819 00000100:00100000:3.0:1777051342.492435:0:6580:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d950889180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+48:132757:x1863365425892992:12345-192.168.201.46@tcp:41:lfs.0 00000004:00000024:3.0:1777051342.492464:0:6580:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4194304 pending 0 free 1446219776 avail 1299980288 00000100:00100000:3.0:1777051342.492530:0:6580:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d950889180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+48:132757:x1863365425892992:12345-192.168.201.46@tcp:41:lfs.0 Request processed in 98us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051342.492545:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111819 00000100:00100000:3.0:1777051342.498100:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051342.498191:0:47388:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425893120 00000100:00100000:1.0:1777051342.498226:0:47388:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425893120 00000100:00100000:1.0:1777051342.498289:0:47388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 5592 00000100:00100000:1.0:1777051342.498301:0:47388:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fd66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+50:132757:x1863365425893120:12345-192.168.201.46@tcp:13:lfs.0 00002000:00000024:1.0:1777051342.498347:0:47388:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 440352320 pending 0 free 3862671360 avail 3631149056 00000100:00100000:1.0:1777051342.498414:0:47388:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fd66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+50:132757:x1863365425893120:12345-192.168.201.46@tcp:13:lfs.0 Request processed in 115us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051342.498423:0:47388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 5592 00000100:00100000:2.0:1777051342.500412:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051342.500482:0:8473:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425893248 00000100:00100000:0.0:1777051342.500490:0:8473:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425893248 00000100:00100000:0.0:1777051342.500538:0:8473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 5593 00000100:00100000:0.0:1777051342.500549:0:8473:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d944e13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+47:132757:x1863365425893248:12345-192.168.201.46@tcp:13:lfs.0 00002000:00000024:0.0:1777051342.500566:0:8473:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 430292544 pending 0 free 3645853696 avail 3414331392 00000100:00100000:0.0:1777051342.500638:0:8473:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d944e13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+47:132757:x1863365425893248:12345-192.168.201.46@tcp:13:lfs.0 Request processed in 89us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051342.500647:0:8473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 5593 00010000:00010000:2.0:1777051342.934644:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051343.958696:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1777051344.667916:0:3677:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1777051344.667955:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95088bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452573440:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1777051344.668128:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051344.668570:0:46500:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452573440 00000100:00100000:1.0:1777051344.668585:0:46500:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452573440 00000100:00100000:1.0:1777051344.668686:0:46500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8065 00000100:00100000:1.0:1777051344.668722:0:46500:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95a580000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+5:3677:x1863365452573440:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1777051344.669048:0:46500:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4194304 pending 0 free 1441644544 avail 1295405056 00000100:00100000:1.0:1777051344.669500:0:46500:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95a580000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+5:3677:x1863365452573440:12345-0@lo:41:osp-pre-0-1.0 Request processed in 797us (1371us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051344.669518:0:46500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8065 00000100:00100000:0.0:1777051344.669555:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95088bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452573440:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1777051344.982500:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1777051345.174670:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d942a0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452573568:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1777051345.174803:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051345.174948:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7cd9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3679:1863365452574080:0@lo:400:kworker.0 00000100:00100000:1.0:1777051345.175036:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051345.175036:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5fbe3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3677:1863365452573824:0@lo:400:kworker.0 00000100:00100000:3.0:1777051345.175520:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5fbe2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3680:1863365452573696:0@lo:400:kworker.0 00000100:00100000:1.0:1777051345.175544:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5fbef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452574592:0@lo:400:kworker.0 00000100:00100000:2.0:1777051345.175611:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051345.175622:0:6585:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452573568 00000100:00100000:3.0:1777051345.175633:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051345.175643:0:6585:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452573568 00000100:00100000:1.0:1777051345.175658:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051345.175684:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955611c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3677:1863365452574336:0@lo:400:kworker.0 00000100:00100000:3.0:1777051345.175755:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955612d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3680:1863365452574208:0@lo:400:kworker.0 00000100:00100000:0.0:1777051345.175763:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8066 00000100:00100000:2.0:1777051345.175774:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051345.175793:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5fbeca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452575104:0@lo:400:kworker.0 00000100:00100000:0.0:1777051345.175800:0:6585:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d950889500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3679:x1863365452573568:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1777051345.175847:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5fbef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452574848:0@lo:400:kworker.0 00000004:00000024:0.0:1777051345.175861:0:6585:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4194304 pending 0 free 1446219776 avail 1299980288 00000100:00100000:3.0:1777051345.175864:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051345.175899:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051345.175936:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051345.175984:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5fbefb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3680:1863365452574720:0@lo:400:kworker.0 00000100:00100000:0.0:1777051345.176018:0:6585:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d950889500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3679:x1863365452573568:12345-0@lo:41:osp-pre-1-0.0 Request processed in 229us (1218us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051345.176035:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8066 00000100:00100000:2.0:1777051345.176044:0:3677:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1777051345.176071:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051345.176079:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7cd9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3677:1863365452573952:0@lo:400:kworker.0 00000100:00100000:0.0:1777051345.176080:0:6585:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452574336 00000100:00100000:1.0:1777051345.176080:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d942a0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452573568:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1777051345.176096:0:6585:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452574336 00000100:00100000:3.0:1777051345.176578:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d9418f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3680:1863365452575232:0@lo:400:kworker.0 00000100:00100000:1.0:1777051345.176613:0:8492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452574080 00000100:00100000:2.0:1777051345.176616:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051345.176626:0:8492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452574080 00000100:00100000:0.0:1777051345.176631:0:6585:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452574848 00000100:00100000:0.0:1777051345.176644:0:6585:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452574848 00000100:00100000:3.0:1777051345.176686:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051345.176692:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955613100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3677:1863365452574464:0@lo:400:kworker.0 00000100:00100000:0.0:1777051345.176723:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8067 00000100:00100000:0.0:1777051345.176747:0:6585:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955ebd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3677:x1863365452574336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777051345.176760:0:8492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452573824 00000100:00100000:1.0:1777051345.176775:0:8492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452573824 00000100:00100000:2.0:1777051345.176777:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051345.176819:0:103166:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452573696 00000100:00100000:3.0:1777051345.176831:0:103166:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452573696 00000100:00100000:2.0:1777051345.176851:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5fbed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452574976:0@lo:400:kworker.0 00000100:00100000:1.0:1777051345.176860:0:8492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452574208 00000100:00100000:1.0:1777051345.176868:0:8492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452574208 00000100:00100000:0.0:1777051345.176871:0:6585:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955ebd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3677:x1863365452574336:12345-0@lo:400:kworker.0 Request processed in 131us (1108us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051345.176894:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8067 00000100:00100000:3.0:1777051345.176940:0:103166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1777051345.176942:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051345.176949:0:8492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452574720 00000100:00100000:0.0:1777051345.176952:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8068 00000100:00100000:1.0:1777051345.176959:0:8492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452574720 00000100:00100000:3.0:1777051345.176978:0:103166:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f2a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9351a01-5b0e-4470-97fd-58b9b4b312a2+23:3680:x1863365452573696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777051345.176990:0:6585:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955ebfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3677:x1863365452574848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777051345.177033:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955611c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3677:1863365452574336:0@lo:400:kworker.0 00000100:00100000:1.0:1777051345.177034:0:8492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452573952 00000100:00100000:1.0:1777051345.177046:0:8492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452573952 00000100:00100000:1.0:1777051345.177112:0:8492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452575232 00000100:00100000:1.0:1777051345.177119:0:8492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452575232 00000100:00100000:0.0:1777051345.177133:0:6585:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955ebfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3677:x1863365452574848:12345-0@lo:400:kworker.0 Request processed in 147us (1194us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051345.177137:0:103166:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f2a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9351a01-5b0e-4470-97fd-58b9b4b312a2+23:3680:x1863365452573696:12345-0@lo:400:kworker.0 Request processed in 166us (1505us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051345.177176:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8068 00000100:00100000:3.0:1777051345.177180:0:103166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1777051345.177189:0:46494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13234 00000100:00100000:0.0:1777051345.177249:0:13320:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452574592 00000100:00100000:1.0:1777051345.177250:0:8492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13235 00000100:00100000:0.0:1777051345.177265:0:13320:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452574592 00000100:00100000:2.0:1777051345.177268:0:46494:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95088bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000-lwp-OST0001_UUID+5:3679:x1863365452574080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777051345.177281:0:8492:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955ebc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3677:x1863365452573824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051345.177374:0:21368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13236 00000100:00100000:3.0:1777051345.177406:0:21368:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fd67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3680:x1863365452574208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777051345.177428:0:46494:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95088bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000-lwp-OST0001_UUID+5:3679:x1863365452574080:12345-0@lo:400:kworker.0 Request processed in 214us (2389us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051345.177435:0:13320:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452575104 00000100:00100000:0.0:1777051345.177447:0:13320:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452575104 00000100:00100000:2.0:1777051345.177454:0:46494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13234 00000100:00100000:2.0:1777051345.177504:0:46494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13237 00000100:00100000:0.0:1777051345.177522:0:13320:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452574464 00000100:00100000:3.0:1777051345.177524:0:21368:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fd67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3680:x1863365452574208:12345-0@lo:400:kworker.0 Request processed in 125us (1663us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051345.177532:0:46494:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fd64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000-lwp-MDT0000_UUID+5:3680:x1863365452574720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777051345.177534:0:13320:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452574464 00000100:00100000:3.0:1777051345.177564:0:21368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13236 00000100:00100000:0.0:1777051345.177598:0:13320:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452574976 00000100:00100000:0.0:1777051345.177609:0:13320:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452574976 00000100:00100000:3.0:1777051345.177627:0:21368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13238 00000100:00100000:2.0:1777051345.178016:0:46494:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fd64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000-lwp-MDT0000_UUID+5:3680:x1863365452574720:12345-0@lo:400:kworker.0 Request processed in 114us (1570us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051345.178033:0:21368:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955ebca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3677:x1863365452573952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777051345.178044:0:46494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13237 00000100:00100000:2.0:1777051345.178106:0:46494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13239 00000100:00100000:0.0:1777051345.178119:0:13320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10304 00000100:00100000:2.0:1777051345.178134:0:46494:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fd65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000-lwp-MDT0001_UUID+5:3680:x1863365452575232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051345.178155:0:21368:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955ebca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3677:x1863365452573952:12345-0@lo:400:kworker.0 Request processed in 500us (1536us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051345.178156:0:13320:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95088aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3679:x1863365452574592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051345.178190:0:21368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13238 00000100:00100000:2.0:1777051345.178332:0:46494:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fd65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000-lwp-MDT0001_UUID+5:3680:x1863365452575232:12345-0@lo:400:kworker.0 Request processed in 210us (1652us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051345.178356:0:46494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13239 00000100:00100000:0.0:1777051345.178362:0:13320:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95088aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3679:x1863365452574592:12345-0@lo:400:kworker.0 Request processed in 214us (2710us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051345.178392:0:13320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10304 00000100:00100000:0.0:1777051345.178444:0:13320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10305 00000100:00100000:2.0:1777051345.178458:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10306 00000100:00100000:0.0:1777051345.178473:0:13320:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95088ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3679:x1863365452575104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777051345.178486:0:8471:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955ebd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3677:x1863365452574464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777051345.178496:0:8492:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955ebc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3677:x1863365452573824:12345-0@lo:400:kworker.0 Request processed in 1224us (2883us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051345.178515:0:8492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13235 00000100:00100000:0.0:1777051345.178579:0:13320:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95088ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3679:x1863365452575104:12345-0@lo:400:kworker.0 Request processed in 119us (2686us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051345.178605:0:8471:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955ebd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3677:x1863365452574464:12345-0@lo:400:kworker.0 Request processed in 125us (1828us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051345.178608:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10307 00000100:00100000:0.0:1777051345.178632:0:13320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10305 00000100:00100000:2.0:1777051345.178653:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10306 00000100:00100000:3.0:1777051345.178735:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5fbe2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3680:1863365452573696:0@lo:400:kworker.0 00000100:00100000:3.0:1777051345.178780:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955612d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3680:1863365452574208:0@lo:400:kworker.0 00000100:00100000:3.0:1777051345.178810:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5fbefb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3680:1863365452574720:0@lo:400:kworker.0 00000100:00100000:2.0:1777051345.178853:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7cd9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3677:1863365452573952:0@lo:400:kworker.0 00000100:00100000:3.0:1777051345.178857:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d9418f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3680:1863365452575232:0@lo:400:kworker.0 00000100:00100000:2.0:1777051345.178904:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955613100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3677:1863365452574464:0@lo:400:kworker.0 00000100:00100000:2.0:1777051345.178944:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5fbe3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3677:1863365452573824:0@lo:400:kworker.0 00000100:00100000:2.0:1777051345.178972:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5fbef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452574848:0@lo:400:kworker.0 00000100:00080000:0.0:1777051345.179144:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1777051345.179154:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1777051345.179159:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1777051345.179163:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1777051345.179437:0:8468:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955ebce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3677:x1863365452574976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777051345.179449:0:3679:0:(client.c:3101:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294968352 gen 2 00000100:00100000:0.0:1777051345.179481:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5fbeca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452575104:0@lo:400:kworker.0 00000100:00100000:0.0:1777051345.179519:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7cd9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3679:1863365452574080:0@lo:400:kworker.0 00000100:00100000:0.0:1777051345.179559:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5fbef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452574592:0@lo:400:kworker.0 00000100:00100000:1.0:1777051345.179568:0:8468:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955ebce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3677:x1863365452574976:12345-0@lo:400:kworker.0 Request processed in 928us (2630us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051345.179589:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10307 00000100:00100000:3.0:1777051345.179638:0:3677:0:(client.c:3101:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294968349 gen 2 00000100:00100000:3.0:1777051345.179676:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5fbed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452574976:0@lo:400:kworker.0 00000020:00000080:2.0:1777051345.453164:0:104900:0:(class_obd.c:319:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe77e1cc10 20000000:00000080:2.0:1777051345.453184:0:104900:0:(mgs_handler.c:1163:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff99da7d848400 uarg=0000000000000000 20000000:01000000:2.0:1777051345.453271:0:104900:0:(mgs_llog.c:6175:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm.default_archive_id=' 20000000:01000000:2.0:1777051345.453305:0:104900:0:(mgs_llog.c:4637:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm.default_archive_id=' 20000000:01000000:2.0:1777051345.453313:0:104900:0:(mgs_llog.c:1366:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm.default_archive_id= del=1 00000040:00080000:2.0:1777051345.454259:0:104901:0:(llog.c:858:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 43 count 43 20000000:02000000:0.0:1777051345.454446:0:104900:0:(mgs_llog.c:4110:mgs_wlp_lcfg()) Disabling parameter lustre.mdt.lustre-MDT0000.hsm.default_archive_id= in log params 10000000:01000000:0.0:1777051345.470985:0:104900:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1777051345.471029:0:104900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99d954ea7600/0x85f51a6b96715390 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 104900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051345.471058:0:104900:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99da7d785400/0x85f51a6b96714bef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b96714be8 expref: 22 pid: 103168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051345.471072:0:104900:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99d955a99600/0x85f51a6b96714c4a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b96714c43 expref: 22 pid: 103168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051345.471083:0:104900:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99d955a99a00/0x85f51a6b96714c74 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b96714c6d expref: 22 pid: 103165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051345.471097:0:104900:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99d95071bc00/0x85f51a6b96714f61 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5ee7 expref: 11 pid: 103165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051345.471114:0:104900:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99d954ea7c00/0x85f51a6b96714f76 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5efc expref: 11 pid: 103169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051345.471125:0:104900:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99d953299400/0x85f51a6b9671505d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b96715056 expref: 22 pid: 103163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051345.471137:0:104900:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99d954ea7600/0x85f51a6b96715390 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 104900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051345.471221:0:104900:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99d953299400/0x85f51a6b9671505d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x85f51a6b96715056 expref: 22 pid: 103163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051345.471243:0:104900:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99d953299400/0x85f51a6b9671505d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x85f51a6b96715056 expref: 22 pid: 103163 timeout: 8074 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051345.471263:0:104900:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95a583100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:104900:1863365452575360:0@lo:104: 00000100:00100000:0.0:1777051345.471377:0:104900:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1777051345.471451:0:104900:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99d954ea7c00/0x85f51a6b96714f76 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5efc expref: 11 pid: 103169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051345.471467:0:104900:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99d954ea7c00/0x85f51a6b96714f76 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5efc expref: 11 pid: 103169 timeout: 8074 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051345.471484:0:104900:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95a581c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:104900:1863365452575488:192.168.201.46@tcp:104: 00000100:00100000:1.0:1777051345.471491:0:102039:0:(service.c:153:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1777051345.471524:0:102039:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452575360 00000100:00100000:1.0:1777051345.471534:0:102039:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452575360 00000100:00100000:1.0:1777051345.471615:0:102039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00010000:00010000:0.0:1777051345.471616:0:104900:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99d95071bc00/0x85f51a6b96714f61 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5ee7 expref: 11 pid: 103165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051345.471637:0:104900:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99d95071bc00/0x85f51a6b96714f61 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5ee7 expref: 11 pid: 103165 timeout: 8074 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051345.471641:0:102039:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9c8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:f9351a01-5b0e-4470-97fd-58b9b4b312a2+3:104900:x1863365452575360:12345-0@lo:104: 00000100:00100000:0.0:1777051345.471667:0:104900:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95a581500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:104900:1863365452575616:192.168.201.46@tcp:104: 00010000:00010000:1.0:1777051345.471686:0:102039:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.146@tcp lock: ffff99d95071ac00/0x85f51a6b96715056 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x85f51a6b9671505d expref: -99 pid: 104204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051345.471992:0:104900:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99d955a99a00/0x85f51a6b96714c74 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x85f51a6b96714c6d expref: 22 pid: 103165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051345.472010:0:104900:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99d955a99a00/0x85f51a6b96714c74 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x85f51a6b96714c6d expref: 22 pid: 103165 timeout: 8074 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051345.472028:0:104900:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d956128000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:104900:1863365452575744:0@lo:104: 00010000:00010000:1.0:1777051345.472073:0:102039:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1777051345.472074:0:104900:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051345.472091:0:102039:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9c8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:f9351a01-5b0e-4470-97fd-58b9b4b312a2+3:104900:x1863365452575360:12345-0@lo:104: Request processed in 458us (711us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051345.472105:0:102039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00010000:00010000:0.0:1777051345.472132:0:104900:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99d955a99600/0x85f51a6b96714c4a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x85f51a6b96714c43 expref: 22 pid: 103168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051345.472149:0:6563:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452575744 00010000:00010000:0.0:1777051345.472150:0:104900:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99d955a99600/0x85f51a6b96714c4a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x85f51a6b96714c43 expref: 22 pid: 103168 timeout: 8074 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051345.472161:0:6563:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452575744 00000100:00100000:0.0:1777051345.472171:0:104900:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95612aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:104900:1863365452575872:0@lo:104: 00000100:00100000:2.0:1777051345.472226:0:6563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1777051345.472240:0:6563:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95612a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f9351a01-5b0e-4470-97fd-58b9b4b312a2+3:104900:x1863365452575744:12345-0@lo:104: 00010000:00010000:2.0:1777051345.472253:0:6563:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.146@tcp lock: ffff99da7d784a00/0x85f51a6b96714c6d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x85f51a6b96714c74 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051345.472254:0:104900:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1777051345.472357:0:104900:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99da7d785400/0x85f51a6b96714bef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x85f51a6b96714be8 expref: 22 pid: 103168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051345.472373:0:104900:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99da7d785400/0x85f51a6b96714bef lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x85f51a6b96714be8 expref: 22 pid: 103168 timeout: 8074 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051345.472389:0:104900:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d956129c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:104900:1863365452576000:0@lo:104: 00010000:00010000:2.0:1777051345.472399:0:6563:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1777051345.472412:0:6563:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95612a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f9351a01-5b0e-4470-97fd-58b9b4b312a2+3:104900:x1863365452575744:12345-0@lo:104: Request processed in 175us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051345.472427:0:6563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1777051345.472436:0:104900:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051345.472466:0:104900:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d9591decc0 going to sleep for 11 seconds 00010000:00010000:3.0:1777051345.472466:0:6567:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:2.0:1777051345.472476:0:6563:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452575872 00010000:00010000:3.0:1777051345.472483:0:6567:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.146@tcp lock: ffff99d95071ac00/0x85f51a6b96715056 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x85f51a6b9671505d expref: -99 pid: 104204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051345.472484:0:6563:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452575872 00010000:00010000:3.0:1777051345.472501:0:6567:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d95071ac00 already unused, calling callback (ffffffffc1208c20) 00000100:00100000:0.0:1777051345.472502:0:104900:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95a583100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:104900:1863365452575360:0@lo:104: 10000000:00010000:3.0:1777051345.472513:0:6567:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.146@tcp lock: ffff99d95071ac00/0x85f51a6b96715056 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x85f51a6b9671505d expref: -99 pid: 104204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051345.472522:0:6563:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452576000 00000100:00100000:2.0:1777051345.472530:0:6563:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452576000 00010000:00010000:3.0:1777051345.472530:0:6567:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.146@tcp lock: ffff99d95071ac00/0x85f51a6b96715056 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x85f51a6b9671505d expref: -99 pid: 104204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051345.472534:0:104900:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d956128000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:104900:1863365452575744:0@lo:104: 10000000:00010000:3.0:1777051345.472558:0:6567:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.146@tcp lock: ffff99d95071ac00/0x85f51a6b96715056 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x85f51a6b9671505d expref: -99 pid: 104204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051345.472568:0:6563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 10000000:01000000:3.0:1777051345.472574:0:6567:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:2.0:1777051345.472584:0:6563:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d956128a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f9351a01-5b0e-4470-97fd-58b9b4b312a2+4:104900:x1863365452575872:12345-0@lo:104: 00010000:00010000:0.0:1777051345.472602:0:13753:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777051345.472605:0:6563:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.146@tcp lock: ffff99da713e3a00/0x85f51a6b96714c43 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x85f51a6b96714c4a expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051345.472610:0:13753:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.146@tcp lock: ffff99da7d784a00/0x85f51a6b96714c6d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x85f51a6b96714c74 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051345.472624:0:6567:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.146@tcp lock: ffff99d95071ac00/0x85f51a6b96715056 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x85f51a6b9671505d expref: -99 pid: 104204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051345.472646:0:13753:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da7d784a00 already unused, calling callback (ffffffffc1208c20) 10000000:00010000:0.0:1777051345.472656:0:13753:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.146@tcp lock: ffff99da7d784a00/0x85f51a6b96714c6d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x85f51a6b96714c74 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051345.472664:0:6567:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1777051345.472675:0:13753:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.146@tcp lock: ffff99da7d784a00/0x85f51a6b96714c6d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x85f51a6b96714c74 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1777051345.472690:0:13753:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.146@tcp lock: ffff99da7d784a00/0x85f51a6b96714c6d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x85f51a6b96714c74 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1777051345.472699:0:13753:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1777051345.472704:0:6563:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1777051345.472718:0:6563:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d956128a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f9351a01-5b0e-4470-97fd-58b9b4b312a2+4:104900:x1863365452575872:12345-0@lo:104: Request processed in 136us (463us total) trans 0 rc 0/0 00010000:00010000:3.0:1777051345.472726:0:6567:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.146@tcp lock: ffff99d95071ac00/0x85f51a6b96715056 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x85f51a6b9671505d expref: -99 pid: 104204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051345.472731:0:13753:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.146@tcp lock: ffff99da7d784a00/0x85f51a6b96714c6d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x85f51a6b96714c74 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051345.472733:0:6563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1777051345.472753:0:6562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00010000:00010000:0.0:1777051345.472764:0:13753:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1777051345.472764:0:6567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.146@tcp lock: ffff99d95071ac00/0x85f51a6b96715056 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x85f51a6b9671505d expref: -99 pid: 104204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051345.472775:0:6562:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d956128380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f9351a01-5b0e-4470-97fd-58b9b4b312a2+3:104900:x1863365452576000:12345-0@lo:104: 00010000:00010000:0.0:1777051345.472782:0:13753:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.146@tcp lock: ffff99da7d784a00/0x85f51a6b96714c6d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x85f51a6b96714c74 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051345.472800:0:13753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.146@tcp lock: ffff99da7d784a00/0x85f51a6b96714c6d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x85f51a6b96714c74 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051345.472800:0:6562:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.146@tcp lock: ffff99d9442eb800/0x85f51a6b96714be8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x85f51a6b96714bef expref: -99 pid: 103158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051345.472804:0:6567:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777051345.472814:0:6567:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.146@tcp lock: ffff99da713e3a00/0x85f51a6b96714c43 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x85f51a6b96714c4a expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051345.472843:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7fd64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3677:1863365452576128:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1777051345.472848:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051345.472848:0:6567:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da713e3a00 already unused, calling callback (ffffffffc1208c20) 00010000:00010000:0.0:1777051345.472856:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:00010000:3.0:1777051345.472859:0:6567:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.146@tcp lock: ffff99da713e3a00/0x85f51a6b96714c43 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x85f51a6b96714c4a expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051345.472861:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051345.472876:0:6567:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.146@tcp lock: ffff99da713e3a00/0x85f51a6b96714c43 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x85f51a6b96714c4a expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1777051345.472888:0:6567:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.146@tcp lock: ffff99da713e3a00/0x85f51a6b96714c43 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x85f51a6b96714c4a expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1777051345.472897:0:6567:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1777051345.472900:0:6562:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1777051345.472909:0:104900:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95612aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:104900:1863365452575872:0@lo:104: 00000100:00100000:1.0:1777051345.472918:0:6562:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d956128380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f9351a01-5b0e-4470-97fd-58b9b4b312a2+3:104900:x1863365452576000:12345-0@lo:104: Request processed in 143us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051345.472924:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051345.472940:0:104900:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d956129c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:104900:1863365452576000:0@lo:104: 00000100:00100000:1.0:1777051345.472941:0:6562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1777051345.472977:0:3677:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1777051345.472991:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f824e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3677:1863365452576256:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1777051345.472993:0:38719:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1777051345.472997:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051345.473007:0:38719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.146@tcp lock: ffff99d9442eb800/0x85f51a6b96714be8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x85f51a6b96714bef expref: -99 pid: 103158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051345.473020:0:38719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d9442eb800 already unused, calling callback (ffffffffc1208c20) 10000000:00010000:1.0:1777051345.473024:0:38719:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.146@tcp lock: ffff99d9442eb800/0x85f51a6b96714be8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x85f51a6b96714bef expref: -99 pid: 103158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051345.473033:0:38719:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.146@tcp lock: ffff99d9442eb800/0x85f51a6b96714be8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x85f51a6b96714bef expref: -99 pid: 103158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051345.473040:0:6564:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452576128 00000100:00100000:2.0:1777051345.473046:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051345.473049:0:6564:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452576128 10000000:00010000:1.0:1777051345.473050:0:38719:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.146@tcp lock: ffff99d9442eb800/0x85f51a6b96714be8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x85f51a6b96714bef expref: -99 pid: 103158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1777051345.473060:0:38719:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1777051345.473084:0:6564:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99d953299400/0x85f51a6b9671505d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x85f51a6b96715056 expref: 23 pid: 103163 timeout: 8074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051345.473088:0:38719:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.146@tcp lock: ffff99d9442eb800/0x85f51a6b96714be8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x85f51a6b96714bef expref: -99 pid: 103158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051345.473115:0:38719:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1777051345.473147:0:6564:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452576256 00010000:00010000:1.0:1777051345.473152:0:38719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.146@tcp lock: ffff99d9442eb800/0x85f51a6b96714be8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x85f51a6b96714bef expref: -99 pid: 103158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051345.473155:0:6564:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452576256 00000100:00100000:2.0:1777051345.473159:0:6566:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3833 00010000:00010000:1.0:1777051345.473175:0:38719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.146@tcp lock: ffff99d9442eb800/0x85f51a6b96714be8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x85f51a6b96714bef expref: -99 pid: 103158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051345.473182:0:6564:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99d955a99a00/0x85f51a6b96714c74 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x85f51a6b96714c6d expref: 24 pid: 103165 timeout: 8074 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051345.473183:0:6566:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955ebdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f9351a01-5b0e-4470-97fd-58b9b4b312a2+24:3677:x1863365452576128:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1777051345.473246:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051345.473252:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051345.473258:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051345.473260:0:6567:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.146@tcp lock: ffff99da713e3a00/0x85f51a6b96714c43 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x85f51a6b96714c4a expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051345.473271:0:6567:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1777051345.473274:0:6566:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777051345.473315:0:6566:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99d953299400/0x85f51a6b9671505d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x85f51a6b96715056 expref: 24 pid: 103163 timeout: 8074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051345.473317:0:6567:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.146@tcp lock: ffff99da713e3a00/0x85f51a6b96714c43 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x85f51a6b96714c4a expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051345.473324:0:9550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3834 00000100:00100000:1.0:1777051345.473347:0:9550:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955ebd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f9351a01-5b0e-4470-97fd-58b9b4b312a2+24:3677:x1863365452576256:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1777051345.473350:0:6566:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99d953299400/0x85f51a6b9671505d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x85f51a6b96715056 expref: 24 pid: 103163 timeout: 8074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051345.473369:0:9550:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1777051345.473376:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95088a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3679:1863365452576384:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1777051345.473380:0:6566:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d953299400/0x85f51a6b9671505d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x85f51a6b96715056 expref: 24 pid: 103163 timeout: 8074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051345.473383:0:9550:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99d955a99a00/0x85f51a6b96714c74 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x85f51a6b96714c6d expref: 24 pid: 103165 timeout: 8074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051345.473422:0:9550:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99d955a99a00/0x85f51a6b96714c74 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x85f51a6b96714c6d expref: 23 pid: 103165 timeout: 8074 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051345.473437:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1777051345.473438:0:6566:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1777051345.473449:0:9550:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d955a99a00/0x85f51a6b96714c74 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x85f51a6b96714c6d expref: 23 pid: 103165 timeout: 8074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051345.473470:0:9550:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1777051345.473489:0:6567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.146@tcp lock: ffff99da713e3a00/0x85f51a6b96714c43 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x85f51a6b96714c4a expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051345.473499:0:3679:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1777051345.473514:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7fd67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3679:1863365452576512:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1777051345.473524:0:6566:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955ebdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f9351a01-5b0e-4470-97fd-58b9b4b312a2+22:3677:x1863365452576128:12345-0@lo:103:ldlm_bl.0 Request processed in 346us (607us total) trans 0 rc 0/0 00010000:00010000:3.0:1777051345.473524:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051345.473532:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1777051345.473539:0:9550:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955ebd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f9351a01-5b0e-4470-97fd-58b9b4b312a2+22:3677:x1863365452576256:12345-0@lo:103:ldlm_bl.0 Request processed in 193us (497us total) trans 0 rc 0/0 00010000:00010000:3.0:1777051345.473540:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1777051345.473547:0:6566:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3833 00000100:00100000:0.0:1777051345.473560:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051345.473567:0:9550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3834 00000100:00100000:3.0:1777051345.473586:0:24467:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452576384 00000100:00100000:3.0:1777051345.473595:0:24467:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452576384 00000100:00100000:2.0:1777051345.473596:0:6566:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452576512 00000100:00100000:2.0:1777051345.473606:0:6566:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452576512 00010000:00010000:3.0:1777051345.473629:0:24467:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99da7d785400/0x85f51a6b96714bef lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x85f51a6b96714be8 expref: 22 pid: 103168 timeout: 8074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051345.473636:0:6566:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99d955a99600/0x85f51a6b96714c4a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x85f51a6b96714c43 expref: 22 pid: 103168 timeout: 8074 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051345.473689:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f824e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3677:1863365452576256:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1777051345.473708:0:24467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3835 00000100:00100000:1.0:1777051345.473715:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7fd64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3677:1863365452576128:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1777051345.473719:0:6566:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3836 00000100:00100000:3.0:1777051345.473728:0:24467:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da6fd40850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f9351a01-5b0e-4470-97fd-58b9b4b312a2+22:3679:x1863365452576384:12345-0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1777051345.473743:0:6566:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f825f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f9351a01-5b0e-4470-97fd-58b9b4b312a2+22:3679:x1863365452576512:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1777051345.473743:0:24467:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777051345.473753:0:24467:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99da7d785400/0x85f51a6b96714bef lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x85f51a6b96714be8 expref: 22 pid: 103168 timeout: 8074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051345.473763:0:6566:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777051345.473772:0:24467:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99da7d785400/0x85f51a6b96714bef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x85f51a6b96714be8 expref: 22 pid: 103168 timeout: 8074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051345.473775:0:6566:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99d955a99600/0x85f51a6b96714c4a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x85f51a6b96714c43 expref: 22 pid: 103168 timeout: 8074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051345.473807:0:24467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99da7d785400/0x85f51a6b96714bef lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x85f51a6b96714be8 expref: 22 pid: 103168 timeout: 8074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051345.473808:0:6566:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99d955a99600/0x85f51a6b96714c4a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x85f51a6b96714c43 expref: 22 pid: 103168 timeout: 8074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051345.473853:0:6566:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d955a99600/0x85f51a6b96714c4a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x85f51a6b96714c43 expref: 21 pid: 103168 timeout: 8074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051345.473853:0:24467:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1777051345.473874:0:6566:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1777051345.473923:0:24467:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da6fd40850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f9351a01-5b0e-4470-97fd-58b9b4b312a2+20:3679:x1863365452576384:12345-0@lo:103:ldlm_bl.0 Request processed in 202us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051345.473934:0:6566:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f825f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f9351a01-5b0e-4470-97fd-58b9b4b312a2+20:3679:x1863365452576512:12345-0@lo:103:ldlm_bl.0 Request processed in 196us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051345.473939:0:24467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3835 00000100:00100000:2.0:1777051345.473956:0:6566:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3836 00000100:00100000:0.0:1777051345.473980:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7fd67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3679:1863365452576512:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1777051345.473994:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95088a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3679:1863365452576384:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1777051345.475427:0:104900:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95a581c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:104900:1863365452575488:192.168.201.46@tcp:104: 00000100:00100000:2.0:1777051345.475427:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051345.475446:0:104900:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95a581500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:104900:1863365452575616:192.168.201.46@tcp:104: 00000100:00100000:1.0:1777051345.475495:0:9550:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425893376 00010000:00010000:0.0:1777051345.475497:0:104900:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99d954ea7600/0x85f51a6b96715390 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 104900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051345.475502:0:9550:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425893376 00000100:00100000:2.0:1777051345.475527:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00010000:00010000:1.0:1777051345.475534:0:9550:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99d954ea7c00/0x85f51a6b96714f76 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5efc expref: 12 pid: 103169 timeout: 8074 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051345.475567:0:9550:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425893504 00000100:00100000:1.0:1777051345.475571:0:9550:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425893504 00010000:00010000:1.0:1777051345.475583:0:9550:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99d95071bc00/0x85f51a6b96714f61 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5ee7 expref: 13 pid: 103165 timeout: 8074 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051345.475602:0:47827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3837 00000100:00100000:0.0:1777051345.475621:0:47827:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955ebf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:29c4352d-3260-4734-909d-9ea5de9e7fa4+13:2436:x1863365425893376:12345-192.168.201.46@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1777051345.475628:0:47597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3838 00010000:00010000:0.0:1777051345.475652:0:47827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1777051345.475660:0:47597:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955ebe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:29c4352d-3260-4734-909d-9ea5de9e7fa4+13:2437:x1863365425893504:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1777051345.475666:0:47827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99d954ea7c00/0x85f51a6b96714f76 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5efc expref: 13 pid: 103169 timeout: 8074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051345.475685:0:47827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99d954ea7c00/0x85f51a6b96714f76 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5efc expref: 13 pid: 103169 timeout: 8074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051345.475704:0:47827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d954ea7c00/0x85f51a6b96714f76 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5efc expref: 13 pid: 103169 timeout: 8074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051345.475720:0:47827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1777051345.476067:0:47827:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955ebf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:29c4352d-3260-4734-909d-9ea5de9e7fa4+12:2436:x1863365425893376:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 450us (659us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051345.476079:0:47827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3837 00010000:00010000:3.0:1777051345.476138:0:47597:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777051345.476149:0:47597:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99d95071bc00/0x85f51a6b96714f61 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5ee7 expref: 11 pid: 103165 timeout: 8074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051345.476421:0:47597:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99d95071bc00/0x85f51a6b96714f61 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5ee7 expref: 11 pid: 103165 timeout: 8074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051345.476442:0:47597:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d95071bc00/0x85f51a6b96714f61 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5ee7 expref: 11 pid: 103165 timeout: 8074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051345.476456:0:47597:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99d954ea7600/0x85f51a6b96715390 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 104900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051345.476465:0:47597:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d954ea7600/0x85f51a6b96715390 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 104900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051345.476481:0:47597:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99d954ea7600/0x85f51a6b96715390 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 104900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051345.476492:0:47597:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99d954ea7600/0x85f51a6b96715390 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 104900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051345.476505:0:47597:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99d954ea7600/0x85f51a6b96715390 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 104900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051345.476516:0:47597:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99d954ea7600/0x85f51a6b96715390 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 104900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051345.476526:0:47597:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d954ea7600 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:3.0:1777051345.476533:0:47597:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99d954ea7600/0x85f51a6b96715390 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 104900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051345.476546:0:47597:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99d954ea7600/0x85f51a6b96715390 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 104900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051345.476578:0:47597:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99d954ea7600/0x85f51a6b96715390 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 104900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051345.476593:0:47597:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1777051345.476643:0:104900:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99d954ea7600/0x85f51a6b96715390 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 104900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051345.476660:0:104900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99d954ea7600/0x85f51a6b96715390 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 104900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051345.476672:0:104900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d954ea7600/0x85f51a6b96715390 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 104900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051345.476914:0:47597:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955ebe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:29c4352d-3260-4734-909d-9ea5de9e7fa4+10:2437:x1863365425893504:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 1265us (1388us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051345.476929:0:47597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3838 00000100:00100000:1.0:1777051345.687651:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95088b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452576640:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1777051345.687748:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051345.687804:0:3677:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1777051345.687818:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d950888380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452576768:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1777051345.687867:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051345.687927:0:47388:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452576640 00000100:00100000:1.0:1777051345.687938:0:47388:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452576640 00000100:00100000:1.0:1777051345.688021:0:47388:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452576768 00000100:00100000:1.0:1777051345.688028:0:47388:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452576768 00000100:00100000:1.0:1777051345.688071:0:47388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5594 00000100:00100000:1.0:1777051345.688088:0:47388:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95088b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3677:x1863365452576640:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1777051345.688129:0:47388:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 430292544 pending 0 free 3645853696 avail 3414331392 00000100:00100000:1.0:1777051345.688233:0:47388:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95088b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3677:x1863365452576640:12345-0@lo:13:osp-pre-1-1.0 Request processed in 114us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051345.688248:0:47388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5594 00000100:00100000:1.0:1777051345.688311:0:47388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5595 00000100:00100000:1.0:1777051345.688327:0:47388:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d950888a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3677:x1863365452576768:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1777051345.688355:0:47388:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 440352320 pending 0 free 3862671360 avail 3631149056 00000100:00100000:1.0:1777051345.688415:0:47388:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d950888a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3677:x1863365452576768:12345-0@lo:13:osp-pre-0-1.0 Request processed in 92us (547us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051345.688427:0:47388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5595 00000100:00100000:1.0:1777051345.688505:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d950888380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452576768:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1777051345.688536:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95088b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452576640:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1777051346.007411:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1777051346.220543:0:104949:0:(class_obd.c:319:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffea61b02a0 20000000:00000080:2.0:1777051346.220561:0:104949:0:(mgs_handler.c:1163:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff99d95d708800 uarg=0000000000000000 20000000:01000000:2.0:1777051346.220609:0:104949:0:(mgs_llog.c:6175:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0001.hsm.default_archive_id=' 20000000:01000000:2.0:1777051346.220618:0:104949:0:(mgs_llog.c:4637:mgs_write_log_param2()) next param 'mdt.lustre-MDT0001.hsm.default_archive_id=' 20000000:01000000:2.0:1777051346.220625:0:104949:0:(mgs_llog.c:1366:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0001.hsm.default_archive_id= del=1 00000040:00080000:2.0:1777051346.221544:0:104950:0:(llog.c:858:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 43 count 43 20000000:02000000:1.0:1777051346.221787:0:104949:0:(mgs_llog.c:4110:mgs_wlp_lcfg()) Disabling parameter lustre.mdt.lustre-MDT0001.hsm.default_archive_id= in log params 10000000:01000000:1.0:1777051346.221796:0:104949:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1777051346.221822:0:104949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99d943eba200/0x85f51a6b96715397 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 104949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051346.221846:0:104949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d943eba200/0x85f51a6b96715397 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 104949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051346.221869:0:104949:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99d943eba200/0x85f51a6b96715397 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 104949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051346.221879:0:104949:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99d943eba200/0x85f51a6b96715397 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 104949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051346.221888:0:104949:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99d943eba200/0x85f51a6b96715397 lrc: 3/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 104949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051346.221900:0:104949:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99d943eba200/0x85f51a6b96715397 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 104949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051346.221910:0:104949:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d943eba200 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:1.0:1777051346.221916:0:104949:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99d943eba200/0x85f51a6b96715397 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 104949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051346.221928:0:104949:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99d943eba200/0x85f51a6b96715397 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 104949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051346.221944:0:104949:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99d943eba200/0x85f51a6b96715397 lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 104949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051346.221956:0:104949:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99d943eba200/0x85f51a6b96715397 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 104949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051346.221965:0:104949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d943eba200/0x85f51a6b96715397 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 104949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051346.853348:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051346.853503:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051346.853578:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051346.853613:0:46494:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425893888 00000100:00100000:0.0:1777051346.853627:0:46494:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425893888 00000100:00100000:2.0:1777051346.853636:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051346.854000:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051346.854002:0:24468:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425894144 00000100:00100000:1.0:1777051346.854015:0:24468:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425894144 00000100:00100000:0.0:1777051346.854064:0:46494:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425894400 00000100:00100000:2.0:1777051346.854064:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051346.854076:0:46494:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425894400 00000100:00100000:1.0:1777051346.854097:0:24468:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425894656 00000100:00100000:1.0:1777051346.854106:0:24468:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425894656 00000100:00100000:2.0:1777051346.854134:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051346.854149:0:46494:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425893760 00000100:00100000:0.0:1777051346.854177:0:46494:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425893760 00000100:00100000:1.0:1777051346.854187:0:24468:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425894016 00000100:00100000:2.0:1777051346.854199:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051346.854251:0:24468:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425894016 00000100:00100000:0.0:1777051346.854335:0:46494:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425894272 00000100:00100000:2.0:1777051346.854344:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051346.854347:0:46494:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425894272 00000100:00100000:0.0:1777051346.854414:0:46494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13240 00000100:00100000:2.0:1777051346.854434:0:10328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13241 00000100:00100000:0.0:1777051346.854439:0:46494:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955ebf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c11b6966-0775-44d2-bdc6-c74c26eb2226+6:2439:x1863365425893888:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:2.0:1777051346.854461:0:10328:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955ebd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+48:2439:x1863365425894400:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:1.0:1777051346.854492:0:24468:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425894528 00000100:00100000:1.0:1777051346.854503:0:24468:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425894528 00000100:00100000:3.0:1777051346.854557:0:103165:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425893632 00000100:00100000:0.0:1777051346.854559:0:46494:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955ebf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c11b6966-0775-44d2-bdc6-c74c26eb2226+6:2439:x1863365425893888:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 127us (1052us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051346.854570:0:103165:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425893632 00000100:00100000:1.0:1777051346.854581:0:24468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10308 00000100:00100000:0.0:1777051346.854584:0:46494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13240 00000100:00100000:1.0:1777051346.854613:0:24468:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955ebdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+48:2439:x1863365425894144:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:0.0:1777051346.854637:0:46494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13242 00000100:00100000:0.0:1777051346.854660:0:46494:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7cd9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c11b6966-0775-44d2-bdc6-c74c26eb2226+14:2439:x1863365425893760:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:2.0:1777051346.855010:0:10328:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955ebd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+48:2439:x1863365425894400:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 557us (1372us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051346.855027:0:10328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13241 00000100:00100000:1.0:1777051346.855052:0:24468:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955ebdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+48:2439:x1863365425894144:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 445us (1469us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051346.855063:0:46494:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7cd9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c11b6966-0775-44d2-bdc6-c74c26eb2226+14:2439:x1863365425893760:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 404us (997us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051346.855069:0:10328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13243 00000100:00100000:1.0:1777051346.855089:0:24468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10308 00000100:00100000:0.0:1777051346.855100:0:46494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13242 00000100:00100000:2.0:1777051346.855101:0:10328:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7cd9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+17:2439:x1863365425894272:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:1.0:1777051346.855150:0:24468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10309 00000100:00080000:0.0:1777051346.855155:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1777051346.855167:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1777051346.855170:0:10328:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7cd9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+17:2439:x1863365425894272:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 76us (974us total) trans 0 rc 0/0 00000100:00080000:0.0:1777051346.855174:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1777051346.855174:0:24468:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7cd9f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+47:2439:x1863365425894656:12345-192.168.201.46@tcp:400:kworker.0 00000100:00080000:0.0:1777051346.855184:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1777051346.855202:0:10328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13243 00000100:00100000:0.0:1777051346.855245:0:13320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10310 00000100:00100000:1.0:1777051346.855253:0:24468:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7cd9f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+47:2439:x1863365425894656:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 84us (1253us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051346.855299:0:13320:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7cd9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+50:2439:x1863365425894016:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:0.0:1777051346.855354:0:13320:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7cd9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+50:2439:x1863365425894016:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 92us (1225us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051346.855556:0:103165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 128 00000100:00100000:3.0:1777051346.855587:0:103165:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94a771050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29c4352d-3260-4734-909d-9ea5de9e7fa4+10:2439:x1863365425893632:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:3.0:1777051346.855638:0:103165:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94a771050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29c4352d-3260-4734-909d-9ea5de9e7fa4+10:2439:x1863365425893632:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 59us (2302us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051346.855652:0:103165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 128 00000100:00100000:2.0:1777051346.856163:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10311 00000100:00100000:1.0:1777051346.856180:0:24468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10309 00000100:00100000:2.0:1777051346.856191:0:8471:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955613100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+50:2439:x1863365425894528:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:0.0:1777051346.856201:0:13320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10310 00000100:00100000:2.0:1777051346.856306:0:8471:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955613100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+50:2439:x1863365425894528:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 126us (1966us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051346.856322:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10311 00010000:00010000:0.0:1777051347.030545:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1777051347.159336:0:6577:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1777051347.159344:0:6577:0:(mgc_request.c:1799:mgc_process_log()) Process log params-ffff99da7dbcc000 from 43 10000000:01000000:2.0:1777051347.159351:0:6577:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1777051347.159408:0:6577:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.146@tcp lock: ffff99da713e3200/0x85f51a6b9671539e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051347.159431:0:6577:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.146@tcp lock: ffff99da713e3200/0x85f51a6b9671539e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051347.159450:0:6577:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.146@tcp lock: ffff99da713e3200/0x85f51a6b9671539e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051347.159484:0:6577:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955612d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452576896:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1777051347.159568:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051347.159673:0:6577:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d9593a1780 going to sleep for 11 seconds 00000100:00100000:3.0:1777051347.159673:0:103163:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452576896 00000100:00100000:3.0:1777051347.159945:0:103163:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452576896 00000100:00100000:3.0:1777051347.160050:0:103163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1777051347.160091:0:103163:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94a773050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9351a01-5b0e-4470-97fd-58b9b4b312a2+19:6577:x1863365452576896:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1777051347.160112:0:103163:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777051347.160133:0:103163:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d941ad6600/0x85f51a6b967153a5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x85f51a6b9671539e expref: -99 pid: 103163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051347.160170:0:103163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d941ad6600/0x85f51a6b967153a5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x85f51a6b9671539e expref: 20 pid: 103163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051347.160187:0:103163:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d941ad6600/0x85f51a6b967153a5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b9671539e expref: 20 pid: 103163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051347.160245:0:103163:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d941ad6600, rc 0) 00000100:00100000:3.0:1777051347.160358:0:103163:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94a773050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9351a01-5b0e-4470-97fd-58b9b4b312a2+20:6577:x1863365452576896:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 294us (788us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051347.160370:0:103163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1777051347.160424:0:6577:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955612d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452576896:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1777051347.160446:0:6577:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.146@tcp lock: ffff99da713e3200/0x85f51a6b9671539e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b967153a5 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051347.160458:0:6577:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.146@tcp lock: ffff99da713e3200/0x85f51a6b9671539e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x85f51a6b967153a5 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051347.160571:0:6577:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f825500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452577024:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1777051347.160956:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051347.161004:0:6577:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d9591de540 going to sleep for 11 seconds 00000100:00100000:2.0:1777051347.161037:0:103169:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452577024 00000100:00100000:2.0:1777051347.161047:0:103169:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452577024 00000100:00100000:2.0:1777051347.161110:0:103169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1777051347.161125:0:103169:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94a771450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f9351a01-5b0e-4470-97fd-58b9b4b312a2+20:6577:x1863365452577024:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1777051347.161312:0:103169:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94a771450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f9351a01-5b0e-4470-97fd-58b9b4b312a2+20:6577:x1863365452577024:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 189us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051347.161327:0:103169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1777051347.163467:0:6577:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f825500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452577024:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1777051347.163523:0:6577:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f825500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452577152:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1777051347.163769:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051347.163901:0:6577:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d9591de540 going to sleep for 11 seconds 00000100:00100000:2.0:1777051347.163965:0:103168:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452577152 00000100:00100000:2.0:1777051347.163973:0:103168:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452577152 00000100:00100000:2.0:1777051347.164029:0:103168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1777051347.164050:0:103168:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7d9cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f9351a01-5b0e-4470-97fd-58b9b4b312a2+20:6577:x1863365452577152:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1777051347.164481:0:103168:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7d9cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f9351a01-5b0e-4470-97fd-58b9b4b312a2+20:6577:x1863365452577152:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 433us (711us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051347.164493:0:103168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1777051347.164542:0:6577:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f825500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452577152:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1777051347.165985:0:104974:0:(llog.c:858:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 43 00000020:01000000:0.0:1777051347.166112:0:6577:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 43-42 (rc=0) 10000000:01000000:0.0:1777051347.166175:0:6577:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.201.146@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1777051347.166188:0:6577:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff99da713e3200/0x85f51a6b9671539e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b967153a5 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051347.166205:0:6577:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.146@tcp lock: ffff99da713e3200/0x85f51a6b9671539e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b967153a5 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1777051347.166221:0:6577:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1777051347.166225:0:6577:0:(mgc_request.c:1799:mgc_process_log()) Process log params-ffff99da5f2be000 from 43 10000000:01000000:0.0:1777051347.166230:0:6577:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1777051347.166297:0:6577:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.146@tcp lock: ffff99d954ea7600/0x85f51a6b967153ac lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051347.166318:0:6577:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.146@tcp lock: ffff99d954ea7600/0x85f51a6b967153ac lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051347.166332:0:6577:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.146@tcp lock: ffff99d954ea7600/0x85f51a6b967153ac lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051347.166379:0:6577:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f825500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452577280:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1777051347.166429:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051347.166475:0:6577:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d9591de540 going to sleep for 11 seconds 00000100:00100000:3.0:1777051347.166788:0:103163:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452577280 00000100:00100000:3.0:1777051347.166815:0:103163:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452577280 00000100:00100000:3.0:1777051347.166866:0:103163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1777051347.166877:0:103163:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7d9cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9351a01-5b0e-4470-97fd-58b9b4b312a2+20:6577:x1863365452577280:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1777051347.166892:0:103163:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777051347.166908:0:103163:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d941ad7000/0x85f51a6b967153b3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x85f51a6b967153ac expref: -99 pid: 103163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051347.166938:0:103163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d941ad7000/0x85f51a6b967153b3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x85f51a6b967153ac expref: 21 pid: 103163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051347.166953:0:103163:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d941ad7000/0x85f51a6b967153b3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b967153ac expref: 21 pid: 103163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051347.166966:0:103163:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d941ad7000, rc 0) 00000100:00100000:3.0:1777051347.167092:0:103163:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7d9cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9351a01-5b0e-4470-97fd-58b9b4b312a2+21:6577:x1863365452577280:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 214us (661us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051347.167103:0:103163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1777051347.167225:0:6577:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f825500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452577280:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1777051347.167245:0:6577:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.146@tcp lock: ffff99d954ea7600/0x85f51a6b967153ac lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b967153b3 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051347.167288:0:6577:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.146@tcp lock: ffff99d954ea7600/0x85f51a6b967153ac lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x85f51a6b967153b3 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051347.167521:0:6577:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f825500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452577408:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1777051347.167567:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051347.167607:0:6577:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d9591de540 going to sleep for 11 seconds 00000100:00100000:2.0:1777051347.167658:0:103169:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452577408 00000100:00100000:2.0:1777051347.167667:0:103169:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452577408 00000100:00100000:2.0:1777051347.167729:0:103169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1777051347.167742:0:103169:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7d9cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f9351a01-5b0e-4470-97fd-58b9b4b312a2+21:6577:x1863365452577408:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1777051347.167902:0:103169:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7d9cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f9351a01-5b0e-4470-97fd-58b9b4b312a2+21:6577:x1863365452577408:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 161us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051347.167918:0:103169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1777051347.167972:0:6577:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f825500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452577408:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1777051347.168021:0:6577:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7fd65180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452577536:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1777051347.168433:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051347.168486:0:103168:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452577536 00000100:00100000:3.0:1777051347.168486:0:6577:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d95361f780 going to sleep for 11 seconds 00000100:00100000:2.0:1777051347.168497:0:103168:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452577536 00000100:00100000:2.0:1777051347.168560:0:103168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1777051347.168572:0:103168:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7d9cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f9351a01-5b0e-4470-97fd-58b9b4b312a2+21:6577:x1863365452577536:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1777051347.168720:0:103168:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7d9cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f9351a01-5b0e-4470-97fd-58b9b4b312a2+21:6577:x1863365452577536:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 150us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051347.168732:0:103168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1777051347.168921:0:6577:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7fd65180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452577536:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1777051347.171703:0:104975:0:(llog.c:858:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 43 00000020:01000000:0.0:1777051347.171855:0:6577:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 43-42 (rc=0) 10000000:01000000:0.0:1777051347.171890:0:6577:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.201.146@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1777051347.171903:0:6577:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff99d954ea7600/0x85f51a6b967153ac lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b967153b3 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051347.171921:0:6577:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.146@tcp lock: ffff99d954ea7600/0x85f51a6b967153ac lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b967153b3 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1777051347.171936:0:6577:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1777051347.171939:0:6577:0:(mgc_request.c:1799:mgc_process_log()) Process log params-ffff99d941839800 from 43 10000000:01000000:0.0:1777051347.171943:0:6577:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1777051347.171980:0:6577:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.146@tcp lock: ffff99d954ea7c00/0x85f51a6b967153ba lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051347.171999:0:6577:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.146@tcp lock: ffff99d954ea7c00/0x85f51a6b967153ba lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051347.172012:0:6577:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.146@tcp lock: ffff99d954ea7c00/0x85f51a6b967153ba lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051347.172037:0:6577:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f825880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452577664:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1777051347.172104:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051347.172486:0:6577:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d9591de3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1777051347.172516:0:103163:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452577664 00000100:00100000:3.0:1777051347.172527:0:103163:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452577664 00000100:00100000:3.0:1777051347.172592:0:103163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1777051347.172606:0:103163:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7d9ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9351a01-5b0e-4470-97fd-58b9b4b312a2+21:6577:x1863365452577664:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1777051347.172621:0:103163:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777051347.172656:0:103163:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d941ad6a00/0x85f51a6b967153c1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x85f51a6b967153ba expref: -99 pid: 103163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051347.172687:0:103163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d941ad6a00/0x85f51a6b967153c1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x85f51a6b967153ba expref: 22 pid: 103163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051347.172702:0:103163:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d941ad6a00/0x85f51a6b967153c1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b967153ba expref: 22 pid: 103163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051347.172715:0:103163:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d941ad6a00, rc 0) 00000100:00100000:3.0:1777051347.172780:0:103163:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7d9ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9351a01-5b0e-4470-97fd-58b9b4b312a2+22:6577:x1863365452577664:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 176us (684us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051347.172791:0:103163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1777051347.172854:0:6577:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f825880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452577664:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1777051347.172875:0:6577:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.146@tcp lock: ffff99d954ea7c00/0x85f51a6b967153ba lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b967153c1 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051347.172891:0:6577:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.146@tcp lock: ffff99d954ea7c00/0x85f51a6b967153ba lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x85f51a6b967153c1 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051347.173069:0:6577:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955611c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452577792:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1777051347.173117:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051347.173154:0:6577:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d9593a1f00 going to sleep for 11 seconds 00000100:00100000:0.0:1777051347.173820:0:103169:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452577792 00000100:00100000:0.0:1777051347.173829:0:103169:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452577792 00000100:00100000:0.0:1777051347.173895:0:103169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1777051347.173911:0:103169:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94a770850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f9351a01-5b0e-4470-97fd-58b9b4b312a2+22:6577:x1863365452577792:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1777051347.174325:0:103169:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94a770850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f9351a01-5b0e-4470-97fd-58b9b4b312a2+22:6577:x1863365452577792:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 417us (1205us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051347.174337:0:103169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1777051347.175423:0:6577:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955611c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452577792:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1777051347.175477:0:6577:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955611c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452577920:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1777051347.175540:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051347.175584:0:6577:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d9593a1f00 going to sleep for 11 seconds 00000100:00100000:1.0:1777051347.176779:0:103168:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452577920 00000100:00100000:1.0:1777051347.176788:0:103168:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452577920 00000100:00100000:1.0:1777051347.176851:0:103168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1777051347.176868:0:103168:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94a770450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f9351a01-5b0e-4470-97fd-58b9b4b312a2+22:6577:x1863365452577920:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1777051347.177039:0:103168:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94a770450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f9351a01-5b0e-4470-97fd-58b9b4b312a2+22:6577:x1863365452577920:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 174us (1496us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051347.177049:0:103168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1777051347.177111:0:6577:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955611c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452577920:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1777051347.179658:0:104976:0:(llog.c:858:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 43 00000020:01000000:1.0:1777051347.180123:0:6577:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 43-42 (rc=0) 10000000:01000000:1.0:1777051347.180159:0:6577:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.201.146@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1777051347.180173:0:6577:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff99d954ea7c00/0x85f51a6b967153ba lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b967153c1 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051347.180216:0:6577:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.146@tcp lock: ffff99d954ea7c00/0x85f51a6b967153ba lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b967153c1 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1777051347.180233:0:6577:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1777051347.180236:0:6577:0:(mgc_request.c:1799:mgc_process_log()) Process log params-ffff99da44f8d000 from 43 10000000:01000000:1.0:1777051347.180241:0:6577:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1777051347.180302:0:6577:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.146@tcp lock: ffff99d943ebb200/0x85f51a6b967153c8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051347.180315:0:6577:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.146@tcp lock: ffff99d943ebb200/0x85f51a6b967153c8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051347.180329:0:6577:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.146@tcp lock: ffff99d943ebb200/0x85f51a6b967153c8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051347.180355:0:6577:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95088b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452578048:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1777051347.180410:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051347.180456:0:6577:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da7d7acd80 going to sleep for 11 seconds 00000100:00100000:0.0:1777051347.180634:0:103163:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452578048 00000100:00100000:0.0:1777051347.180643:0:103163:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452578048 00000100:00100000:0.0:1777051347.180701:0:103163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1777051347.180714:0:103163:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7d9cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9351a01-5b0e-4470-97fd-58b9b4b312a2+22:6577:x1863365452578048:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1777051347.180728:0:103163:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051347.180746:0:103163:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d954ea6200/0x85f51a6b967153cf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x85f51a6b967153c8 expref: -99 pid: 103163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051347.181075:0:103163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d954ea6200/0x85f51a6b967153cf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x85f51a6b967153c8 expref: 23 pid: 103163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051347.181102:0:103163:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d954ea6200/0x85f51a6b967153cf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b967153c8 expref: 23 pid: 103163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051347.181114:0:103163:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d954ea6200, rc 0) 00000100:00100000:0.0:1777051347.181179:0:103163:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7d9cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9351a01-5b0e-4470-97fd-58b9b4b312a2+23:6577:x1863365452578048:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 468us (768us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051347.181190:0:103163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1777051347.181363:0:6577:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95088b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452578048:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1777051347.181384:0:6577:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.146@tcp lock: ffff99d943ebb200/0x85f51a6b967153c8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b967153cf expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051347.181399:0:6577:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.146@tcp lock: ffff99d943ebb200/0x85f51a6b967153c8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x85f51a6b967153cf expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051347.181604:0:6577:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955611c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452578176:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1777051347.181649:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051347.181967:0:6577:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da50ee2300 going to sleep for 11 seconds 00000100:00100000:0.0:1777051347.184023:0:103169:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452578176 00000100:00100000:0.0:1777051347.184032:0:103169:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452578176 00000100:00100000:0.0:1777051347.184093:0:103169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1777051347.184108:0:103169:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7d9cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f9351a01-5b0e-4470-97fd-58b9b4b312a2+23:6577:x1863365452578176:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1777051347.184291:0:103169:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7d9cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f9351a01-5b0e-4470-97fd-58b9b4b312a2+23:6577:x1863365452578176:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 185us (2639us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051347.184307:0:103169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1777051347.184324:0:6577:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955611c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452578176:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1777051347.184409:0:6577:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d950888380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452578304:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1777051347.184491:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051347.184527:0:103168:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452578304 00000100:00100000:2.0:1777051347.184537:0:103168:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452578304 00000100:00100000:1.0:1777051347.184542:0:6577:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da7d7ac840 going to sleep for 11 seconds 00000100:00100000:2.0:1777051347.184605:0:103168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1777051347.184622:0:103168:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d943e25c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f9351a01-5b0e-4470-97fd-58b9b4b312a2+23:6577:x1863365452578304:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1777051347.185018:0:103168:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d943e25c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f9351a01-5b0e-4470-97fd-58b9b4b312a2+23:6577:x1863365452578304:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 400us (526us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051347.185032:0:103168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1777051347.185169:0:6577:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d950888380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452578304:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1777051347.187061:0:104977:0:(llog.c:858:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 43 00000020:01000000:1.0:1777051347.187472:0:6577:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 43-42 (rc=0) 10000000:01000000:1.0:1777051347.187513:0:6577:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.201.146@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1777051347.187526:0:6577:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff99d943ebb200/0x85f51a6b967153c8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b967153cf expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051347.187543:0:6577:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.146@tcp lock: ffff99d943ebb200/0x85f51a6b967153c8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b967153cf expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051347.222418:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f827100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452578432:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1777051347.222517:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051347.222603:0:47388:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452578432 00000100:00100000:0.0:1777051347.222615:0:47388:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452578432 00000100:00100000:0.0:1777051347.222707:0:47388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5596 00000100:00080000:1.0:1777051347.222714:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1777051347.222725:0:47388:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d950888380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3679:x1863365452578432:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1777051347.222766:0:47388:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 440352320 pending 0 free 3862671360 avail 3631149056 00000100:00100000:2.0:1777051347.222811:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955611c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3680:1863365452578560:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1777051347.222839:0:47388:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d950888380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3679:x1863365452578432:12345-0@lo:13:osp-pre-0-0.0 Request processed in 116us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051347.222851:0:47388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5596 00000100:00100000:2.0:1777051347.222895:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051347.222926:0:8472:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452578560 00000100:00100000:3.0:1777051347.222934:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f827100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452578432:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1777051347.222936:0:8472:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452578560 00000100:00100000:0.0:1777051347.223020:0:8472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5597 00000100:00100000:0.0:1777051347.223034:0:8472:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955612d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3680:x1863365452578560:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1777051347.223063:0:8472:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 430292544 pending 0 free 3645853696 avail 3414331392 00000100:00100000:0.0:1777051347.223129:0:8472:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955612d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3680:x1863365452578560:12345-0@lo:13:osp-pre-1-0.0 Request processed in 98us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051347.223140:0:8472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5597 00000100:00080000:0.0:1777051347.223175:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1777051347.223230:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955611c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3680:1863365452578560:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1777051347.363465:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051347.363564:0:103163:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425894784 00000100:00100000:2.0:1777051347.363579:0:103163:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425894784 00000100:00100000:2.0:1777051347.363656:0:103163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 141 00000100:00100000:2.0:1777051347.363674:0:103163:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d943e24450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29c4352d-3260-4734-909d-9ea5de9e7fa4+10:6255:x1863365425894784:12345-192.168.201.46@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1777051347.363699:0:103163:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051347.363724:0:103163:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99da713e3a00/0x85f51a6b967153d6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b5f18 expref: -99 pid: 103163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051347.363771:0:103163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99da713e3a00/0x85f51a6b967153d6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5f18 expref: 11 pid: 103163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051347.363793:0:103163:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99da713e3a00/0x85f51a6b967153d6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5f18 expref: 11 pid: 103163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051347.363809:0:103163:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99da713e3a00, rc 0) 00000100:00100000:2.0:1777051347.363907:0:103163:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d943e24450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29c4352d-3260-4734-909d-9ea5de9e7fa4+11:6255:x1863365425894784:12345-192.168.201.46@tcp:101:ll_cfg_requeue.0 Request processed in 235us (803us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051347.363923:0:103163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 141 00000100:00100000:0.0:1777051347.370111:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051347.371022:0:103166:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425894912 00000100:00100000:3.0:1777051347.371036:0:103166:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425894912 00000100:00100000:3.0:1777051347.371132:0:103166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 142 00000100:00100000:3.0:1777051347.371149:0:103166:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d943e26450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29c4352d-3260-4734-909d-9ea5de9e7fa4+11:6255:x1863365425894912:12345-192.168.201.46@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1777051347.371495:0:103166:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d943e26450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29c4352d-3260-4734-909d-9ea5de9e7fa4+11:6255:x1863365425894912:12345-192.168.201.46@tcp:501:ll_cfg_requeue.0 Request processed in 348us (1387us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051347.371520:0:103166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 142 00000100:00100000:0.0:1777051347.374388:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051347.374502:0:103165:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425895040 00000100:00100000:1.0:1777051347.374515:0:103165:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425895040 00000100:00100000:1.0:1777051347.374638:0:103165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 143 00000100:00100000:1.0:1777051347.375028:0:103165:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d943e26050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29c4352d-3260-4734-909d-9ea5de9e7fa4+11:6255:x1863365425895040:12345-192.168.201.46@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1777051347.375245:0:103165:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d943e26050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29c4352d-3260-4734-909d-9ea5de9e7fa4+11:6255:x1863365425895040:12345-192.168.201.46@tcp:503:ll_cfg_requeue.0 Request processed in 592us (862us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051347.375286:0:103165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 143 00000100:00100000:0.0:1777051347.389604:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051347.389703:0:103163:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425895168 00000100:00100000:1.0:1777051347.389717:0:103163:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425895168 00000100:00100000:1.0:1777051347.389812:0:103163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 144 00000100:00100000:1.0:1777051347.389831:0:103163:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d943e25450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29c4352d-3260-4734-909d-9ea5de9e7fa4+11:6255:x1863365425895168:12345-192.168.201.46@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1777051347.389857:0:103163:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777051347.389885:0:103163:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d943ebb600/0x85f51a6b967153dd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b5f1f expref: -99 pid: 103163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051347.389932:0:103163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d943ebb600/0x85f51a6b967153dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5f1f expref: 12 pid: 103163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051347.389956:0:103163:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d943ebb600/0x85f51a6b967153dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5f1f expref: 12 pid: 103163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051347.389982:0:103163:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d943ebb600, rc 0) 00000100:00100000:1.0:1777051347.390077:0:103163:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d943e25450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29c4352d-3260-4734-909d-9ea5de9e7fa4+12:6255:x1863365425895168:12345-192.168.201.46@tcp:101:ll_cfg_requeue.0 Request processed in 250us (482us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051347.390092:0:103163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 144 00000100:00100000:0.0:1777051347.393173:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051347.393434:0:103166:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425895296 00000100:00100000:1.0:1777051347.393447:0:103166:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425895296 00000100:00100000:1.0:1777051347.393515:0:103166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 145 00000100:00100000:1.0:1777051347.393534:0:103166:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d943e27050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29c4352d-3260-4734-909d-9ea5de9e7fa4+12:6255:x1863365425895296:12345-192.168.201.46@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1777051347.394088:0:103166:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d943e27050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29c4352d-3260-4734-909d-9ea5de9e7fa4+12:6255:x1863365425895296:12345-192.168.201.46@tcp:501:ll_cfg_requeue.0 Request processed in 555us (940us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051347.394104:0:103166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 145 00000100:00100000:0.0:1777051347.397375:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051347.397615:0:103165:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425895424 00000100:00100000:2.0:1777051347.397626:0:103165:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425895424 00000100:00100000:2.0:1777051347.397704:0:103165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 146 00000100:00100000:2.0:1777051347.398069:0:103165:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d943e26c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29c4352d-3260-4734-909d-9ea5de9e7fa4+12:6255:x1863365425895424:12345-192.168.201.46@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1777051347.398290:0:103165:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d943e26c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29c4352d-3260-4734-909d-9ea5de9e7fa4+12:6255:x1863365425895424:12345-192.168.201.46@tcp:503:ll_cfg_requeue.0 Request processed in 567us (915us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051347.398316:0:103165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 146 00000040:00080000:2.0:1777051347.480407:0:103189:0:(llog.c:858:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1777051348.055459:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051349.078653:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1777051349.782571:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d950889c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452578688:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1777051349.782662:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051349.782746:0:6585:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452578688 00000100:00100000:0.0:1777051349.782758:0:6585:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452578688 00000100:00100000:0.0:1777051349.782829:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8069 00000100:00100000:0.0:1777051349.782844:0:6585:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955611c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3677:x1863365452578688:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1777051349.782886:0:6585:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4194304 pending 0 free 1441644544 avail 1295405056 00000100:00100000:0.0:1777051349.782960:0:6585:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955611c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3677:x1863365452578688:12345-0@lo:41:osp-pre-0-1.0 Request processed in 119us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051349.782972:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8069 00000100:00100000:2.0:1777051349.783040:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d950889c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452578688:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1777051350.102949:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1777051350.294503:0:3677:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1777051350.294537:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da4384df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3677:1863365452578816:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1777051350.294592:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d950889880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3679:1863365452578944:0@lo:400:kworker.0 00000100:00100000:2.0:1777051350.294649:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051350.294691:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051350.294762:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95088b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3677:1863365452579200:0@lo:400:kworker.0 00000100:00100000:3.0:1777051350.294791:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d944e11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3679:1863365452579456:0@lo:400:kworker.0 00000100:00100000:0.0:1777051350.294819:0:103163:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452578944 00000100:00100000:2.0:1777051350.294822:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051350.294833:0:103163:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452578944 00000100:00100000:3.0:1777051350.294863:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95088a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3678:1863365452579328:0@lo:400:kworker.0 00000100:00100000:2.0:1777051350.294899:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d944e11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3677:1863365452579712:0@lo:400:kworker.0 00000100:00100000:3.0:1777051350.294922:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051350.294928:0:103163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1777051350.294949:0:103163:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d943e27850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9351a01-5b0e-4470-97fd-58b9b4b312a2+23:3679:x1863365452578944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777051350.294974:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051350.294982:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d942a0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3678:1863365452579840:0@lo:400:kworker.0 00000100:00100000:1.0:1777051350.295016:0:8468:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452579712 00000100:00100000:1.0:1777051350.295027:0:8468:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452579712 00000100:00100000:2.0:1777051350.295039:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d951fa0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452580224:0@lo:400:kworker.0 00000100:00100000:0.0:1777051350.295065:0:103163:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d943e27850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9351a01-5b0e-4470-97fd-58b9b4b312a2+23:3679:x1863365452578944:12345-0@lo:400:kworker.0 Request processed in 120us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051350.295079:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051350.295090:0:103163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1777051350.295437:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d950889c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3680:1863365452579072:0@lo:400:kworker.0 00000100:00100000:1.0:1777051350.295460:0:8468:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452579840 00000100:00100000:1.0:1777051350.295475:0:8468:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452579840 00000100:00100000:1.0:1777051350.295527:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10312 00000100:00100000:1.0:1777051350.295538:0:8468:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da57c84850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3677:x1863365452579712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051350.296305:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d951fa1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452580352:0@lo:400:kworker.0 00000100:00100000:2.0:1777051350.296317:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051350.296334:0:8468:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da57c84850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3677:x1863365452579712:12345-0@lo:400:kworker.0 Request processed in 792us (1359us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051350.296350:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10312 00000100:00100000:2.0:1777051350.296375:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d944e11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3680:1863365452579584:0@lo:400:kworker.0 00000100:00100000:3.0:1777051350.296381:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051350.296539:0:24468:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452580352 00000100:00100000:0.0:1777051350.296557:0:24468:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452580352 00000100:00100000:0.0:1777051350.296623:0:24468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10313 00000100:00100000:0.0:1777051350.296636:0:24468:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fd65880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3678:x1863365452579840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777051350.296673:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10314 00000100:00100000:1.0:1777051350.296690:0:8468:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fd67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3678:x1863365452580352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777051350.297047:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051350.297066:0:24468:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fd65880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3678:x1863365452579840:12345-0@lo:400:kworker.0 Request processed in 429us (1995us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051350.297066:0:6580:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452579200 00000100:00100000:1.0:1777051350.297078:0:8468:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fd67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3678:x1863365452580352:12345-0@lo:400:kworker.0 Request processed in 384us (699us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051350.297080:0:6580:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452579200 00000100:00100000:0.0:1777051350.297086:0:24468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10313 00000100:00100000:2.0:1777051350.297091:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d951fa2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3680:1863365452580096:0@lo:400:kworker.0 00000100:00080000:0.0:1777051350.297439:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1777051350.297449:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1777051350.297450:0:6580:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452579328 00000100:00080000:0.0:1777051350.297453:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1777051350.297461:0:6580:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452579328 00000100:00080000:0.0:1777051350.297500:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1777051350.297521:0:6580:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452579072 00000100:00100000:3.0:1777051350.297528:0:6580:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452579072 00000100:00080000:0.0:1777051350.297561:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1777051350.297599:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13244 00000100:00100000:0.0:1777051350.297615:0:46497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13245 00000100:00100000:3.0:1777051350.297617:0:6580:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da4384d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3677:x1863365452579200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777051350.297638:0:46497:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fd65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:lustre-MDT0000-lwp-OST0001_UUID+5:3678:x1863365452579328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051350.297701:0:6580:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da4384d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3677:x1863365452579200:12345-0@lo:400:kworker.0 Request processed in 87us (2878us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051350.297716:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13244 00000100:00100000:0.0:1777051350.297721:0:46497:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fd65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:lustre-MDT0000-lwp-OST0001_UUID+5:3678:x1863365452579328:12345-0@lo:400:kworker.0 Request processed in 89us (2802us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051350.297734:0:46497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13245 00000100:00100000:3.0:1777051350.297760:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13246 00000100:00100000:2.0:1777051350.297767:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051350.297783:0:6580:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da4384dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3680:x1863365452579072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777051350.297828:0:46498:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452578816 00000100:00100000:0.0:1777051350.297838:0:46498:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452578816 00000100:00100000:1.0:1777051350.297867:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10314 00000100:00100000:3.0:1777051350.297869:0:6580:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da4384dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3680:x1863365452579072:12345-0@lo:400:kworker.0 Request processed in 89us (1551us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051350.297893:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051350.297893:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13246 00000100:00100000:0.0:1777051350.297894:0:46498:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452579584 00000100:00100000:0.0:1777051350.297903:0:46498:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452579584 00000100:00100000:1.0:1777051350.297934:0:8492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452579456 00000100:00100000:1.0:1777051350.297947:0:8492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452579456 00000100:00100000:2.0:1777051350.297947:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d942a0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3679:1863365452579968:0@lo:400:kworker.0 00000100:00100000:0.0:1777051350.297953:0:46498:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452580096 00000100:00100000:0.0:1777051350.297963:0:46498:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452580096 00000100:00100000:3.0:1777051350.297979:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051350.298025:0:46498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8070 00000100:00100000:2.0:1777051350.298039:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051350.298049:0:8492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13247 00000100:00100000:0.0:1777051350.298050:0:46498:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da4384f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+7:3677:x1863365452578816:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1777051350.298391:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95088b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3677:1863365452579200:0@lo:400:kworker.0 00000100:00100000:2.0:1777051350.298430:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d951fa0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3679:1863365452580480:0@lo:400:kworker.0 00000004:00000024:0.0:1777051350.298431:0:46498:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4194304 pending 0 free 1446219776 avail 1299980288 00000100:00100000:3.0:1777051350.298432:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d944e11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3677:1863365452579712:0@lo:400:kworker.0 00000100:00100000:3.0:1777051350.298492:0:27884:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452580224 00000100:00100000:3.0:1777051350.298499:0:27884:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452580224 00000100:00100000:2.0:1777051350.298531:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051350.298552:0:46498:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da4384f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+7:3677:x1863365452578816:12345-0@lo:41:osp-pre-1-0.0 Request processed in 507us (3904us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051350.298571:0:27884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10315 00000100:00100000:0.0:1777051350.298572:0:46498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8070 00000100:00100000:2.0:1777051350.298595:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d950889880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3679:1863365452578944:0@lo:400:kworker.0 00000100:00100000:3.0:1777051350.298595:0:27884:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fd65500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3677:x1863365452580224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777051350.298621:0:46498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8071 00000100:00100000:1.0:1777051350.298632:0:8492:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da4384e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3679:x1863365452579456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777051350.298647:0:46498:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da4384e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+6:3680:x1863365452579584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777051350.298658:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8072 00000100:00100000:2.0:1777051350.298675:0:6584:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da4384fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3680:x1863365452580096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051350.298681:0:27884:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fd65500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3677:x1863365452580224:12345-0@lo:400:kworker.0 Request processed in 90us (700us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051350.298696:0:27884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10315 00000100:00100000:0.0:1777051350.298754:0:46498:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da4384e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+6:3680:x1863365452579584:12345-0@lo:400:kworker.0 Request processed in 112us (1709us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051350.298764:0:8492:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da4384e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3679:x1863365452579456:12345-0@lo:400:kworker.0 Request processed in 691us (875us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051350.298772:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d951fa0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452580224:0@lo:400:kworker.0 00000100:00100000:0.0:1777051350.298775:0:46498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8071 00000100:00100000:2.0:1777051350.298786:0:6584:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da4384fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3680:x1863365452580096:12345-0@lo:400:kworker.0 Request processed in 112us (1027us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051350.298800:0:8492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13247 00000100:00100000:2.0:1777051350.298807:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8072 00000100:00100000:3.0:1777051350.298827:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da4384df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3677:1863365452578816:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1777051350.298846:0:46494:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452579968 00000100:00100000:0.0:1777051350.298855:0:46494:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452579968 00000100:00100000:1.0:1777051350.298873:0:8492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452580480 00000100:00100000:1.0:1777051350.298884:0:8492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452580480 00000100:00100000:2.0:1777051350.298904:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d944e11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3679:1863365452579456:0@lo:400:kworker.0 00000100:00100000:0.0:1777051350.298918:0:46494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13248 00000100:00100000:3.0:1777051350.298940:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95088a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3678:1863365452579328:0@lo:400:kworker.0 00000100:00100000:0.0:1777051350.298942:0:46494:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da4384c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000-lwp-MDT0000_UUID+5:3679:x1863365452579968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777051350.298961:0:8492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13249 00000100:00100000:1.0:1777051350.298981:0:8492:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da4384c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3679:x1863365452580480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777051350.298985:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d950889c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3680:1863365452579072:0@lo:400:kworker.0 00000100:00100000:3.0:1777051350.298992:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d942a0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3678:1863365452579840:0@lo:400:kworker.0 00000100:00100000:2.0:1777051350.299034:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d944e11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3680:1863365452579584:0@lo:400:kworker.0 00000100:00100000:3.0:1777051350.299041:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d951fa1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452580352:0@lo:400:kworker.0 00000100:00100000:0.0:1777051350.299049:0:46494:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da4384c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000-lwp-MDT0000_UUID+5:3679:x1863365452579968:12345-0@lo:400:kworker.0 Request processed in 113us (1015us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051350.299066:0:46494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13248 00000100:00100000:1.0:1777051350.299079:0:8492:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da4384c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3679:x1863365452580480:12345-0@lo:400:kworker.0 Request processed in 100us (546us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051350.299081:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d951fa2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3680:1863365452580096:0@lo:400:kworker.0 00000100:00100000:3.0:1777051350.299149:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d942a0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3679:1863365452579968:0@lo:400:kworker.0 00000100:00100000:3.0:1777051350.299167:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d951fa0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3679:1863365452580480:0@lo:400:kworker.0 00000100:00080000:2.0:1777051350.299190:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1777051350.299266:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1777051350.299370:0:8492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13249 00000100:00100000:2.0:1777051350.806441:0:3679:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1777051350.806467:0:3678:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1777051350.806470:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da4384d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452580736:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1777051350.806488:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d951fa3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452580608:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1777051350.806560:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051350.806598:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051350.806714:0:47388:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452580608 00000100:00100000:0.0:1777051350.806725:0:47388:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452580608 00000100:00100000:0.0:1777051350.806791:0:47388:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452580736 00000100:00100000:0.0:1777051350.806798:0:47388:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452580736 00000100:00100000:1.0:1777051350.806854:0:8473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5598 00000100:00100000:1.0:1777051350.806872:0:8473:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d951fa1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3678:x1863365452580608:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1777051350.806912:0:8473:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 430292544 pending 0 free 3645853696 avail 3414331392 00000100:00100000:1.0:1777051350.806976:0:8473:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d951fa1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3678:x1863365452580608:12345-0@lo:13:osp-pre-1-1.0 Request processed in 110us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051350.809064:0:47388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5599 00000100:00100000:0.0:1777051350.809080:0:47388:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fd67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3679:x1863365452580736:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1777051350.809107:0:47388:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 440352320 pending 0 free 3862671360 avail 3631149056 00000100:00100000:0.0:1777051350.809167:0:47388:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fd67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3679:x1863365452580736:12345-0@lo:13:osp-pre-0-1.0 Request processed in 92us (2569us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051350.809178:0:47388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5599 00000100:00100000:0.0:1777051350.809274:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da4384d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452580736:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1777051350.809360:0:8473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5598 00000100:00100000:1.0:1777051350.809439:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d951fa3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452580608:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1777051351.126624:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1777051351.240764:0:105151:0:(debug.c:645:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-hsm test 400: Single request is sent to the right MDT ========================================================== 13:22:30 (1777051350) 00000100:00100000:3.0:1777051351.481856:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051351.482306:0:10328:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425895552 00000100:00100000:2.0:1777051351.482351:0:10328:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425895552 00000100:00080000:0.0:1777051351.482493:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1777051351.482508:0:10328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111820 00000100:00100000:2.0:1777051351.482533:0:10328:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fd67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+14:133431:x1863365425895552:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1777051351.482572:0:10328:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051351.482619:0:10328:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da713e2e00/0x85f51a6b967153e4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b5f26 expref: -99 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.482747:0:10328:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d955a90400/0x85f51a6b967153eb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.482774:0:10328:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d955a90400/0x85f51a6b967153eb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.483774:0:10328:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d955a90400/0x85f51a6b967153eb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.483810:0:10328:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d95d338c00/0x85f51a6b967153f2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.483825:0:10328:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d95d338c00/0x85f51a6b967153f2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.483839:0:10328:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d95d338c00/0x85f51a6b967153f2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.484131:0:10328:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d95d338e00/0x85f51a6b967153f9 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.484148:0:10328:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d95d338e00/0x85f51a6b967153f9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.484161:0:10328:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d95d338e00/0x85f51a6b967153f9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1777051351.484269:0:10328:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1777051351.484277:0:10328:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1777051351.484338:0:10328:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99d95d338e00/0x85f51a6b967153f9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.484369:0:10328:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d955a90400/0x85f51a6b967153eb lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.484382:0:10328:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d955a90400/0x85f51a6b967153eb lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.484395:0:10328:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d955a90400/0x85f51a6b967153eb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.484407:0:10328:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d955a90400/0x85f51a6b967153eb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.484419:0:10328:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d955a90400 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:2.0:1777051351.484427:0:10328:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d955a90400/0x85f51a6b967153eb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.484441:0:10328:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d955a90400/0x85f51a6b967153eb lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.484461:0:10328:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d941e2ee00) 00010000:00010000:2.0:1777051351.484468:0:10328:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777051351.484476:0:10328:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d955a90400/0x85f51a6b967153eb lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.484489:0:10328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d955a90400/0x85f51a6b967153eb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.484516:0:10328:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d95d338c00/0x85f51a6b967153f2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.484528:0:10328:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d95d338c00/0x85f51a6b967153f2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.484540:0:10328:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d95d338c00/0x85f51a6b967153f2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.484551:0:10328:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d95d338c00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:2.0:1777051351.484556:0:10328:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d95d338c00/0x85f51a6b967153f2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.484567:0:10328:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d95d338c00/0x85f51a6b967153f2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.484581:0:10328:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff99d94e5e2100) 00010000:00010000:2.0:1777051351.484586:0:10328:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777051351.484590:0:10328:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d95d338c00/0x85f51a6b967153f2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.484601:0:10328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d95d338c00/0x85f51a6b967153f2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.484655:0:10328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da713e2e00/0x85f51a6b967153e4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5f26 expref: 16 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.484682:0:10328:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d95d338e00/0x85f51a6b967153f9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5f26 expref: 15 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.484697:0:10328:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff99d94e5e2500) 00010000:00010000:2.0:1777051351.484701:0:10328:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1777051351.484706:0:10328:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d95d338e00, rc 0) 00000100:00100000:2.0:1777051351.484820:0:10328:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fd67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+15:133431:x1863365425895552:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 Request processed in 2295us (2976us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051351.484841:0:10328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111820 00000100:00100000:0.0:1777051351.488679:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051351.489501:0:46494:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425895808 00000100:00100000:2.0:1777051351.489515:0:46494:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425895808 00000100:00100000:2.0:1777051351.489606:0:46494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111821 00000100:00100000:2.0:1777051351.489622:0:46494:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f824a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c11b6966-0775-44d2-bdc6-c74c26eb2226+15:133431:x1863365425895808:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1777051351.489648:0:46494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051351.489672:0:46494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d95d339e00/0x85f51a6b96715400 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b5f2d expref: -99 pid: 46494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.489766:0:46494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d95d338400/0x85f51a6b96715407 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.489784:0:46494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d95d338400/0x85f51a6b96715407 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.489799:0:46494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d95d338400/0x85f51a6b96715407 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.489820:0:46494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d95d338800/0x85f51a6b9671540e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.489833:0:46494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d95d338800/0x85f51a6b9671540e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.489844:0:46494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d95d338800/0x85f51a6b9671540e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.489962:0:46494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d95d339a00/0x85f51a6b96715415 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.489983:0:46494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d95d339a00/0x85f51a6b96715415 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.489994:0:46494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d95d339a00/0x85f51a6b96715415 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1777051351.490009:0:46494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:2.0:1777051351.490147:0:46494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d95d338400/0x85f51a6b96715407 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.490160:0:46494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d95d338400/0x85f51a6b96715407 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.490171:0:46494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d95d338400/0x85f51a6b96715407 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.490561:0:46494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d95d338400 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:2.0:1777051351.490570:0:46494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d95d338400/0x85f51a6b96715407 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.490583:0:46494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d95d338400/0x85f51a6b96715407 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.490600:0:46494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff99d94e5e2500) 00010000:00010000:2.0:1777051351.490605:0:46494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777051351.490611:0:46494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d95d338400/0x85f51a6b96715407 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.490622:0:46494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d95d338400/0x85f51a6b96715407 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.490638:0:46494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d95d338800/0x85f51a6b9671540e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.490649:0:46494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d95d338800/0x85f51a6b9671540e lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.490659:0:46494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d95d338800/0x85f51a6b9671540e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.490666:0:46494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d95d338800 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:2.0:1777051351.490671:0:46494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d95d338800/0x85f51a6b9671540e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.490681:0:46494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d95d338800/0x85f51a6b9671540e lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.490691:0:46494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff99d94e5e2d00) 00010000:00010000:2.0:1777051351.490695:0:46494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777051351.490699:0:46494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d95d338800/0x85f51a6b9671540e lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.490708:0:46494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d95d338800/0x85f51a6b9671540e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.495752:0:46494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d95d339e00/0x85f51a6b96715400 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5f2d expref: 18 pid: 46494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.495799:0:46494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d95d339a00/0x85f51a6b96715415 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5f2d expref: 17 pid: 46494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.495814:0:46494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99d941e2ea00) 00010000:00010000:2.0:1777051351.495820:0:46494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777051351.495828:0:46494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d95d339a00, rc 0) 00000100:00100000:2.0:1777051351.495952:0:46494:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f824a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c11b6966-0775-44d2-bdc6-c74c26eb2226+17:133431:x1863365425895808:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 Request processed in 6330us (7288us total) trans 30064771078 rc 0/0 00000100:00100000:2.0:1777051351.495970:0:46494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111821 00000100:00100000:0.0:1777051351.500779:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051351.500908:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051351.501049:0:6581:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425896064 00000100:00100000:1.0:1777051351.501063:0:6581:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425896064 00000100:00100000:1.0:1777051351.501476:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111822 00000100:00100000:1.0:1777051351.501493:0:6581:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f826300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+17:133431:x1863365425896064:12345-192.168.201.46@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1777051351.501641:0:6581:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f826300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+17:133431:x1863365425896064:12345-192.168.201.46@tcp:59:lhsmtool_posix.0 Request processed in 149us (742us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051351.501657:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111822 00000100:00100000:2.0:1777051351.503303:0:6566:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425895936 00000100:00100000:2.0:1777051351.503321:0:6566:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425895936 00000100:00100000:2.0:1777051351.503421:0:6566:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13673 00000100:00100000:2.0:1777051351.503441:0:6566:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f824000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+17:2438:x1863365425895936:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1777051351.503467:0:6566:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777051351.503508:0:6566:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d95d339a00/0x85f51a6b96715415 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5f2d expref: 17 pid: 46494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.503543:0:6566:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99d941e2ea00) 00010000:00010000:2.0:1777051351.503551:0:6566:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1777051351.503629:0:6566:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f824000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+16:2438:x1863365425895936:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 194us (2864us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051351.503643:0:6566:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13673 00000100:00100000:0.0:1777051351.505497:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051351.505560:0:27882:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425896192 00000100:00100000:2.0:1777051351.505572:0:27882:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425896192 00000100:00080000:0.0:1777051351.505667:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1777051351.505700:0:27882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111823 00000100:00100000:2.0:1777051351.505718:0:27882:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f827b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+6:133431:x1863365425896192:12345-192.168.201.46@tcp:59:lhsmtool_posix.0 00000004:00080000:2.0:1777051351.507319:0:27882:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 1288us 00000100:00100000:3.0:1777051351.508851:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051351.509005:0:6579:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425896320 00000100:00100000:0.0:1777051351.509019:0:6579:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425896320 00000100:00100000:0.0:1777051351.509490:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111824 00000100:00100000:0.0:1777051351.509512:0:6579:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fd64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+17:133432:x1863365425896320:12345-192.168.201.46@tcp:101:lfs.0 00010000:00010000:0.0:1777051351.509540:0:6579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051351.509571:0:6579:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da40030c00/0x85f51a6b96715423 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b5f34 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051351.509664:0:6579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da40030000/0x85f51a6b9671542a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1777051351.509684:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1777051351.509689:0:6579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da40030000/0x85f51a6b9671542a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051351.509710:0:6579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da40030000/0x85f51a6b9671542a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051351.509739:0:6579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da40031600/0x85f51a6b96715431 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8781f5e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051351.509752:0:6579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da40031600/0x85f51a6b96715431 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8781f5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051351.509765:0:6579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da40031600/0x85f51a6b96715431 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8781f5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051351.509836:0:6579:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da40030000/0x85f51a6b9671542a lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051351.509849:0:6579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da40030000/0x85f51a6b9671542a lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051351.509862:0:6579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99da40030000/0x85f51a6b9671542a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051351.509874:0:6579:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99da40030000/0x85f51a6b9671542a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051351.509886:0:6579:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da40030000 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:0.0:1777051351.509893:0:6579:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da40030000/0x85f51a6b9671542a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051351.509906:0:6579:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da40030000/0x85f51a6b9671542a lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051351.509930:0:6579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d941e2ee00) 00010000:00010000:0.0:1777051351.509936:0:6579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777051351.509944:0:6579:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99da40030000/0x85f51a6b9671542a lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051351.509955:0:6579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da40030000/0x85f51a6b9671542a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051351.509979:0:6579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da40031600/0x85f51a6b96715431 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8781f5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051351.509991:0:6579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99da40031600/0x85f51a6b96715431 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8781f5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051351.510003:0:6579:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99da40031600/0x85f51a6b96715431 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8781f5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051351.510013:0:6579:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da40031600 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:0.0:1777051351.510019:0:6579:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da40031600/0x85f51a6b96715431 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8781f5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051351.510032:0:6579:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da40031600/0x85f51a6b96715431 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8781f5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051351.510046:0:6579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8781f5e (ffff99d943f76500) 00010000:00010000:0.0:1777051351.510051:0:6579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777051351.510056:0:6579:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99da40031600/0x85f51a6b96715431 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8781f5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051351.510068:0:6579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da40031600/0x85f51a6b96715431 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8781f5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051351.510127:0:6579:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99da40030c00/0x85f51a6b96715423 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5f34 expref: 18 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051351.510147:0:6579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d941e2ee00) 00010000:00010000:0.0:1777051351.510150:0:6579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777051351.510157:0:6579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da40030c00/0x85f51a6b96715423 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5f34 expref: 18 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051351.510172:0:6579:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99da40030c00, rc 0) 00000100:00100000:0.0:1777051351.510314:0:6579:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fd64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+17:133432:x1863365425896320:12345-192.168.201.46@tcp:101:lfs.0 Request processed in 807us (1492us total) trans 0 rc 301/301 00000100:00100000:0.0:1777051351.510331:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111824 00000100:00100000:0.0:1777051351.514747:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051351.514880:0:21368:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425896576 00000100:00100000:3.0:1777051351.514892:0:21368:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425896576 00000100:00100000:3.0:1777051351.514954:0:21368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111825 00000100:00100000:3.0:1777051351.514972:0:21368:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f826a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+17:133432:x1863365425896576:12345-192.168.201.46@tcp:36:lfs.0 00010000:00010000:3.0:1777051351.515049:0:21368:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777051351.515081:0:21368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e9d6400/0x85f51a6b96714d23 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5d12 expref: 17 pid: 103199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051351.515106:0:21368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d941e2ee00) 00010000:00010000:3.0:1777051351.515113:0:21368:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1777051351.515278:0:21368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7a00/0x85f51a6b96715438 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051351.515297:0:21368:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99d954ea7800/0x85f51a6b96714f4c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5ed2 expref: 15 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051351.515308:0:21368:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7a00/0x85f51a6b96715438 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051351.515349:0:21368:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99d954ea7800/0x85f51a6b96714f4c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5ed2 expref: 15 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051351.515367:0:21368:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99d954ea7800/0x85f51a6b96714f4c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5ed2 expref: 15 pid: 6581 timeout: 8080 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051351.515392:0:21368:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94e625500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:21368:1863365452580864:192.168.201.46@tcp:104: 00000100:00100000:3.0:1777051351.515507:0:21368:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d959408c00 going to sleep for 11 seconds 00000100:00100000:2.0:1777051351.521478:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051351.521533:0:6565:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425896704 00000100:00100000:3.0:1777051351.521546:0:6565:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425896704 00010000:00010000:3.0:1777051351.521597:0:6565:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d954ea7800/0x85f51a6b96714f4c lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5ed2 expref: 16 pid: 6581 timeout: 8080 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051351.521619:0:21368:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94e625500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:21368:1863365452580864:192.168.201.46@tcp:104: 00010000:00010000:2.0:1777051351.521650:0:21368:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7a00/0x85f51a6b96715438 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051351.521895:0:6565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3839 00000100:00100000:3.0:1777051351.521907:0:6565:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da4384ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+16:2436:x1863365425896704:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1777051351.521923:0:6565:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777051351.521932:0:6565:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99d954ea7800/0x85f51a6b96714f4c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5ed2 expref: 16 pid: 6581 timeout: 8080 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051351.521947:0:6565:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99d954ea7800/0x85f51a6b96714f4c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5ed2 expref: 16 pid: 6581 timeout: 8080 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051351.521967:0:6565:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d954ea7800/0x85f51a6b96714f4c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5ed2 expref: 16 pid: 6581 timeout: 8080 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051351.521980:0:6565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d941e2ee00) 00010000:00010000:3.0:1777051351.521986:0:6565:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7a00/0x85f51a6b96715438 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051351.521996:0:6565:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7a00/0x85f51a6b96715438 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051351.522009:0:6565:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7a00/0x85f51a6b96715438 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051351.522043:0:6565:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1777051351.522113:0:21368:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7a00/0x85f51a6b96715438 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051351.522119:0:6565:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da4384ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+15:2436:x1863365425896704:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 209us (647us total) trans 0 rc 0/0 00010000:00010000:2.0:1777051351.522149:0:21368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7a00/0x85f51a6b96715438 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051351.522151:0:6565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3839 00010000:00010000:2.0:1777051351.522261:0:21368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d95d339a00/0x85f51a6b9671543f lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x8781f5e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.522316:0:21368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d95d339a00/0x85f51a6b9671543f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8781f5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.522332:0:21368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d95d339a00/0x85f51a6b9671543f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8781f5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051351.526483:0:27882:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f827b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+6:133431:x1863365425896192:12345-192.168.201.46@tcp:59:lhsmtool_posix.0 Request processed in 20762us (20985us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051351.526504:0:27882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111823 00010000:00010000:1.0:1777051351.528671:0:21368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d943ebbc00/0x85f51a6b96715446 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0xd3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051351.528690:0:21368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d943ebbc00/0x85f51a6b96715446 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051351.528701:0:21368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d943ebbc00/0x85f51a6b96715446 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1777051351.528717:0:21368:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000a43555af reply state 00000000913f37e4 transno 30064771079 ns: mdt-lustre-MDT0000_UUID lock: ffff99d943ebbc00/0x85f51a6b96715446 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051351.528729:0:21368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d943ebbc00/0x85f51a6b96715446 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051351.528737:0:21368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xd3:0x0].0x0 (ffff99d94e6b6b00) 00010000:00010000:1.0:1777051351.528740:0:21368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1777051351.528743:0:21368:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1777051351.528748:0:21368:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0xd3:0x0]: returning size 4096 00010000:00010000:1.0:1777051351.528756:0:21368:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7a00/0x85f51a6b96715438 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051351.528764:0:21368:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7a00/0x85f51a6b96715438 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051351.528772:0:21368:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7a00/0x85f51a6b96715438 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051351.528779:0:21368:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d941ad7a00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:1.0:1777051351.528783:0:21368:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7a00/0x85f51a6b96715438 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051351.528791:0:21368:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7a00/0x85f51a6b96715438 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051351.528799:0:21368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d941e2ee00) 00010000:00010000:1.0:1777051351.528802:0:21368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777051351.528805:0:21368:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7a00/0x85f51a6b96715438 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051351.528811:0:21368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7a00/0x85f51a6b96715438 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1777051351.528826:0:21368:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000a43555af reply state 00000000913f37e4 transno 30064771079 ns: mdt-lustre-MDT0000_UUID lock: ffff99d95d339a00/0x85f51a6b9671543f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8781f5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051351.528835:0:21368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d95d339a00/0x85f51a6b9671543f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8781f5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051351.528841:0:21368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8781f5e (ffff99d94e5e2d00) 00010000:00010000:1.0:1777051351.528844:0:21368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1777051351.528845:0:21368:0:(service.c:177:ptlrpc_save_lock()) nlocks 1 00000100:00100000:1.0:1777051351.528935:0:21368:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f826a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+18:133432:x1863365425896576:12345-192.168.201.46@tcp:36:lfs.0 Request processed in 13966us (14190us total) trans 30064771079 rc 0/0 00000100:00100000:1.0:1777051351.528948:0:21368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111825 00000100:00100000:1.0:1777051351.556134:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051351.556239:0:6580:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425896832 00000100:00100000:3.0:1777051351.556253:0:6580:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425896832 00000100:00100000:3.0:1777051351.556332:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111826 00000100:00100000:3.0:1777051351.556346:0:6580:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d951fa3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+18:133435:x1863365425896832:12345-192.168.201.46@tcp:101:lfs.0 00010000:00010000:3.0:1777051351.556377:0:6580:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777051351.556406:0:6580:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6c00/0x85f51a6b9671544d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b5f3b expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051351.556485:0:6580:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6400/0x85f51a6b96715454 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051351.556503:0:6580:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6400/0x85f51a6b96715454 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051351.556521:0:6580:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6400/0x85f51a6b96715454 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1777051351.556579:0:6580:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 12288 00000004:00200000:3.0:1777051351.556585:0:6580:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1777051351.556610:0:6580:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6400/0x85f51a6b96715454 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051351.556635:0:6580:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6c00/0x85f51a6b9671544d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5f3b expref: 20 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051351.556652:0:6580:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6400/0x85f51a6b96715454 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5f3b expref: 19 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051351.556660:0:6580:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d9533ab000) 00010000:00010000:3.0:1777051351.556664:0:6580:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1777051351.556667:0:6580:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d941ad6400, rc 0) 00000100:00100000:3.0:1777051351.556755:0:6580:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d951fa3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+19:133435:x1863365425896832:12345-192.168.201.46@tcp:101:lfs.0 Request processed in 410us (626us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051351.556766:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111826 00000100:00100000:3.0:1777051351.559727:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051351.559813:0:6581:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425896960 00000100:00100000:1.0:1777051351.559823:0:6581:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425896960 00000100:00100000:1.0:1777051351.559923:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111827 00000100:00100000:1.0:1777051351.559937:0:6581:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94e624e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+19:133435:x1863365425896960:12345-192.168.201.46@tcp:101:lfs.0 00010000:00010000:1.0:1777051351.559951:0:6581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777051351.559970:0:6581:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d943ebbe00/0x85f51a6b9671545b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b5f42 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051351.560059:0:6581:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d943ebac00/0x85f51a6b96715462 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051351.560073:0:6581:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d943ebac00/0x85f51a6b96715462 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051351.560082:0:6581:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d943ebac00/0x85f51a6b96715462 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051351.560097:0:6581:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d943ebaa00/0x85f51a6b96715469 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8781f5e bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051351.560108:0:6581:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d943ebaa00/0x85f51a6b96715469 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8781f5e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051351.560118:0:6581:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d943ebaa00/0x85f51a6b96715469 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8781f5e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051351.560276:0:6581:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d943ebba00/0x85f51a6b96715470 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051351.560289:0:6581:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d943ebba00/0x85f51a6b96715470 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051351.560301:0:6581:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d943ebba00/0x85f51a6b96715470 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1777051351.560332:0:6581:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0xd3:0x0]: returning size 4096 00000004:00200000:1.0:1777051351.560336:0:6581:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1777051351.560353:0:6581:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99d943ebba00/0x85f51a6b96715470 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051351.560369:0:6581:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d943ebac00/0x85f51a6b96715462 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051351.560379:0:6581:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d943ebac00/0x85f51a6b96715462 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051351.560389:0:6581:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d943ebac00/0x85f51a6b96715462 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051351.560397:0:6581:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d943ebac00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:1.0:1777051351.560403:0:6581:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d943ebac00/0x85f51a6b96715462 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051351.560413:0:6581:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d943ebac00/0x85f51a6b96715462 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051351.560428:0:6581:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d9533ab000) 00010000:00010000:1.0:1777051351.560432:0:6581:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777051351.560437:0:6581:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d943ebac00/0x85f51a6b96715462 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051351.560447:0:6581:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d943ebac00/0x85f51a6b96715462 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051351.560471:0:6581:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d943ebaa00/0x85f51a6b96715469 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8781f5e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051351.560479:0:6581:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d943ebaa00/0x85f51a6b96715469 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8781f5e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051351.560488:0:6581:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d943ebaa00/0x85f51a6b96715469 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8781f5e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051351.560496:0:6581:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d943ebaa00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:1.0:1777051351.560500:0:6581:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d943ebaa00/0x85f51a6b96715469 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8781f5e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051351.560510:0:6581:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d943ebaa00/0x85f51a6b96715469 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8781f5e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051351.560522:0:6581:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8781f5e (ffff99d94e5e2d00) 00010000:00010000:1.0:1777051351.560526:0:6581:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777051351.560530:0:6581:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d943ebaa00/0x85f51a6b96715469 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8781f5e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051351.560536:0:6581:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d943ebaa00/0x85f51a6b96715469 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8781f5e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051351.560560:0:6581:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d943ebbe00/0x85f51a6b9671545b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5f42 expref: 21 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051351.560572:0:6581:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d943ebba00/0x85f51a6b96715470 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5f42 expref: 20 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051351.560585:0:6581:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xd3:0x0].0x0 (ffff99d94e6b6b00) 00010000:00010000:1.0:1777051351.560588:0:6581:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1777051351.560590:0:6581:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d943ebba00, rc 0) 00000100:00100000:1.0:1777051351.560651:0:6581:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94e624e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+20:133435:x1863365425896960:12345-192.168.201.46@tcp:101:lfs.0 Request processed in 716us (928us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051351.560662:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111827 00000100:00100000:0.0:1777051351.563445:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051351.563681:0:27885:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425897088 00000100:00100000:1.0:1777051351.563690:0:27885:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425897088 00000100:00100000:1.0:1777051351.563755:0:27885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111828 00000100:00100000:1.0:1777051351.563767:0:27885:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f824700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+20:133435:x1863365425897088:12345-192.168.201.46@tcp:101:lfs.0 00010000:00010000:1.0:1777051351.563786:0:27885:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777051351.563807:0:27885:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d943ebb800/0x85f51a6b96715477 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b5f49 expref: -99 pid: 27885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051351.563867:0:27885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d943eba200/0x85f51a6b9671547e lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051351.563884:0:27885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d943eba200/0x85f51a6b9671547e lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051351.563898:0:27885:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d943eba200/0x85f51a6b9671547e lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051351.563917:0:27885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d943ebae00/0x85f51a6b96715485 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xd3:0x0].0xac1bda01 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051351.563928:0:27885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d943ebae00/0x85f51a6b96715485 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xd3:0x0].0xac1bda01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051351.563939:0:27885:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d943ebae00/0x85f51a6b96715485 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xd3:0x0].0xac1bda01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051351.563969:0:27885:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d943eba200/0x85f51a6b9671547e lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051351.563980:0:27885:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d943eba200/0x85f51a6b9671547e lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051351.563990:0:27885:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d943eba200/0x85f51a6b9671547e lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051351.563999:0:27885:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d943eba200 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:1.0:1777051351.564004:0:27885:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d943eba200/0x85f51a6b9671547e lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051351.564015:0:27885:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d943eba200/0x85f51a6b9671547e lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051351.564030:0:27885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xd3:0x0].0x0 (ffff99d94e6b6b00) 00010000:00010000:1.0:1777051351.564035:0:27885:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777051351.564041:0:27885:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d943eba200/0x85f51a6b9671547e lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051351.564051:0:27885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d943eba200/0x85f51a6b9671547e lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051351.564068:0:27885:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d943ebae00/0x85f51a6b96715485 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xd3:0x0].0xac1bda01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051351.564078:0:27885:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d943ebae00/0x85f51a6b96715485 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0xd3:0x0].0xac1bda01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051351.564089:0:27885:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d943ebae00/0x85f51a6b96715485 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xd3:0x0].0xac1bda01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051351.564098:0:27885:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d943ebae00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:1.0:1777051351.564102:0:27885:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d943ebae00/0x85f51a6b96715485 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xd3:0x0].0xac1bda01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051351.564113:0:27885:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d943ebae00/0x85f51a6b96715485 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0xd3:0x0].0xac1bda01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051351.564125:0:27885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xd3:0x0].0xac1bda01 (ffff99d94e6b6600) 00010000:00010000:1.0:1777051351.564129:0:27885:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777051351.564134:0:27885:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d943ebae00/0x85f51a6b96715485 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0xd3:0x0].0xac1bda01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051351.564143:0:27885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d943ebae00/0x85f51a6b96715485 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xd3:0x0].0xac1bda01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051351.564214:0:27885:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d943ebb800/0x85f51a6b96715477 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5f49 expref: 21 pid: 27885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051351.564231:0:27885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xd3:0x0].0x0 (ffff99d94e6b6b00) 00010000:00010000:1.0:1777051351.564236:0:27885:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777051351.564242:0:27885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d943ebb800/0x85f51a6b96715477 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5f49 expref: 21 pid: 27885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051351.564257:0:27885:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d943ebb800, rc 0) 00000100:00100000:1.0:1777051351.564321:0:27885:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f824700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+20:133435:x1863365425897088:12345-192.168.201.46@tcp:101:lfs.0 Request processed in 555us (881us total) trans 0 rc 301/301 00000100:00100000:1.0:1777051351.564340:0:27885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111828 00000100:00100000:0.0:1777051351.567275:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051351.567353:0:6579:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425897216 00000100:00100000:1.0:1777051351.567363:0:6579:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425897216 00000100:00100000:1.0:1777051351.567447:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111829 00000100:00100000:1.0:1777051351.567459:0:6579:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f826d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+20:133435:x1863365425897216:12345-192.168.201.46@tcp:101:lfs.0 00010000:00010000:1.0:1777051351.567474:0:6579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777051351.567490:0:6579:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d943ebbe00/0x85f51a6b9671548c lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b5f50 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051351.567560:0:6579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d943ebaa00/0x85f51a6b96715493 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051351.567577:0:6579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d943ebaa00/0x85f51a6b96715493 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051351.567592:0:6579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d943ebaa00/0x85f51a6b96715493 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051351.567609:0:6579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d943ebac00/0x85f51a6b9671549a lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xd3:0x0].0xac1bda01 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051351.567620:0:6579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d943ebac00/0x85f51a6b9671549a lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xd3:0x0].0xac1bda01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051351.567631:0:6579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d943ebac00/0x85f51a6b9671549a lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xd3:0x0].0xac1bda01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051351.567660:0:6579:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d943ebaa00/0x85f51a6b96715493 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051351.567676:0:6579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d943ebaa00/0x85f51a6b96715493 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051351.567685:0:6579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d943ebaa00/0x85f51a6b96715493 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051351.567695:0:6579:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d943ebaa00/0x85f51a6b96715493 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051351.567702:0:6579:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d943ebaa00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:1.0:1777051351.567707:0:6579:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d943ebaa00/0x85f51a6b96715493 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051351.567717:0:6579:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d943ebaa00/0x85f51a6b96715493 lrc: 5/0,0 mode: CR/CR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051351.567730:0:6579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xd3:0x0].0x0 (ffff99d94e6b6b00) 00010000:00010000:1.0:1777051351.567734:0:6579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777051351.567739:0:6579:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d943ebaa00/0x85f51a6b96715493 lrc: 3/0,0 mode: --/CR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051351.567748:0:6579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d943ebaa00/0x85f51a6b96715493 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051351.567807:0:6579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d943ebac00/0x85f51a6b9671549a lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xd3:0x0].0xac1bda01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051351.568074:0:6579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d943ebac00/0x85f51a6b9671549a lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0xd3:0x0].0xac1bda01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051351.568087:0:6579:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d943ebac00/0x85f51a6b9671549a lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xd3:0x0].0xac1bda01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051351.568098:0:6579:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d943ebac00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:1.0:1777051351.568105:0:6579:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d943ebac00/0x85f51a6b9671549a lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xd3:0x0].0xac1bda01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051351.568117:0:6579:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d943ebac00/0x85f51a6b9671549a lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0xd3:0x0].0xac1bda01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051351.568132:0:6579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xd3:0x0].0xac1bda01 (ffff99d94e6b6200) 00010000:00010000:1.0:1777051351.568137:0:6579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777051351.568142:0:6579:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d943ebac00/0x85f51a6b9671549a lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0xd3:0x0].0xac1bda01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051351.568151:0:6579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d943ebac00/0x85f51a6b9671549a lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xd3:0x0].0xac1bda01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051351.568222:0:6579:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d943ebbe00/0x85f51a6b9671548c lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5f50 expref: 21 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051351.568272:0:6579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xd3:0x0].0x0 (ffff99d94e6b6b00) 00010000:00010000:1.0:1777051351.568276:0:6579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777051351.568283:0:6579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d943ebbe00/0x85f51a6b9671548c lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5f50 expref: 21 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051351.568300:0:6579:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d943ebbe00, rc 0) 00000100:00100000:1.0:1777051351.568362:0:6579:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f826d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+20:133435:x1863365425897216:12345-192.168.201.46@tcp:101:lfs.0 Request processed in 904us (1092us total) trans 0 rc 301/301 00000100:00100000:1.0:1777051351.568374:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111829 00000100:00100000:3.0:1777051351.572517:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051351.572604:0:27882:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425897344 00000100:00100000:2.0:1777051351.572613:0:27882:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425897344 00000100:00100000:2.0:1777051351.572679:0:27882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111830 00000100:00100000:2.0:1777051351.572692:0:27882:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94e627800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+20:133435:x1863365425897344:12345-192.168.201.46@tcp:101:lfs.0 00010000:00010000:2.0:1777051351.572712:0:27882:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051351.572733:0:27882:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d95d339e00/0x85f51a6b967154a1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b5f57 expref: -99 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.572801:0:27882:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d95d338800/0x85f51a6b967154a8 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.572818:0:27882:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d95d338800/0x85f51a6b967154a8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.572834:0:27882:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d95d338800/0x85f51a6b967154a8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1777051351.572887:0:27882:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0xd3:0x0]: returning size 4096 00000004:00200000:2.0:1777051351.572892:0:27882:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1777051351.572914:0:27882:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99d95d338800/0x85f51a6b967154a8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.572938:0:27882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d95d339e00/0x85f51a6b967154a1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5f57 expref: 22 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.572956:0:27882:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d95d338800/0x85f51a6b967154a8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5f57 expref: 21 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.572966:0:27882:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xd3:0x0].0x0 (ffff99d94e6b6b00) 00010000:00010000:2.0:1777051351.572970:0:27882:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1777051351.572975:0:27882:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d95d338800, rc 0) 00000100:00100000:2.0:1777051351.573050:0:27882:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94e627800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+21:133435:x1863365425897344:12345-192.168.201.46@tcp:101:lfs.0 Request processed in 359us (535us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051351.573063:0:27882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111830 00000040:00080000:2.0:1777051351.575480:0:103189:0:(llog.c:858:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1777051351.576982:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051351.577073:0:46494:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425897472 00000100:00100000:2.0:1777051351.577082:0:46494:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425897472 00000100:00100000:2.0:1777051351.577148:0:46494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111831 00000100:00100000:2.0:1777051351.577161:0:46494:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f827800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c11b6966-0775-44d2-bdc6-c74c26eb2226+15:133435:x1863365425897472:12345-192.168.201.46@tcp:101:lfs.0 00010000:00010000:2.0:1777051351.577206:0:46494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051351.577228:0:46494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d95d338400/0x85f51a6b967154af lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b5f5e expref: -99 pid: 46494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.577288:0:46494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d95d338c00/0x85f51a6b967154b6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.577305:0:46494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d95d338c00/0x85f51a6b967154b6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.577318:0:46494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d95d338c00/0x85f51a6b967154b6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1777051351.577359:0:46494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 12288 00000004:00200000:2.0:1777051351.577364:0:46494:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1777051351.577384:0:46494:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99d95d338c00/0x85f51a6b967154b6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.577413:0:46494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d95d338400/0x85f51a6b967154af lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5f5e expref: 17 pid: 46494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.577436:0:46494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d95d338c00/0x85f51a6b967154b6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5f5e expref: 16 pid: 46494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.577448:0:46494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d9533ab000) 00010000:00010000:2.0:1777051351.577453:0:46494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1777051351.577457:0:46494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d95d338c00, rc 0) 00000100:00100000:2.0:1777051351.577519:0:46494:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f827800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c11b6966-0775-44d2-bdc6-c74c26eb2226+16:133435:x1863365425897472:12345-192.168.201.46@tcp:101:lfs.0 Request processed in 359us (539us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051351.577530:0:46494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111831 00000100:00100000:0.0:1777051351.582735:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051351.583004:0:46497:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425897728 00000100:00100000:2.0:1777051351.583017:0:46497:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425897728 00000100:00100000:2.0:1777051351.583096:0:46497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111832 00000100:00100000:2.0:1777051351.583112:0:46497:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f827480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+21:133435:x1863365425897728:12345-192.168.201.46@tcp:101:lfs.0 00010000:00010000:2.0:1777051351.583136:0:46497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051351.583165:0:46497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da713e2e00/0x85f51a6b967154bd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b5f65 expref: -99 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1777051351.583592:0:46497:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0xd3:0x0]: returning size 4096 00010000:00010000:2.0:1777051351.583730:0:46497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99da713e2e00/0x85f51a6b967154bd lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5f65 expref: 23 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.583752:0:46497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d9533ab000) 00010000:00010000:2.0:1777051351.583757:0:46497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1777051351.583765:0:46497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da713e2e00/0x85f51a6b967154bd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5f65 expref: 23 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.583786:0:46497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99da713e2e00, rc 0) 00000100:00100000:2.0:1777051351.584058:0:46497:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f827480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+22:133435:x1863365425897728:12345-192.168.201.46@tcp:101:lfs.0 Request processed in 948us (1331us total) trans 30064771080 rc 301/301 00000100:00100000:2.0:1777051351.584068:0:46497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111832 00000100:00100000:1.0:1777051351.587558:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051351.587677:0:8492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425897984 00000100:00100000:3.0:1777051351.587687:0:8492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425897984 00000100:00100000:3.0:1777051351.588008:0:8492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111833 00000100:00100000:3.0:1777051351.588023:0:8492:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d951fa2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+22:133435:x1863365425897984:12345-192.168.201.46@tcp:36:lfs.0 00010000:00010000:3.0:1777051351.588091:0:8492:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777051351.588117:0:8492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d95d338800/0x85f51a6b967154a8 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5f57 expref: 22 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051351.588137:0:8492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xd3:0x0].0x0 (ffff99d94e6b6b00) 00010000:00010000:3.0:1777051351.588143:0:8492:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1777051351.588271:0:8492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6c00/0x85f51a6b967154cb lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0xd3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051351.588309:0:8492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6c00/0x85f51a6b967154cb lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051351.588325:0:8492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6c00/0x85f51a6b967154cb lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051351.588346:0:8492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7600/0x85f51a6b967154d2 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0xd3:0x0].0xac1bda01 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051351.588356:0:8492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7600/0x85f51a6b967154d2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xd3:0x0].0xac1bda01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051351.588367:0:8492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7600/0x85f51a6b967154d2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xd3:0x0].0xac1bda01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051351.589254:0:8492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7400/0x85f51a6b967154d9 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0xd4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051351.589271:0:8492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7400/0x85f51a6b967154d9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xd4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051351.589284:0:8492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7400/0x85f51a6b967154d9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xd4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777051351.589306:0:8492:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000bb703720 reply state 00000000c1bf5ac2 transno 30064771081 ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7400/0x85f51a6b967154d9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xd4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051351.589322:0:8492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7400/0x85f51a6b967154d9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0xd4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051351.589332:0:8492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xd4:0x0].0x0 (ffff99d9533ab300) 00010000:00010000:3.0:1777051351.589337:0:8492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1777051351.589341:0:8492:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1777051351.589346:0:8492:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0xd4:0x0]: returning size 4096 00010000:00010000:3.0:1777051351.589357:0:8492:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6c00/0x85f51a6b967154cb lrc: 4/0,1 mode: CW/CW res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051351.589367:0:8492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6c00/0x85f51a6b967154cb lrc: 4/0,1 mode: CW/CW res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051351.589377:0:8492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6c00/0x85f51a6b967154cb lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051351.589387:0:8492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6c00/0x85f51a6b967154cb lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051351.589397:0:8492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d941ad6c00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:3.0:1777051351.589403:0:8492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6c00/0x85f51a6b967154cb lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051351.589414:0:8492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6c00/0x85f51a6b967154cb lrc: 5/0,0 mode: CW/CW res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051351.589426:0:8492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xd3:0x0].0x0 (ffff99d94e6b6b00) 00010000:00010000:3.0:1777051351.589430:0:8492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777051351.589435:0:8492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6c00/0x85f51a6b967154cb lrc: 3/0,0 mode: --/CW res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051351.589444:0:8492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6c00/0x85f51a6b967154cb lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777051351.589459:0:8492:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000bb703720 reply state 00000000c1bf5ac2 transno 30064771081 ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7600/0x85f51a6b967154d2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xd3:0x0].0xac1bda01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051351.589475:0:8492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7600/0x85f51a6b967154d2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0xd3:0x0].0xac1bda01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051351.589482:0:8492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xd3:0x0].0xac1bda01 (ffff99d9533ab100) 00010000:00010000:3.0:1777051351.589484:0:8492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1777051351.589486:0:8492:0:(service.c:177:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1777051351.589561:0:8492:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d951fa2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+23:133435:x1863365425897984:12345-192.168.201.46@tcp:36:lfs.0 Request processed in 1543us (2013us total) trans 30064771081 rc 0/0 00000100:00100000:3.0:1777051351.589569:0:8492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111833 00000100:00100000:0.0:1777051351.595627:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051351.595705:0:6582:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425898240 00000100:00100000:2.0:1777051351.595716:0:6582:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425898240 00000100:00100000:2.0:1777051351.595788:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3321 00000100:00100000:2.0:1777051351.595803:0:6582:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f825c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+23:133435:x1863365425898240:12345-192.168.201.46@tcp:35:lfs.0 00000100:00100000:2.0:1777051351.596058:0:6582:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f825c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+24:133435:x1863365425898240:12345-192.168.201.46@tcp:35:lfs.0 Request processed in 258us (436us total) trans 30064771082 rc 0/0 00000100:00100000:2.0:1777051351.596067:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3321 00000100:00100000:0.0:1777051351.629695:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051351.630071:0:10328:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425898368 00000100:00100000:2.0:1777051351.630085:0:10328:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425898368 00000100:00100000:2.0:1777051351.630162:0:10328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111834 00000100:00100000:2.0:1777051351.630177:0:10328:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f827100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+24:133438:x1863365425898368:12345-192.168.201.46@tcp:101:lfs.0 00010000:00010000:2.0:1777051351.630295:0:10328:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777051351.630414:0:10328:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6c00/0x85f51a6b967154e0 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b5f6c expref: -99 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051351.630506:0:10328:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7a00/0x85f51a6b967154e7 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051351.630527:0:10328:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7a00/0x85f51a6b967154e7 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051351.630544:0:10328:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7a00/0x85f51a6b967154e7 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051351.630566:0:10328:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6800/0x85f51a6b967154ee lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xd3:0x0].0xceea225b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051351.630578:0:10328:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6800/0x85f51a6b967154ee lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xd3:0x0].0xceea225b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051351.630609:0:10328:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6800/0x85f51a6b967154ee lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xd3:0x0].0xceea225b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051351.630663:0:10328:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7a00/0x85f51a6b967154e7 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051351.630677:0:10328:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7a00/0x85f51a6b967154e7 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051351.630981:0:10328:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7a00/0x85f51a6b967154e7 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051351.630992:0:10328:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7a00/0x85f51a6b967154e7 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051351.631003:0:10328:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d941ad7a00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:3.0:1777051351.631010:0:10328:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7a00/0x85f51a6b967154e7 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051351.631023:0:10328:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7a00/0x85f51a6b967154e7 lrc: 5/0,0 mode: CR/CR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051351.631040:0:10328:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xd3:0x0].0x0 (ffff99d94e6b6b00) 00010000:00010000:3.0:1777051351.631045:0:10328:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777051351.631053:0:10328:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7a00/0x85f51a6b967154e7 lrc: 3/0,0 mode: --/CR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051351.631064:0:10328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7a00/0x85f51a6b967154e7 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051351.631084:0:10328:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6800/0x85f51a6b967154ee lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xd3:0x0].0xceea225b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051351.631095:0:10328:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6800/0x85f51a6b967154ee lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0xd3:0x0].0xceea225b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051351.631106:0:10328:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6800/0x85f51a6b967154ee lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xd3:0x0].0xceea225b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051351.631115:0:10328:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d941ad6800 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:3.0:1777051351.631120:0:10328:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6800/0x85f51a6b967154ee lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xd3:0x0].0xceea225b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051351.631130:0:10328:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6800/0x85f51a6b967154ee lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0xd3:0x0].0xceea225b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051351.631143:0:10328:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xd3:0x0].0xceea225b (ffff99d9533abb00) 00010000:00010000:3.0:1777051351.631147:0:10328:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777051351.631152:0:10328:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6800/0x85f51a6b967154ee lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0xd3:0x0].0xceea225b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051351.631161:0:10328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6800/0x85f51a6b967154ee lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xd3:0x0].0xceea225b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051351.631289:0:10328:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6c00/0x85f51a6b967154e0 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5f6c expref: 25 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051351.631309:0:10328:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xd3:0x0].0x0 (ffff99d94e6b6b00) 00010000:00010000:3.0:1777051351.631313:0:10328:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777051351.631321:0:10328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6c00/0x85f51a6b967154e0 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5f6c expref: 25 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051351.631340:0:10328:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d941ad6c00, rc 0) 00000100:00100000:3.0:1777051351.631423:0:10328:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f827100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+24:133438:x1863365425898368:12345-192.168.201.46@tcp:101:lfs.0 Request processed in 1248us (1746us total) trans 0 rc 301/301 00000100:00100000:3.0:1777051351.631444:0:10328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111834 00000100:00100000:1.0:1777051351.636985:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051351.637350:0:21368:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425898496 00000100:00100000:3.0:1777051351.637362:0:21368:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425898496 00000100:00100000:3.0:1777051351.637487:0:21368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111835 00000100:00100000:3.0:1777051351.637501:0:21368:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d951fa1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+24:133438:x1863365425898496:12345-192.168.201.46@tcp:101:lfs.0 00010000:00010000:3.0:1777051351.637523:0:21368:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777051351.637568:0:21368:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6800/0x85f51a6b967154f5 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b5f73 expref: -99 pid: 21368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051351.637645:0:21368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7a00/0x85f51a6b967154fc lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051351.637664:0:21368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7a00/0x85f51a6b967154fc lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051351.637679:0:21368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7a00/0x85f51a6b967154fc lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051351.637698:0:21368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7c00/0x85f51a6b96715503 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xd3:0x0].0xceea225b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051351.637709:0:21368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7c00/0x85f51a6b96715503 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xd3:0x0].0xceea225b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051351.637720:0:21368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7c00/0x85f51a6b96715503 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xd3:0x0].0xceea225b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051351.637773:0:21368:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7a00/0x85f51a6b967154fc lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051351.637798:0:21368:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7a00/0x85f51a6b967154fc lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051351.637808:0:21368:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7a00/0x85f51a6b967154fc lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051351.637817:0:21368:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d941ad7a00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:3.0:1777051351.637823:0:21368:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7a00/0x85f51a6b967154fc lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051351.637834:0:21368:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7a00/0x85f51a6b967154fc lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051351.637850:0:21368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xd3:0x0].0x0 (ffff99d94e6b6b00) 00010000:00010000:3.0:1777051351.637855:0:21368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777051351.637861:0:21368:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7a00/0x85f51a6b967154fc lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051351.637870:0:21368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7a00/0x85f51a6b967154fc lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051351.637893:0:21368:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7c00/0x85f51a6b96715503 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xd3:0x0].0xceea225b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051351.637904:0:21368:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7c00/0x85f51a6b96715503 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0xd3:0x0].0xceea225b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051351.637930:0:21368:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7c00/0x85f51a6b96715503 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xd3:0x0].0xceea225b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051351.637944:0:21368:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d941ad7c00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:3.0:1777051351.637950:0:21368:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7c00/0x85f51a6b96715503 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xd3:0x0].0xceea225b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051351.637959:0:21368:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7c00/0x85f51a6b96715503 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0xd3:0x0].0xceea225b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051351.637970:0:21368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xd3:0x0].0xceea225b (ffff99d9533abb00) 00010000:00010000:3.0:1777051351.637974:0:21368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777051351.637978:0:21368:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7c00/0x85f51a6b96715503 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0xd3:0x0].0xceea225b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051351.637987:0:21368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7c00/0x85f51a6b96715503 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xd3:0x0].0xceea225b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051351.638029:0:21368:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6800/0x85f51a6b967154f5 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5f73 expref: 25 pid: 21368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051351.638045:0:21368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xd3:0x0].0x0 (ffff99d94e6b6b00) 00010000:00010000:3.0:1777051351.638049:0:21368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777051351.638055:0:21368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6800/0x85f51a6b967154f5 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5f73 expref: 25 pid: 21368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051351.638069:0:21368:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d941ad6800, rc 0) 00000100:00100000:3.0:1777051351.638139:0:21368:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d951fa1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+24:133438:x1863365425898496:12345-192.168.201.46@tcp:101:lfs.0 Request processed in 640us (1159us total) trans 0 rc 301/301 00000100:00100000:3.0:1777051351.638150:0:21368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111835 00000100:00100000:0.0:1777051351.645638:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051351.645820:0:46494:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425898624 00000100:00100000:2.0:1777051351.645833:0:46494:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425898624 00000100:00100000:2.0:1777051351.645917:0:46494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111836 00000100:00100000:2.0:1777051351.645932:0:46494:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f825880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+24:133438:x1863365425898624:12345-192.168.201.46@tcp:101:lfs.0 00010000:00010000:2.0:1777051351.645957:0:46494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051351.645983:0:46494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da713e2e00/0x85f51a6b9671550a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b5f7a expref: -99 pid: 46494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.646090:0:46494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d95d338800/0x85f51a6b96715511 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.646111:0:46494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d95d338800/0x85f51a6b96715511 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.646127:0:46494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d95d338800/0x85f51a6b96715511 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1777051351.646243:0:46494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0xd3:0x0]: returning size 4096 00000004:00200000:2.0:1777051351.646251:0:46494:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1777051351.646282:0:46494:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99d95d338800/0x85f51a6b96715511 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.646318:0:46494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da713e2e00/0x85f51a6b9671550a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5f7a expref: 26 pid: 46494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.646347:0:46494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d95d338800/0x85f51a6b96715511 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5f7a expref: 25 pid: 46494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.646370:0:46494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xd3:0x0].0x0 (ffff99d94e6b6b00) 00010000:00010000:2.0:1777051351.646375:0:46494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1777051351.646379:0:46494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d95d338800, rc 0) 00000100:00100000:2.0:1777051351.646455:0:46494:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f825880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+25:133438:x1863365425898624:12345-192.168.201.46@tcp:101:lfs.0 Request processed in 525us (823us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051351.646467:0:46494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111836 00000100:00100000:0.0:1777051351.650428:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051351.650575:0:6581:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425898880 00000100:00100000:1.0:1777051351.650606:0:6581:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425898880 00000100:00100000:1.0:1777051351.650669:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111837 00000100:00100000:1.0:1777051351.650680:0:6581:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f825500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+25:133438:x1863365425898880:12345-192.168.201.46@tcp:101:lfs.0 00010000:00010000:1.0:1777051351.650699:0:6581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777051351.650721:0:6581:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d943ebb800/0x85f51a6b96715518 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b5f81 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051351.651126:0:6581:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d943ebae00/0x85f51a6b9671551f lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051351.651148:0:6581:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d943ebae00/0x85f51a6b9671551f lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051351.651164:0:6581:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d943ebae00/0x85f51a6b9671551f lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1777051351.651329:0:6581:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0xd3:0x0]: returning size 4096 00010000:00010000:1.0:1777051351.651472:0:6581:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d943ebb800/0x85f51a6b96715518 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5f81 expref: 28 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051351.651499:0:6581:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d943ebae00/0x85f51a6b9671551f lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5f81 expref: 27 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051351.651514:0:6581:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xd3:0x0].0x0 (ffff99d94e6b6b00) 00010000:00010000:1.0:1777051351.651521:0:6581:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1777051351.651526:0:6581:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d943ebae00, rc 0) 00000100:00100000:1.0:1777051351.651680:0:6581:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f825500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+27:133438:x1863365425898880:12345-192.168.201.46@tcp:101:lfs.0 Request processed in 999us (1260us total) trans 30064771083 rc 0/0 00000100:00100000:1.0:1777051351.651694:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111837 00000100:00100000:1.0:1777051351.654448:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051351.654540:0:8492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425899136 00000100:00100000:3.0:1777051351.654551:0:8492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425899136 00000100:00100000:3.0:1777051351.654634:0:8492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111838 00000100:00100000:3.0:1777051351.654647:0:8492:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d951fa3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+48:133438:x1863365425899136:12345-192.168.201.46@tcp:36:lfs.0 00000100:00100000:3.0:1777051351.654792:0:8492:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94e625880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8492:1863365452580992:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1777051351.654859:0:8492:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051351.654903:0:8492:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d959408300 going to sleep for 11 seconds 00000100:00100000:0.0:1777051351.654964:0:46498:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452580992 00000100:00100000:0.0:1777051351.654974:0:46498:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452580992 00000100:00100000:0.0:1777051351.655042:0:46498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8073 00000100:00100000:0.0:1777051351.655075:0:46498:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da6ff7d450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+5:8492:x1863365452580992:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1777051351.655253:0:46498:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da6ff7d450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+5:8492:x1863365452580992:12345-0@lo:1000:mdt00_003.0 Request processed in 199us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051351.655268:0:46498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8073 00000100:00100000:3.0:1777051351.655408:0:8492:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94e625880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8492:1863365452580992:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1777051351.655524:0:8492:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94e625880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8492:1863365452581120:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1777051351.655654:0:8492:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051351.655697:0:8492:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da7d7ac0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1777051351.655732:0:46498:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452581120 00000100:00100000:0.0:1777051351.655742:0:46498:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452581120 00000100:00100000:0.0:1777051351.655795:0:46498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8074 00000100:00100000:0.0:1777051351.655804:0:46498:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94e626680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+5:8492:x1863365452581120:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1777051351.655904:0:46498:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94e626680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+5:8492:x1863365452581120:12345-0@lo:1000:mdt00_003.0 Request processed in 98us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051351.655915:0:46498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8074 00000100:00100000:3.0:1777051351.655988:0:8492:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94e625880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8492:1863365452581120:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1777051351.656051:0:8492:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94e625880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8492:1863365452581248:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1777051351.656092:0:8492:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051351.656125:0:8492:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d959408300 going to sleep for 11 seconds 00000100:00100000:0.0:1777051351.656277:0:46500:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452581248 00000100:00100000:0.0:1777051351.656292:0:46500:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452581248 00000100:00080000:2.0:1777051351.656315:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1777051351.656357:0:46500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8075 00000100:00100000:0.0:1777051351.656386:0:46500:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94e627b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+5:8492:x1863365452581248:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1777051351.656502:0:46500:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94e627b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+5:8492:x1863365452581248:12345-0@lo:1000:mdt00_003.0 Request processed in 132us (407us total) trans 0 rc -2/-2 00000100:00100000:0.0:1777051351.656514:0:46500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8075 00000100:00100000:3.0:1777051351.656586:0:8492:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94e625880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8492:1863365452581248:0@lo:1000:mdt00_003.0 00010000:00010000:3.0:1777051351.656660:0:8492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d941ad6800/0x85f51a6b9671552d lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0xd3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051351.656947:0:8492:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d941ad6800/0x85f51a6b9671552d lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 8492 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051351.656964:0:8492:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d941ad6800/0x85f51a6b9671552d lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 8492 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051351.656989:0:8492:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94e625880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8492:1863365452581376:0@lo:101:mdt00_003.0 00000100:00100000:3.0:1777051351.657032:0:8492:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051351.657075:0:8492:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da7d7ac900 going to sleep for 11 seconds 00000100:00100000:1.0:1777051351.657175:0:47208:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452581376 00000100:00100000:1.0:1777051351.657209:0:47208:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452581376 00000100:00100000:1.0:1777051351.657268:0:47208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8076 00000100:00100000:1.0:1777051351.657282:0:47208:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94e627100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+5:8492:x1863365452581376:12345-0@lo:101:mdt00_003.0 00010000:00010000:1.0:1777051351.657297:0:47208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777051351.657316:0:47208:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d943eba200/0x85f51a6b96715534 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0xd3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x85f51a6b9671552d expref: -99 pid: 47208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051351.657347:0:47208:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99d943ebbc00/0x85f51a6b96715446 lrc: 2/0,1 mode: TXN/TXN res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051351.657365:0:47208:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99d95d338800/0x85f51a6b96715511 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5f7a expref: 26 pid: 46494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051351.657381:0:47208:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d943eba200/0x85f51a6b96715534 lrc: 5/0,0 mode: --/CW res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x85f51a6b9671552d expref: 6 pid: 47208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051351.657418:0:47208:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99d95d338800/0x85f51a6b96715511 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5f7a expref: 26 pid: 46494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051351.657440:0:47208:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99d95d338800/0x85f51a6b96715511 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5f7a expref: 26 pid: 46494 timeout: 8080 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051351.657458:0:47208:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d951fa1880 pname:cluuid:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000_UUID:47208:1863365452581504:192.168.201.46@tcp:104: 00010000:00010000:1.0:1777051351.657541:0:47208:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff99d943ebbc00/0x85f51a6b96715446 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00080000:00080000:1.0:1777051351.657573:0:47208:0:(osd_handler.c:2852:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:1.0:1777051351.658045:0:47208:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d94b77f900 going to sleep for 11 seconds 00000100:00100000:1.0:1777051351.659934:0:47208:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d951fa1880 pname:cluuid:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000_UUID:47208:1863365452581504:192.168.201.46@tcp:104: 00010000:00010000:1.0:1777051351.659986:0:47208:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d943eba200/0x85f51a6b96715534 lrc: 3/0,0 mode: --/CW res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b9671552d expref: 6 pid: 47208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051351.660004:0:47208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xd3:0x0].0x0 (ffff99d94e6b6b00) 00010000:00010000:1.0:1777051351.660009:0:47208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777051351.660014:0:47208:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff99d943eba200/0x85f51a6b96715534 lrc: 3/0,0 mode: --/CW res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b9671552d expref: 6 pid: 47208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051351.660029:0:47208:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d943eba200, rc 0) 00000100:00100000:1.0:1777051351.660110:0:47208:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94e627100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+6:8492:x1863365452581376:12345-0@lo:101:mdt00_003.0 Request processed in 2830us (3076us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051351.660121:0:47208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8076 00000100:00100000:2.0:1777051351.660257:0:8492:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94e625880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8492:1863365452581376:0@lo:101:mdt00_003.0 00010000:00010000:2.0:1777051351.660301:0:8492:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d941ad6800/0x85f51a6b9671552d lrc: 4/0,1 mode: --/CW res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x85f51a6b96715534 expref: -99 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.660321:0:8492:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d941ad6800/0x85f51a6b9671552d lrc: 4/0,1 mode: --/CW res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x85f51a6b96715534 expref: -99 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051351.660372:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051351.660529:0:6564:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425899264 00000100:00100000:2.0:1777051351.660538:0:6564:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425899264 00010000:00010000:2.0:1777051351.660574:0:6564:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d95d338800/0x85f51a6b96715511 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5f7a expref: 27 pid: 46494 timeout: 8080 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051351.660623:0:6564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3840 00000100:00100000:2.0:1777051351.660635:0:6564:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d951fa1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+27:2437:x1863365425899264:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1777051351.660653:0:6564:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777051351.660663:0:6564:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99d95d338800/0x85f51a6b96715511 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5f7a expref: 27 pid: 46494 timeout: 8080 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.660694:0:6564:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99d95d338800/0x85f51a6b96715511 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5f7a expref: 27 pid: 46494 timeout: 8080 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.660721:0:6564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d95d338800/0x85f51a6b96715511 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5f7a expref: 27 pid: 46494 timeout: 8080 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.660740:0:6564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xd3:0x0].0x0 (ffff99d94e6b6b00) 00010000:00010000:2.0:1777051351.660748:0:6564:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff99d943eba200/0x85f51a6b96715534 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b9671552d expref: 5 pid: 47208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.660761:0:6564:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1777051351.660815:0:6564:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d951fa1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+26:2437:x1863365425899264:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 180us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051351.660828:0:6564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3840 00000001:00080000:3.0:1777051351.661428:0:103159:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771083 is committed 00000001:00080000:3.0:1777051351.661448:0:103159:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771078 is committed 00010000:00010000:2.0:1777051351.661571:0:3664:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99d95d339a00/0x85f51a6b9671543f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8781f5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.661587:0:3664:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d95d339a00/0x85f51a6b9671543f lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8781f5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.661599:0:3664:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d95d339a00/0x85f51a6b9671543f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8781f5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.661609:0:3664:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d95d339a00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:2.0:1777051351.661614:0:3664:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d95d339a00/0x85f51a6b9671543f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8781f5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.661625:0:3664:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d95d339a00/0x85f51a6b9671543f lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8781f5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.661642:0:3664:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8781f5e (ffff99d94e5e2d00) 00010000:00010000:2.0:1777051351.661647:0:3664:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777051351.661652:0:3664:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d95d339a00/0x85f51a6b9671543f lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x8781f5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.661662:0:3664:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d95d339a00/0x85f51a6b9671543f lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x8781f5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.661687:0:3664:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99d943ebbc00/0x85f51a6b96715446 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.661698:0:3664:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d943ebbc00/0x85f51a6b96715446 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.661708:0:3664:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d943ebbc00/0x85f51a6b96715446 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.661716:0:3664:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d943ebbc00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:2.0:1777051351.661721:0:3664:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d943ebbc00/0x85f51a6b96715446 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.661731:0:3664:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d943ebbc00/0x85f51a6b96715446 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.661745:0:3664:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xd3:0x0].0x0 (ffff99d94e6b6b00) 00010000:00010000:2.0:1777051351.661749:0:3664:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777051351.661756:0:3664:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff99d943eba200/0x85f51a6b96715534 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b9671552d expref: 5 pid: 47208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.661773:0:3664:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99d943eba200/0x85f51a6b96715534 lrc: 2/0,0 mode: CW/CW res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x85f51a6b9671552d expref: 5 pid: 47208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.661789:0:3664:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d943eba200/0x85f51a6b96715534 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x85f51a6b9671552d expref: 5 pid: 47208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.661830:0:3664:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff99d943eba200/0x85f51a6b96715534 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b9671552d expref: 5 pid: 47208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051351.661849:0:3664:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da4384ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_001:lustre-MDT0000_UUID:3664:1863365452581632:0@lo:105: 00000100:00100000:2.0:1777051351.661896:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051351.661945:0:3664:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da6fdb6cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1777051351.661987:0:6563:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452581632 00000100:00100000:1.0:1777051351.661995:0:6563:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452581632 00000100:00100000:1.0:1777051351.662046:0:6563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1777051351.662058:0:6563:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da4384c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:3664:x1863365452581632:12345-0@lo:105: 00010000:00010000:1.0:1777051351.662074:0:6563:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d941ad6800/0x85f51a6b9671552d lrc: 5/0,1 mode: --/CW res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x85f51a6b96715534 expref: -99 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051351.662091:0:6563:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d941ad6800/0x85f51a6b9671552d lrc: 5/0,1 mode: --/CW res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x85f51a6b96715534 expref: -99 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051351.662114:0:6563:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d941ad6800/0x85f51a6b9671552d lrc: 5/0,1 mode: --/CW res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x85f51a6b96715534 expref: -99 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051351.662127:0:6563:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d941ad6800/0x85f51a6b9671552d lrc: 5/0,1 mode: CW/CW res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x85f51a6b96715534 expref: -99 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051351.662490:0:6563:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d941ad6800/0x85f51a6b9671552d lrc: 6/0,1 mode: CW/CW res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x85f51a6b96715534 expref: -99 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051351.662512:0:6563:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d941ad6800/0x85f51a6b9671552d lrc: 6/0,1 mode: CW/CW res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x85f51a6b96715534 expref: -99 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051351.662548:0:6563:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff99d941ad6800) 00010000:00010000:2.0:1777051351.662604:0:8492:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d941ad6800/0x85f51a6b9671552d lrc: 4/0,1 mode: CW/CW res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x85f51a6b96715534 expref: -99 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051351.662620:0:6563:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da4384c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:3664:x1863365452581632:12345-0@lo:105: Request processed in 564us (723us total) trans 0 rc 0/0 00010000:00010000:2.0:1777051351.662620:0:8492:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d941ad6800/0x85f51a6b9671552d lrc: 4/0,1 mode: CW/CW res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x85f51a6b96715534 expref: -99 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051351.662632:0:6563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000004:00080000:2.0:1777051351.662657:0:8492:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000bd2:0xd3:0x0] 00010000:00010000:2.0:1777051351.662703:0:8492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d95d338400/0x85f51a6b9671553b lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0xd3:0x0].0xceea225b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.662716:0:8492:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d95d338400/0x85f51a6b9671553b lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0xd3:0x0].0xceea225b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 8492 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.662729:0:8492:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d95d338400/0x85f51a6b9671553b lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0xd3:0x0].0xceea225b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 8492 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051351.662751:0:8492:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da4384ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8492:1863365452581760:0@lo:101:mdt00_003.0 00000100:00100000:2.0:1777051351.662812:0:8492:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051351.662849:0:8492:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d955a450c0 going to sleep for 11 seconds 00000100:00100000:3.0:1777051351.662906:0:3664:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da4384ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_001:lustre-MDT0000_UUID:3664:1863365452581632:0@lo:105: 00010000:00010000:3.0:1777051351.662939:0:3664:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d943ebbc00/0x85f51a6b96715446 lrc: 2/0,0 mode: --/TXN res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051351.662942:0:11727:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452581760 00000100:00100000:1.0:1777051351.662951:0:11727:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452581760 00010000:00010000:3.0:1777051351.662962:0:3664:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d943ebbc00/0x85f51a6b96715446 lrc: 0/0,0 mode: --/TXN res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051351.662990:0:3664:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7600/0x85f51a6b967154d2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0xd3:0x0].0xac1bda01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051351.663002:0:11727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8077 00010000:00010000:3.0:1777051351.663011:0:3664:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7600/0x85f51a6b967154d2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd2:0xd3:0x0].0xac1bda01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051351.663023:0:11727:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da4384f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:8492:x1863365452581760:12345-0@lo:101:mdt00_003.0 00010000:00010000:3.0:1777051351.663031:0:3664:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7600/0x85f51a6b967154d2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0xd3:0x0].0xac1bda01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051351.663045:0:3664:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d941ad7600 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:1.0:1777051351.663046:0:11727:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777051351.663052:0:3664:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7600/0x85f51a6b967154d2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0xd3:0x0].0xac1bda01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051351.663067:0:3664:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7600/0x85f51a6b967154d2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd2:0xd3:0x0].0xac1bda01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051351.663070:0:11727:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d943ebb800/0x85f51a6b96715542 lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0xd3:0x0].0xceea225b bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x85f51a6b9671553b expref: -99 pid: 11727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051351.663097:0:3664:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xd3:0x0].0xac1bda01 (ffff99d9533ab100) 00010000:00010000:3.0:1777051351.663104:0:3664:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777051351.663110:0:3664:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7600/0x85f51a6b967154d2 lrc: 2/0,0 mode: --/TXN res: [0x200000bd2:0xd3:0x0].0xac1bda01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051351.663113:0:11727:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d943ebb800/0x85f51a6b96715542 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xd3:0x0].0xceea225b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x85f51a6b9671553b expref: 7 pid: 11727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051351.663141:0:3664:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7600/0x85f51a6b967154d2 lrc: 0/0,0 mode: --/TXN res: [0x200000bd2:0xd3:0x0].0xac1bda01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051351.663167:0:11727:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d943ebb800/0x85f51a6b96715542 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xd3:0x0].0xceea225b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b9671553b expref: 7 pid: 11727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051351.663177:0:11727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xd3:0x0].0xceea225b (ffff99d94e6b6200) 00010000:00010000:1.0:1777051351.663250:0:11727:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777051351.663255:0:11727:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d943ebb800, rc 0) 00010000:00010000:3.0:1777051351.663264:0:3664:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7400/0x85f51a6b967154d9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0xd4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051351.663280:0:3664:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7400/0x85f51a6b967154d9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd2:0xd4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051351.663292:0:3664:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7400/0x85f51a6b967154d9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0xd4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051351.663302:0:3664:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d941ad7400 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:3.0:1777051351.663309:0:3664:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7400/0x85f51a6b967154d9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0xd4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051351.663319:0:3664:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7400/0x85f51a6b967154d9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd2:0xd4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051351.663336:0:3664:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xd4:0x0].0x0 (ffff99d9533ab300) 00010000:00010000:3.0:1777051351.663345:0:3664:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1777051351.663346:0:11727:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da4384f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:8492:x1863365452581760:12345-0@lo:101:mdt00_003.0 Request processed in 325us (528us total) trans 0 rc 0/0 00010000:00010000:3.0:1777051351.663352:0:3664:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7400/0x85f51a6b967154d9 lrc: 2/0,0 mode: --/TXN res: [0x200000bd2:0xd4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051351.663368:0:11727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8077 00010000:00010000:3.0:1777051351.663375:0:3664:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7400/0x85f51a6b967154d9 lrc: 0/0,0 mode: --/TXN res: [0x200000bd2:0xd4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051351.663414:0:8492:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da4384ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8492:1863365452581760:0@lo:101:mdt00_003.0 00010000:00010000:2.0:1777051351.663439:0:8492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d95d338400/0x85f51a6b9671553b lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0xd3:0x0].0xceea225b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x85f51a6b96715542 expref: -99 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.663462:0:8492:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d95d338400/0x85f51a6b9671553b lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0xd3:0x0].0xceea225b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x85f51a6b96715542 expref: -99 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1777051351.663485:0:8492:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000bd2:0xd3:0x0] 00000100:00100000:2.0:1777051351.663532:0:8492:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da4384ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8492:1863365452581888:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1777051351.663579:0:8492:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051351.663627:0:8492:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d941bdd540 going to sleep for 11 seconds 00000100:00100000:1.0:1777051351.663655:0:6585:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452581888 00000100:00100000:1.0:1777051351.663662:0:6585:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452581888 00000100:00100000:1.0:1777051351.663706:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8078 00000100:00100000:1.0:1777051351.663718:0:6585:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da4384e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:8492:x1863365452581888:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1777051351.663819:0:6585:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da4384e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:8492:x1863365452581888:12345-0@lo:1000:mdt00_003.0 Request processed in 101us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051351.663831:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8078 00000100:00100000:2.0:1777051351.663882:0:8492:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da4384ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8492:1863365452581888:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1777051351.663942:0:8492:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da4384ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8492:1863365452582016:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1777051351.663982:0:8492:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051351.664016:0:8492:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d955a450c0 going to sleep for 11 seconds 00000100:00100000:1.0:1777051351.664065:0:6584:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452582016 00000100:00100000:1.0:1777051351.664074:0:6584:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452582016 00000100:00100000:1.0:1777051351.664129:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8079 00000100:00100000:1.0:1777051351.664142:0:6584:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da4384fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:8492:x1863365452582016:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1777051351.664329:0:6584:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da4384fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:8492:x1863365452582016:12345-0@lo:1000:mdt00_003.0 Request processed in 187us (343us total) trans 0 rc -2/-2 00000100:00100000:1.0:1777051351.664346:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8079 00000100:00100000:2.0:1777051351.664369:0:8492:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da4384ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8492:1863365452582016:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1777051351.664461:0:8492:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da4384ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8492:1863365452582144:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1777051351.664497:0:8492:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051351.664536:0:8492:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da6fddff00 going to sleep for 11 seconds 00000100:00100000:1.0:1777051351.664612:0:46498:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452582144 00000100:00100000:1.0:1777051351.664621:0:46498:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452582144 00000100:00100000:1.0:1777051351.664675:0:46498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8080 00000100:00100000:1.0:1777051351.664690:0:46498:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da4384d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+7:8492:x1863365452582144:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1777051351.664793:0:46498:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da4384d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+7:8492:x1863365452582144:12345-0@lo:1000:mdt00_003.0 Request processed in 105us (292us total) trans 0 rc -2/-2 00000100:00100000:1.0:1777051351.664806:0:46498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8080 00000100:00100000:2.0:1777051351.664948:0:8492:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da4384ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8492:1863365452582144:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1777051351.665013:0:8492:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da4384ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8492:1863365452582272:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1777051351.665040:0:8492:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051351.665070:0:8492:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d941bdd540 going to sleep for 11 seconds 00000100:00100000:0.0:1777051351.665670:0:46500:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452582272 00000100:00100000:0.0:1777051351.665679:0:46500:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452582272 00000100:00100000:0.0:1777051351.665733:0:46500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8081 00000100:00100000:0.0:1777051351.665745:0:46500:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da4384df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+7:8492:x1863365452582272:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1777051351.665841:0:46500:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da4384df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+7:8492:x1863365452582272:12345-0@lo:1000:mdt00_003.0 Request processed in 97us (797us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051351.665852:0:46500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8081 00000100:00100000:2.0:1777051351.666233:0:8492:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da4384ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8492:1863365452582272:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1777051351.666317:0:8492:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da4384ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8492:1863365452582400:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1777051351.666345:0:8492:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051351.666373:0:8492:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d955a450c0 going to sleep for 11 seconds 00000100:00100000:0.0:1777051351.666439:0:47208:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452582400 00000100:00100000:0.0:1777051351.666448:0:47208:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452582400 00000100:00100000:0.0:1777051351.666500:0:47208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8082 00000100:00100000:0.0:1777051351.666510:0:47208:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da4384ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+7:8492:x1863365452582400:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1777051351.666604:0:47208:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da4384ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+7:8492:x1863365452582400:12345-0@lo:1000:mdt00_003.0 Request processed in 94us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051351.666615:0:47208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8082 00000100:00100000:2.0:1777051351.666994:0:8492:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da4384ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8492:1863365452582400:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1777051351.667139:0:8492:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da4384ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8492:1863365452582528:0@lo:700:mdt00_003.0 00000100:00100000:2.0:1777051351.667212:0:8492:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051351.667244:0:8492:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da50ee2600 going to sleep for 11 seconds 00000100:00100000:0.0:1777051351.667304:0:6589:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452582528 00000100:00100000:0.0:1777051351.667312:0:6589:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452582528 00000100:00100000:0.0:1777051351.667357:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1777051351.667368:0:6589:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d944070a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:lustre-MDT0001-mdtlov_UUID+7:8492:x1863365452582528:12345-0@lo:700:mdt00_003.0 00000100:00100000:0.0:1777051351.667467:0:6589:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d944070a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:lustre-MDT0001-mdtlov_UUID+7:8492:x1863365452582528:12345-0@lo:700:mdt00_003.0 Request processed in 99us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051351.667478:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1777051351.667535:0:8492:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da4384ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8492:1863365452582528:0@lo:700:mdt00_003.0 00000040:00080000:3.0:1777051351.667670:0:8492:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1777051351.667698:0:8492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000401:0x1:0x0].3, 64 off32960 00000004:00080000:3.0:1777051351.667709:0:8492:0:(osp_trans.c:1582:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff99da7d7ac0c0 with version 5 00000004:00080000:0.0:1777051351.667769:0:104211:0:(osp_trans.c:1330:osp_get_next_request()) ou ffff99d9596fa9c0 version 5 rpc_version 5 00000020:00100000:0.0:1777051351.667800:0:104211:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1777051351.667815:0:104211:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff99da5f824380 x1863365452582784/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1312/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000040:00080000:3.0:1777051351.667838:0:8492:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1777051351.667857:0:8492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000401:0x1:0x0].4, 64 off33024 00000100:00100000:0.0:1777051351.667865:0:104211:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f824380 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:104211:1863365452582784:0@lo:1000:osp_up0-1.0 00000004:00080000:3.0:1777051351.667865:0:8492:0:(osp_trans.c:1582:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff99da6fdb6cc0 with version 6 00000100:00100000:0.0:1777051351.667926:0:104211:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051351.667961:0:104211:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d95361f6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1777051351.668043:0:11727:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452582784 00000100:00100000:1.0:1777051351.668053:0:11727:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452582784 00000100:00100000:1.0:1777051351.668114:0:11727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8083 00000100:00100000:1.0:1777051351.668130:0:11727:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f825180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:104211:x1863365452582784:12345-0@lo:1000:osp_up0-1.0 00000040:00080000:3.0:1777051351.671388:0:8492:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1777051351.672121:0:8492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000400:0x1:0x0].2, 64 off32896 00000040:00080000:3.0:1777051351.672660:0:8492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000bd0:0x1:0x0].1, 1080 off33848 00000040:00080000:3.0:1777051351.672819:0:8492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2000032e1:0x1:0x0].1, 1224 off33992 00000004:00080000:3.0:1777051351.672832:0:8492:0:(osp_trans.c:1582:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff99d941bdd540 with version 7 00000001:00080000:3.0:1777051351.680679:0:103159:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771084 is committed 00000100:00100000:1.0:1777051351.680933:0:11727:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f825180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:104211:x1863365452582784:12345-0@lo:1000:osp_up0-1.0 Request processed in 12801us (13000us total) trans 30064771084 rc 0/0 00000100:00100000:1.0:1777051351.680955:0:11727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8083 00000004:00080000:0.0:1777051351.681024:0:104211:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 30064771084 committed transno 30064771084 00000100:00100000:0.0:1777051351.681054:0:104211:0:(client.c:3101:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 30064771084 gen 2 00000100:00100000:0.0:1777051351.681091:0:104211:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f824380 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:104211:1863365452582784:0@lo:1000:osp_up0-1.0 00000004:00080000:0.0:1777051351.681133:0:104211:0:(osp_trans.c:1330:osp_get_next_request()) ou ffff99d9596fa9c0 version 6 rpc_version 6 00000020:00100000:0.0:1777051351.681168:0:104211:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1777051351.681267:0:104211:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff99da5f824380 x1863365452583040/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1312/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1777051351.681308:0:104211:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f824380 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:104211:1863365452583040:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1777051351.681368:0:104211:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051351.681413:0:104211:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d95361f6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1777051351.681489:0:6585:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452583040 00000100:00100000:1.0:1777051351.681502:0:6585:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452583040 00000100:00100000:1.0:1777051351.681569:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8084 00000100:00100000:1.0:1777051351.681584:0:6585:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f826680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:104211:x1863365452583040:12345-0@lo:1000:osp_up0-1.0 00000001:00080000:3.0:1777051351.690282:0:103159:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771085 is committed 00000100:00100000:1.0:1777051351.693058:0:6585:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f826680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:104211:x1863365452583040:12345-0@lo:1000:osp_up0-1.0 Request processed in 11473us (11686us total) trans 30064771085 rc 0/0 00000100:00100000:1.0:1777051351.693076:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8084 00000004:00080000:0.0:1777051351.693157:0:104211:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 30064771085 committed transno 30064771085 00000100:00100000:0.0:1777051351.693165:0:104211:0:(client.c:3101:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 30064771085 gen 2 00000100:00100000:0.0:1777051351.693266:0:104211:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f824380 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:104211:1863365452583040:0@lo:1000:osp_up0-1.0 00000004:00080000:0.0:1777051351.693304:0:104211:0:(osp_trans.c:1330:osp_get_next_request()) ou ffff99d9596fa9c0 version 7 rpc_version 7 00000020:00100000:0.0:1777051351.693341:0:104211:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1777051351.693352:0:104211:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff99da5f824380 x1863365452583296/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 264/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1777051351.693374:0:104211:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f824380 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:104211:1863365452583296:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1777051351.693420:0:104211:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051351.693460:0:104211:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d95361f300 going to sleep for 11 seconds 00000100:00100000:1.0:1777051351.693510:0:6584:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452583296 00000100:00100000:1.0:1777051351.693520:0:6584:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452583296 00000100:00100000:1.0:1777051351.693579:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8085 00000100:00100000:1.0:1777051351.693591:0:6584:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f824e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:104211:x1863365452583296:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1777051351.695122:0:6584:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f824e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:104211:x1863365452583296:12345-0@lo:1000:osp_up0-1.0 Request processed in 1529us (1695us total) trans 30064771086 rc 0/0 00000100:00100000:1.0:1777051351.695135:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8085 00000100:00100000:0.0:1777051351.695300:0:104211:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f824380 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:104211:1863365452583296:0@lo:1000:osp_up0-1.0 00010000:00010000:3.0:1777051351.695440:0:8492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff99d941ad7400/0x85f51a6b96715549 lrc: 3/0,1 mode: --/PW res: [0x240000404:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051351.695465:0:8492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d941ad7400/0x85f51a6b96715549 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0xe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8492 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051351.695482:0:8492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d941ad7400/0x85f51a6b96715549 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0xe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8492 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777051351.695506:0:8492:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000c23423c7 reply state 00000000d159398a transno 8589934593 ns: mdt-lustre-MDT0001_UUID lock: ffff99d941ad7400/0x85f51a6b96715549 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0xe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8492 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051351.695524:0:8492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d941ad7400/0x85f51a6b96715549 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0xe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8492 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051351.695536:0:8492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0xe:0x0].0x0 (ffff99d9413d2300) 00010000:00010000:3.0:1777051351.695541:0:8492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1777051351.695546:0:8492:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1777051351.695554:0:8492:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0xe:0x0]: returning size 4096 00000004:00080000:3.0:1777051351.695565:0:8492:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000bd2:0xd3:0x0] 00010000:00010000:3.0:1777051351.695578:0:8492:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d941ad6800/0x85f51a6b9671552d lrc: 4/0,1 mode: CW/CW res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x85f51a6b96715534 expref: -99 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051351.695592:0:8492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d941ad6800/0x85f51a6b9671552d lrc: 4/0,1 mode: CW/CW res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x85f51a6b96715534 expref: -99 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051351.695604:0:8492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d941ad6800/0x85f51a6b9671552d lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x85f51a6b96715534 expref: -99 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051351.695640:0:8492:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:3.0:1777051351.695648:0:8492:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000bd2:0xd3:0x0] 00010000:00010000:3.0:1777051351.695656:0:8492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d95d338400/0x85f51a6b9671553b lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0xd3:0x0].0xceea225b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x85f51a6b96715542 expref: -99 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051351.695668:0:8492:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d95d338400/0x85f51a6b9671553b lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xd3:0x0].0xceea225b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x85f51a6b96715542 expref: -99 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051351.695702:0:38719:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777051351.695716:0:38719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d941ad6800/0x85f51a6b9671552d lrc: 2/0,0 mode: CW/CW res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x85f51a6b96715534 expref: -99 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051351.695732:0:38719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d941ad6800 already unused, calling callback (ffffffffc177eed0) 00010000:00010000:1.0:1777051351.695991:0:38719:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d941ad6800/0x85f51a6b9671552d lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x85f51a6b96715534 expref: -99 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1777051351.696007:0:38719:0:(mdt_handler.c:3963:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d941ad6800/0x85f51a6b9671552d lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x85f51a6b96715534 expref: -99 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051351.696049:0:38719:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d941ad6800/0x85f51a6b9671552d lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x85f51a6b96715534 expref: -99 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051351.696063:0:8492:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d951fa3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+50:133438:x1863365425899136:12345-192.168.201.46@tcp:36:lfs.0 Request processed in 41412us (41611us total) trans 8589934593 rc 0/0 00010000:00010000:1.0:1777051351.696067:0:38719:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1777051351.696086:0:8492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111838 00010000:00010000:1.0:1777051351.696131:0:38719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d941ad6800/0x85f51a6b9671552d lrc: 1/0,0 mode: --/CW res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x85f51a6b96715534 expref: -99 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051351.696146:0:38719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d941ad6800/0x85f51a6b9671552d lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x85f51a6b96715534 expref: -99 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051351.696175:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051351.696260:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051351.696265:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1777051351.696280:0:3677:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1777051351.696294:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d951fa1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452583424:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1777051351.696354:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051351.696426:0:47597:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452583424 00000100:00100000:0.0:1777051351.696436:0:47597:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452583424 00000100:00100000:0.0:1777051351.696510:0:47597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13674 00000100:00100000:0.0:1777051351.696523:0:47597:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da6fd41c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+8:3677:x1863365452583424:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1777051351.696540:0:47597:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777051351.696566:0:47597:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d943eba200/0x85f51a6b96715534 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x85f51a6b9671552d expref: 8 pid: 47208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051351.696588:0:47597:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xd3:0x0].0x0 (ffff99d94e6b6b00) 00010000:00010000:0.0:1777051351.696595:0:47597:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1777051351.696643:0:47597:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da6fd41c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+7:3677:x1863365452583424:12345-0@lo:103:ldlm_bl.0 Request processed in 123us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051351.696651:0:47597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13674 00000100:00100000:1.0:1777051351.696713:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d951fa1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452583424:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1777051351.733029:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051351.733112:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051351.733154:0:6579:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425899392 00000100:00100000:0.0:1777051351.733168:0:6579:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425899392 00000100:00100000:3.0:1777051351.733248:0:10328:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425899648 00000100:00100000:3.0:1777051351.733258:0:10328:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425899648 00000100:00100000:0.0:1777051351.733317:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111839 00000100:00100000:0.0:1777051351.733337:0:6579:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d951fa1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+16:2436:x1863365425899392:12345-192.168.201.46@tcp:41:mkdir.0 00000100:00100000:3.0:1777051351.733349:0:10328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111840 00000100:00100000:3.0:1777051351.733368:0:10328:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d951fa0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+16:133442:x1863365425899648:12345-192.168.201.46@tcp:36:mkdir.0 00000004:00000024:0.0:1777051351.733388:0:6579:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4194304 pending 0 free 1441595392 avail 1295355904 00010000:00010000:3.0:1777051351.733435:0:10328:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777051351.733466:0:10328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d95d338c00/0x85f51a6b967154b6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5f5e expref: 16 pid: 46494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051351.733488:0:10328:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d9533ab000) 00010000:00010000:3.0:1777051351.733493:0:10328:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1777051351.733522:0:6579:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d951fa1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+15:2436:x1863365425899392:12345-192.168.201.46@tcp:41:mkdir.0 Request processed in 175us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051351.733542:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111839 00000100:00100000:3.0:1777051351.733613:0:10328:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d951fa0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+14:133442:x1863365425899648:12345-192.168.201.46@tcp:36:mkdir.0 Request processed in 253us (501us total) trans 0 rc -17/-17 00000100:00100000:3.0:1777051351.733621:0:10328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111840 00000100:00100000:0.0:1777051351.735471:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051351.735706:0:6580:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425899776 00000100:00100000:3.0:1777051351.735717:0:6580:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425899776 00000100:00100000:3.0:1777051351.735773:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111841 00000100:00100000:3.0:1777051351.735786:0:6580:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f825f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+14:133442:x1863365425899776:12345-192.168.201.46@tcp:101:mkdir.0 00010000:00010000:3.0:1777051351.735803:0:6580:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777051351.735827:0:6580:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7600/0x85f51a6b96715550 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b5f88 expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051351.735891:0:6580:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7c00/0x85f51a6b96715557 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051351.735910:0:6580:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7c00/0x85f51a6b96715557 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051351.735926:0:6580:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7c00/0x85f51a6b96715557 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1777051351.735977:0:6580:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 12288 00000004:00200000:3.0:1777051351.735983:0:6580:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1777051351.736011:0:6580:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7c00/0x85f51a6b96715557 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051351.736042:0:6580:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7600/0x85f51a6b96715550 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5f88 expref: 16 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051351.736065:0:6580:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7c00/0x85f51a6b96715557 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5f88 expref: 15 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051351.736078:0:6580:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d9533ab000) 00010000:00010000:3.0:1777051351.736083:0:6580:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1777051351.736087:0:6580:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d941ad7c00, rc 0) 00000100:00100000:3.0:1777051351.736142:0:6580:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f825f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+15:133442:x1863365425899776:12345-192.168.201.46@tcp:101:mkdir.0 Request processed in 358us (672us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051351.736689:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111841 00000100:00100000:1.0:1777051351.738764:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051351.738848:0:46497:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425899904 00000100:00100000:2.0:1777051351.738856:0:46497:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425899904 00000100:00100000:2.0:1777051351.738917:0:46497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111842 00000100:00100000:2.0:1777051351.738930:0:46497:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d951fa3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:c11b6966-0775-44d2-bdc6-c74c26eb2226+15:133442:x1863365425899904:12345-192.168.201.46@tcp:101:mkdir.0 00010000:00010000:2.0:1777051351.738945:0:46497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051351.738978:0:46497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d95d339a00/0x85f51a6b9671555e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b5f8f expref: -99 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.739044:0:46497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d95d338800/0x85f51a6b96715565 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.739059:0:46497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d95d338800/0x85f51a6b96715565 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.739333:0:46497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d95d338800/0x85f51a6b96715565 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.739359:0:46497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d95d339e00/0x85f51a6b9671556c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8781f5e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.739372:0:46497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d95d339e00/0x85f51a6b9671556c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8781f5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.739382:0:46497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d95d339e00/0x85f51a6b9671556c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8781f5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.739460:0:46497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da713e2e00/0x85f51a6b96715573 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.739473:0:46497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da713e2e00/0x85f51a6b96715573 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.739483:0:46497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da713e2e00/0x85f51a6b96715573 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1777051351.739513:0:46497:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0xd3:0x0]: returning size 4096 00000004:00200000:2.0:1777051351.739518:0:46497:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1777051351.739540:0:46497:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99da713e2e00/0x85f51a6b96715573 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.739553:0:46497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d95d338800/0x85f51a6b96715565 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.739559:0:46497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d95d338800/0x85f51a6b96715565 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.739566:0:46497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d95d338800/0x85f51a6b96715565 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.739572:0:46497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d95d338800 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:2.0:1777051351.739575:0:46497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d95d338800/0x85f51a6b96715565 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.739582:0:46497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d95d338800/0x85f51a6b96715565 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.739591:0:46497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d9533ab000) 00010000:00010000:2.0:1777051351.739596:0:46497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777051351.739601:0:46497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d95d338800/0x85f51a6b96715565 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.739608:0:46497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d95d338800/0x85f51a6b96715565 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.739619:0:46497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d95d339e00/0x85f51a6b9671556c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8781f5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.739625:0:46497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d95d339e00/0x85f51a6b9671556c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8781f5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.739631:0:46497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d95d339e00/0x85f51a6b9671556c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8781f5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.739636:0:46497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d95d339e00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:2.0:1777051351.739647:0:46497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d95d339e00/0x85f51a6b9671556c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8781f5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.739653:0:46497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d95d339e00/0x85f51a6b9671556c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8781f5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.739660:0:46497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8781f5e (ffff99d94e5e2d00) 00010000:00010000:2.0:1777051351.739663:0:46497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777051351.739666:0:46497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d95d339e00/0x85f51a6b9671556c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8781f5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.739671:0:46497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d95d339e00/0x85f51a6b9671556c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8781f5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.739698:0:46497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d95d339a00/0x85f51a6b9671555e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5f8f expref: 17 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.739716:0:46497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99da713e2e00/0x85f51a6b96715573 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5f8f expref: 16 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.739723:0:46497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xd3:0x0].0x0 (ffff99d94e6b6b00) 00010000:00010000:2.0:1777051351.739726:0:46497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1777051351.739728:0:46497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99da713e2e00, rc 0) 00000100:00100000:2.0:1777051351.740018:0:46497:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d951fa3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:c11b6966-0775-44d2-bdc6-c74c26eb2226+16:133442:x1863365425899904:12345-192.168.201.46@tcp:101:mkdir.0 Request processed in 847us (1014us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051351.740029:0:46497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111842 00000100:00100000:1.0:1777051351.743050:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051351.743138:0:27885:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425900160 00000100:00100000:0.0:1777051351.743146:0:27885:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425900160 00000100:00100000:0.0:1777051351.743273:0:27885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111843 00000100:00100000:0.0:1777051351.743289:0:27885:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d951fa3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c11b6966-0775-44d2-bdc6-c74c26eb2226+16:133442:x1863365425900160:12345-192.168.201.46@tcp:36:mkdir.0 00010000:00010000:0.0:1777051351.743337:0:27885:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777051351.743360:0:27885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da713e2e00/0x85f51a6b96715573 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5f8f expref: 16 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051351.743383:0:27885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xd3:0x0].0x0 (ffff99d94e6b6b00) 00010000:00010000:0.0:1777051351.743389:0:27885:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1777051351.743493:0:27885:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d951fa3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c11b6966-0775-44d2-bdc6-c74c26eb2226+15:133442:x1863365425900160:12345-192.168.201.46@tcp:36:mkdir.0 Request processed in 206us (446us total) trans 0 rc -17/-17 00000100:00100000:0.0:1777051351.743505:0:27885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111843 00000100:00100000:0.0:1777051351.745359:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051351.745430:0:27882:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425900288 00000100:00100000:2.0:1777051351.745438:0:27882:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425900288 00000100:00100000:2.0:1777051351.745492:0:27882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111844 00000100:00100000:2.0:1777051351.745505:0:27882:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f824000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+15:133442:x1863365425900288:12345-192.168.201.46@tcp:101:mkdir.0 00010000:00010000:2.0:1777051351.745528:0:27882:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051351.745568:0:27882:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d955a90400/0x85f51a6b9671557a lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b5f96 expref: -99 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.745645:0:27882:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d785400/0x85f51a6b96715581 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.745664:0:27882:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d785400/0x85f51a6b96715581 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.745678:0:27882:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d785400/0x85f51a6b96715581 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.745699:0:27882:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784a00/0x85f51a6b96715588 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xd3:0x0].0xac1bda01 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.745711:0:27882:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784a00/0x85f51a6b96715588 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xd3:0x0].0xac1bda01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.745721:0:27882:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784a00/0x85f51a6b96715588 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xd3:0x0].0xac1bda01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.745785:0:27882:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d785a00/0x85f51a6b9671558f lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xd4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.745798:0:27882:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d785a00/0x85f51a6b9671558f lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xd4:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.745816:0:27882:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d785a00/0x85f51a6b9671558f lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xd4:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1777051351.745856:0:27882:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0xd4:0x0]: returning size 4096 00000004:00200000:2.0:1777051351.745861:0:27882:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1777051351.745881:0:27882:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d785a00/0x85f51a6b9671558f lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xd4:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.745897:0:27882:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d785400/0x85f51a6b96715581 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.745907:0:27882:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d785400/0x85f51a6b96715581 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.745915:0:27882:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d785400/0x85f51a6b96715581 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.745924:0:27882:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d785400/0x85f51a6b96715581 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.745939:0:27882:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da7d785400 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:2.0:1777051351.745944:0:27882:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d785400/0x85f51a6b96715581 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.745954:0:27882:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d785400/0x85f51a6b96715581 lrc: 5/0,0 mode: CR/CR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.745967:0:27882:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xd3:0x0].0x0 (ffff99d94e6b6b00) 00010000:00010000:2.0:1777051351.745971:0:27882:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777051351.745976:0:27882:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d785400/0x85f51a6b96715581 lrc: 3/0,0 mode: --/CR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.745984:0:27882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d785400/0x85f51a6b96715581 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.746002:0:27882:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784a00/0x85f51a6b96715588 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xd3:0x0].0xac1bda01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.746011:0:27882:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784a00/0x85f51a6b96715588 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0xd3:0x0].0xac1bda01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.746020:0:27882:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784a00/0x85f51a6b96715588 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xd3:0x0].0xac1bda01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.746029:0:27882:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da7d784a00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:2.0:1777051351.746033:0:27882:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784a00/0x85f51a6b96715588 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xd3:0x0].0xac1bda01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.746042:0:27882:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784a00/0x85f51a6b96715588 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0xd3:0x0].0xac1bda01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.746060:0:27882:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xd3:0x0].0xac1bda01 (ffff99d94e5e2b00) 00010000:00010000:2.0:1777051351.746064:0:27882:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777051351.746068:0:27882:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784a00/0x85f51a6b96715588 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0xd3:0x0].0xac1bda01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.746077:0:27882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784a00/0x85f51a6b96715588 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xd3:0x0].0xac1bda01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.746115:0:27882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d955a90400/0x85f51a6b9671557a lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5f96 expref: 17 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.746133:0:27882:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d785a00/0x85f51a6b9671558f lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xd4:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5f96 expref: 16 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.746141:0:27882:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xd4:0x0].0x0 (ffff99d94e5e2600) 00010000:00010000:2.0:1777051351.746143:0:27882:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1777051351.746146:0:27882:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99da7d785a00, rc 0) 00000100:00100000:2.0:1777051351.746336:0:27882:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f824000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+16:133442:x1863365425900288:12345-192.168.201.46@tcp:101:mkdir.0 Request processed in 831us (979us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051351.746348:0:27882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111844 00000100:00100000:1.0:1777051351.754760:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051351.754845:0:6579:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425900416 00000100:00100000:0.0:1777051351.754856:0:6579:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425900416 00000100:00100000:0.0:1777051351.754955:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111845 00000100:00100000:0.0:1777051351.754998:0:6579:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d951fa2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+16:133443:x1863365425900416:12345-192.168.201.46@tcp:101:rm.0 00010000:00010000:0.0:1777051351.755024:0:6579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051351.755050:0:6579:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da40030400/0x85f51a6b96715596 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b5f9d expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051351.755130:0:6579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da40030c00/0x85f51a6b9671559d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051351.755150:0:6579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da40030c00/0x85f51a6b9671559d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051351.755166:0:6579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da40030c00/0x85f51a6b9671559d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051351.755432:0:6579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da40031600/0x85f51a6b967155a4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8781f5e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051351.755446:0:6579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da40031600/0x85f51a6b967155a4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8781f5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051351.755459:0:6579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da40031600/0x85f51a6b967155a4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8781f5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051351.755555:0:6579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da40030000/0x85f51a6b967155ab lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051351.755571:0:6579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da40030000/0x85f51a6b967155ab lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051351.755583:0:6579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da40030000/0x85f51a6b967155ab lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1777051351.755624:0:6579:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0xd3:0x0]: returning size 4096 00000004:00200000:0.0:1777051351.755629:0:6579:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1777051351.755676:0:6579:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99da40030000/0x85f51a6b967155ab lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051351.755694:0:6579:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da40030c00/0x85f51a6b9671559d lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051351.755705:0:6579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da40030c00/0x85f51a6b9671559d lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051351.755716:0:6579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99da40030c00/0x85f51a6b9671559d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051351.755726:0:6579:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99da40030c00/0x85f51a6b9671559d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051351.755736:0:6579:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da40030c00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:0.0:1777051351.755742:0:6579:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da40030c00/0x85f51a6b9671559d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051351.755752:0:6579:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da40030c00/0x85f51a6b9671559d lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051351.755768:0:6579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d9533ab000) 00010000:00010000:0.0:1777051351.755771:0:6579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777051351.755776:0:6579:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99da40030c00/0x85f51a6b9671559d lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051351.755783:0:6579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da40030c00/0x85f51a6b9671559d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051351.755799:0:6579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da40031600/0x85f51a6b967155a4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8781f5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051351.755808:0:6579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99da40031600/0x85f51a6b967155a4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8781f5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051351.755816:0:6579:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99da40031600/0x85f51a6b967155a4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8781f5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051351.755825:0:6579:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da40031600 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:0.0:1777051351.755828:0:6579:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da40031600/0x85f51a6b967155a4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8781f5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051351.755837:0:6579:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da40031600/0x85f51a6b967155a4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8781f5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051351.755848:0:6579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8781f5e (ffff99d943f76500) 00010000:00010000:0.0:1777051351.755852:0:6579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777051351.755856:0:6579:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99da40031600/0x85f51a6b967155a4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8781f5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051351.755866:0:6579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da40031600/0x85f51a6b967155a4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8781f5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051351.755908:0:6579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da40030400/0x85f51a6b96715596 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5f9d expref: 18 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051351.755937:0:6579:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99da40030000/0x85f51a6b967155ab lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5f9d expref: 17 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051351.755947:0:6579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xd3:0x0].0x0 (ffff99d94e6b6b00) 00010000:00010000:0.0:1777051351.755951:0:6579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1777051351.755955:0:6579:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99da40030000, rc 0) 00000100:00100000:0.0:1777051351.756052:0:6579:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d951fa2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+17:133443:x1863365425900416:12345-192.168.201.46@tcp:101:rm.0 Request processed in 1058us (1301us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051351.756065:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111845 00000100:00100000:1.0:1777051351.761547:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051351.761641:0:46494:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425900544 00000100:00100000:2.0:1777051351.761652:0:46494:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425900544 00000100:00100000:2.0:1777051351.761716:0:46494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111846 00000100:00100000:2.0:1777051351.761731:0:46494:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d951fa0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c11b6966-0775-44d2-bdc6-c74c26eb2226+17:133443:x1863365425900544:12345-192.168.201.46@tcp:101:rm.0 00010000:00010000:2.0:1777051351.761749:0:46494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051351.761769:0:46494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784a00/0x85f51a6b967155b2 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0xd4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b5fa4 expref: -99 pid: 46494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.761848:0:46494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d785400/0x85f51a6b967155b9 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0xd4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.761867:0:46494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d785400/0x85f51a6b967155b9 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0xd4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.761883:0:46494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d785400/0x85f51a6b967155b9 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0xd4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.761901:0:46494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784e00/0x85f51a6b967155c0 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xd4:0x0].0x674069f9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.761913:0:46494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784e00/0x85f51a6b967155c0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xd4:0x0].0x674069f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.761926:0:46494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784e00/0x85f51a6b967155c0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xd4:0x0].0x674069f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.761976:0:46494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d785400/0x85f51a6b967155b9 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0xd4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.761988:0:46494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d785400/0x85f51a6b967155b9 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0xd4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.761999:0:46494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d785400/0x85f51a6b967155b9 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0xd4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.762008:0:46494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da7d785400 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:2.0:1777051351.762014:0:46494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d785400/0x85f51a6b967155b9 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0xd4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.762032:0:46494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d785400/0x85f51a6b967155b9 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0xd4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.762048:0:46494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xd4:0x0].0x0 (ffff99d94e5e2600) 00010000:00010000:2.0:1777051351.762052:0:46494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777051351.762058:0:46494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d785400/0x85f51a6b967155b9 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0xd4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.762067:0:46494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d785400/0x85f51a6b967155b9 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0xd4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.762088:0:46494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784e00/0x85f51a6b967155c0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xd4:0x0].0x674069f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.762099:0:46494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784e00/0x85f51a6b967155c0 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0xd4:0x0].0x674069f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.762109:0:46494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784e00/0x85f51a6b967155c0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xd4:0x0].0x674069f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.762130:0:46494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da7d784e00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:2.0:1777051351.762134:0:46494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784e00/0x85f51a6b967155c0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xd4:0x0].0x674069f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.762144:0:46494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784e00/0x85f51a6b967155c0 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0xd4:0x0].0x674069f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.762156:0:46494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xd4:0x0].0x674069f9 (ffff99d94e5e2b00) 00010000:00010000:2.0:1777051351.762160:0:46494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777051351.762164:0:46494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784e00/0x85f51a6b967155c0 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0xd4:0x0].0x674069f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.762175:0:46494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784e00/0x85f51a6b967155c0 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xd4:0x0].0x674069f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.762297:0:46494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784a00/0x85f51a6b967155b2 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0xd4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5fa4 expref: 18 pid: 46494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.762314:0:46494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xd4:0x0].0x0 (ffff99d94e5e2600) 00010000:00010000:2.0:1777051351.762317:0:46494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777051351.762323:0:46494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784a00/0x85f51a6b967155b2 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0xd4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5fa4 expref: 18 pid: 46494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.762337:0:46494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99da7d784a00, rc 0) 00000100:00100000:2.0:1777051351.762400:0:46494:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d951fa0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c11b6966-0775-44d2-bdc6-c74c26eb2226+17:133443:x1863365425900544:12345-192.168.201.46@tcp:101:rm.0 Request processed in 672us (857us total) trans 0 rc 301/301 00000100:00100000:2.0:1777051351.762425:0:46494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111846 00000100:00100000:3.0:1777051351.772915:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051351.773037:0:6581:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425900800 00000100:00100000:1.0:1777051351.773049:0:6581:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425900800 00000100:00100000:1.0:1777051351.773123:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111847 00000100:00100000:1.0:1777051351.773137:0:6581:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94e624700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+17:133444:x1863365425900800:12345-192.168.201.46@tcp:101:dd.0 00010000:00010000:1.0:1777051351.773160:0:6581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777051351.773165:0:6581:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1777051351.773265:0:6581:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d785a00/0x85f51a6b9671558f lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xd4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5f96 expref: 17 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051351.773304:0:6581:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xd4:0x0].0x0 (ffff99d94e5e2600) 00010000:00010000:1.0:1777051351.773318:0:6581:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1777051351.773340:0:6581:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d943eba600/0x85f51a6b967155c7 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0xd4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b5fab expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051351.773456:0:6581:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d943eba000/0x85f51a6b967155ce lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0xd4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051351.773473:0:6581:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d943eba000/0x85f51a6b967155ce lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0xd4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051351.773485:0:6581:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d943eba000/0x85f51a6b967155ce lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0xd4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051351.773502:0:6581:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d943eba200/0x85f51a6b967155d5 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0xd4:0x0].0x674069f9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051351.773520:0:6581:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d943eba200/0x85f51a6b967155d5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xd4:0x0].0x674069f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051351.773528:0:6581:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d943eba200/0x85f51a6b967155d5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xd4:0x0].0x674069f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1777051351.775347:0:6581:0:(osp_internal.h:570:osp_update_last_fid()) Gap in objids: start=[0x280000401:0x15f:0x0], count =131 00000004:00080000:1.0:1777051351.775359:0:6581:0:(osp_object.c:1640:osp_create()) Writing gap [0x280000401:0x15f:0x0]+131 in llog 00000004:00080000:1.0:1777051351.775405:0:6581:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x1e2:0x0], index 0: 0 00010000:00010000:1.0:1777051351.775643:0:6581:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d943ebbc00/0x85f51a6b967155dc lrc: 3/1,0 mode: --/PR res: [0x200000bd3:0xc2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051351.775659:0:6581:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d943ebbc00/0x85f51a6b967155dc lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0xc2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051351.775673:0:6581:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d943ebbc00/0x85f51a6b967155dc lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0xc2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051351.775716:0:6581:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d943eba000/0x85f51a6b967155ce lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0xd4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051351.775727:0:6581:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d943eba000/0x85f51a6b967155ce lrc: 2/0,0 mode: CW/CW res: [0x200000bd2:0xd4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051351.775736:0:6581:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d943eba000/0x85f51a6b967155ce lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0xd4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051351.775746:0:6581:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d943eba000 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:1.0:1777051351.775752:0:6581:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d943eba000/0x85f51a6b967155ce lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0xd4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051351.775771:0:6581:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d943eba000/0x85f51a6b967155ce lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0xd4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051351.775782:0:6581:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xd4:0x0].0x0 (ffff99d94e6b6600) 00010000:00010000:1.0:1777051351.775785:0:6581:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777051351.775790:0:6581:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d943eba000/0x85f51a6b967155ce lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0xd4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051351.775796:0:6581:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d943eba000/0x85f51a6b967155ce lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0xd4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1777051351.775808:0:6581:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000df24549f reply state 00000000e331b068 transno 30064771087 ns: mdt-lustre-MDT0000_UUID lock: ffff99d943eba200/0x85f51a6b967155d5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xd4:0x0].0x674069f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051351.775819:0:6581:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d943eba200/0x85f51a6b967155d5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0xd4:0x0].0x674069f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051351.775826:0:6581:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xd4:0x0].0x674069f9 (ffff99d94e6b6d00) 00010000:00010000:1.0:1777051351.775828:0:6581:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1777051351.775831:0:6581:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1777051351.775862:0:6581:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d943eba600/0x85f51a6b967155c7 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0xd4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5fab expref: 19 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051351.775880:0:6581:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d943ebbc00/0x85f51a6b967155dc lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0xc2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5fab expref: 18 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051351.775888:0:6581:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0xc2:0x0].0x0 (ffff99d94e6b6500) 00010000:00010000:1.0:1777051351.775890:0:6581:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1777051351.775892:0:6581:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d943ebbc00, rc 0) 00000100:00100000:1.0:1777051351.775968:0:6581:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94e624700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+19:133444:x1863365425900800:12345-192.168.201.46@tcp:101:dd.0 Request processed in 2833us (3059us total) trans 30064771087 rc 0/0 00000100:00100000:1.0:1777051351.775981:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111847 00000100:00100000:1.0:1777051351.809071:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051351.809637:0:55805:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425900928 00000100:00100000:3.0:1777051351.809650:0:55805:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425900928 00000100:00080000:2.0:1777051351.809747:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1777051351.810049:0:55805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 7962 00000100:00100000:3.0:1777051351.810475:0:55805:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d951fa1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c11b6966-0775-44d2-bdc6-c74c26eb2226+50:133444:x1863365425900928:12345-192.168.201.46@tcp:101:dd.0 00010000:00010000:3.0:1777051351.810497:0:55805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777051351.810520:0:55805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b2b12361/0x85f51a6b967155ea lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1e2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b5fb2 expref: -99 pid: 55805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1777051351.810549:0:55805:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x1e2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777051351.810570:0:55805:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051351.810573:0:55805:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051351.810582:0:55805:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b2b12361/0x85f51a6b967155ea lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5fb2 expref: 51 pid: 55805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051351.810601:0:55805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b2b12361/0x85f51a6b967155ea lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5fb2 expref: 51 pid: 55805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051351.810615:0:55805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d941ad7600, rc 0) 00000100:00100000:3.0:1777051351.811035:0:55805:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d951fa1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c11b6966-0775-44d2-bdc6-c74c26eb2226+51:133444:x1863365425900928:12345-192.168.201.46@tcp:101:dd.0 Request processed in 968us (1972us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051351.811049:0:55805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 7962 00000100:00100000:3.0:1777051351.837672:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051351.837791:0:46205:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425901056 00000100:00100000:0.0:1777051351.837806:0:46205:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425901056 00002000:00100000:0.0:1777051351.837869:0:46205:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x1e2:0x0] (0->1048575) req@ffff99d94e625f80 x1863365425901056/t0(0) o4->c11b6966-0775-44d2-bdc6-c74c26eb2226@192.168.201.46@tcp:312/0 lens 488/0 e 0 to 0 dl 1777051362 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1777051351.837889:0:46205:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99d94e625f80 with x1863365425901056 ext(0->1048575) 00002000:00010000:0.0:1777051351.837897:0:46205:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99d94e625f80 00000100:00100000:0.0:1777051351.838053:0:46205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 1758 00000100:00100000:0.0:1777051351.838071:0:46205:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94e625f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:c11b6966-0775-44d2-bdc6-c74c26eb2226+51:2437:x1863365425901056:12345-192.168.201.46@tcp:4:dd.0 00000100:00100000:0.0:1777051351.861036:0:46205:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94e625f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:c11b6966-0775-44d2-bdc6-c74c26eb2226+53:2437:x1863365425901056:12345-192.168.201.46@tcp:4:dd.0 Request processed in 22959us (23365us total) trans 4294968350 rc 0/0 00000100:00100000:0.0:1777051351.861558:0:46205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 1758 00002000:00100000:0.0:1777051351.861579:0:46205:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x1e2:0x0] (0->1048575) req@ffff99d94e625f80 x1863365425901056/t4294968350(0) o4->c11b6966-0775-44d2-bdc6-c74c26eb2226@192.168.201.46@tcp:312/0 lens 488/448 e 0 to 0 dl 1777051362 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1777051351.861596:0:46205:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99d94e625f80 with x1863365425901056 ext(0->1048575) 00002000:00010000:0.0:1777051351.861606:0:46205:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99d94e625f80 00000100:00100000:3.0:1777051351.864163:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051351.864305:0:8492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425901184 00000100:00100000:2.0:1777051351.864318:0:8492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425901184 00000100:00100000:2.0:1777051351.864388:0:8492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111848 00000100:00100000:2.0:1777051351.864402:0:8492:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94e625500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+19:133444:x1863365425901184:12345-192.168.201.46@tcp:44:dd.0 00000001:00080000:0.0:1777051351.868018:0:103159:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771087 is committed 00000001:00080000:0.0:1777051351.868038:0:103159:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771086 is committed 00010000:00010000:2.0:1777051351.868038:0:3663:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99d943eba200/0x85f51a6b967155d5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0xd4:0x0].0x674069f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.868061:0:3663:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d943eba200/0x85f51a6b967155d5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd2:0xd4:0x0].0x674069f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.868075:0:3663:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d943eba200/0x85f51a6b967155d5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0xd4:0x0].0x674069f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.868088:0:3663:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d943eba200 already unused, calling callback (ffffffffc17724f0) 00000100:00100000:3.0:1777051351.868385:0:8492:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94e625500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+18:133444:x1863365425901184:12345-192.168.201.46@tcp:44:dd.0 Request processed in 3981us (4222us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051351.868401:0:8492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111848 00010000:00010000:2.0:1777051351.868689:0:3663:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d943eba200/0x85f51a6b967155d5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0xd4:0x0].0x674069f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.868710:0:3663:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d943eba200/0x85f51a6b967155d5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd2:0xd4:0x0].0x674069f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.868737:0:3663:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xd4:0x0].0x674069f9 (ffff99d94e6b6d00) 00010000:00010000:2.0:1777051351.868743:0:3663:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777051351.868749:0:3663:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d943eba200/0x85f51a6b967155d5 lrc: 2/0,0 mode: --/TXN res: [0x200000bd2:0xd4:0x0].0x674069f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.868757:0:3663:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d943eba200/0x85f51a6b967155d5 lrc: 0/0,0 mode: --/TXN res: [0x200000bd2:0xd4:0x0].0x674069f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051351.872019:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051351.872122:0:13320:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425901312 00000100:00100000:0.0:1777051351.872132:0:13320:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425901312 00000100:00100000:0.0:1777051351.872513:0:13320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 7963 00000100:00100000:0.0:1777051351.872527:0:13320:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d951fa0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+53:2436:x1863365425901312:12345-192.168.201.46@tcp:16:dd.0 00000001:00080000:3.0:1777051351.875351:0:8464:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0000: transno 4294968350 is committed 00000100:00100000:0.0:1777051351.875541:0:13320:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d951fa0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+51:2436:x1863365425901312:12345-192.168.201.46@tcp:16:dd.0 Request processed in 3013us (3524us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051351.875555:0:13320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 7963 00000100:00100000:1.0:1777051351.877749:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051351.877841:0:46501:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425901568 00000100:00100000:2.0:1777051351.877849:0:46501:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425901568 00000100:00100000:2.0:1777051351.877910:0:46501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3322 00000100:00100000:2.0:1777051351.877924:0:46501:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7b5e5450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+17:133444:x1863365425901568:12345-192.168.201.46@tcp:35:dd.0 00000100:00100000:2.0:1777051351.878617:0:46501:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7b5e5450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+18:133444:x1863365425901568:12345-192.168.201.46@tcp:35:dd.0 Request processed in 693us (866us total) trans 30064771088 rc 0/0 00000100:00100000:2.0:1777051351.878649:0:46501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3322 00000100:00100000:0.0:1777051351.899725:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051351.899845:0:21368:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425901696 00000100:00100000:1.0:1777051351.899859:0:21368:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425901696 00000100:00100000:1.0:1777051351.899924:0:21368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111849 00000100:00100000:1.0:1777051351.899936:0:21368:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f825c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+18:133445:x1863365425901696:12345-192.168.201.46@tcp:101:lfs.0 00010000:00010000:1.0:1777051351.899962:0:21368:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777051351.899985:0:21368:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d943ebac00/0x85f51a6b967155f1 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b5fb9 expref: -99 pid: 21368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051351.900051:0:21368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d943eba200/0x85f51a6b967155f8 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051351.900066:0:21368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d943eba200/0x85f51a6b967155f8 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051351.900079:0:21368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d943eba200/0x85f51a6b967155f8 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051351.900092:0:21368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d943ebbe00/0x85f51a6b967155ff lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xd3:0x0].0xac1bda01 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051351.900099:0:21368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d943ebbe00/0x85f51a6b967155ff lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xd3:0x0].0xac1bda01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051351.900108:0:21368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d943ebbe00/0x85f51a6b967155ff lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xd3:0x0].0xac1bda01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051351.900567:0:21368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d943ebaa00/0x85f51a6b96715606 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xd4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051351.900583:0:21368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d943ebaa00/0x85f51a6b96715606 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xd4:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051351.900595:0:21368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d943ebaa00/0x85f51a6b96715606 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xd4:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1777051351.900641:0:21368:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0xd4:0x0]: returning size 4096 00000004:00200000:1.0:1777051351.900649:0:21368:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1777051351.900677:0:21368:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99d943ebaa00/0x85f51a6b96715606 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xd4:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051351.900695:0:21368:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d943eba200/0x85f51a6b967155f8 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051351.900706:0:21368:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d943eba200/0x85f51a6b967155f8 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051351.900718:0:21368:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d943eba200/0x85f51a6b967155f8 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051351.900728:0:21368:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d943eba200 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:1.0:1777051351.900734:0:21368:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d943eba200/0x85f51a6b967155f8 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051351.900745:0:21368:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d943eba200/0x85f51a6b967155f8 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051351.900761:0:21368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xd3:0x0].0x0 (ffff99d94e6b6b00) 00010000:00010000:1.0:1777051351.900766:0:21368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777051351.900773:0:21368:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d943eba200/0x85f51a6b967155f8 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051351.900782:0:21368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d943eba200/0x85f51a6b967155f8 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051351.900798:0:21368:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d943ebbe00/0x85f51a6b967155ff lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xd3:0x0].0xac1bda01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051351.900808:0:21368:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d943ebbe00/0x85f51a6b967155ff lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0xd3:0x0].0xac1bda01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051351.900818:0:21368:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d943ebbe00/0x85f51a6b967155ff lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xd3:0x0].0xac1bda01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051351.900827:0:21368:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d943ebbe00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:1.0:1777051351.900831:0:21368:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d943ebbe00/0x85f51a6b967155ff lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xd3:0x0].0xac1bda01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051351.900838:0:21368:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d943ebbe00/0x85f51a6b967155ff lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0xd3:0x0].0xac1bda01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051351.900845:0:21368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xd3:0x0].0xac1bda01 (ffff99d94e6b6600) 00010000:00010000:1.0:1777051351.900848:0:21368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777051351.900851:0:21368:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d943ebbe00/0x85f51a6b967155ff lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0xd3:0x0].0xac1bda01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051351.900856:0:21368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d943ebbe00/0x85f51a6b967155ff lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xd3:0x0].0xac1bda01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051351.901531:0:21368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d943ebac00/0x85f51a6b967155f1 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5fb9 expref: 20 pid: 21368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051351.901556:0:21368:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d943ebaa00/0x85f51a6b96715606 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xd4:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5fb9 expref: 19 pid: 21368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051351.901568:0:21368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xd4:0x0].0x0 (ffff99d94e6b6100) 00010000:00010000:1.0:1777051351.901572:0:21368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1777051351.901576:0:21368:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d943ebaa00, rc 0) 00000100:00100000:1.0:1777051351.901657:0:21368:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f825c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+19:133445:x1863365425901696:12345-192.168.201.46@tcp:101:lfs.0 Request processed in 1722us (1942us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051351.901669:0:21368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111849 00000100:00100000:1.0:1777051351.946498:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051351.947011:0:10328:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425901952 00000100:00100000:3.0:1777051351.947027:0:10328:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425901952 00000100:00100000:3.0:1777051351.947125:0:10328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111850 00000100:00100000:3.0:1777051351.947458:0:10328:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d951fa2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+19:133450:x1863365425901952:12345-192.168.201.46@tcp:36:mkdir.0 00000100:00100000:3.0:1777051351.947678:0:10328:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d951fa2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+19:133450:x1863365425901952:12345-192.168.201.46@tcp:36:mkdir.0 Request processed in 539us (1225us total) trans 0 rc -17/-17 00000100:00100000:3.0:1777051351.947691:0:10328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111850 00000100:00100000:0.0:1777051351.951788:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051351.951897:0:6580:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425902080 00000100:00100000:3.0:1777051351.951907:0:6580:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425902080 00000100:00100000:3.0:1777051351.951974:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111851 00000100:00100000:3.0:1777051351.951989:0:6580:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d956129500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+19:133450:x1863365425902080:12345-192.168.201.46@tcp:101:mkdir.0 00010000:00010000:3.0:1777051351.952010:0:6580:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777051351.952038:0:6580:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7a00/0x85f51a6b9671560d lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b5fc0 expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051351.952115:0:6580:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6c00/0x85f51a6b96715614 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051351.952136:0:6580:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6c00/0x85f51a6b96715614 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051351.952155:0:6580:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6c00/0x85f51a6b96715614 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051351.952171:0:6580:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6200/0x85f51a6b9671561b lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xd3:0x0].0xceea225b bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051351.952282:0:6580:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99d943ebb800/0x85f51a6b96715542 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0xd3:0x0].0xceea225b bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b9671553b expref: 5 pid: 11727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051351.952296:0:6580:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6200/0x85f51a6b9671561b lrc: 4/1,0 mode: --/PR res: [0x200000bd2:0xd3:0x0].0xceea225b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051351.952344:0:6580:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99d943ebb800/0x85f51a6b96715542 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xd3:0x0].0xceea225b bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x85f51a6b9671553b expref: 5 pid: 11727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051351.952368:0:6580:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94e625880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6580:1863365452583552:0@lo:104: 00000100:00100000:3.0:1777051351.952426:0:6580:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051351.952505:0:6580:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da70bc9a80 going to sleep for 11 seconds 00000100:00100000:0.0:1777051351.952641:0:99220:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452583552 00000100:00100000:0.0:1777051351.952932:0:99220:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452583552 00000100:00100000:0.0:1777051351.953001:0:99220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1777051351.953013:0:99220:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da4384ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:6580:x1863365452583552:12345-0@lo:104: 00010000:00010000:0.0:1777051351.953031:0:99220:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d95d338400/0x85f51a6b9671553b lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xd3:0x0].0xceea225b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x85f51a6b96715542 expref: -99 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051351.953122:0:99220:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1777051351.953131:0:99220:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da4384ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:6580:x1863365452583552:12345-0@lo:104: Request processed in 121us (705us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051351.953142:0:99220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00010000:00010000:2.0:1777051351.953254:0:6567:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777051351.953267:0:6567:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d95d338400/0x85f51a6b9671553b lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xd3:0x0].0xceea225b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x85f51a6b96715542 expref: -99 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.953283:0:6567:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d95d338400 already unused, calling callback (ffffffffc177eed0) 00010000:00010000:2.0:1777051351.953292:0:6567:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d95d338400/0x85f51a6b9671553b lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0xd3:0x0].0xceea225b bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0x85f51a6b96715542 expref: -99 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1777051351.953317:0:6567:0:(mdt_handler.c:3963:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d95d338400/0x85f51a6b9671553b lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0xd3:0x0].0xceea225b bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0x85f51a6b96715542 expref: -99 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.953355:0:6567:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d95d338400/0x85f51a6b9671553b lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0xd3:0x0].0xceea225b bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x85f51a6b96715542 expref: -99 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.953364:0:6567:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1777051351.953410:0:6567:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d95d338400/0x85f51a6b9671553b lrc: 1/0,0 mode: --/PW res: [0x200000bd2:0xd3:0x0].0xceea225b bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x85f51a6b96715542 expref: -99 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.953424:0:6567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d95d338400/0x85f51a6b9671553b lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0xd3:0x0].0xceea225b bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x85f51a6b96715542 expref: -99 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.953459:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777051351.953463:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777051351.953467:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777051351.953476:0:6580:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94e625880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6580:1863365452583552:0@lo:104: 00000100:00100000:1.0:1777051351.953490:0:3680:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:3.0:1777051351.953514:0:6580:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6200/0x85f51a6b9671561b lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xd3:0x0].0xceea225b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051351.953515:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d944073480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3680:1863365452583680:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1777051351.953579:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051351.953734:0:6566:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452583680 00000100:00100000:2.0:1777051351.953743:0:6566:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452583680 00010000:00010000:2.0:1777051351.953778:0:6566:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d943ebb800/0x85f51a6b96715542 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xd3:0x0].0xceea225b bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0x85f51a6b9671553b expref: 6 pid: 11727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051351.953914:0:6566:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3841 00000100:00100000:2.0:1777051351.953927:0:6566:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d951fa1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+6:3680:x1863365452583680:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1777051351.953943:0:6566:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000001:00080000:0.0:1777051351.957048:0:103159:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771088 is committed 00010000:00010000:2.0:1777051351.957637:0:6566:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d943ebb800/0x85f51a6b96715542 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0xd3:0x0].0xceea225b bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0x85f51a6b9671553b expref: 6 pid: 11727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.957674:0:6566:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xd3:0x0].0xceea225b (ffff99d94e6b6200) 00010000:00010000:2.0:1777051351.957682:0:6566:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6200/0x85f51a6b9671561b lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xd3:0x0].0xceea225b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.957696:0:6566:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6200/0x85f51a6b9671561b lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xd3:0x0].0xceea225b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.957708:0:6566:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6200/0x85f51a6b9671561b lrc: 4/1,0 mode: PR/PR res: [0x200000bd2:0xd3:0x0].0xceea225b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.957751:0:6566:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1777051351.957829:0:6580:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6200/0x85f51a6b9671561b lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xd3:0x0].0xceea225b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051351.957831:0:6566:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d951fa1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+5:3680:x1863365452583680:12345-0@lo:103:ldlm_bl.0 Request processed in 3903us (4249us total) trans 0 rc 0/0 00010000:00010000:3.0:1777051351.957860:0:6580:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6200/0x85f51a6b9671561b lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xd3:0x0].0xceea225b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051351.957863:0:6566:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3841 00000100:00100000:1.0:1777051351.957926:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d944073480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3680:1863365452583680:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1777051351.958027:0:6580:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da4384ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6580:1863365452583808:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1777051351.958099:0:6580:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051351.958139:0:6580:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d95d7c4300 going to sleep for 11 seconds 00000100:00100000:0.0:1777051351.958251:0:46498:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452583808 00000100:00100000:0.0:1777051351.958261:0:46498:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452583808 00000100:00100000:0.0:1777051351.958337:0:46498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8086 00000100:00100000:0.0:1777051351.958353:0:46498:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94e625880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+6:6580:x1863365452583808:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1777051351.958496:0:46498:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94e625880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+6:6580:x1863365452583808:12345-0@lo:1000:mdt00_001.0 Request processed in 145us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051351.958508:0:46498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8086 00000100:00100000:3.0:1777051351.958585:0:6580:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da4384ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6580:1863365452583808:0@lo:1000:mdt00_001.0 00010000:00010000:3.0:1777051351.958669:0:6580:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7e00/0x85f51a6b96715622 lrc: 3/1,0 mode: --/PR res: [0x240000404:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051351.958689:0:6580:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7e00/0x85f51a6b96715622 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0xe:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051351.958704:0:6580:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7e00/0x85f51a6b96715622 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0xe:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777051351.958733:0:6580:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7e00/0x85f51a6b96715622 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0xe:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051351.958753:0:6580:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6c00/0x85f51a6b96715614 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051351.958765:0:6580:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6c00/0x85f51a6b96715614 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051351.958775:0:6580:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6c00/0x85f51a6b96715614 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051351.958786:0:6580:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6c00/0x85f51a6b96715614 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051351.958795:0:6580:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d941ad6c00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:3.0:1777051351.958801:0:6580:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6c00/0x85f51a6b96715614 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051351.958812:0:6580:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6c00/0x85f51a6b96715614 lrc: 5/0,0 mode: CR/CR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051351.958827:0:6580:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xd3:0x0].0x0 (ffff99d94e6b6b00) 00010000:00010000:3.0:1777051351.958832:0:6580:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777051351.958837:0:6580:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6c00/0x85f51a6b96715614 lrc: 3/0,0 mode: --/CR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051351.958848:0:6580:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6c00/0x85f51a6b96715614 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051351.958866:0:6580:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6200/0x85f51a6b9671561b lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xd3:0x0].0xceea225b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051351.958877:0:6580:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6200/0x85f51a6b9671561b lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0xd3:0x0].0xceea225b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051351.958887:0:6580:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6200/0x85f51a6b9671561b lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xd3:0x0].0xceea225b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051351.958895:0:6580:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d941ad6200 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:3.0:1777051351.958899:0:6580:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6200/0x85f51a6b9671561b lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xd3:0x0].0xceea225b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051351.958908:0:6580:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6200/0x85f51a6b9671561b lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0xd3:0x0].0xceea225b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051351.958921:0:6580:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xd3:0x0].0xceea225b (ffff99d94e6b6200) 00010000:00010000:3.0:1777051351.958926:0:6580:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777051351.958931:0:6580:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6200/0x85f51a6b9671561b lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0xd3:0x0].0xceea225b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051351.958937:0:6580:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6200/0x85f51a6b9671561b lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xd3:0x0].0xceea225b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051351.958983:0:6580:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7a00/0x85f51a6b9671560d lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5fc0 expref: 20 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051351.959011:0:6580:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7e00/0x85f51a6b96715622 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0xe:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5fc0 expref: 19 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051351.959022:0:6580:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0xe:0x0].0x0 (ffff99d9413d2e00) 00010000:00010000:3.0:1777051351.959026:0:6580:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1777051351.959030:0:6580:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d941ad7e00, rc 0) 00000040:00080000:1.0:1777051351.959114:0:104226:0:(llog.c:858:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1777051351.959133:0:6580:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d956129500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+19:133450:x1863365425902080:12345-192.168.201.46@tcp:101:mkdir.0 Request processed in 7142us (7346us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051351.959146:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111851 00000100:00100000:1.0:1777051351.962502:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051351.962571:0:46497:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425902208 00000100:00100000:2.0:1777051351.962581:0:46497:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425902208 00000100:00100000:2.0:1777051351.962638:0:46497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111852 00000100:00100000:2.0:1777051351.962651:0:46497:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d951fa0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:c11b6966-0775-44d2-bdc6-c74c26eb2226+6:133450:x1863365425902208:12345-192.168.201.46@tcp:101:mkdir.0 00010000:00010000:2.0:1777051351.962670:0:46497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051351.962693:0:46497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d784a00/0x85f51a6b96715629 lrc: 2/0,0 mode: --/CR res: [0x240000404:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b5fc7 expref: -99 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.962759:0:46497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d784e00/0x85f51a6b96715630 lrc: 3/1,0 mode: --/PR res: [0x240000404:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.962776:0:46497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d784e00/0x85f51a6b96715630 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0xe:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.962793:0:46497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d784e00/0x85f51a6b96715630 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0xe:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1777051351.962851:0:46497:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0xe:0x0]: returning size 4096 00000004:00200000:2.0:1777051351.962857:0:46497:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:2.0:1777051351.962911:0:46497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d784a00/0x85f51a6b96715629 lrc: 0/0,0 mode: --/CR res: [0x240000404:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5fc7 expref: 8 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.962930:0:46497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d784e00/0x85f51a6b96715630 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0xe:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5fc7 expref: 7 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.962939:0:46497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0xe:0x0].0x0 (ffff99d9413d2300) 00010000:00010000:2.0:1777051351.962942:0:46497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1777051351.962946:0:46497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99da7d784e00, rc 0) 00000100:00100000:2.0:1777051351.963000:0:46497:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d951fa0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:c11b6966-0775-44d2-bdc6-c74c26eb2226+7:133450:x1863365425902208:12345-192.168.201.46@tcp:101:mkdir.0 Request processed in 350us (502us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051351.963011:0:46497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111852 00000100:00100000:0.0:1777051351.971529:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051351.971597:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051351.971626:0:27887:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425902464 00000100:00100000:2.0:1777051351.971639:0:27887:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425902464 00000100:00100000:0.0:1777051351.971667:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051351.971718:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00080000:3.0:1777051351.971750:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1777051351.971767:0:27887:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425902720 00000100:00100000:2.0:1777051351.971777:0:27887:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425902720 00000100:00100000:0.0:1777051351.971792:0:8471:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425902592 00000100:00100000:0.0:1777051351.971803:0:8471:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425902592 00000100:00100000:1.0:1777051351.971814:0:103169:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425902336 00000100:00100000:3.0:1777051351.971816:0:27884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10316 00000100:00100000:1.0:1777051351.971826:0:103169:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425902336 00000100:00100000:3.0:1777051351.971843:0:27884:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d956129180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+48:2438:x1863365425902464:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:2.0:1777051351.971866:0:27887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10317 00000100:00100000:0.0:1777051351.971888:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10318 00000100:00100000:2.0:1777051351.971891:0:27887:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d956129880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+47:2438:x1863365425902720:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:1.0:1777051351.971913:0:103169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 148 00000100:00100000:0.0:1777051351.971916:0:8471:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95612a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+50:2439:x1863365425902592:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:3.0:1777051351.971934:0:27884:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d956129180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+48:2438:x1863365425902464:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 97us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051351.971935:0:103169:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d943e27450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:29c4352d-3260-4734-909d-9ea5de9e7fa4+12:2439:x1863365425902336:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:3.0:1777051351.971960:0:27884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10316 00000100:00100000:2.0:1777051351.971988:0:27887:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d956129880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+47:2438:x1863365425902720:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 103us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051351.972011:0:8471:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95612a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+50:2439:x1863365425902592:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 84us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051351.972012:0:27887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10317 00000100:00100000:1.0:1777051351.972013:0:103169:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d943e27450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:29c4352d-3260-4734-909d-9ea5de9e7fa4+12:2439:x1863365425902336:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 84us (413us total) trans 0 rc 0/0 00000100:00080000:3.0:1777051351.972015:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1777051351.972027:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1777051351.972044:0:103169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 148 00000100:00100000:0.0:1777051351.972051:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10318 00000100:00100000:0.0:1777051351.974163:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051351.974293:0:27885:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425902848 00000100:00100000:1.0:1777051351.974318:0:27885:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425902848 00000100:00100000:1.0:1777051351.974385:0:27885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111853 00000100:00100000:1.0:1777051351.974399:0:27885:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d956128700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c11b6966-0775-44d2-bdc6-c74c26eb2226+7:133451:x1863365425902848:12345-192.168.201.46@tcp:101:rm.0 00010000:00010000:1.0:1777051351.974419:0:27885:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777051351.974444:0:27885:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d943ebbe00/0x85f51a6b96715637 lrc: 2/0,0 mode: --/CR res: [0x240000404:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b5fce expref: -99 pid: 27885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051351.974530:0:27885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d943eba200/0x85f51a6b9671563e lrc: 3/1,0 mode: --/CR res: [0x240000404:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051351.974545:0:27885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d943eba200/0x85f51a6b9671563e lrc: 3/1,0 mode: CR/CR res: [0x240000404:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 27885 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051351.974558:0:27885:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d943eba200/0x85f51a6b9671563e lrc: 3/1,0 mode: CR/CR res: [0x240000404:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 27885 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051351.974571:0:27885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d943eba000/0x85f51a6b96715645 lrc: 3/1,0 mode: --/PR res: [0x240000404:0xe:0x0].0x674069f9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051351.974579:0:27885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d943eba000/0x85f51a6b96715645 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0xe:0x0].0x674069f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27885 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051351.974585:0:27885:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d943eba000/0x85f51a6b96715645 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0xe:0x0].0x674069f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27885 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051351.974628:0:27885:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d943eba200/0x85f51a6b9671563e lrc: 3/1,0 mode: CR/CR res: [0x240000404:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 27885 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051351.974634:0:27885:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d943eba200/0x85f51a6b9671563e lrc: 2/0,0 mode: CR/CR res: [0x240000404:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 27885 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051351.974641:0:27885:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99d943eba200/0x85f51a6b9671563e lrc: 3/0,0 mode: CR/CR res: [0x240000404:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 27885 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051351.974648:0:27885:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d943eba200 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:1.0:1777051351.974653:0:27885:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d943eba200/0x85f51a6b9671563e lrc: 3/0,0 mode: CR/CR res: [0x240000404:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 27885 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051351.974660:0:27885:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d943eba200/0x85f51a6b9671563e lrc: 4/0,0 mode: CR/CR res: [0x240000404:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 27885 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051351.974671:0:27885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0xe:0x0].0x0 (ffff99d9413d2300) 00010000:00010000:1.0:1777051351.974674:0:27885:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777051351.974679:0:27885:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99d943eba200/0x85f51a6b9671563e lrc: 2/0,0 mode: --/CR res: [0x240000404:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 27885 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051351.974685:0:27885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d943eba200/0x85f51a6b9671563e lrc: 0/0,0 mode: --/CR res: [0x240000404:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 27885 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051351.974697:0:27885:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d943eba000/0x85f51a6b96715645 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0xe:0x0].0x674069f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27885 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051351.974703:0:27885:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d943eba000/0x85f51a6b96715645 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0xe:0x0].0x674069f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 27885 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051351.974710:0:27885:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99d943eba000/0x85f51a6b96715645 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0xe:0x0].0x674069f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27885 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051351.974715:0:27885:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d943eba000 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:1.0:1777051351.974717:0:27885:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d943eba000/0x85f51a6b96715645 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0xe:0x0].0x674069f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27885 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051351.975032:0:27885:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d943eba000/0x85f51a6b96715645 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0xe:0x0].0x674069f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 27885 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051351.975053:0:27885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0xe:0x0].0x674069f9 (ffff99d94e6b6600) 00010000:00010000:1.0:1777051351.975057:0:27885:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777051351.975413:0:27885:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99d943eba000/0x85f51a6b96715645 lrc: 2/0,0 mode: --/PR res: [0x240000404:0xe:0x0].0x674069f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27885 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051351.975426:0:27885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d943eba000/0x85f51a6b96715645 lrc: 0/0,0 mode: --/PR res: [0x240000404:0xe:0x0].0x674069f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27885 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051351.975480:0:27885:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99d943ebbe00/0x85f51a6b96715637 lrc: 1/0,0 mode: --/CR res: [0x240000404:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5fce expref: 8 pid: 27885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051351.975496:0:27885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0xe:0x0].0x0 (ffff99d9413d2300) 00010000:00010000:1.0:1777051351.975499:0:27885:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777051351.975506:0:27885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d943ebbe00/0x85f51a6b96715637 lrc: 0/0,0 mode: --/CR res: [0x240000404:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5fce expref: 8 pid: 27885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051351.975520:0:27885:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d943ebbe00, rc 0) 00000100:00100000:1.0:1777051351.975591:0:27885:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d956128700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c11b6966-0775-44d2-bdc6-c74c26eb2226+7:133451:x1863365425902848:12345-192.168.201.46@tcp:101:rm.0 Request processed in 1193us (1429us total) trans 0 rc 301/301 00000100:00100000:1.0:1777051351.975603:0:27885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111853 00000100:00100000:0.0:1777051351.986719:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051351.986835:0:27882:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425903104 00000100:00100000:2.0:1777051351.986846:0:27882:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425903104 00000100:00100000:2.0:1777051351.986909:0:27882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111854 00000100:00100000:2.0:1777051351.986921:0:27882:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d956129c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+7:133452:x1863365425903104:12345-192.168.201.46@tcp:101:dd.0 00010000:00010000:2.0:1777051351.986941:0:27882:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051351.986945:0:27882:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1777051351.986970:0:27882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d784e00/0x85f51a6b96715630 lrc: 0/0,0 mode: --/PR res: [0x240000404:0xe:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5fc7 expref: 7 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.986994:0:27882:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0xe:0x0].0x0 (ffff99d9413d2300) 00010000:00010000:2.0:1777051351.987001:0:27882:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1777051351.987017:0:27882:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d785400/0x85f51a6b9671564c lrc: 2/0,0 mode: --/CW res: [0x240000404:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b5fd5 expref: -99 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051351.987159:0:27882:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d944072d80 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0001_UUID:27882:1863365452583936:0@lo:900:mdt00_006.0 00000100:00100000:2.0:1777051351.987337:0:27882:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051351.987371:0:27882:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da5077b600 going to sleep for 11 seconds 00000100:00100000:0.0:1777051351.987494:0:6591:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452583936 00000100:00100000:0.0:1777051351.987508:0:6591:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452583936 00000100:00100000:0.0:1777051351.987565:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1777051351.987579:0:6591:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d944073b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:27882:x1863365452583936:12345-0@lo:900:mdt00_006.0 00000100:00100000:0.0:1777051351.987738:0:6591:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d944073b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:27882:x1863365452583936:12345-0@lo:900:mdt00_006.0 Request processed in 161us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051351.987751:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1777051351.987860:0:27882:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d944072d80 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0001_UUID:27882:1863365452583936:0@lo:900:mdt00_006.0 00000100:00100000:2.0:1777051351.987935:0:27882:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d944072d80 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-mdtlov_UUID:27882:1863365452584064:0@lo:1000:mdt00_006.0 00000100:00100000:2.0:1777051351.987981:0:27882:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051351.988083:0:27882:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da5077bd80 going to sleep for 11 seconds 00000100:00100000:0.0:1777051351.988152:0:46500:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452584064 00000100:00100000:0.0:1777051351.988159:0:46500:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452584064 00000100:00100000:0.0:1777051351.988254:0:46500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8087 00000100:00100000:0.0:1777051351.988272:0:46500:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d944071f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+5:27882:x1863365452584064:12345-0@lo:1000:mdt00_006.0 00000100:00100000:0.0:1777051351.988413:0:46500:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d944071f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+5:27882:x1863365452584064:12345-0@lo:1000:mdt00_006.0 Request processed in 148us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051351.988422:0:46500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8087 00000100:00100000:2.0:1777051351.988484:0:27882:0:(client.c:3101:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 30064771086 gen 2 00000004:00080000:2.0:1777051351.988494:0:27882:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 30064771086 committed transno 30064771086 00000100:00100000:2.0:1777051351.988554:0:27882:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d944072d80 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-mdtlov_UUID:27882:1863365452584064:0@lo:1000:mdt00_006.0 00010000:00010000:2.0:1777051351.988623:0:27882:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-osp-MDT0001 lock: ffff99da7d784400/0x85f51a6b96715653 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.988637:0:27882:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff99da7d784400/0x85f51a6b96715653 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x0 pid: 27882 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.988659:0:27882:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff99da7d784400/0x85f51a6b96715653 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 27882 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051351.988680:0:27882:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d944072d80 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-mdtlov_UUID:27882:1863365452584192:0@lo:101:mdt00_006.0 00000100:00100000:2.0:1777051351.988722:0:27882:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051351.989088:0:27882:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da5077b600 going to sleep for 11 seconds 00000100:00100000:0.0:1777051351.989533:0:47208:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452584192 00000100:00100000:0.0:1777051351.989541:0:47208:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452584192 00000100:00100000:0.0:1777051351.989591:0:47208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8088 00000100:00100000:0.0:1777051351.989603:0:47208:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d944072300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+5:27882:x1863365452584192:12345-0@lo:101:mdt00_006.0 00010000:00010000:0.0:1777051351.989618:0:47208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051351.989637:0:47208:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da40031600/0x85f51a6b9671565a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x85f51a6b96715653 expref: -99 pid: 47208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051351.989669:0:47208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da40031600/0x85f51a6b9671565a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x85f51a6b96715653 expref: 6 pid: 47208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051351.989985:0:47208:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99da40031600/0x85f51a6b9671565a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b96715653 expref: 6 pid: 47208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051351.989997:0:47208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d9533ab000) 00010000:00010000:0.0:1777051351.990002:0:47208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1777051351.990006:0:47208:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99da40031600, rc 0) 00000100:00100000:0.0:1777051351.990080:0:47208:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d944072300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+6:27882:x1863365452584192:12345-0@lo:101:mdt00_006.0 Request processed in 478us (1356us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051351.990091:0:47208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8088 00000100:00100000:2.0:1777051351.990574:0:27882:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d944072d80 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-mdtlov_UUID:27882:1863365452584192:0@lo:101:mdt00_006.0 00010000:00010000:2.0:1777051351.990594:0:27882:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff99da7d784400/0x85f51a6b96715653 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x85f51a6b9671565a expref: -99 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.990610:0:27882:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff99da7d784400/0x85f51a6b96715653 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x85f51a6b9671565a expref: -99 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1777051351.990635:0:27882:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:2.0:1777051351.990644:0:27882:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-osp-MDT0001 lock: ffff99da7d784400/0x85f51a6b96715653 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x85f51a6b9671565a expref: -99 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.990656:0:27882:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff99da7d784400/0x85f51a6b96715653 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x85f51a6b9671565a expref: -99 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.990718:0:27882:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d784c00/0x85f51a6b96715661 lrc: 3/0,1 mode: --/CW res: [0x240000404:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.990734:0:27882:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d784c00/0x85f51a6b96715661 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 27882 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.990746:0:27882:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d784c00/0x85f51a6b96715661 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 27882 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.990771:0:27882:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d785e00/0x85f51a6b96715668 lrc: 3/0,1 mode: --/PW res: [0x240000404:0xe:0x0].0x674069f9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.990782:0:27882:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d785e00/0x85f51a6b96715668 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0xe:0x0].0x674069f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27882 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.990792:0:27882:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d785e00/0x85f51a6b96715668 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0xe:0x0].0x674069f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27882 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051351.990916:0:27882:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d944072d80 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-mdtlov_UUID:27882:1863365452584320:0@lo:1000:mdt00_006.0 00000100:00100000:2.0:1777051351.990956:0:27882:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051351.991363:0:27882:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da5077bd80 going to sleep for 11 seconds 00000100:00100000:0.0:1777051351.991437:0:46498:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452584320 00000100:00100000:0.0:1777051351.991446:0:46498:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452584320 00000100:00100000:0.0:1777051351.991510:0:46498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8089 00000100:00100000:0.0:1777051351.991523:0:46498:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d944070000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:27882:x1863365452584320:12345-0@lo:1000:mdt00_006.0 00000100:00100000:0.0:1777051351.991658:0:46498:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d944070000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:27882:x1863365452584320:12345-0@lo:1000:mdt00_006.0 Request processed in 136us (700us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051351.991670:0:46498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8089 00000100:00100000:2.0:1777051351.992102:0:27882:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d944072d80 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-mdtlov_UUID:27882:1863365452584320:0@lo:1000:mdt00_006.0 00000004:00080000:2.0:1777051351.992445:0:27882:0:(osp_internal.h:570:osp_update_last_fid()) Gap in objids: start=[0x280000400:0xe4:0x0], count =30 00000004:00080000:2.0:1777051351.992454:0:27882:0:(osp_object.c:1640:osp_create()) Writing gap [0x280000400:0xe4:0x0]+30 in llog 00000004:00080000:2.0:1777051351.992474:0:27882:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x102:0x0], index 0: 0 00010000:00010000:2.0:1777051351.992663:0:27882:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d785200/0x85f51a6b9671566f lrc: 3/1,0 mode: --/PR res: [0x240000405:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.992679:0:27882:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d785200/0x85f51a6b9671566f lrc: 3/1,0 mode: PR/PR res: [0x240000405:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27882 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.992751:0:27882:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d785200/0x85f51a6b9671566f lrc: 3/1,0 mode: PR/PR res: [0x240000405:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27882 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.992800:0:27882:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d784c00/0x85f51a6b96715661 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 27882 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.992812:0:27882:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d784c00/0x85f51a6b96715661 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 27882 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.992822:0:27882:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d784c00/0x85f51a6b96715661 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 27882 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.992832:0:27882:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d784c00/0x85f51a6b96715661 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 27882 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.992843:0:27882:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da7d784c00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:2.0:1777051351.992849:0:27882:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d784c00/0x85f51a6b96715661 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 27882 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.992860:0:27882:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d784c00/0x85f51a6b96715661 lrc: 5/0,0 mode: CW/CW res: [0x240000404:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 27882 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.992876:0:27882:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0xe:0x0].0x0 (ffff99d9413d2300) 00010000:00010000:2.0:1777051351.992881:0:27882:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777051351.992888:0:27882:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d784c00/0x85f51a6b96715661 lrc: 3/0,0 mode: --/CW res: [0x240000404:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 27882 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.992899:0:27882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d784c00/0x85f51a6b96715661 lrc: 0/0,0 mode: --/CW res: [0x240000404:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 27882 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1777051351.992918:0:27882:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000d1af1422 reply state 000000004f594644 transno 8589934594 ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d785e00/0x85f51a6b96715668 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0xe:0x0].0x674069f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27882 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.992935:0:27882:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d785e00/0x85f51a6b96715668 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0xe:0x0].0x674069f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27882 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.992947:0:27882:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0xe:0x0].0x674069f9 (ffff99d94e5e2b00) 00010000:00010000:2.0:1777051351.992952:0:27882:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1777051351.992956:0:27882:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1777051351.992999:0:27882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d785400/0x85f51a6b9671564c lrc: 0/0,0 mode: --/CW res: [0x240000404:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5fd5 expref: 9 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.993024:0:27882:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d785200/0x85f51a6b9671566f lrc: 3/0,0 mode: PR/PR res: [0x240000405:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5fd5 expref: 8 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051351.993037:0:27882:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0xa:0x0].0x0 (ffff99d94e5e2d00) 00010000:00010000:2.0:1777051351.993041:0:27882:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1777051351.993045:0:27882:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99da7d785200, rc 0) 00000100:00100000:2.0:1777051351.993224:0:27882:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d956129c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+9:133452:x1863365425903104:12345-192.168.201.46@tcp:101:dd.0 Request processed in 6301us (6512us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1777051351.993244:0:27882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111854 00000100:00100000:2.0:1777051352.023541:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051352.023631:0:55805:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425903232 00000100:00100000:3.0:1777051352.023644:0:55805:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425903232 00000100:00100000:3.0:1777051352.023727:0:55805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 7964 00000100:00100000:3.0:1777051352.023745:0:55805:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d944072d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c11b6966-0775-44d2-bdc6-c74c26eb2226+51:133452:x1863365425903232:12345-192.168.201.46@tcp:101:dd.0 00010000:00010000:3.0:1777051352.023770:0:55805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777051352.023817:0:55805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f2fd58b2/0x85f51a6b9671567d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x102:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b5fdc expref: -99 pid: 55805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1777051352.023863:0:55805:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x102:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777051352.023891:0:55805:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051352.023895:0:55805:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051352.023907:0:55805:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f2fd58b2/0x85f51a6b9671567d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x102:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5fdc expref: 52 pid: 55805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051352.023933:0:55805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f2fd58b2/0x85f51a6b9671567d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x102:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5fdc expref: 52 pid: 55805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051352.023952:0:55805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d941ad7a00, rc 0) 00000100:00100000:3.0:1777051352.024037:0:55805:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d944072d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c11b6966-0775-44d2-bdc6-c74c26eb2226+52:133452:x1863365425903232:12345-192.168.201.46@tcp:101:dd.0 Request processed in 295us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051352.024050:0:55805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 7964 00000100:00100000:0.0:1777051352.054622:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051352.054733:0:20161:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425903360 00000100:00100000:3.0:1777051352.054747:0:20161:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425903360 00002000:00100000:3.0:1777051352.054809:0:20161:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000400:0x102:0x0] (0->1048575) req@ffff99d95612aa00 x1863365425903360/t0(0) o4->c11b6966-0775-44d2-bdc6-c74c26eb2226@192.168.201.46@tcp:313/0 lens 488/0 e 0 to 0 dl 1777051363 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1777051352.054826:0:20161:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99d95612aa00 with x1863365425903360 ext(0->1048575) 00002000:00010000:3.0:1777051352.054833:0:20161:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99d95612aa00 00000100:00100000:3.0:1777051352.054884:0:20161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 1759 00000100:00100000:3.0:1777051352.054898:0:20161:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95612aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+52:2436:x1863365425903360:12345-192.168.201.46@tcp:4:dd.0 00000100:00100000:3.0:1777051352.069869:0:20161:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95612aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+54:2436:x1863365425903360:12345-192.168.201.46@tcp:4:dd.0 Request processed in 14948us (15231us total) trans 4294968351 rc 0/0 00000100:00100000:3.0:1777051352.069895:0:20161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 1759 00002000:00100000:3.0:1777051352.069919:0:20161:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000400:0x102:0x0] (0->1048575) req@ffff99d95612aa00 x1863365425903360/t4294968351(0) o4->c11b6966-0775-44d2-bdc6-c74c26eb2226@192.168.201.46@tcp:313/0 lens 488/448 e 0 to 0 dl 1777051363 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1777051352.069935:0:20161:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99d95612aa00 with x1863365425903360 ext(0->1048575) 00002000:00010000:3.0:1777051352.069946:0:20161:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99d95612aa00 00000100:00100000:2.0:1777051352.075496:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051352.075642:0:10328:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425903488 00000100:00100000:3.0:1777051352.075655:0:10328:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425903488 00000100:00100000:3.0:1777051352.075724:0:10328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111855 00000100:00100000:3.0:1777051352.075735:0:10328:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d944070380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+9:133452:x1863365425903488:12345-192.168.201.46@tcp:44:dd.0 00000001:00080000:0.0:1777051352.081582:0:104205:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934594 is committed 00000001:00080000:0.0:1777051352.081629:0:104205:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934593 is committed 00000020:00080000:0.0:1777051352.081642:0:104205:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff99da6fddff00 refcount 2 committed 0 result 0 batchid 4294970574 00000020:00080000:0.0:1777051352.081650:0:104205:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff99da43901700 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff99d941bdd540 00000020:00080000:0.0:1777051352.081657:0:104205:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x2000032e1:0x1:0x0].1 00000020:00080000:0.0:1777051352.081662:0:104205:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff99da43901300 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff99da7f866000 00000020:00080000:0.0:1777051352.081666:0:104205:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x240000bd0:0x1:0x0].1 00000020:00080000:1.0:1777051352.081799:0:104230:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 4294970574 committed batchid 56 00010000:00010000:2.0:1777051352.081816:0:3663:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff99d941ad7400/0x85f51a6b96715549 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0xe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8492 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051352.081836:0:3663:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d941ad7400/0x85f51a6b96715549 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0xe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8492 initiator: MDT1 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1777051352.081916:0:104230:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 56 00010000:00010000:2.0:1777051352.081941:0:3663:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99d941ad7400/0x85f51a6b96715549 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0xe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8492 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051352.081952:0:3663:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d941ad7400 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:2.0:1777051352.081960:0:3663:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d941ad7400/0x85f51a6b96715549 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0xe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8492 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051352.081971:0:3663:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d941ad7400/0x85f51a6b96715549 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0xe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8492 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051352.082034:0:3664:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d785e00/0x85f51a6b96715668 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0xe:0x0].0x674069f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27882 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051352.082056:0:3664:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d785e00/0x85f51a6b96715668 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0xe:0x0].0x674069f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 27882 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051352.082067:0:3664:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d785e00/0x85f51a6b96715668 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0xe:0x0].0x674069f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27882 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051352.082075:0:3664:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da7d785e00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:0.0:1777051352.082080:0:3664:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d785e00/0x85f51a6b96715668 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0xe:0x0].0x674069f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27882 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051352.082090:0:3664:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d785e00/0x85f51a6b96715668 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0xe:0x0].0x674069f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 27882 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051352.082456:0:3663:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0xe:0x0].0x0 (ffff99d9413d2300) 00010000:00010000:2.0:1777051352.082462:0:3663:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777051352.082470:0:3663:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99d941ad7400/0x85f51a6b96715549 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0xe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8492 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051352.082480:0:3663:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d941ad7400/0x85f51a6b96715549 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0xe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8492 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051352.082564:0:3664:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0xe:0x0].0x674069f9 (ffff99d94e5e2b00) 00010000:00010000:0.0:1777051352.082568:0:3664:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777051352.082574:0:3664:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d785e00/0x85f51a6b96715668 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0xe:0x0].0x674069f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27882 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051352.082583:0:3664:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d785e00/0x85f51a6b96715668 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0xe:0x0].0x674069f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27882 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051352.083516:0:10328:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d944070380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+7:133452:x1863365425903488:12345-192.168.201.46@tcp:44:dd.0 Request processed in 7772us (8023us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051352.083536:0:10328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111855 00000100:00100000:0.0:1777051352.085856:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051352.085942:0:13320:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425903616 00000100:00100000:2.0:1777051352.085957:0:13320:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425903616 00000100:00100000:2.0:1777051352.086038:0:13320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 7965 00000100:00100000:2.0:1777051352.086055:0:13320:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d956128000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+54:2437:x1863365425903616:12345-192.168.201.46@tcp:16:dd.0 00000001:00080000:3.0:1777051352.091272:0:8464:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0000: transno 4294968351 is committed 00000100:00100000:2.0:1777051352.091542:0:13320:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d956128000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+52:2437:x1863365425903616:12345-192.168.201.46@tcp:16:dd.0 Request processed in 5472us (5675us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051352.091560:0:13320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 7965 00000100:00100000:0.0:1777051352.095554:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051352.095683:0:6583:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425903872 00000100:00100000:1.0:1777051352.095696:0:6583:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425903872 00000100:00100000:1.0:1777051352.096068:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3323 00000100:00100000:1.0:1777051352.096085:0:6583:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95a581f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+7:133452:x1863365425903872:12345-192.168.201.46@tcp:35:dd.0 00000100:00100000:1.0:1777051352.096625:0:6583:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95a581f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+8:133452:x1863365425903872:12345-192.168.201.46@tcp:35:dd.0 Request processed in 543us (1077us total) trans 8589934595 rc 0/0 00000100:00100000:1.0:1777051352.096640:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3323 00000100:00100000:1.0:1777051352.118624:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051352.118754:0:46494:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425904000 00000100:00100000:2.0:1777051352.119219:0:46494:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425904000 00000100:00100000:2.0:1777051352.119313:0:46494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111856 00000100:00100000:2.0:1777051352.119327:0:46494:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d944e10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c11b6966-0775-44d2-bdc6-c74c26eb2226+19:133453:x1863365425904000:12345-192.168.201.46@tcp:101:lfs.0 00010000:00010000:2.0:1777051352.119358:0:46494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051352.119438:0:46494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784e00/0x85f51a6b96715684 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b5fe3 expref: -99 pid: 46494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051352.119543:0:46494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784600/0x85f51a6b9671568b lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051352.119567:0:46494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784600/0x85f51a6b9671568b lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051352.119585:0:46494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784600/0x85f51a6b9671568b lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051352.119606:0:46494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d785600/0x85f51a6b96715692 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xd3:0x0].0xceea225b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051352.119615:0:46494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d785600/0x85f51a6b96715692 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xd3:0x0].0xceea225b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051352.119621:0:46494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d785600/0x85f51a6b96715692 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xd3:0x0].0xceea225b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051352.119695:0:46494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d785e00/0x85f51a6b96715699 lrc: 3/1,0 mode: --/PR res: [0x240000404:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051352.119708:0:46494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d785e00/0x85f51a6b96715699 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0xe:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051352.119718:0:46494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d785e00/0x85f51a6b96715699 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0xe:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1777051352.119751:0:46494:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d785e00/0x85f51a6b96715699 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0xe:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051352.120067:0:46494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784600/0x85f51a6b9671568b lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051352.120079:0:46494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784600/0x85f51a6b9671568b lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051352.120089:0:46494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784600/0x85f51a6b9671568b lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051352.120099:0:46494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da7d784600 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:2.0:1777051352.120105:0:46494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784600/0x85f51a6b9671568b lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051352.120118:0:46494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784600/0x85f51a6b9671568b lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051352.120139:0:46494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xd3:0x0].0x0 (ffff99d94e6b6b00) 00010000:00010000:2.0:1777051352.120142:0:46494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777051352.120149:0:46494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784600/0x85f51a6b9671568b lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051352.120156:0:46494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784600/0x85f51a6b9671568b lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051352.120196:0:46494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d785600/0x85f51a6b96715692 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xd3:0x0].0xceea225b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051352.120224:0:46494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d785600/0x85f51a6b96715692 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0xd3:0x0].0xceea225b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051352.120231:0:46494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d785600/0x85f51a6b96715692 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xd3:0x0].0xceea225b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051352.120237:0:46494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da7d785600 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:2.0:1777051352.120241:0:46494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d785600/0x85f51a6b96715692 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xd3:0x0].0xceea225b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051352.120247:0:46494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d785600/0x85f51a6b96715692 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0xd3:0x0].0xceea225b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051352.120256:0:46494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xd3:0x0].0xceea225b (ffff99d94e5e2a00) 00010000:00010000:2.0:1777051352.120259:0:46494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777051352.120262:0:46494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d785600/0x85f51a6b96715692 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0xd3:0x0].0xceea225b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051352.120269:0:46494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d785600/0x85f51a6b96715692 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xd3:0x0].0xceea225b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051352.120314:0:46494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784e00/0x85f51a6b96715684 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5fe3 expref: 21 pid: 46494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051352.120335:0:46494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d785e00/0x85f51a6b96715699 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0xe:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5fe3 expref: 20 pid: 46494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051352.120346:0:46494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0xe:0x0].0x0 (ffff99d9413d2e00) 00010000:00010000:2.0:1777051352.120349:0:46494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1777051352.120353:0:46494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99da7d785e00, rc 0) 00000100:00100000:2.0:1777051352.120445:0:46494:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d944e10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c11b6966-0775-44d2-bdc6-c74c26eb2226+20:133453:x1863365425904000:12345-192.168.201.46@tcp:101:lfs.0 Request processed in 1119us (1835us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051352.120458:0:46494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111856 00000100:00100000:0.0:1777051352.123663:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051352.124052:0:6581:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425904128 00000100:00100000:1.0:1777051352.124065:0:6581:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425904128 00000100:00100000:2.0:1777051352.124513:0:46497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111857 00000100:00100000:2.0:1777051352.124532:0:46497:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95a581180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:c11b6966-0775-44d2-bdc6-c74c26eb2226+8:133453:x1863365425904128:12345-192.168.201.46@tcp:101:lfs.0 00010000:00010000:2.0:1777051352.124566:0:46497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051352.124595:0:46497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d785400/0x85f51a6b967156a0 lrc: 2/0,0 mode: --/CR res: [0x240000404:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b5fea expref: -99 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051352.124672:0:46497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d784c00/0x85f51a6b967156a7 lrc: 3/1,0 mode: --/PR res: [0x240000404:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051352.124692:0:46497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d784c00/0x85f51a6b967156a7 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0xe:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051352.124714:0:46497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d784c00/0x85f51a6b967156a7 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0xe:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1777051352.124778:0:46497:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0xe:0x0]: returning size 4096 00000004:00200000:2.0:1777051352.124785:0:46497:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:2.0:1777051352.124843:0:46497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d785400/0x85f51a6b967156a0 lrc: 0/0,0 mode: --/CR res: [0x240000404:0xe:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5fea expref: 10 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051352.124869:0:46497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d784c00/0x85f51a6b967156a7 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0xe:0x0].0x0 bits 0x10/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5fea expref: 9 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051352.124883:0:46497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0xe:0x0].0x0 (ffff99d94e5e2c00) 00010000:00010000:2.0:1777051352.124888:0:46497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:2.0:1777051352.124894:0:46497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99da7d784c00, rc 0) 00000100:00100000:2.0:1777051352.124985:0:46497:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95a581180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:c11b6966-0775-44d2-bdc6-c74c26eb2226+9:133453:x1863365425904128:12345-192.168.201.46@tcp:101:lfs.0 Request processed in 457us (1328us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051352.124996:0:46497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111857 00000100:00100000:1.0:1777051352.125162:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051352.125262:0:6565:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425904256 00000100:00100000:3.0:1777051352.125269:0:6565:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425904256 00000100:00100000:3.0:1777051352.125331:0:6565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13675 00000100:00100000:3.0:1777051352.125341:0:6565:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d944e10380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+20:2437:x1863365425904256:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1777051352.125355:0:6565:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777051352.125376:0:6565:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d785e00/0x85f51a6b96715699 lrc: 0/0,0 mode: --/PR res: [0x240000404:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5fe3 expref: 20 pid: 46494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051352.125393:0:6565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0xe:0x0].0x0 (ffff99d9413d2e00) 00010000:00010000:3.0:1777051352.125397:0:6565:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1777051352.125451:0:6565:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d944e10380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+19:2437:x1863365425904256:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 112us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051352.125458:0:6565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13675 00010000:00010000:3.0:1777051352.150525:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1777051352.154493:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051352.154654:0:8492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425904384 00000100:00100000:3.0:1777051352.154670:0:8492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425904384 00000100:00100000:3.0:1777051352.154768:0:8492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111858 00000100:00100000:3.0:1777051352.154786:0:8492:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d944e11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+19:133455:x1863365425904384:12345-192.168.201.46@tcp:101:lfs.0 00010000:00010000:3.0:1777051352.154825:0:8492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777051352.154859:0:8492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6200/0x85f51a6b967156ae lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b5ff1 expref: -99 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051352.154956:0:8492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6c00/0x85f51a6b967156b5 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051352.154979:0:8492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6c00/0x85f51a6b967156b5 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051352.154995:0:8492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6c00/0x85f51a6b967156b5 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051352.155017:0:8492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6000/0x85f51a6b967156bc lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xd3:0x0].0xac1bda01 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051352.155028:0:8492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6000/0x85f51a6b967156bc lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xd3:0x0].0xac1bda01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051352.155038:0:8492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6000/0x85f51a6b967156bc lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xd3:0x0].0xac1bda01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051352.155493:0:8492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6e00/0x85f51a6b967156c3 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xd4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051352.155507:0:8492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6e00/0x85f51a6b967156c3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xd4:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051352.155518:0:8492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6e00/0x85f51a6b967156c3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xd4:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1777051352.155577:0:8492:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0xd4:0x0]: returning size 4096 00000004:00200000:3.0:1777051352.155585:0:8492:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1777051352.155618:0:8492:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6e00/0x85f51a6b967156c3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xd4:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051352.155637:0:8492:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6c00/0x85f51a6b967156b5 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051352.155646:0:8492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6c00/0x85f51a6b967156b5 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051352.155920:0:8492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6c00/0x85f51a6b967156b5 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051352.155930:0:8492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6c00/0x85f51a6b967156b5 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051352.155939:0:8492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d941ad6c00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:3.0:1777051352.155945:0:8492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6c00/0x85f51a6b967156b5 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051352.155955:0:8492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6c00/0x85f51a6b967156b5 lrc: 5/0,0 mode: CR/CR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051352.155971:0:8492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xd3:0x0].0x0 (ffff99d94e6b6b00) 00010000:00010000:3.0:1777051352.155977:0:8492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777051352.155984:0:8492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6c00/0x85f51a6b967156b5 lrc: 3/0,0 mode: --/CR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051352.155995:0:8492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6c00/0x85f51a6b967156b5 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051352.156017:0:8492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6000/0x85f51a6b967156bc lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xd3:0x0].0xac1bda01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051352.156032:0:8492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6000/0x85f51a6b967156bc lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0xd3:0x0].0xac1bda01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051352.156041:0:8492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6000/0x85f51a6b967156bc lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xd3:0x0].0xac1bda01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051352.156048:0:8492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d941ad6000 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:3.0:1777051352.156052:0:8492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6000/0x85f51a6b967156bc lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xd3:0x0].0xac1bda01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051352.156060:0:8492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6000/0x85f51a6b967156bc lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0xd3:0x0].0xac1bda01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051352.156069:0:8492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xd3:0x0].0xac1bda01 (ffff99d9413d2900) 00010000:00010000:3.0:1777051352.156073:0:8492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777051352.156076:0:8492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6000/0x85f51a6b967156bc lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0xd3:0x0].0xac1bda01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051352.156085:0:8492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6000/0x85f51a6b967156bc lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xd3:0x0].0xac1bda01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051352.156127:0:8492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6200/0x85f51a6b967156ae lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5ff1 expref: 21 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051352.156148:0:8492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6e00/0x85f51a6b967156c3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xd4:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5ff1 expref: 20 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051352.156158:0:8492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xd4:0x0].0x0 (ffff99d94e6b6100) 00010000:00010000:3.0:1777051352.156162:0:8492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1777051352.156166:0:8492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d941ad6e00, rc 0) 00000100:00100000:3.0:1777051352.156327:0:8492:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d944e11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+20:133455:x1863365425904384:12345-192.168.201.46@tcp:101:lfs.0 Request processed in 1542us (1843us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051352.156341:0:8492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111858 00000100:00100000:0.0:1777051352.160925:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051352.161019:0:21368:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425904512 00000100:00100000:1.0:1777051352.161031:0:21368:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425904512 00000100:00100000:1.0:1777051352.161110:0:21368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111859 00000100:00100000:1.0:1777051352.161469:0:21368:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95a583800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+20:133455:x1863365425904512:12345-192.168.201.46@tcp:101:lfs.0 00010000:00010000:1.0:1777051352.161500:0:21368:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777051352.161527:0:21368:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d943eba200/0x85f51a6b967156ca lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0xd4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b5ff8 expref: -99 pid: 21368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051352.161607:0:21368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d943eba600/0x85f51a6b967156d1 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0xd4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051352.161628:0:21368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d943eba600/0x85f51a6b967156d1 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0xd4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051352.161644:0:21368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d943eba600/0x85f51a6b967156d1 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0xd4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051352.161665:0:21368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d943ebb400/0x85f51a6b967156d8 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xd4:0x0].0x674069f9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051352.161684:0:21368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d943ebb400/0x85f51a6b967156d8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xd4:0x0].0x674069f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051352.161694:0:21368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d943ebb400/0x85f51a6b967156d8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xd4:0x0].0x674069f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051352.162062:0:21368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d943ebb000/0x85f51a6b967156df lrc: 3/1,0 mode: --/PR res: [0x200000bd3:0xc2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051352.162075:0:21368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d943ebb000/0x85f51a6b967156df lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0xc2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051352.162087:0:21368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d943ebb000/0x85f51a6b967156df lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0xc2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1777051352.162140:0:21368:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd3:0xc2:0x0]: returning size 1048576 00000004:00200000:1.0:1777051352.162147:0:21368:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1777051352.162223:0:21368:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99d943ebb000/0x85f51a6b967156df lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0xc2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051352.162242:0:21368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d943ebb000/0x85f51a6b967156df lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0xc2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051352.162253:0:21368:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d943eba600/0x85f51a6b967156d1 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0xd4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051352.162262:0:21368:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d943eba600/0x85f51a6b967156d1 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0xd4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051352.162272:0:21368:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d943eba600/0x85f51a6b967156d1 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0xd4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051352.162288:0:21368:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d943eba600 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:1.0:1777051352.162294:0:21368:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d943eba600/0x85f51a6b967156d1 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0xd4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051352.162305:0:21368:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d943eba600/0x85f51a6b967156d1 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0xd4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051352.162320:0:21368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xd4:0x0].0x0 (ffff99d94e6b6100) 00010000:00010000:1.0:1777051352.162324:0:21368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777051352.162331:0:21368:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d943eba600/0x85f51a6b967156d1 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0xd4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051352.162340:0:21368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d943eba600/0x85f51a6b967156d1 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0xd4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051352.162363:0:21368:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d943ebb400/0x85f51a6b967156d8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xd4:0x0].0x674069f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051352.162373:0:21368:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d943ebb400/0x85f51a6b967156d8 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0xd4:0x0].0x674069f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051352.162381:0:21368:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d943ebb400/0x85f51a6b967156d8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xd4:0x0].0x674069f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051352.162389:0:21368:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d943ebb400 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:1.0:1777051352.162394:0:21368:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d943ebb400/0x85f51a6b967156d8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xd4:0x0].0x674069f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051352.162403:0:21368:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d943ebb400/0x85f51a6b967156d8 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0xd4:0x0].0x674069f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051352.162422:0:21368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xd4:0x0].0x674069f9 (ffff99d94e6b6600) 00010000:00010000:1.0:1777051352.162426:0:21368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777051352.162431:0:21368:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d943ebb400/0x85f51a6b967156d8 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0xd4:0x0].0x674069f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051352.162440:0:21368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d943ebb400/0x85f51a6b967156d8 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xd4:0x0].0x674069f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051352.162482:0:21368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d943eba200/0x85f51a6b967156ca lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0xd4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5ff8 expref: 22 pid: 21368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051352.162496:0:21368:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d943ebb000/0x85f51a6b967156df lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0xc2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5ff8 expref: 21 pid: 21368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051352.162503:0:21368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0xc2:0x0].0x0 (ffff99d94e6b6500) 00010000:00010000:1.0:1777051352.162506:0:21368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1777051352.162508:0:21368:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d943ebb000, rc 0) 00000100:00100000:1.0:1777051352.162583:0:21368:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95a583800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+21:133455:x1863365425904512:12345-192.168.201.46@tcp:101:lfs.0 Request processed in 1462us (1670us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051352.162592:0:21368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111859 00000100:00100000:1.0:1777051352.165606:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051352.165727:0:27887:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425904640 00000100:00100000:2.0:1777051352.165738:0:27887:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425904640 00000100:00100000:2.0:1777051352.165804:0:27887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 7966 00000100:00100000:2.0:1777051352.165817:0:27887:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d944e11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+50:2437:x1863365425904640:12345-192.168.201.46@tcp:101:lfs.0 00010000:00010000:2.0:1777051352.165838:0:27887:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051352.165857:0:27887:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c299d683/0x85f51a6b967156e6 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x1e2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b5fff expref: -99 pid: 27887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051352.165935:0:27887:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d944073800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:27887:1863365452584448:192.168.201.46@tcp:106: 00000100:00100000:2.0:1777051352.166053:0:27887:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da5077bd80 going to sleep for 11 seconds 00002000:00010000:0.0:1777051352.169374:0:27887:0:(ofd_lvb.c:259:ofd_lvbo_update()) res: [0x280000401:0x1e2:0x0] updating lvb size: 0 -> 1048576 00002000:00010000:0.0:1777051352.169383:0:27887:0:(ofd_lvb.c:265:ofd_lvbo_update()) res: [0x280000401:0x1e2:0x0] updating lvb mtime: 0 -> 1777051351 00002000:00010000:0.0:1777051352.169387:0:27887:0:(ofd_lvb.c:271:ofd_lvbo_update()) res: [0x280000401:0x1e2:0x0] updating lvb atime: 0 -> 1777051351 00002000:00010000:0.0:1777051352.169390:0:27887:0:(ofd_lvb.c:277:ofd_lvbo_update()) res: [0x280000401:0x1e2:0x0] updating lvb ctime: 0 -> 1777051351 00002000:00010000:0.0:1777051352.169393:0:27887:0:(ofd_lvb.c:283:ofd_lvbo_update()) res: [0x280000401:0x1e2:0x0] updating lvb blocks: 0 -> 2048 00000100:00100000:0.0:1777051352.169421:0:27887:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d944073800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:27887:1863365452584448:192.168.201.46@tcp:106: 00010000:00010000:0.0:1777051352.169475:0:27887:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c299d683/0x85f51a6b967156e6 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x1e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5fff expref: 51 pid: 27887 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051352.169527:0:27887:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c299d683/0x85f51a6b967156e6 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x1e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5fff expref: 51 pid: 27887 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051352.169548:0:27887:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99da7d784e00, rc 0) 00000100:00100000:0.0:1777051352.169618:0:27887:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d944e11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+50:2437:x1863365425904640:12345-192.168.201.46@tcp:101:lfs.0 Request processed in 3803us (4033us total) trans 0 rc 301/301 00000100:00100000:0.0:1777051352.169630:0:27887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 7966 00000100:00100000:0.0:1777051352.174642:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051352.174760:0:6579:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425904768 00000100:00100000:1.0:1777051352.174774:0:6579:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425904768 00000100:00100000:1.0:1777051352.175098:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111860 00000100:00100000:1.0:1777051352.175113:0:6579:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95a580000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+21:133455:x1863365425904768:12345-192.168.201.46@tcp:101:lfs.0 00010000:00010000:1.0:1777051352.175142:0:6579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777051352.175265:0:6579:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d943ebb400/0x85f51a6b967156ed lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6006 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051352.175368:0:6579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d943eba600/0x85f51a6b967156f4 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051352.175391:0:6579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d943eba600/0x85f51a6b967156f4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051352.175409:0:6579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d943eba600/0x85f51a6b967156f4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1777051352.175475:0:6579:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0xd3:0x0]: returning size 4096 00000004:00200000:1.0:1777051352.175482:0:6579:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1777051352.175513:0:6579:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99d943eba600/0x85f51a6b967156f4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051352.175573:0:6579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d943ebb400/0x85f51a6b967156ed lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6006 expref: 23 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051352.175598:0:6579:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d943eba600/0x85f51a6b967156f4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6006 expref: 22 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051352.175611:0:6579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xd3:0x0].0x0 (ffff99d94e6b6b00) 00010000:00010000:1.0:1777051352.175615:0:6579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1777051352.175620:0:6579:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d943eba600, rc 0) 00000100:00100000:1.0:1777051352.175704:0:6579:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95a580000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+22:133455:x1863365425904768:12345-192.168.201.46@tcp:101:lfs.0 Request processed in 593us (1073us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051352.175715:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111860 00000100:00100000:1.0:1777051352.181023:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051352.181138:0:6580:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425904896 00000100:00100000:3.0:1777051352.181150:0:6580:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425904896 00000100:00100000:3.0:1777051352.181871:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111861 00000100:00100000:3.0:1777051352.181888:0:6580:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d944e11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+22:133455:x1863365425904896:12345-192.168.201.46@tcp:101:lfs.0 00010000:00010000:3.0:1777051352.181916:0:6580:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777051352.181943:0:6580:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6200/0x85f51a6b967156fb lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b600d expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051352.182032:0:6580:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6000/0x85f51a6b96715702 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xd4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051352.182052:0:6580:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6000/0x85f51a6b96715702 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xd4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051352.182069:0:6580:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6000/0x85f51a6b96715702 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xd4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1777051352.182123:0:6580:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0xd4:0x0]: returning size 4096 00000004:00200000:3.0:1777051352.182128:0:6580:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1777051352.182157:0:6580:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6000/0x85f51a6b96715702 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xd4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051352.182250:0:6580:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6200/0x85f51a6b967156fb lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b600d expref: 24 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051352.182274:0:6580:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6000/0x85f51a6b96715702 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xd4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b600d expref: 23 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051352.182288:0:6580:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xd4:0x0].0x0 (ffff99d94e6b6100) 00010000:00010000:3.0:1777051352.182292:0:6580:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1777051352.182296:0:6580:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d941ad6000, rc 0) 00000100:00100000:3.0:1777051352.182369:0:6580:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d944e11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+23:133455:x1863365425904896:12345-192.168.201.46@tcp:101:lfs.0 Request processed in 485us (1356us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051352.182379:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111861 00000100:00100000:2.0:1777051352.190293:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051352.190402:0:8471:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425905024 00000100:00100000:0.0:1777051352.190418:0:8471:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425905024 00000100:00100000:0.0:1777051352.190522:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 7967 00000100:00100000:0.0:1777051352.190537:0:8471:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d944071180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+50:2436:x1863365425905024:12345-192.168.201.46@tcp:101:lfs.0 00010000:00010000:0.0:1777051352.190565:0:8471:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051352.190606:0:8471:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000051eb6e5f/0x85f51a6b96715709 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x1e2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6014 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051352.190698:0:8471:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95a581500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8471:1863365452584576:192.168.201.46@tcp:106: 00000100:00100000:0.0:1777051352.190822:0:8471:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d95361f600 going to sleep for 11 seconds 00000100:00100000:2.0:1777051352.194754:0:8471:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95a581500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8471:1863365452584576:192.168.201.46@tcp:106: 00010000:00010000:2.0:1777051352.195051:0:8471:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000051eb6e5f/0x85f51a6b96715709 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x1e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6014 expref: 51 pid: 8471 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051352.195089:0:8471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000051eb6e5f/0x85f51a6b96715709 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x1e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6014 expref: 51 pid: 8471 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051352.195110:0:8471:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99da40030c00, rc 0) 00000100:00100000:2.0:1777051352.195550:0:8471:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d944071180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+50:2436:x1863365425905024:12345-192.168.201.46@tcp:101:lfs.0 Request processed in 5014us (5268us total) trans 0 rc 301/301 00000100:00100000:2.0:1777051352.195564:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 7967 00000100:00100000:1.0:1777051352.200672:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051352.200796:0:6581:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425905280 00000100:00100000:0.0:1777051352.200811:0:6581:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425905280 00000100:00100000:0.0:1777051352.200901:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111862 00000100:00100000:0.0:1777051352.200918:0:6581:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d944e13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+23:133455:x1863365425905280:12345-192.168.201.46@tcp:58:lfs.0 00000040:00080000:0.0:1777051352.202502:0:6581:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1777051352.203477:0:6581:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].6, 64 off8576 00000040:00080000:0.0:1777051352.203652:0:6581:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2b:0x0].1, 136 off8328 00000100:00100000:0.0:1777051352.203783:0:6581:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d944e13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+23:133455:x1863365425905280:12345-192.168.201.46@tcp:58:lfs.0 Request processed in 2865us (3126us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051352.203797:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111862 00000100:00100000:1.0:1777051352.342435:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d944070e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3680:1863365452584704:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1777051352.342555:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051352.342627:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da4384ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3680:1863365452584832:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1777051352.342640:0:47388:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452584704 00000100:00100000:2.0:1777051352.342655:0:47388:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452584704 00000100:00100000:1.0:1777051352.342673:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051352.343017:0:47388:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452584832 00000100:00100000:2.0:1777051352.343024:0:47388:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452584832 00000100:00100000:2.0:1777051352.343082:0:47388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5600 00000100:00100000:2.0:1777051352.343100:0:47388:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d944e10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3680:x1863365452584704:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1777051352.343194:0:47388:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 430292544 pending 0 free 3645853696 avail 3414331392 00000100:00100000:2.0:1777051352.343275:0:47388:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d944e10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3680:x1863365452584704:12345-0@lo:13:osp-pre-1-0.0 Request processed in 178us (719us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051352.343289:0:47388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5600 00000100:00100000:2.0:1777051352.343325:0:47388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5601 00000100:00100000:2.0:1777051352.343339:0:47388:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3680:x1863365452584832:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1777051352.343352:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d944070e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3680:1863365452584704:0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1777051352.343399:0:47388:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 455081536 pending 0 free 3862671360 avail 3629002752 00000100:00100000:2.0:1777051352.343462:0:47388:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3680:x1863365452584832:12345-0@lo:13:osp-pre-0-0.0 Request processed in 123us (788us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051352.343476:0:47388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5601 00000100:00100000:1.0:1777051352.343518:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da4384ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3680:1863365452584832:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1777051352.343619:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1777051352.343628:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000040:00080000:2.0:1777051352.598656:0:103189:0:(llog.c:801:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:2.0:1777051352.598667:0:103189:0:(llog_cat.c:158:llog_cat_process_common()) processing log [0x1:0x2b:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1777051352.598704:0:103189:0:(llog.c:858:llog_process_thread()) stop processing plain [0x1:0x2b:0x0] index 2 count 2 00000040:00080000:2.0:1777051352.598715:0:103189:0:(llog.c:858:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00000100:00100000:2.0:1777051352.599082:0:103189:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d944071500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:103189:1863365452584960:192.168.201.46@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1777051352.599289:0:103189:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da5077b900 going to sleep for 11 seconds 00000100:00100000:2.0:1777051352.604703:0:103189:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d944071500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:103189:1863365452584960:192.168.201.46@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1777051352.605689:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051352.605809:0:27885:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425905408 00000100:00100000:2.0:1777051352.605821:0:27885:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425905408 00000100:00100000:2.0:1777051352.605899:0:27885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111863 00000100:00100000:2.0:1777051352.605916:0:27885:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95a581c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c11b6966-0775-44d2-bdc6-c74c26eb2226+19:133465:x1863365425905408:12345-192.168.201.46@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1777051352.605956:0:27885:0:(mdt_handler.c:7958:mdt_fid2path()) path get [0x200000bd3:0xc2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1777051352.606116:0:27885:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95a581c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c11b6966-0775-44d2-bdc6-c74c26eb2226+19:133465:x1863365425905408:12345-192.168.201.46@tcp:53:lhsmtool_posix.0 Request processed in 202us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051352.606453:0:27885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111863 00000100:00100000:0.0:1777051352.610672:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051352.610802:0:27882:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425905664 00000100:00100000:2.0:1777051352.610813:0:27882:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425905664 00000100:00100000:2.0:1777051352.610866:0:27882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111864 00000100:00100000:2.0:1777051352.610881:0:27882:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95a583100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+19:133465:x1863365425905664:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1777051352.610903:0:27882:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051352.610931:0:27882:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784a00/0x85f51a6b96715710 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b601b expref: -99 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051352.611071:0:27882:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d785a00/0x85f51a6b96715717 lrc: 3/1,0 mode: --/PR res: [0x200000bd3:0xc2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051352.611092:0:27882:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d785a00/0x85f51a6b96715717 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0xc2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051352.611427:0:27882:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d785a00/0x85f51a6b96715717 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0xc2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1777051352.611449:0:27882:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd3:0xc2:0x0]: returning size 1048576 00010000:00010000:2.0:1777051352.611604:0:27882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784a00/0x85f51a6b96715710 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b601b expref: 22 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051352.611632:0:27882:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d785a00/0x85f51a6b96715717 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0xc2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b601b expref: 21 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051352.611647:0:27882:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0xc2:0x0].0x0 (ffff99d94e6b6500) 00010000:00010000:2.0:1777051352.611652:0:27882:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1777051352.611658:0:27882:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99da7d785a00, rc 0) 00000100:00100000:2.0:1777051352.611988:0:27882:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95a583100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+21:133465:x1863365425905664:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 Request processed in 1109us (1321us total) trans 30064771089 rc 0/0 00000100:00100000:2.0:1777051352.612001:0:27882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111864 00000100:00100000:0.0:1777051352.616671:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051352.616744:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051352.616771:0:8468:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425905920 00000100:00100000:2.0:1777051352.616783:0:8468:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425905920 00000100:00100000:2.0:1777051352.616862:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 7968 00000100:00100000:2.0:1777051352.616879:0:8468:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95a581500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+52:2437:x1863365425905920:12345-192.168.201.46@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1777051352.616933:0:8468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000060c30f6d/0x85f51a6b96715725 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x1e2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051352.616966:0:8468:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b2b12361/0x85f51a6b967155ea lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5fb2 expref: 52 pid: 55805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051352.616981:0:8468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 1 00000100:00100000:1.0:1777051352.616985:0:6564:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425905792 00010000:00010000:2.0:1777051352.616985:0:8468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1777051352.616992:0:8468:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000060c30f6d/0x85f51a6b96715725 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x1e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051352.616996:0:6564:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425905792 00010000:00010000:2.0:1777051352.617045:0:8468:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b2b12361/0x85f51a6b967155ea lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5fb2 expref: 52 pid: 55805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051352.617073:0:8468:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b2b12361/0x85f51a6b967155ea lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5fb2 expref: 52 pid: 55805 timeout: 8081 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051352.617100:0:8468:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d944071500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8468:1863365452585088:192.168.201.46@tcp:104: 00000100:00100000:0.0:1777051352.617154:0:6564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13676 00000100:00100000:0.0:1777051352.617196:0:6564:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95fbaf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+21:2439:x1863365425905792:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1777051352.617217:0:6564:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777051352.617246:0:6564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d785a00/0x85f51a6b96715717 lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0xc2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b601b expref: 21 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051352.617255:0:8468:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da5077b900 going to sleep for 11 seconds 00010000:00010000:0.0:1777051352.617275:0:6564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0xc2:0x0].0x0 (ffff99d94e6b6500) 00010000:00010000:0.0:1777051352.617285:0:6564:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1777051352.617376:0:6564:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95fbaf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+20:2439:x1863365425905792:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 208us (631us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051352.617408:0:6564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13676 00000100:00100000:2.0:1777051352.622727:0:8468:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d944071500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8468:1863365452585088:192.168.201.46@tcp:104: 00010000:00010000:2.0:1777051352.622764:0:8468:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000060c30f6d/0x85f51a6b96715725 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x1e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051352.627895:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051352.628035:0:47597:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425906048 00000100:00100000:3.0:1777051352.628528:0:47597:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425906048 00010000:00010000:3.0:1777051352.628579:0:47597:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b2b12361/0x85f51a6b967155ea lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5fb2 expref: 53 pid: 55805 timeout: 8081 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051352.628652:0:47597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3842 00000100:00100000:3.0:1777051352.628668:0:47597:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95fbaca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+53:2436:x1863365425906048:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1777051352.628691:0:47597:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777051352.628717:0:47597:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b2b12361/0x85f51a6b967155ea lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5fb2 expref: 53 pid: 55805 timeout: 8081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051352.628740:0:47597:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b2b12361/0x85f51a6b967155ea lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5fb2 expref: 53 pid: 55805 timeout: 8081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051352.628772:0:47597:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b2b12361/0x85f51a6b967155ea lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5fb2 expref: 53 pid: 55805 timeout: 8081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051352.628805:0:47597:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051352.628810:0:47597:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051352.628818:0:47597:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000060c30f6d/0x85f51a6b96715725 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x1e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051352.628836:0:47597:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000060c30f6d/0x85f51a6b96715725 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x1e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051352.628888:0:47597:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1777051352.628925:0:8468:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000060c30f6d/0x85f51a6b96715725 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x1e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051352.628941:0:8468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000060c30f6d/0x85f51a6b96715725 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x1e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051352.628964:0:47597:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95fbaca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+52:2436:x1863365425906048:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 299us (1077us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051352.628978:0:47597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3842 00010000:00010000:1.0:1777051352.628995:0:8468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000060c30f6d/0x85f51a6b96715725 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x1e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051352.629013:0:8468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000060c30f6d/0x85f51a6b96715725 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x1e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051352.629028:0:8468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000060c30f6d/0x85f51a6b96715725 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x1e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051352.629042:0:8468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da7d784600 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:1.0:1777051352.629048:0:8468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000060c30f6d/0x85f51a6b96715725 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x1e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051352.629065:0:8468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000060c30f6d/0x85f51a6b96715725 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x1e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051352.629428:0:8468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000060c30f6d/0x85f51a6b96715725 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x1e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051352.629444:0:8468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000060c30f6d/0x85f51a6b96715725 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x1e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051352.629535:0:8468:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95a581500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+51:2437:x1863365425905920:12345-192.168.201.46@tcp:1:lhsmtool_posix.0 Request processed in 12659us (12870us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051352.629554:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 7968 00000100:00100000:1.0:1777051352.633910:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051352.633998:0:10328:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425906304 00000100:00100000:3.0:1777051352.634010:0:10328:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425906304 00000100:00100000:3.0:1777051352.634411:0:10328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111865 00000100:00100000:3.0:1777051352.634430:0:10328:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+20:133465:x1863365425906304:12345-192.168.201.46@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1777051352.634652:0:10328:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+20:133465:x1863365425906304:12345-192.168.201.46@tcp:57:lhsmtool_posix.0 Request processed in 224us (743us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051352.634668:0:10328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111865 00000100:00100000:0.0:1777051352.639690:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051352.639782:0:55805:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425906432 00000100:00100000:3.0:1777051352.639793:0:55805:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425906432 00000100:00100000:3.0:1777051352.639854:0:55805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 7969 00000100:00100000:3.0:1777051352.639865:0:55805:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95fbace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c11b6966-0775-44d2-bdc6-c74c26eb2226+51:2439:x1863365425906432:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1777051352.639883:0:55805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777051352.639906:0:55805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b2b12361/0x85f51a6b9671572c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x1e2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6022 expref: -99 pid: 55805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1777051352.639942:0:55805:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x1e2:0x0] initial LVB size: 1048576, mtime: 0x69eba6d7, atime: 0x0, ctime: 0x69eba6d7, blocks: 0x800 00010000:00010000:3.0:1777051352.639969:0:55805:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051352.639973:0:55805:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051352.639985:0:55805:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b2b12361/0x85f51a6b9671572c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x1e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6022 expref: 52 pid: 55805 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051352.640011:0:55805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b2b12361/0x85f51a6b9671572c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x1e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6022 expref: 52 pid: 55805 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051352.640032:0:55805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d941ad7600, rc 0) 00000100:00100000:3.0:1777051352.640104:0:55805:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95fbace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c11b6966-0775-44d2-bdc6-c74c26eb2226+52:2439:x1863365425906432:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 Request processed in 239us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051352.640112:0:55805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 7969 00000100:00100000:1.0:1777051352.644456:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051352.644542:0:6580:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425906688 00000100:00100000:3.0:1777051352.644553:0:6580:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425906688 00000100:00100000:3.0:1777051352.644640:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111866 00000100:00100000:3.0:1777051352.644657:0:6580:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+20:133465:x1863365425906688:12345-192.168.201.46@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1777051352.644798:0:6580:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+20:133465:x1863365425906688:12345-192.168.201.46@tcp:57:lhsmtool_posix.0 Request processed in 144us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051352.644811:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111866 00000100:00100000:0.0:1777051352.658746:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051352.658878:0:46203:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425906816 00000100:00100000:3.0:1777051352.658892:0:46203:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425906816 00002000:00100000:3.0:1777051352.658965:0:46203:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x1e2:0x0] (0->1048575) req@ffff99d95fbae300 x1863365425906816/t0(0) o3->c11b6966-0775-44d2-bdc6-c74c26eb2226@192.168.201.46@tcp:313/0 lens 488/0 e 0 to 0 dl 1777051363 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1777051352.658985:0:46203:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99d95fbae300 with x1863365425906816 ext(0->1048575) 00002000:00010000:3.0:1777051352.658995:0:46203:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99d95fbae300 00000100:00100000:3.0:1777051352.659054:0:46203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 1760 00000100:00100000:3.0:1777051352.659071:0:46203:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95fbae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:c11b6966-0775-44d2-bdc6-c74c26eb2226+52:2439:x1863365425906816:12345-192.168.201.46@tcp:3:lhsmtool_posix.0 00000100:00100000:3.0:1777051352.685300:0:46203:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95fbae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:c11b6966-0775-44d2-bdc6-c74c26eb2226+52:2439:x1863365425906816:12345-192.168.201.46@tcp:3:lhsmtool_posix.0 Request processed in 26220us (26553us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1777051352.685321:0:46203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 1760 00002000:00100000:3.0:1777051352.685341:0:46203:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x1e2:0x0] (0->1048575) req@ffff99d95fbae300 x1863365425906816/t0(0) o3->c11b6966-0775-44d2-bdc6-c74c26eb2226@192.168.201.46@tcp:313/0 lens 488/440 e 0 to 0 dl 1777051363 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1777051352.685359:0:46203:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99d95fbae300 with x1863365425906816 ext(0->1048575) 00002000:00010000:3.0:1777051352.685368:0:46203:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99d95fbae300 00000100:00100000:0.0:1777051352.709752:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051352.710068:0:46497:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425906944 00000100:00100000:2.0:1777051352.710082:0:46497:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425906944 00000100:00100000:2.0:1777051352.710240:0:46497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111867 00000100:00100000:2.0:1777051352.710260:0:46497:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95fbad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:c11b6966-0775-44d2-bdc6-c74c26eb2226+20:133465:x1863365425906944:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1777051352.710288:0:46497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051352.710317:0:46497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784a00/0x85f51a6b96715733 lrc: 2/0,0 mode: --/PR res: [0x200000bd3:0xc2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6029 expref: -99 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051352.710375:0:46497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d785600/0x85f51a6b9671573a lrc: 3/1,0 mode: --/PR res: [0x200000bd3:0xc2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051352.710398:0:46497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d785600/0x85f51a6b9671573a lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0xc2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051352.710418:0:46497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d785600/0x85f51a6b9671573a lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0xc2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051352.710575:0:46497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784a00/0x85f51a6b96715733 lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0xc2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6029 expref: 22 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051352.710628:0:46497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d785600/0x85f51a6b9671573a lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0xc2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6029 expref: 21 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051352.710644:0:46497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0xc2:0x0].0x0 (ffff99d94e6b6500) 00010000:00010000:2.0:1777051352.710650:0:46497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1777051352.710655:0:46497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99da7d785600, rc 0) 00000100:00100000:2.0:1777051352.710732:0:46497:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95fbad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:c11b6966-0775-44d2-bdc6-c74c26eb2226+21:133465:x1863365425906944:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 Request processed in 477us (990us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051352.710981:0:46497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111867 00000100:00100000:1.0:1777051352.718630:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051352.719237:0:8492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425907072 00000100:00100000:3.0:1777051352.719251:0:8492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425907072 00000100:00100000:3.0:1777051352.719351:0:8492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111868 00000100:00100000:3.0:1777051352.719370:0:8492:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+21:133465:x1863365425907072:12345-192.168.201.46@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1777051352.719521:0:8492:0:(mdt_handler.c:7958:mdt_fid2path()) path get [0x200000bd3:0xc2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1777051352.719939:0:8492:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+21:133465:x1863365425907072:12345-192.168.201.46@tcp:53:lhsmtool_posix.0 Request processed in 569us (1314us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051352.719955:0:8492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111868 00000100:00100000:1.0:1777051352.724885:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051352.724972:0:13320:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425907200 00000100:00100000:2.0:1777051352.724985:0:13320:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425907200 00000100:00100000:3.0:1777051352.725462:0:8470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 7970 00000100:00100000:3.0:1777051352.725484:0:8470:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+52:2437:x1863365425907200:12345-192.168.201.46@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1777051352.725539:0:8470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000026ade6d4/0x85f51a6b96715741 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x1e2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051352.725565:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051352.725569:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051352.725577:0:8470:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000026ade6d4/0x85f51a6b96715741 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x1e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051352.725631:0:8470:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000026ade6d4/0x85f51a6b96715741 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x1e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051352.725668:0:8470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000026ade6d4/0x85f51a6b96715741 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x1e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051352.725684:0:8470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000026ade6d4/0x85f51a6b96715741 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x1e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051352.725968:0:8470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000026ade6d4/0x85f51a6b96715741 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x1e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051352.725981:0:8470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d941ad6200 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:3.0:1777051352.725987:0:8470:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000026ade6d4/0x85f51a6b96715741 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x1e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051352.726002:0:8470:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000026ade6d4/0x85f51a6b96715741 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x1e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051352.726026:0:8470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000026ade6d4/0x85f51a6b96715741 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x1e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051352.726039:0:8470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000026ade6d4/0x85f51a6b96715741 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x1e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051352.726143:0:8470:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+52:2437:x1863365425907200:12345-192.168.201.46@tcp:1:lhsmtool_posix.0 Request processed in 665us (1261us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051352.726155:0:8470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 7970 00000100:00100000:1.0:1777051352.730728:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051352.731387:0:27882:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425907456 00000100:00100000:2.0:1777051352.731397:0:27882:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425907456 00000100:00100000:2.0:1777051352.731583:0:27882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111869 00000100:00100000:2.0:1777051352.731602:0:27882:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+21:133465:x1863365425907456:12345-192.168.201.46@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1777051352.731695:0:27882:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784a00/0x85f51a6b96715748 lrc: 3/0,1 mode: --/PW res: [0x200000bd3:0xc2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051352.731725:0:27882:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d785600/0x85f51a6b9671573a lrc: 2/0,0 mode: PR/PR res: [0x200000bd3:0xc2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6029 expref: 21 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051352.732067:0:27882:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784a00/0x85f51a6b96715748 lrc: 4/0,1 mode: --/PW res: [0x200000bd3:0xc2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051352.732120:0:27882:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d785600/0x85f51a6b9671573a lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0xc2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6029 expref: 21 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051352.732143:0:27882:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d785600/0x85f51a6b9671573a lrc: 4/0,0 mode: PR/PR res: [0x200000bd3:0xc2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6029 expref: 21 pid: 46497 timeout: 8081 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051352.732194:0:27882:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d944071500 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27882:1863365452585216:192.168.201.46@tcp:104: 00000100:00100000:2.0:1777051352.732335:0:27882:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da5077b900 going to sleep for 11 seconds 00000100:00100000:2.0:1777051352.735539:0:27882:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d944071500 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27882:1863365452585216:192.168.201.46@tcp:104: 00010000:00010000:2.0:1777051352.735599:0:27882:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784a00/0x85f51a6b96715748 lrc: 3/0,1 mode: --/PW res: [0x200000bd3:0xc2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051352.736194:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051352.736310:0:6566:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425907584 00000100:00100000:2.0:1777051352.736321:0:6566:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425907584 00010000:00010000:2.0:1777051352.736365:0:6566:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d785600/0x85f51a6b9671573a lrc: 4/0,0 mode: PR/PR res: [0x200000bd3:0xc2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6029 expref: 22 pid: 46497 timeout: 8081 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051352.736434:0:6566:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3843 00000100:00100000:2.0:1777051352.736445:0:6566:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95fbaf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+22:2437:x1863365425907584:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1777051352.736464:0:6566:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777051352.736476:0:6566:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d785600/0x85f51a6b9671573a lrc: 4/0,0 mode: PR/PR res: [0x200000bd3:0xc2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6029 expref: 22 pid: 46497 timeout: 8081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051352.736503:0:6566:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d785600/0x85f51a6b9671573a lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0xc2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6029 expref: 22 pid: 46497 timeout: 8081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051352.736538:0:6566:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d785600/0x85f51a6b9671573a lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0xc2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6029 expref: 22 pid: 46497 timeout: 8081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051352.736565:0:6566:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0xc2:0x0].0x0 (ffff99d94e6b6500) 00010000:00010000:2.0:1777051352.736574:0:6566:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784a00/0x85f51a6b96715748 lrc: 3/0,1 mode: --/PW res: [0x200000bd3:0xc2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051352.736589:0:6566:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784a00/0x85f51a6b96715748 lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0xc2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051352.736603:0:6566:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784a00/0x85f51a6b96715748 lrc: 4/0,1 mode: PW/PW res: [0x200000bd3:0xc2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051352.736647:0:6566:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1777051352.737048:0:6566:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95fbaf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+21:2437:x1863365425907584:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 599us (880us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051352.737064:0:6566:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3843 00010000:00010000:3.0:1777051352.737311:0:27882:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784a00/0x85f51a6b96715748 lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0xc2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051352.737333:0:27882:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784a00/0x85f51a6b96715748 lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0xc2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051352.737636:0:27882:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784a00/0x85f51a6b96715748 lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0xc2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051352.737945:0:27882:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784a00/0x85f51a6b96715748 lrc: 2/0,0 mode: PW/PW res: [0x200000bd3:0xc2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051352.737959:0:27882:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784a00/0x85f51a6b96715748 lrc: 3/0,0 mode: PW/PW res: [0x200000bd3:0xc2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051352.737971:0:27882:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da7d784a00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:2.0:1777051352.737978:0:27882:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784a00/0x85f51a6b96715748 lrc: 3/0,0 mode: PW/PW res: [0x200000bd3:0xc2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051352.737991:0:27882:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784a00/0x85f51a6b96715748 lrc: 4/0,0 mode: PW/PW res: [0x200000bd3:0xc2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051352.738009:0:27882:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0xc2:0x0].0x0 (ffff99d94e6b6500) 00010000:00010000:2.0:1777051352.738015:0:27882:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1777051352.738022:0:27882:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784a00/0x85f51a6b96715748 lrc: 2/0,0 mode: --/PW res: [0x200000bd3:0xc2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051352.738034:0:27882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784a00/0x85f51a6b96715748 lrc: 0/0,0 mode: --/PW res: [0x200000bd3:0xc2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051352.738598:0:27882:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+21:133465:x1863365425907456:12345-192.168.201.46@tcp:57:lhsmtool_posix.0 Request processed in 7000us (7870us total) trans 30064771090 rc 0/0 00000100:00100000:2.0:1777051352.738615:0:27882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111869 00000040:00080000:1.0:1777051352.739829:0:103189:0:(llog.c:801:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:1.0:1777051352.739837:0:103189:0:(llog_cat.c:158:llog_cat_process_common()) processing log [0x1:0x2b:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1777051352.739875:0:103189:0:(llog.c:858:llog_process_thread()) stop processing plain [0x1:0x2b:0x0] index 2 count 2 00000040:00080000:1.0:1777051352.739886:0:103189:0:(llog.c:858:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00000100:00100000:1.0:1777051352.742388:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051352.742617:0:24269:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425907840 00000100:00100000:3.0:1777051352.742629:0:24269:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425907840 00000100:00100000:3.0:1777051352.742712:0:24269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3324 00000100:00100000:3.0:1777051352.742733:0:24269:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d960409180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+21:133465:x1863365425907840:12345-192.168.201.46@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1777051352.743006:0:24269:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d960409180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+22:133465:x1863365425907840:12345-192.168.201.46@tcp:35:lhsmtool_posix.0 Request processed in 277us (618us total) trans 30064771091 rc 0/0 00000100:00100000:3.0:1777051352.743024:0:24269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3324 00000040:00080000:1.0:1777051352.889010:0:105201:0:(llog.c:801:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:1.0:1777051352.889020:0:105201:0:(llog_cat.c:158:llog_cat_process_common()) processing log [0x1:0x2b:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1777051352.889058:0:105201:0:(llog.c:858:llog_process_thread()) stop processing plain [0x1:0x2b:0x0] index 2 count 2 00000040:00080000:1.0:1777051352.889068:0:105201:0:(llog.c:858:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00000100:00100000:2.0:1777051352.939428:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051352.939619:0:6579:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425907968 00000100:00100000:1.0:1777051352.939633:0:6579:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425907968 00000100:00100000:1.0:1777051352.939718:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111870 00000100:00100000:1.0:1777051352.939733:0:6579:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d944071500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+23:133466:x1863365425907968:12345-192.168.201.46@tcp:101:lfs.0 00010000:00010000:1.0:1777051352.940049:0:6579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777051352.940080:0:6579:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d943eba200/0x85f51a6b9671574f lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6030 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051352.940192:0:6579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d943ebb400/0x85f51a6b96715756 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051352.940214:0:6579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d943ebb400/0x85f51a6b96715756 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051352.940234:0:6579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d943ebb400/0x85f51a6b96715756 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051352.940260:0:6579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d943eba000/0x85f51a6b9671575d lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xd3:0x0].0xceea225b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051352.940273:0:6579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d943eba000/0x85f51a6b9671575d lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xd3:0x0].0xceea225b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051352.940285:0:6579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d943eba000/0x85f51a6b9671575d lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xd3:0x0].0xceea225b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051352.940351:0:6579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d943ebbe00/0x85f51a6b96715764 lrc: 3/1,0 mode: --/PR res: [0x240000404:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051352.940367:0:6579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d943ebbe00/0x85f51a6b96715764 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0xe:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051352.940401:0:6579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d943ebbe00/0x85f51a6b96715764 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0xe:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1777051352.940432:0:6579:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99d943ebbe00/0x85f51a6b96715764 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0xe:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051352.940488:0:6579:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d943ebb400/0x85f51a6b96715756 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051352.940502:0:6579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d943ebb400/0x85f51a6b96715756 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051352.940512:0:6579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d943ebb400/0x85f51a6b96715756 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051352.940523:0:6579:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d943ebb400/0x85f51a6b96715756 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051352.940534:0:6579:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d943ebb400 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:1.0:1777051352.940541:0:6579:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d943ebb400/0x85f51a6b96715756 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051352.940553:0:6579:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d943ebb400/0x85f51a6b96715756 lrc: 5/0,0 mode: CR/CR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051352.940573:0:6579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xd3:0x0].0x0 (ffff99d94e6b6b00) 00010000:00010000:1.0:1777051352.940579:0:6579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777051352.940586:0:6579:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d943ebb400/0x85f51a6b96715756 lrc: 3/0,0 mode: --/CR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051352.940597:0:6579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d943ebb400/0x85f51a6b96715756 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051352.940618:0:6579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d943eba000/0x85f51a6b9671575d lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xd3:0x0].0xceea225b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051352.940628:0:6579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d943eba000/0x85f51a6b9671575d lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0xd3:0x0].0xceea225b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051352.940638:0:6579:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d943eba000/0x85f51a6b9671575d lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xd3:0x0].0xceea225b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051352.940647:0:6579:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d943eba000 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:1.0:1777051352.940652:0:6579:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d943eba000/0x85f51a6b9671575d lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xd3:0x0].0xceea225b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051352.940662:0:6579:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d943eba000/0x85f51a6b9671575d lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0xd3:0x0].0xceea225b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051352.940676:0:6579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xd3:0x0].0xceea225b (ffff99d94e6b6000) 00010000:00010000:1.0:1777051352.940680:0:6579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777051352.940685:0:6579:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d943eba000/0x85f51a6b9671575d lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0xd3:0x0].0xceea225b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051352.940695:0:6579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d943eba000/0x85f51a6b9671575d lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xd3:0x0].0xceea225b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051352.940742:0:6579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d943eba200/0x85f51a6b9671574f lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6030 expref: 25 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051352.940770:0:6579:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d943ebbe00/0x85f51a6b96715764 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0xe:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6030 expref: 24 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051352.940793:0:6579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0xe:0x0].0x0 (ffff99d9413d2e00) 00010000:00010000:1.0:1777051352.940799:0:6579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1777051352.940803:0:6579:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d943ebbe00, rc 0) 00000100:00100000:1.0:1777051352.940884:0:6579:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d944071500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+24:133466:x1863365425907968:12345-192.168.201.46@tcp:101:lfs.0 Request processed in 1154us (1464us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051352.940896:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111870 00000100:00100000:1.0:1777051352.944722:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051352.945117:0:46494:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425908096 00000100:00100000:0.0:1777051352.945130:0:46494:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425908096 00000100:00100000:0.0:1777051352.945253:0:46494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111871 00000100:00100000:0.0:1777051352.945270:0:46494:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d960408380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+48:133466:x1863365425908096:12345-192.168.201.46@tcp:101:lfs.0 00010000:00010000:0.0:1777051352.945294:0:46494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051352.945318:0:46494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d95595b200/0x85f51a6b9671576b lrc: 2/0,0 mode: --/CR res: [0x240000404:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6037 expref: -99 pid: 46494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051352.945408:0:46494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d95595ac00/0x85f51a6b96715772 lrc: 3/1,0 mode: --/PR res: [0x240000404:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051352.945427:0:46494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d95595ac00/0x85f51a6b96715772 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0xe:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 46494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051352.945446:0:46494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d95595ac00/0x85f51a6b96715772 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0xe:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 46494 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1777051352.945515:0:46494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0xe:0x0]: returning size 4096 00000004:00200000:0.0:1777051352.945521:0:46494:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:0.0:1777051352.945576:0:46494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d95595b200/0x85f51a6b9671576b lrc: 0/0,0 mode: --/CR res: [0x240000404:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6037 expref: 50 pid: 46494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051352.945603:0:46494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99d95595ac00/0x85f51a6b96715772 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0xe:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6037 expref: 49 pid: 46494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051352.945617:0:46494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0xe:0x0].0x0 (ffff99d94e5e2c00) 00010000:00010000:0.0:1777051352.945622:0:46494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:0.0:1777051352.945628:0:46494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d95595ac00, rc 0) 00000100:00100000:0.0:1777051352.945965:0:46494:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d960408380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+49:133466:x1863365425908096:12345-192.168.201.46@tcp:101:lfs.0 Request processed in 698us (1248us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051352.945977:0:46494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111871 00000100:00100000:3.0:1777051352.952884:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051352.953005:0:6581:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425908224 00000100:00100000:0.0:1777051352.953015:0:6581:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425908224 00000100:00100000:0.0:1777051352.953090:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111872 00000100:00100000:0.0:1777051352.953104:0:6581:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da4384ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+49:133466:x1863365425908224:12345-192.168.201.46@tcp:101:lfs.0 00010000:00010000:0.0:1777051352.953127:0:6581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051352.953150:0:6581:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d95595ae00/0x85f51a6b96715779 lrc: 2/0,0 mode: --/CR res: [0x240000404:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b603e expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051352.953268:0:6581:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d95595a200/0x85f51a6b96715780 lrc: 3/1,0 mode: --/CR res: [0x240000404:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051352.953287:0:6581:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d95595a200/0x85f51a6b96715780 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6581 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051352.953310:0:6581:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d95595a200/0x85f51a6b96715780 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6581 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051352.953330:0:6581:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d95595b600/0x85f51a6b96715787 lrc: 3/1,0 mode: --/PR res: [0x240000404:0xe:0x0].0x674069f9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051352.953341:0:6581:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d95595b600/0x85f51a6b96715787 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0xe:0x0].0x674069f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6581 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051352.953352:0:6581:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d95595b600/0x85f51a6b96715787 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0xe:0x0].0x674069f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6581 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051352.953442:0:6581:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d95595b400/0x85f51a6b9671578e lrc: 3/1,0 mode: --/PR res: [0x240000405:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051352.953455:0:6581:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d95595b400/0x85f51a6b9671578e lrc: 3/1,0 mode: PR/PR res: [0x240000405:0xa:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6581 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051352.953466:0:6581:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d95595b400/0x85f51a6b9671578e lrc: 3/1,0 mode: PR/PR res: [0x240000405:0xa:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6581 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1777051352.953514:0:6581:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000405:0xa:0x0]: returning size 1048576 00000004:00200000:0.0:1777051352.953520:0:6581:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1777051352.953545:0:6581:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff99d95595b400/0x85f51a6b9671578e lrc: 3/1,0 mode: PR/PR res: [0x240000405:0xa:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6581 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051352.953562:0:6581:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d95595b400/0x85f51a6b9671578e lrc: 3/1,0 mode: PR/PR res: [0x240000405:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6581 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051352.953573:0:6581:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d95595a200/0x85f51a6b96715780 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6581 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051352.953588:0:6581:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d95595a200/0x85f51a6b96715780 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6581 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051352.953598:0:6581:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99d95595a200/0x85f51a6b96715780 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6581 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051352.953608:0:6581:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d95595a200 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:0.0:1777051352.953613:0:6581:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d95595a200/0x85f51a6b96715780 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6581 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051352.953622:0:6581:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d95595a200/0x85f51a6b96715780 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6581 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051352.953638:0:6581:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0xe:0x0].0x0 (ffff99d94e5e2c00) 00010000:00010000:0.0:1777051352.953644:0:6581:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777051352.953650:0:6581:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99d95595a200/0x85f51a6b96715780 lrc: 2/0,0 mode: --/CR res: [0x240000404:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6581 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051352.953659:0:6581:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d95595a200/0x85f51a6b96715780 lrc: 0/0,0 mode: --/CR res: [0x240000404:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6581 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051352.954014:0:6581:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d95595b600/0x85f51a6b96715787 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0xe:0x0].0x674069f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6581 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051352.954024:0:6581:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d95595b600/0x85f51a6b96715787 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0xe:0x0].0x674069f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6581 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051352.954033:0:6581:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99d95595b600/0x85f51a6b96715787 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0xe:0x0].0x674069f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6581 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051352.954041:0:6581:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d95595b600 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:0.0:1777051352.954047:0:6581:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d95595b600/0x85f51a6b96715787 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0xe:0x0].0x674069f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6581 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051352.954057:0:6581:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d95595b600/0x85f51a6b96715787 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0xe:0x0].0x674069f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6581 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051352.954074:0:6581:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0xe:0x0].0x674069f9 (ffff99d950c54800) 00010000:00010000:0.0:1777051352.954078:0:6581:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777051352.954083:0:6581:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99d95595b600/0x85f51a6b96715787 lrc: 2/0,0 mode: --/PR res: [0x240000404:0xe:0x0].0x674069f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6581 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051352.954092:0:6581:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d95595b600/0x85f51a6b96715787 lrc: 0/0,0 mode: --/PR res: [0x240000404:0xe:0x0].0x674069f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6581 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051352.954140:0:6581:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d95595ae00/0x85f51a6b96715779 lrc: 0/0,0 mode: --/CR res: [0x240000404:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b603e expref: 51 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051352.954187:0:6581:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99d95595b400/0x85f51a6b9671578e lrc: 3/0,0 mode: PR/PR res: [0x240000405:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b603e expref: 50 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051352.954239:0:6581:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0xa:0x0].0x0 (ffff99d94e5e2d00) 00010000:00010000:0.0:1777051352.954243:0:6581:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1777051352.954248:0:6581:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d95595b400, rc 0) 00000100:00100000:0.0:1777051352.954321:0:6581:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da4384ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+50:133466:x1863365425908224:12345-192.168.201.46@tcp:101:lfs.0 Request processed in 1220us (1441us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051352.954332:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111872 00000100:00100000:2.0:1777051352.961035:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051352.961129:0:27887:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425908352 00000100:00100000:0.0:1777051352.961141:0:27887:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425908352 00000100:00100000:0.0:1777051352.961252:0:27887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 7971 00000100:00100000:0.0:1777051352.961266:0:27887:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d944070e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+50:2436:x1863365425908352:12345-192.168.201.46@tcp:101:lfs.0 00010000:00010000:0.0:1777051352.961288:0:27887:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051352.961310:0:27887:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b457160c/0x85f51a6b96715795 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x102:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6045 expref: -99 pid: 27887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051352.961383:0:27887:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95fbac700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:27887:1863365452585344:192.168.201.46@tcp:106: 00000100:00100000:0.0:1777051352.961507:0:27887:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da6fdb6e40 going to sleep for 11 seconds 00002000:00010000:2.0:1777051352.967072:0:27887:0:(ofd_lvb.c:259:ofd_lvbo_update()) res: [0x280000400:0x102:0x0] updating lvb size: 0 -> 1048576 00002000:00010000:2.0:1777051352.967081:0:27887:0:(ofd_lvb.c:265:ofd_lvbo_update()) res: [0x280000400:0x102:0x0] updating lvb mtime: 0 -> 1777051352 00002000:00010000:2.0:1777051352.967085:0:27887:0:(ofd_lvb.c:271:ofd_lvbo_update()) res: [0x280000400:0x102:0x0] updating lvb atime: 0 -> 1777051352 00002000:00010000:2.0:1777051352.967090:0:27887:0:(ofd_lvb.c:277:ofd_lvbo_update()) res: [0x280000400:0x102:0x0] updating lvb ctime: 0 -> 1777051352 00002000:00010000:2.0:1777051352.967094:0:27887:0:(ofd_lvb.c:283:ofd_lvbo_update()) res: [0x280000400:0x102:0x0] updating lvb blocks: 0 -> 2048 00000100:00100000:2.0:1777051352.967434:0:27887:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95fbac700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:27887:1863365452585344:192.168.201.46@tcp:106: 00010000:00010000:2.0:1777051352.967482:0:27887:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b457160c/0x85f51a6b96715795 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x102:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6045 expref: 51 pid: 27887 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051352.967518:0:27887:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b457160c/0x85f51a6b96715795 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x102:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6045 expref: 51 pid: 27887 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051352.967536:0:27887:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d95595b200, rc 0) 00000100:00100000:2.0:1777051352.967607:0:27887:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d944070e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+50:2436:x1863365425908352:12345-192.168.201.46@tcp:101:lfs.0 Request processed in 6343us (6582us total) trans 0 rc 301/301 00000100:00100000:2.0:1777051352.967619:0:27887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 7971 00000100:00100000:2.0:1777051352.978710:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051352.979002:0:27885:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425908480 00000100:00100000:3.0:1777051352.979017:0:27885:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425908480 00000100:00100000:3.0:1777051352.979110:0:27885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111873 00000100:00100000:3.0:1777051352.979128:0:27885:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d944073800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+50:133466:x1863365425908480:12345-192.168.201.46@tcp:101:lfs.0 00010000:00010000:3.0:1777051352.979188:0:27885:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777051352.979260:0:27885:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d941ad6200/0x85f51a6b9671579c lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b604c expref: -99 pid: 27885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051352.979368:0:27885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d941ad6c00/0x85f51a6b967157a3 lrc: 3/1,0 mode: --/PR res: [0x240000404:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051352.979388:0:27885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d941ad6c00/0x85f51a6b967157a3 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0xe:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 27885 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051352.979404:0:27885:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d941ad6c00/0x85f51a6b967157a3 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0xe:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 27885 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1777051352.979462:0:27885:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0xe:0x0]: returning size 4096 00000004:00200000:3.0:1777051352.979468:0:27885:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1777051352.979497:0:27885:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff99d941ad6c00/0x85f51a6b967157a3 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0xe:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 27885 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051352.979541:0:27885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d941ad6200/0x85f51a6b9671579c lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b604c expref: 52 pid: 27885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051352.979596:0:27885:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99d941ad6c00/0x85f51a6b967157a3 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0xe:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b604c expref: 51 pid: 27885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051352.979611:0:27885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0xe:0x0].0x0 (ffff99d94e5e2c00) 00010000:00010000:3.0:1777051352.979617:0:27885:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1777051352.979622:0:27885:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d941ad6c00, rc 0) 00000100:00100000:3.0:1777051352.980064:0:27885:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d944073800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+51:133466:x1863365425908480:12345-192.168.201.46@tcp:101:lfs.0 Request processed in 939us (1362us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051352.980078:0:27885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111873 00000100:00100000:0.0:1777051352.985312:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051352.985378:0:8471:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425908608 00000100:00100000:2.0:1777051352.985387:0:8471:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425908608 00000100:00100000:2.0:1777051352.985447:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 7972 00000100:00100000:2.0:1777051352.985462:0:8471:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95fbadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+50:2437:x1863365425908608:12345-192.168.201.46@tcp:101:lfs.0 00010000:00010000:2.0:1777051352.985482:0:8471:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051352.985503:0:8471:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002af3bbf5/0x85f51a6b967157aa lrc: 2/0,0 mode: --/PR res: [0x280000400:0x102:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6053 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051352.985578:0:8471:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d944073480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8471:1863365452585472:192.168.201.46@tcp:106: 00000100:00100000:2.0:1777051352.985991:0:8471:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da5077b540 going to sleep for 11 seconds 00000100:00100000:2.0:1777051352.989568:0:8471:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d944073480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8471:1863365452585472:192.168.201.46@tcp:106: 00010000:00010000:2.0:1777051352.989621:0:8471:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002af3bbf5/0x85f51a6b967157aa lrc: 1/0,0 mode: --/PR res: [0x280000400:0x102:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6053 expref: 51 pid: 8471 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051352.989653:0:8471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002af3bbf5/0x85f51a6b967157aa lrc: 0/0,0 mode: --/PR res: [0x280000400:0x102:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6053 expref: 51 pid: 8471 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051352.989673:0:8471:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99da7d785e00, rc 0) 00000100:00100000:2.0:1777051352.989740:0:8471:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95fbadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+50:2437:x1863365425908608:12345-192.168.201.46@tcp:101:lfs.0 Request processed in 4280us (4433us total) trans 0 rc 301/301 00000100:00100000:2.0:1777051352.989753:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 7972 00000100:00100000:2.0:1777051352.995797:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051352.995887:0:21368:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425908864 00000100:00100000:1.0:1777051352.995898:0:21368:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425908864 00000100:00100000:1.0:1777051352.996000:0:21368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111874 00000100:00100000:1.0:1777051352.996017:0:21368:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d944073480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+51:133466:x1863365425908864:12345-192.168.201.46@tcp:58:lfs.0 00000040:00080000:1.0:1777051353.000119:0:21368:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1777051353.000851:0:21368:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:1.0:1777051353.001066:0:21368:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].1, 136 off8328 00000100:00100000:1.0:1777051353.001486:0:21368:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d944073480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+51:133466:x1863365425908864:12345-192.168.201.46@tcp:58:lfs.0 Request processed in 5469us (5691us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051353.001502:0:21368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111874 00010000:00010000:0.0:1777051353.174586:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1777051353.808550:0:105252:0:(llog.c:801:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1777051353.808560:0:105252:0:(llog_cat.c:158:llog_cat_process_common()) processing log [0x1:0x12:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1777051353.808599:0:105252:0:(llog.c:858:llog_process_thread()) stop processing plain [0x1:0x12:0x0] index 2 count 2 00000040:00080000:2.0:1777051353.808609:0:105252:0:(llog.c:858:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000040:00080000:1.0:1777051354.007972:0:104226:0:(llog.c:801:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1777051354.007983:0:104226:0:(llog_cat.c:158:llog_cat_process_common()) processing log [0x1:0x12:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1777051354.008019:0:104226:0:(llog.c:858:llog_process_thread()) stop processing plain [0x1:0x12:0x0] index 2 count 2 00000040:00080000:1.0:1777051354.008030:0:104226:0:(llog.c:858:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1777051354.008652:0:104226:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d960409c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0001_UUID:104226:1863365452585600:192.168.201.46@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1777051354.008770:0:104226:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d944ac0cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1777051354.013501:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051354.013569:0:104226:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d960409c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0001_UUID:104226:1863365452585600:192.168.201.46@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1777051354.013823:0:10328:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425908992 00000100:00100000:3.0:1777051354.013834:0:10328:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425908992 00000100:00100000:3.0:1777051354.013948:0:10328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111875 00000100:00100000:3.0:1777051354.013965:0:10328:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f824380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+9:133477:x1863365425908992:12345-192.168.201.46@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1777051354.014007:0:10328:0:(mdt_handler.c:7958:mdt_fid2path()) path get [0x240000405:0xa:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1777051354.014290:0:10328:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f824380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+9:133477:x1863365425908992:12345-192.168.201.46@tcp:53:lhsmtool_posix.0 Request processed in 327us (795us total) trans 0 rc -66/-66 00000100:00100000:3.0:1777051354.014305:0:10328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111875 00000100:00080000:0.0:1777051354.014469:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1777051354.018921:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051354.019078:0:6580:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425909120 00000100:00100000:1.0:1777051354.019090:0:6580:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425909120 00000100:00100000:1.0:1777051354.019458:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111876 00000100:00100000:1.0:1777051354.019475:0:6580:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95fbaf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+22:133477:x1863365425909120:12345-192.168.201.46@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1777051354.019516:0:6580:0:(mdt_handler.c:7958:mdt_fid2path()) path get [0x200000bd2:0xd3:0x0] from 18446744073709551615 #-1 00000100:00100000:1.0:1777051354.019637:0:6580:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95fbaf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+22:133477:x1863365425909120:12345-192.168.201.46@tcp:53:lhsmtool_posix.0 Request processed in 166us (722us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051354.019649:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111876 00000100:00080000:0.0:1777051354.019738:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1777051354.024766:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051354.024873:0:6581:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425909376 00000100:00100000:0.0:1777051354.024884:0:6581:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425909376 00000100:00100000:0.0:1777051354.024979:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111877 00000100:00100000:0.0:1777051354.025002:0:6581:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da45f75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+9:133477:x1863365425909376:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1777051354.025044:0:6581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051354.025437:0:6581:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d95595ae00/0x85f51a6b967157b1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b605a expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051354.025570:0:6581:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d95595b200/0x85f51a6b967157b8 lrc: 3/1,0 mode: --/PR res: [0x240000405:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051354.025593:0:6581:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d95595b200/0x85f51a6b967157b8 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6581 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051354.025614:0:6581:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d95595b200/0x85f51a6b967157b8 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6581 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1777051354.025658:0:6581:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000405:0xa:0x0]: returning size 1048576 00010000:00010000:0.0:1777051354.026136:0:6581:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d95595ae00/0x85f51a6b967157b1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b605a expref: 12 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051354.026237:0:6581:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99d95595b200/0x85f51a6b967157b8 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b605a expref: 11 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051354.026251:0:6581:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0xa:0x0].0x0 (ffff99d94e5e2d00) 00010000:00010000:0.0:1777051354.026255:0:6581:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1777051354.027135:0:6581:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d95595b200, rc 0) 00000100:00100000:0.0:1777051354.027239:0:6581:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da45f75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+11:133477:x1863365425909376:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 Request processed in 2246us (2494us total) trans 8589934596 rc 0/0 00000100:00100000:0.0:1777051354.027253:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111877 00000100:00100000:3.0:1777051354.032339:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051354.032424:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051354.032545:0:47827:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425909504 00000100:00100000:2.0:1777051354.032558:0:47827:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425909504 00000100:00100000:2.0:1777051354.032680:0:47827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13677 00000100:00100000:2.0:1777051354.032698:0:47827:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d9600b8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+11:2438:x1863365425909504:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1777051354.032720:0:47827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777051354.032748:0:47827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d95595b200/0x85f51a6b967157b8 lrc: 0/0,0 mode: --/PR res: [0x240000405:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b605a expref: 11 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051354.032776:0:47827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0xa:0x0].0x0 (ffff99d94e5e2d00) 00010000:00010000:2.0:1777051354.032784:0:47827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1777051354.032854:0:47827:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d9600b8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+10:2438:x1863365425909504:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 160us (524us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051354.032867:0:47827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13677 00000100:00100000:1.0:1777051354.034521:0:8468:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425909632 00000100:00100000:1.0:1777051354.034528:0:8468:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425909632 00000100:00080000:0.0:1777051354.034588:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1777051354.034605:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 7973 00000100:00100000:1.0:1777051354.034621:0:8468:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d9600b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+52:2437:x1863365425909632:12345-192.168.201.46@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1777051354.034665:0:8468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f4222aed/0x85f51a6b967157c6 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x102:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051354.034691:0:8468:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f2fd58b2/0x85f51a6b9671567d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x102:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5fdc expref: 52 pid: 55805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051354.034704:0:8468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1777051354.034708:0:8468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1777051354.034713:0:8468:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f4222aed/0x85f51a6b967157c6 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x102:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051354.034755:0:8468:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f2fd58b2/0x85f51a6b9671567d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x102:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5fdc expref: 52 pid: 55805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051354.034777:0:8468:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f2fd58b2/0x85f51a6b9671567d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x102:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5fdc expref: 52 pid: 55805 timeout: 8083 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051354.034804:0:8468:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d960409c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8468:1863365452585728:192.168.201.46@tcp:104: 00000100:00100000:1.0:1777051354.034876:0:8468:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d944ac0240 going to sleep for 11 seconds 00000100:00100000:1.0:1777051354.037504:0:8468:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d960409c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8468:1863365452585728:192.168.201.46@tcp:104: 00010000:00010000:1.0:1777051354.037537:0:8468:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f4222aed/0x85f51a6b967157c6 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x102:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051354.040625:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051354.040767:0:6564:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425909760 00000100:00100000:2.0:1777051354.040779:0:6564:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425909760 00010000:00010000:2.0:1777051354.040823:0:6564:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f2fd58b2/0x85f51a6b9671567d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x102:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5fdc expref: 53 pid: 55805 timeout: 8083 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051354.040887:0:6564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3844 00000100:00100000:2.0:1777051354.040900:0:6564:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da6fd42450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+53:2436:x1863365425909760:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1777051354.040922:0:6564:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777051354.040951:0:6564:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f2fd58b2/0x85f51a6b9671567d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x102:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5fdc expref: 53 pid: 55805 timeout: 8083 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051354.040987:0:6564:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f2fd58b2/0x85f51a6b9671567d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x102:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5fdc expref: 53 pid: 55805 timeout: 8083 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051354.041023:0:6564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f2fd58b2/0x85f51a6b9671567d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x102:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5fdc expref: 53 pid: 55805 timeout: 8083 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051354.041045:0:6564:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777051354.041049:0:6564:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777051354.041055:0:6564:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f4222aed/0x85f51a6b967157c6 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x102:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051354.041072:0:6564:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f4222aed/0x85f51a6b967157c6 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x102:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051354.041128:0:6564:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1777051354.041240:0:8468:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f4222aed/0x85f51a6b967157c6 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x102:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051354.041259:0:8468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f4222aed/0x85f51a6b967157c6 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x102:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051354.041292:0:8468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f4222aed/0x85f51a6b967157c6 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x102:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051354.041306:0:8468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f4222aed/0x85f51a6b967157c6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x102:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051354.041319:0:8468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f4222aed/0x85f51a6b967157c6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x102:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051354.041333:0:8468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d943ebb400 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:3.0:1777051354.041340:0:8468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4222aed/0x85f51a6b967157c6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x102:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051354.041364:0:8468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4222aed/0x85f51a6b967157c6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x102:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051354.041388:0:8468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f4222aed/0x85f51a6b967157c6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x102:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051354.041398:0:6564:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da6fd42450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+52:2436:x1863365425909760:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 493us (774us total) trans 0 rc 0/0 00010000:00010000:3.0:1777051354.041418:0:8468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f4222aed/0x85f51a6b967157c6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x102:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051354.041428:0:6564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3844 00000100:00100000:3.0:1777051354.041547:0:8468:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d9600b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+51:2437:x1863365425909632:12345-192.168.201.46@tcp:1:lhsmtool_posix.0 Request processed in 6901us (9094us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051354.041566:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 7973 00000100:00100000:3.0:1777051354.046939:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051354.047040:0:8492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425910016 00000100:00100000:2.0:1777051354.047413:0:8492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425910016 00000100:00100000:2.0:1777051354.047496:0:8492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111878 00000100:00100000:2.0:1777051354.047512:0:8492:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d9600b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+10:133477:x1863365425910016:12345-192.168.201.46@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1777051354.047706:0:8492:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d9600b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+10:133477:x1863365425910016:12345-192.168.201.46@tcp:57:lhsmtool_posix.0 Request processed in 196us (772us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051354.047721:0:8492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111878 00000100:00100000:2.0:1777051354.053330:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051354.053437:0:55805:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425910144 00000100:00100000:3.0:1777051354.053449:0:55805:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425910144 00000100:00100000:3.0:1777051354.053522:0:55805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 7974 00000100:00100000:3.0:1777051354.053535:0:55805:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da45f77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c11b6966-0775-44d2-bdc6-c74c26eb2226+51:2436:x1863365425910144:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1777051354.053555:0:55805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777051354.053580:0:55805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000854d280c/0x85f51a6b967157cd lrc: 2/0,0 mode: --/PR res: [0x280000400:0x102:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6061 expref: -99 pid: 55805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1777051354.053612:0:55805:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x102:0x0] initial LVB size: 1048576, mtime: 0x69eba6d8, atime: 0x0, ctime: 0x69eba6d8, blocks: 0x800 00010000:00010000:3.0:1777051354.053637:0:55805:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051354.053640:0:55805:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051354.053651:0:55805:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000854d280c/0x85f51a6b967157cd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x102:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6061 expref: 52 pid: 55805 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051354.053678:0:55805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000854d280c/0x85f51a6b967157cd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x102:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6061 expref: 52 pid: 55805 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051354.053698:0:55805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d941ad7200, rc 0) 00000100:00100000:3.0:1777051354.053785:0:55805:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da45f77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c11b6966-0775-44d2-bdc6-c74c26eb2226+52:2436:x1863365425910144:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 Request processed in 251us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051354.053796:0:55805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 7974 00000100:00100000:0.0:1777051354.058385:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051354.058537:0:27882:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425910400 00000100:00100000:2.0:1777051354.058547:0:27882:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425910400 00000100:00100000:2.0:1777051354.058623:0:27882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111879 00000100:00100000:2.0:1777051354.058637:0:27882:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95fbad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+10:133477:x1863365425910400:12345-192.168.201.46@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1777051354.058841:0:27882:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95fbad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+10:133477:x1863365425910400:12345-192.168.201.46@tcp:57:lhsmtool_posix.0 Request processed in 205us (462us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051354.058853:0:27882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111879 00000100:00100000:0.0:1777051354.068578:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051354.068701:0:8475:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425910528 00000100:00100000:1.0:1777051354.068713:0:8475:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425910528 00002000:00100000:1.0:1777051354.068764:0:8475:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000400:0x102:0x0] (0->1048575) req@ffff99d95fbae680 x1863365425910528/t0(0) o3->c11b6966-0775-44d2-bdc6-c74c26eb2226@192.168.201.46@tcp:315/0 lens 488/0 e 0 to 0 dl 1777051365 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1777051354.068778:0:8475:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99d95fbae680 with x1863365425910528 ext(0->1048575) 00002000:00010000:1.0:1777051354.068787:0:8475:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99d95fbae680 00000100:00100000:1.0:1777051354.068836:0:8475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 1761 00000100:00100000:1.0:1777051354.068850:0:8475:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95fbae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+52:2437:x1863365425910528:12345-192.168.201.46@tcp:3:lhsmtool_posix.0 00000100:00100000:1.0:1777051354.094536:0:8475:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95fbae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+52:2437:x1863365425910528:12345-192.168.201.46@tcp:3:lhsmtool_posix.0 Request processed in 25680us (25960us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1777051354.094551:0:8475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 1761 00002000:00100000:1.0:1777051354.094566:0:8475:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000400:0x102:0x0] (0->1048575) req@ffff99d95fbae680 x1863365425910528/t0(0) o3->c11b6966-0775-44d2-bdc6-c74c26eb2226@192.168.201.46@tcp:315/0 lens 488/440 e 0 to 0 dl 1777051365 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1777051354.094579:0:8475:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99d95fbae680 with x1863365425910528 ext(0->1048575) 00002000:00010000:1.0:1777051354.094587:0:8475:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99d95fbae680 00000100:00100000:3.0:1777051354.108364:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051354.108590:0:6579:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425910656 00000100:00100000:1.0:1777051354.108609:0:6579:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425910656 00000100:00100000:1.0:1777051354.109031:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111880 00000100:00100000:1.0:1777051354.109049:0:6579:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d9600ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+10:133477:x1863365425910656:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1777051354.109083:0:6579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777051354.109117:0:6579:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d943ebb800/0x85f51a6b967157d4 lrc: 2/0,0 mode: --/PR res: [0x240000405:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6068 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051354.109201:0:6579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d943ebac00/0x85f51a6b967157db lrc: 3/1,0 mode: --/PR res: [0x240000405:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051354.109224:0:6579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d943ebac00/0x85f51a6b967157db lrc: 3/1,0 mode: PR/PR res: [0x240000405:0xa:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051354.109242:0:6579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d943ebac00/0x85f51a6b967157db lrc: 3/1,0 mode: PR/PR res: [0x240000405:0xa:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051354.109448:0:6579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d943ebb800/0x85f51a6b967157d4 lrc: 0/0,0 mode: --/PR res: [0x240000405:0xa:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6068 expref: 12 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051354.109478:0:6579:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99d943ebac00/0x85f51a6b967157db lrc: 3/0,0 mode: PR/PR res: [0x240000405:0xa:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6068 expref: 11 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051354.109491:0:6579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0xa:0x0].0x0 (ffff99d94e5e2d00) 00010000:00010000:1.0:1777051354.109497:0:6579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1777051354.109503:0:6579:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d943ebac00, rc 0) 00000100:00100000:1.0:1777051354.109593:0:6579:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d9600ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+11:133477:x1863365425910656:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 Request processed in 549us (1253us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051354.109604:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111880 00000100:00100000:0.0:1777051354.113991:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051354.114063:0:6580:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425910784 00000100:00100000:1.0:1777051354.114074:0:6580:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425910784 00000100:00100000:1.0:1777051354.114472:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111881 00000100:00100000:1.0:1777051354.114495:0:6580:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95fbaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+11:133477:x1863365425910784:12345-192.168.201.46@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1777051354.114536:0:6580:0:(mdt_handler.c:7958:mdt_fid2path()) path get [0x240000405:0xa:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1777051354.114685:0:6580:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95fbaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+11:133477:x1863365425910784:12345-192.168.201.46@tcp:53:lhsmtool_posix.0 Request processed in 194us (699us total) trans 0 rc -66/-66 00000100:00100000:1.0:1777051354.114697:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111881 00000100:00100000:0.0:1777051354.117125:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051354.117229:0:46497:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425910912 00000100:00100000:2.0:1777051354.117238:0:46497:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425910912 00000100:00100000:2.0:1777051354.117288:0:46497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111882 00000100:00100000:2.0:1777051354.117297:0:46497:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95fbafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:c11b6966-0775-44d2-bdc6-c74c26eb2226+22:133477:x1863365425910912:12345-192.168.201.46@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1777051354.117318:0:46497:0:(mdt_handler.c:7958:mdt_fid2path()) path get [0x200000bd2:0xd3:0x0] from 18446744073709551615 #-1 00000100:00100000:2.0:1777051354.117389:0:46497:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95fbafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:c11b6966-0775-44d2-bdc6-c74c26eb2226+22:133477:x1863365425910912:12345-192.168.201.46@tcp:53:lhsmtool_posix.0 Request processed in 93us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051354.117396:0:46497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111882 00000100:00100000:2.0:1777051354.119618:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051354.119710:0:8470:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425911040 00000100:00100000:3.0:1777051354.119717:0:8470:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425911040 00000100:00100000:3.0:1777051354.119887:0:8470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 7975 00000100:00100000:3.0:1777051354.119897:0:8470:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da45f76d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+52:2436:x1863365425911040:12345-192.168.201.46@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1777051354.119942:0:8470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c429bca5/0x85f51a6b967157e2 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x102:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051354.119964:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051354.119966:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051354.119973:0:8470:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c429bca5/0x85f51a6b967157e2 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x102:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051354.119989:0:8470:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c429bca5/0x85f51a6b967157e2 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x102:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051354.120017:0:8470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c429bca5/0x85f51a6b967157e2 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x102:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051354.120032:0:8470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c429bca5/0x85f51a6b967157e2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x102:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051354.120040:0:8470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c429bca5/0x85f51a6b967157e2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x102:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051354.120046:0:8470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d95595b800 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:3.0:1777051354.120051:0:8470:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c429bca5/0x85f51a6b967157e2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x102:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051354.120059:0:8470:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c429bca5/0x85f51a6b967157e2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x102:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051354.120087:0:8470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c429bca5/0x85f51a6b967157e2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x102:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051354.120095:0:8470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c429bca5/0x85f51a6b967157e2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x102:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051354.120192:0:8470:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da45f76d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+52:2436:x1863365425911040:12345-192.168.201.46@tcp:1:lhsmtool_posix.0 Request processed in 294us (578us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051354.120202:0:8470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 7975 00000100:00100000:0.0:1777051354.124320:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051354.124389:0:27885:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425911296 00000100:00100000:3.0:1777051354.124399:0:27885:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425911296 00000100:00100000:3.0:1777051354.124462:0:27885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111883 00000100:00100000:3.0:1777051354.124477:0:27885:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95fbac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c11b6966-0775-44d2-bdc6-c74c26eb2226+11:133477:x1863365425911296:12345-192.168.201.46@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1777051354.124604:0:27885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff99d95595ba00/0x85f51a6b967157e9 lrc: 3/0,1 mode: --/PW res: [0x240000405:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051354.124630:0:27885:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff99d943ebac00/0x85f51a6b967157db lrc: 2/0,0 mode: PR/PR res: [0x240000405:0xa:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6068 expref: 11 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051354.124643:0:27885:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d95595ba00/0x85f51a6b967157e9 lrc: 4/0,1 mode: --/PW res: [0x240000405:0xa:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 27885 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051354.124697:0:27885:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff99d943ebac00/0x85f51a6b967157db lrc: 3/0,0 mode: PR/PR res: [0x240000405:0xa:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6068 expref: 11 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051354.124722:0:27885:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff99d943ebac00/0x85f51a6b967157db lrc: 4/0,0 mode: PR/PR res: [0x240000405:0xa:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6068 expref: 11 pid: 6579 timeout: 8083 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051354.124745:0:27885:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d9600bad80 pname:cluuid:pid:xid:nid:opc:job mdt00_007:lustre-MDT0001_UUID:27885:1863365452585856:192.168.201.46@tcp:104: 00000100:00100000:3.0:1777051354.124846:0:27885:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da5077b900 going to sleep for 11 seconds 00000100:00100000:3.0:1777051354.126510:0:27885:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d9600bad80 pname:cluuid:pid:xid:nid:opc:job mdt00_007:lustre-MDT0001_UUID:27885:1863365452585856:192.168.201.46@tcp:104: 00010000:00010000:3.0:1777051354.126541:0:27885:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff99d95595ba00/0x85f51a6b967157e9 lrc: 3/0,1 mode: --/PW res: [0x240000405:0xa:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 27885 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051354.129493:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051354.129574:0:47597:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425911424 00000100:00100000:3.0:1777051354.129582:0:47597:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425911424 00010000:00010000:3.0:1777051354.129623:0:47597:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d943ebac00/0x85f51a6b967157db lrc: 4/0,0 mode: PR/PR res: [0x240000405:0xa:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6068 expref: 12 pid: 6579 timeout: 8083 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051354.129676:0:47597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3845 00000100:00100000:3.0:1777051354.129689:0:47597:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95fbac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+12:2437:x1863365425911424:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1777051354.129708:0:47597:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777051354.129718:0:47597:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff99d943ebac00/0x85f51a6b967157db lrc: 4/0,0 mode: PR/PR res: [0x240000405:0xa:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6068 expref: 12 pid: 6579 timeout: 8083 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051354.129735:0:47597:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff99d943ebac00/0x85f51a6b967157db lrc: 3/0,0 mode: PR/PR res: [0x240000405:0xa:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6068 expref: 12 pid: 6579 timeout: 8083 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051354.129901:0:47597:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d943ebac00/0x85f51a6b967157db lrc: 0/0,0 mode: --/PR res: [0x240000405:0xa:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6068 expref: 12 pid: 6579 timeout: 8083 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051354.129924:0:47597:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0xa:0x0].0x0 (ffff99d94e5e2d00) 00010000:00010000:3.0:1777051354.129932:0:47597:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0001_UUID lock: ffff99d95595ba00/0x85f51a6b967157e9 lrc: 3/0,1 mode: --/PW res: [0x240000405:0xa:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 27885 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051354.129944:0:47597:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff99d95595ba00/0x85f51a6b967157e9 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0xa:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 27885 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051354.129956:0:47597:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d95595ba00/0x85f51a6b967157e9 lrc: 4/0,1 mode: PW/PW res: [0x240000405:0xa:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 27885 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051354.130004:0:47597:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1777051354.130063:0:47597:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95fbac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+11:2437:x1863365425911424:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 375us (574us total) trans 0 rc 0/0 00010000:00010000:2.0:1777051354.130064:0:27885:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff99d95595ba00/0x85f51a6b967157e9 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0xa:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 27885 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051354.130081:0:47597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3845 00010000:00010000:2.0:1777051354.130082:0:27885:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d95595ba00/0x85f51a6b967157e9 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0xa:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 27885 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051354.130422:0:27885:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff99d95595ba00/0x85f51a6b967157e9 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0xa:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 27885 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051354.130436:0:27885:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d95595ba00/0x85f51a6b967157e9 lrc: 2/0,0 mode: PW/PW res: [0x240000405:0xa:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 27885 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051354.130446:0:27885:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99d95595ba00/0x85f51a6b967157e9 lrc: 3/0,0 mode: PW/PW res: [0x240000405:0xa:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 27885 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051354.130454:0:27885:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d95595ba00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:2.0:1777051354.130460:0:27885:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d95595ba00/0x85f51a6b967157e9 lrc: 3/0,0 mode: PW/PW res: [0x240000405:0xa:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 27885 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051354.130470:0:27885:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d95595ba00/0x85f51a6b967157e9 lrc: 4/0,0 mode: PW/PW res: [0x240000405:0xa:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 27885 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051354.130484:0:27885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0xa:0x0].0x0 (ffff99d94e5e2d00) 00010000:00010000:2.0:1777051354.130488:0:27885:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1777051354.130493:0:27885:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99d95595ba00/0x85f51a6b967157e9 lrc: 2/0,0 mode: --/PW res: [0x240000405:0xa:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 27885 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051354.130502:0:27885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d95595ba00/0x85f51a6b967157e9 lrc: 0/0,0 mode: --/PW res: [0x240000405:0xa:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 27885 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051354.130656:0:27885:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95fbac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c11b6966-0775-44d2-bdc6-c74c26eb2226+11:133477:x1863365425911296:12345-192.168.201.46@tcp:57:lhsmtool_posix.0 Request processed in 6179us (6344us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1777051354.130669:0:27885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111883 00000040:00080000:1.0:1777051354.131042:0:104226:0:(llog.c:801:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1777051354.131049:0:104226:0:(llog_cat.c:158:llog_cat_process_common()) processing log [0x1:0x12:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1777051354.131078:0:104226:0:(llog.c:858:llog_process_thread()) stop processing plain [0x1:0x12:0x0] index 2 count 2 00000040:00080000:1.0:1777051354.131088:0:104226:0:(llog.c:858:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1777051354.133320:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051354.133390:0:6582:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425911680 00000100:00100000:2.0:1777051354.133400:0:6582:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425911680 00000100:00100000:2.0:1777051354.133455:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3325 00000100:00100000:2.0:1777051354.133468:0:6582:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d960409c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+11:133477:x1863365425911680:12345-192.168.201.46@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1777051354.133727:0:6582:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d960409c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+12:133477:x1863365425911680:12345-192.168.201.46@tcp:35:lhsmtool_posix.0 Request processed in 262us (415us total) trans 8589934598 rc 0/0 00000100:00100000:2.0:1777051354.133746:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3325 00010000:00010000:1.0:1777051354.198814:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777051354.902596:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d96040b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452585984:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1777051354.902697:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051354.902776:0:6585:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452585984 00000100:00100000:1.0:1777051354.902792:0:6585:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452585984 00000100:00100000:1.0:1777051354.902878:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8090 00000100:00100000:1.0:1777051354.902892:0:6585:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d9600bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3677:x1863365452585984:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1777051354.902951:0:6585:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4194304 pending 0 free 1441579008 avail 1295339520 00000100:00100000:1.0:1777051354.903033:0:6585:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d9600bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3677:x1863365452585984:12345-0@lo:41:osp-pre-0-1.0 Request processed in 143us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051354.903058:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8090 00000100:00100000:3.0:1777051354.903119:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d96040b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452585984:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1777051355.223091:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777051355.414453:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d96040b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3678:1863365452586112:0@lo:400:kworker.0 00000100:00100000:1.0:1777051355.414551:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d942a0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3677:1863365452586496:0@lo:400:kworker.0 00000100:00100000:3.0:1777051355.414565:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051355.414626:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051355.414662:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d942a0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3678:1863365452586624:0@lo:400:kworker.0 00000100:00100000:1.0:1777051355.414671:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f298e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3677:1863365452587008:0@lo:400:kworker.0 00000100:00100000:3.0:1777051355.414738:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051355.414771:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f299f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3678:1863365452587136:0@lo:400:kworker.0 00000100:00100000:3.0:1777051355.414814:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051355.414845:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d942a0f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3680:1863365452586368:0@lo:400:kworker.0 00000100:00100000:3.0:1777051355.414869:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d950889c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3678:1863365452587648:0@lo:400:kworker.0 00000100:00100000:1.0:1777051355.414901:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051355.414949:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f29b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3680:1863365452586880:0@lo:400:kworker.0 00000100:00100000:3.0:1777051355.414963:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051355.415007:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051355.415048:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f298a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3680:1863365452587392:0@lo:400:kworker.0 00000100:00100000:3.0:1777051355.415058:0:103165:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452586112 00000100:00100000:3.0:1777051355.415070:0:103165:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452586112 00000100:00100000:1.0:1777051355.415088:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051355.415171:0:103165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1777051355.415186:0:103165:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d943e24850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9351a01-5b0e-4470-97fd-58b9b4b312a2+23:3678:x1863365452586112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051355.415262:0:103165:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d943e24850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9351a01-5b0e-4470-97fd-58b9b4b312a2+23:3678:x1863365452586112:12345-0@lo:400:kworker.0 Request processed in 78us (702us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051355.415273:0:103165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1777051355.415365:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da45f77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452586240:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1777051355.415415:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051355.415449:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d942a0c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3679:1863365452586752:0@lo:400:kworker.0 00000100:00100000:3.0:1777051355.415504:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051355.415542:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f299180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3679:1863365452587264:0@lo:400:kworker.0 00000100:00100000:3.0:1777051355.415575:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051355.415653:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d96040b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3678:1863365452586112:0@lo:400:kworker.0 00000100:00100000:3.0:1777051355.415709:0:27887:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452587136 00000100:00100000:3.0:1777051355.415717:0:27887:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452587136 00000100:00100000:3.0:1777051355.416072:0:27887:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452587392 00000100:00100000:3.0:1777051355.416079:0:27887:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452587392 00000100:00100000:3.0:1777051355.416145:0:27887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10319 00000100:00100000:3.0:1777051355.416162:0:27887:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d9600b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3678:x1863365452587136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051355.416272:0:27887:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d9600b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3678:x1863365452587136:12345-0@lo:400:kworker.0 Request processed in 114us (1455us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051355.416282:0:27887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10319 00000100:00100000:3.0:1777051355.416306:0:27887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10320 00000100:00100000:3.0:1777051355.416321:0:27887:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95088aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3680:x1863365452587392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777051355.416357:0:47208:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452586880 00000100:00100000:0.0:1777051355.416365:0:47208:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452586880 00000100:00100000:0.0:1777051355.416407:0:47208:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452586240 00000100:00100000:0.0:1777051355.416411:0:47208:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452586240 00000100:00100000:0.0:1777051355.416441:0:47208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8091 00000100:00100000:0.0:1777051355.416452:0:47208:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95088b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+7:3680:x1863365452586880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777051355.416552:0:46494:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452586496 00000100:00100000:2.0:1777051355.416560:0:46494:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452586496 00000100:00100000:2.0:1777051355.416605:0:46494:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452586624 00000100:00100000:2.0:1777051355.416610:0:46494:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452586624 00000100:00100000:2.0:1777051355.416633:0:46494:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452586368 00000100:00100000:2.0:1777051355.416637:0:46494:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452586368 00000100:00100000:2.0:1777051355.416662:0:46494:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452587648 00000100:00100000:2.0:1777051355.416666:0:46494:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452587648 00000100:00100000:2.0:1777051355.416691:0:46494:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452586752 00000100:00100000:2.0:1777051355.416695:0:46494:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452586752 00000100:00100000:2.0:1777051355.416713:0:46494:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452587264 00000100:00100000:2.0:1777051355.416717:0:46494:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452587264 00000100:00100000:2.0:1777051355.416737:0:46494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13250 00000100:00100000:2.0:1777051355.416747:0:46494:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95088a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0001-lwp-OST0000_UUID+5:3677:x1863365452586496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777051355.416803:0:46494:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95088a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0001-lwp-OST0000_UUID+5:3677:x1863365452586496:12345-0@lo:400:kworker.0 Request processed in 56us (2180us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051355.416818:0:46494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13250 00000100:00100000:2.0:1777051355.416839:0:46494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13251 00000100:00100000:2.0:1777051355.416849:0:46494:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d9600bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000-lwp-OST0001_UUID+5:3678:x1863365452586624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051355.416879:0:27887:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95088aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3680:x1863365452587392:12345-0@lo:400:kworker.0 Request processed in 559us (1788us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051355.416911:0:27887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10320 00000100:00100000:2.0:1777051355.416918:0:46494:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d9600bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000-lwp-OST0001_UUID+5:3678:x1863365452586624:12345-0@lo:400:kworker.0 Request processed in 67us (2178us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051355.416936:0:46494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13251 00000100:00100000:3.0:1777051355.416962:0:27882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13252 00000100:00100000:2.0:1777051355.416971:0:46494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13253 00000100:00100000:3.0:1777051355.416980:0:27882:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d950889880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0000_UUID+5:3680:x1863365452586368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777051355.416989:0:46494:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d9600b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000-lwp-MDT0001_UUID+5:3678:x1863365452587648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051355.417054:0:27882:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d950889880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0000_UUID+5:3680:x1863365452586368:12345-0@lo:400:kworker.0 Request processed in 79us (2154us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051355.417064:0:46494:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d9600b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000-lwp-MDT0001_UUID+5:3678:x1863365452587648:12345-0@lo:400:kworker.0 Request processed in 81us (2102us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051355.417070:0:27882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13252 00000100:00100000:2.0:1777051355.417085:0:46494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13253 00000100:00100000:3.0:1777051355.417106:0:27882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13254 00000100:00100000:2.0:1777051355.417145:0:46494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13255 00000100:00100000:3.0:1777051355.417156:0:27882:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d9600bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0001_UUID+5:3679:x1863365452586752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777051355.417165:0:46494:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d9600b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000-lwp-MDT0000_UUID+5:3679:x1863365452587264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777051355.417250:0:47208:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95088b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+7:3680:x1863365452586880:12345-0@lo:400:kworker.0 Request processed in 796us (2242us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051355.417257:0:27882:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d9600bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0001_UUID+5:3679:x1863365452586752:12345-0@lo:400:kworker.0 Request processed in 135us (1768us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051355.417267:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f29b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3680:1863365452586880:0@lo:400:kworker.0 00000100:00100000:2.0:1777051355.417271:0:46494:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d9600b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000-lwp-MDT0000_UUID+5:3679:x1863365452587264:12345-0@lo:400:kworker.0 Request processed in 110us (1690us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051355.417291:0:47208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8091 00000100:00100000:3.0:1777051355.417291:0:27882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13254 00000100:00100000:1.0:1777051355.417299:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f298a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3680:1863365452587392:0@lo:400:kworker.0 00000100:00100000:0.0:1777051355.417335:0:47208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8092 00000100:00100000:1.0:1777051355.417339:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d942a0f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3680:1863365452586368:0@lo:400:kworker.0 00000100:00080000:3.0:1777051355.417346:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1777051355.417348:0:46494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13255 00000100:00100000:0.0:1777051355.417354:0:47208:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d9600b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+6:3679:x1863365452586240:12345-0@lo:41:osp-pre-1-0.0 00000100:00080000:3.0:1777051355.417358:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1777051355.417368:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1777051355.417373:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00000024:0.0:1777051355.417393:0:47208:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4194304 pending 0 free 1446150144 avail 1299910656 00000100:00100000:3.0:1777051355.417439:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d942a0c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3679:1863365452586752:0@lo:400:kworker.0 00000100:00100000:0.0:1777051355.417456:0:47208:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d9600b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+6:3679:x1863365452586240:12345-0@lo:41:osp-pre-1-0.0 Request processed in 107us (2041us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051355.417467:0:47208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8092 00000100:00100000:3.0:1777051355.417473:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f299180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3679:1863365452587264:0@lo:400:kworker.0 00000100:00100000:1.0:1777051355.417484:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051355.417538:0:8468:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452587008 00000100:00100000:3.0:1777051355.417538:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da45f77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452586240:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1777051355.417547:0:8468:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452587008 00000100:00100000:2.0:1777051355.417558:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d942a0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3678:1863365452586624:0@lo:400:kworker.0 00000100:00100000:2.0:1777051355.417578:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f299f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3678:1863365452587136:0@lo:400:kworker.0 00000100:00100000:2.0:1777051355.417601:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d950889c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3678:1863365452587648:0@lo:400:kworker.0 00000100:00100000:0.0:1777051355.417605:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10321 00000100:00100000:0.0:1777051355.417617:0:8468:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95088ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3677:x1863365452587008:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1777051355.417661:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1777051355.417977:0:8468:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95088ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3677:x1863365452587008:12345-0@lo:400:kworker.0 Request processed in 360us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051355.417988:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10321 00000100:00100000:1.0:1777051355.418022:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d950889500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452587520:0@lo:400:kworker.0 00000100:00100000:1.0:1777051355.418070:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051355.418144:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d942a0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3677:1863365452586496:0@lo:400:kworker.0 00000100:00100000:2.0:1777051355.418165:0:13320:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452587520 00000100:00100000:1.0:1777051355.418171:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f298e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3677:1863365452587008:0@lo:400:kworker.0 00000100:00100000:2.0:1777051355.418175:0:13320:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452587520 00000100:00100000:2.0:1777051355.418257:0:13320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10322 00000100:00100000:2.0:1777051355.418273:0:13320:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d950889c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3677:x1863365452587520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777051355.418381:0:13320:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d950889c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3677:x1863365452587520:12345-0@lo:400:kworker.0 Request processed in 112us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051355.418394:0:13320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10322 00000100:00100000:1.0:1777051355.418423:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d950889500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452587520:0@lo:400:kworker.0 00000100:00080000:0.0:1777051355.418481:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000040:00080000:3.0:1777051355.636006:0:105303:0:(llog.c:801:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1777051355.636018:0:105303:0:(llog_cat.c:158:llog_cat_process_common()) processing log [0x1:0x12:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1777051355.636384:0:105303:0:(llog.c:858:llog_process_thread()) stop processing plain [0x1:0x12:0x0] index 2 count 2 00000040:00080000:3.0:1777051355.636393:0:105303:0:(llog.c:858:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1777051355.926434:0:3680:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1777051355.926466:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d950889500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3680:1863365452587776:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1777051355.926566:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051355.926621:0:3679:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1777051355.926653:0:8472:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452587776 00000100:00100000:1.0:1777051355.926666:0:8472:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452587776 00000100:00100000:0.0:1777051355.926738:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da45f76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452587904:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1777051355.926758:0:8472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5602 00000100:00100000:1.0:1777051355.926776:0:8472:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942a0e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3680:x1863365452587776:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1777051355.926804:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:1.0:1777051355.926821:0:8472:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 430292544 pending 0 free 3645853696 avail 3414331392 00000100:00100000:1.0:1777051355.926907:0:8472:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942a0e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3680:x1863365452587776:12345-0@lo:13:osp-pre-1-1.0 Request processed in 136us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051355.926927:0:8472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5602 00000100:00100000:1.0:1777051355.927020:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d950889500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3680:1863365452587776:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1777051355.927071:0:8473:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452587904 00000100:00100000:0.0:1777051355.927490:0:8473:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452587904 00000100:00100000:0.0:1777051355.927549:0:8473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5603 00000100:00100000:0.0:1777051355.927563:0:8473:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95fbadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3679:x1863365452587904:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1777051355.927590:0:8473:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 455081536 pending 0 free 3860574208 avail 3629051904 00000100:00100000:0.0:1777051355.927652:0:8473:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95fbadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3679:x1863365452587904:12345-0@lo:13:osp-pre-0-1.0 Request processed in 92us (850us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051355.927663:0:8473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5603 00000100:00100000:1.0:1777051355.927734:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da45f76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452587904:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1777051356.246844:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777051357.092517:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051357.092590:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051357.092615:0:103163:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425911808 00000100:00100000:1.0:1777051357.092629:0:103163:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425911808 00000100:00100000:1.0:1777051357.093031:0:103163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 150 00000100:00100000:3.0:1777051357.093047:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051357.093056:0:103163:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f3ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29c4352d-3260-4734-909d-9ea5de9e7fa4+12:2436:x1863365425911808:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:3.0:1777051357.093129:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051357.093181:0:103163:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f3ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29c4352d-3260-4734-909d-9ea5de9e7fa4+12:2436:x1863365425911808:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 133us (671us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051357.093194:0:103163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 150 00000100:00100000:3.0:1777051357.093470:0:8470:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425912320 00000100:00100000:3.0:1777051357.093478:0:8470:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425912320 00000100:00100000:3.0:1777051357.093541:0:8470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10323 00000100:00100000:3.0:1777051357.093554:0:8470:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da44494000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+48:2436:x1863365425912320:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:3.0:1777051357.093613:0:8470:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da44494000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+48:2436:x1863365425912320:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 61us (569us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051357.093627:0:8470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10323 00000100:00080000:3.0:1777051357.093656:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1777051357.093702:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051357.094029:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051357.094286:0:27882:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425912064 00000100:00100000:1.0:1777051357.094287:0:46494:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425912576 00000100:00100000:2.0:1777051357.094296:0:27882:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425912064 00000100:00100000:1.0:1777051357.094298:0:46494:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425912576 00000100:00100000:1.0:1777051357.094376:0:46494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13256 00000100:00100000:1.0:1777051357.094390:0:46494:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da44496300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+51:2436:x1863365425912576:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:1.0:1777051357.094454:0:46494:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da44496300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+51:2436:x1863365425912576:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 66us (1327us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051357.094466:0:46494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13256 00000100:00100000:3.0:1777051357.094571:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051357.094610:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051357.095179:0:27882:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425911936 00000100:00100000:2.0:1777051357.095188:0:27882:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425911936 00000100:00100000:1.0:1777051357.095237:0:46494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13257 00000100:00100000:2.0:1777051357.095252:0:27882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13258 00000100:00100000:1.0:1777051357.095258:0:46494:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d96040b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c11b6966-0775-44d2-bdc6-c74c26eb2226+12:2436:x1863365425912064:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:2.0:1777051357.095275:0:27882:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da44494a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+22:2436:x1863365425911936:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:1.0:1777051357.095320:0:46494:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d96040b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c11b6966-0775-44d2-bdc6-c74c26eb2226+12:2436:x1863365425912064:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 69us (2730us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051357.095330:0:46494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13257 00000100:00100000:2.0:1777051357.095343:0:27882:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da44494a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+22:2436:x1863365425911936:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 73us (1577us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051357.095356:0:27882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13258 00000100:00100000:2.0:1777051357.095411:0:8471:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425912832 00000100:00100000:2.0:1777051357.095418:0:8471:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425912832 00000100:00100000:2.0:1777051357.095470:0:8471:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425912192 00000100:00100000:2.0:1777051357.095475:0:8471:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425912192 00000100:00100000:1.0:1777051357.095508:0:27884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10324 00000100:00100000:2.0:1777051357.095521:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10325 00000100:00100000:1.0:1777051357.095529:0:27884:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da44495500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+47:2436:x1863365425912832:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:2.0:1777051357.095544:0:8471:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da44497800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+52:2436:x1863365425912192:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:1.0:1777051357.095589:0:27884:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da44495500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+47:2436:x1863365425912832:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 66us (1884us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051357.095601:0:27884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10324 00000100:00100000:2.0:1777051357.095609:0:8471:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da44497800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+52:2436:x1863365425912192:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 69us (1036us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051357.095622:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10325 00000100:00080000:2.0:1777051357.095709:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1777051357.095714:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1777051357.095718:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1777051357.095721:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1777051357.095857:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051357.095957:0:27885:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425912448 00000100:00100000:2.0:1777051357.095965:0:27885:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425912448 00000100:00100000:2.0:1777051357.096042:0:27885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13259 00000100:00100000:2.0:1777051357.096055:0:27885:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da44495c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+24:2436:x1863365425912448:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:1.0:1777051357.096131:0:8468:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425912704 00000100:00100000:1.0:1777051357.096141:0:8468:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425912704 00000100:00100000:2.0:1777051357.096145:0:27885:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da44495c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+24:2436:x1863365425912448:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 90us (1531us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051357.096159:0:27885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13259 00000100:00080000:3.0:1777051357.096177:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1777051357.096188:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1777051357.096222:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10326 00000100:00100000:1.0:1777051357.096241:0:8468:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da44495880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+50:2436:x1863365425912704:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:1.0:1777051357.096324:0:8468:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da44495880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+50:2436:x1863365425912704:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 85us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051357.096337:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10326 00010000:00010000:0.0:1777051357.271421:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1777051357.463456:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da45f76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3678:1863365452588032:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1777051357.463569:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da44495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3677:1863365452588160:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1777051357.463572:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051357.463653:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051357.463704:0:47388:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452588032 00000100:00100000:0.0:1777051357.463719:0:47388:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452588032 00000100:00100000:1.0:1777051357.464030:0:8472:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452588160 00000100:00100000:1.0:1777051357.464040:0:8472:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452588160 00000100:00080000:3.0:1777051357.464152:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1777051357.464163:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1777051357.464173:0:47388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5604 00000100:00100000:0.0:1777051357.464432:0:47388:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da45f75180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3678:x1863365452588032:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1777051357.464465:0:47388:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 430292544 pending 0 free 3645853696 avail 3414331392 00000100:00100000:0.0:1777051357.464537:0:47388:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da45f75180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3678:x1863365452588032:12345-0@lo:13:osp-pre-1-0.0 Request processed in 114us (968us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051357.464649:0:8472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5605 00000100:00100000:1.0:1777051357.464680:0:8472:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942a0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3677:x1863365452588160:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1777051357.464705:0:8472:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 455081536 pending 0 free 3860574208 avail 3629051904 00000100:00100000:1.0:1777051357.464777:0:8472:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942a0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3677:x1863365452588160:12345-0@lo:13:osp-pre-0-0.0 Request processed in 113us (1123us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051357.464791:0:8472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5605 00000100:00100000:1.0:1777051357.464862:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da44495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3677:1863365452588160:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1777051357.465437:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da45f76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3678:1863365452588032:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1777051357.466463:0:47388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5604 00000040:00080000:1.0:1777051357.847062:0:103189:0:(llog.c:801:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:1.0:1777051357.847075:0:103189:0:(llog_cat.c:158:llog_cat_process_common()) processing log [0x1:0x2b:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1777051357.847144:0:103189:0:(llog.c:858:llog_process_thread()) stop processing plain [0x1:0x2b:0x0] index 2 count 2 00000040:00080000:1.0:1777051357.847156:0:103189:0:(llog.c:858:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00000001:00080000:3.0:1777051357.980395:0:103159:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771091 is committed 00000001:00080000:3.0:1777051357.982430:0:104205:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934598 is committed 00000020:00080000:3.0:1777051357.982459:0:104205:0:(update_trans.c:1333:distribute_txn_batchid_cb()) lustre-MDT0001: 4294970574 batchid updated 00000020:00080000:1.0:1777051357.983474:0:104230:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 4294970574 00000100:00100000:1.0:1777051357.983602:0:104230:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d942a0c000 pname:cluuid:pid:xid:nid:opc:job dist_txn-1:lustre-MDT0001-mdtlov_UUID:104230:1863365452588288:0@lo:1000:dist_txn-1.0 00000100:00100000:1.0:1777051357.983684:0:104230:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051357.983767:0:104230:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d95a2a89c0 going to sleep for 11 seconds 00000100:00100000:3.0:1777051357.983788:0:46500:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452588288 00000100:00100000:3.0:1777051357.983803:0:46500:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452588288 00000100:00100000:3.0:1777051357.983896:0:46500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8093 00000100:00100000:3.0:1777051357.983917:0:46500:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942a0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+6:104230:x1863365452588288:12345-0@lo:1000:dist_txn-1.0 00000100:00100000:3.0:1777051357.984117:0:46500:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942a0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+6:104230:x1863365452588288:12345-0@lo:1000:dist_txn-1.0 Request processed in 206us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051357.984132:0:46500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8093 00000100:00100000:1.0:1777051357.984271:0:104230:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d942a0c000 pname:cluuid:pid:xid:nid:opc:job dist_txn-1:lustre-MDT0001-mdtlov_UUID:104230:1863365452588288:0@lo:1000:dist_txn-1.0 00000004:00080000:1.0:1777051357.984327:0:104230:0:(osp_trans.c:1582:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff99d95a2a8d80 with version 8 00000020:00080000:1.0:1777051357.984363:0:104230:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4294970574 cancel update log [0x2000032e1:0x1:0x0].1: rc = 0 00000004:00080000:2.0:1777051357.984438:0:104211:0:(osp_trans.c:1330:osp_get_next_request()) ou ffff99d9596fa9c0 version 8 rpc_version 8 00000020:00100000:2.0:1777051357.984474:0:104211:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000020:00080000:1.0:1777051357.984486:0:104230:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4294970574 cancel update log [0x240000bd0:0x1:0x0].1: rc = 0 00000100:00100000:2.0:1777051357.984489:0:104211:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff99da45f74000 x1863365452588544/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000020:00080000:1.0:1777051357.984511:0:104230:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 4294970574 00000100:00100000:2.0:1777051357.984527:0:104211:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da45f74000 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:104211:1863365452588544:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1777051357.984593:0:104211:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051357.984643:0:104211:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da50e93f00 going to sleep for 11 seconds 00000100:00100000:1.0:1777051357.984687:0:6584:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452588544 00000100:00100000:1.0:1777051357.984697:0:6584:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452588544 00000100:00100000:1.0:1777051357.984761:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8094 00000100:00100000:1.0:1777051357.984775:0:6584:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da45f76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:104211:x1863365452588544:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1777051357.984972:0:6584:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da45f76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:104211:x1863365452588544:12345-0@lo:1000:osp_up0-1.0 Request processed in 197us (377us total) trans 30064771092 rc 0/0 00000100:00100000:1.0:1777051357.984987:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8094 00000100:00100000:3.0:1777051357.985473:0:104211:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da45f74000 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:104211:1863365452588544:0@lo:1000:osp_up0-1.0 00010000:00010000:0.0:1777051358.294369:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777051359.319331:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1777051360.024132:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d942a0c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452588672:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1777051360.025586:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051360.026095:0:47208:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452588672 00000100:00100000:2.0:1777051360.026110:0:47208:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452588672 00000100:00100000:2.0:1777051360.026222:0:47208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8095 00000100:00100000:2.0:1777051360.026236:0:47208:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95fbad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+7:3679:x1863365452588672:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1777051360.026673:0:47208:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4194304 pending 0 free 1441579008 avail 1295339520 00000100:00100000:2.0:1777051360.026760:0:47208:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95fbad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+7:3679:x1863365452588672:12345-0@lo:41:osp-pre-0-1.0 Request processed in 525us (1178us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051360.026770:0:47208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8095 00000100:00100000:0.0:1777051360.026857:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d942a0c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452588672:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1777051360.150387:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051360.150446:0:6579:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425913088 00000100:00100000:1.0:1777051360.150461:0:6579:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425913088 00000100:00100000:1.0:1777051360.150567:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111884 00000100:00100000:1.0:1777051360.150582:0:6579:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942a0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+51:133909:x1863365425913088:12345-192.168.201.46@tcp:101:rm.0 00010000:00010000:1.0:1777051360.150614:0:6579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777051360.150650:0:6579:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d943ebb400/0x85f51a6b967157f0 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b606f expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1777051360.151035:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00200000:1.0:1777051360.151099:0:6579:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0xe:0x0]: returning size 4096 00010000:00010000:1.0:1777051360.151619:0:6579:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99d943ebb400/0x85f51a6b967157f0 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b606f expref: 53 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051360.151641:0:6579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xd3:0x0].0x0 (ffff99d94e6b6000) 00010000:00010000:1.0:1777051360.151645:0:6579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1777051360.151652:0:6579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d943ebb400/0x85f51a6b967157f0 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b606f expref: 53 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051360.151675:0:6579:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d943ebb400, rc 0) 00000100:00100000:1.0:1777051360.151768:0:6579:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942a0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+52:133909:x1863365425913088:12345-192.168.201.46@tcp:101:rm.0 Request processed in 1189us (1414us total) trans 8589934599 rc 301/301 00000100:00100000:1.0:1777051360.151781:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111884 00000100:00100000:1.0:1777051360.159023:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051360.160930:0:46501:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425913216 00000100:00100000:2.0:1777051360.160946:0:46501:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425913216 00000100:00100000:2.0:1777051360.161024:0:46501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3326 00000100:00100000:2.0:1777051360.161038:0:46501:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d950889500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+52:133909:x1863365425913216:12345-192.168.201.46@tcp:37:rm.0 00000100:00100000:1.0:1777051360.168683:0:46501:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d950889500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+52:133909:x1863365425913216:12345-192.168.201.46@tcp:37:rm.0 Request processed in 7635us (9658us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051360.168705:0:46501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3326 00000100:00100000:2.0:1777051360.173986:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051360.174090:0:6583:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425913472 00000100:00100000:0.0:1777051360.174380:0:6583:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425913472 00000100:00100000:0.0:1777051360.174471:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3327 00000100:00100000:0.0:1777051360.174490:0:6583:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da45f75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+52:133909:x1863365425913472:12345-192.168.201.46@tcp:35:rm.0 00000100:00100000:0.0:1777051360.174855:0:6583:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da45f75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+53:133909:x1863365425913472:12345-192.168.201.46@tcp:35:rm.0 Request processed in 370us (878us total) trans 8589934600 rc 0/0 00000100:00100000:0.0:1777051360.174866:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3327 00000100:00100000:2.0:1777051360.179448:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051360.179513:0:46494:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425913728 00000100:00100000:1.0:1777051360.179523:0:46494:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425913728 00000100:00100000:1.0:1777051360.179594:0:46494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111885 00000100:00100000:1.0:1777051360.179608:0:46494:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da45f77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+53:133909:x1863365425913728:12345-192.168.201.46@tcp:101:rm.0 00010000:00010000:1.0:1777051360.179631:0:46494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777051360.179666:0:46494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d943ebb400/0x85f51a6b967157fe lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6076 expref: -99 pid: 46494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051360.179783:0:46494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d943eba000/0x85f51a6b96715805 lrc: 3/1,0 mode: --/CR res: [0x240000404:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051360.179801:0:46494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d943eba000/0x85f51a6b96715805 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 46494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051360.179815:0:46494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d943eba000/0x85f51a6b96715805 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 46494 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1777051360.179827:0:46494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0xe:0x0]: returning size 4096 00010000:00010000:1.0:1777051360.179916:0:46494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d943ebb400/0x85f51a6b967157fe lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6076 expref: 56 pid: 46494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051360.179937:0:46494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99d943eba000/0x85f51a6b96715805 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6076 expref: 55 pid: 46494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051360.179947:0:46494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0xe:0x0].0x0 (ffff99d94e5e2c00) 00010000:00010000:1.0:1777051360.179951:0:46494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1777051360.179954:0:46494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d943eba000, rc 0) 00000100:00100000:1.0:1777051360.180020:0:46494:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da45f77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+55:133909:x1863365425913728:12345-192.168.201.46@tcp:101:rm.0 Request processed in 414us (574us total) trans 8589934601 rc 0/0 00000100:00100000:1.0:1777051360.180035:0:46494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111885 00000100:00100000:2.0:1777051360.184979:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051360.185073:0:6581:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425913856 00000100:00100000:0.0:1777051360.185087:0:6581:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425913856 00000100:00100000:0.0:1777051360.185173:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111886 00000100:00080000:3.0:1777051360.185190:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1777051360.185192:0:6581:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da45f75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+24:133909:x1863365425913856:12345-192.168.201.46@tcp:41:rm.0 00000004:00000024:0.0:1777051360.185261:0:6581:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4194304 pending 0 free 7506427904 avail 7043383296 00000100:00100000:0.0:1777051360.185332:0:6581:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da45f75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+24:133909:x1863365425913856:12345-192.168.201.46@tcp:41:rm.0 Request processed in 148us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051360.185344:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111886 00000100:00100000:2.0:1777051360.191251:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051360.191383:0:6580:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425914112 00000100:00100000:1.0:1777051360.191393:0:6580:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425914112 00000100:00100000:1.0:1777051360.191457:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111887 00000100:00100000:1.0:1777051360.191471:0:6580:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da45f75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+55:133909:x1863365425914112:12345-192.168.201.46@tcp:36:rm.0 00010000:00010000:1.0:1777051360.191534:0:6580:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1777051360.191570:0:6580:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d95595b400/0x85f51a6b9671578e lrc: 0/0,0 mode: --/PR res: [0x240000405:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b603e expref: 55 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051360.191597:0:6580:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0xa:0x0].0x0 (ffff99d94e5e2d00) 00010000:00010000:1.0:1777051360.191612:0:6580:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d941ad6c00/0x85f51a6b967157a3 lrc: 0/0,0 mode: --/PR res: [0x240000404:0xe:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b604c expref: 54 pid: 27885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051360.191627:0:6580:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0xe:0x0].0x0 (ffff99d94e5e2c00) 00010000:00010000:1.0:1777051360.191632:0:6580:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1777051360.191659:0:6580:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff99d943ebb400/0x85f51a6b96715813 lrc: 3/0,1 mode: --/CW res: [0x240000404:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051360.191677:0:6580:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d943ebb400/0x85f51a6b96715813 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6580 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051360.191692:0:6580:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d943ebb400/0x85f51a6b96715813 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6580 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051360.191712:0:6580:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff99d943eba200/0x85f51a6b9671581a lrc: 3/0,1 mode: --/PW res: [0x240000404:0xe:0x0].0x674069f9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051360.191742:0:6580:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d943eba200/0x85f51a6b9671581a lrc: 3/0,1 mode: PW/PW res: [0x240000404:0xe:0x0].0x674069f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6580 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051360.191753:0:6580:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d943eba200/0x85f51a6b9671581a lrc: 3/0,1 mode: PW/PW res: [0x240000404:0xe:0x0].0x674069f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6580 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051360.191879:0:6580:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff99d943ebac00/0x85f51a6b96715821 lrc: 3/0,1 mode: --/EX res: [0x240000405:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051360.191895:0:6580:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d785200/0x85f51a6b9671566f lrc: 2/0,0 mode: PR/PR res: [0x240000405:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5fd5 expref: 7 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051360.191917:0:6580:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d943ebac00/0x85f51a6b96715821 lrc: 4/0,1 mode: --/EX res: [0x240000405:0xa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6580 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051360.191967:0:6580:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d785200/0x85f51a6b9671566f lrc: 3/0,0 mode: PR/PR res: [0x240000405:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5fd5 expref: 7 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051360.191990:0:6580:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d785200/0x85f51a6b9671566f lrc: 4/0,0 mode: PR/PR res: [0x240000405:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5fd5 expref: 7 pid: 27882 timeout: 8089 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051360.192013:0:6580:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f298e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6580:1863365452588800:192.168.201.46@tcp:104: 00000100:00100000:1.0:1777051360.192156:0:6580:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d944ac0cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1777051360.195089:0:6580:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f298e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6580:1863365452588800:192.168.201.46@tcp:104: 00010000:00010000:1.0:1777051360.195122:0:6580:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff99d943ebac00/0x85f51a6b96715821 lrc: 3/0,1 mode: --/EX res: [0x240000405:0xa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6580 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051360.195349:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051360.195483:0:6566:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425914240 00000100:00100000:3.0:1777051360.195504:0:6566:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425914240 00000100:00080000:0.0:1777051360.195577:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1777051360.195642:0:6566:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d785200/0x85f51a6b9671566f lrc: 4/0,0 mode: PR/PR res: [0x240000405:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5fd5 expref: 8 pid: 27882 timeout: 8089 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051360.195686:0:6566:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3846 00000100:00100000:0.0:1777051360.195701:0:6566:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da45f76680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+8:2437:x1863365425914240:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1777051360.195718:0:6566:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777051360.195726:0:6566:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d785200/0x85f51a6b9671566f lrc: 4/0,0 mode: PR/PR res: [0x240000405:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5fd5 expref: 8 pid: 27882 timeout: 8089 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051360.195743:0:6566:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d785200/0x85f51a6b9671566f lrc: 3/0,0 mode: PR/PR res: [0x240000405:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5fd5 expref: 8 pid: 27882 timeout: 8089 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051360.196072:0:6566:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d785200/0x85f51a6b9671566f lrc: 0/0,0 mode: --/PR res: [0x240000405:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5fd5 expref: 8 pid: 27882 timeout: 8089 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051360.196093:0:6566:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0xa:0x0].0x0 (ffff99d94e5e2d00) 00010000:00010000:0.0:1777051360.196099:0:6566:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff99d943ebac00/0x85f51a6b96715821 lrc: 3/0,1 mode: --/EX res: [0x240000405:0xa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6580 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051360.196110:0:6566:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff99d943ebac00/0x85f51a6b96715821 lrc: 3/0,1 mode: EX/EX res: [0x240000405:0xa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6580 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051360.196119:0:6566:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d943ebac00/0x85f51a6b96715821 lrc: 4/0,1 mode: EX/EX res: [0x240000405:0xa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6580 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051360.196163:0:6566:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1777051360.196254:0:6566:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da45f76680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+7:2437:x1863365425914240:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 557us (907us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051360.196266:0:6566:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3846 00010000:00010000:1.0:1777051360.196608:0:6580:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff99d943ebac00/0x85f51a6b96715821 lrc: 3/0,1 mode: EX/EX res: [0x240000405:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6580 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051360.196616:0:6580:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d943ebac00/0x85f51a6b96715821 lrc: 3/0,1 mode: EX/EX res: [0x240000405:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6580 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1777051360.196973:0:6580:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].2, 64 off8320 00000004:00080000:1.0:1777051360.196990:0:6580:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 7989389791533ns, next at 7990389787835ns, rc = 0 00010000:00010000:1.0:1777051360.197657:0:6580:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff99d943ebb800/0x85f51a6b96715828 lrc: 3/0,1 mode: --/PW res: [0x240000405:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051360.197670:0:6580:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d943ebb800/0x85f51a6b96715828 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0xa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6580 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051360.197679:0:6580:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d943ebb800/0x85f51a6b96715828 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0xa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6580 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051360.197687:0:6580:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff99d943ebb800/0x85f51a6b96715828 lrc: 4/0,1 mode: PW/PW res: [0x240000405:0xa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6580 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051360.197693:0:6580:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff99d943ebb800/0x85f51a6b96715828 lrc: 4/0,1 mode: PW/PW res: [0x240000405:0xa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6580 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051360.197699:0:6580:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d943ebb800/0x85f51a6b96715828 lrc: 3/0,0 mode: PW/PW res: [0x240000405:0xa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6580 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051360.197725:0:6580:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1777051360.197750:0:6580:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff99d943ebac00/0x85f51a6b96715821 lrc: 3/0,1 mode: EX/EX res: [0x240000405:0xa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6580 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051360.197755:0:6580:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d943ebac00/0x85f51a6b96715821 lrc: 2/0,0 mode: EX/EX res: [0x240000405:0xa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6580 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051360.197760:0:6580:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99d943ebac00/0x85f51a6b96715821 lrc: 3/0,0 mode: EX/EX res: [0x240000405:0xa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6580 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051360.197766:0:6580:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d943ebac00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:1.0:1777051360.197772:0:6580:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d943ebac00/0x85f51a6b96715821 lrc: 3/0,0 mode: EX/EX res: [0x240000405:0xa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6580 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051360.197780:0:6580:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d943ebac00/0x85f51a6b96715821 lrc: 4/0,0 mode: EX/EX res: [0x240000405:0xa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6580 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051360.197792:0:6580:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0xa:0x0].0x0 (ffff99d94e5e2d00) 00010000:00010000:1.0:1777051360.197797:0:6580:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1777051360.197803:0:6580:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99d943ebac00/0x85f51a6b96715821 lrc: 2/0,0 mode: --/EX res: [0x240000405:0xa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6580 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051360.197814:0:6580:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d943ebac00/0x85f51a6b96715821 lrc: 0/0,0 mode: --/EX res: [0x240000405:0xa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6580 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051360.197818:0:13753:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777051360.197840:0:13753:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99d943ebb800/0x85f51a6b96715828 lrc: 2/0,0 mode: PW/PW res: [0x240000405:0xa:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6580 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051360.197849:0:6580:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff99d943ebb400/0x85f51a6b96715813 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6580 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051360.197865:0:13753:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d943ebb800 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:1.0:1777051360.197869:0:6580:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff99d943ebb400/0x85f51a6b96715813 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6580 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051360.197876:0:13753:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d943ebb800/0x85f51a6b96715828 lrc: 2/0,0 mode: PW/PW res: [0x240000405:0xa:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6580 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051360.197888:0:6580:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d943ebb400/0x85f51a6b96715813 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6580 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051360.197906:0:13753:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d943ebb800/0x85f51a6b96715828 lrc: 3/0,0 mode: PW/PW res: [0x240000405:0xa:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6580 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051360.197909:0:6580:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99d943ebb400/0x85f51a6b96715813 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6580 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051360.197932:0:6580:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d943ebb400 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:1.0:1777051360.197936:0:6580:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d943ebb400/0x85f51a6b96715813 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6580 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051360.197943:0:6580:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d943ebb400/0x85f51a6b96715813 lrc: 5/0,0 mode: CW/CW res: [0x240000404:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6580 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051360.197964:0:6580:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0xe:0x0].0x0 (ffff99d94e5e2c00) 00010000:00010000:1.0:1777051360.197969:0:6580:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777051360.197972:0:6580:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99d943ebb400/0x85f51a6b96715813 lrc: 3/0,0 mode: --/CW res: [0x240000404:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6580 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051360.197979:0:6580:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d943ebb400/0x85f51a6b96715813 lrc: 0/0,0 mode: --/CW res: [0x240000404:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6580 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051360.197987:0:13753:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0xa:0x0].0x0 (ffff99d94e5e2d00) 00000004:00010000:1.0:1777051360.197991:0:6580:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000155701fd reply state 0000000099b14d13 transno 8589934602 ns: mdt-lustre-MDT0001_UUID lock: ffff99d943eba200/0x85f51a6b9671581a lrc: 3/0,1 mode: PW/PW res: [0x240000404:0xe:0x0].0x674069f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6580 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051360.197996:0:13753:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1777051360.198007:0:13753:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99d943ebb800/0x85f51a6b96715828 lrc: 1/0,0 mode: --/PW res: [0x240000405:0xa:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6580 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051360.198015:0:6580:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d943eba200/0x85f51a6b9671581a lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0xe:0x0].0x674069f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6580 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051360.198021:0:13753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d943ebb800/0x85f51a6b96715828 lrc: 0/0,0 mode: --/PW res: [0x240000405:0xa:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6580 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051360.198068:0:6580:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0xe:0x0].0x674069f9 (ffff99d94e6b6000) 00010000:00010000:1.0:1777051360.198083:0:6580:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1777051360.198088:0:6580:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1777051360.198138:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051360.198142:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051360.198146:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1777051360.198213:0:6580:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da45f75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+55:133909:x1863365425914112:12345-192.168.201.46@tcp:36:rm.0 Request processed in 6729us (6951us total) trans 8589934602 rc 0/0 00000100:00100000:1.0:1777051360.198230:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111887 00000100:00100000:2.0:1777051360.204300:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051360.204391:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051360.204457:0:24269:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425914624 00000100:00100000:0.0:1777051360.204459:0:47827:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425914368 00000100:00100000:0.0:1777051360.204470:0:47827:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425914368 00000100:00100000:3.0:1777051360.204470:0:24269:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425914624 00000100:00100000:3.0:1777051360.204554:0:24269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3328 00000100:00100000:0.0:1777051360.204569:0:47827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13678 00000100:00100000:3.0:1777051360.204572:0:24269:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7b5e7850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+55:133909:x1863365425914624:12345-192.168.201.46@tcp:35:rm.0 00000100:00100000:0.0:1777051360.204589:0:47827:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da45f76300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+24:2436:x1863365425914368:12345-192.168.201.46@tcp:103:rm.0 00010000:00010000:0.0:1777051360.204609:0:47827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777051360.204641:0:47827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d943ebbe00/0x85f51a6b96715764 lrc: 0/0,0 mode: --/PR res: [0x240000404:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6030 expref: 24 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051360.204664:0:47827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0xe:0x0].0x0 (ffff99d9413d2e00) 00010000:00010000:0.0:1777051360.204670:0:47827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1777051360.204728:0:47827:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da45f76300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+23:2436:x1863365425914368:12345-192.168.201.46@tcp:103:rm.0 Request processed in 147us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051360.204739:0:47827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13678 00000100:00100000:3.0:1777051360.204822:0:24269:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7b5e7850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+56:133909:x1863365425914624:12345-192.168.201.46@tcp:35:rm.0 Request processed in 254us (428us total) trans 8589934603 rc 0/0 00000100:00100000:3.0:1777051360.204834:0:24269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3328 00000100:00100000:2.0:1777051360.208897:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051360.208962:0:27885:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425914880 00000100:00100000:0.0:1777051360.208970:0:27885:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425914880 00000100:00100000:0.0:1777051360.209024:0:27885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111888 00000100:00100000:0.0:1777051360.209038:0:27885:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da45f77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+56:133909:x1863365425914880:12345-192.168.201.46@tcp:36:rm.0 00010000:00010000:0.0:1777051360.209113:0:27885:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1777051360.209137:0:27885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d943eba000/0x85f51a6b96715805 lrc: 0/0,0 mode: --/CR res: [0x240000404:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6076 expref: 56 pid: 46494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051360.209182:0:27885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d95595ac00/0x85f51a6b96715772 lrc: 0/0,0 mode: --/PR res: [0x240000404:0xe:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6037 expref: 55 pid: 46494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051360.209208:0:27885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0xe:0x0].0x0 (ffff99d94e5e2c00) 00010000:00010000:0.0:1777051360.209214:0:27885:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1777051360.209298:0:27885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d9559a2000/0x85f51a6b9671582f lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0xd3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051360.209311:0:27885:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d9559a2000/0x85f51a6b9671582f lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 27885 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051360.209325:0:27885:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d9559a2000/0x85f51a6b9671582f lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 27885 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051360.209352:0:27885:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95fbaf480 pname:cluuid:pid:xid:nid:opc:job mdt00_007:lustre-MDT0001-mdtlov_UUID:27885:1863365452588928:0@lo:101:mdt00_007.0 00000100:00100000:0.0:1777051360.209402:0:27885:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051360.209444:0:27885:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da4a170f00 going to sleep for 11 seconds 00000100:00100000:1.0:1777051360.209463:0:6585:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452588928 00000100:00100000:1.0:1777051360.209473:0:6585:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452588928 00000100:00100000:1.0:1777051360.209531:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8096 00000100:00100000:1.0:1777051360.209543:0:6585:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95fbaca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:27885:x1863365452588928:12345-0@lo:101:mdt00_007.0 00010000:00010000:1.0:1777051360.209561:0:6585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777051360.209584:0:6585:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d943ebb800/0x85f51a6b96715836 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0xd3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x85f51a6b9671582f expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051360.209617:0:6585:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99d943eba600/0x85f51a6b967156f4 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6006 expref: 22 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051360.209633:0:6585:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d943ebb800/0x85f51a6b96715836 lrc: 4/0,0 mode: --/CW res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x85f51a6b9671582f expref: 8 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051360.209668:0:6585:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99d943eba600/0x85f51a6b967156f4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6006 expref: 22 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051360.209682:0:6585:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99d943eba600/0x85f51a6b967156f4 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6006 expref: 22 pid: 6579 timeout: 8089 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051360.209703:0:6585:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f298e00 pname:cluuid:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000_UUID:6585:1863365452589056:192.168.201.46@tcp:104: 00000100:00100000:1.0:1777051360.210431:0:6585:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d944ac0b40 going to sleep for 11 seconds 00000100:00100000:1.0:1777051360.213105:0:6585:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f298e00 pname:cluuid:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000_UUID:6585:1863365452589056:192.168.201.46@tcp:104: 00010000:00010000:1.0:1777051360.213136:0:6585:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d943ebb800/0x85f51a6b96715836 lrc: 3/0,0 mode: --/CW res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b9671582f expref: 8 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051360.213148:0:6585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xd3:0x0].0x0 (ffff99d94e6b6b00) 00010000:00010000:1.0:1777051360.213151:0:6585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777051360.213155:0:6585:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff99d943ebb800/0x85f51a6b96715836 lrc: 3/0,0 mode: --/CW res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b9671582f expref: 8 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051360.213164:0:6585:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d943ebb800, rc 0) 00000100:00100000:1.0:1777051360.213218:0:6585:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95fbaca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:27885:x1863365452588928:12345-0@lo:101:mdt00_007.0 Request processed in 3678us (3815us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051360.213229:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8096 00000100:00100000:0.0:1777051360.213315:0:27885:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95fbaf480 pname:cluuid:pid:xid:nid:opc:job mdt00_007:lustre-MDT0001-mdtlov_UUID:27885:1863365452588928:0@lo:101:mdt00_007.0 00010000:00010000:0.0:1777051360.213338:0:27885:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d9559a2000/0x85f51a6b9671582f lrc: 4/0,1 mode: --/CW res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x85f51a6b96715836 expref: -99 pid: 27885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051360.213355:0:27885:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d9559a2000/0x85f51a6b9671582f lrc: 4/0,1 mode: --/CW res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x85f51a6b96715836 expref: -99 pid: 27885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051360.213524:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051360.213599:0:6564:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425915008 00000100:00100000:0.0:1777051360.213607:0:6564:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425915008 00010000:00010000:0.0:1777051360.213637:0:6564:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d943eba600/0x85f51a6b967156f4 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6006 expref: 23 pid: 6579 timeout: 8089 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051360.213683:0:6564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3847 00000100:00100000:0.0:1777051360.213694:0:6564:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da45f75500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+23:2437:x1863365425915008:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1777051360.213710:0:6564:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777051360.213717:0:6564:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99d943eba600/0x85f51a6b967156f4 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6006 expref: 23 pid: 6579 timeout: 8089 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051360.213739:0:6564:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99d943eba600/0x85f51a6b967156f4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6006 expref: 23 pid: 6579 timeout: 8089 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051360.213761:0:6564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d943eba600/0x85f51a6b967156f4 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6006 expref: 23 pid: 6579 timeout: 8089 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051360.213781:0:6564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xd3:0x0].0x0 (ffff99d94e6b6b00) 00010000:00010000:0.0:1777051360.213786:0:6564:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff99d943ebb800/0x85f51a6b96715836 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b9671582f expref: 7 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051360.213797:0:6564:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99d943ebb800/0x85f51a6b96715836 lrc: 2/0,0 mode: CW/CW res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x85f51a6b9671582f expref: 7 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051360.213806:0:6564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d943ebb800/0x85f51a6b96715836 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x85f51a6b9671582f expref: 7 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051360.213834:0:6564:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff99d943ebb800/0x85f51a6b96715836 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b9671582f expref: 7 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051360.213843:0:6564:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95fbaf100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000_UUID:6564:1863365452589184:0@lo:105: 00000100:00100000:0.0:1777051360.213874:0:6564:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051360.213906:0:6564:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da4a170f00 going to sleep for 11 seconds 00000100:00100000:1.0:1777051360.213939:0:6563:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452589184 00000100:00100000:1.0:1777051360.213946:0:6563:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452589184 00000100:00100000:1.0:1777051360.213983:0:6563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1777051360.213991:0:6563:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95fbac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:6564:x1863365452589184:12345-0@lo:105: 00010000:00010000:1.0:1777051360.214005:0:6563:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d9559a2000/0x85f51a6b9671582f lrc: 5/0,1 mode: --/CW res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x85f51a6b96715836 expref: -99 pid: 27885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051360.214020:0:6563:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d9559a2000/0x85f51a6b9671582f lrc: 5/0,1 mode: --/CW res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x85f51a6b96715836 expref: -99 pid: 27885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051360.214069:0:6563:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d9559a2000/0x85f51a6b9671582f lrc: 5/0,1 mode: --/CW res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x85f51a6b96715836 expref: -99 pid: 27885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051360.214083:0:6563:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d9559a2000/0x85f51a6b9671582f lrc: 5/0,1 mode: CW/CW res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x85f51a6b96715836 expref: -99 pid: 27885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051360.214094:0:6563:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d9559a2000/0x85f51a6b9671582f lrc: 6/0,1 mode: CW/CW res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x85f51a6b96715836 expref: -99 pid: 27885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051360.214107:0:6563:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d9559a2000/0x85f51a6b9671582f lrc: 6/0,1 mode: CW/CW res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x85f51a6b96715836 expref: -99 pid: 27885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051360.214130:0:6563:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff99d9559a2000) 00000100:00100000:1.0:1777051360.214178:0:6563:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95fbac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:6564:x1863365452589184:12345-0@lo:105: Request processed in 186us (301us total) trans 0 rc 0/0 00010000:00010000:0.0:1777051360.214179:0:27885:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d9559a2000/0x85f51a6b9671582f lrc: 4/0,1 mode: CW/CW res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x85f51a6b96715836 expref: -99 pid: 27885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051360.214203:0:6563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00010000:00010000:0.0:1777051360.214204:0:27885:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d9559a2000/0x85f51a6b9671582f lrc: 4/0,1 mode: CW/CW res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x85f51a6b96715836 expref: -99 pid: 27885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1777051360.214234:0:27885:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000bd2:0xd3:0x0] 00010000:00010000:0.0:1777051360.214270:0:27885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d9559a3200/0x85f51a6b9671583d lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0xd3:0x0].0xceea225b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051360.214278:0:6564:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95fbaf100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000_UUID:6564:1863365452589184:0@lo:105: 00010000:00010000:0.0:1777051360.214285:0:27885:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d9559a3200/0x85f51a6b9671583d lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0xd3:0x0].0xceea225b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 27885 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051360.214300:0:27885:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d9559a3200/0x85f51a6b9671583d lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0xd3:0x0].0xceea225b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 27885 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051360.214307:0:6564:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1777051360.214354:0:27885:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95fbaf480 pname:cluuid:pid:xid:nid:opc:job mdt00_007:lustre-MDT0001-mdtlov_UUID:27885:1863365452589312:0@lo:101:mdt00_007.0 00000100:00100000:2.0:1777051360.214366:0:6564:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da45f75500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+22:2437:x1863365425915008:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 670us (840us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051360.214381:0:6564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3847 00000100:00100000:0.0:1777051360.214403:0:27885:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051360.214429:0:27885:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da4a170d80 going to sleep for 11 seconds 00000100:00100000:2.0:1777051360.214452:0:6584:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452589312 00000100:00100000:2.0:1777051360.214458:0:6584:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452589312 00000100:00100000:2.0:1777051360.214512:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8097 00000100:00100000:2.0:1777051360.214524:0:6584:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95fbaf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:27885:x1863365452589312:12345-0@lo:101:mdt00_007.0 00010000:00010000:2.0:1777051360.214539:0:6584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051360.214560:0:6584:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d785e00/0x85f51a6b96715844 lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0xd3:0x0].0xceea225b bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x85f51a6b9671583d expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051360.214585:0:6584:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d785e00/0x85f51a6b96715844 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xd3:0x0].0xceea225b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x85f51a6b9671583d expref: 9 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051360.214602:0:6584:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d785e00/0x85f51a6b96715844 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xd3:0x0].0xceea225b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b9671583d expref: 9 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051360.214621:0:6584:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xd3:0x0].0xceea225b (ffff99d94c159e00) 00010000:00010000:2.0:1777051360.214626:0:6584:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777051360.214629:0:6584:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99da7d785e00, rc 0) 00000100:00100000:2.0:1777051360.214683:0:6584:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95fbaf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:27885:x1863365452589312:12345-0@lo:101:mdt00_007.0 Request processed in 161us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051360.214691:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8097 00000100:00100000:0.0:1777051360.214733:0:27885:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95fbaf480 pname:cluuid:pid:xid:nid:opc:job mdt00_007:lustre-MDT0001-mdtlov_UUID:27885:1863365452589312:0@lo:101:mdt00_007.0 00010000:00010000:0.0:1777051360.215007:0:27885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d9559a3200/0x85f51a6b9671583d lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0xd3:0x0].0xceea225b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x85f51a6b96715844 expref: -99 pid: 27885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051360.215020:0:27885:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d9559a3200/0x85f51a6b9671583d lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0xd3:0x0].0xceea225b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x85f51a6b96715844 expref: -99 pid: 27885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1777051360.215034:0:27885:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000bd2:0xd3:0x0] 00000100:00100000:0.0:1777051360.215108:0:27885:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95fbaf480 pname:cluuid:pid:xid:nid:opc:job mdt00_007:lustre-MDT0001-mdtlov_UUID:27885:1863365452589440:0@lo:1000:mdt00_007.0 00000100:00100000:0.0:1777051360.215150:0:27885:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051360.215184:0:27885:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da4a170b40 going to sleep for 11 seconds 00000100:00100000:2.0:1777051360.215256:0:46498:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452589440 00000100:00100000:2.0:1777051360.215265:0:46498:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452589440 00000100:00100000:2.0:1777051360.215310:0:46498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8098 00000100:00100000:2.0:1777051360.215321:0:46498:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94ed2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+9:27885:x1863365452589440:12345-0@lo:1000:mdt00_007.0 00000100:00100000:2.0:1777051360.215397:0:46498:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94ed2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+9:27885:x1863365452589440:12345-0@lo:1000:mdt00_007.0 Request processed in 77us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051360.215407:0:46498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8098 00000100:00100000:0.0:1777051360.215423:0:27885:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95fbaf480 pname:cluuid:pid:xid:nid:opc:job mdt00_007:lustre-MDT0001-mdtlov_UUID:27885:1863365452589440:0@lo:1000:mdt00_007.0 00000100:00100000:0.0:1777051360.215474:0:27885:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94ed2f800 pname:cluuid:pid:xid:nid:opc:job mdt00_007:lustre-MDT0001-mdtlov_UUID:27885:1863365452589568:0@lo:1000:mdt00_007.0 00000100:00100000:0.0:1777051360.215498:0:27885:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051360.215519:0:27885:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da4a170b40 going to sleep for 11 seconds 00000100:00100000:3.0:1777051360.215578:0:46500:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452589568 00000100:00100000:3.0:1777051360.215586:0:46500:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452589568 00000100:00100000:3.0:1777051360.215638:0:46500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8099 00000100:00100000:3.0:1777051360.215650:0:46500:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94ed2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+9:27885:x1863365452589568:12345-0@lo:1000:mdt00_007.0 00000100:00100000:3.0:1777051360.216096:0:46500:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94ed2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+9:27885:x1863365452589568:12345-0@lo:1000:mdt00_007.0 Request processed in 445us (592us total) trans 0 rc 1/1 00000100:00100000:3.0:1777051360.216116:0:46500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8099 00000100:00100000:0.0:1777051360.216126:0:27885:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94ed2f800 pname:cluuid:pid:xid:nid:opc:job mdt00_007:lustre-MDT0001-mdtlov_UUID:27885:1863365452589568:0@lo:1000:mdt00_007.0 00010000:00010000:0.0:1777051360.216193:0:27885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d9559a2400/0x85f51a6b9671584b lrc: 3/0,1 mode: --/EX res: [0x240000404:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051360.216205:0:27885:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d9559a2400/0x85f51a6b9671584b lrc: 3/0,1 mode: --/EX res: [0x240000404:0xe:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 27885 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051360.216216:0:27885:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d9559a2400/0x85f51a6b9671584b lrc: 3/0,1 mode: --/EX res: [0x240000404:0xe:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 27885 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051360.216235:0:27885:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94ed2f800 pname:cluuid:pid:xid:nid:opc:job mdt00_007:lustre-MDT0001-mdtlov_UUID:27885:1863365452589696:0@lo:101:mdt00_007.0 00000100:00100000:0.0:1777051360.216268:0:27885:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051360.216296:0:27885:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da4a170d80 going to sleep for 11 seconds 00000100:00100000:2.0:1777051360.216342:0:11727:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452589696 00000100:00100000:2.0:1777051360.216350:0:11727:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452589696 00000100:00100000:2.0:1777051360.216399:0:11727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8100 00000100:00100000:2.0:1777051360.216408:0:11727:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94ed2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:27885:x1863365452589696:12345-0@lo:101:mdt00_007.0 00010000:00010000:2.0:1777051360.216421:0:11727:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051360.216438:0:11727:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d785600/0x85f51a6b96715852 lrc: 2/0,0 mode: --/EX res: [0x240000404:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x85f51a6b9671584b expref: -99 pid: 11727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051360.216466:0:11727:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7e00/0x85f51a6b96715622 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0xe:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5fc0 expref: 18 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051360.216481:0:11727:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d785600/0x85f51a6b96715852 lrc: 4/0,0 mode: --/EX res: [0x240000404:0xe:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x85f51a6b9671584b expref: 10 pid: 11727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051360.216523:0:11727:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7e00/0x85f51a6b96715622 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0xe:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5fc0 expref: 18 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051360.216542:0:11727:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7e00/0x85f51a6b96715622 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0xe:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5fc0 expref: 18 pid: 6580 timeout: 8089 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051360.216558:0:11727:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d951fa1f80 pname:cluuid:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000_UUID:11727:1863365452589824:192.168.201.46@tcp:104: 00000100:00100000:2.0:1777051360.216621:0:11727:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da43840480 going to sleep for 11 seconds 00000100:00100000:2.0:1777051360.222687:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051360.223014:0:11727:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d951fa1f80 pname:cluuid:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000_UUID:11727:1863365452589824:192.168.201.46@tcp:104: 00010000:00010000:0.0:1777051360.223082:0:11727:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d785600/0x85f51a6b96715852 lrc: 3/0,0 mode: --/EX res: [0x240000404:0xe:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b9671584b expref: 10 pid: 11727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051360.223085:0:47597:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425915136 00000100:00100000:3.0:1777051360.223096:0:47597:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425915136 00010000:00010000:0.0:1777051360.223111:0:11727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0xe:0x0].0x0 (ffff99d9413d2e00) 00010000:00010000:0.0:1777051360.223119:0:11727:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1777051360.223126:0:11727:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d785600/0x85f51a6b96715852 lrc: 3/0,0 mode: --/EX res: [0x240000404:0xe:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b9671584b expref: 10 pid: 11727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051360.223435:0:11727:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99da7d785600, rc 0) 00000100:00100000:0.0:1777051360.223496:0:11727:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94ed2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+10:27885:x1863365452589696:12345-0@lo:101:mdt00_007.0 Request processed in 7085us (7224us total) trans 0 rc 0/0 00010000:00010000:3.0:1777051360.223496:0:47597:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7e00/0x85f51a6b96715622 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0xe:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5fc0 expref: 19 pid: 6580 timeout: 8089 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1777051360.223508:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1777051360.223515:0:11727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8100 00000100:00100000:3.0:1777051360.223560:0:47597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3848 00000100:00100000:2.0:1777051360.223561:0:27885:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94ed2f800 pname:cluuid:pid:xid:nid:opc:job mdt00_007:lustre-MDT0001-mdtlov_UUID:27885:1863365452589696:0@lo:101:mdt00_007.0 00000100:00100000:3.0:1777051360.223581:0:47597:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d944e10380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+19:2437:x1863365425915136:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1777051360.223588:0:27885:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d9559a2400/0x85f51a6b9671584b lrc: 4/0,1 mode: --/EX res: [0x240000404:0xe:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x85f51a6b96715852 expref: -99 pid: 27885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051360.223598:0:47597:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777051360.223610:0:27885:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d9559a2400/0x85f51a6b9671584b lrc: 4/0,1 mode: --/EX res: [0x240000404:0xe:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x85f51a6b96715852 expref: -99 pid: 27885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051360.223611:0:47597:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7e00/0x85f51a6b96715622 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5fc0 expref: 19 pid: 6580 timeout: 8089 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051360.223896:0:47597:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7e00/0x85f51a6b96715622 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5fc0 expref: 19 pid: 6580 timeout: 8089 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051360.223926:0:47597:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7e00/0x85f51a6b96715622 lrc: 0/0,0 mode: --/PR res: [0x240000404:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5fc0 expref: 19 pid: 6580 timeout: 8089 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051360.223947:0:47597:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0xe:0x0].0x0 (ffff99d9413d2e00) 00010000:00010000:3.0:1777051360.223955:0:47597:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d785600/0x85f51a6b96715852 lrc: 2/0,0 mode: --/EX res: [0x240000404:0xe:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b9671584b expref: 9 pid: 11727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051360.223971:0:47597:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d785600/0x85f51a6b96715852 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0xe:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x85f51a6b9671584b expref: 9 pid: 11727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051360.223983:0:47597:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d785600/0x85f51a6b96715852 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0xe:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x85f51a6b9671584b expref: 9 pid: 11727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051360.224022:0:47597:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d785600/0x85f51a6b96715852 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0xe:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b9671584b expref: 9 pid: 11727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051360.224040:0:47597:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da44494e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0000_UUID:47597:1863365452589952:0@lo:105: 00000100:00100000:3.0:1777051360.224462:0:47597:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051360.224501:0:47597:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d95ba60900 going to sleep for 11 seconds 00000100:00100000:1.0:1777051360.224568:0:102039:0:(service.c:153:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1777051360.224588:0:102039:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452589952 00000100:00100000:1.0:1777051360.224593:0:102039:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452589952 00000100:00100000:1.0:1777051360.224648:0:102039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1777051360.224659:0:102039:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f29c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0001-mdtlov_UUID+4:47597:x1863365452589952:12345-0@lo:105: 00010000:00010000:1.0:1777051360.224670:0:102039:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d9559a2400/0x85f51a6b9671584b lrc: 5/0,1 mode: --/EX res: [0x240000404:0xe:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x85f51a6b96715852 expref: -99 pid: 27885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051360.224683:0:102039:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d9559a2400/0x85f51a6b9671584b lrc: 5/0,1 mode: --/EX res: [0x240000404:0xe:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x85f51a6b96715852 expref: -99 pid: 27885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051360.224694:0:102039:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d9559a2400/0x85f51a6b9671584b lrc: 5/0,1 mode: --/EX res: [0x240000404:0xe:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x85f51a6b96715852 expref: -99 pid: 27885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051360.224702:0:102039:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d9559a2400/0x85f51a6b9671584b lrc: 5/0,1 mode: EX/EX res: [0x240000404:0xe:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x85f51a6b96715852 expref: -99 pid: 27885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051360.224708:0:102039:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d9559a2400/0x85f51a6b9671584b lrc: 6/0,1 mode: EX/EX res: [0x240000404:0xe:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x85f51a6b96715852 expref: -99 pid: 27885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051360.224716:0:102039:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d9559a2400/0x85f51a6b9671584b lrc: 6/0,1 mode: EX/EX res: [0x240000404:0xe:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x85f51a6b96715852 expref: -99 pid: 27885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051360.224738:0:102039:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff99d9559a2400) 00000100:00100000:1.0:1777051360.224781:0:102039:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f29c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0001-mdtlov_UUID+4:47597:x1863365452589952:12345-0@lo:105: Request processed in 124us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051360.224789:0:102039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00010000:00010000:0.0:1777051360.224807:0:27885:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d9559a2400/0x85f51a6b9671584b lrc: 4/0,1 mode: EX/EX res: [0x240000404:0xe:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x85f51a6b96715852 expref: -99 pid: 27885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051360.224824:0:27885:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d9559a2400/0x85f51a6b9671584b lrc: 4/0,1 mode: EX/EX res: [0x240000404:0xe:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x85f51a6b96715852 expref: -99 pid: 27885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051360.224862:0:47597:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da44494e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0000_UUID:47597:1863365452589952:0@lo:105: 00010000:00010000:0.0:1777051360.224871:0:27885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a2c00/0x85f51a6b96715859 lrc: 3/0,1 mode: --/EX res: [0x240000404:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051360.224887:0:47597:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1777051360.224889:0:27885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a2c00/0x85f51a6b96715859 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 27885 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051360.224905:0:27885:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a2c00/0x85f51a6b96715859 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 27885 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051360.224948:0:47597:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d944e10380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+18:2437:x1863365425915136:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 1369us (2264us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051360.224961:0:47597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3848 00000040:00080000:0.0:1777051360.225547:0:27885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000bd0:0x1:0x0].2, 416 off34264 00000040:00080000:0.0:1777051360.225628:0:27885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2000032e1:0x1:0x0].2, 496 off34488 00000004:00080000:0.0:1777051360.225639:0:27885:0:(osp_trans.c:1582:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff99da4a170b40 with version 9 00000004:00080000:3.0:1777051360.225717:0:104211:0:(osp_trans.c:1330:osp_get_next_request()) ou ffff99d9596fa9c0 version 9 rpc_version 9 00000020:00100000:3.0:1777051360.225748:0:104211:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1777051360.225761:0:104211:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff99da44494e00 x1863365452590208/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1728/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1777051360.225787:0:104211:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da44494e00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:104211:1863365452590208:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1777051360.225835:0:104211:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051360.225869:0:104211:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d95ba60900 going to sleep for 11 seconds 00000100:00100000:0.0:1777051360.225933:0:47208:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452590208 00000100:00100000:0.0:1777051360.225941:0:47208:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452590208 00000100:00100000:0.0:1777051360.225997:0:47208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8101 00000100:00100000:0.0:1777051360.226009:0:47208:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da44494700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+10:104211:x1863365452590208:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1777051360.226583:0:47208:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da44494700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+11:104211:x1863365452590208:12345-0@lo:1000:osp_up0-1.0 Request processed in 574us (746us total) trans 30064771093 rc 0/0 00000100:00100000:0.0:1777051360.226594:0:47208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8101 00000100:00100000:3.0:1777051360.226661:0:104211:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da44494e00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:104211:1863365452590208:0@lo:1000:osp_up0-1.0 00000004:00200000:0.0:1777051360.226689:0:27885:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0xe:0x0]: returning size 4096 00010000:00010000:0.0:1777051360.226716:0:27885:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a2c00/0x85f51a6b96715859 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 27885 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051360.227017:0:27885:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a2c00/0x85f51a6b96715859 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 27885 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051360.227028:0:27885:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a2c00/0x85f51a6b96715859 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 27885 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051360.227038:0:27885:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d9559a2c00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:0.0:1777051360.227068:0:27885:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a2c00/0x85f51a6b96715859 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 27885 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051360.227083:0:27885:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a2c00/0x85f51a6b96715859 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 27885 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051360.227098:0:27885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0xe:0x0].0x0 (ffff99d94e5e2c00) 00010000:00010000:0.0:1777051360.227102:0:27885:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777051360.227108:0:27885:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a2c00/0x85f51a6b96715859 lrc: 2/0,0 mode: --/EX res: [0x240000404:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 27885 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051360.227118:0:27885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a2c00/0x85f51a6b96715859 lrc: 0/0,0 mode: --/EX res: [0x240000404:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 27885 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051360.227436:0:27885:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d9559a2400/0x85f51a6b9671584b lrc: 4/0,1 mode: EX/EX res: [0x240000404:0xe:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x85f51a6b96715852 expref: -99 pid: 27885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051360.227450:0:27885:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d9559a2400/0x85f51a6b9671584b lrc: 4/0,1 mode: EX/EX res: [0x240000404:0xe:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x85f51a6b96715852 expref: -99 pid: 27885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051360.227461:0:27885:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d9559a2400/0x85f51a6b9671584b lrc: 3/0,0 mode: EX/EX res: [0x240000404:0xe:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x85f51a6b96715852 expref: -99 pid: 27885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051360.227505:0:27885:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1777051360.227519:0:27885:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000bd2:0xd3:0x0] 00010000:00010000:0.0:1777051360.227525:0:27885:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d9559a2000/0x85f51a6b9671582f lrc: 4/0,1 mode: CW/CW res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x85f51a6b96715836 expref: -99 pid: 27885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051360.227535:0:27885:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d9559a2000/0x85f51a6b9671582f lrc: 4/0,1 mode: CW/CW res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x85f51a6b96715836 expref: -99 pid: 27885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051360.227547:0:27885:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d9559a2000/0x85f51a6b9671582f lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x85f51a6b96715836 expref: -99 pid: 27885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051360.227586:0:27885:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1777051360.227591:0:6568:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000004:00080000:0.0:1777051360.227593:0:27885:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000bd2:0xd3:0x0] 00010000:00010000:0.0:1777051360.227604:0:27885:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d9559a3200/0x85f51a6b9671583d lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0xd3:0x0].0xceea225b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x85f51a6b96715844 expref: -99 pid: 27885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051360.227604:0:6568:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d9559a2400/0x85f51a6b9671584b lrc: 2/0,0 mode: EX/EX res: [0x240000404:0xe:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x85f51a6b96715852 expref: -99 pid: 27885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051360.227645:0:27885:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d9559a3200/0x85f51a6b9671583d lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xd3:0x0].0xceea225b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x85f51a6b96715844 expref: -99 pid: 27885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051360.227645:0:6568:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d9559a2400 already unused, calling callback (ffffffffc177eed0) 00010000:00010000:2.0:1777051360.227657:0:6568:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d9559a2400/0x85f51a6b9671584b lrc: 3/0,0 mode: EX/EX res: [0x240000404:0xe:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x85f51a6b96715852 expref: -99 pid: 27885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1777051360.227672:0:6568:0:(mdt_handler.c:3963:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d9559a2400/0x85f51a6b9671584b lrc: 3/0,0 mode: EX/EX res: [0x240000404:0xe:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x85f51a6b96715852 expref: -99 pid: 27885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051360.227736:0:27885:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da45f77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+55:133909:x1863365425914880:12345-192.168.201.46@tcp:36:rm.0 Request processed in 18698us (18838us total) trans 8589934604 rc 0/0 00000100:00100000:0.0:1777051360.227748:0:27885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111888 00010000:00010000:1.0:1777051360.227955:0:38719:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777051360.227965:0:38719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d9559a2000/0x85f51a6b9671582f lrc: 2/0,0 mode: CW/CW res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x85f51a6b96715836 expref: -99 pid: 27885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051360.227978:0:38719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d9559a2000 already unused, calling callback (ffffffffc177eed0) 00010000:00010000:1.0:1777051360.227984:0:38719:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d9559a2000/0x85f51a6b9671582f lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x85f51a6b96715836 expref: -99 pid: 27885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1777051360.227996:0:38719:0:(mdt_handler.c:3963:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d9559a2000/0x85f51a6b9671582f lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x85f51a6b96715836 expref: -99 pid: 27885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051360.228036:0:38719:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d9559a2000/0x85f51a6b9671582f lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x85f51a6b96715836 expref: -99 pid: 27885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051360.228073:0:38719:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1777051360.228543:0:38719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d9559a2000/0x85f51a6b9671582f lrc: 1/0,0 mode: --/CW res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x85f51a6b96715836 expref: -99 pid: 27885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051360.228562:0:38719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d9559a2000/0x85f51a6b9671582f lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x85f51a6b96715836 expref: -99 pid: 27885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051360.228590:0:3679:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:1.0:1777051360.228590:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051360.228595:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051360.228600:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1777051360.228614:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f298e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452590336:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1777051360.228659:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051360.228729:0:6566:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452590336 00000100:00100000:1.0:1777051360.228736:0:6566:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452590336 00000100:00100000:1.0:1777051360.228791:0:6566:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13679 00000100:00100000:1.0:1777051360.228802:0:6566:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94ed2f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+11:3679:x1863365452590336:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1777051360.228815:0:6566:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1777051360.228833:0:6566:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d943ebb800/0x85f51a6b96715836 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x85f51a6b9671582f expref: 11 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051360.228851:0:6566:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xd3:0x0].0x0 (ffff99d94e6b6b00) 00010000:00010000:1.0:1777051360.228858:0:6566:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1777051360.228911:0:6566:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94ed2f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+10:3679:x1863365452590336:12345-0@lo:103:ldlm_bl.0 Request processed in 109us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051360.228923:0:6566:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13679 00000100:00100000:0.0:1777051360.228961:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f298e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452590336:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1777051360.231121:0:6568:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d9559a2400/0x85f51a6b9671584b lrc: 2/0,0 mode: --/EX res: [0x240000404:0xe:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x85f51a6b96715852 expref: -99 pid: 27885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051360.231136:0:6568:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1777051360.231181:0:6568:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d9559a2400/0x85f51a6b9671584b lrc: 1/0,0 mode: --/EX res: [0x240000404:0xe:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x85f51a6b96715852 expref: -99 pid: 27885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051360.231195:0:6568:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d9559a2400/0x85f51a6b9671584b lrc: 0/0,0 mode: --/EX res: [0x240000404:0xe:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x85f51a6b96715852 expref: -99 pid: 27885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051360.231225:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1777051360.231228:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95f65aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452590464:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1777051360.231232:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777051360.231239:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1777051360.231299:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051360.231365:0:47827:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452590464 00000100:00100000:0.0:1777051360.231373:0:47827:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452590464 00000100:00100000:0.0:1777051360.231433:0:47827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13680 00000100:00100000:0.0:1777051360.231446:0:47827:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da6fd40050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:lustre-MDT0001-mdtlov_UUID+10:3677:x1863365452590464:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1777051360.231462:0:47827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777051360.231480:0:47827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d785600/0x85f51a6b96715852 lrc: 0/0,0 mode: --/EX res: [0x240000404:0xe:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x85f51a6b9671584b expref: 10 pid: 11727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051360.231519:0:47827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0xe:0x0].0x0 (ffff99d9413d2e00) 00010000:00010000:0.0:1777051360.231534:0:47827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1777051360.231603:0:47827:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da6fd40050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:lustre-MDT0001-mdtlov_UUID+9:3677:x1863365452590464:12345-0@lo:103:ldlm_bl.0 Request processed in 159us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051360.231614:0:47827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13680 00000100:00100000:1.0:1777051360.231662:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95f65aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452590464:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1777051360.239400:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051360.239418:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051360.239525:0:6579:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425915392 00000100:00100000:3.0:1777051360.239537:0:6579:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425915392 00000100:00100000:3.0:1777051360.239624:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111889 00000100:00100000:3.0:1777051360.239641:0:6579:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f299f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+22:133910:x1863365425915392:12345-192.168.201.46@tcp:101:rm.0 00010000:00010000:3.0:1777051360.239968:0:6579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777051360.239997:0:6579:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d95595b200/0x85f51a6b96715860 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b60a0 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1777051360.240255:0:6579:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0xd4:0x0]: returning size 4096 00010000:00010000:3.0:1777051360.240432:0:6579:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d95595b200/0x85f51a6b96715860 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b60a0 expref: 24 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051360.240457:0:6579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xd3:0x0].0x0 (ffff99d94e6b6b00) 00010000:00010000:3.0:1777051360.240464:0:6579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00000100:00100000:0.0:1777051360.240466:0:6585:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425915520 00010000:00010000:3.0:1777051360.240475:0:6579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d95595b200/0x85f51a6b96715860 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b60a0 expref: 24 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051360.240477:0:6585:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425915520 00010000:00010000:3.0:1777051360.240502:0:6579:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d95595b200, rc 0) 00000100:00100000:0.0:1777051360.240544:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 8102 00000100:00100000:0.0:1777051360.240560:0:6585:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f658700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+24:2436:x1863365425915520:12345-192.168.201.46@tcp:63:ll_sa.0 00000100:00100000:3.0:1777051360.240597:0:6579:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f299f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+24:133910:x1863365425915392:12345-192.168.201.46@tcp:101:rm.0 Request processed in 957us (1206us total) trans 30064771094 rc 301/301 00000100:00100000:3.0:1777051360.240612:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111889 00010000:00010000:0.0:1777051360.240621:0:6585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051360.240639:0:6585:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2c00/0x85f51a6b9671586e lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b607d expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051360.240690:0:6585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3400/0x85f51a6b96715875 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051360.240707:0:6585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3400/0x85f51a6b96715875 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051360.240719:0:6585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3400/0x85f51a6b96715875 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051360.240733:0:6585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2600/0x85f51a6b9671587c lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xd3:0x0].0xceea225b bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051360.240751:0:6585:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d785e00/0x85f51a6b96715844 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0xd3:0x0].0xceea225b bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b9671583d expref: 8 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051360.240765:0:6585:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2600/0x85f51a6b9671587c lrc: 4/1,0 mode: --/PR res: [0x200000bd2:0xd3:0x0].0xceea225b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051360.240813:0:6585:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d785e00/0x85f51a6b96715844 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xd3:0x0].0xceea225b bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x85f51a6b9671583d expref: 8 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051360.240836:0:6585:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94ed2f800 pname:cluuid:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000_UUID:6585:1863365452590592:0@lo:104: 00000100:00100000:0.0:1777051360.240892:0:6585:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051360.240952:0:6585:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d9565d43c0 going to sleep for 11 seconds 00000100:00100000:3.0:1777051360.241119:0:99220:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452590592 00000100:00100000:3.0:1777051360.241127:0:99220:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452590592 00000100:00100000:1.0:1777051360.241418:0:6563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1777051360.241437:0:6563:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94ed2df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:6585:x1863365452590592:12345-0@lo:104: 00010000:00010000:1.0:1777051360.241478:0:6563:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d9559a3200/0x85f51a6b9671583d lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xd3:0x0].0xceea225b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x85f51a6b96715844 expref: -99 pid: 27885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051360.241585:0:6563:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1777051360.241597:0:6563:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94ed2df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:6585:x1863365452590592:12345-0@lo:104: Request processed in 165us (703us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051360.241610:0:6563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1777051360.241639:0:6585:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94ed2f800 pname:cluuid:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000_UUID:6585:1863365452590592:0@lo:104: 00010000:00010000:2.0:1777051360.241645:0:6567:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777051360.241660:0:6567:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d9559a3200/0x85f51a6b9671583d lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xd3:0x0].0xceea225b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x85f51a6b96715844 expref: -99 pid: 27885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051360.241671:0:6585:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2600/0x85f51a6b9671587c lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xd3:0x0].0xceea225b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051360.241683:0:6567:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d9559a3200 already unused, calling callback (ffffffffc177eed0) 00010000:00010000:2.0:1777051360.241695:0:6567:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d9559a3200/0x85f51a6b9671583d lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0xd3:0x0].0xceea225b bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0x85f51a6b96715844 expref: -99 pid: 27885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1777051360.241711:0:6567:0:(mdt_handler.c:3963:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d9559a3200/0x85f51a6b9671583d lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0xd3:0x0].0xceea225b bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0x85f51a6b96715844 expref: -99 pid: 27885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051360.241752:0:6567:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d9559a3200/0x85f51a6b9671583d lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0xd3:0x0].0xceea225b bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x85f51a6b96715844 expref: -99 pid: 27885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051360.241773:0:6567:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1777051360.241817:0:6567:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d9559a3200/0x85f51a6b9671583d lrc: 1/0,0 mode: --/PW res: [0x200000bd2:0xd3:0x0].0xceea225b bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x85f51a6b96715844 expref: -99 pid: 27885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051360.241830:0:6567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d9559a3200/0x85f51a6b9671583d lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0xd3:0x0].0xceea225b bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x85f51a6b96715844 expref: -99 pid: 27885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051360.241858:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777051360.241862:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777051360.241867:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777051360.241891:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95f658000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452590720:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1777051360.241950:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051360.242024:0:6564:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452590720 00000100:00100000:2.0:1777051360.242032:0:6564:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452590720 00010000:00010000:2.0:1777051360.242088:0:6564:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d785e00/0x85f51a6b96715844 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xd3:0x0].0xceea225b bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0x85f51a6b9671583d expref: 9 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051360.242153:0:6564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3849 00000100:00100000:2.0:1777051360.242167:0:6564:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da44496680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+9:3678:x1863365452590720:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1777051360.242184:0:6564:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1777051360.244885:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051360.244970:0:6582:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425915648 00000100:00100000:2.0:1777051360.244987:0:6582:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425915648 00000100:00100000:2.0:1777051360.245389:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3329 00000100:00100000:2.0:1777051360.245411:0:6582:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f299180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+25:133910:x1863365425915648:12345-192.168.201.46@tcp:37:rm.0 00000001:00080000:3.0:1777051360.246093:0:103159:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771094 is committed 00000001:00080000:3.0:1777051360.246105:0:103159:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771093 is committed 00010000:00010000:0.0:1777051360.246333:0:6564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d785e00/0x85f51a6b96715844 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0xd3:0x0].0xceea225b bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0x85f51a6b9671583d expref: 7 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051360.246359:0:6564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xd3:0x0].0xceea225b (ffff99d94c159e00) 00010000:00010000:0.0:1777051360.246367:0:6564:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2600/0x85f51a6b9671587c lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xd3:0x0].0xceea225b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051360.246381:0:6564:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2600/0x85f51a6b9671587c lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xd3:0x0].0xceea225b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051360.246402:0:6564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2600/0x85f51a6b9671587c lrc: 4/1,0 mode: PR/PR res: [0x200000bd2:0xd3:0x0].0xceea225b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051360.246445:0:6564:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1777051360.246517:0:6585:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2600/0x85f51a6b9671587c lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xd3:0x0].0xceea225b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6585 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051360.246523:0:6564:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da44496680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+6:3678:x1863365452590720:12345-0@lo:103:ldlm_bl.0 Request processed in 4356us (4569us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051360.246553:0:6564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3849 00010000:00010000:1.0:1777051360.246568:0:6585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2600/0x85f51a6b9671587c lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xd3:0x0].0xceea225b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6585 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051360.246614:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95f658000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452590720:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1777051360.246619:0:6585:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3400/0x85f51a6b96715875 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051360.246631:0:6585:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3400/0x85f51a6b96715875 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051360.246641:0:6585:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3400/0x85f51a6b96715875 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051360.246647:0:6585:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d9559a3400 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:1.0:1777051360.246655:0:6585:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3400/0x85f51a6b96715875 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051360.246665:0:6585:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3400/0x85f51a6b96715875 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051360.246681:0:6585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xd3:0x0].0x0 (ffff99d94e6b6b00) 00010000:00010000:1.0:1777051360.246685:0:6585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777051360.246690:0:6585:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3400/0x85f51a6b96715875 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051360.246698:0:6585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3400/0x85f51a6b96715875 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051360.246711:0:6585:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2600/0x85f51a6b9671587c lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xd3:0x0].0xceea225b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051360.246718:0:6585:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2600/0x85f51a6b9671587c lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0xd3:0x0].0xceea225b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051360.246724:0:6585:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2600/0x85f51a6b9671587c lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xd3:0x0].0xceea225b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051360.246729:0:6585:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d9559a2600 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:1.0:1777051360.246732:0:6585:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2600/0x85f51a6b9671587c lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xd3:0x0].0xceea225b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051360.246738:0:6585:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2600/0x85f51a6b9671587c lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0xd3:0x0].0xceea225b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051360.246745:0:6585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xd3:0x0].0xceea225b (ffff99d94c159e00) 00010000:00010000:1.0:1777051360.246748:0:6585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777051360.246753:0:6585:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2600/0x85f51a6b9671587c lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0xd3:0x0].0xceea225b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051360.246761:0:6585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2600/0x85f51a6b9671587c lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xd3:0x0].0xceea225b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6585 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051360.246804:0:6585:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2c00/0x85f51a6b9671586e lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b607d expref: 25 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051360.246816:0:6585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xd3:0x0].0x0 (ffff99d94e6b6b00) 00010000:00010000:1.0:1777051360.246819:0:6585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1777051360.246823:0:6585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2c00/0x85f51a6b9671586e lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b607d expref: 25 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051360.246836:0:6585:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d9559a2c00, rc -2) 00000100:00100000:1.0:1777051360.246900:0:6585:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f658700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+24:2436:x1863365425915520:12345-192.168.201.46@tcp:63:ll_sa.0 Request processed in 6345us (7487us total) trans 0 rc -2/-2 00000100:00100000:1.0:1777051360.246912:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 8102 00000100:00100000:2.0:1777051360.250668:0:6582:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f299180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+22:133910:x1863365425915648:12345-192.168.201.46@tcp:37:rm.0 Request processed in 5264us (5787us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051360.250680:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3329 00000100:00100000:0.0:1777051360.256557:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051360.256674:0:46501:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425915904 00000100:00100000:1.0:1777051360.256688:0:46501:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425915904 00000100:00100000:1.0:1777051360.256766:0:46501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3330 00000100:00100000:1.0:1777051360.256782:0:46501:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94ed2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+22:133910:x1863365425915904:12345-192.168.201.46@tcp:35:rm.0 00000100:00100000:1.0:1777051360.257170:0:46501:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94ed2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+23:133910:x1863365425915904:12345-192.168.201.46@tcp:35:rm.0 Request processed in 391us (621us total) trans 30064771095 rc 0/0 00000100:00100000:1.0:1777051360.257183:0:46501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3330 00000100:00100000:0.0:1777051360.260617:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051360.260991:0:27882:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425916160 00000100:00100000:2.0:1777051360.261003:0:27882:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425916160 00000100:00100000:2.0:1777051360.261130:0:27882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111890 00000100:00100000:2.0:1777051360.261148:0:27882:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94ed2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+23:133910:x1863365425916160:12345-192.168.201.46@tcp:101:rm.0 00010000:00010000:2.0:1777051360.261175:0:27882:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051360.261276:0:27882:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d785400/0x85f51a6b96715883 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b60bc expref: -99 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051360.261426:0:27882:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784e00/0x85f51a6b9671588a lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0xd4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051360.261452:0:27882:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784e00/0x85f51a6b9671588a lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0xd4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051360.261474:0:27882:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784e00/0x85f51a6b9671588a lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0xd4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1777051360.261495:0:27882:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0xd4:0x0]: returning size 4096 00010000:00010000:2.0:1777051360.261637:0:27882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d785400/0x85f51a6b96715883 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b60bc expref: 26 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051360.261964:0:27882:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784e00/0x85f51a6b9671588a lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0xd4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b60bc expref: 25 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051360.261980:0:27882:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xd4:0x0].0x0 (ffff99d94e6b6100) 00010000:00010000:2.0:1777051360.261985:0:27882:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1777051360.261991:0:27882:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99da7d784e00, rc 0) 00000100:00100000:2.0:1777051360.262084:0:27882:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94ed2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+25:133910:x1863365425916160:12345-192.168.201.46@tcp:101:rm.0 Request processed in 940us (1468us total) trans 30064771096 rc 0/0 00000100:00100000:2.0:1777051360.262097:0:27882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111890 00000100:00100000:2.0:1777051360.266620:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051360.266735:0:46497:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425916416 00000100:00100000:0.0:1777051360.266747:0:46497:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425916416 00000100:00100000:0.0:1777051360.266828:0:46497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111891 00000100:00100000:0.0:1777051360.266845:0:46497:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f65bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+25:133910:x1863365425916416:12345-192.168.201.46@tcp:36:rm.0 00010000:00010000:0.0:1777051360.266905:0:46497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1777051360.266939:0:46497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d943ebb000/0x85f51a6b967156df lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0xc2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5ff8 expref: 25 pid: 21368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051360.266965:0:46497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0xc2:0x0].0x0 (ffff99d94e6b6500) 00010000:00010000:0.0:1777051360.266981:0:46497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6000/0x85f51a6b96715702 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xd4:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b600d expref: 24 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051360.266999:0:46497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xd4:0x0].0x0 (ffff99d94e6b6100) 00010000:00010000:0.0:1777051360.267004:0:46497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1777051360.267028:0:46497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2e00/0x85f51a6b96715898 lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0xd4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051360.267083:0:46497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2e00/0x85f51a6b96715898 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0xd4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051360.267100:0:46497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2e00/0x85f51a6b96715898 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0xd4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051360.267130:0:46497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3000/0x85f51a6b9671589f lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0xd4:0x0].0x674069f9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051360.267162:0:46497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3000/0x85f51a6b9671589f lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xd4:0x0].0x674069f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051360.267177:0:46497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3000/0x85f51a6b9671589f lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xd4:0x0].0x674069f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051360.267374:0:46497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2800/0x85f51a6b967158a6 lrc: 3/0,1 mode: --/EX res: [0x200000bd3:0xc2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051360.267394:0:46497:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99d943ebbc00/0x85f51a6b967155dc lrc: 2/0,0 mode: PR/PR res: [0x200000bd3:0xc2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5fab expref: 17 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051360.267408:0:46497:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2800/0x85f51a6b967158a6 lrc: 4/0,1 mode: --/EX res: [0x200000bd3:0xc2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051360.267463:0:46497:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99d943ebbc00/0x85f51a6b967155dc lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0xc2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5fab expref: 17 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051360.267489:0:46497:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99d943ebbc00/0x85f51a6b967155dc lrc: 4/0,0 mode: PR/PR res: [0x200000bd3:0xc2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5fab expref: 17 pid: 6581 timeout: 8089 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051360.267513:0:46497:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94ed2c000 pname:cluuid:pid:xid:nid:opc:job mdt00_009:lustre-MDT0000_UUID:46497:1863365452590848:192.168.201.46@tcp:104: 00000100:00100000:0.0:1777051360.267632:0:46497:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d9565d43c0 going to sleep for 11 seconds 00000100:00100000:2.0:1777051360.270602:0:46497:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94ed2c000 pname:cluuid:pid:xid:nid:opc:job mdt00_009:lustre-MDT0000_UUID:46497:1863365452590848:192.168.201.46@tcp:104: 00010000:00010000:2.0:1777051360.270638:0:46497:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2800/0x85f51a6b967158a6 lrc: 3/0,1 mode: --/EX res: [0x200000bd3:0xc2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051360.272414:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051360.272618:0:47597:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425916544 00000100:00100000:3.0:1777051360.272630:0:47597:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425916544 00010000:00010000:3.0:1777051360.272676:0:47597:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d943ebbc00/0x85f51a6b967155dc lrc: 4/0,0 mode: PR/PR res: [0x200000bd3:0xc2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5fab expref: 18 pid: 6581 timeout: 8089 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051360.273127:0:9550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3850 00000100:00100000:0.0:1777051360.273147:0:9550:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f65b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+18:2436:x1863365425916544:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1777051360.273170:0:9550:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777051360.273181:0:9550:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99d943ebbc00/0x85f51a6b967155dc lrc: 4/0,0 mode: PR/PR res: [0x200000bd3:0xc2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5fab expref: 18 pid: 6581 timeout: 8089 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051360.273252:0:9550:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99d943ebbc00/0x85f51a6b967155dc lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0xc2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5fab expref: 18 pid: 6581 timeout: 8089 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051360.273281:0:9550:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d943ebbc00/0x85f51a6b967155dc lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0xc2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5fab expref: 18 pid: 6581 timeout: 8089 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051360.273304:0:9550:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0xc2:0x0].0x0 (ffff99d94e6b6500) 00010000:00010000:0.0:1777051360.273312:0:9550:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2800/0x85f51a6b967158a6 lrc: 3/0,1 mode: --/EX res: [0x200000bd3:0xc2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051360.273325:0:9550:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2800/0x85f51a6b967158a6 lrc: 3/0,1 mode: EX/EX res: [0x200000bd3:0xc2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051360.273337:0:9550:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2800/0x85f51a6b967158a6 lrc: 4/0,1 mode: EX/EX res: [0x200000bd3:0xc2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051360.273377:0:9550:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1777051360.273450:0:46497:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2800/0x85f51a6b967158a6 lrc: 3/0,1 mode: EX/EX res: [0x200000bd3:0xc2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051360.273453:0:9550:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f65b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+17:2436:x1863365425916544:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 310us (1040us total) trans 0 rc 0/0 00010000:00010000:2.0:1777051360.273479:0:46497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2800/0x85f51a6b967158a6 lrc: 3/0,1 mode: EX/EX res: [0x200000bd3:0xc2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051360.273483:0:9550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3850 00000040:00080000:2.0:1777051360.274688:0:46497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x27:0x0].2, 64 off8320 00000004:00080000:2.0:1777051360.274712:0:46497:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 7989467511785ns, next at 7990467506805ns, rc = 0 00010000:00010000:2.0:1777051360.274799:0:46497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784600/0x85f51a6b967158ad lrc: 3/0,1 mode: --/PW res: [0x200000bd3:0xc2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051360.274819:0:46497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784600/0x85f51a6b967158ad lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0xc2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051360.274836:0:46497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784600/0x85f51a6b967158ad lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0xc2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051360.274850:0:46497:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784600/0x85f51a6b967158ad lrc: 4/0,1 mode: PW/PW res: [0x200000bd3:0xc2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051360.274862:0:46497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784600/0x85f51a6b967158ad lrc: 4/0,1 mode: PW/PW res: [0x200000bd3:0xc2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051360.274873:0:46497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784600/0x85f51a6b967158ad lrc: 3/0,0 mode: PW/PW res: [0x200000bd3:0xc2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051360.274917:0:46497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1777051360.274937:0:13753:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777051360.274948:0:13753:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784600/0x85f51a6b967158ad lrc: 2/0,0 mode: PW/PW res: [0x200000bd3:0xc2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051360.274950:0:46497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2800/0x85f51a6b967158a6 lrc: 3/0,1 mode: EX/EX res: [0x200000bd3:0xc2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051360.274979:0:46497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2800/0x85f51a6b967158a6 lrc: 2/0,0 mode: EX/EX res: [0x200000bd3:0xc2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051360.274990:0:46497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2800/0x85f51a6b967158a6 lrc: 3/0,0 mode: EX/EX res: [0x200000bd3:0xc2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051360.274991:0:13753:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da7d784600 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:2.0:1777051360.275006:0:46497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d9559a2800 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:2.0:1777051360.275014:0:46497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2800/0x85f51a6b967158a6 lrc: 3/0,0 mode: EX/EX res: [0x200000bd3:0xc2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051360.275016:0:13753:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784600/0x85f51a6b967158ad lrc: 2/0,0 mode: PW/PW res: [0x200000bd3:0xc2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051360.275038:0:46497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2800/0x85f51a6b967158a6 lrc: 4/0,0 mode: EX/EX res: [0x200000bd3:0xc2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051360.275065:0:13753:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784600/0x85f51a6b967158ad lrc: 3/0,0 mode: PW/PW res: [0x200000bd3:0xc2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051360.275086:0:13753:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0xc2:0x0].0x0 (ffff99d94e6b6500) 00010000:00010000:3.0:1777051360.275091:0:13753:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1777051360.275103:0:13753:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784600/0x85f51a6b967158ad lrc: 1/0,0 mode: --/PW res: [0x200000bd3:0xc2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051360.275113:0:13753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784600/0x85f51a6b967158ad lrc: 0/0,0 mode: --/PW res: [0x200000bd3:0xc2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051360.275134:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051360.275137:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051360.275139:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777051360.275181:0:46497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0xc2:0x0].0x0 (ffff99d94e6b6500) 00010000:00010000:2.0:1777051360.275186:0:46497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1777051360.275193:0:46497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2800/0x85f51a6b967158a6 lrc: 2/0,0 mode: --/EX res: [0x200000bd3:0xc2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051360.275205:0:46497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2800/0x85f51a6b967158a6 lrc: 0/0,0 mode: --/EX res: [0x200000bd3:0xc2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051360.275248:0:46497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2e00/0x85f51a6b96715898 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0xd4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051360.275262:0:46497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2e00/0x85f51a6b96715898 lrc: 2/0,0 mode: CW/CW res: [0x200000bd2:0xd4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051360.275283:0:46497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2e00/0x85f51a6b96715898 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0xd4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051360.275292:0:46497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d9559a2e00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:2.0:1777051360.275297:0:46497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2e00/0x85f51a6b96715898 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0xd4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051360.275350:0:46497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2e00/0x85f51a6b96715898 lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0xd4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051360.275367:0:46497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xd4:0x0].0x0 (ffff99d94e6b6100) 00010000:00010000:2.0:1777051360.275373:0:46497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777051360.275378:0:46497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2e00/0x85f51a6b96715898 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0xd4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051360.275387:0:46497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2e00/0x85f51a6b96715898 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0xd4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1777051360.275404:0:46497:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000ac4a688c reply state 000000003043164d transno 30064771097 ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3000/0x85f51a6b9671589f lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xd4:0x0].0x674069f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051360.275420:0:46497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3000/0x85f51a6b9671589f lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0xd4:0x0].0x674069f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051360.275430:0:46497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xd4:0x0].0x674069f9 (ffff99d950c54500) 00010000:00010000:2.0:1777051360.275434:0:46497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1777051360.275438:0:46497:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1777051360.275513:0:46497:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f65bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+25:133910:x1863365425916416:12345-192.168.201.46@tcp:36:rm.0 Request processed in 8673us (8912us total) trans 30064771097 rc 0/0 00000100:00100000:2.0:1777051360.275525:0:46497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111891 00000100:00100000:2.0:1777051360.277976:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051360.278083:0:6583:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425916800 00000100:00100000:0.0:1777051360.278094:0:6583:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425916800 00000100:00100000:0.0:1777051360.278174:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3331 00000100:00100000:0.0:1777051360.278190:0:6583:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f659f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+25:133910:x1863365425916800:12345-192.168.201.46@tcp:35:rm.0 00000100:00100000:0.0:1777051360.278425:0:6583:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f659f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+26:133910:x1863365425916800:12345-192.168.201.46@tcp:35:rm.0 Request processed in 236us (448us total) trans 30064771098 rc 0/0 00000100:00100000:0.0:1777051360.278438:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3331 00000100:00100000:0.0:1777051360.282091:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051360.282214:0:8492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425917056 00000100:00100000:2.0:1777051360.282224:0:8492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425917056 00000100:00100000:2.0:1777051360.282290:0:8492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111892 00000100:00100000:2.0:1777051360.282306:0:8492:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94ed2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+26:133910:x1863365425917056:12345-192.168.201.46@tcp:36:rm.0 00010000:00010000:2.0:1777051360.282503:0:8492:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1777051360.282557:0:8492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784e00/0x85f51a6b9671588a lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0xd4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b60bc expref: 26 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051360.282587:0:8492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6e00/0x85f51a6b967156c3 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xd4:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5ff1 expref: 25 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051360.282600:0:8492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xd4:0x0].0x0 (ffff99d94e6b6100) 00010000:00010000:2.0:1777051360.282605:0:8492:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1777051360.282627:0:8492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d785a00/0x85f51a6b967158b4 lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0xd3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051360.282640:0:8492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d785a00/0x85f51a6b967158b4 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051360.282650:0:8492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d785a00/0x85f51a6b967158b4 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051360.282666:0:8492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d785400/0x85f51a6b967158bb lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0xd3:0x0].0xac1bda01 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051360.282674:0:8492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d785400/0x85f51a6b967158bb lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xd3:0x0].0xac1bda01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051360.282681:0:8492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d785400/0x85f51a6b967158bb lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xd3:0x0].0xac1bda01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051360.282759:0:8492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784a00/0x85f51a6b967158c2 lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0xd4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051360.282771:0:8492:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99d943ebaa00/0x85f51a6b96715606 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0xd4:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5fb9 expref: 16 pid: 21368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051360.282781:0:8492:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784a00/0x85f51a6b967158c2 lrc: 4/0,1 mode: --/EX res: [0x200000bd2:0xd4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051360.282818:0:8492:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99d943ebaa00/0x85f51a6b96715606 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xd4:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5fb9 expref: 16 pid: 21368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051360.282833:0:8492:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99d943ebaa00/0x85f51a6b96715606 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0xd4:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5fb9 expref: 16 pid: 21368 timeout: 8089 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051360.282850:0:8492:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95f659880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8492:1863365452590976:192.168.201.46@tcp:104: 00000100:00100000:2.0:1777051360.282942:0:8492:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da70a7d780 going to sleep for 11 seconds 00000100:00100000:1.0:1777051360.285162:0:8492:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95f659880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8492:1863365452590976:192.168.201.46@tcp:104: 00010000:00010000:1.0:1777051360.285261:0:8492:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784a00/0x85f51a6b967158c2 lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0xd4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051360.285656:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051360.285756:0:6566:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425917184 00000100:00100000:1.0:1777051360.285766:0:6566:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425917184 00010000:00010000:1.0:1777051360.285807:0:6566:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d943ebaa00/0x85f51a6b96715606 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0xd4:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5fb9 expref: 17 pid: 21368 timeout: 8089 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051360.285862:0:6566:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3851 00000100:00100000:1.0:1777051360.285878:0:6566:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94ed2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+17:2437:x1863365425917184:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1777051360.285896:0:6566:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1777051360.285907:0:6566:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99d943ebaa00/0x85f51a6b96715606 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0xd4:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5fb9 expref: 17 pid: 21368 timeout: 8089 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051360.285931:0:6566:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99d943ebaa00/0x85f51a6b96715606 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xd4:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5fb9 expref: 17 pid: 21368 timeout: 8089 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051360.285959:0:6566:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d943ebaa00/0x85f51a6b96715606 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xd4:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5fb9 expref: 17 pid: 21368 timeout: 8089 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051360.285982:0:6566:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xd4:0x0].0x0 (ffff99d94e6b6100) 00010000:00010000:1.0:1777051360.285989:0:6566:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784a00/0x85f51a6b967158c2 lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0xd4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051360.286002:0:6566:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784a00/0x85f51a6b967158c2 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0xd4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051360.286013:0:6566:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784a00/0x85f51a6b967158c2 lrc: 4/0,1 mode: EX/EX res: [0x200000bd2:0xd4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051360.286819:0:8492:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784a00/0x85f51a6b967158c2 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0xd4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051360.286820:0:6566:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1777051360.286832:0:8492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784a00/0x85f51a6b967158c2 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0xd4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051360.286901:0:6566:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94ed2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+16:2437:x1863365425917184:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 1024us (1245us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051360.286916:0:6566:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3851 00000004:00200000:2.0:1777051360.287240:0:8492:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0xd4:0x0]: returning size 4096 00010000:00010000:2.0:1777051360.287264:0:8492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784a00/0x85f51a6b967158c2 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0xd4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051360.287279:0:8492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784a00/0x85f51a6b967158c2 lrc: 2/0,0 mode: EX/EX res: [0x200000bd2:0xd4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051360.287300:0:8492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784a00/0x85f51a6b967158c2 lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0xd4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051360.287312:0:8492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da7d784a00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:2.0:1777051360.287318:0:8492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784a00/0x85f51a6b967158c2 lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0xd4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051360.287331:0:8492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784a00/0x85f51a6b967158c2 lrc: 4/0,0 mode: EX/EX res: [0x200000bd2:0xd4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051360.287347:0:8492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xd4:0x0].0x0 (ffff99d94e6b6100) 00010000:00010000:2.0:1777051360.287354:0:8492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1777051360.287361:0:8492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784a00/0x85f51a6b967158c2 lrc: 2/0,0 mode: --/EX res: [0x200000bd2:0xd4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051360.287374:0:8492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784a00/0x85f51a6b967158c2 lrc: 0/0,0 mode: --/EX res: [0x200000bd2:0xd4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051360.287419:0:8492:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d785a00/0x85f51a6b967158b4 lrc: 4/0,1 mode: CW/CW res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051360.287431:0:8492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d785a00/0x85f51a6b967158b4 lrc: 4/0,1 mode: CW/CW res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051360.287442:0:8492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d785a00/0x85f51a6b967158b4 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051360.287449:0:8492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d785a00/0x85f51a6b967158b4 lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051360.287454:0:8492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da7d785a00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:2.0:1777051360.287459:0:8492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d785a00/0x85f51a6b967158b4 lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051360.287466:0:8492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d785a00/0x85f51a6b967158b4 lrc: 5/0,0 mode: CW/CW res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051360.287475:0:8492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xd3:0x0].0x0 (ffff99d94e6b6b00) 00010000:00010000:2.0:1777051360.287477:0:8492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777051360.287480:0:8492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d785a00/0x85f51a6b967158b4 lrc: 3/0,0 mode: --/CW res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051360.287487:0:8492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d785a00/0x85f51a6b967158b4 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1777051360.287499:0:8492:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000f94f3fc7 reply state 0000000082eee282 transno 30064771099 ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d785400/0x85f51a6b967158bb lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xd3:0x0].0xac1bda01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051360.287515:0:8492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d785400/0x85f51a6b967158bb lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0xd3:0x0].0xac1bda01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051360.287526:0:8492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xd3:0x0].0xac1bda01 (ffff99d94c159000) 00010000:00010000:2.0:1777051360.287530:0:8492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1777051360.287534:0:8492:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1777051360.287610:0:8492:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94ed2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+26:133910:x1863365425917056:12345-192.168.201.46@tcp:36:rm.0 Request processed in 5307us (5521us total) trans 30064771099 rc 0/0 00000100:00100000:2.0:1777051360.287621:0:8492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111892 00010000:00010000:1.0:1777051360.342450:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1777051360.368152:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051360.368284:0:10328:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425917312 00000100:00100000:2.0:1777051360.368302:0:10328:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425917312 00000100:00100000:2.0:1777051360.368424:0:10328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111893 00000100:00100000:2.0:1777051360.368442:0:10328:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94ed2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+16:133431:x1863365425917312:12345-192.168.201.46@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1777051360.368618:0:10328:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94ed2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+16:133431:x1863365425917312:12345-192.168.201.46@tcp:60:lhsmtool_posix.0 Request processed in 179us (477us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051360.368645:0:10328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111893 00000100:00100000:3.0:1777051360.370906:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051360.371008:0:21368:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425917440 00000100:00100000:1.0:1777051360.371016:0:21368:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425917440 00000100:00100000:1.0:1777051360.371096:0:21368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111894 00000100:00100000:1.0:1777051360.371106:0:21368:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da44497b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+7:133431:x1863365425917440:12345-192.168.201.46@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1777051360.371185:0:21368:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da44497b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+7:133431:x1863365425917440:12345-192.168.201.46@tcp:60:lhsmtool_posix.0 Request processed in 78us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051360.371248:0:21368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111894 00000100:00100000:3.0:1777051360.372898:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051360.373008:0:24269:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425917696 00000100:00100000:0.0:1777051360.373018:0:24269:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425917696 00000100:00100000:0.0:1777051360.373116:0:24269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3332 00000100:00100000:0.0:1777051360.373132:0:24269:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da44496a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+16:133431:x1863365425917696:12345-192.168.201.46@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1777051360.373482:0:24269:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da44496a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+17:133431:x1863365425917696:12345-192.168.201.46@tcp:35:lhsmtool_posix.0 Request processed in 352us (585us total) trans 30064771100 rc 0/0 00000100:00100000:0.0:1777051360.373494:0:24269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3332 00000100:00100000:1.0:1777051360.537731:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95f658e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3680:1863365452591232:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1777051360.537738:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da44495f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3677:1863365452591360:0@lo:400:kworker.0 00000100:00100000:0.0:1777051360.537741:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da44494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3679:1863365452591104:0@lo:400:kworker.0 00000100:00100000:2.0:1777051360.537873:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051360.537874:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051360.537876:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da44495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3678:1863365452591488:0@lo:400:kworker.0 00000100:00100000:1.0:1777051360.537883:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051360.537960:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051360.537983:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d960409c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3677:1863365452591872:0@lo:400:kworker.0 00000100:00100000:1.0:1777051360.537986:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d960409180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3680:1863365452591744:0@lo:400:kworker.0 00000100:00100000:0.0:1777051360.537999:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95a581f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3679:1863365452591616:0@lo:400:kworker.0 00000100:00100000:3.0:1777051360.538007:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d950889500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3678:1863365452592000:0@lo:400:kworker.0 00000100:00100000:2.0:1777051360.538075:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051360.538117:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051360.538136:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051360.538137:0:103168:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452591104 00000100:00100000:2.0:1777051360.538144:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d9533bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452592384:0@lo:400:kworker.0 00000100:00100000:0.0:1777051360.538153:0:103168:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452591104 00000100:00100000:1.0:1777051360.538175:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d9533bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3680:1863365452592256:0@lo:400:kworker.0 00000100:00100000:3.0:1777051360.538188:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d9533bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452592512:0@lo:400:kworker.0 00000100:00100000:2.0:1777051360.538203:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051360.538293:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051360.538340:0:103168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1777051360.538354:0:8470:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452592000 00000100:00100000:0.0:1777051360.538362:0:103168:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f3dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f9351a01-5b0e-4470-97fd-58b9b4b312a2+23:3679:x1863365452591104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051360.538364:0:8470:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452592000 00000100:00100000:1.0:1777051360.538372:0:6584:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452591232 00000100:00100000:2.0:1777051360.538381:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051360.538383:0:6584:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452591232 00000100:00100000:1.0:1777051360.538449:0:6584:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452591872 00000100:00100000:3.0:1777051360.538464:0:8470:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452592384 00000100:00100000:0.0:1777051360.538465:0:103168:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f3dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f9351a01-5b0e-4470-97fd-58b9b4b312a2+23:3679:x1863365452591104:12345-0@lo:400:kworker.0 Request processed in 107us (594us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051360.538468:0:27887:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452592512 00000100:00100000:1.0:1777051360.538471:0:6584:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452591872 00000100:00100000:3.0:1777051360.538474:0:8470:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452592384 00000100:00100000:2.0:1777051360.538477:0:27887:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452592512 00000100:00100000:0.0:1777051360.538492:0:103168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1777051360.538539:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8103 00000100:00100000:1.0:1777051360.538560:0:6584:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f298a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:3680:x1863365452591232:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1777051360.538568:0:27887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10327 00000100:00100000:3.0:1777051360.538584:0:8470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10328 00000100:00100000:2.0:1777051360.538593:0:27887:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d9533bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3678:x1863365452592000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051360.538607:0:8470:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f659500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3678:x1863365452592512:12345-0@lo:400:kworker.0 00000004:00000024:1.0:1777051360.538618:0:6584:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4194304 pending 0 free 1446154240 avail 1299914752 00000100:00100000:0.0:1777051360.538629:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051360.538678:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d9533bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452592128:0@lo:400:kworker.0 00000100:00100000:2.0:1777051360.538704:0:27887:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d9533bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3678:x1863365452592000:12345-0@lo:400:kworker.0 Request processed in 117us (570us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051360.538717:0:8470:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f659500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3678:x1863365452592512:12345-0@lo:400:kworker.0 Request processed in 116us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051360.538720:0:27887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10327 00000100:00100000:3.0:1777051360.538741:0:8470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10328 00000100:00100000:1.0:1777051360.538745:0:6584:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f298a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:3680:x1863365452591232:12345-0@lo:41:osp-pre-1-0.0 Request processed in 190us (880us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051360.538755:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051360.538761:0:27887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10329 00000100:00100000:2.0:1777051360.538777:0:27887:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f658a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3677:x1863365452592384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777051360.538785:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8103 00000100:00100000:3.0:1777051360.538792:0:8470:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452592128 00000100:00100000:3.0:1777051360.538800:0:8470:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452592128 00000100:00100000:0.0:1777051360.538805:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d9533bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3679:1863365452592640:0@lo:400:kworker.0 00000100:00100000:1.0:1777051360.538828:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8104 00000100:00100000:1.0:1777051360.538847:0:6584:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f659c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3677:x1863365452591872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777051360.538861:0:27887:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f658a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3677:x1863365452592384:12345-0@lo:400:kworker.0 Request processed in 84us (658us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051360.538874:0:8470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10330 00000100:00100000:0.0:1777051360.538879:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051360.538889:0:27887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10329 00000100:00100000:3.0:1777051360.538895:0:8470:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94ed2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3679:x1863365452592128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777051360.538932:0:6584:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f659c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3677:x1863365452591872:12345-0@lo:400:kworker.0 Request processed in 90us (855us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051360.538944:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8104 00000100:00100000:0.0:1777051360.538957:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da44494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3679:1863365452591104:0@lo:400:kworker.0 00000100:00100000:3.0:1777051360.538980:0:8470:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94ed2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3679:x1863365452592128:12345-0@lo:400:kworker.0 Request processed in 91us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051360.538995:0:8470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10330 00000100:00080000:1.0:1777051360.539000:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1777051360.539006:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d950889500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3678:1863365452592000:0@lo:400:kworker.0 00000100:00080000:1.0:1777051360.539011:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1777051360.539019:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d9533bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452592128:0@lo:400:kworker.0 00000100:00100000:2.0:1777051360.539076:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d9533bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452592512:0@lo:400:kworker.0 00000100:00100000:3.0:1777051360.539100:0:6581:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452591360 00000100:00100000:3.0:1777051360.539109:0:6581:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452591360 00000100:00100000:1.0:1777051360.539125:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95f658e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3680:1863365452591232:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1777051360.539127:0:8492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452591488 00000100:00100000:0.0:1777051360.539138:0:8492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452591488 00000100:00100000:2.0:1777051360.539162:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d960409c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3677:1863365452591872:0@lo:400:kworker.0 00000100:00100000:2.0:1777051360.539503:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d9533bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452592384:0@lo:400:kworker.0 00000100:00100000:1.0:1777051360.539513:0:46494:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452591744 00000100:00100000:1.0:1777051360.539523:0:46494:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452591744 00000100:00100000:3.0:1777051360.539523:0:6581:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452592256 00000100:00100000:0.0:1777051360.539524:0:8492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452591616 00000100:00100000:3.0:1777051360.539534:0:6581:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452592256 00000100:00100000:0.0:1777051360.539535:0:8492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452591616 00000100:00100000:2.0:1777051360.539559:0:10328:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452592640 00000100:00100000:2.0:1777051360.539567:0:10328:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452592640 00000100:00100000:1.0:1777051360.539596:0:46494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13260 00000100:00100000:3.0:1777051360.539611:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13261 00000100:00100000:1.0:1777051360.539617:0:46494:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f658380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000-lwp-OST0000_UUID+5:3677:x1863365452591360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777051360.539628:0:8492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13262 00000100:00100000:3.0:1777051360.539634:0:6581:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d9533bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3678:x1863365452591488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777051360.539647:0:10328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13263 00000100:00100000:0.0:1777051360.539650:0:8492:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f29b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3680:x1863365452591744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777051360.539668:0:10328:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f298e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3680:x1863365452592256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777051360.539945:0:46494:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f658380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000-lwp-OST0000_UUID+5:3677:x1863365452591360:12345-0@lo:400:kworker.0 Request processed in 333us (2079us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051360.539958:0:46494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13260 00000100:00100000:3.0:1777051360.539984:0:6581:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d9533bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3678:x1863365452591488:12345-0@lo:400:kworker.0 Request processed in 357us (2023us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051360.539996:0:46494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13264 00000100:00100000:3.0:1777051360.540006:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13261 00000100:00100000:1.0:1777051360.540018:0:46494:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94ed2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000-lwp-OST0001_UUID+5:3679:x1863365452591616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777051360.540019:0:8492:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f29b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3680:x1863365452591744:12345-0@lo:400:kworker.0 Request processed in 368us (1897us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051360.540019:0:10328:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f298e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3680:x1863365452592256:12345-0@lo:400:kworker.0 Request processed in 355us (1722us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051360.540071:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13265 00000100:00100000:2.0:1777051360.540084:0:10328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13263 00000100:00100000:3.0:1777051360.540091:0:6581:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94ed2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3679:x1863365452592640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777051360.540101:0:8492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13262 00000100:00100000:1.0:1777051360.540135:0:46494:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94ed2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000-lwp-OST0001_UUID+5:3679:x1863365452591616:12345-0@lo:400:kworker.0 Request processed in 123us (1508us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051360.540148:0:46494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13264 00000100:00100000:2.0:1777051360.540162:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da44495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3678:1863365452591488:0@lo:400:kworker.0 00000100:00100000:0.0:1777051360.540184:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95a581f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3679:1863365452591616:0@lo:400:kworker.0 00000100:00100000:3.0:1777051360.540192:0:6581:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94ed2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3679:x1863365452592640:12345-0@lo:400:kworker.0 Request processed in 103us (1315us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051360.540248:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d9533bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3679:1863365452592640:0@lo:400:kworker.0 00000100:00100000:3.0:1777051360.540251:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13265 00000100:00100000:2.0:1777051360.540264:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da44495f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3677:1863365452591360:0@lo:400:kworker.0 00000100:00100000:1.0:1777051360.540275:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d960409180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3680:1863365452591744:0@lo:400:kworker.0 00000100:00080000:3.0:1777051360.540300:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1777051360.540307:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d9533bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3680:1863365452592256:0@lo:400:kworker.0 00000100:00080000:3.0:1777051360.540311:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1777051361.046745:0:3678:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1777051361.046785:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95612a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452592768:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1777051361.046804:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95f65b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3680:1863365452592896:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1777051361.046926:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051361.047379:0:8472:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452592768 00000100:00100000:1.0:1777051361.047396:0:8472:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452592768 00000100:00100000:1.0:1777051361.047506:0:8472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5606 00000100:00100000:3.0:1777051361.047518:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051361.047532:0:8472:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f65b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3678:x1863365452592768:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1777051361.047592:0:8472:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 430292544 pending 0 free 3645853696 avail 3414331392 00000100:00100000:2.0:1777051361.047611:0:10113:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452592896 00000100:00100000:2.0:1777051361.047619:0:10113:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452592896 00000100:00100000:2.0:1777051361.047683:0:10113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5607 00000100:00100000:1.0:1777051361.047696:0:8472:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f65b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3678:x1863365452592768:12345-0@lo:13:osp-pre-1-1.0 Request processed in 169us (767us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051361.047700:0:10113:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d9533bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3680:x1863365452592896:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1777051361.047727:0:8472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5606 00002000:00000024:2.0:1777051361.047747:0:10113:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 455081536 pending 0 free 3860574208 avail 3629051904 00000100:00100000:3.0:1777051361.047820:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95612a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452592768:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1777051361.047931:0:10113:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d9533bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3680:x1863365452592896:12345-0@lo:13:osp-pre-0-1.0 Request processed in 235us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051361.047946:0:10113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5607 00000100:00100000:3.0:1777051361.048000:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95f65b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3680:1863365452592896:0@lo:13:osp-pre-0-1.0 00000040:00080000:2.0:1777051361.303592:0:104226:0:(llog.c:801:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1777051361.303606:0:104226:0:(llog_cat.c:158:llog_cat_process_common()) processing log [0x1:0x12:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1777051361.303649:0:104226:0:(llog.c:858:llog_process_thread()) stop processing plain [0x1:0x12:0x0] index 2 count 2 00000040:00080000:2.0:1777051361.303663:0:104226:0:(llog.c:858:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:2.0:1777051361.367550:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1777051361.812587:0:105500:0:(debug.c:645:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-hsm test 401: Compound requests split and sent to their respective MDTs ========================================================== 13:22:40 (1777051360) 00000100:00100000:0.0:1777051362.171111:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051362.171256:0:10328:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425917952 00000100:00100000:2.0:1777051362.171270:0:10328:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425917952 00000100:00100000:2.0:1777051362.171377:0:10328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111895 00000100:00080000:3.0:1777051362.171383:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1777051362.171396:0:10328:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94ed2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+17:134099:x1863365425917952:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1777051362.171431:0:10328:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051362.171462:0:10328:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d785a00/0x85f51a6b967158c9 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b60c3 expref: -99 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.171560:0:10328:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784a00/0x85f51a6b967158d0 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.171582:0:10328:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784a00/0x85f51a6b967158d0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.171602:0:10328:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784a00/0x85f51a6b967158d0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.171625:0:10328:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784e00/0x85f51a6b967158d7 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.171637:0:10328:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784e00/0x85f51a6b967158d7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.171647:0:10328:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784e00/0x85f51a6b967158d7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.171751:0:10328:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d785e00/0x85f51a6b967158de lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.171762:0:10328:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d785e00/0x85f51a6b967158de lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.171771:0:10328:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d785e00/0x85f51a6b967158de lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1777051362.171781:0:10328:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:2.0:1777051362.171873:0:10328:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784a00/0x85f51a6b967158d0 lrc: 4/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.171886:0:10328:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784a00/0x85f51a6b967158d0 lrc: 4/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.171896:0:10328:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784a00/0x85f51a6b967158d0 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.171907:0:10328:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784a00/0x85f51a6b967158d0 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.171916:0:10328:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da7d784a00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:2.0:1777051362.171923:0:10328:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784a00/0x85f51a6b967158d0 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.171933:0:10328:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784a00/0x85f51a6b967158d0 lrc: 5/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.171949:0:10328:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff99d94e5e2500) 00010000:00010000:2.0:1777051362.171954:0:10328:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777051362.171960:0:10328:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784a00/0x85f51a6b967158d0 lrc: 3/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.171971:0:10328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784a00/0x85f51a6b967158d0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.171992:0:10328:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784e00/0x85f51a6b967158d7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.172003:0:10328:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784e00/0x85f51a6b967158d7 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.172044:0:10328:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784e00/0x85f51a6b967158d7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.172054:0:10328:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da7d784e00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:2.0:1777051362.172059:0:10328:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784e00/0x85f51a6b967158d7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.172068:0:10328:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784e00/0x85f51a6b967158d7 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.172082:0:10328:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff99d94c159600) 00010000:00010000:2.0:1777051362.172087:0:10328:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777051362.172092:0:10328:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784e00/0x85f51a6b967158d7 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.172100:0:10328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784e00/0x85f51a6b967158d7 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.172501:0:10328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d785a00/0x85f51a6b967158c9 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b60c3 expref: 20 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.172526:0:10328:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d785e00/0x85f51a6b967158de lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b60c3 expref: 19 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.172539:0:10328:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99d941e2ea00) 00010000:00010000:2.0:1777051362.172543:0:10328:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777051362.172548:0:10328:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99da7d785e00, rc 0) 00000100:00100000:2.0:1777051362.172624:0:10328:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94ed2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+19:134099:x1863365425917952:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 Request processed in 1234us (1526us total) trans 30064771101 rc 0/0 00000100:00100000:2.0:1777051362.172638:0:10328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111895 00000100:00100000:3.0:1777051362.176120:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051362.176252:0:46494:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425918080 00000100:00100000:1.0:1777051362.176265:0:46494:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425918080 00000100:00100000:1.0:1777051362.176334:0:46494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111896 00000100:00100000:1.0:1777051362.176348:0:46494:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d9533bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c11b6966-0775-44d2-bdc6-c74c26eb2226+19:134099:x1863365425918080:12345-192.168.201.46@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1777051362.176425:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051362.176496:0:46494:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d9533bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c11b6966-0775-44d2-bdc6-c74c26eb2226+19:134099:x1863365425918080:12345-192.168.201.46@tcp:59:lhsmtool_posix.0 Request processed in 148us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051362.176509:0:46494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111896 00000100:00100000:0.0:1777051362.176626:0:47827:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425918208 00000100:00100000:0.0:1777051362.176635:0:47827:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425918208 00000100:00100000:0.0:1777051362.176704:0:47827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13681 00000100:00100000:0.0:1777051362.176718:0:47827:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d9533bc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+19:2439:x1863365425918208:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1777051362.176736:0:47827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777051362.176763:0:47827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d785e00/0x85f51a6b967158de lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b60c3 expref: 19 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.176790:0:47827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99d941e2ea00) 00010000:00010000:0.0:1777051362.176797:0:47827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1777051362.176852:0:47827:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d9533bc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+18:2439:x1863365425918208:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 135us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051362.176863:0:47827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13681 00000100:00100000:3.0:1777051362.184424:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051362.185083:0:6581:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425918336 00000100:00100000:2.0:1777051362.185094:0:6581:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425918336 00000100:00080000:3.0:1777051362.185180:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1777051362.185239:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111897 00000100:00100000:2.0:1777051362.185261:0:6581:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d9533bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+7:134099:x1863365425918336:12345-192.168.201.46@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1777051362.185374:0:6581:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d9533bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+7:134099:x1863365425918336:12345-192.168.201.46@tcp:59:lhsmtool_posix.0 Request processed in 120us (957us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051362.185387:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111897 00000100:00100000:3.0:1777051362.197450:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051362.198048:0:27885:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425918464 00000100:00100000:0.0:1777051362.198061:0:27885:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425918464 00000100:00080000:3.0:1777051362.199095:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1777051362.199277:0:27885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111898 00000100:00100000:0.0:1777051362.199310:0:27885:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d9533bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+26:134100:x1863365425918464:12345-192.168.201.46@tcp:101:lfs.0 00010000:00010000:0.0:1777051362.199339:0:27885:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051362.199364:0:27885:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3400/0x85f51a6b967158ec lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b60ca expref: -99 pid: 27885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.199459:0:27885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3200/0x85f51a6b967158f3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.199479:0:27885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3200/0x85f51a6b967158f3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.199495:0:27885:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3200/0x85f51a6b967158f3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.199516:0:27885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2200/0x85f51a6b967158fa lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x51d501f3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.199528:0:27885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2200/0x85f51a6b967158fa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x51d501f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.199547:0:27885:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2200/0x85f51a6b967158fa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x51d501f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.201400:0:27885:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3200/0x85f51a6b967158f3 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.201416:0:27885:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3200/0x85f51a6b967158f3 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.201427:0:27885:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3200/0x85f51a6b967158f3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.201437:0:27885:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3200/0x85f51a6b967158f3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.201447:0:27885:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d9559a3200 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:0.0:1777051362.201454:0:27885:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3200/0x85f51a6b967158f3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.201466:0:27885:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3200/0x85f51a6b967158f3 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.201485:0:27885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d9533ab000) 00010000:00010000:0.0:1777051362.201490:0:27885:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777051362.201496:0:27885:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3200/0x85f51a6b967158f3 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.201506:0:27885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3200/0x85f51a6b967158f3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.201527:0:27885:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2200/0x85f51a6b967158fa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x51d501f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.201537:0:27885:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2200/0x85f51a6b967158fa lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x51d501f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.201545:0:27885:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2200/0x85f51a6b967158fa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x51d501f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.201553:0:27885:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d9559a2200 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:0.0:1777051362.201558:0:27885:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2200/0x85f51a6b967158fa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x51d501f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.201568:0:27885:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2200/0x85f51a6b967158fa lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x51d501f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.201580:0:27885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x51d501f3 (ffff99d950c54400) 00010000:00010000:0.0:1777051362.201584:0:27885:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777051362.201588:0:27885:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2200/0x85f51a6b967158fa lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x51d501f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.201598:0:27885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2200/0x85f51a6b967158fa lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x51d501f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.201645:0:27885:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3400/0x85f51a6b967158ec lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b60ca expref: 27 pid: 27885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.201660:0:27885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d9533ab000) 00010000:00010000:0.0:1777051362.201664:0:27885:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777051362.201669:0:27885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3400/0x85f51a6b967158ec lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b60ca expref: 27 pid: 27885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.201692:0:27885:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d9559a3400, rc 0) 00000100:00100000:0.0:1777051362.202402:0:27885:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d9533bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+26:134100:x1863365425918464:12345-192.168.201.46@tcp:101:lfs.0 Request processed in 3103us (4964us total) trans 0 rc 301/301 00000100:00100000:0.0:1777051362.202416:0:27885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111898 00000100:00100000:0.0:1777051362.208748:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051362.208851:0:6580:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425918720 00000100:00100000:1.0:1777051362.208861:0:6580:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425918720 00000100:00100000:3.0:1777051362.209362:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111899 00000100:00100000:3.0:1777051362.209386:0:6579:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95a581f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+26:134100:x1863365425918720:12345-192.168.201.46@tcp:36:lfs.0 00010000:00010000:3.0:1777051362.209449:0:6579:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777051362.209477:0:6579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6400/0x85f51a6b96715454 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5f3b expref: 26 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051362.209500:0:6579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d9533ab000) 00010000:00010000:3.0:1777051362.209506:0:6579:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1777051362.209581:0:6579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d95595b800/0x85f51a6b96715901 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051362.209602:0:6579:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7c00/0x85f51a6b96715557 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5f88 expref: 17 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051362.209615:0:6579:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d95595b800/0x85f51a6b96715901 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051362.209692:0:6579:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7c00/0x85f51a6b96715557 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5f88 expref: 17 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051362.209994:0:6579:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7c00/0x85f51a6b96715557 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5f88 expref: 17 pid: 6580 timeout: 8091 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051362.210346:0:6579:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d9533bc700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6579:1863365452593024:192.168.201.46@tcp:104: 00000100:00100000:3.0:1777051362.210725:0:6579:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d95ba60300 going to sleep for 11 seconds 00000100:00100000:1.0:1777051362.210780:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051362.210881:0:103166:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425918848 00000100:00100000:3.0:1777051362.210890:0:103166:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425918848 00000100:00100000:1.0:1777051362.210916:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051362.210975:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051362.210991:0:103166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 152 00000100:00100000:3.0:1777051362.211035:0:103166:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f3dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29c4352d-3260-4734-909d-9ea5de9e7fa4+12:2438:x1863365425918848:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:0.0:1777051362.211051:0:8468:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425919104 00000100:00100000:2.0:1777051362.211059:0:27887:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425918976 00000100:00100000:1.0:1777051362.211060:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051362.211064:0:8468:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425919104 00000100:00100000:2.0:1777051362.211071:0:27887:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425918976 00000100:00100000:3.0:1777051362.211116:0:103166:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f3dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29c4352d-3260-4734-909d-9ea5de9e7fa4+12:2438:x1863365425918848:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 108us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051362.211133:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051362.211147:0:103166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 152 00000100:00100000:0.0:1777051362.211148:0:8468:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425919360 00000100:00100000:0.0:1777051362.211157:0:8468:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425919360 00000100:00080000:3.0:1777051362.211205:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1777051362.211213:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1777051362.211248:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051362.211483:0:27887:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425919488 00000100:00100000:2.0:1777051362.211492:0:27887:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425919488 00000100:00100000:0.0:1777051362.211508:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10331 00000100:00100000:1.0:1777051362.211525:0:27884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10332 00000100:00100000:0.0:1777051362.211532:0:8468:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d956128a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+48:2438:x1863365425919104:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:3.0:1777051362.211547:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10333 00000100:00100000:1.0:1777051362.211549:0:27884:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d956128380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+52:2439:x1863365425918976:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:3.0:1777051362.211572:0:8471:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95612a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+50:2438:x1863365425919360:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:0.0:1777051362.211611:0:8468:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d956128a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+48:2438:x1863365425919104:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 87us (693us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051362.211614:0:27884:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d956128380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+52:2439:x1863365425918976:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 71us (638us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051362.211640:0:8471:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95612a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+50:2438:x1863365425919360:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 75us (586us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051362.211675:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10333 00000100:00100000:2.0:1777051362.211704:0:27887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10334 00000100:00100000:2.0:1777051362.211721:0:27887:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da4384ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+47:2439:x1863365425919488:12345-192.168.201.46@tcp:400:kworker.0 00000100:00080000:3.0:1777051362.211768:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1777051362.211778:0:27887:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da4384ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+47:2439:x1863365425919488:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 61us (530us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051362.211791:0:27887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10334 00000100:00100000:3.0:1777051362.211810:0:8492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425919232 00000100:00100000:3.0:1777051362.211819:0:8492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425919232 00000100:00100000:0.0:1777051362.211833:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10331 00000100:00100000:1.0:1777051362.211843:0:27884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10332 00000100:00100000:3.0:1777051362.211897:0:8492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13266 00000100:00100000:3.0:1777051362.211915:0:8492:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da4384c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+55:2439:x1863365425919232:12345-192.168.201.46@tcp:400:kworker.0 00000100:00080000:2.0:1777051362.211994:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1777051362.212048:0:8492:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da4384c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+55:2439:x1863365425919232:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 137us (918us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051362.212061:0:8492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13266 00000100:00100000:3.0:1777051362.214593:0:6579:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d9533bc700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6579:1863365452593024:192.168.201.46@tcp:104: 00010000:00010000:3.0:1777051362.214617:0:6579:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99d95595b800/0x85f51a6b96715901 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051362.214708:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051362.214792:0:6564:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425919616 00000100:00100000:0.0:1777051362.214799:0:6564:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425919616 00010000:00010000:0.0:1777051362.214826:0:6564:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7c00/0x85f51a6b96715557 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5f88 expref: 18 pid: 6580 timeout: 8091 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051362.214860:0:6564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3852 00000100:00100000:0.0:1777051362.214869:0:6564:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f65a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+18:2437:x1863365425919616:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1777051362.214881:0:6564:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777051362.214887:0:6564:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7c00/0x85f51a6b96715557 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5f88 expref: 18 pid: 6580 timeout: 8091 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.214908:0:6564:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7c00/0x85f51a6b96715557 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5f88 expref: 18 pid: 6580 timeout: 8091 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.214929:0:6564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7c00/0x85f51a6b96715557 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5f88 expref: 18 pid: 6580 timeout: 8091 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.214943:0:6564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d9533ab000) 00010000:00010000:0.0:1777051362.214948:0:6564:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff99d95595b800/0x85f51a6b96715901 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.214957:0:6564:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99d95595b800/0x85f51a6b96715901 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.214982:0:6564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d95595b800/0x85f51a6b96715901 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.215042:0:6564:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1777051362.215093:0:6579:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99d95595b800/0x85f51a6b96715901 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051362.215106:0:6579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d95595b800/0x85f51a6b96715901 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051362.215107:0:6564:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f65a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+17:2437:x1863365425919616:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 234us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051362.215128:0:6564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3852 00010000:00010000:3.0:1777051362.215143:0:6579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d95595b200/0x85f51a6b96715908 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x51d501f3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051362.215159:0:6579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d95595b200/0x85f51a6b96715908 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x51d501f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051362.215173:0:6579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d95595b200/0x85f51a6b96715908 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x51d501f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051362.216056:0:6579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d95595be00/0x85f51a6b9671590f lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0xd5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051362.216068:0:6579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d95595be00/0x85f51a6b9671590f lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051362.216077:0:6579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d95595be00/0x85f51a6b9671590f lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777051362.216093:0:6579:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000aa4778d0 reply state 00000000879beabd transno 30064771102 ns: mdt-lustre-MDT0000_UUID lock: ffff99d95595be00/0x85f51a6b9671590f lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051362.216104:0:6579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d95595be00/0x85f51a6b9671590f lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051362.216111:0:6579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xd5:0x0].0x0 (ffff99d9413d2a00) 00010000:00010000:3.0:1777051362.216114:0:6579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1777051362.216117:0:6579:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1777051362.216123:0:6579:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0xd5:0x0]: returning size 4096 00010000:00010000:3.0:1777051362.216146:0:6579:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d95595b800/0x85f51a6b96715901 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051362.216157:0:6579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d95595b800/0x85f51a6b96715901 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051362.216166:0:6579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d95595b800/0x85f51a6b96715901 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051362.216175:0:6579:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d95595b800/0x85f51a6b96715901 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051362.216183:0:6579:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d95595b800 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:3.0:1777051362.216188:0:6579:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d95595b800/0x85f51a6b96715901 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051362.216198:0:6579:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d95595b800/0x85f51a6b96715901 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051362.216211:0:6579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d9533ab000) 00010000:00010000:3.0:1777051362.216214:0:6579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777051362.216220:0:6579:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d95595b800/0x85f51a6b96715901 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051362.216229:0:6579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d95595b800/0x85f51a6b96715901 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777051362.216246:0:6579:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000aa4778d0 reply state 00000000879beabd transno 30064771102 ns: mdt-lustre-MDT0000_UUID lock: ffff99d95595b200/0x85f51a6b96715908 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x51d501f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051362.216261:0:6579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d95595b200/0x85f51a6b96715908 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x51d501f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051362.216270:0:6579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x51d501f3 (ffff99d9413d2d00) 00010000:00010000:3.0:1777051362.216274:0:6579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1777051362.216278:0:6579:0:(service.c:177:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1777051362.216530:0:6579:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95a581f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+27:134100:x1863365425918720:12345-192.168.201.46@tcp:36:lfs.0 Request processed in 7152us (7791us total) trans 30064771102 rc 0/0 00000100:00100000:3.0:1777051362.216539:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111899 00000100:00100000:2.0:1777051362.244088:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051362.244407:0:21368:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425919744 00000100:00100000:1.0:1777051362.244418:0:21368:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425919744 00000100:00100000:1.0:1777051362.244480:0:21368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111900 00000100:00100000:1.0:1777051362.244492:0:21368:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f65ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+27:134104:x1863365425919744:12345-192.168.201.46@tcp:101:lfs.0 00010000:00010000:1.0:1777051362.244521:0:21368:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777051362.244544:0:21368:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48b800/0x85f51a6b96715916 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b60d1 expref: -99 pid: 21368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051362.244610:0:21368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48ba00/0x85f51a6b9671591d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051362.244625:0:21368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48ba00/0x85f51a6b9671591d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051362.244636:0:21368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48ba00/0x85f51a6b9671591d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1777051362.244680:0:21368:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 12288 00000004:00200000:1.0:1777051362.244684:0:21368:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1777051362.244701:0:21368:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48ba00/0x85f51a6b9671591d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051362.244965:0:21368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48b800/0x85f51a6b96715916 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b60d1 expref: 29 pid: 21368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051362.244989:0:21368:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48ba00/0x85f51a6b9671591d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b60d1 expref: 28 pid: 21368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051362.245004:0:21368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d9533ab000) 00010000:00010000:1.0:1777051362.245008:0:21368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1777051362.245042:0:21368:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d94e48ba00, rc 0) 00000100:00100000:1.0:1777051362.245424:0:21368:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f65ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+28:134104:x1863365425919744:12345-192.168.201.46@tcp:101:lfs.0 Request processed in 931us (1343us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051362.245443:0:21368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111900 00000100:00100000:1.0:1777051362.248573:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051362.248668:0:46497:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425919872 00000100:00100000:0.0:1777051362.248677:0:46497:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425919872 00000100:00100000:0.0:1777051362.248733:0:46497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111901 00000100:00100000:0.0:1777051362.248745:0:46497:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955ebf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+28:134104:x1863365425919872:12345-192.168.201.46@tcp:101:lfs.0 00010000:00010000:0.0:1777051362.249004:0:46497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051362.249361:0:46497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3200/0x85f51a6b96715924 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b60d8 expref: -99 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.249432:0:46497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3800/0x85f51a6b9671592b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.249447:0:46497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3800/0x85f51a6b9671592b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.249461:0:46497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3800/0x85f51a6b9671592b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.249477:0:46497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2000/0x85f51a6b96715932 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x51d501f3 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.249488:0:46497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2000/0x85f51a6b96715932 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x51d501f3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.249499:0:46497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2000/0x85f51a6b96715932 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x51d501f3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.249596:0:46497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2400/0x85f51a6b96715939 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.249611:0:46497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2400/0x85f51a6b96715939 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.249622:0:46497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2400/0x85f51a6b96715939 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1777051362.249654:0:46497:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0xd5:0x0]: returning size 4096 00000004:00200000:0.0:1777051362.249659:0:46497:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1777051362.249678:0:46497:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2400/0x85f51a6b96715939 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.249702:0:46497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3800/0x85f51a6b9671592b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.249712:0:46497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3800/0x85f51a6b9671592b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.249722:0:46497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3800/0x85f51a6b9671592b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.249732:0:46497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d9559a3800 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:0.0:1777051362.249738:0:46497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3800/0x85f51a6b9671592b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.249748:0:46497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3800/0x85f51a6b9671592b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.249763:0:46497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d9533ab000) 00010000:00010000:0.0:1777051362.249767:0:46497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777051362.249773:0:46497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3800/0x85f51a6b9671592b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.249782:0:46497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3800/0x85f51a6b9671592b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.249797:0:46497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2000/0x85f51a6b96715932 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x51d501f3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.249807:0:46497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2000/0x85f51a6b96715932 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x51d501f3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.249815:0:46497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2000/0x85f51a6b96715932 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x51d501f3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.249825:0:46497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d9559a2000 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:0.0:1777051362.249829:0:46497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2000/0x85f51a6b96715932 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x51d501f3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.249838:0:46497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2000/0x85f51a6b96715932 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x51d501f3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.249849:0:46497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x51d501f3 (ffff99d9413d2d00) 00010000:00010000:0.0:1777051362.249853:0:46497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777051362.249857:0:46497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2000/0x85f51a6b96715932 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x51d501f3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.249867:0:46497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2000/0x85f51a6b96715932 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x51d501f3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.249899:0:46497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3200/0x85f51a6b96715924 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b60d8 expref: 30 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.249916:0:46497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2400/0x85f51a6b96715939 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b60d8 expref: 29 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.249928:0:46497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xd5:0x0].0x0 (ffff99d9413d2a00) 00010000:00010000:0.0:1777051362.249932:0:46497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1777051362.249936:0:46497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d9559a2400, rc 0) 00000100:00100000:0.0:1777051362.249993:0:46497:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955ebf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+29:134104:x1863365425919872:12345-192.168.201.46@tcp:101:lfs.0 Request processed in 1250us (1425us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051362.250005:0:46497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111901 00000100:00100000:0.0:1777051362.254400:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051362.254772:0:27882:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425920000 00000100:00100000:2.0:1777051362.254782:0:27882:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425920000 00000100:00100000:2.0:1777051362.254843:0:27882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111902 00000100:00100000:2.0:1777051362.254858:0:27882:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da44495f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+29:134104:x1863365425920000:12345-192.168.201.46@tcp:101:lfs.0 00010000:00010000:2.0:1777051362.254890:0:27882:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051362.254910:0:27882:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d785200/0x85f51a6b96715940 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b60df expref: -99 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.254979:0:27882:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784a00/0x85f51a6b96715947 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.254995:0:27882:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784a00/0x85f51a6b96715947 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.255006:0:27882:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784a00/0x85f51a6b96715947 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.255054:0:27882:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784e00/0x85f51a6b9671594e lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xd5:0x0].0xac1bda01 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.255065:0:27882:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784e00/0x85f51a6b9671594e lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xd5:0x0].0xac1bda01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.255075:0:27882:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784e00/0x85f51a6b9671594e lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xd5:0x0].0xac1bda01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.255115:0:27882:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784a00/0x85f51a6b96715947 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.255125:0:27882:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784a00/0x85f51a6b96715947 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.255150:0:27882:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784a00/0x85f51a6b96715947 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.255159:0:27882:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784a00/0x85f51a6b96715947 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.255168:0:27882:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da7d784a00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:2.0:1777051362.255173:0:27882:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784a00/0x85f51a6b96715947 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.255182:0:27882:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784a00/0x85f51a6b96715947 lrc: 5/0,0 mode: CR/CR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.255231:0:27882:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xd5:0x0].0x0 (ffff99d9413d2a00) 00010000:00010000:2.0:1777051362.255237:0:27882:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777051362.255245:0:27882:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784a00/0x85f51a6b96715947 lrc: 3/0,0 mode: --/CR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.255255:0:27882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784a00/0x85f51a6b96715947 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.255277:0:27882:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784e00/0x85f51a6b9671594e lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xd5:0x0].0xac1bda01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.255287:0:27882:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784e00/0x85f51a6b9671594e lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0xd5:0x0].0xac1bda01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.255297:0:27882:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784e00/0x85f51a6b9671594e lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xd5:0x0].0xac1bda01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.255305:0:27882:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da7d784e00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:2.0:1777051362.255309:0:27882:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784e00/0x85f51a6b9671594e lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xd5:0x0].0xac1bda01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.255319:0:27882:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784e00/0x85f51a6b9671594e lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0xd5:0x0].0xac1bda01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.255338:0:27882:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xd5:0x0].0xac1bda01 (ffff99d94c159600) 00010000:00010000:2.0:1777051362.255343:0:27882:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777051362.255347:0:27882:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784e00/0x85f51a6b9671594e lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0xd5:0x0].0xac1bda01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.255355:0:27882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784e00/0x85f51a6b9671594e lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xd5:0x0].0xac1bda01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.255393:0:27882:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d785200/0x85f51a6b96715940 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b60df expref: 30 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.255404:0:27882:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xd5:0x0].0x0 (ffff99d9413d2a00) 00010000:00010000:2.0:1777051362.255607:0:27882:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777051362.255617:0:27882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d785200/0x85f51a6b96715940 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b60df expref: 30 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.255633:0:27882:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99da7d785200, rc 0) 00000100:00100000:2.0:1777051362.255694:0:27882:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da44495f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+29:134104:x1863365425920000:12345-192.168.201.46@tcp:101:lfs.0 Request processed in 840us (1299us total) trans 0 rc 301/301 00000100:00100000:2.0:1777051362.255703:0:27882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111902 00000100:00100000:2.0:1777051362.258750:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051362.258830:0:6580:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425920128 00000100:00100000:1.0:1777051362.258838:0:6580:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425920128 00000100:00100000:1.0:1777051362.258890:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111903 00000100:00100000:1.0:1777051362.258903:0:6580:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f65b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+29:134104:x1863365425920128:12345-192.168.201.46@tcp:101:lfs.0 00010000:00010000:1.0:1777051362.258938:0:6580:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777051362.258957:0:6580:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48b600/0x85f51a6b96715955 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b60e6 expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051362.259037:0:6580:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48b800/0x85f51a6b9671595c lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051362.259053:0:6580:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48b800/0x85f51a6b9671595c lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051362.259066:0:6580:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48b800/0x85f51a6b9671595c lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051362.259089:0:6580:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48b400/0x85f51a6b96715963 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xd5:0x0].0xac1bda01 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051362.259099:0:6580:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48b400/0x85f51a6b96715963 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xd5:0x0].0xac1bda01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051362.259110:0:6580:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48b400/0x85f51a6b96715963 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xd5:0x0].0xac1bda01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051362.259148:0:6580:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48b800/0x85f51a6b9671595c lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051362.259157:0:6580:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48b800/0x85f51a6b9671595c lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051362.259167:0:6580:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48b800/0x85f51a6b9671595c lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051362.259176:0:6580:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48b800/0x85f51a6b9671595c lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051362.259184:0:6580:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94e48b800 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:1.0:1777051362.259189:0:6580:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48b800/0x85f51a6b9671595c lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051362.259237:0:6580:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48b800/0x85f51a6b9671595c lrc: 5/0,0 mode: CR/CR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051362.259251:0:6580:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xd5:0x0].0x0 (ffff99d9413d2a00) 00010000:00010000:1.0:1777051362.259256:0:6580:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777051362.259263:0:6580:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48b800/0x85f51a6b9671595c lrc: 3/0,0 mode: --/CR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051362.259273:0:6580:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48b800/0x85f51a6b9671595c lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051362.259291:0:6580:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48b400/0x85f51a6b96715963 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xd5:0x0].0xac1bda01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051362.259302:0:6580:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48b400/0x85f51a6b96715963 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0xd5:0x0].0xac1bda01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051362.259311:0:6580:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48b400/0x85f51a6b96715963 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xd5:0x0].0xac1bda01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051362.259316:0:6580:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94e48b400 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:1.0:1777051362.259319:0:6580:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48b400/0x85f51a6b96715963 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xd5:0x0].0xac1bda01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051362.259325:0:6580:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48b400/0x85f51a6b96715963 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0xd5:0x0].0xac1bda01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051362.259332:0:6580:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xd5:0x0].0xac1bda01 (ffff99d94e6b6400) 00010000:00010000:1.0:1777051362.259334:0:6580:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777051362.259337:0:6580:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48b400/0x85f51a6b96715963 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0xd5:0x0].0xac1bda01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051362.259342:0:6580:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48b400/0x85f51a6b96715963 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xd5:0x0].0xac1bda01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051362.259371:0:6580:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48b600/0x85f51a6b96715955 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b60e6 expref: 30 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051362.259381:0:6580:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xd5:0x0].0x0 (ffff99d9413d2a00) 00010000:00010000:1.0:1777051362.259383:0:6580:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777051362.259386:0:6580:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48b600/0x85f51a6b96715955 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b60e6 expref: 30 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051362.259404:0:6580:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d94e48b600, rc 0) 00000100:00100000:1.0:1777051362.259482:0:6580:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f65b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+29:134104:x1863365425920128:12345-192.168.201.46@tcp:101:lfs.0 Request processed in 581us (735us total) trans 0 rc 301/301 00000100:00100000:1.0:1777051362.259493:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111903 00000100:00100000:1.0:1777051362.263334:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051362.263422:0:8492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425920256 00000100:00100000:3.0:1777051362.263433:0:8492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425920256 00000100:00100000:3.0:1777051362.263515:0:8492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111904 00000100:00100000:3.0:1777051362.263529:0:8492:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955ebe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+29:134104:x1863365425920256:12345-192.168.201.46@tcp:101:lfs.0 00010000:00010000:3.0:1777051362.263546:0:8492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777051362.263567:0:8492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d95595b800/0x85f51a6b9671596a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b60ed expref: -99 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051362.263637:0:8492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d95595a800/0x85f51a6b96715971 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051362.263656:0:8492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d95595a800/0x85f51a6b96715971 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051362.263670:0:8492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d95595a800/0x85f51a6b96715971 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1777051362.263718:0:8492:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0xd5:0x0]: returning size 4096 00000004:00200000:3.0:1777051362.263725:0:8492:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1777051362.263750:0:8492:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99d95595a800/0x85f51a6b96715971 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051362.263783:0:8492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d95595b800/0x85f51a6b9671596a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b60ed expref: 31 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051362.263808:0:8492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d95595a800/0x85f51a6b96715971 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b60ed expref: 30 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051362.263821:0:8492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xd5:0x0].0x0 (ffff99d9413d2a00) 00010000:00010000:3.0:1777051362.263825:0:8492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1777051362.263830:0:8492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d95595a800, rc 0) 00000100:00100000:3.0:1777051362.263899:0:8492:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955ebe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+30:134104:x1863365425920256:12345-192.168.201.46@tcp:101:lfs.0 Request processed in 374us (568us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051362.263911:0:8492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111904 00000100:00100000:0.0:1777051362.268188:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051362.268305:0:21368:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425920384 00000100:00100000:1.0:1777051362.268314:0:21368:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425920384 00000100:00100000:1.0:1777051362.268382:0:21368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111905 00000100:00100000:1.0:1777051362.268395:0:21368:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da44495180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+17:134104:x1863365425920384:12345-192.168.201.46@tcp:101:lfs.0 00010000:00010000:1.0:1777051362.268412:0:21368:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777051362.268447:0:21368:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48b600/0x85f51a6b96715978 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b60f4 expref: -99 pid: 21368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051362.268508:0:21368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48b400/0x85f51a6b9671597f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051362.268525:0:21368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48b400/0x85f51a6b9671597f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051362.268537:0:21368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48b400/0x85f51a6b9671597f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1777051362.268574:0:21368:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 12288 00000004:00200000:1.0:1777051362.268579:0:21368:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1777051362.268598:0:21368:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48b400/0x85f51a6b9671597f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051362.268627:0:21368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48b600/0x85f51a6b96715978 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b60f4 expref: 19 pid: 21368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051362.268651:0:21368:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48b400/0x85f51a6b9671597f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b60f4 expref: 18 pid: 21368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051362.268663:0:21368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d9533ab000) 00010000:00010000:1.0:1777051362.268668:0:21368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1777051362.268672:0:21368:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d94e48b400, rc 0) 00000100:00100000:1.0:1777051362.268735:0:21368:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da44495180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+18:134104:x1863365425920384:12345-192.168.201.46@tcp:101:lfs.0 Request processed in 341us (551us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051362.268746:0:21368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111905 00000100:00100000:2.0:1777051362.271748:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051362.271862:0:6581:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425920640 00000100:00100000:3.0:1777051362.271871:0:6581:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425920640 00000100:00100000:3.0:1777051362.271947:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111906 00000100:00100000:3.0:1777051362.271962:0:6581:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f658e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+30:134104:x1863365425920640:12345-192.168.201.46@tcp:101:lfs.0 00010000:00010000:3.0:1777051362.271978:0:6581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777051362.271996:0:6581:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d95595aa00/0x85f51a6b96715986 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b60fb expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1777051362.272112:0:6581:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0xd5:0x0]: returning size 4096 00010000:00010000:3.0:1777051362.272278:0:6581:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d95595aa00/0x85f51a6b96715986 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b60fb expref: 32 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051362.272300:0:6581:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d9533ab000) 00010000:00010000:3.0:1777051362.272305:0:6581:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1777051362.272313:0:6581:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d95595aa00/0x85f51a6b96715986 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b60fb expref: 32 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051362.272331:0:6581:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d95595aa00, rc 0) 00000100:00100000:3.0:1777051362.272396:0:6581:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f658e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+31:134104:x1863365425920640:12345-192.168.201.46@tcp:101:lfs.0 Request processed in 436us (650us total) trans 30064771103 rc 301/301 00000100:00100000:3.0:1777051362.272407:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111906 00000100:00100000:3.0:1777051362.275103:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051362.275254:0:27885:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425920896 00000100:00100000:0.0:1777051362.275264:0:27885:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425920896 00000100:00100000:0.0:1777051362.275335:0:27885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111907 00000100:00100000:0.0:1777051362.275349:0:27885:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d9533bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+31:134104:x1863365425920896:12345-192.168.201.46@tcp:36:lfs.0 00010000:00010000:0.0:1777051362.275398:0:27885:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777051362.275421:0:27885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d95595a800/0x85f51a6b96715971 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b60ed expref: 31 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.275442:0:27885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xd5:0x0].0x0 (ffff99d9413d2a00) 00010000:00010000:0.0:1777051362.275448:0:27885:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1777051362.275499:0:27885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2000/0x85f51a6b96715994 lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0xd5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.275518:0:27885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2000/0x85f51a6b96715994 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.275532:0:27885:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2000/0x85f51a6b96715994 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.275552:0:27885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3800/0x85f51a6b9671599b lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0xd5:0x0].0xac1bda01 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.275563:0:27885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3800/0x85f51a6b9671599b lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xd5:0x0].0xac1bda01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.275572:0:27885:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3800/0x85f51a6b9671599b lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xd5:0x0].0xac1bda01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.276167:0:27885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3a00/0x85f51a6b967159a2 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0xd6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.276182:0:27885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3a00/0x85f51a6b967159a2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.276220:0:27885:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3a00/0x85f51a6b967159a2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1777051362.276247:0:27885:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000857ec2bc reply state 000000004a56a4bd transno 30064771104 ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3a00/0x85f51a6b967159a2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.276264:0:27885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3a00/0x85f51a6b967159a2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.276275:0:27885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xd6:0x0].0x0 (ffff99d950c54600) 00010000:00010000:0.0:1777051362.276279:0:27885:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1777051362.276283:0:27885:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1777051362.276288:0:27885:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0xd6:0x0]: returning size 4096 00010000:00010000:0.0:1777051362.276299:0:27885:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2000/0x85f51a6b96715994 lrc: 4/0,1 mode: CW/CW res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.276309:0:27885:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2000/0x85f51a6b96715994 lrc: 4/0,1 mode: CW/CW res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.276319:0:27885:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2000/0x85f51a6b96715994 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.276330:0:27885:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2000/0x85f51a6b96715994 lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.276339:0:27885:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d9559a2000 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:0.0:1777051362.276345:0:27885:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2000/0x85f51a6b96715994 lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.276363:0:27885:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2000/0x85f51a6b96715994 lrc: 5/0,0 mode: CW/CW res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.276377:0:27885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xd5:0x0].0x0 (ffff99d9413d2a00) 00010000:00010000:0.0:1777051362.276381:0:27885:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777051362.276386:0:27885:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2000/0x85f51a6b96715994 lrc: 3/0,0 mode: --/CW res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.276395:0:27885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2000/0x85f51a6b96715994 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1777051362.276413:0:27885:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000857ec2bc reply state 000000004a56a4bd transno 30064771104 ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3800/0x85f51a6b9671599b lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xd5:0x0].0xac1bda01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.276426:0:27885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3800/0x85f51a6b9671599b lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0xd5:0x0].0xac1bda01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.276436:0:27885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xd5:0x0].0xac1bda01 (ffff99d950c54400) 00010000:00010000:0.0:1777051362.276439:0:27885:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1777051362.276442:0:27885:0:(service.c:177:ptlrpc_save_lock()) nlocks 1 00000100:00100000:0.0:1777051362.276523:0:27885:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d9533bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+32:134104:x1863365425920896:12345-192.168.201.46@tcp:36:lfs.0 Request processed in 1175us (1419us total) trans 30064771104 rc 0/0 00000100:00100000:0.0:1777051362.276534:0:27885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111907 00000100:00100000:1.0:1777051362.279839:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051362.279942:0:6582:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425921152 00000100:00100000:2.0:1777051362.279952:0:6582:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425921152 00000100:00100000:2.0:1777051362.280057:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3333 00000100:00100000:2.0:1777051362.280072:0:6582:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955ebdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+32:134104:x1863365425921152:12345-192.168.201.46@tcp:35:lfs.0 00000100:00100000:2.0:1777051362.280333:0:6582:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955ebdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+33:134104:x1863365425921152:12345-192.168.201.46@tcp:35:lfs.0 Request processed in 263us (495us total) trans 30064771105 rc 0/0 00000100:00100000:2.0:1777051362.280346:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3333 00000100:00100000:2.0:1777051362.304101:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051362.304176:0:10328:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425921280 00000100:00100000:0.0:1777051362.304188:0:10328:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425921280 00000100:00100000:0.0:1777051362.304307:0:10328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111908 00000100:00100000:0.0:1777051362.304320:0:10328:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f659880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+33:134107:x1863365425921280:12345-192.168.201.46@tcp:101:lfs.0 00010000:00010000:0.0:1777051362.304348:0:10328:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051362.304369:0:10328:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2000/0x85f51a6b967159a9 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6102 expref: -99 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.304455:0:10328:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3200/0x85f51a6b967159b0 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.304470:0:10328:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3200/0x85f51a6b967159b0 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.304481:0:10328:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3200/0x85f51a6b967159b0 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.304497:0:10328:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2200/0x85f51a6b967159b7 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xd5:0x0].0xceea225b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.304507:0:10328:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2200/0x85f51a6b967159b7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xd5:0x0].0xceea225b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.304519:0:10328:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2200/0x85f51a6b967159b7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xd5:0x0].0xceea225b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.304561:0:10328:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3200/0x85f51a6b967159b0 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.304572:0:10328:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3200/0x85f51a6b967159b0 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.304582:0:10328:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3200/0x85f51a6b967159b0 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.304592:0:10328:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3200/0x85f51a6b967159b0 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.304601:0:10328:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d9559a3200 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:0.0:1777051362.304608:0:10328:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3200/0x85f51a6b967159b0 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.304617:0:10328:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3200/0x85f51a6b967159b0 lrc: 5/0,0 mode: CR/CR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.304632:0:10328:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xd5:0x0].0x0 (ffff99d9413d2a00) 00010000:00010000:0.0:1777051362.304637:0:10328:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777051362.304642:0:10328:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3200/0x85f51a6b967159b0 lrc: 3/0,0 mode: --/CR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.304650:0:10328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3200/0x85f51a6b967159b0 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.304666:0:10328:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2200/0x85f51a6b967159b7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xd5:0x0].0xceea225b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.304675:0:10328:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2200/0x85f51a6b967159b7 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0xd5:0x0].0xceea225b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.304685:0:10328:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2200/0x85f51a6b967159b7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xd5:0x0].0xceea225b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.304693:0:10328:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d9559a2200 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:0.0:1777051362.304697:0:10328:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2200/0x85f51a6b967159b7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xd5:0x0].0xceea225b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.304707:0:10328:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2200/0x85f51a6b967159b7 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0xd5:0x0].0xceea225b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.304719:0:10328:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xd5:0x0].0xceea225b (ffff99d950c54a00) 00010000:00010000:0.0:1777051362.304722:0:10328:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777051362.304726:0:10328:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2200/0x85f51a6b967159b7 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0xd5:0x0].0xceea225b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.304734:0:10328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2200/0x85f51a6b967159b7 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xd5:0x0].0xceea225b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.304800:0:10328:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2000/0x85f51a6b967159a9 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6102 expref: 34 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.304818:0:10328:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xd5:0x0].0x0 (ffff99d9413d2a00) 00010000:00010000:0.0:1777051362.304822:0:10328:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777051362.304828:0:10328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2000/0x85f51a6b967159a9 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6102 expref: 34 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.304843:0:10328:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d9559a2000, rc 0) 00000100:00100000:0.0:1777051362.304925:0:10328:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f659880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+33:134107:x1863365425921280:12345-192.168.201.46@tcp:101:lfs.0 Request processed in 606us (829us total) trans 0 rc 301/301 00000100:00100000:0.0:1777051362.304937:0:10328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111908 00000100:00100000:2.0:1777051362.307360:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051362.307462:0:8492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425921408 00000100:00100000:3.0:1777051362.307471:0:8492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425921408 00000100:00100000:3.0:1777051362.307534:0:8492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111909 00000100:00100000:3.0:1777051362.307546:0:8492:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f658000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+33:134107:x1863365425921408:12345-192.168.201.46@tcp:101:lfs.0 00010000:00010000:3.0:1777051362.307559:0:8492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777051362.307573:0:8492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d95595aa00/0x85f51a6b967159be lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6109 expref: -99 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051362.307619:0:8492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d95595b800/0x85f51a6b967159c5 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051362.307630:0:8492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d95595b800/0x85f51a6b967159c5 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051362.307642:0:8492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d95595b800/0x85f51a6b967159c5 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051362.307658:0:8492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d95595a200/0x85f51a6b967159cc lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xd5:0x0].0xceea225b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051362.307669:0:8492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d95595a200/0x85f51a6b967159cc lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xd5:0x0].0xceea225b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051362.307680:0:8492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d95595a200/0x85f51a6b967159cc lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xd5:0x0].0xceea225b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051362.307708:0:8492:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d95595b800/0x85f51a6b967159c5 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051362.307718:0:8492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d95595b800/0x85f51a6b967159c5 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051362.307729:0:8492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d95595b800/0x85f51a6b967159c5 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051362.307739:0:8492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d95595b800/0x85f51a6b967159c5 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051362.307748:0:8492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d95595b800 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:3.0:1777051362.307753:0:8492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d95595b800/0x85f51a6b967159c5 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051362.307763:0:8492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d95595b800/0x85f51a6b967159c5 lrc: 5/0,0 mode: CR/CR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051362.307776:0:8492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xd5:0x0].0x0 (ffff99d9413d2a00) 00010000:00010000:3.0:1777051362.307780:0:8492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777051362.307785:0:8492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d95595b800/0x85f51a6b967159c5 lrc: 3/0,0 mode: --/CR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051362.307796:0:8492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d95595b800/0x85f51a6b967159c5 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051362.307812:0:8492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d95595a200/0x85f51a6b967159cc lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xd5:0x0].0xceea225b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051362.307823:0:8492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d95595a200/0x85f51a6b967159cc lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0xd5:0x0].0xceea225b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051362.307833:0:8492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d95595a200/0x85f51a6b967159cc lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xd5:0x0].0xceea225b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051362.307841:0:8492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d95595a200 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:3.0:1777051362.307845:0:8492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d95595a200/0x85f51a6b967159cc lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xd5:0x0].0xceea225b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051362.307855:0:8492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d95595a200/0x85f51a6b967159cc lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0xd5:0x0].0xceea225b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051362.307867:0:8492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xd5:0x0].0xceea225b (ffff99d9413d2f00) 00010000:00010000:3.0:1777051362.307870:0:8492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777051362.307874:0:8492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d95595a200/0x85f51a6b967159cc lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0xd5:0x0].0xceea225b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051362.307880:0:8492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d95595a200/0x85f51a6b967159cc lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xd5:0x0].0xceea225b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051362.307919:0:8492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d95595aa00/0x85f51a6b967159be lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6109 expref: 34 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051362.307928:0:8492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xd5:0x0].0x0 (ffff99d9413d2a00) 00010000:00010000:3.0:1777051362.307930:0:8492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777051362.307934:0:8492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d95595aa00/0x85f51a6b967159be lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6109 expref: 34 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051362.307948:0:8492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d95595aa00, rc 0) 00000100:00100000:3.0:1777051362.307990:0:8492:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f658000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+33:134107:x1863365425921408:12345-192.168.201.46@tcp:101:lfs.0 Request processed in 448us (633us total) trans 0 rc 301/301 00000100:00100000:3.0:1777051362.307998:0:8492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111909 00000100:00100000:1.0:1777051362.311555:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051362.311649:0:46494:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425921536 00000100:00100000:2.0:1777051362.311659:0:46494:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425921536 00000100:00100000:2.0:1777051362.311724:0:46494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111910 00000100:00100000:2.0:1777051362.311737:0:46494:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955ebd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+33:134107:x1863365425921536:12345-192.168.201.46@tcp:101:lfs.0 00010000:00010000:2.0:1777051362.311753:0:46494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051362.311770:0:46494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d785a00/0x85f51a6b967159d3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6110 expref: -99 pid: 46494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.312114:0:46494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d785e00/0x85f51a6b967159da lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.312131:0:46494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d785e00/0x85f51a6b967159da lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.312144:0:46494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d785e00/0x85f51a6b967159da lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1777051362.312491:0:46494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0xd5:0x0]: returning size 4096 00000004:00200000:2.0:1777051362.312497:0:46494:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1777051362.312524:0:46494:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d785e00/0x85f51a6b967159da lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.312556:0:46494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d785a00/0x85f51a6b967159d3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6110 expref: 35 pid: 46494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.312580:0:46494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d785e00/0x85f51a6b967159da lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6110 expref: 34 pid: 46494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.312592:0:46494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xd5:0x0].0x0 (ffff99d9413d2a00) 00010000:00010000:2.0:1777051362.312597:0:46494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1777051362.312601:0:46494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99da7d785e00, rc 0) 00000100:00100000:2.0:1777051362.312667:0:46494:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955ebd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+34:134107:x1863365425921536:12345-192.168.201.46@tcp:101:lfs.0 Request processed in 932us (1116us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051362.312679:0:46494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111910 00000100:00100000:2.0:1777051362.320620:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051362.320724:0:6581:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425921792 00000100:00100000:3.0:1777051362.321050:0:6581:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425921792 00000100:00100000:3.0:1777051362.321226:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111911 00000100:00100000:3.0:1777051362.321242:0:6581:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f65aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+34:134107:x1863365425921792:12345-192.168.201.46@tcp:101:lfs.0 00010000:00010000:3.0:1777051362.321262:0:6581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777051362.321323:0:6581:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d95595aa00/0x85f51a6b967159e1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6117 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051362.321440:0:6581:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d95595a200/0x85f51a6b967159e8 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051362.321461:0:6581:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d95595a200/0x85f51a6b967159e8 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051362.321476:0:6581:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d95595a200/0x85f51a6b967159e8 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1777051362.321492:0:6581:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0xd5:0x0]: returning size 4096 00010000:00010000:3.0:1777051362.321617:0:6581:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d95595aa00/0x85f51a6b967159e1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6117 expref: 37 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051362.321641:0:6581:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d95595a200/0x85f51a6b967159e8 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6117 expref: 36 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051362.321662:0:6581:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xd5:0x0].0x0 (ffff99d9413d2a00) 00010000:00010000:3.0:1777051362.321666:0:6581:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1777051362.321670:0:6581:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d95595a200, rc 0) 00000100:00100000:3.0:1777051362.321742:0:6581:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f65aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+36:134107:x1863365425921792:12345-192.168.201.46@tcp:101:lfs.0 Request processed in 504us (1130us total) trans 30064771106 rc 0/0 00000100:00100000:3.0:1777051362.321753:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111911 00000100:00100000:1.0:1777051362.323998:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051362.324133:0:27882:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425922048 00000100:00100000:2.0:1777051362.324143:0:27882:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425922048 00000100:00100000:2.0:1777051362.324254:0:27882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111912 00000100:00100000:2.0:1777051362.324272:0:27882:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955ebfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+55:134107:x1863365425922048:12345-192.168.201.46@tcp:36:lfs.0 00000100:00100000:2.0:1777051362.324446:0:27882:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d960409180 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-mdtlov_UUID:27882:1863365452593152:0@lo:1000:mdt00_006.0 00000100:00100000:2.0:1777051362.324510:0:27882:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051362.324559:0:27882:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da70a7db40 going to sleep for 11 seconds 00000100:00100000:3.0:1777051362.324599:0:46500:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452593152 00000100:00100000:3.0:1777051362.324610:0:46500:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452593152 00000100:00100000:3.0:1777051362.324668:0:46500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8105 00000100:00100000:3.0:1777051362.324679:0:46500:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d960409c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+6:27882:x1863365452593152:12345-0@lo:1000:mdt00_006.0 00000100:00100000:3.0:1777051362.324769:0:46500:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d960409c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+6:27882:x1863365452593152:12345-0@lo:1000:mdt00_006.0 Request processed in 89us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051362.324780:0:46500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8105 00000100:00100000:2.0:1777051362.324854:0:27882:0:(client.c:3101:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 30064771093 gen 2 00000004:00080000:2.0:1777051362.324863:0:27882:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 30064771092 committed transno 30064771093 00000004:00080000:2.0:1777051362.324893:0:27882:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 30064771093 committed transno 30064771093 00000100:00100000:2.0:1777051362.324918:0:27882:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d960409180 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-mdtlov_UUID:27882:1863365452593152:0@lo:1000:mdt00_006.0 00000100:00100000:2.0:1777051362.324996:0:27882:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d960409180 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-mdtlov_UUID:27882:1863365452593280:0@lo:1000:mdt00_006.0 00000100:00100000:2.0:1777051362.325063:0:27882:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051362.325104:0:27882:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da70a7db40 going to sleep for 11 seconds 00000040:00080000:1.0:1777051362.326687:0:104226:0:(llog.c:801:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1777051362.326695:0:104226:0:(llog_cat.c:158:llog_cat_process_common()) processing log [0x1:0x12:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1777051362.326725:0:104226:0:(llog.c:858:llog_process_thread()) stop processing plain [0x1:0x12:0x0] index 2 count 2 00000040:00080000:1.0:1777051362.326736:0:104226:0:(llog.c:858:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1777051362.328170:0:46498:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452593280 00000100:00100000:0.0:1777051362.328179:0:46498:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452593280 00000100:00100000:0.0:1777051362.328272:0:46498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8106 00000100:00100000:0.0:1777051362.328285:0:46498:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d950889500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:27882:x1863365452593280:12345-0@lo:1000:mdt00_006.0 00000100:00100000:0.0:1777051362.328370:0:46498:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d950889500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:27882:x1863365452593280:12345-0@lo:1000:mdt00_006.0 Request processed in 89us (3308us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051362.328378:0:46498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8106 00000100:00100000:2.0:1777051362.328458:0:27882:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d960409180 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-mdtlov_UUID:27882:1863365452593280:0@lo:1000:mdt00_006.0 00000100:00100000:2.0:1777051362.328525:0:27882:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d960409180 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-mdtlov_UUID:27882:1863365452593408:0@lo:1000:mdt00_006.0 00000100:00100000:2.0:1777051362.328574:0:27882:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051362.328615:0:27882:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da70a7db40 going to sleep for 11 seconds 00000100:00100000:0.0:1777051362.328666:0:47208:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452593408 00000100:00100000:0.0:1777051362.328674:0:47208:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452593408 00000100:00100000:0.0:1777051362.328719:0:47208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8107 00000100:00100000:0.0:1777051362.328727:0:47208:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94c12b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+6:27882:x1863365452593408:12345-0@lo:1000:mdt00_006.0 00000100:00100000:0.0:1777051362.328828:0:47208:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94c12b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+6:27882:x1863365452593408:12345-0@lo:1000:mdt00_006.0 Request processed in 100us (253us total) trans 0 rc -2/-2 00000100:00100000:0.0:1777051362.328842:0:47208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8107 00000100:00100000:2.0:1777051362.328888:0:27882:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d960409180 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-mdtlov_UUID:27882:1863365452593408:0@lo:1000:mdt00_006.0 00010000:00010000:2.0:1777051362.328954:0:27882:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff99da7d785a00/0x85f51a6b967159f6 lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0xd5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.328970:0:27882:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff99da7d785a00/0x85f51a6b967159f6 lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 27882 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.328984:0:27882:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff99da7d785a00/0x85f51a6b967159f6 lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 27882 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051362.329004:0:27882:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94c128a80 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-mdtlov_UUID:27882:1863365452593536:0@lo:101:mdt00_006.0 00000100:00100000:2.0:1777051362.329077:0:27882:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051362.329113:0:27882:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da70a7d900 going to sleep for 11 seconds 00000100:00100000:1.0:1777051362.329173:0:6585:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452593536 00000100:00100000:1.0:1777051362.329182:0:6585:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452593536 00000100:00100000:1.0:1777051362.329267:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8108 00000100:00100000:1.0:1777051362.329279:0:6585:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94c129500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:27882:x1863365452593536:12345-0@lo:101:mdt00_006.0 00010000:00010000:1.0:1777051362.329293:0:6585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777051362.329312:0:6585:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48a800/0x85f51a6b967159fd lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0xd5:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x85f51a6b967159f6 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051362.329343:0:6585:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99d95595be00/0x85f51a6b9671590f lrc: 2/0,1 mode: TXN/TXN res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051362.329360:0:6585:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d785e00/0x85f51a6b967159da lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6110 expref: 35 pid: 46494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051362.329371:0:6585:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48a800/0x85f51a6b967159fd lrc: 5/0,0 mode: --/CW res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x85f51a6b967159f6 expref: 7 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051362.329416:0:6585:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d785e00/0x85f51a6b967159da lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6110 expref: 35 pid: 46494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051362.329442:0:6585:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d785e00/0x85f51a6b967159da lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6110 expref: 35 pid: 46494 timeout: 8091 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051362.329462:0:6585:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955ebd180 pname:cluuid:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000_UUID:6585:1863365452593664:192.168.201.46@tcp:104: 00010000:00010000:1.0:1777051362.329550:0:6585:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff99d95595be00/0x85f51a6b9671590f lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00080000:00080000:1.0:1777051362.329581:0:6585:0:(osd_handler.c:2852:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:1.0:1777051362.329621:0:6585:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d944ac0840 going to sleep for 11 seconds 00000100:00100000:0.0:1777051362.332375:0:6585:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955ebd180 pname:cluuid:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000_UUID:6585:1863365452593664:192.168.201.46@tcp:104: 00010000:00010000:0.0:1777051362.332413:0:6585:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48a800/0x85f51a6b967159fd lrc: 3/0,0 mode: --/CW res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b967159f6 expref: 7 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.332432:0:6585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xd5:0x0].0x0 (ffff99d9413d2a00) 00010000:00010000:0.0:1777051362.332438:0:6585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777051362.332446:0:6585:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48a800/0x85f51a6b967159fd lrc: 3/0,0 mode: --/CW res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b967159f6 expref: 7 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.332460:0:6585:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d94e48a800, rc 0) 00000100:00100000:0.0:1777051362.332531:0:6585:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94c129500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:27882:x1863365452593536:12345-0@lo:101:mdt00_006.0 Request processed in 3252us (3452us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051362.332542:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8108 00000100:00100000:2.0:1777051362.332681:0:27882:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94c128a80 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-mdtlov_UUID:27882:1863365452593536:0@lo:101:mdt00_006.0 00010000:00010000:2.0:1777051362.332704:0:27882:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff99da7d785a00/0x85f51a6b967159f6 lrc: 4/0,1 mode: --/CW res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x85f51a6b967159fd expref: -99 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.332721:0:27882:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff99da7d785a00/0x85f51a6b967159f6 lrc: 4/0,1 mode: --/CW res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x85f51a6b967159fd expref: -99 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051362.333179:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000001:00080000:3.0:1777051362.333328:0:103159:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771106 is committed 00000100:00100000:0.0:1777051362.333385:0:9550:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425922176 00000100:00100000:0.0:1777051362.333395:0:9550:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425922176 00010000:00010000:2.0:1777051362.333428:0:3664:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3000/0x85f51a6b9671589f lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0xd4:0x0].0x674069f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.333431:0:9550:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d785e00/0x85f51a6b967159da lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6110 expref: 31 pid: 46494 timeout: 8091 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.333462:0:3664:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3000/0x85f51a6b9671589f lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd2:0xd4:0x0].0x674069f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.333478:0:3664:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3000/0x85f51a6b9671589f lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0xd4:0x0].0x674069f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.333491:0:3664:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d9559a3000 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:2.0:1777051362.333498:0:3664:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3000/0x85f51a6b9671589f lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0xd4:0x0].0x674069f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.333510:0:3664:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3000/0x85f51a6b9671589f lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd2:0xd4:0x0].0x674069f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.333530:0:3664:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xd4:0x0].0x674069f9 (ffff99d950c54500) 00010000:00010000:2.0:1777051362.333536:0:3664:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777051362.333544:0:3664:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3000/0x85f51a6b9671589f lrc: 2/0,0 mode: --/TXN res: [0x200000bd2:0xd4:0x0].0x674069f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.333556:0:3664:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3000/0x85f51a6b9671589f lrc: 0/0,0 mode: --/TXN res: [0x200000bd2:0xd4:0x0].0x674069f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1777051362.333558:0:103159:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771101 is committed 00000100:00100000:1.0:1777051362.333591:0:6565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3853 00000004:00080000:3.0:1777051362.333593:0:103159:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00010000:00010000:2.0:1777051362.333605:0:3664:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d785400/0x85f51a6b967158bb lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0xd3:0x0].0xac1bda01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051362.333613:0:6565:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955ebce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+27:2437:x1863365425922176:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1777051362.333619:0:3664:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d785400/0x85f51a6b967158bb lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd2:0xd3:0x0].0xac1bda01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051362.333632:0:6565:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777051362.333632:0:3664:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d785400/0x85f51a6b967158bb lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0xd3:0x0].0xac1bda01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051362.333644:0:6565:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d785e00/0x85f51a6b967159da lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6110 expref: 25 pid: 46494 timeout: 8091 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.333644:0:3664:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da7d785400 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:2.0:1777051362.333649:0:3664:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d785400/0x85f51a6b967158bb lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0xd3:0x0].0xac1bda01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.333660:0:3664:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d785400/0x85f51a6b967158bb lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd2:0xd3:0x0].0xac1bda01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051362.333665:0:6565:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d785e00/0x85f51a6b967159da lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6110 expref: 25 pid: 46494 timeout: 8091 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.333684:0:3664:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xd3:0x0].0xac1bda01 (ffff99d94c159000) 00010000:00010000:2.0:1777051362.333690:0:3664:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777051362.333693:0:6565:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d785e00/0x85f51a6b967159da lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6110 expref: 25 pid: 46494 timeout: 8091 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.333696:0:3664:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d785400/0x85f51a6b967158bb lrc: 2/0,0 mode: --/TXN res: [0x200000bd2:0xd3:0x0].0xac1bda01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.333707:0:3664:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d785400/0x85f51a6b967158bb lrc: 0/0,0 mode: --/TXN res: [0x200000bd2:0xd3:0x0].0xac1bda01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051362.333711:0:6565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xd5:0x0].0x0 (ffff99d9413d2a00) 00010000:00010000:1.0:1777051362.333719:0:6565:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48a800/0x85f51a6b967159fd lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b967159f6 expref: 6 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.333732:0:3664:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99d95595b200/0x85f51a6b96715908 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x51d501f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051362.333733:0:6565:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1777051362.333736:0:3677:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:2.0:1777051362.333749:0:3664:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d95595b200/0x85f51a6b96715908 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x51d501f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.333760:0:3664:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d95595b200/0x85f51a6b96715908 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x51d501f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051362.333762:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da44494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3677:1863365452593792:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1777051362.333779:0:3664:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d95595b200 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:2.0:1777051362.333784:0:3664:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d95595b200/0x85f51a6b96715908 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x51d501f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051362.333794:0:6565:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955ebce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+23:2437:x1863365425922176:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 181us (610us total) trans 0 rc 0/0 00010000:00010000:2.0:1777051362.333796:0:3664:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d95595b200/0x85f51a6b96715908 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x51d501f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051362.333807:0:6565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3853 00010000:00010000:2.0:1777051362.333810:0:3664:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x51d501f3 (ffff99d9413d2d00) 00010000:00010000:2.0:1777051362.333814:0:3664:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777051362.333819:0:3664:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d95595b200/0x85f51a6b96715908 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x51d501f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.333828:0:3664:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d95595b200/0x85f51a6b96715908 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x51d501f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051362.333852:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1777051362.333855:0:3664:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99d95595be00/0x85f51a6b9671590f lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.333868:0:3664:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d95595be00/0x85f51a6b9671590f lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.333878:0:3664:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d95595be00/0x85f51a6b9671590f lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.333888:0:3664:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d95595be00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:2.0:1777051362.333893:0:3664:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d95595be00/0x85f51a6b9671590f lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.333917:0:3664:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d95595be00/0x85f51a6b9671590f lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.333932:0:3664:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xd5:0x0].0x0 (ffff99d9413d2a00) 00010000:00010000:2.0:1777051362.333936:0:3664:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1777051362.333940:0:24468:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452593792 00010000:00010000:2.0:1777051362.333943:0:3664:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48a800/0x85f51a6b967159fd lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b967159f6 expref: 6 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051362.333949:0:24468:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452593792 00010000:00010000:2.0:1777051362.333959:0:3664:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48a800/0x85f51a6b967159fd lrc: 2/0,0 mode: CW/CW res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x85f51a6b967159f6 expref: 6 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.333973:0:3664:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48a800/0x85f51a6b967159fd lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x85f51a6b967159f6 expref: 6 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1777051362.334040:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1777051362.334044:0:3664:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48a800/0x85f51a6b967159fd lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b967159f6 expref: 6 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051362.334060:0:24468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7976 00000100:00100000:2.0:1777051362.334075:0:3664:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94c12b800 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_001:lustre-MDT0000_UUID:3664:1863365452593920:0@lo:105: 00000100:00100000:1.0:1777051362.334079:0:24468:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da44494e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3677:x1863365452593792:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1777051362.334107:0:24468:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:482 count 1 00000100:00100000:2.0:1777051362.334127:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1777051362.334132:0:24468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002888929b/0x85f51a6b96715a04 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1e2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051362.334158:0:24468:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b2b12361/0x85f51a6b9671572c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x1e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6022 expref: 51 pid: 55805 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051362.334171:0:24468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051362.334175:0:24468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051362.334179:0:24468:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002888929b/0x85f51a6b96715a04 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x1e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051362.334224:0:24468:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b2b12361/0x85f51a6b9671572c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x1e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6022 expref: 51 pid: 55805 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051362.334251:0:3664:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da70a7d900 going to sleep for 11 seconds 00010000:00010000:1.0:1777051362.334272:0:24468:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b2b12361/0x85f51a6b9671572c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x1e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6022 expref: 51 pid: 55805 timeout: 8091 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051362.334292:0:24468:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955ebdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:24468:1863365452594048:192.168.201.46@tcp:104: 00000100:00100000:1.0:1777051362.334371:0:24468:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d944ac0840 going to sleep for 11 seconds 00000100:00100000:3.0:1777051362.334472:0:6562:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452593920 00000100:00100000:3.0:1777051362.334480:0:6562:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452593920 00000100:00100000:3.0:1777051362.334525:0:6562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1777051362.334533:0:6562:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94c12a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:3664:x1863365452593920:12345-0@lo:105: 00010000:00010000:3.0:1777051362.334546:0:6562:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff99da7d785a00/0x85f51a6b967159f6 lrc: 5/0,1 mode: --/CW res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x85f51a6b967159fd expref: -99 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051362.334558:0:6562:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff99da7d785a00/0x85f51a6b967159f6 lrc: 5/0,1 mode: --/CW res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x85f51a6b967159fd expref: -99 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051362.334575:0:6562:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff99da7d785a00/0x85f51a6b967159f6 lrc: 5/0,1 mode: --/CW res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x85f51a6b967159fd expref: -99 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051362.334584:0:6562:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff99da7d785a00/0x85f51a6b967159f6 lrc: 5/0,1 mode: CW/CW res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x85f51a6b967159fd expref: -99 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051362.334592:0:6562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff99da7d785a00/0x85f51a6b967159f6 lrc: 6/0,1 mode: CW/CW res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x85f51a6b967159fd expref: -99 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051362.334603:0:6562:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff99da7d785a00/0x85f51a6b967159f6 lrc: 6/0,1 mode: CW/CW res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x85f51a6b967159fd expref: -99 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051362.334630:0:6562:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff99da7d785a00) 00000100:00100000:3.0:1777051362.334691:0:6562:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94c12a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:3664:x1863365452593920:12345-0@lo:105: Request processed in 156us (564us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051362.334702:0:6562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1777051362.334780:0:3664:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94c12b800 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_001:lustre-MDT0000_UUID:3664:1863365452593920:0@lo:105: 00010000:00010000:0.0:1777051362.334798:0:3664:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d95595be00/0x85f51a6b9671590f lrc: 2/0,0 mode: --/TXN res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.334812:0:3664:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d95595be00/0x85f51a6b9671590f lrc: 0/0,0 mode: --/TXN res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.334829:0:3664:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3800/0x85f51a6b9671599b lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0xd5:0x0].0xac1bda01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.334836:0:3664:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3800/0x85f51a6b9671599b lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd2:0xd5:0x0].0xac1bda01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.334843:0:3664:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3800/0x85f51a6b9671599b lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0xd5:0x0].0xac1bda01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.334849:0:3664:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d9559a3800 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:0.0:1777051362.334852:0:3664:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3800/0x85f51a6b9671599b lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0xd5:0x0].0xac1bda01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.334858:0:3664:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3800/0x85f51a6b9671599b lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd2:0xd5:0x0].0xac1bda01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.334867:0:3664:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xd5:0x0].0xac1bda01 (ffff99d950c54400) 00010000:00010000:0.0:1777051362.334870:0:3664:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777051362.334873:0:3664:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3800/0x85f51a6b9671599b lrc: 2/0,0 mode: --/TXN res: [0x200000bd2:0xd5:0x0].0xac1bda01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.334879:0:3664:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3800/0x85f51a6b9671599b lrc: 0/0,0 mode: --/TXN res: [0x200000bd2:0xd5:0x0].0xac1bda01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.334891:0:3664:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3a00/0x85f51a6b967159a2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.334897:0:3664:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3a00/0x85f51a6b967159a2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd2:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.334904:0:3664:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3a00/0x85f51a6b967159a2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.334909:0:3664:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d9559a3a00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:0.0:1777051362.334928:0:3664:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3a00/0x85f51a6b967159a2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.334934:0:3664:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3a00/0x85f51a6b967159a2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd2:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.334941:0:3664:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xd6:0x0].0x0 (ffff99d950c54600) 00010000:00010000:0.0:1777051362.334944:0:3664:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777051362.334947:0:3664:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3a00/0x85f51a6b967159a2 lrc: 2/0,0 mode: --/TXN res: [0x200000bd2:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.334953:0:3664:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3a00/0x85f51a6b967159a2 lrc: 0/0,0 mode: --/TXN res: [0x200000bd2:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051362.336460:0:24468:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955ebdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:24468:1863365452594048:192.168.201.46@tcp:104: 00010000:00010000:3.0:1777051362.336483:0:24468:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002888929b/0x85f51a6b96715a04 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.338107:0:27882:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff99da7d785a00/0x85f51a6b967159f6 lrc: 4/0,1 mode: CW/CW res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x85f51a6b967159fd expref: -99 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.338125:0:27882:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff99da7d785a00/0x85f51a6b967159f6 lrc: 4/0,1 mode: CW/CW res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x85f51a6b967159fd expref: -99 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1777051362.338151:0:27882:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000bd2:0xd5:0x0] 00010000:00010000:2.0:1777051362.338189:0:27882:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff99da7d784600/0x85f51a6b96715a0b lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0xd5:0x0].0xceea225b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.338233:0:27882:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff99da7d784600/0x85f51a6b96715a0b lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0xd5:0x0].0xceea225b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 27882 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.338247:0:27882:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff99da7d784600/0x85f51a6b96715a0b lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0xd5:0x0].0xceea225b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 27882 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051362.338270:0:27882:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94c128a80 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-mdtlov_UUID:27882:1863365452594176:0@lo:101:mdt00_006.0 00000100:00100000:2.0:1777051362.338312:0:27882:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051362.338348:0:27882:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da70a7db40 going to sleep for 11 seconds 00000100:00100000:0.0:1777051362.339626:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051362.339690:0:6566:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425922304 00000100:00100000:2.0:1777051362.339698:0:6566:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425922304 00010000:00010000:2.0:1777051362.339728:0:6566:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b2b12361/0x85f51a6b9671572c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x1e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6022 expref: 52 pid: 55805 timeout: 8091 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051362.339777:0:6566:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3854 00000100:00100000:2.0:1777051362.339789:0:6566:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da6fd43c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+52:2437:x1863365425922304:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1777051362.339802:0:6566:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777051362.339809:0:6566:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b2b12361/0x85f51a6b9671572c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x1e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6022 expref: 52 pid: 55805 timeout: 8091 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.339826:0:6566:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b2b12361/0x85f51a6b9671572c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x1e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6022 expref: 52 pid: 55805 timeout: 8091 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.339860:0:6566:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b2b12361/0x85f51a6b9671572c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x1e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6022 expref: 52 pid: 55805 timeout: 8091 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.339880:0:6566:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777051362.339883:0:6566:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777051362.339889:0:6566:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002888929b/0x85f51a6b96715a04 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.339903:0:6566:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002888929b/0x85f51a6b96715a04 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.339939:0:6566:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1777051362.339981:0:6566:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da6fd43c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+51:2437:x1863365425922304:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 191us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051362.339983:0:6584:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452594176 00010000:00010000:3.0:1777051362.339994:0:24468:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002888929b/0x85f51a6b96715a04 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051362.339995:0:6584:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452594176 00000100:00100000:2.0:1777051362.339998:0:6566:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3854 00010000:00010000:3.0:1777051362.340043:0:24468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002888929b/0x85f51a6b96715a04 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051362.340069:0:24468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002888929b/0x85f51a6b96715a04 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051362.340082:0:24468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002888929b/0x85f51a6b96715a04 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051362.340088:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8109 00000100:00100000:1.0:1777051362.340109:0:6584:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94c12ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:27882:x1863365452594176:12345-0@lo:101:mdt00_006.0 00010000:00010000:3.0:1777051362.340122:0:24468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1777051362.340128:0:6584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051362.340132:0:6567:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777051362.340143:0:6567:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002888929b/0x85f51a6b96715a04 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051362.340152:0:6584:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48be00/0x85f51a6b96715a12 lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0xd5:0x0].0xceea225b bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x85f51a6b96715a0b expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.340190:0:6567:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94e48b000 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:2.0:1777051362.340196:0:6567:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002888929b/0x85f51a6b96715a04 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.340207:0:6567:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002888929b/0x85f51a6b96715a04 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.340223:0:6567:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002888929b/0x85f51a6b96715a04 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.340232:0:6567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002888929b/0x85f51a6b96715a04 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051362.340243:0:6584:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48be00/0x85f51a6b96715a12 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xd5:0x0].0xceea225b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x85f51a6b96715a0b expref: 8 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.340261:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051362.340267:0:6584:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48be00/0x85f51a6b96715a12 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xd5:0x0].0xceea225b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b96715a0b expref: 8 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.340268:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777051362.340273:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051362.340286:0:6584:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xd5:0x0].0xceea225b (ffff99d94e6b6400) 00010000:00010000:1.0:1777051362.340291:0:6584:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777051362.340297:0:6584:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d94e48be00, rc 0) 00000100:00100000:1.0:1777051362.340380:0:6584:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94c12ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:27882:x1863365452594176:12345-0@lo:101:mdt00_006.0 Request processed in 275us (2065us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051362.340390:0:24468:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da44494e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3677:x1863365452593792:12345-0@lo:6:osp-syn-0-0.0 Request processed in 6312us (6536us total) trans 4294968352 rc 0/0 00000100:00100000:1.0:1777051362.340396:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8109 00000100:00100000:3.0:1777051362.340413:0:24468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7976 00000100:00100000:2.0:1777051362.340415:0:27882:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94c128a80 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-mdtlov_UUID:27882:1863365452594176:0@lo:101:mdt00_006.0 00010000:00010000:2.0:1777051362.340444:0:27882:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff99da7d784600/0x85f51a6b96715a0b lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0xd5:0x0].0xceea225b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x85f51a6b96715a12 expref: -99 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1777051362.340449:0:3677:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99da44494380/2, rc 0, transno 4294968352 00000100:00100000:0.0:1777051362.340465:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da44494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3677:1863365452593792:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1777051362.340465:0:27882:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff99da7d784600/0x85f51a6b96715a0b lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0xd5:0x0].0xceea225b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x85f51a6b96715a12 expref: -99 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1777051362.340492:0:27882:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000bd2:0xd5:0x0] 00000100:00100000:2.0:1777051362.340535:0:27882:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94c128a80 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-mdtlov_UUID:27882:1863365452594304:0@lo:1000:mdt00_006.0 00000100:00100000:2.0:1777051362.340577:0:27882:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051362.340611:0:27882:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da70a7d900 going to sleep for 11 seconds 00000100:00100000:0.0:1777051362.340645:0:11727:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452594304 00000100:00100000:0.0:1777051362.340653:0:11727:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452594304 00000100:00100000:0.0:1777051362.340703:0:11727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8110 00000100:00100000:0.0:1777051362.340714:0:11727:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94c12a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:27882:x1863365452594304:12345-0@lo:1000:mdt00_006.0 00000100:00100000:0.0:1777051362.340795:0:11727:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94c12a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:27882:x1863365452594304:12345-0@lo:1000:mdt00_006.0 Request processed in 83us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051362.340802:0:11727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8110 00000100:00100000:2.0:1777051362.340844:0:27882:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94c128a80 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-mdtlov_UUID:27882:1863365452594304:0@lo:1000:mdt00_006.0 00000100:00100000:2.0:1777051362.340898:0:27882:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94c128a80 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-mdtlov_UUID:27882:1863365452594432:0@lo:1000:mdt00_006.0 00000100:00100000:2.0:1777051362.340933:0:27882:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051362.340963:0:27882:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da70a7db40 going to sleep for 11 seconds 00000100:00100000:3.0:1777051362.341040:0:46500:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452594432 00000100:00100000:3.0:1777051362.341048:0:46500:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452594432 00000100:00100000:3.0:1777051362.341096:0:46500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8111 00000100:00100000:3.0:1777051362.341107:0:46500:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94c129f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+8:27882:x1863365452594432:12345-0@lo:1000:mdt00_006.0 00000100:00100000:3.0:1777051362.341755:0:46500:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94c129f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+8:27882:x1863365452594432:12345-0@lo:1000:mdt00_006.0 Request processed in 646us (817us total) trans 0 rc -2/-2 00000100:00100000:3.0:1777051362.341766:0:46500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8111 00000100:00100000:2.0:1777051362.341816:0:27882:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94c128a80 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-mdtlov_UUID:27882:1863365452594432:0@lo:1000:mdt00_006.0 00000100:00100000:2.0:1777051362.341901:0:27882:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94c128a80 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-mdtlov_UUID:27882:1863365452594560:0@lo:1000:mdt00_006.0 00000100:00100000:2.0:1777051362.341940:0:27882:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051362.341983:0:27882:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da70a7d900 going to sleep for 11 seconds 00000100:00100000:0.0:1777051362.342097:0:46498:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452594560 00000100:00100000:0.0:1777051362.342104:0:46498:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452594560 00000100:00100000:0.0:1777051362.342150:0:46498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8112 00000100:00100000:0.0:1777051362.342160:0:46498:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94c128380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+8:27882:x1863365452594560:12345-0@lo:1000:mdt00_006.0 00000100:00100000:0.0:1777051362.342600:0:46498:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94c128380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+8:27882:x1863365452594560:12345-0@lo:1000:mdt00_006.0 Request processed in 432us (651us total) trans 0 rc -2/-2 00000100:00100000:0.0:1777051362.342612:0:46498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8112 00000100:00100000:2.0:1777051362.342661:0:27882:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94c128a80 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-mdtlov_UUID:27882:1863365452594560:0@lo:1000:mdt00_006.0 00000100:00100000:2.0:1777051362.342731:0:27882:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94c128a80 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-mdtlov_UUID:27882:1863365452594688:0@lo:1000:mdt00_006.0 00000100:00100000:2.0:1777051362.342769:0:27882:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051362.342802:0:27882:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da70a7db40 going to sleep for 11 seconds 00000100:00100000:0.0:1777051362.342841:0:47208:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452594688 00000100:00100000:0.0:1777051362.342849:0:47208:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452594688 00000100:00100000:0.0:1777051362.342900:0:47208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8113 00000100:00100000:0.0:1777051362.342911:0:47208:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94c129180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+8:27882:x1863365452594688:12345-0@lo:1000:mdt00_006.0 00000100:00100000:0.0:1777051362.342997:0:47208:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94c129180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+8:27882:x1863365452594688:12345-0@lo:1000:mdt00_006.0 Request processed in 85us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051362.343040:0:47208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8113 00000100:00100000:2.0:1777051362.343057:0:27882:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94c128a80 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-mdtlov_UUID:27882:1863365452594688:0@lo:1000:mdt00_006.0 00000100:00100000:2.0:1777051362.343148:0:27882:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94c128a80 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-mdtlov_UUID:27882:1863365452594816:0@lo:1000:mdt00_006.0 00000100:00100000:2.0:1777051362.343189:0:27882:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051362.343276:0:27882:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da70a7d900 going to sleep for 11 seconds 00000100:00100000:0.0:1777051362.343299:0:6585:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452594816 00000100:00100000:0.0:1777051362.343308:0:6585:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452594816 00000100:00100000:0.0:1777051362.343355:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8114 00000100:00100000:0.0:1777051362.343368:0:6585:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94c129c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:27882:x1863365452594816:12345-0@lo:1000:mdt00_006.0 00000100:00100000:0.0:1777051362.343458:0:6585:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94c129c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:27882:x1863365452594816:12345-0@lo:1000:mdt00_006.0 Request processed in 91us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051362.343469:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8114 00000100:00100000:2.0:1777051362.343617:0:27882:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94c128a80 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-mdtlov_UUID:27882:1863365452594816:0@lo:1000:mdt00_006.0 00000040:00080000:2.0:1777051362.345630:0:27882:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000bd0:0x1:0x0].3, 1080 off35344 00000040:00080000:2.0:1777051362.345714:0:27882:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2000032e1:0x1:0x0].3, 1224 off35712 00000004:00080000:2.0:1777051362.345725:0:27882:0:(osp_trans.c:1582:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff99da7ff82000 with version 10 00000004:00080000:3.0:1777051362.345802:0:104211:0:(osp_trans.c:1330:osp_get_next_request()) ou ffff99d9596fa9c0 version 10 rpc_version 10 00000020:00100000:3.0:1777051362.345847:0:104211:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1777051362.345855:0:104211:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff99d9533bf480 x1863365452595072/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 2496/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1777051362.345873:0:104211:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d9533bf480 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:104211:1863365452595072:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1777051362.345913:0:104211:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051362.345950:0:104211:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d95ba60180 going to sleep for 11 seconds 00000100:00100000:1.0:1777051362.346230:0:6584:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452595072 00000100:00100000:1.0:1777051362.346239:0:6584:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452595072 00000100:00100000:1.0:1777051362.346298:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8115 00000100:00100000:1.0:1777051362.346314:0:6584:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d9533bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:104211:x1863365452595072:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1777051362.346708:0:6584:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d9533bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:104211:x1863365452595072:12345-0@lo:1000:osp_up0-1.0 Request processed in 397us (790us total) trans 30064771107 rc 0/0 00000100:00100000:1.0:1777051362.347036:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8115 00000100:00100000:3.0:1777051362.347118:0:104211:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d9533bf480 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:104211:1863365452595072:0@lo:1000:osp_up0-1.0 00010000:00010000:2.0:1777051362.347272:0:27882:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d785400/0x85f51a6b96715a19 lrc: 3/0,1 mode: --/PW res: [0x240000404:0xf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.347303:0:27882:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d785400/0x85f51a6b96715a19 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0xf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27882 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.347321:0:27882:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d785400/0x85f51a6b96715a19 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0xf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27882 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1777051362.347345:0:27882:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000006a390809 reply state 000000009d536d31 transno 8589934605 ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d785400/0x85f51a6b96715a19 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0xf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27882 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.347362:0:27882:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d785400/0x85f51a6b96715a19 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0xf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27882 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.347373:0:27882:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0xf:0x0].0x0 (ffff99d94c159000) 00010000:00010000:2.0:1777051362.347378:0:27882:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1777051362.347383:0:27882:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1777051362.347390:0:27882:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0xf:0x0]: returning size 4096 00000004:00080000:2.0:1777051362.347399:0:27882:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000bd2:0xd5:0x0] 00010000:00010000:2.0:1777051362.347409:0:27882:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff99da7d785a00/0x85f51a6b967159f6 lrc: 4/0,1 mode: CW/CW res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x85f51a6b967159fd expref: -99 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.347422:0:27882:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff99da7d785a00/0x85f51a6b967159f6 lrc: 4/0,1 mode: CW/CW res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x85f51a6b967159fd expref: -99 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.347435:0:27882:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff99da7d785a00/0x85f51a6b967159f6 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x85f51a6b967159fd expref: -99 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.347474:0:27882:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:2.0:1777051362.347482:0:27882:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000bd2:0xd5:0x0] 00010000:00010000:2.0:1777051362.347490:0:27882:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff99da7d784600/0x85f51a6b96715a0b lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0xd5:0x0].0xceea225b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x85f51a6b96715a12 expref: -99 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.347512:0:27882:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff99da7d784600/0x85f51a6b96715a0b lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xd5:0x0].0xceea225b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x85f51a6b96715a12 expref: -99 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051362.347531:0:13753:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777051362.347544:0:13753:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff99da7d785a00/0x85f51a6b967159f6 lrc: 2/0,0 mode: CW/CW res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x85f51a6b967159fd expref: -99 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051362.347561:0:13753:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da7d785a00 already unused, calling callback (ffffffffc177eed0) 00010000:00010000:3.0:1777051362.347570:0:13753:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff99da7d785a00/0x85f51a6b967159f6 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x85f51a6b967159fd expref: -99 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777051362.347584:0:13753:0:(mdt_handler.c:3963:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff99da7d785a00/0x85f51a6b967159f6 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x85f51a6b967159fd expref: -99 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051362.347610:0:27882:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955ebfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+57:134107:x1863365425922048:12345-192.168.201.46@tcp:36:lfs.0 Request processed in 23341us (23612us total) trans 8589934605 rc 0/0 00000100:00100000:2.0:1777051362.347622:0:27882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111912 00010000:00010000:3.0:1777051362.347624:0:13753:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff99da7d785a00/0x85f51a6b967159f6 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x85f51a6b967159fd expref: -99 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051362.347638:0:13753:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1777051362.347957:0:13753:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff99da7d785a00/0x85f51a6b967159f6 lrc: 1/0,0 mode: --/CW res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x85f51a6b967159fd expref: -99 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051362.347971:0:13753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff99da7d785a00/0x85f51a6b967159f6 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x85f51a6b967159fd expref: -99 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051362.348000:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1777051362.348003:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d9533bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452595200:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1777051362.348005:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051362.348035:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1777051362.348100:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051362.348699:0:47827:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452595200 00000100:00100000:3.0:1777051362.348707:0:47827:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452595200 00000100:00100000:3.0:1777051362.348771:0:47827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13682 00000100:00100000:3.0:1777051362.348785:0:47827:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da44496680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:lustre-MDT0001-mdtlov_UUID+9:3679:x1863365452595200:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1777051362.348802:0:47827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777051362.348828:0:47827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48a800/0x85f51a6b967159fd lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x85f51a6b967159f6 expref: 9 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051362.348851:0:47827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xd5:0x0].0x0 (ffff99d9413d2a00) 00010000:00010000:3.0:1777051362.348857:0:47827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1777051362.348948:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d9533bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452595200:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1777051362.349504:0:47827:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da44496680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:lustre-MDT0001-mdtlov_UUID+8:3679:x1863365452595200:12345-0@lo:103:ldlm_bl.0 Request processed in 721us (1402us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051362.349515:0:47827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13682 00000100:00100000:0.0:1777051362.384474:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051362.384632:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051362.385061:0:6580:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425922688 00000100:00100000:2.0:1777051362.385062:0:10328:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425922432 00000100:00100000:1.0:1777051362.385078:0:6580:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425922688 00000100:00100000:2.0:1777051362.385078:0:10328:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425922432 00000100:00100000:2.0:1777051362.385163:0:10328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111913 00000100:00100000:1.0:1777051362.385192:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111914 00000100:00100000:2.0:1777051362.385193:0:10328:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da45f76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+8:2437:x1863365425922432:12345-192.168.201.46@tcp:41:mkdir.0 00000100:00100000:1.0:1777051362.385212:0:6580:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da45f74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+8:134111:x1863365425922688:12345-192.168.201.46@tcp:36:mkdir.0 00000004:00000024:2.0:1777051362.385279:0:10328:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4194304 pending 0 free 1446150144 avail 1299910656 00000100:00100000:2.0:1777051362.385373:0:10328:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da45f76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+8:2437:x1863365425922432:12345-192.168.201.46@tcp:41:mkdir.0 Request processed in 196us (739us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051362.385386:0:6580:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955ebce00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6580:1863365452595328:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1777051362.385389:0:10328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111913 00000100:00100000:1.0:1777051362.385457:0:6580:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051362.385500:0:6580:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d9565d4e40 going to sleep for 11 seconds 00000100:00100000:2.0:1777051362.385590:0:11727:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452595328 00000100:00100000:2.0:1777051362.385597:0:11727:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452595328 00000100:00100000:2.0:1777051362.385644:0:11727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8116 00000100:00100000:2.0:1777051362.385654:0:11727:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955ebdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:6580:x1863365452595328:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1777051362.385756:0:11727:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955ebdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:6580:x1863365452595328:12345-0@lo:1000:mdt00_001.0 Request processed in 102us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051362.385773:0:11727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8116 00000100:00100000:1.0:1777051362.385902:0:6580:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955ebce00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6580:1863365452595328:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1777051362.385977:0:6580:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955ebce00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6580:1863365452595456:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1777051362.386043:0:6580:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051362.386080:0:6580:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d9565d43c0 going to sleep for 11 seconds 00000100:00100000:0.0:1777051362.386183:0:6585:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452595456 00000100:00100000:0.0:1777051362.386190:0:6585:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452595456 00000100:00100000:0.0:1777051362.386572:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8117 00000100:00100000:0.0:1777051362.386583:0:6585:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955ebd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:6580:x1863365452595456:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1777051362.386776:0:6585:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955ebd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:6580:x1863365452595456:12345-0@lo:1000:mdt00_001.0 Request processed in 192us (730us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051362.386789:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8117 00000100:00100000:1.0:1777051362.386887:0:6580:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955ebce00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6580:1863365452595456:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1777051362.386939:0:6580:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955ebce00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6580:1863365452595584:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1777051362.386977:0:6580:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051362.387361:0:6580:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d9565d4e40 going to sleep for 11 seconds 00000100:00100000:0.0:1777051362.387427:0:46498:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452595584 00000100:00100000:0.0:1777051362.387434:0:46498:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452595584 00000100:00100000:0.0:1777051362.387485:0:46498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8118 00000100:00100000:0.0:1777051362.387496:0:46498:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7cd9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+8:6580:x1863365452595584:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1777051362.387639:0:46498:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7cd9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+8:6580:x1863365452595584:12345-0@lo:1000:mdt00_001.0 Request processed in 143us (659us total) trans 0 rc 1/1 00000100:00100000:0.0:1777051362.387652:0:46498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8118 00000100:00100000:1.0:1777051362.387693:0:6580:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955ebce00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6580:1863365452595584:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1777051362.387763:0:6580:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da45f74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+7:134111:x1863365425922688:12345-192.168.201.46@tcp:36:mkdir.0 Request processed in 2559us (3300us total) trans 0 rc -17/-17 00000100:00100000:1.0:1777051362.387770:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111914 00010000:00010000:1.0:1777051362.390976:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1777051362.392442:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051362.392572:0:21368:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425922816 00000100:00100000:1.0:1777051362.392581:0:21368:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425922816 00000100:00100000:1.0:1777051362.392638:0:21368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111915 00000100:00100000:1.0:1777051362.392650:0:21368:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da45f76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+16:134111:x1863365425922816:12345-192.168.201.46@tcp:101:mkdir.0 00010000:00010000:1.0:1777051362.392669:0:21368:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777051362.392693:0:21368:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48b200/0x85f51a6b96715a20 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b611e expref: -99 pid: 21368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051362.392774:0:21368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48a000/0x85f51a6b96715a27 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051362.392795:0:21368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48a000/0x85f51a6b96715a27 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051362.392810:0:21368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48a000/0x85f51a6b96715a27 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051362.392830:0:21368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48ac00/0x85f51a6b96715a2e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x51d501f3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051362.392840:0:21368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48ac00/0x85f51a6b96715a2e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x51d501f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051362.392850:0:21368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48ac00/0x85f51a6b96715a2e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x51d501f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051362.392974:0:21368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48bc00/0x85f51a6b96715a35 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051362.392990:0:21368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48bc00/0x85f51a6b96715a35 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051362.393004:0:21368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48bc00/0x85f51a6b96715a35 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1777051362.393077:0:21368:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0xd5:0x0]: returning size 4096 00000004:00200000:1.0:1777051362.393083:0:21368:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1777051362.393127:0:21368:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48bc00/0x85f51a6b96715a35 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051362.393142:0:21368:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48a000/0x85f51a6b96715a27 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051362.393152:0:21368:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48a000/0x85f51a6b96715a27 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051362.393161:0:21368:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48a000/0x85f51a6b96715a27 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051362.393169:0:21368:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94e48a000 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:1.0:1777051362.393175:0:21368:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48a000/0x85f51a6b96715a27 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051362.393185:0:21368:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48a000/0x85f51a6b96715a27 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051362.393230:0:21368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d9533ab000) 00010000:00010000:1.0:1777051362.393236:0:21368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777051362.393244:0:21368:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48a000/0x85f51a6b96715a27 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051362.393253:0:21368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48a000/0x85f51a6b96715a27 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051362.393274:0:21368:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48ac00/0x85f51a6b96715a2e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x51d501f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051362.393283:0:21368:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48ac00/0x85f51a6b96715a2e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x51d501f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051362.393291:0:21368:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48ac00/0x85f51a6b96715a2e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x51d501f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051362.393299:0:21368:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94e48ac00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:1.0:1777051362.393303:0:21368:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48ac00/0x85f51a6b96715a2e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x51d501f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051362.393312:0:21368:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48ac00/0x85f51a6b96715a2e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x51d501f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051362.393322:0:21368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x51d501f3 (ffff99d94e6b6700) 00010000:00010000:1.0:1777051362.393335:0:21368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777051362.393339:0:21368:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48ac00/0x85f51a6b96715a2e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x51d501f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051362.393347:0:21368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48ac00/0x85f51a6b96715a2e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x51d501f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051362.393389:0:21368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48b200/0x85f51a6b96715a20 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b611e expref: 18 pid: 21368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051362.393418:0:21368:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48bc00/0x85f51a6b96715a35 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b611e expref: 17 pid: 21368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051362.393429:0:21368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xd5:0x0].0x0 (ffff99d9413d2a00) 00010000:00010000:1.0:1777051362.393432:0:21368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1777051362.393436:0:21368:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d94e48bc00, rc 0) 00000100:00100000:1.0:1777051362.393507:0:21368:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da45f76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+17:134111:x1863365425922816:12345-192.168.201.46@tcp:101:mkdir.0 Request processed in 857us (1068us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051362.393518:0:21368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111915 00000100:00100000:2.0:1777051362.397131:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051362.397253:0:46497:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425923072 00000100:00100000:0.0:1777051362.397263:0:46497:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425923072 00000100:00100000:0.0:1777051362.397325:0:46497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111916 00000100:00100000:0.0:1777051362.397337:0:46497:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94c128a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:c11b6966-0775-44d2-bdc6-c74c26eb2226+17:134111:x1863365425923072:12345-192.168.201.46@tcp:36:mkdir.0 00010000:00010000:0.0:1777051362.397447:0:46497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777051362.397470:0:46497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48bc00/0x85f51a6b96715a35 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b611e expref: 17 pid: 21368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.397490:0:46497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xd5:0x0].0x0 (ffff99d9413d2a00) 00010000:00010000:0.0:1777051362.397494:0:46497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1777051362.397584:0:46497:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94c128a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:c11b6966-0775-44d2-bdc6-c74c26eb2226+16:134111:x1863365425923072:12345-192.168.201.46@tcp:36:mkdir.0 Request processed in 250us (457us total) trans 0 rc -17/-17 00000100:00100000:0.0:1777051362.397595:0:46497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111916 00000100:00100000:0.0:1777051362.399942:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051362.400071:0:27885:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425923200 00000100:00100000:2.0:1777051362.400377:0:27885:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425923200 00000100:00100000:2.0:1777051362.400435:0:27885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111917 00000100:00100000:2.0:1777051362.400450:0:27885:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da45f75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c11b6966-0775-44d2-bdc6-c74c26eb2226+16:134111:x1863365425923200:12345-192.168.201.46@tcp:101:mkdir.0 00010000:00010000:2.0:1777051362.400467:0:27885:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051362.400487:0:27885:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d785600/0x85f51a6b96715a3c lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6125 expref: -99 pid: 27885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.400542:0:27885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784a00/0x85f51a6b96715a43 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.400559:0:27885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784a00/0x85f51a6b96715a43 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.400570:0:27885:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784a00/0x85f51a6b96715a43 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.400584:0:27885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784e00/0x85f51a6b96715a4a lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xd5:0x0].0xac1bda01 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.400591:0:27885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784e00/0x85f51a6b96715a4a lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xd5:0x0].0xac1bda01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.400597:0:27885:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784e00/0x85f51a6b96715a4a lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xd5:0x0].0xac1bda01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.400643:0:27885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d785200/0x85f51a6b96715a51 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xd6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.400650:0:27885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d785200/0x85f51a6b96715a51 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xd6:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.400656:0:27885:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d785200/0x85f51a6b96715a51 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xd6:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1777051362.400691:0:27885:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0xd6:0x0]: returning size 4096 00000004:00200000:2.0:1777051362.400695:0:27885:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1777051362.400711:0:27885:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d785200/0x85f51a6b96715a51 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xd6:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.400721:0:27885:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784a00/0x85f51a6b96715a43 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.400727:0:27885:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784a00/0x85f51a6b96715a43 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.400733:0:27885:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784a00/0x85f51a6b96715a43 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.400739:0:27885:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784a00/0x85f51a6b96715a43 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.400744:0:27885:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da7d784a00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:2.0:1777051362.400747:0:27885:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784a00/0x85f51a6b96715a43 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.400753:0:27885:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784a00/0x85f51a6b96715a43 lrc: 5/0,0 mode: CR/CR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.400761:0:27885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xd5:0x0].0x0 (ffff99d9413d2a00) 00010000:00010000:2.0:1777051362.400764:0:27885:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777051362.400767:0:27885:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784a00/0x85f51a6b96715a43 lrc: 3/0,0 mode: --/CR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.400772:0:27885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784a00/0x85f51a6b96715a43 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.400787:0:27885:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784e00/0x85f51a6b96715a4a lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xd5:0x0].0xac1bda01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.400793:0:27885:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784e00/0x85f51a6b96715a4a lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0xd5:0x0].0xac1bda01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.400799:0:27885:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784e00/0x85f51a6b96715a4a lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xd5:0x0].0xac1bda01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.400804:0:27885:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da7d784e00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:2.0:1777051362.400807:0:27885:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784e00/0x85f51a6b96715a4a lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xd5:0x0].0xac1bda01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.400816:0:27885:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784e00/0x85f51a6b96715a4a lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0xd5:0x0].0xac1bda01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.400825:0:27885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xd5:0x0].0xac1bda01 (ffff99d94c159f00) 00010000:00010000:2.0:1777051362.400828:0:27885:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777051362.400832:0:27885:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784e00/0x85f51a6b96715a4a lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0xd5:0x0].0xac1bda01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.400841:0:27885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784e00/0x85f51a6b96715a4a lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xd5:0x0].0xac1bda01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.400873:0:27885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d785600/0x85f51a6b96715a3c lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6125 expref: 18 pid: 27885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.400892:0:27885:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d785200/0x85f51a6b96715a51 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xd6:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6125 expref: 17 pid: 27885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.400911:0:27885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xd6:0x0].0x0 (ffff99d94c159600) 00010000:00010000:2.0:1777051362.400914:0:27885:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1777051362.400918:0:27885:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99da7d785200, rc 0) 00000100:00100000:2.0:1777051362.400970:0:27885:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da45f75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c11b6966-0775-44d2-bdc6-c74c26eb2226+17:134111:x1863365425923200:12345-192.168.201.46@tcp:101:mkdir.0 Request processed in 523us (1031us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051362.400980:0:27885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111917 00000100:00100000:2.0:1777051362.415182:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051362.415312:0:6579:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425923328 00000100:00100000:0.0:1777051362.415324:0:6579:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425923328 00000100:00100000:0.0:1777051362.415398:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111918 00000100:00100000:0.0:1777051362.415411:0:6579:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94c12bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+17:134112:x1863365425923328:12345-192.168.201.46@tcp:101:rm.0 00010000:00010000:0.0:1777051362.415434:0:6579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051362.415459:0:6579:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3400/0x85f51a6b96715a58 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b612c expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.415532:0:6579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2600/0x85f51a6b96715a5f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.415547:0:6579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2600/0x85f51a6b96715a5f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.415559:0:6579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2600/0x85f51a6b96715a5f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.415571:0:6579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2c00/0x85f51a6b96715a66 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x51d501f3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.415578:0:6579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2c00/0x85f51a6b96715a66 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x51d501f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.415584:0:6579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2c00/0x85f51a6b96715a66 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x51d501f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.415668:0:6579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3600/0x85f51a6b96715a6d lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.415681:0:6579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3600/0x85f51a6b96715a6d lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.415982:0:6579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3600/0x85f51a6b96715a6d lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1777051362.416058:0:6579:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0xd5:0x0]: returning size 4096 00000004:00200000:0.0:1777051362.416064:0:6579:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1777051362.416089:0:6579:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3600/0x85f51a6b96715a6d lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.416106:0:6579:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2600/0x85f51a6b96715a5f lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.416116:0:6579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2600/0x85f51a6b96715a5f lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.416125:0:6579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2600/0x85f51a6b96715a5f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.416135:0:6579:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2600/0x85f51a6b96715a5f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.416144:0:6579:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d9559a2600 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:0.0:1777051362.416149:0:6579:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2600/0x85f51a6b96715a5f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.416158:0:6579:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2600/0x85f51a6b96715a5f lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.416173:0:6579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d9533ab000) 00010000:00010000:0.0:1777051362.416178:0:6579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777051362.416184:0:6579:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2600/0x85f51a6b96715a5f lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.416223:0:6579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2600/0x85f51a6b96715a5f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.416244:0:6579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2c00/0x85f51a6b96715a66 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x51d501f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.416252:0:6579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2c00/0x85f51a6b96715a66 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x51d501f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.416261:0:6579:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2c00/0x85f51a6b96715a66 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x51d501f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.416268:0:6579:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d9559a2c00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:0.0:1777051362.416273:0:6579:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2c00/0x85f51a6b96715a66 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x51d501f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.416282:0:6579:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2c00/0x85f51a6b96715a66 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x51d501f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.416294:0:6579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x51d501f3 (ffff99d950c54600) 00010000:00010000:0.0:1777051362.416297:0:6579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777051362.416301:0:6579:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2c00/0x85f51a6b96715a66 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x51d501f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.416310:0:6579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2c00/0x85f51a6b96715a66 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x51d501f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.416349:0:6579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3400/0x85f51a6b96715a58 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b612c expref: 19 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.416376:0:6579:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3600/0x85f51a6b96715a6d lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b612c expref: 18 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.416386:0:6579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xd5:0x0].0x0 (ffff99d9413d2a00) 00010000:00010000:0.0:1777051362.416390:0:6579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1777051362.416393:0:6579:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d9559a3600, rc 0) 00000100:00100000:0.0:1777051362.416471:0:6579:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94c12bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+18:134112:x1863365425923328:12345-192.168.201.46@tcp:101:rm.0 Request processed in 1062us (1297us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051362.416482:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111918 00000100:00100000:1.0:1777051362.419132:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051362.419237:0:10328:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425923456 00000100:00100000:2.0:1777051362.419246:0:10328:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425923456 00000100:00100000:2.0:1777051362.419298:0:10328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111919 00000100:00100000:2.0:1777051362.419312:0:10328:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7cd9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+18:134112:x1863365425923456:12345-192.168.201.46@tcp:101:rm.0 00010000:00010000:2.0:1777051362.419328:0:10328:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051362.419344:0:10328:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d785600/0x85f51a6b96715a74 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0xd6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6133 expref: -99 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.419393:0:10328:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784e00/0x85f51a6b96715a7b lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0xd6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.419407:0:10328:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784e00/0x85f51a6b96715a7b lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.419432:0:10328:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784e00/0x85f51a6b96715a7b lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.419450:0:10328:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784a00/0x85f51a6b96715a82 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xd6:0x0].0xc67b6e72 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.419460:0:10328:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784a00/0x85f51a6b96715a82 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xd6:0x0].0xc67b6e72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.419470:0:10328:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784a00/0x85f51a6b96715a82 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xd6:0x0].0xc67b6e72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.419502:0:10328:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784e00/0x85f51a6b96715a7b lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.419511:0:10328:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784e00/0x85f51a6b96715a7b lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.419519:0:10328:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784e00/0x85f51a6b96715a7b lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.419528:0:10328:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784e00/0x85f51a6b96715a7b lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.419536:0:10328:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da7d784e00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:2.0:1777051362.419541:0:10328:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784e00/0x85f51a6b96715a7b lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.419550:0:10328:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784e00/0x85f51a6b96715a7b lrc: 5/0,0 mode: CR/CR res: [0x200000bd2:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.419562:0:10328:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xd6:0x0].0x0 (ffff99d94c159600) 00010000:00010000:2.0:1777051362.419566:0:10328:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777051362.419570:0:10328:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784e00/0x85f51a6b96715a7b lrc: 3/0,0 mode: --/CR res: [0x200000bd2:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.419579:0:10328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784e00/0x85f51a6b96715a7b lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.419594:0:10328:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784a00/0x85f51a6b96715a82 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xd6:0x0].0xc67b6e72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.419603:0:10328:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784a00/0x85f51a6b96715a82 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0xd6:0x0].0xc67b6e72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.419611:0:10328:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784a00/0x85f51a6b96715a82 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xd6:0x0].0xc67b6e72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.419618:0:10328:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da7d784a00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:2.0:1777051362.419622:0:10328:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784a00/0x85f51a6b96715a82 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xd6:0x0].0xc67b6e72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.419630:0:10328:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784a00/0x85f51a6b96715a82 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0xd6:0x0].0xc67b6e72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.419640:0:10328:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xd6:0x0].0xc67b6e72 (ffff99d94c159f00) 00010000:00010000:2.0:1777051362.419643:0:10328:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777051362.419647:0:10328:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784a00/0x85f51a6b96715a82 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0xd6:0x0].0xc67b6e72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.419655:0:10328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784a00/0x85f51a6b96715a82 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xd6:0x0].0xc67b6e72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.419952:0:10328:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d785600/0x85f51a6b96715a74 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6133 expref: 19 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.419967:0:10328:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xd6:0x0].0x0 (ffff99d94c159600) 00010000:00010000:2.0:1777051362.419971:0:10328:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777051362.419977:0:10328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d785600/0x85f51a6b96715a74 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6133 expref: 19 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.419999:0:10328:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99da7d785600, rc 0) 00000100:00100000:2.0:1777051362.420094:0:10328:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7cd9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+18:134112:x1863365425923456:12345-192.168.201.46@tcp:101:rm.0 Request processed in 783us (965us total) trans 0 rc 301/301 00000100:00100000:2.0:1777051362.420105:0:10328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111919 00000100:00100000:1.0:1777051362.429920:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051362.430054:0:46494:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425923712 00000100:00100000:2.0:1777051362.430065:0:46494:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425923712 00000100:00100000:2.0:1777051362.430143:0:46494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111920 00000100:00100000:2.0:1777051362.430157:0:46494:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7cd9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c11b6966-0775-44d2-bdc6-c74c26eb2226+18:134113:x1863365425923712:12345-192.168.201.46@tcp:101:dd.0 00010000:00010000:2.0:1777051362.430177:0:46494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051362.430181:0:46494:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1777051362.430503:0:46494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d785200/0x85f51a6b96715a51 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xd6:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6125 expref: 18 pid: 27885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.430525:0:46494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xd6:0x0].0x0 (ffff99d94c159600) 00010000:00010000:2.0:1777051362.430536:0:46494:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1777051362.430551:0:46494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d785600/0x85f51a6b96715a89 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0xd6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b613a expref: -99 pid: 46494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.430901:0:46494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784a00/0x85f51a6b96715a90 lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0xd6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.430919:0:46494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784a00/0x85f51a6b96715a90 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.430933:0:46494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784a00/0x85f51a6b96715a90 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.430960:0:46494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784e00/0x85f51a6b96715a97 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0xd6:0x0].0xc67b6e72 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.430971:0:46494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784e00/0x85f51a6b96715a97 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xd6:0x0].0xc67b6e72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.430980:0:46494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784e00/0x85f51a6b96715a97 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xd6:0x0].0xc67b6e72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1777051362.431409:0:46494:0:(osp_internal.h:570:osp_update_last_fid()) Gap in objids: start=[0x2c0000401:0x15f:0x0], count =131 00000004:00080000:2.0:1777051362.431420:0:46494:0:(osp_object.c:1640:osp_create()) Writing gap [0x2c0000401:0x15f:0x0]+131 in llog 00000004:00080000:2.0:1777051362.431437:0:46494:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x1e2:0x0], index 1: 0 00010000:00010000:2.0:1777051362.431602:0:46494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d785e00/0x85f51a6b96715a9e lrc: 3/1,0 mode: --/PR res: [0x200000bd3:0xc5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.431612:0:46494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d785e00/0x85f51a6b96715a9e lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0xc5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.431620:0:46494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d785e00/0x85f51a6b96715a9e lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0xc5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.431650:0:46494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784a00/0x85f51a6b96715a90 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.431658:0:46494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784a00/0x85f51a6b96715a90 lrc: 2/0,0 mode: CW/CW res: [0x200000bd2:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.431663:0:46494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784a00/0x85f51a6b96715a90 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.431669:0:46494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da7d784a00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:2.0:1777051362.431673:0:46494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784a00/0x85f51a6b96715a90 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.431679:0:46494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784a00/0x85f51a6b96715a90 lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.431686:0:46494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xd6:0x0].0x0 (ffff99d94c159f00) 00010000:00010000:2.0:1777051362.431689:0:46494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777051362.431692:0:46494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784a00/0x85f51a6b96715a90 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.431698:0:46494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784a00/0x85f51a6b96715a90 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1777051362.431707:0:46494:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000f0a4ea1e reply state 000000005927d044 transno 30064771108 ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784e00/0x85f51a6b96715a97 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xd6:0x0].0xc67b6e72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.431717:0:46494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784e00/0x85f51a6b96715a97 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0xd6:0x0].0xc67b6e72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.431723:0:46494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xd6:0x0].0xc67b6e72 (ffff99d9533a8800) 00010000:00010000:2.0:1777051362.431725:0:46494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1777051362.431727:0:46494:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1777051362.431751:0:46494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d785600/0x85f51a6b96715a89 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b613a expref: 20 pid: 46494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.431766:0:46494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d785e00/0x85f51a6b96715a9e lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0xc5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b613a expref: 19 pid: 46494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.431773:0:46494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0xc5:0x0].0x0 (ffff99d9533a8b00) 00010000:00010000:2.0:1777051362.431776:0:46494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1777051362.431780:0:46494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99da7d785e00, rc 0) 00000100:00100000:2.0:1777051362.431849:0:46494:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7cd9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c11b6966-0775-44d2-bdc6-c74c26eb2226+20:134113:x1863365425923712:12345-192.168.201.46@tcp:101:dd.0 Request processed in 1694us (1936us total) trans 30064771108 rc 0/0 00000100:00100000:2.0:1777051362.431860:0:46494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111920 00000100:00100000:0.0:1777051362.458553:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051362.458648:0:8470:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425923840 00000100:00100000:3.0:1777051362.458661:0:8470:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425923840 00000100:00100000:3.0:1777051362.458744:0:8470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 7977 00000100:00100000:3.0:1777051362.458758:0:8470:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d944e10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+48:134113:x1863365425923840:12345-192.168.201.46@tcp:101:dd.0 00010000:00010000:3.0:1777051362.458782:0:8470:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777051362.458810:0:8470:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007692fab8/0x85f51a6b96715aac lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x1e2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6141 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1777051362.458844:0:8470:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x1e2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777051362.458872:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051362.458891:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051362.458905:0:8470:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007692fab8/0x85f51a6b96715aac lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6141 expref: 49 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051362.458930:0:8470:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007692fab8/0x85f51a6b96715aac lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6141 expref: 49 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051362.458949:0:8470:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d95595aa00, rc 0) 00000100:00100000:3.0:1777051362.459387:0:8470:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d944e10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+49:134113:x1863365425923840:12345-192.168.201.46@tcp:101:dd.0 Request processed in 629us (842us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051362.459408:0:8470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 7977 00000100:00100000:1.0:1777051362.483173:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051362.483377:0:43492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425923968 00000100:00100000:3.0:1777051362.483390:0:43492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425923968 00002000:00100000:3.0:1777051362.483451:0:43492:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x1e2:0x0] (0->1048575) req@ffff99da7cd9c380 x1863365425923968/t0(0) o4->c11b6966-0775-44d2-bdc6-c74c26eb2226@192.168.201.46@tcp:323/0 lens 488/0 e 0 to 0 dl 1777051373 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1777051362.483466:0:43492:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99da7cd9c380 with x1863365425923968 ext(0->1048575) 00002000:00010000:3.0:1777051362.483473:0:43492:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99da7cd9c380 00000100:00100000:3.0:1777051362.483511:0:43492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 1762 00000100:00100000:3.0:1777051362.483522:0:43492:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7cd9c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+49:2437:x1863365425923968:12345-192.168.201.46@tcp:4:dd.0 00000100:00100000:2.0:1777051362.506779:0:43492:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7cd9c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+51:2437:x1863365425923968:12345-192.168.201.46@tcp:4:dd.0 Request processed in 23245us (23603us total) trans 4294968353 rc 0/0 00000100:00100000:2.0:1777051362.506794:0:43492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 1762 00002000:00100000:2.0:1777051362.506809:0:43492:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x1e2:0x0] (0->1048575) req@ffff99da7cd9c380 x1863365425923968/t4294968353(0) o4->c11b6966-0775-44d2-bdc6-c74c26eb2226@192.168.201.46@tcp:323/0 lens 488/448 e 0 to 0 dl 1777051373 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1777051362.506822:0:43492:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99da7cd9c380 with x1863365425923968 ext(0->1048575) 00002000:00010000:2.0:1777051362.506831:0:43492:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99da7cd9c380 00000100:00100000:1.0:1777051362.509806:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051362.509919:0:6581:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425924096 00000100:00100000:3.0:1777051362.509932:0:6581:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425924096 00000100:00100000:3.0:1777051362.510039:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111921 00000100:00100000:3.0:1777051362.510058:0:6581:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7cd9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+20:134113:x1863365425924096:12345-192.168.201.46@tcp:44:dd.0 00000001:00080000:0.0:1777051362.515709:0:103159:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771108 is committed 00000001:00080000:0.0:1777051362.515721:0:103159:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771107 is committed 00010000:00010000:2.0:1777051362.515782:0:3663:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784e00/0x85f51a6b96715a97 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0xd6:0x0].0xc67b6e72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.515801:0:3663:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784e00/0x85f51a6b96715a97 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd2:0xd6:0x0].0xc67b6e72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.515812:0:3663:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784e00/0x85f51a6b96715a97 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0xd6:0x0].0xc67b6e72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.515823:0:3663:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da7d784e00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:2.0:1777051362.515831:0:3663:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784e00/0x85f51a6b96715a97 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0xd6:0x0].0xc67b6e72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.515842:0:3663:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784e00/0x85f51a6b96715a97 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd2:0xd6:0x0].0xc67b6e72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.515859:0:3663:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xd6:0x0].0xc67b6e72 (ffff99d9533a8800) 00010000:00010000:2.0:1777051362.515864:0:3663:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777051362.515870:0:3663:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784e00/0x85f51a6b96715a97 lrc: 2/0,0 mode: --/TXN res: [0x200000bd2:0xd6:0x0].0xc67b6e72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.515877:0:3663:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784e00/0x85f51a6b96715a97 lrc: 0/0,0 mode: --/TXN res: [0x200000bd2:0xd6:0x0].0xc67b6e72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051362.516075:0:6581:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7cd9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+18:134113:x1863365425924096:12345-192.168.201.46@tcp:44:dd.0 Request processed in 6019us (6270us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051362.516090:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111921 00000100:00100000:1.0:1777051362.519592:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051362.519757:0:8628:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425924224 00000100:00100000:3.0:1777051362.519767:0:8628:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425924224 00000100:00100000:3.0:1777051362.519830:0:8628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 7978 00000100:00100000:3.0:1777051362.519843:0:8628:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7cd9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+51:2436:x1863365425924224:12345-192.168.201.46@tcp:16:dd.0 00000001:00080000:3.0:1777051362.522099:0:9540:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0001: transno 4294968353 is committed 00000100:00100000:2.0:1777051362.522562:0:8628:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7cd9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+49:2436:x1863365425924224:12345-192.168.201.46@tcp:16:dd.0 Request processed in 2718us (2972us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051362.522576:0:8628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 7978 00000100:00100000:0.0:1777051362.525578:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051362.525655:0:24269:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425924480 00000100:00100000:2.0:1777051362.525663:0:24269:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425924480 00000100:00100000:2.0:1777051362.525720:0:24269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3334 00000100:00100000:2.0:1777051362.525731:0:24269:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7b5e7450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+18:134113:x1863365425924480:12345-192.168.201.46@tcp:35:dd.0 00000100:00100000:2.0:1777051362.526625:0:24269:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7b5e7450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+19:134113:x1863365425924480:12345-192.168.201.46@tcp:35:dd.0 Request processed in 893us (1049us total) trans 30064771109 rc 0/0 00000100:00100000:2.0:1777051362.526637:0:24269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3334 00000100:00100000:1.0:1777051362.544620:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051362.544723:0:27882:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425924608 00000100:00100000:0.0:1777051362.544736:0:27882:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425924608 00000100:00100000:0.0:1777051362.544811:0:27882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111922 00000100:00100000:0.0:1777051362.544823:0:27882:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7cd9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+19:134114:x1863365425924608:12345-192.168.201.46@tcp:101:lfs.0 00010000:00010000:0.0:1777051362.544850:0:27882:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051362.544871:0:27882:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2600/0x85f51a6b96715ab3 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6148 expref: -99 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.544963:0:27882:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3c00/0x85f51a6b96715aba lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.544983:0:27882:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3c00/0x85f51a6b96715aba lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.545026:0:27882:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3c00/0x85f51a6b96715aba lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.545048:0:27882:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2800/0x85f51a6b96715ac1 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xd5:0x0].0xac1bda01 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.545077:0:27882:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2800/0x85f51a6b96715ac1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xd5:0x0].0xac1bda01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.545087:0:27882:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2800/0x85f51a6b96715ac1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xd5:0x0].0xac1bda01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.545448:0:27882:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2e00/0x85f51a6b96715ac8 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xd6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.545462:0:27882:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2e00/0x85f51a6b96715ac8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xd6:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.545473:0:27882:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2e00/0x85f51a6b96715ac8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xd6:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1777051362.545512:0:27882:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0xd6:0x0]: returning size 4096 00000004:00200000:0.0:1777051362.545517:0:27882:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1777051362.545541:0:27882:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2e00/0x85f51a6b96715ac8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xd6:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.545557:0:27882:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3c00/0x85f51a6b96715aba lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.545567:0:27882:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3c00/0x85f51a6b96715aba lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.545610:0:27882:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3c00/0x85f51a6b96715aba lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.545619:0:27882:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3c00/0x85f51a6b96715aba lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.545624:0:27882:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d9559a3c00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:0.0:1777051362.545628:0:27882:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3c00/0x85f51a6b96715aba lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.545636:0:27882:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3c00/0x85f51a6b96715aba lrc: 5/0,0 mode: CR/CR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.545648:0:27882:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xd5:0x0].0x0 (ffff99d9413d2a00) 00010000:00010000:0.0:1777051362.545652:0:27882:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777051362.545657:0:27882:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3c00/0x85f51a6b96715aba lrc: 3/0,0 mode: --/CR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.545664:0:27882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3c00/0x85f51a6b96715aba lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.545681:0:27882:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2800/0x85f51a6b96715ac1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xd5:0x0].0xac1bda01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.545687:0:27882:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2800/0x85f51a6b96715ac1 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0xd5:0x0].0xac1bda01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.545692:0:27882:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2800/0x85f51a6b96715ac1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xd5:0x0].0xac1bda01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.545697:0:27882:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d9559a2800 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:0.0:1777051362.545700:0:27882:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2800/0x85f51a6b96715ac1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xd5:0x0].0xac1bda01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.545706:0:27882:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2800/0x85f51a6b96715ac1 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0xd5:0x0].0xac1bda01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.545711:0:27882:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xd5:0x0].0xac1bda01 (ffff99d94e81c800) 00010000:00010000:0.0:1777051362.545714:0:27882:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777051362.545716:0:27882:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2800/0x85f51a6b96715ac1 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0xd5:0x0].0xac1bda01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.545721:0:27882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2800/0x85f51a6b96715ac1 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xd5:0x0].0xac1bda01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.545757:0:27882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2600/0x85f51a6b96715ab3 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6148 expref: 21 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.545770:0:27882:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2e00/0x85f51a6b96715ac8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xd6:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6148 expref: 20 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.545776:0:27882:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xd6:0x0].0x0 (ffff99d94e81c200) 00010000:00010000:0.0:1777051362.545778:0:27882:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1777051362.545780:0:27882:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d9559a2e00, rc 0) 00000100:00100000:0.0:1777051362.545842:0:27882:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7cd9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+20:134114:x1863365425924608:12345-192.168.201.46@tcp:101:lfs.0 Request processed in 1022us (1232us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051362.545850:0:27882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111922 00000100:00100000:1.0:1777051362.581962:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051362.582080:0:8492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425924864 00000100:00100000:3.0:1777051362.582092:0:8492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425924864 00000100:00100000:3.0:1777051362.582171:0:8492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111923 00000100:00100000:3.0:1777051362.582186:0:8492:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7cd9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+20:134119:x1863365425924864:12345-192.168.201.46@tcp:36:mkdir.0 00000100:00100000:1.0:1777051362.582441:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7cd9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3680:1863365452595712:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1777051362.582509:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051362.582563:0:47388:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452595712 00000100:00100000:0.0:1777051362.582574:0:47388:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452595712 00000100:00100000:3.0:1777051362.582589:0:8492:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7cd9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+20:134119:x1863365425924864:12345-192.168.201.46@tcp:36:mkdir.0 Request processed in 403us (632us total) trans 0 rc -17/-17 00000100:00100000:3.0:1777051362.582602:0:8492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111923 00000100:00100000:0.0:1777051362.582639:0:47388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5608 00000100:00100000:0.0:1777051362.582653:0:47388:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7cd9e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3680:x1863365452595712:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1777051362.582679:0:47388:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 455081536 pending 0 free 3860574208 avail 3629051904 00000100:00100000:0.0:1777051362.582743:0:47388:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7cd9e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3680:x1863365452595712:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051362.582756:0:47388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5608 00000100:00100000:1.0:1777051362.582785:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7cd9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3680:1863365452595712:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1777051362.582990:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94c12b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3677:1863365452595840:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1777051362.583066:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051362.583163:0:8473:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452595840 00000100:00100000:3.0:1777051362.583171:0:8473:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452595840 00000100:00080000:2.0:1777051362.583297:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1777051362.583312:0:8473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5609 00000100:00100000:3.0:1777051362.583326:0:8473:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d951fa1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3677:x1863365452595840:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1777051362.583343:0:8473:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 437657152 pending 0 free 3645853696 avail 3413258240 00000100:00100000:3.0:1777051362.583408:0:8473:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d951fa1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3677:x1863365452595840:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051362.583418:0:8473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5609 00000100:00100000:1.0:1777051362.583508:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94c12b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3677:1863365452595840:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1777051362.585886:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051362.586397:0:6580:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425924992 00000100:00100000:1.0:1777051362.586405:0:6580:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425924992 00000100:00100000:1.0:1777051362.586462:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111924 00000100:00100000:1.0:1777051362.586473:0:6580:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94c12b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+20:134119:x1863365425924992:12345-192.168.201.46@tcp:101:mkdir.0 00010000:00010000:1.0:1777051362.586489:0:6580:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777051362.586512:0:6580:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48a800/0x85f51a6b96715acf lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b614f expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051362.586578:0:6580:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48a600/0x85f51a6b96715ad6 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051362.586598:0:6580:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48a600/0x85f51a6b96715ad6 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051362.586613:0:6580:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48a600/0x85f51a6b96715ad6 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051362.586628:0:6580:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48b000/0x85f51a6b96715add lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xd5:0x0].0xceea225b bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051362.586641:0:6580:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48be00/0x85f51a6b96715a12 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0xd5:0x0].0xceea225b bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b96715a0b expref: 6 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051362.586653:0:6580:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48b000/0x85f51a6b96715add lrc: 4/1,0 mode: --/PR res: [0x200000bd2:0xd5:0x0].0xceea225b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051362.586688:0:6580:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48be00/0x85f51a6b96715a12 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xd5:0x0].0xceea225b bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x85f51a6b96715a0b expref: 6 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051362.586707:0:6580:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7cd9d880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6580:1863365452595968:0@lo:104: 00000100:00100000:1.0:1777051362.586753:0:6580:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051362.586796:0:6580:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d9565d4e40 going to sleep for 11 seconds 00000100:00100000:3.0:1777051362.586838:0:99220:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452595968 00000100:00100000:3.0:1777051362.586846:0:99220:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452595968 00000100:00100000:3.0:1777051362.586896:0:99220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1777051362.586907:0:99220:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7cd9df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:6580:x1863365452595968:12345-0@lo:104: 00010000:00010000:3.0:1777051362.586924:0:99220:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff99da7d784600/0x85f51a6b96715a0b lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xd5:0x0].0xceea225b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x85f51a6b96715a12 expref: -99 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051362.587032:0:99220:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1777051362.587044:0:99220:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7cd9df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:6580:x1863365452595968:12345-0@lo:104: Request processed in 137us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051362.587056:0:99220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00010000:00010000:2.0:1777051362.587063:0:6568:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777051362.587074:0:6568:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff99da7d784600/0x85f51a6b96715a0b lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xd5:0x0].0xceea225b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x85f51a6b96715a12 expref: -99 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.587089:0:6568:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da7d784600 already unused, calling callback (ffffffffc177eed0) 00010000:00010000:2.0:1777051362.587096:0:6568:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff99da7d784600/0x85f51a6b96715a0b lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0xd5:0x0].0xceea225b bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0x85f51a6b96715a12 expref: -99 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051362.587108:0:6580:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7cd9d880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6580:1863365452595968:0@lo:104: 00000004:00010000:2.0:1777051362.587112:0:6568:0:(mdt_handler.c:3963:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff99da7d784600/0x85f51a6b96715a0b lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0xd5:0x0].0xceea225b bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0x85f51a6b96715a12 expref: -99 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.587157:0:6580:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48b000/0x85f51a6b96715add lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xd5:0x0].0xceea225b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.587173:0:6568:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff99da7d784600/0x85f51a6b96715a0b lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0xd5:0x0].0xceea225b bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x85f51a6b96715a12 expref: -99 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.587186:0:6568:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1777051362.587260:0:6568:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff99da7d784600/0x85f51a6b96715a0b lrc: 1/0,0 mode: --/PW res: [0x200000bd2:0xd5:0x0].0xceea225b bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x85f51a6b96715a12 expref: -99 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.587272:0:6568:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff99da7d784600/0x85f51a6b96715a0b lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0xd5:0x0].0xceea225b bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x85f51a6b96715a12 expref: -99 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.587299:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777051362.587303:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777051362.587306:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1777051362.587324:0:3677:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1777051362.587341:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f299180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452596096:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1777051362.587378:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051362.587449:0:6564:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452596096 00000100:00100000:0.0:1777051362.587456:0:6564:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452596096 00010000:00010000:0.0:1777051362.587480:0:6564:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48be00/0x85f51a6b96715a12 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xd5:0x0].0xceea225b bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0x85f51a6b96715a0b expref: 7 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051362.587520:0:6564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3855 00000100:00100000:0.0:1777051362.587530:0:6564:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7cd9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+7:3677:x1863365452596096:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1777051362.587543:0:6564:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000001:00080000:3.0:1777051362.591979:0:103159:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771109 is committed 00010000:00010000:0.0:1777051362.592136:0:6564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48be00/0x85f51a6b96715a12 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0xd5:0x0].0xceea225b bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0x85f51a6b96715a0b expref: 7 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.592153:0:6564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xd5:0x0].0xceea225b (ffff99d94e6b6400) 00010000:00010000:0.0:1777051362.592158:0:6564:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48b000/0x85f51a6b96715add lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xd5:0x0].0xceea225b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.592168:0:6564:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48b000/0x85f51a6b96715add lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xd5:0x0].0xceea225b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.592184:0:6564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48b000/0x85f51a6b96715add lrc: 4/1,0 mode: PR/PR res: [0x200000bd2:0xd5:0x0].0xceea225b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.592243:0:6564:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1777051362.592314:0:6564:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7cd9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+6:3677:x1863365452596096:12345-0@lo:103:ldlm_bl.0 Request processed in 4783us (4933us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051362.592325:0:6564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3855 00010000:00010000:1.0:1777051362.592371:0:6580:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48b000/0x85f51a6b96715add lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xd5:0x0].0xceea225b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051362.592386:0:6580:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48b000/0x85f51a6b96715add lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xd5:0x0].0xceea225b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051362.592498:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f299180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452596096:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1777051362.592531:0:6580:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7cd9f800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6580:1863365452596224:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1777051362.592578:0:6580:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051362.592610:0:6580:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d9565d4e40 going to sleep for 11 seconds 00000100:00100000:0.0:1777051362.592630:0:47208:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452596224 00000100:00100000:0.0:1777051362.592637:0:47208:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452596224 00000100:00100000:0.0:1777051362.592681:0:47208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8119 00000100:00100000:0.0:1777051362.592934:0:47208:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7cd9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+6:6580:x1863365452596224:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1777051362.593055:0:47208:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7cd9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+6:6580:x1863365452596224:12345-0@lo:1000:mdt00_001.0 Request processed in 358us (476us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051362.593066:0:47208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8119 00000100:00100000:1.0:1777051362.593112:0:6580:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7cd9f800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6580:1863365452596224:0@lo:1000:mdt00_001.0 00010000:00010000:1.0:1777051362.593178:0:6580:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48a400/0x85f51a6b96715ae4 lrc: 3/1,0 mode: --/PR res: [0x240000404:0xf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051362.593191:0:6580:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48a400/0x85f51a6b96715ae4 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0xf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051362.593228:0:6580:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48a400/0x85f51a6b96715ae4 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0xf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1777051362.593256:0:6580:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48a400/0x85f51a6b96715ae4 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0xf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051362.593274:0:6580:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48a600/0x85f51a6b96715ad6 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051362.593283:0:6580:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48a600/0x85f51a6b96715ad6 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051362.593292:0:6580:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48a600/0x85f51a6b96715ad6 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051362.593303:0:6580:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48a600/0x85f51a6b96715ad6 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051362.593309:0:6580:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94e48a600 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:1.0:1777051362.593312:0:6580:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48a600/0x85f51a6b96715ad6 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051362.593318:0:6580:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48a600/0x85f51a6b96715ad6 lrc: 5/0,0 mode: CR/CR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051362.593326:0:6580:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xd5:0x0].0x0 (ffff99d9413d2a00) 00010000:00010000:1.0:1777051362.593329:0:6580:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777051362.593332:0:6580:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48a600/0x85f51a6b96715ad6 lrc: 3/0,0 mode: --/CR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051362.593337:0:6580:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48a600/0x85f51a6b96715ad6 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051362.593347:0:6580:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48b000/0x85f51a6b96715add lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xd5:0x0].0xceea225b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051362.593353:0:6580:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48b000/0x85f51a6b96715add lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0xd5:0x0].0xceea225b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051362.593361:0:6580:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48b000/0x85f51a6b96715add lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xd5:0x0].0xceea225b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051362.593369:0:6580:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94e48b000 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:1.0:1777051362.593372:0:6580:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48b000/0x85f51a6b96715add lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xd5:0x0].0xceea225b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051362.593386:0:6580:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48b000/0x85f51a6b96715add lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0xd5:0x0].0xceea225b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051362.593396:0:6580:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xd5:0x0].0xceea225b (ffff99d94e6b6400) 00010000:00010000:1.0:1777051362.593400:0:6580:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777051362.593404:0:6580:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48b000/0x85f51a6b96715add lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0xd5:0x0].0xceea225b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051362.593412:0:6580:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48b000/0x85f51a6b96715add lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xd5:0x0].0xceea225b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051362.593454:0:6580:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48a800/0x85f51a6b96715acf lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b614f expref: 21 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051362.593472:0:6580:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48a400/0x85f51a6b96715ae4 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0xf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b614f expref: 20 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051362.593482:0:6580:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0xf:0x0].0x0 (ffff99d94e6b6700) 00010000:00010000:1.0:1777051362.593485:0:6580:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1777051362.593487:0:6580:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d94e48a400, rc 0) 00000100:00100000:1.0:1777051362.593550:0:6580:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94c12b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+20:134119:x1863365425924992:12345-192.168.201.46@tcp:101:mkdir.0 Request processed in 7078us (7684us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051362.593561:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111924 00000100:00100000:1.0:1777051362.596776:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051362.596832:0:21368:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425925120 00000100:00100000:2.0:1777051362.596839:0:21368:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425925120 00000100:00100000:2.0:1777051362.596886:0:21368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111925 00000100:00100000:2.0:1777051362.596909:0:21368:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7cd9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+7:134119:x1863365425925120:12345-192.168.201.46@tcp:101:mkdir.0 00010000:00010000:2.0:1777051362.596927:0:21368:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051362.596946:0:21368:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d784600/0x85f51a6b96715aeb lrc: 2/0,0 mode: --/CR res: [0x240000404:0xf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6156 expref: -99 pid: 21368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.597001:0:21368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d785600/0x85f51a6b96715af2 lrc: 3/1,0 mode: --/PR res: [0x240000404:0xf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.597044:0:21368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d785600/0x85f51a6b96715af2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0xf:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 21368 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.597063:0:21368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d785600/0x85f51a6b96715af2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0xf:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21368 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1777051362.597113:0:21368:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0xf:0x0]: returning size 4096 00000004:00200000:2.0:1777051362.597118:0:21368:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:2.0:1777051362.597157:0:21368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d784600/0x85f51a6b96715aeb lrc: 0/0,0 mode: --/CR res: [0x240000404:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6156 expref: 9 pid: 21368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.597179:0:21368:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d785600/0x85f51a6b96715af2 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0xf:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6156 expref: 8 pid: 21368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.597190:0:21368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0xf:0x0].0x0 (ffff99d94c159000) 00010000:00010000:2.0:1777051362.597193:0:21368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1777051362.597217:0:21368:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99da7d785600, rc 0) 00000100:00100000:2.0:1777051362.597276:0:21368:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7cd9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+8:134119:x1863365425925120:12345-192.168.201.46@tcp:101:mkdir.0 Request processed in 368us (501us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051362.597287:0:21368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111925 00000100:00100000:0.0:1777051362.607899:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051362.607994:0:46497:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425925248 00000100:00100000:2.0:1777051362.608025:0:46497:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425925248 00000100:00100000:2.0:1777051362.608099:0:46497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111926 00000100:00100000:2.0:1777051362.608113:0:46497:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95fbac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:c11b6966-0775-44d2-bdc6-c74c26eb2226+8:134120:x1863365425925248:12345-192.168.201.46@tcp:101:rm.0 00010000:00010000:2.0:1777051362.608134:0:46497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051362.608158:0:46497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d784600/0x85f51a6b96715af9 lrc: 2/0,0 mode: --/CR res: [0x240000404:0xf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b615d expref: -99 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.608260:0:46497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d784a00/0x85f51a6b96715b00 lrc: 3/1,0 mode: --/CR res: [0x240000404:0xf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.608286:0:46497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d784a00/0x85f51a6b96715b00 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0xf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.608302:0:46497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d784a00/0x85f51a6b96715b00 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0xf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.608321:0:46497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d785200/0x85f51a6b96715b07 lrc: 3/1,0 mode: --/PR res: [0x240000404:0xf:0x0].0xc67b6e72 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.608332:0:46497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d785200/0x85f51a6b96715b07 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0xf:0x0].0xc67b6e72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.608341:0:46497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d785200/0x85f51a6b96715b07 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0xf:0x0].0xc67b6e72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.608412:0:46497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d784a00/0x85f51a6b96715b00 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0xf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.608424:0:46497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d784a00/0x85f51a6b96715b00 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0xf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.608434:0:46497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d784a00/0x85f51a6b96715b00 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0xf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.608442:0:46497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da7d784a00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:2.0:1777051362.608447:0:46497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d784a00/0x85f51a6b96715b00 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0xf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.608457:0:46497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d784a00/0x85f51a6b96715b00 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0xf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.608472:0:46497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0xf:0x0].0x0 (ffff99d94c159000) 00010000:00010000:2.0:1777051362.608477:0:46497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777051362.608483:0:46497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d784a00/0x85f51a6b96715b00 lrc: 2/0,0 mode: --/CR res: [0x240000404:0xf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.608492:0:46497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d784a00/0x85f51a6b96715b00 lrc: 0/0,0 mode: --/CR res: [0x240000404:0xf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.608508:0:46497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d785200/0x85f51a6b96715b07 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0xf:0x0].0xc67b6e72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.608517:0:46497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d785200/0x85f51a6b96715b07 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0xf:0x0].0xc67b6e72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.608526:0:46497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d785200/0x85f51a6b96715b07 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0xf:0x0].0xc67b6e72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.608533:0:46497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da7d785200 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:2.0:1777051362.608538:0:46497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d785200/0x85f51a6b96715b07 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0xf:0x0].0xc67b6e72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.608546:0:46497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d785200/0x85f51a6b96715b07 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0xf:0x0].0xc67b6e72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.608555:0:46497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0xf:0x0].0xc67b6e72 (ffff99d95c19c900) 00010000:00010000:2.0:1777051362.608559:0:46497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777051362.608562:0:46497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d785200/0x85f51a6b96715b07 lrc: 2/0,0 mode: --/PR res: [0x240000404:0xf:0x0].0xc67b6e72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.608570:0:46497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d785200/0x85f51a6b96715b07 lrc: 0/0,0 mode: --/PR res: [0x240000404:0xf:0x0].0xc67b6e72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.608611:0:46497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d784600/0x85f51a6b96715af9 lrc: 1/0,0 mode: --/CR res: [0x240000404:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b615d expref: 9 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.608626:0:46497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0xf:0x0].0x0 (ffff99d94c159000) 00010000:00010000:2.0:1777051362.608629:0:46497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777051362.608634:0:46497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d784600/0x85f51a6b96715af9 lrc: 0/0,0 mode: --/CR res: [0x240000404:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b615d expref: 9 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.608647:0:46497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99da7d784600, rc 0) 00000100:00100000:2.0:1777051362.608715:0:46497:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95fbac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:c11b6966-0775-44d2-bdc6-c74c26eb2226+8:134120:x1863365425925248:12345-192.168.201.46@tcp:101:rm.0 Request processed in 605us (825us total) trans 0 rc 301/301 00000100:00100000:2.0:1777051362.608726:0:46497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111926 00000100:00100000:0.0:1777051362.620355:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051362.620448:0:27885:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425925504 00000100:00100000:2.0:1777051362.620460:0:27885:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425925504 00000100:00100000:2.0:1777051362.620534:0:27885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111927 00000100:00100000:2.0:1777051362.620548:0:27885:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95fbac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c11b6966-0775-44d2-bdc6-c74c26eb2226+8:134121:x1863365425925504:12345-192.168.201.46@tcp:101:dd.0 00010000:00010000:2.0:1777051362.620570:0:27885:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051362.620574:0:27885:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1777051362.620605:0:27885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d785600/0x85f51a6b96715af2 lrc: 0/0,0 mode: --/PR res: [0x240000404:0xf:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6156 expref: 8 pid: 21368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.620633:0:27885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0xf:0x0].0x0 (ffff99d94c159000) 00010000:00010000:2.0:1777051362.620637:0:27885:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1777051362.620651:0:27885:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d784600/0x85f51a6b96715b0e lrc: 2/0,0 mode: --/CW res: [0x240000404:0xf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6164 expref: -99 pid: 27885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.620739:0:27885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d785200/0x85f51a6b96715b15 lrc: 3/0,1 mode: --/CW res: [0x240000404:0xf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.620756:0:27885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d785200/0x85f51a6b96715b15 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 27885 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.620765:0:27885:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d785200/0x85f51a6b96715b15 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 27885 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.620777:0:27885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d784a00/0x85f51a6b96715b1c lrc: 3/0,1 mode: --/PW res: [0x240000404:0xf:0x0].0xc67b6e72 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.620783:0:27885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d784a00/0x85f51a6b96715b1c lrc: 3/0,1 mode: PW/PW res: [0x240000404:0xf:0x0].0xc67b6e72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27885 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.620789:0:27885:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d784a00/0x85f51a6b96715b1c lrc: 3/0,1 mode: PW/PW res: [0x240000404:0xf:0x0].0xc67b6e72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27885 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1777051362.621467:0:27885:0:(osp_internal.h:570:osp_update_last_fid()) Gap in objids: start=[0x2c0000400:0xe4:0x0], count =30 00000004:00080000:2.0:1777051362.621477:0:27885:0:(osp_object.c:1640:osp_create()) Writing gap [0x2c0000400:0xe4:0x0]+30 in llog 00000004:00080000:2.0:1777051362.621499:0:27885:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x102:0x0], index 1: 0 00010000:00010000:2.0:1777051362.621632:0:27885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d785a00/0x85f51a6b96715b23 lrc: 3/1,0 mode: --/PR res: [0x240000405:0xc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.621641:0:27885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d785a00/0x85f51a6b96715b23 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27885 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.621648:0:27885:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d785a00/0x85f51a6b96715b23 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27885 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.621677:0:27885:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d785200/0x85f51a6b96715b15 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 27885 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.621684:0:27885:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d785200/0x85f51a6b96715b15 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 27885 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.621690:0:27885:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d785200/0x85f51a6b96715b15 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 27885 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.621696:0:27885:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d785200/0x85f51a6b96715b15 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 27885 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.621701:0:27885:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da7d785200 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:2.0:1777051362.621704:0:27885:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d785200/0x85f51a6b96715b15 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 27885 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.621710:0:27885:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d785200/0x85f51a6b96715b15 lrc: 5/0,0 mode: CW/CW res: [0x240000404:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 27885 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.621717:0:27885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0xf:0x0].0x0 (ffff99d94c159000) 00010000:00010000:2.0:1777051362.621720:0:27885:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777051362.621723:0:27885:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d785200/0x85f51a6b96715b15 lrc: 3/0,0 mode: --/CW res: [0x240000404:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 27885 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.621728:0:27885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d785200/0x85f51a6b96715b15 lrc: 0/0,0 mode: --/CW res: [0x240000404:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 27885 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1777051362.621738:0:27885:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000cdce3ec5 reply state 000000008164b660 transno 8589934606 ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d784a00/0x85f51a6b96715b1c lrc: 3/0,1 mode: PW/PW res: [0x240000404:0xf:0x0].0xc67b6e72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27885 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.621747:0:27885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d784a00/0x85f51a6b96715b1c lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0xf:0x0].0xc67b6e72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27885 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.621752:0:27885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0xf:0x0].0xc67b6e72 (ffff99d95c19c900) 00010000:00010000:2.0:1777051362.621754:0:27885:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1777051362.621756:0:27885:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1777051362.621778:0:27885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d784600/0x85f51a6b96715b0e lrc: 0/0,0 mode: --/CW res: [0x240000404:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6164 expref: 10 pid: 27885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.621791:0:27885:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d785a00/0x85f51a6b96715b23 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6164 expref: 9 pid: 27885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.621797:0:27885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0xc:0x0].0x0 (ffff99d95c19cb00) 00010000:00010000:2.0:1777051362.621800:0:27885:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1777051362.621802:0:27885:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99da7d785a00, rc 0) 00000100:00100000:2.0:1777051362.621873:0:27885:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95fbac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c11b6966-0775-44d2-bdc6-c74c26eb2226+10:134121:x1863365425925504:12345-192.168.201.46@tcp:101:dd.0 Request processed in 1328us (1775us total) trans 8589934606 rc 0/0 00000100:00100000:2.0:1777051362.621883:0:27885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111927 00000100:00100000:1.0:1777051362.650918:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051362.651079:0:27887:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425925632 00000100:00100000:2.0:1777051362.651091:0:27887:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425925632 00000100:00100000:2.0:1777051362.651158:0:27887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 7979 00000100:00100000:2.0:1777051362.651172:0:27887:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955ebdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c11b6966-0775-44d2-bdc6-c74c26eb2226+49:134121:x1863365425925632:12345-192.168.201.46@tcp:101:dd.0 00010000:00010000:2.0:1777051362.651235:0:27887:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051362.651261:0:27887:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000060c30f6d/0x85f51a6b96715b31 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x102:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b616b expref: -99 pid: 27887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1777051362.651302:0:27887:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x102:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1777051362.651327:0:27887:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777051362.651330:0:27887:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777051362.651341:0:27887:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000060c30f6d/0x85f51a6b96715b31 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x102:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b616b expref: 50 pid: 27887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.651373:0:27887:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000060c30f6d/0x85f51a6b96715b31 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x102:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b616b expref: 50 pid: 27887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.651393:0:27887:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99da7d784600, rc 0) 00000100:00100000:2.0:1777051362.651455:0:27887:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955ebdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c11b6966-0775-44d2-bdc6-c74c26eb2226+50:134121:x1863365425925632:12345-192.168.201.46@tcp:101:dd.0 Request processed in 286us (544us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051362.651465:0:27887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 7979 00000100:00100000:0.0:1777051362.673171:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051362.673280:0:46199:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425925760 00000100:00100000:2.0:1777051362.673293:0:46199:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425925760 00002000:00100000:2.0:1777051362.673349:0:46199:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000400:0x102:0x0] (0->1048575) req@ffff99d95fbaf480 x1863365425925760/t0(0) o4->c11b6966-0775-44d2-bdc6-c74c26eb2226@192.168.201.46@tcp:323/0 lens 488/0 e 0 to 0 dl 1777051373 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1777051362.673389:0:46199:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99d95fbaf480 with x1863365425925760 ext(0->1048575) 00002000:00010000:2.0:1777051362.673398:0:46199:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99d95fbaf480 00000100:00100000:2.0:1777051362.673438:0:46199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 1763 00000100:00100000:2.0:1777051362.673452:0:46199:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95fbaf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:c11b6966-0775-44d2-bdc6-c74c26eb2226+50:2436:x1863365425925760:12345-192.168.201.46@tcp:4:dd.0 00000100:00100000:2.0:1777051362.686475:0:46199:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95fbaf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:c11b6966-0775-44d2-bdc6-c74c26eb2226+52:2436:x1863365425925760:12345-192.168.201.46@tcp:4:dd.0 Request processed in 13015us (13303us total) trans 4294968354 rc 0/0 00000100:00100000:2.0:1777051362.686492:0:46199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 1763 00002000:00100000:2.0:1777051362.686509:0:46199:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000400:0x102:0x0] (0->1048575) req@ffff99d95fbaf480 x1863365425925760/t4294968354(0) o4->c11b6966-0775-44d2-bdc6-c74c26eb2226@192.168.201.46@tcp:323/0 lens 488/448 e 0 to 0 dl 1777051373 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1777051362.686525:0:46199:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99d95fbaf480 with x1863365425925760 ext(0->1048575) 00002000:00010000:2.0:1777051362.686533:0:46199:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99d95fbaf480 00000100:00100000:1.0:1777051362.689372:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051362.689466:0:6579:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425925888 00000100:00100000:0.0:1777051362.689477:0:6579:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425925888 00000100:00100000:0.0:1777051362.689548:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111928 00000100:00100000:0.0:1777051362.689564:0:6579:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955ebce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+10:134121:x1863365425925888:12345-192.168.201.46@tcp:44:dd.0 00000001:00080000:3.0:1777051362.692922:0:104205:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934606 is committed 00000001:00080000:3.0:1777051362.692954:0:104205:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934605 is committed 00000020:00080000:3.0:1777051362.692971:0:104205:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff99da4a170f00 refcount 2 committed 0 result 0 batchid 4294970575 00000020:00080000:3.0:1777051362.692979:0:104205:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff99da43925b00 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff99da4a170b40 00000020:00080000:3.0:1777051362.692985:0:104205:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x2000032e1:0x1:0x0].2 00010000:00010000:0.0:1777051362.692990:0:3664:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d784a00/0x85f51a6b96715b1c lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0xf:0x0].0xc67b6e72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27885 initiator: MDT1 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1777051362.692991:0:104205:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff99da43925800 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff99d95594d600 00000020:00080000:3.0:1777051362.692998:0:104205:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x240000bd0:0x1:0x0].2 00010000:00010000:0.0:1777051362.693039:0:3664:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d784a00/0x85f51a6b96715b1c lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0xf:0x0].0xc67b6e72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 27885 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.693051:0:3664:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d784a00/0x85f51a6b96715b1c lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0xf:0x0].0xc67b6e72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27885 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1777051362.693056:0:104205:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 2 committed 00010000:00010000:0.0:1777051362.693064:0:3664:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da7d784a00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:0.0:1777051362.693073:0:3664:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d784a00/0x85f51a6b96715b1c lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0xf:0x0].0xc67b6e72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27885 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.693085:0:3664:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d784a00/0x85f51a6b96715b1c lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0xf:0x0].0xc67b6e72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 27885 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.693109:0:3664:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0xf:0x0].0xc67b6e72 (ffff99d95c19c900) 00010000:00010000:0.0:1777051362.693115:0:3664:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777051362.693121:0:3664:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d784a00/0x85f51a6b96715b1c lrc: 2/0,0 mode: --/TXN res: [0x240000404:0xf:0x0].0xc67b6e72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27885 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.693132:0:3664:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d784a00/0x85f51a6b96715b1c lrc: 0/0,0 mode: --/TXN res: [0x240000404:0xf:0x0].0xc67b6e72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27885 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051362.693279:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d9533bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452596352:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1777051362.693358:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:1.0:1777051362.693377:0:104230:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 4294970575 committed batchid 4294970574 00000020:00080000:1.0:1777051362.693449:0:104230:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 4294970574 00000100:00100000:0.0:1777051362.693528:0:6579:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955ebce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+8:134121:x1863365425925888:12345-192.168.201.46@tcp:44:dd.0 Request processed in 3966us (4159us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051362.693542:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111928 00000100:00100000:3.0:1777051362.693558:0:27884:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452596352 00000100:00100000:3.0:1777051362.693567:0:27884:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452596352 00000100:00100000:3.0:1777051362.693651:0:27884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7980 00010000:00010000:2.0:1777051362.693657:0:3663:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff99d943eba200/0x85f51a6b9671581a lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0xe:0x0].0x674069f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6580 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051362.693666:0:27884:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7c9a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3679:x1863365452596352:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1777051362.693681:0:3663:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d943eba200/0x85f51a6b9671581a lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0xe:0x0].0x674069f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6580 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.693694:0:3663:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99d943eba200/0x85f51a6b9671581a lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0xe:0x0].0x674069f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6580 initiator: MDT1 lru_score: 0 lru_type: 0 00002000:00080000:3.0:1777051362.693703:0:27884:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:258 count 1 00010000:00010000:2.0:1777051362.693704:0:3663:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d943eba200 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:2.0:1777051362.693713:0:3663:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d943eba200/0x85f51a6b9671581a lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0xe:0x0].0x674069f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6580 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.693727:0:3663:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d943eba200/0x85f51a6b9671581a lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0xe:0x0].0x674069f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6580 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051362.693732:0:27884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c429bca5/0x85f51a6b96715b38 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x102:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 27884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.693747:0:3663:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0xe:0x0].0x674069f9 (ffff99d94e6b6000) 00010000:00010000:2.0:1777051362.693752:0:3663:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777051362.693757:0:3663:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99d943eba200/0x85f51a6b9671581a lrc: 2/0,0 mode: --/TXN res: [0x240000404:0xe:0x0].0x674069f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6580 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.693768:0:3663:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d943eba200/0x85f51a6b9671581a lrc: 0/0,0 mode: --/TXN res: [0x240000404:0xe:0x0].0x674069f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6580 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051362.693772:0:27884:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000854d280c/0x85f51a6b967157cd lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x102:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6061 expref: 50 pid: 55805 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051362.693794:0:27884:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051362.693797:0:27884:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051362.693801:0:27884:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c429bca5/0x85f51a6b96715b38 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x102:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 27884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.693805:0:3663:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d785400/0x85f51a6b96715a19 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0xf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27882 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.693821:0:3663:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d785400/0x85f51a6b96715a19 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0xf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 27882 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.693830:0:3663:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d785400/0x85f51a6b96715a19 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0xf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27882 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.693839:0:3663:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da7d785400 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:3.0:1777051362.693840:0:27884:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000854d280c/0x85f51a6b967157cd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x102:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6061 expref: 50 pid: 55805 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.693844:0:3663:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d785400/0x85f51a6b96715a19 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0xf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27882 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.693866:0:3663:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d785400/0x85f51a6b96715a19 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0xf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 27882 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.693878:0:3663:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0xf:0x0].0x0 (ffff99d94c159000) 00010000:00010000:2.0:1777051362.693882:0:3663:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777051362.693886:0:3663:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d785400/0x85f51a6b96715a19 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0xf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27882 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.693894:0:3663:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d785400/0x85f51a6b96715a19 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0xf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27882 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1777051362.693969:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1777051362.694412:0:27884:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000854d280c/0x85f51a6b967157cd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x102:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6061 expref: 50 pid: 55805 timeout: 8091 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051362.694430:0:27884:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7fdf0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:27884:1863365452596480:192.168.201.46@tcp:104: 00000100:00100000:3.0:1777051362.694505:0:27884:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d95ba609c0 going to sleep for 11 seconds 00000100:00100000:1.0:1777051362.696636:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051362.696703:0:24468:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425926016 00000100:00100000:3.0:1777051362.696710:0:24468:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425926016 00000100:00100000:3.0:1777051362.696749:0:24468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 7981 00000100:00100000:3.0:1777051362.696760:0:24468:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955612680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+52:2437:x1863365425926016:12345-192.168.201.46@tcp:16:dd.0 00000001:00080000:2.0:1777051362.699136:0:9540:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0001: transno 4294968354 is committed 00000100:00100000:1.0:1777051362.699316:0:24468:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955612680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+50:2437:x1863365425926016:12345-192.168.201.46@tcp:16:dd.0 Request processed in 2553us (2676us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051362.699330:0:24468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 7981 00000100:00100000:3.0:1777051362.699369:0:27884:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7fdf0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:27884:1863365452596480:192.168.201.46@tcp:104: 00010000:00010000:3.0:1777051362.699393:0:27884:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c429bca5/0x85f51a6b96715b38 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x102:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 27884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051362.700527:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051362.700619:0:6565:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425926144 00000100:00100000:3.0:1777051362.700639:0:6565:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425926144 00010000:00010000:3.0:1777051362.700673:0:6565:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000854d280c/0x85f51a6b967157cd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x102:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6061 expref: 51 pid: 55805 timeout: 8091 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051362.700972:0:6565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3856 00000100:00100000:3.0:1777051362.700987:0:6565:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955612300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+51:2437:x1863365425926144:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1777051362.701029:0:6565:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777051362.701038:0:6565:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000854d280c/0x85f51a6b967157cd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x102:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6061 expref: 51 pid: 55805 timeout: 8091 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051362.701058:0:6565:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000854d280c/0x85f51a6b967157cd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x102:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6061 expref: 51 pid: 55805 timeout: 8091 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051362.701083:0:6565:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000854d280c/0x85f51a6b967157cd lrc: 0/0,0 mode: --/PR res: [0x280000400:0x102:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6061 expref: 51 pid: 55805 timeout: 8091 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051362.701109:0:6565:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051362.701112:0:6565:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051362.701118:0:6565:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c429bca5/0x85f51a6b96715b38 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x102:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 27884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051362.701130:0:6565:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c429bca5/0x85f51a6b96715b38 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x102:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 27884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051362.702845:0:27884:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c429bca5/0x85f51a6b96715b38 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x102:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 27884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051362.702858:0:27884:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c429bca5/0x85f51a6b96715b38 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x102:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 27884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051362.702873:0:27884:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c429bca5/0x85f51a6b96715b38 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x102:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 27884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051362.702893:0:27884:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c429bca5/0x85f51a6b96715b38 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x102:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 27884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051362.702928:0:27884:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1777051362.702946:0:6565:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1777051362.702988:0:6567:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777051362.703027:0:6567:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c429bca5/0x85f51a6b96715b38 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x102:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 27884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051362.703032:0:6565:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955612300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+50:2437:x1863365425926144:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 2021us (2487us total) trans 0 rc 0/0 00010000:00010000:2.0:1777051362.703057:0:6567:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d95595b800 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:2.0:1777051362.703066:0:6567:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c429bca5/0x85f51a6b96715b38 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x102:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 27884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051362.703066:0:6565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3856 00000100:00100000:0.0:1777051362.703073:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00010000:00010000:2.0:1777051362.703089:0:6567:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c429bca5/0x85f51a6b96715b38 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x102:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 27884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.703112:0:6567:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c429bca5/0x85f51a6b96715b38 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x102:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 27884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051362.703114:0:6583:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425926400 00000100:00100000:0.0:1777051362.703123:0:6583:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425926400 00010000:00010000:2.0:1777051362.703128:0:6567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c429bca5/0x85f51a6b96715b38 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x102:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 27884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.703167:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777051362.703172:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1777051362.703173:0:27884:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7c9a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+6:3679:x1863365452596352:12345-0@lo:6:osp-syn-0-1.0 Request processed in 9508us (9811us total) trans 4294968353 rc 0/0 00010000:00010000:2.0:1777051362.703177:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1777051362.703191:0:27884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7980 00000004:00080000:3.0:1777051362.703220:0:3679:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99d9533bc380/2, rc 0, transno 4294968353 00000100:00100000:0.0:1777051362.703223:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3335 00000100:00100000:0.0:1777051362.703242:0:6583:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7c9a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+8:134121:x1863365425926400:12345-192.168.201.46@tcp:35:dd.0 00000100:00100000:3.0:1777051362.703365:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d9533bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452596352:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1777051362.703526:0:6583:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7c9a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+9:134121:x1863365425926400:12345-192.168.201.46@tcp:35:dd.0 Request processed in 289us (463us total) trans 8589934607 rc 0/0 00000100:00100000:0.0:1777051362.703538:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3335 00000100:00100000:3.0:1777051362.718827:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051362.718915:0:10328:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425926528 00000100:00100000:0.0:1777051362.718926:0:10328:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425926528 00000100:00100000:0.0:1777051362.719033:0:10328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111929 00000100:00100000:0.0:1777051362.719053:0:10328:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fdf0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+20:134122:x1863365425926528:12345-192.168.201.46@tcp:101:lfs.0 00010000:00010000:0.0:1777051362.719077:0:10328:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051362.719101:0:10328:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2800/0x85f51a6b96715b3f lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6172 expref: -99 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.719185:0:10328:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2600/0x85f51a6b96715b46 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.719234:0:10328:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2600/0x85f51a6b96715b46 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.719252:0:10328:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2600/0x85f51a6b96715b46 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.719273:0:10328:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2c00/0x85f51a6b96715b4d lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xd5:0x0].0xceea225b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.719284:0:10328:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2c00/0x85f51a6b96715b4d lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xd5:0x0].0xceea225b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.719294:0:10328:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2c00/0x85f51a6b96715b4d lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xd5:0x0].0xceea225b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.719352:0:10328:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3400/0x85f51a6b96715b54 lrc: 3/1,0 mode: --/PR res: [0x240000404:0xf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.719369:0:10328:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3400/0x85f51a6b96715b54 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0xf:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.719378:0:10328:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3400/0x85f51a6b96715b54 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0xf:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1777051362.719406:0:10328:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3400/0x85f51a6b96715b54 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0xf:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.719422:0:10328:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2600/0x85f51a6b96715b46 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.719432:0:10328:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2600/0x85f51a6b96715b46 lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.719440:0:10328:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2600/0x85f51a6b96715b46 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.719450:0:10328:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2600/0x85f51a6b96715b46 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.719458:0:10328:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d9559a2600 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:0.0:1777051362.719463:0:10328:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2600/0x85f51a6b96715b46 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.719471:0:10328:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2600/0x85f51a6b96715b46 lrc: 5/0,0 mode: CR/CR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.719481:0:10328:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xd5:0x0].0x0 (ffff99d9413d2a00) 00010000:00010000:0.0:1777051362.719484:0:10328:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777051362.719488:0:10328:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2600/0x85f51a6b96715b46 lrc: 3/0,0 mode: --/CR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.719495:0:10328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2600/0x85f51a6b96715b46 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.719509:0:10328:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2c00/0x85f51a6b96715b4d lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xd5:0x0].0xceea225b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.719514:0:10328:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2c00/0x85f51a6b96715b4d lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0xd5:0x0].0xceea225b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.719519:0:10328:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2c00/0x85f51a6b96715b4d lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xd5:0x0].0xceea225b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.719523:0:10328:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d9559a2c00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:0.0:1777051362.719526:0:10328:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2c00/0x85f51a6b96715b4d lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xd5:0x0].0xceea225b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.719530:0:10328:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2c00/0x85f51a6b96715b4d lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0xd5:0x0].0xceea225b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.719536:0:10328:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xd5:0x0].0xceea225b (ffff99d94e81c800) 00010000:00010000:0.0:1777051362.719538:0:10328:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777051362.719540:0:10328:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2c00/0x85f51a6b96715b4d lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0xd5:0x0].0xceea225b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.719544:0:10328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2c00/0x85f51a6b96715b4d lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xd5:0x0].0xceea225b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.719573:0:10328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2800/0x85f51a6b96715b3f lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6172 expref: 22 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.719597:0:10328:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3400/0x85f51a6b96715b54 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0xf:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6172 expref: 21 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.719607:0:10328:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0xf:0x0].0x0 (ffff99d94e6b6700) 00010000:00010000:0.0:1777051362.719611:0:10328:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1777051362.719615:0:10328:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d9559a3400, rc 0) 00000100:00100000:0.0:1777051362.719693:0:10328:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fdf0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+21:134122:x1863365425926528:12345-192.168.201.46@tcp:101:lfs.0 Request processed in 643us (872us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051362.719704:0:10328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111929 00000100:00100000:1.0:1777051362.721891:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051362.722069:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051362.722093:0:46494:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425926656 00000100:00100000:2.0:1777051362.722103:0:46494:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425926656 00000100:00100000:2.0:1777051362.722169:0:46494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111930 00000100:00100000:2.0:1777051362.722190:0:46494:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955610700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c11b6966-0775-44d2-bdc6-c74c26eb2226+9:134122:x1863365425926656:12345-192.168.201.46@tcp:101:lfs.0 00010000:00010000:2.0:1777051362.722249:0:46494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051362.722272:0:46494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d785400/0x85f51a6b96715b5b lrc: 2/0,0 mode: --/CR res: [0x240000404:0xf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6179 expref: -99 pid: 46494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.722328:0:46494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d785600/0x85f51a6b96715b62 lrc: 3/1,0 mode: --/PR res: [0x240000404:0xf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.722343:0:46494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d785600/0x85f51a6b96715b62 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0xf:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 46494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.722356:0:46494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d785600/0x85f51a6b96715b62 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0xf:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 46494 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1777051362.722403:0:46494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0xf:0x0]: returning size 4096 00000004:00200000:2.0:1777051362.722408:0:46494:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:1.0:1777051362.722448:0:6566:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425926784 00010000:00010000:2.0:1777051362.722453:0:46494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d785400/0x85f51a6b96715b5b lrc: 0/0,0 mode: --/CR res: [0x240000404:0xf:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6179 expref: 11 pid: 46494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051362.722457:0:6566:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425926784 00010000:00010000:2.0:1777051362.722485:0:46494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d785600/0x85f51a6b96715b62 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0xf:0x0].0x0 bits 0x10/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6179 expref: 10 pid: 46494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.722505:0:46494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0xf:0x0].0x0 (ffff99d9533a8500) 00010000:00010000:2.0:1777051362.722509:0:46494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:2.0:1777051362.722514:0:46494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99da7d785600, rc 0) 00000100:00100000:1.0:1777051362.722521:0:6566:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13683 00000100:00100000:1.0:1777051362.722537:0:6566:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fdf3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+21:2438:x1863365425926784:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1777051362.722552:0:6566:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1777051362.722573:0:6566:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3400/0x85f51a6b96715b54 lrc: 0/0,0 mode: --/PR res: [0x240000404:0xf:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6172 expref: 21 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051362.722586:0:46494:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955610700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c11b6966-0775-44d2-bdc6-c74c26eb2226+10:134122:x1863365425926656:12345-192.168.201.46@tcp:101:lfs.0 Request processed in 395us (692us total) trans 0 rc 0/0 00010000:00010000:1.0:1777051362.722599:0:6566:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0xf:0x0].0x0 (ffff99d94e6b6700) 00000100:00100000:2.0:1777051362.722601:0:46494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111930 00010000:00010000:1.0:1777051362.722611:0:6566:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1777051362.722655:0:6566:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fdf3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+20:2438:x1863365425926784:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 121us (589us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051362.722668:0:6566:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13683 00000100:00100000:1.0:1777051362.739098:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051362.739469:0:6581:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425926912 00000100:00100000:3.0:1777051362.739481:0:6581:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425926912 00000100:00100000:2.0:1777051362.739627:0:46497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111931 00000100:00100000:2.0:1777051362.739656:0:46497:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955610e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+21:134124:x1863365425926912:12345-192.168.201.46@tcp:101:lfs.0 00010000:00010000:2.0:1777051362.739686:0:46497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051362.739710:0:46497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d785400/0x85f51a6b96715b69 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6180 expref: -99 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.739785:0:46497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d785200/0x85f51a6b96715b70 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.739805:0:46497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d785200/0x85f51a6b96715b70 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.739816:0:46497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d785200/0x85f51a6b96715b70 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.739830:0:46497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784a00/0x85f51a6b96715b77 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xd5:0x0].0xac1bda01 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.739836:0:46497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784a00/0x85f51a6b96715b77 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xd5:0x0].0xac1bda01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.739842:0:46497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784a00/0x85f51a6b96715b77 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xd5:0x0].0xac1bda01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.739946:0:46497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784e00/0x85f51a6b96715b7e lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xd6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.739959:0:46497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784e00/0x85f51a6b96715b7e lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xd6:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.739979:0:46497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784e00/0x85f51a6b96715b7e lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xd6:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1777051362.740051:0:46497:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0xd6:0x0]: returning size 4096 00000004:00200000:2.0:1777051362.740057:0:46497:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1777051362.740084:0:46497:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784e00/0x85f51a6b96715b7e lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xd6:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.740101:0:46497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d785200/0x85f51a6b96715b70 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.740111:0:46497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d785200/0x85f51a6b96715b70 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.740445:0:46497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d785200/0x85f51a6b96715b70 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.740457:0:46497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da7d785200 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:2.0:1777051362.740461:0:46497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d785200/0x85f51a6b96715b70 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.740469:0:46497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d785200/0x85f51a6b96715b70 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.740482:0:46497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xd5:0x0].0x0 (ffff99d9413d2a00) 00010000:00010000:2.0:1777051362.740486:0:46497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777051362.740489:0:46497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d785200/0x85f51a6b96715b70 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.740496:0:46497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d785200/0x85f51a6b96715b70 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.740509:0:46497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784a00/0x85f51a6b96715b77 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xd5:0x0].0xac1bda01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.740514:0:46497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784a00/0x85f51a6b96715b77 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0xd5:0x0].0xac1bda01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.740519:0:46497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784a00/0x85f51a6b96715b77 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xd5:0x0].0xac1bda01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.740524:0:46497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da7d784a00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:2.0:1777051362.740527:0:46497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784a00/0x85f51a6b96715b77 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xd5:0x0].0xac1bda01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.740532:0:46497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784a00/0x85f51a6b96715b77 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0xd5:0x0].0xac1bda01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.740537:0:46497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xd5:0x0].0xac1bda01 (ffff99d9533a8800) 00010000:00010000:2.0:1777051362.740540:0:46497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777051362.740542:0:46497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784a00/0x85f51a6b96715b77 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0xd5:0x0].0xac1bda01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.740546:0:46497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784a00/0x85f51a6b96715b77 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xd5:0x0].0xac1bda01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.740577:0:46497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d785400/0x85f51a6b96715b69 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6180 expref: 23 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.740594:0:46497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784e00/0x85f51a6b96715b7e lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xd6:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6180 expref: 22 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.740605:0:46497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xd6:0x0].0x0 (ffff99d94e81c200) 00010000:00010000:2.0:1777051362.740609:0:46497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1777051362.740612:0:46497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99da7d784e00, rc 0) 00000100:00100000:2.0:1777051362.740685:0:46497:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955610e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+22:134124:x1863365425926912:12345-192.168.201.46@tcp:101:lfs.0 Request processed in 1045us (1596us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051362.740696:0:46497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111931 00000100:00100000:3.0:1777051362.744256:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051362.744312:0:27882:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425927040 00000100:00100000:0.0:1777051362.744322:0:27882:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425927040 00000100:00100000:0.0:1777051362.744367:0:27882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111932 00000100:00100000:0.0:1777051362.744375:0:27882:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fdf0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+22:134124:x1863365425927040:12345-192.168.201.46@tcp:101:lfs.0 00010000:00010000:0.0:1777051362.744387:0:27882:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051362.744399:0:27882:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2800/0x85f51a6b96715b85 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0xd6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6187 expref: -99 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.744441:0:27882:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2c00/0x85f51a6b96715b8c lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0xd6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.744451:0:27882:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2c00/0x85f51a6b96715b8c lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.744460:0:27882:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2c00/0x85f51a6b96715b8c lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.744472:0:27882:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2600/0x85f51a6b96715b93 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xd6:0x0].0xc67b6e72 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.744479:0:27882:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2600/0x85f51a6b96715b93 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xd6:0x0].0xc67b6e72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.744485:0:27882:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2600/0x85f51a6b96715b93 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xd6:0x0].0xc67b6e72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.744544:0:27882:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2a00/0x85f51a6b96715b9a lrc: 3/1,0 mode: --/PR res: [0x200000bd3:0xc5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.744556:0:27882:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2a00/0x85f51a6b96715b9a lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0xc5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.744566:0:27882:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2a00/0x85f51a6b96715b9a lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0xc5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1777051362.744606:0:27882:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd3:0xc5:0x0]: returning size 1048576 00000004:00200000:0.0:1777051362.744610:0:27882:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1777051362.744628:0:27882:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2a00/0x85f51a6b96715b9a lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0xc5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.744651:0:27882:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2a00/0x85f51a6b96715b9a lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0xc5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.744664:0:27882:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2c00/0x85f51a6b96715b8c lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.744672:0:27882:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2c00/0x85f51a6b96715b8c lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.744681:0:27882:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2c00/0x85f51a6b96715b8c lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.744698:0:27882:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2c00/0x85f51a6b96715b8c lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.744707:0:27882:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d9559a2c00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:0.0:1777051362.744712:0:27882:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2c00/0x85f51a6b96715b8c lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.744722:0:27882:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2c00/0x85f51a6b96715b8c lrc: 5/0,0 mode: CR/CR res: [0x200000bd2:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.744735:0:27882:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xd6:0x0].0x0 (ffff99d94e81c200) 00010000:00010000:0.0:1777051362.744739:0:27882:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777051362.744744:0:27882:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2c00/0x85f51a6b96715b8c lrc: 3/0,0 mode: --/CR res: [0x200000bd2:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.744750:0:27882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2c00/0x85f51a6b96715b8c lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.744766:0:27882:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2600/0x85f51a6b96715b93 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xd6:0x0].0xc67b6e72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.745056:0:27882:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2600/0x85f51a6b96715b93 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0xd6:0x0].0xc67b6e72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.745065:0:27882:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2600/0x85f51a6b96715b93 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xd6:0x0].0xc67b6e72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.745073:0:27882:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d9559a2600 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:0.0:1777051362.745078:0:27882:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2600/0x85f51a6b96715b93 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xd6:0x0].0xc67b6e72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.745095:0:27882:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2600/0x85f51a6b96715b93 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0xd6:0x0].0xc67b6e72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.745107:0:27882:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xd6:0x0].0xc67b6e72 (ffff99d94e81c800) 00010000:00010000:0.0:1777051362.745111:0:27882:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777051362.745115:0:27882:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2600/0x85f51a6b96715b93 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0xd6:0x0].0xc67b6e72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.745124:0:27882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2600/0x85f51a6b96715b93 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xd6:0x0].0xc67b6e72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.745169:0:27882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2800/0x85f51a6b96715b85 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6187 expref: 24 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.745187:0:27882:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2a00/0x85f51a6b96715b9a lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0xc5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6187 expref: 23 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.745228:0:27882:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0xc5:0x0].0x0 (ffff99d9533a8b00) 00010000:00010000:0.0:1777051362.745232:0:27882:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1777051362.745236:0:27882:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d9559a2a00, rc 0) 00000100:00100000:0.0:1777051362.745305:0:27882:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fdf0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+23:134124:x1863365425927040:12345-192.168.201.46@tcp:101:lfs.0 Request processed in 927us (1052us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051362.745316:0:27882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111932 00000100:00100000:3.0:1777051362.748456:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051362.748536:0:8470:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425927168 00000100:00100000:0.0:1777051362.748546:0:8470:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425927168 00000100:00100000:0.0:1777051362.748600:0:8470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 7982 00000100:00100000:0.0:1777051362.748610:0:8470:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fdf0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+47:2436:x1863365425927168:12345-192.168.201.46@tcp:101:lfs.0 00010000:00010000:0.0:1777051362.748627:0:8470:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051362.748641:0:8470:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000554aaf12/0x85f51a6b96715ba1 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x1e2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b618e expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051362.748694:0:8470:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7c9a1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8470:1863365452596608:192.168.201.46@tcp:106: 00000100:00100000:0.0:1777051362.748763:0:8470:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d959b89240 going to sleep for 11 seconds 00002000:00010000:0.0:1777051362.752103:0:8470:0:(ofd_lvb.c:259:ofd_lvbo_update()) res: [0x2c0000401:0x1e2:0x0] updating lvb size: 0 -> 1048576 00002000:00010000:0.0:1777051362.752111:0:8470:0:(ofd_lvb.c:265:ofd_lvbo_update()) res: [0x2c0000401:0x1e2:0x0] updating lvb mtime: 0 -> 1777051362 00002000:00010000:0.0:1777051362.752127:0:8470:0:(ofd_lvb.c:271:ofd_lvbo_update()) res: [0x2c0000401:0x1e2:0x0] updating lvb atime: 0 -> 1777051362 00002000:00010000:0.0:1777051362.752129:0:8470:0:(ofd_lvb.c:277:ofd_lvbo_update()) res: [0x2c0000401:0x1e2:0x0] updating lvb ctime: 0 -> 1777051362 00002000:00010000:0.0:1777051362.752132:0:8470:0:(ofd_lvb.c:283:ofd_lvbo_update()) res: [0x2c0000401:0x1e2:0x0] updating lvb blocks: 0 -> 2048 00000100:00100000:0.0:1777051362.752152:0:8470:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7c9a1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8470:1863365452596608:192.168.201.46@tcp:106: 00010000:00010000:0.0:1777051362.752189:0:8470:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000554aaf12/0x85f51a6b96715ba1 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x1e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b618e expref: 48 pid: 8470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.752250:0:8470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000554aaf12/0x85f51a6b96715ba1 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x1e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b618e expref: 48 pid: 8470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.752267:0:8470:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d9559a3800, rc 0) 00000100:00100000:0.0:1777051362.752322:0:8470:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fdf0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+47:2436:x1863365425927168:12345-192.168.201.46@tcp:101:lfs.0 Request processed in 3711us (3867us total) trans 0 rc 301/301 00000100:00100000:0.0:1777051362.752335:0:8470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 7982 00000100:00100000:3.0:1777051362.757109:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051362.757285:0:8492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425927296 00000100:00100000:0.0:1777051362.757296:0:8492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425927296 00000100:00100000:0.0:1777051362.757370:0:8492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111933 00000100:00100000:0.0:1777051362.757383:0:8492:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fdf1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+23:134124:x1863365425927296:12345-192.168.201.46@tcp:101:lfs.0 00010000:00010000:0.0:1777051362.757405:0:8492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051362.757427:0:8492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2800/0x85f51a6b96715ba8 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6195 expref: -99 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.757499:0:8492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2600/0x85f51a6b96715baf lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.757520:0:8492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2600/0x85f51a6b96715baf lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.757535:0:8492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2600/0x85f51a6b96715baf lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.757554:0:8492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2c00/0x85f51a6b96715bb6 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xd5:0x0].0xceea225b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.757564:0:8492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2c00/0x85f51a6b96715bb6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xd5:0x0].0xceea225b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.757574:0:8492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2c00/0x85f51a6b96715bb6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xd5:0x0].0xceea225b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.757629:0:8492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3a00/0x85f51a6b96715bbd lrc: 3/1,0 mode: --/PR res: [0x240000404:0xf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.757642:0:8492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3a00/0x85f51a6b96715bbd lrc: 3/1,0 mode: PR/PR res: [0x240000404:0xf:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.757653:0:8492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3a00/0x85f51a6b96715bbd lrc: 3/1,0 mode: PR/PR res: [0x240000404:0xf:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1777051362.757683:0:8492:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3a00/0x85f51a6b96715bbd lrc: 3/1,0 mode: PR/PR res: [0x240000404:0xf:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.757702:0:8492:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2600/0x85f51a6b96715baf lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.757712:0:8492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2600/0x85f51a6b96715baf lrc: 4/1,0 mode: CR/CR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.757722:0:8492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2600/0x85f51a6b96715baf lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.757732:0:8492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2600/0x85f51a6b96715baf lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.757741:0:8492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d9559a2600 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:0.0:1777051362.757747:0:8492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2600/0x85f51a6b96715baf lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.757758:0:8492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2600/0x85f51a6b96715baf lrc: 5/0,0 mode: CR/CR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.757774:0:8492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xd5:0x0].0x0 (ffff99d9413d2a00) 00010000:00010000:0.0:1777051362.757779:0:8492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777051362.757785:0:8492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2600/0x85f51a6b96715baf lrc: 3/0,0 mode: --/CR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.757796:0:8492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2600/0x85f51a6b96715baf lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.757816:0:8492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2c00/0x85f51a6b96715bb6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xd5:0x0].0xceea225b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.757826:0:8492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2c00/0x85f51a6b96715bb6 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0xd5:0x0].0xceea225b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.757835:0:8492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2c00/0x85f51a6b96715bb6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xd5:0x0].0xceea225b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.757845:0:8492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d9559a2c00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:0.0:1777051362.757850:0:8492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2c00/0x85f51a6b96715bb6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xd5:0x0].0xceea225b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.757860:0:8492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2c00/0x85f51a6b96715bb6 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0xd5:0x0].0xceea225b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.757871:0:8492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xd5:0x0].0xceea225b (ffff99d94e81c800) 00010000:00010000:0.0:1777051362.757875:0:8492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777051362.757879:0:8492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2c00/0x85f51a6b96715bb6 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0xd5:0x0].0xceea225b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.757888:0:8492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2c00/0x85f51a6b96715bb6 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xd5:0x0].0xceea225b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.757930:0:8492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2800/0x85f51a6b96715ba8 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6195 expref: 25 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.757949:0:8492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3a00/0x85f51a6b96715bbd lrc: 3/0,0 mode: PR/PR res: [0x240000404:0xf:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6195 expref: 24 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.757961:0:8492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0xf:0x0].0x0 (ffff99d94e6b6700) 00010000:00010000:0.0:1777051362.757964:0:8492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1777051362.757968:0:8492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d9559a3a00, rc 0) 00000100:00100000:0.0:1777051362.758057:0:8492:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fdf1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+24:134124:x1863365425927296:12345-192.168.201.46@tcp:101:lfs.0 Request processed in 676us (954us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051362.758076:0:8492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111933 00000100:00100000:3.0:1777051362.760839:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051362.760942:0:6580:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425927424 00000100:00100000:1.0:1777051362.760952:0:6580:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425927424 00000100:00100000:1.0:1777051362.761044:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111934 00000100:00100000:1.0:1777051362.761059:0:6580:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fdf1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+48:134124:x1863365425927424:12345-192.168.201.46@tcp:101:lfs.0 00010000:00010000:1.0:1777051362.761083:0:6580:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777051362.761104:0:6580:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e48a800/0x85f51a6b96715bc4 lrc: 2/0,0 mode: --/CR res: [0x240000404:0xf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b619c expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051362.761423:0:6580:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e48be00/0x85f51a6b96715bcb lrc: 3/1,0 mode: --/PR res: [0x240000404:0xf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051362.761440:0:6580:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e48be00/0x85f51a6b96715bcb lrc: 3/1,0 mode: PR/PR res: [0x240000404:0xf:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6580 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051362.761454:0:6580:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e48be00/0x85f51a6b96715bcb lrc: 3/1,0 mode: PR/PR res: [0x240000404:0xf:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6580 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1777051362.761506:0:6580:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0xf:0x0]: returning size 4096 00000004:00200000:1.0:1777051362.761512:0:6580:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:1.0:1777051362.761552:0:6580:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e48a800/0x85f51a6b96715bc4 lrc: 0/0,0 mode: --/CR res: [0x240000404:0xf:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b619c expref: 50 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051362.761576:0:6580:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e48be00/0x85f51a6b96715bcb lrc: 3/0,0 mode: PR/PR res: [0x240000404:0xf:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b619c expref: 49 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051362.761587:0:6580:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0xf:0x0].0x0 (ffff99d9533a8500) 00010000:00010000:1.0:1777051362.761591:0:6580:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:1.0:1777051362.761595:0:6580:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d94e48be00, rc 0) 00000100:00100000:1.0:1777051362.761648:0:6580:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fdf1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+49:134124:x1863365425927424:12345-192.168.201.46@tcp:101:lfs.0 Request processed in 593us (810us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051362.761656:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111934 00000100:00100000:1.0:1777051362.764827:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051362.764906:0:21368:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425927552 00000100:00100000:3.0:1777051362.764913:0:21368:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425927552 00000100:00100000:3.0:1777051362.764960:0:21368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111935 00000100:00100000:3.0:1777051362.764973:0:21368:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955611c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+49:134124:x1863365425927552:12345-192.168.201.46@tcp:101:lfs.0 00010000:00010000:3.0:1777051362.764991:0:21368:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777051362.765039:0:21368:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d95595ae00/0x85f51a6b96715bd2 lrc: 2/0,0 mode: --/CR res: [0x240000404:0xf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b61a3 expref: -99 pid: 21368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051362.765095:0:21368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d95595b600/0x85f51a6b96715bd9 lrc: 3/1,0 mode: --/CR res: [0x240000404:0xf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051362.765107:0:21368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d95595b600/0x85f51a6b96715bd9 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0xf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 21368 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051362.765116:0:21368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d95595b600/0x85f51a6b96715bd9 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0xf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 21368 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051362.765130:0:21368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d95595b800/0x85f51a6b96715be0 lrc: 3/1,0 mode: --/PR res: [0x240000404:0xf:0x0].0xc67b6e72 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051362.765137:0:21368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d95595b800/0x85f51a6b96715be0 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0xf:0x0].0xc67b6e72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21368 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051362.765151:0:21368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d95595b800/0x85f51a6b96715be0 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0xf:0x0].0xc67b6e72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21368 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051362.765274:0:21368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d95595be00/0x85f51a6b96715be7 lrc: 3/1,0 mode: --/PR res: [0x240000405:0xc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051362.765290:0:21368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d95595be00/0x85f51a6b96715be7 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0xc:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21368 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051362.765301:0:21368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d95595be00/0x85f51a6b96715be7 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0xc:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21368 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1777051362.765402:0:21368:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000405:0xc:0x0]: returning size 1048576 00000004:00200000:2.0:1777051362.765409:0:21368:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1777051362.765448:0:21368:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff99d95595be00/0x85f51a6b96715be7 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0xc:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21368 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.765467:0:21368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d95595be00/0x85f51a6b96715be7 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21368 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.765479:0:21368:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d95595b600/0x85f51a6b96715bd9 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0xf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 21368 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.765489:0:21368:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d95595b600/0x85f51a6b96715bd9 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0xf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 21368 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.765500:0:21368:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99d95595b600/0x85f51a6b96715bd9 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0xf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 21368 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.765509:0:21368:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d95595b600 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:2.0:1777051362.765515:0:21368:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d95595b600/0x85f51a6b96715bd9 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0xf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 21368 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.765531:0:21368:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d95595b600/0x85f51a6b96715bd9 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0xf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 21368 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.765547:0:21368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0xf:0x0].0x0 (ffff99d9533a8500) 00010000:00010000:2.0:1777051362.765551:0:21368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777051362.765556:0:21368:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99d95595b600/0x85f51a6b96715bd9 lrc: 2/0,0 mode: --/CR res: [0x240000404:0xf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 21368 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.765565:0:21368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d95595b600/0x85f51a6b96715bd9 lrc: 0/0,0 mode: --/CR res: [0x240000404:0xf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 21368 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.765582:0:21368:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d95595b800/0x85f51a6b96715be0 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0xf:0x0].0xc67b6e72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21368 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.765592:0:21368:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d95595b800/0x85f51a6b96715be0 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0xf:0x0].0xc67b6e72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 21368 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.765601:0:21368:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99d95595b800/0x85f51a6b96715be0 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0xf:0x0].0xc67b6e72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21368 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.765609:0:21368:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d95595b800 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:2.0:1777051362.765613:0:21368:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d95595b800/0x85f51a6b96715be0 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0xf:0x0].0xc67b6e72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21368 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.765622:0:21368:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d95595b800/0x85f51a6b96715be0 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0xf:0x0].0xc67b6e72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 21368 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.765633:0:21368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0xf:0x0].0xc67b6e72 (ffff99d9413d2600) 00010000:00010000:2.0:1777051362.765636:0:21368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777051362.765639:0:21368:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99d95595b800/0x85f51a6b96715be0 lrc: 2/0,0 mode: --/PR res: [0x240000404:0xf:0x0].0xc67b6e72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21368 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.765650:0:21368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d95595b800/0x85f51a6b96715be0 lrc: 0/0,0 mode: --/PR res: [0x240000404:0xf:0x0].0xc67b6e72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21368 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.765680:0:21368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d95595ae00/0x85f51a6b96715bd2 lrc: 0/0,0 mode: --/CR res: [0x240000404:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b61a3 expref: 51 pid: 21368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.765693:0:21368:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99d95595be00/0x85f51a6b96715be7 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b61a3 expref: 50 pid: 21368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.765700:0:21368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0xc:0x0].0x0 (ffff99d95c19cb00) 00010000:00010000:2.0:1777051362.765703:0:21368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1777051362.765705:0:21368:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d95595be00, rc 0) 00000100:00100000:2.0:1777051362.765759:0:21368:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955611c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+50:134124:x1863365425927552:12345-192.168.201.46@tcp:101:lfs.0 Request processed in 788us (932us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051362.765769:0:21368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111935 00000100:00100000:3.0:1777051362.768826:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051362.768946:0:8628:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425927680 00000100:00100000:2.0:1777051362.768956:0:8628:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425927680 00000100:00100000:2.0:1777051362.769033:0:8628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 7983 00000100:00100000:2.0:1777051362.769045:0:8628:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fdf3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+47:2437:x1863365425927680:12345-192.168.201.46@tcp:101:lfs.0 00010000:00010000:2.0:1777051362.769058:0:8628:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051362.769072:0:8628:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c58d8153/0x85f51a6b96715bee lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x102:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b61aa expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051362.769127:0:8628:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f299180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8628:1863365452596736:192.168.201.46@tcp:106: 00000100:00100000:2.0:1777051362.769198:0:8628:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d95744ba80 going to sleep for 11 seconds 00002000:00010000:0.0:1777051362.771545:0:8628:0:(ofd_lvb.c:259:ofd_lvbo_update()) res: [0x2c0000400:0x102:0x0] updating lvb size: 0 -> 1048576 00002000:00010000:0.0:1777051362.771551:0:8628:0:(ofd_lvb.c:265:ofd_lvbo_update()) res: [0x2c0000400:0x102:0x0] updating lvb mtime: 0 -> 1777051362 00002000:00010000:0.0:1777051362.771554:0:8628:0:(ofd_lvb.c:271:ofd_lvbo_update()) res: [0x2c0000400:0x102:0x0] updating lvb atime: 0 -> 1777051362 00002000:00010000:0.0:1777051362.771556:0:8628:0:(ofd_lvb.c:277:ofd_lvbo_update()) res: [0x2c0000400:0x102:0x0] updating lvb ctime: 0 -> 1777051362 00002000:00010000:0.0:1777051362.771558:0:8628:0:(ofd_lvb.c:283:ofd_lvbo_update()) res: [0x2c0000400:0x102:0x0] updating lvb blocks: 0 -> 2048 00000100:00100000:0.0:1777051362.771575:0:8628:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f299180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8628:1863365452596736:192.168.201.46@tcp:106: 00010000:00010000:0.0:1777051362.771605:0:8628:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c58d8153/0x85f51a6b96715bee lrc: 1/0,0 mode: --/PR res: [0x2c0000400:0x102:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b61aa expref: 48 pid: 8628 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.771633:0:8628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c58d8153/0x85f51a6b96715bee lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x102:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b61aa expref: 48 pid: 8628 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.771653:0:8628:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99da7d785400, rc 0) 00000100:00100000:0.0:1777051362.771711:0:8628:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fdf3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+47:2437:x1863365425927680:12345-192.168.201.46@tcp:101:lfs.0 Request processed in 2666us (2886us total) trans 0 rc 301/301 00000100:00100000:0.0:1777051362.771723:0:8628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 7983 00000100:00100000:1.0:1777051362.774745:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051362.774832:0:46497:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425927808 00000100:00100000:2.0:1777051362.774841:0:46497:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425927808 00000100:00100000:2.0:1777051362.774913:0:46497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111936 00000100:00100000:2.0:1777051362.774928:0:46497:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955610000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+24:134124:x1863365425927808:12345-192.168.201.46@tcp:101:lfs.0 00010000:00010000:2.0:1777051362.774947:0:46497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051362.774968:0:46497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784a00/0x85f51a6b96715bf5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b61b1 expref: -99 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.775089:0:46497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d785200/0x85f51a6b96715bfc lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.775108:0:46497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d785200/0x85f51a6b96715bfc lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.775124:0:46497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d785200/0x85f51a6b96715bfc lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1777051362.775169:0:46497:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0xd5:0x0]: returning size 4096 00000004:00200000:2.0:1777051362.775175:0:46497:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1777051362.775530:0:46497:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d785200/0x85f51a6b96715bfc lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.775562:0:46497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784a00/0x85f51a6b96715bf5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b61b1 expref: 26 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.775585:0:46497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d785200/0x85f51a6b96715bfc lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b61b1 expref: 25 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.775596:0:46497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xd5:0x0].0x0 (ffff99d9413d2a00) 00010000:00010000:2.0:1777051362.775601:0:46497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1777051362.775605:0:46497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99da7d785200, rc 0) 00000100:00100000:2.0:1777051362.775662:0:46497:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955610000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+25:134124:x1863365425927808:12345-192.168.201.46@tcp:101:lfs.0 Request processed in 736us (920us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051362.775959:0:46497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111936 00000100:00100000:3.0:1777051362.780295:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051362.780343:0:27885:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425927936 00000100:00100000:2.0:1777051362.780352:0:27885:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425927936 00000100:00100000:2.0:1777051362.780415:0:27885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111937 00000100:00100000:2.0:1777051362.780428:0:27885:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fdf2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+25:134124:x1863365425927936:12345-192.168.201.46@tcp:101:lfs.0 00010000:00010000:2.0:1777051362.780445:0:27885:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051362.780463:0:27885:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d785400/0x85f51a6b96715c03 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b61b8 expref: -99 pid: 27885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.780552:0:27885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d955a90400/0x85f51a6b96715c0a lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xd6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.780567:0:27885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d955a90400/0x85f51a6b96715c0a lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xd6:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.780581:0:27885:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d955a90400/0x85f51a6b96715c0a lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xd6:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1777051362.780614:0:27885:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0xd6:0x0]: returning size 4096 00000004:00200000:2.0:1777051362.780619:0:27885:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1777051362.780636:0:27885:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99d955a90400/0x85f51a6b96715c0a lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xd6:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.780673:0:27885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d785400/0x85f51a6b96715c03 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b61b8 expref: 27 pid: 27885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.780695:0:27885:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d955a90400/0x85f51a6b96715c0a lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xd6:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b61b8 expref: 26 pid: 27885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.780714:0:27885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xd6:0x0].0x0 (ffff99d94e81c200) 00010000:00010000:2.0:1777051362.780717:0:27885:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1777051362.780720:0:27885:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d955a90400, rc 0) 00000100:00100000:2.0:1777051362.780764:0:27885:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fdf2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+26:134124:x1863365425927936:12345-192.168.201.46@tcp:101:lfs.0 Request processed in 339us (474us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051362.780771:0:27885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111937 00000100:00100000:3.0:1777051362.784107:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051362.784444:0:27887:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425928064 00000100:00100000:2.0:1777051362.784453:0:27887:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425928064 00000100:00100000:2.0:1777051362.784509:0:27887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 7984 00000100:00100000:2.0:1777051362.784521:0:27887:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fdf2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+47:2436:x1863365425928064:12345-192.168.201.46@tcp:101:lfs.0 00010000:00010000:2.0:1777051362.784535:0:27887:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051362.784551:0:27887:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b2388768/0x85f51a6b96715c11 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x1e2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b61bf expref: -99 pid: 27887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051362.784614:0:27887:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f299180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:27887:1863365452596864:192.168.201.46@tcp:106: 00000100:00100000:2.0:1777051362.785054:0:27887:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d95744b6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1777051362.788956:0:27887:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f299180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:27887:1863365452596864:192.168.201.46@tcp:106: 00010000:00010000:2.0:1777051362.788995:0:27887:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b2388768/0x85f51a6b96715c11 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x1e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b61bf expref: 48 pid: 27887 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.789054:0:27887:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b2388768/0x85f51a6b96715c11 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x1e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b61bf expref: 48 pid: 27887 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.789072:0:27887:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99da7d784a00, rc 0) 00000100:00100000:2.0:1777051362.789133:0:27887:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fdf2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+47:2436:x1863365425928064:12345-192.168.201.46@tcp:101:lfs.0 Request processed in 4613us (5029us total) trans 0 rc 301/301 00000100:00100000:2.0:1777051362.789145:0:27887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 7984 00000100:00100000:3.0:1777051362.797583:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051362.797697:0:6579:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425928320 00000100:00100000:1.0:1777051362.797709:0:6579:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425928320 00000100:00100000:1.0:1777051362.797785:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111938 00000100:00100000:1.0:1777051362.797801:0:6579:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fdf2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+26:134124:x1863365425928320:12345-192.168.201.46@tcp:58:lfs.0 00000040:00080000:1.0:1777051362.798052:0:6579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2b:0x0].2, 136 off8464 00000100:00100000:1.0:1777051362.798581:0:6579:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fdf2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+26:134124:x1863365425928320:12345-192.168.201.46@tcp:58:lfs.0 Request processed in 780us (1000us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051362.798596:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111938 00000100:00100000:3.0:1777051362.801255:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051362.801378:0:10328:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425928576 00000100:00100000:0.0:1777051362.801387:0:10328:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425928576 00000100:00100000:0.0:1777051362.801445:0:10328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111939 00000100:00100000:0.0:1777051362.801458:0:10328:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fdf1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+50:134124:x1863365425928576:12345-192.168.201.46@tcp:58:lfs.0 00000040:00080000:0.0:1777051362.801584:0:10328:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].2, 136 off8464 00000100:00100000:0.0:1777051362.801972:0:10328:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fdf1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+50:134124:x1863365425928576:12345-192.168.201.46@tcp:58:lfs.0 Request processed in 514us (771us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051362.801985:0:10328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111939 00000040:00080000:0.0:1777051362.967452:0:103189:0:(llog.c:801:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:0.0:1777051362.967464:0:103189:0:(llog_cat.c:158:llog_cat_process_common()) processing log [0x1:0x2b:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1777051362.967505:0:103189:0:(llog.c:858:llog_process_thread()) stop processing plain [0x1:0x2b:0x0] index 3 count 3 00000040:00080000:0.0:1777051362.967517:0:103189:0:(llog.c:858:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00000100:00100000:0.0:1777051362.967839:0:103189:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7c9a1180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:103189:1863365452596992:192.168.201.46@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1777051362.967962:0:103189:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d959b89240 going to sleep for 11 seconds 00000100:00100000:0.0:1777051362.971409:0:103189:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7c9a1180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:103189:1863365452596992:192.168.201.46@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1777051362.972215:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051362.972315:0:46494:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425928704 00000100:00100000:1.0:1777051362.972327:0:46494:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425928704 00000100:00100000:1.0:1777051362.972404:0:46494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111940 00000100:00100000:1.0:1777051362.972421:0:46494:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fdf2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c11b6966-0775-44d2-bdc6-c74c26eb2226+20:134134:x1863365425928704:12345-192.168.201.46@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1777051362.972460:0:46494:0:(mdt_handler.c:7958:mdt_fid2path()) path get [0x200000bd3:0xc5:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1777051362.972592:0:46494:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fdf2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c11b6966-0775-44d2-bdc6-c74c26eb2226+20:134134:x1863365425928704:12345-192.168.201.46@tcp:53:lhsmtool_posix.0 Request processed in 173us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051362.972606:0:46494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111940 00000100:00100000:3.0:1777051362.976385:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051362.976475:0:6581:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425928960 00000100:00100000:2.0:1777051362.976487:0:6581:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425928960 00000100:00100000:2.0:1777051362.976569:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111941 00000100:00100000:2.0:1777051362.976584:0:6581:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95fae9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+20:134134:x1863365425928960:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1777051362.976604:0:6581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051362.976633:0:6581:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784a00/0x85f51a6b96715c18 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b61c6 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.977448:0:6581:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950262600/0x85f51a6b96715c1f lrc: 3/1,0 mode: --/PR res: [0x200000bd3:0xc5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.977471:0:6581:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d950262600/0x85f51a6b96715c1f lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0xc5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.977494:0:6581:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d950262600/0x85f51a6b96715c1f lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0xc5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1777051362.977511:0:6581:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd3:0xc5:0x0]: returning size 1048576 00010000:00010000:2.0:1777051362.977668:0:6581:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784a00/0x85f51a6b96715c18 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b61c6 expref: 23 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.977696:0:6581:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950262600/0x85f51a6b96715c1f lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0xc5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b61c6 expref: 22 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051362.977711:0:6581:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0xc5:0x0].0x0 (ffff99d9533a8b00) 00010000:00010000:2.0:1777051362.977717:0:6581:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1777051362.977724:0:6581:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d950262600, rc 0) 00000100:00100000:2.0:1777051362.977789:0:6581:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95fae9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+22:134134:x1863365425928960:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 Request processed in 1207us (1408us total) trans 30064771110 rc 0/0 00000100:00100000:2.0:1777051362.977804:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111941 00000100:00100000:1.0:1777051362.981358:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051362.981650:0:13320:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425929088 00000100:00100000:3.0:1777051362.981660:0:13320:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425929088 00000100:00100000:3.0:1777051362.981736:0:13320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 7985 00000100:00100000:3.0:1777051362.981753:0:13320:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955612a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+50:2436:x1863365425929088:12345-192.168.201.46@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1777051362.981801:0:13320:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000b457160c/0x85f51a6b96715c2d lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x1e2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051362.981832:0:13320:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007692fab8/0x85f51a6b96715aac lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6141 expref: 50 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051362.981847:0:13320:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1777051362.981851:0:13320:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1777051362.981857:0:13320:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b457160c/0x85f51a6b96715c2d lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x1e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051362.981908:0:13320:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007692fab8/0x85f51a6b96715aac lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6141 expref: 50 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051362.981934:0:13320:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007692fab8/0x85f51a6b96715aac lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6141 expref: 50 pid: 8470 timeout: 8092 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051362.981969:0:13320:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95faebb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:13320:1863365452597120:192.168.201.46@tcp:104: 00000100:00100000:3.0:1777051362.982125:0:13320:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d95ba609c0 going to sleep for 11 seconds 00000100:00100000:3.0:1777051362.984474:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051362.984566:0:47827:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425929216 00000100:00100000:1.0:1777051362.984576:0:47827:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425929216 00000100:00100000:1.0:1777051362.984731:0:47827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13684 00000100:00100000:1.0:1777051362.984747:0:47827:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95fae8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+22:2438:x1863365425929216:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1777051362.984764:0:47827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1777051362.984790:0:47827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d950262600/0x85f51a6b96715c1f lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0xc5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b61c6 expref: 22 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051362.984817:0:47827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0xc5:0x0].0x0 (ffff99d9533a8b00) 00010000:00010000:1.0:1777051362.984827:0:47827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1777051362.984882:0:47827:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95fae8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+21:2438:x1863365425929216:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 139us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051362.984896:0:47827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13684 00000100:00100000:0.0:1777051362.988064:0:13320:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95faebb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:13320:1863365452597120:192.168.201.46@tcp:104: 00010000:00010000:0.0:1777051362.988357:0:13320:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b457160c/0x85f51a6b96715c2d lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x1e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051362.991143:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051362.992545:0:6564:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425929344 00000100:00100000:0.0:1777051362.992555:0:6564:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425929344 00010000:00010000:0.0:1777051362.992598:0:6564:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007692fab8/0x85f51a6b96715aac lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6141 expref: 51 pid: 8470 timeout: 8092 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051362.992649:0:6564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3857 00000100:00100000:0.0:1777051362.992663:0:6564:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955613100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+51:2437:x1863365425929344:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1777051362.992679:0:6564:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777051362.992701:0:6564:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007692fab8/0x85f51a6b96715aac lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6141 expref: 51 pid: 8470 timeout: 8092 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.992717:0:6564:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007692fab8/0x85f51a6b96715aac lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6141 expref: 51 pid: 8470 timeout: 8092 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.992744:0:6564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007692fab8/0x85f51a6b96715aac lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6141 expref: 51 pid: 8470 timeout: 8092 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.992762:0:6564:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777051362.992764:0:6564:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777051362.992770:0:6564:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b457160c/0x85f51a6b96715c2d lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x1e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.992780:0:6564:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b457160c/0x85f51a6b96715c2d lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x1e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051362.992818:0:6564:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1777051362.992860:0:13320:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b457160c/0x85f51a6b96715c2d lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x1e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051362.992881:0:6564:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955613100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+50:2437:x1863365425929344:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 218us (1737us total) trans 0 rc 0/0 00010000:00010000:1.0:1777051362.992883:0:13320:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b457160c/0x85f51a6b96715c2d lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x1e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051362.992907:0:6564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3857 00010000:00010000:1.0:1777051362.992936:0:13320:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000b457160c/0x85f51a6b96715c2d lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x1e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051362.992954:0:13320:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b457160c/0x85f51a6b96715c2d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x1e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051362.992970:0:13320:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b457160c/0x85f51a6b96715c2d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051362.992983:0:13320:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d95595b200 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:1.0:1777051362.992990:0:13320:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b457160c/0x85f51a6b96715c2d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051362.993035:0:13320:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b457160c/0x85f51a6b96715c2d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051362.993058:0:13320:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b457160c/0x85f51a6b96715c2d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x1e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051362.993072:0:13320:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b457160c/0x85f51a6b96715c2d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x1e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051362.993169:0:13320:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955612a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+49:2436:x1863365425929088:12345-192.168.201.46@tcp:1:lhsmtool_posix.0 Request processed in 11418us (11815us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051362.993199:0:13320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 7985 00000100:00100000:1.0:1777051362.995401:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051362.995572:0:27882:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425929600 00000100:00100000:0.0:1777051362.995581:0:27882:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425929600 00000100:00100000:0.0:1777051362.995646:0:27882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111942 00000100:00100000:0.0:1777051362.995660:0:27882:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d943d90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+21:134134:x1863365425929600:12345-192.168.201.46@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1777051362.995773:0:27882:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d943d90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+21:134134:x1863365425929600:12345-192.168.201.46@tcp:57:lhsmtool_posix.0 Request processed in 114us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051362.995786:0:27882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111942 00000100:00100000:3.0:1777051363.000471:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051363.000691:0:27884:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425929728 00000100:00100000:1.0:1777051363.000700:0:27884:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425929728 00000100:00100000:1.0:1777051363.000774:0:27884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 7986 00000100:00100000:1.0:1777051363.000790:0:27884:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95faeaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+49:2439:x1863365425929728:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1777051363.000813:0:27884:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777051363.000837:0:27884:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c82c3fc4/0x85f51a6b96715c34 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x1e2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b61cd expref: -99 pid: 27884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1777051363.000868:0:27884:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x1e2:0x0] initial LVB size: 1048576, mtime: 0x69eba6e2, atime: 0x0, ctime: 0x69eba6e2, blocks: 0x800 00010000:00010000:1.0:1777051363.000891:0:27884:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051363.000894:0:27884:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051363.000903:0:27884:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c82c3fc4/0x85f51a6b96715c34 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b61cd expref: 50 pid: 27884 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051363.000922:0:27884:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c82c3fc4/0x85f51a6b96715c34 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b61cd expref: 50 pid: 27884 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051363.000938:0:27884:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d94e48ac00, rc 0) 00000100:00100000:1.0:1777051363.000992:0:27884:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95faeaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+50:2439:x1863365425929728:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 Request processed in 208us (528us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051363.001041:0:27884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 7986 00000100:00100000:3.0:1777051363.006519:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051363.006802:0:8492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425929984 00000100:00100000:1.0:1777051363.006812:0:8492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425929984 00000100:00100000:1.0:1777051363.006880:0:8492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111943 00000100:00100000:1.0:1777051363.006895:0:8492:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95fae9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+21:134134:x1863365425929984:12345-192.168.201.46@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1777051363.007049:0:8492:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95fae9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+21:134134:x1863365425929984:12345-192.168.201.46@tcp:57:lhsmtool_posix.0 Request processed in 156us (537us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051363.007061:0:8492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111943 00000100:00100000:3.0:1777051363.016122:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051363.016265:0:46205:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425930112 00000100:00100000:0.0:1777051363.016275:0:46205:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425930112 00002000:00100000:0.0:1777051363.016329:0:46205:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x1e2:0x0] (0->1048575) req@ffff99d95faea300 x1863365425930112/t0(0) o3->c11b6966-0775-44d2-bdc6-c74c26eb2226@192.168.201.46@tcp:324/0 lens 488/0 e 0 to 0 dl 1777051374 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1777051363.016347:0:46205:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99d95faea300 with x1863365425930112 ext(0->1048575) 00002000:00010000:0.0:1777051363.016356:0:46205:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99d95faea300 00000100:00100000:0.0:1777051363.016399:0:46205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 1764 00000100:00100000:0.0:1777051363.016412:0:46205:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95faea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:c11b6966-0775-44d2-bdc6-c74c26eb2226+50:2436:x1863365425930112:12345-192.168.201.46@tcp:3:lhsmtool_posix.0 00000100:00100000:0.0:1777051363.037569:0:46205:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95faea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:c11b6966-0775-44d2-bdc6-c74c26eb2226+50:2436:x1863365425930112:12345-192.168.201.46@tcp:3:lhsmtool_posix.0 Request processed in 21148us (21444us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1777051363.037583:0:46205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 1764 00002000:00100000:0.0:1777051363.037598:0:46205:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x1e2:0x0] (0->1048575) req@ffff99d95faea300 x1863365425930112/t0(0) o3->c11b6966-0775-44d2-bdc6-c74c26eb2226@192.168.201.46@tcp:324/0 lens 488/440 e 0 to 0 dl 1777051374 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1777051363.037611:0:46205:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99d95faea300 with x1863365425930112 ext(0->1048575) 00002000:00010000:0.0:1777051363.037619:0:46205:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99d95faea300 00000100:00100000:3.0:1777051363.052872:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051363.053030:0:6580:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425930240 00000100:00100000:1.0:1777051363.053047:0:6580:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425930240 00000100:00100000:1.0:1777051363.053127:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111944 00000100:00100000:1.0:1777051363.053144:0:6580:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95fae8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+21:134134:x1863365425930240:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1777051363.053175:0:6580:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777051363.053255:0:6580:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48a000/0x85f51a6b96715c3b lrc: 2/0,0 mode: --/PR res: [0x200000bd3:0xc5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b61d4 expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051363.053309:0:6580:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48ae00/0x85f51a6b96715c42 lrc: 3/1,0 mode: --/PR res: [0x200000bd3:0xc5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051363.053328:0:6580:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48ae00/0x85f51a6b96715c42 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0xc5:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051363.053341:0:6580:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48ae00/0x85f51a6b96715c42 lrc: 3/1,0 mode: PR/PR res: [0x200000bd3:0xc5:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051363.053517:0:6580:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48a000/0x85f51a6b96715c3b lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0xc5:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b61d4 expref: 23 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051363.053551:0:6580:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48ae00/0x85f51a6b96715c42 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0xc5:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b61d4 expref: 22 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051363.053566:0:6580:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0xc5:0x0].0x0 (ffff99d9533a8b00) 00010000:00010000:1.0:1777051363.053571:0:6580:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1777051363.053577:0:6580:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d94e48ae00, rc 0) 00000100:00100000:1.0:1777051363.053659:0:6580:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95fae8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+22:134134:x1863365425930240:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 Request processed in 517us (798us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051363.053673:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111944 00000100:00100000:3.0:1777051363.059502:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051363.060783:0:46494:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425930368 00000100:00100000:1.0:1777051363.060795:0:46494:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425930368 00000100:00100000:1.0:1777051363.060861:0:46494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111945 00000100:00100000:1.0:1777051363.060873:0:46494:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95fae8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c11b6966-0775-44d2-bdc6-c74c26eb2226+22:134134:x1863365425930368:12345-192.168.201.46@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1777051363.060914:0:46494:0:(mdt_handler.c:7958:mdt_fid2path()) path get [0x200000bd3:0xc5:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1777051363.061136:0:46494:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95fae8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c11b6966-0775-44d2-bdc6-c74c26eb2226+22:134134:x1863365425930368:12345-192.168.201.46@tcp:53:lhsmtool_posix.0 Request processed in 260us (1640us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051363.061150:0:46494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111945 00000100:00100000:3.0:1777051363.065302:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051363.065397:0:8470:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425930496 00000100:00100000:0.0:1777051363.065411:0:8470:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425930496 00000100:00100000:0.0:1777051363.065490:0:8470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 7987 00000100:00100000:0.0:1777051363.065507:0:8470:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95faead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+50:2436:x1863365425930496:12345-192.168.201.46@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1777051363.065561:0:8470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000554aaf12/0x85f51a6b96715c49 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x1e2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051363.065590:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777051363.065594:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777051363.065603:0:8470:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000554aaf12/0x85f51a6b96715c49 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x1e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051363.065627:0:8470:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000554aaf12/0x85f51a6b96715c49 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x1e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051363.065663:0:8470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000554aaf12/0x85f51a6b96715c49 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x1e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051363.065680:0:8470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000554aaf12/0x85f51a6b96715c49 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x1e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051363.065695:0:8470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000554aaf12/0x85f51a6b96715c49 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051363.066058:0:8470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d9559a3800 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:0.0:1777051363.066068:0:8470:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000554aaf12/0x85f51a6b96715c49 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051363.066086:0:8470:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000554aaf12/0x85f51a6b96715c49 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051363.066112:0:8470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000554aaf12/0x85f51a6b96715c49 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x1e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051363.066126:0:8470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000554aaf12/0x85f51a6b96715c49 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x1e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051363.066302:0:8470:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95faead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+50:2436:x1863365425930496:12345-192.168.201.46@tcp:1:lhsmtool_posix.0 Request processed in 794us (1004us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051363.066319:0:8470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 7987 00000100:00100000:2.0:1777051363.069652:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051363.069743:0:46497:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425930752 00000100:00100000:3.0:1777051363.069751:0:46497:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425930752 00000100:00100000:3.0:1777051363.069808:0:46497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111946 00000100:00100000:3.0:1777051363.069824:0:46497:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f299180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:c11b6966-0775-44d2-bdc6-c74c26eb2226+22:134134:x1863365425930752:12345-192.168.201.46@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1777051363.069908:0:46497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6400/0x85f51a6b96715c50 lrc: 3/0,1 mode: --/PW res: [0x200000bd3:0xc5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051363.069935:0:46497:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48ae00/0x85f51a6b96715c42 lrc: 2/0,0 mode: PR/PR res: [0x200000bd3:0xc5:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b61d4 expref: 22 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051363.069948:0:46497:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6400/0x85f51a6b96715c50 lrc: 4/0,1 mode: --/PW res: [0x200000bd3:0xc5:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051363.070043:0:46497:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48ae00/0x85f51a6b96715c42 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0xc5:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b61d4 expref: 22 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051363.070068:0:46497:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48ae00/0x85f51a6b96715c42 lrc: 4/0,0 mode: PR/PR res: [0x200000bd3:0xc5:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b61d4 expref: 22 pid: 6580 timeout: 8092 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051363.070096:0:46497:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95faeb480 pname:cluuid:pid:xid:nid:opc:job mdt00_009:lustre-MDT0000_UUID:46497:1863365452597248:192.168.201.46@tcp:104: 00000100:00100000:3.0:1777051363.070304:0:46497:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d95ba60600 going to sleep for 11 seconds 00000100:00100000:3.0:1777051363.073766:0:46497:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95faeb480 pname:cluuid:pid:xid:nid:opc:job mdt00_009:lustre-MDT0000_UUID:46497:1863365452597248:192.168.201.46@tcp:104: 00010000:00010000:3.0:1777051363.073799:0:46497:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6400/0x85f51a6b96715c50 lrc: 3/0,1 mode: --/PW res: [0x200000bd3:0xc5:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051363.074526:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051363.074647:0:6565:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425930880 00000100:00100000:3.0:1777051363.074658:0:6565:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425930880 00010000:00010000:3.0:1777051363.074695:0:6565:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48ae00/0x85f51a6b96715c42 lrc: 4/0,0 mode: PR/PR res: [0x200000bd3:0xc5:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b61d4 expref: 23 pid: 6580 timeout: 8092 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051363.074815:0:6566:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3858 00000100:00100000:1.0:1777051363.074831:0:6566:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da6fd42050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+23:2436:x1863365425930880:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1777051363.074847:0:6566:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1777051363.074856:0:6566:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48ae00/0x85f51a6b96715c42 lrc: 4/0,0 mode: PR/PR res: [0x200000bd3:0xc5:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b61d4 expref: 23 pid: 6580 timeout: 8092 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051363.074877:0:6566:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48ae00/0x85f51a6b96715c42 lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0xc5:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b61d4 expref: 23 pid: 6580 timeout: 8092 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051363.074920:0:6566:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48ae00/0x85f51a6b96715c42 lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0xc5:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b61d4 expref: 23 pid: 6580 timeout: 8092 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051363.074946:0:6566:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0xc5:0x0].0x0 (ffff99d9533a8b00) 00010000:00010000:1.0:1777051363.074955:0:6566:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6400/0x85f51a6b96715c50 lrc: 3/0,1 mode: --/PW res: [0x200000bd3:0xc5:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051363.074970:0:6566:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6400/0x85f51a6b96715c50 lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0xc5:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051363.074983:0:6566:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6400/0x85f51a6b96715c50 lrc: 4/0,1 mode: PW/PW res: [0x200000bd3:0xc5:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051363.075071:0:6566:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1777051363.075185:0:6566:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da6fd42050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+22:2436:x1863365425930880:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 347us (653us total) trans 0 rc 0/0 00010000:00010000:3.0:1777051363.075186:0:46497:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6400/0x85f51a6b96715c50 lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0xc5:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051363.075210:0:46497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6400/0x85f51a6b96715c50 lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0xc5:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051363.075276:0:6566:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3858 00010000:00010000:3.0:1777051363.075685:0:46497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6400/0x85f51a6b96715c50 lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0xc5:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051363.075702:0:46497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6400/0x85f51a6b96715c50 lrc: 2/0,0 mode: PW/PW res: [0x200000bd3:0xc5:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051363.075715:0:46497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6400/0x85f51a6b96715c50 lrc: 3/0,0 mode: PW/PW res: [0x200000bd3:0xc5:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051363.075727:0:46497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d941ad6400 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:3.0:1777051363.075734:0:46497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6400/0x85f51a6b96715c50 lrc: 3/0,0 mode: PW/PW res: [0x200000bd3:0xc5:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051363.075748:0:46497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6400/0x85f51a6b96715c50 lrc: 4/0,0 mode: PW/PW res: [0x200000bd3:0xc5:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051363.075769:0:46497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0xc5:0x0].0x0 (ffff99d9533a8b00) 00010000:00010000:3.0:1777051363.075777:0:46497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1777051363.075784:0:46497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6400/0x85f51a6b96715c50 lrc: 2/0,0 mode: --/PW res: [0x200000bd3:0xc5:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051363.075796:0:46497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6400/0x85f51a6b96715c50 lrc: 0/0,0 mode: --/PW res: [0x200000bd3:0xc5:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051363.075989:0:46497:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f299180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:c11b6966-0775-44d2-bdc6-c74c26eb2226+22:134134:x1863365425930752:12345-192.168.201.46@tcp:57:lhsmtool_posix.0 Request processed in 6161us (6332us total) trans 30064771111 rc 0/0 00000100:00100000:3.0:1777051363.076041:0:46497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111946 00000040:00080000:1.0:1777051363.076136:0:103189:0:(llog.c:801:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:1.0:1777051363.076144:0:103189:0:(llog_cat.c:158:llog_cat_process_common()) processing log [0x1:0x2b:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1777051363.076176:0:103189:0:(llog.c:858:llog_process_thread()) stop processing plain [0x1:0x2b:0x0] index 3 count 3 00000040:00080000:1.0:1777051363.076187:0:103189:0:(llog.c:858:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00000100:00100000:3.0:1777051363.078235:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051363.078321:0:46501:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425931136 00000100:00100000:1.0:1777051363.078332:0:46501:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425931136 00000100:00100000:1.0:1777051363.078426:0:46501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3336 00000100:00100000:1.0:1777051363.078443:0:46501:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95faeb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+22:134134:x1863365425931136:12345-192.168.201.46@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1777051363.078687:0:46501:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95faeb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+23:134134:x1863365425931136:12345-192.168.201.46@tcp:35:lhsmtool_posix.0 Request processed in 247us (458us total) trans 30064771112 rc 0/0 00000100:00100000:1.0:1777051363.078702:0:46501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3336 00000040:00080000:1.0:1777051363.351038:0:104226:0:(llog.c:801:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1777051363.351049:0:104226:0:(llog_cat.c:158:llog_cat_process_common()) processing log [0x1:0x12:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1777051363.351097:0:104226:0:(llog.c:858:llog_process_thread()) stop processing plain [0x1:0x12:0x0] index 3 count 3 00000040:00080000:1.0:1777051363.351110:0:104226:0:(llog.c:858:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1777051363.351442:0:104226:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d943d91880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0001_UUID:104226:1863365452597376:192.168.201.46@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1777051363.351580:0:104226:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d9565d46c0 going to sleep for 11 seconds 00000100:00100000:1.0:1777051363.357674:0:104226:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d943d91880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0001_UUID:104226:1863365452597376:192.168.201.46@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1777051363.357677:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051363.358765:0:27885:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425931264 00000100:00100000:3.0:1777051363.358778:0:27885:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425931264 00000100:00100000:3.0:1777051363.358875:0:27885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111947 00000100:00100000:3.0:1777051363.358896:0:27885:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7c9a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c11b6966-0775-44d2-bdc6-c74c26eb2226+10:134135:x1863365425931264:12345-192.168.201.46@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1777051363.358940:0:27885:0:(mdt_handler.c:7958:mdt_fid2path()) path get [0x240000405:0xc:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1777051363.359147:0:27885:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7c9a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c11b6966-0775-44d2-bdc6-c74c26eb2226+10:134135:x1863365425931264:12345-192.168.201.46@tcp:53:lhsmtool_posix.0 Request processed in 252us (1473us total) trans 0 rc -66/-66 00000100:00100000:3.0:1777051363.359500:0:27885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111947 00000100:00100000:2.0:1777051363.362533:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051363.362632:0:6579:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425931392 00000100:00100000:0.0:1777051363.362644:0:6579:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425931392 00000100:00100000:0.0:1777051363.363104:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111948 00000100:00100000:0.0:1777051363.363122:0:6579:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da44496680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+23:134135:x1863365425931392:12345-192.168.201.46@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1777051363.363161:0:6579:0:(mdt_handler.c:7958:mdt_fid2path()) path get [0x200000bd2:0xd5:0x0] from 18446744073709551615 #-1 00000100:00100000:0.0:1777051363.363674:0:6579:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da44496680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+23:134135:x1863365425931392:12345-192.168.201.46@tcp:53:lhsmtool_posix.0 Request processed in 555us (1145us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051363.363689:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111948 00000100:00100000:0.0:1777051363.368480:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051363.368700:0:10328:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425931648 00000100:00100000:2.0:1777051363.368713:0:10328:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425931648 00000100:00100000:2.0:1777051363.368794:0:10328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111949 00000100:00100000:2.0:1777051363.368811:0:10328:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7c9a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+10:134135:x1863365425931648:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1777051363.368837:0:10328:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051363.368871:0:10328:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d950263800/0x85f51a6b96715c57 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b61db expref: -99 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051363.369035:0:10328:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d950262200/0x85f51a6b96715c5e lrc: 3/1,0 mode: --/PR res: [0x240000405:0xc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051363.369060:0:10328:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d950262200/0x85f51a6b96715c5e lrc: 3/1,0 mode: PR/PR res: [0x240000405:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10328 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051363.369083:0:10328:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d950262200/0x85f51a6b96715c5e lrc: 3/1,0 mode: PR/PR res: [0x240000405:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10328 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1777051363.369103:0:10328:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000405:0xc:0x0]: returning size 1048576 00010000:00010000:2.0:1777051363.369300:0:10328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d950263800/0x85f51a6b96715c57 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b61db expref: 13 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051363.369340:0:10328:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99d950262200/0x85f51a6b96715c5e lrc: 3/0,0 mode: PR/PR res: [0x240000405:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b61db expref: 12 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051363.369358:0:10328:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0xc:0x0].0x0 (ffff99d95c19cb00) 00010000:00010000:2.0:1777051363.369365:0:10328:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1777051363.369371:0:10328:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d950262200, rc 0) 00000100:00100000:2.0:1777051363.369485:0:10328:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7c9a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+12:134135:x1863365425931648:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 Request processed in 677us (1010us total) trans 8589934608 rc 0/0 00000100:00100000:2.0:1777051363.369497:0:10328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111949 00000100:00100000:2.0:1777051363.372498:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051363.372733:0:47597:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425931776 00000100:00100000:0.0:1777051363.372742:0:47597:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425931776 00000100:00100000:0.0:1777051363.372809:0:47597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13685 00000100:00100000:0.0:1777051363.372827:0:47597:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da44496a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+12:2438:x1863365425931776:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1777051363.372848:0:47597:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777051363.372877:0:47597:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d950262200/0x85f51a6b96715c5e lrc: 0/0,0 mode: --/PR res: [0x240000405:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b61db expref: 12 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051363.372902:0:47597:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0xc:0x0].0x0 (ffff99d95c19cb00) 00010000:00010000:0.0:1777051363.372911:0:47597:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1777051363.373020:0:47597:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da44496a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+11:2438:x1863365425931776:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 166us (493us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051363.373043:0:47597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13685 00000100:00100000:1.0:1777051363.373053:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051363.373120:0:8628:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425931904 00000100:00100000:1.0:1777051363.373130:0:8628:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425931904 00000100:00100000:1.0:1777051363.373211:0:8628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 7988 00000100:00100000:1.0:1777051363.373525:0:8628:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da57c85c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+50:2436:x1863365425931904:12345-192.168.201.46@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1777051363.373577:0:8628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e41ebf46/0x85f51a6b96715c6c lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0x102:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051363.373608:0:8628:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000060c30f6d/0x85f51a6b96715b31 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x102:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b616b expref: 50 pid: 27887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051363.373625:0:8628:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1777051363.373631:0:8628:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1777051363.373637:0:8628:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e41ebf46/0x85f51a6b96715c6c lrc: 4/1,0 mode: --/PR res: [0x2c0000400:0x102:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051363.373688:0:8628:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000060c30f6d/0x85f51a6b96715b31 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x102:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b616b expref: 50 pid: 27887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051363.373714:0:8628:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000060c30f6d/0x85f51a6b96715b31 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x102:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b616b expref: 50 pid: 27887 timeout: 8092 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051363.373738:0:8628:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d943d91880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8628:1863365452597504:192.168.201.46@tcp:104: 00000100:00100000:1.0:1777051363.373859:0:8628:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d9565d46c0 going to sleep for 11 seconds 00000100:00100000:1.0:1777051363.376917:0:8628:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d943d91880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8628:1863365452597504:192.168.201.46@tcp:104: 00010000:00010000:1.0:1777051363.376955:0:8628:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e41ebf46/0x85f51a6b96715c6c lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0x102:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051363.383595:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051363.383977:0:47827:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425932032 00000100:00100000:1.0:1777051363.384018:0:47827:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425932032 00010000:00010000:1.0:1777051363.384074:0:47827:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000060c30f6d/0x85f51a6b96715b31 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x102:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b616b expref: 51 pid: 27887 timeout: 8092 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051363.384141:0:47827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3859 00000100:00100000:1.0:1777051363.384159:0:47827:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7c9a3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+51:2436:x1863365425932032:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1777051363.384184:0:47827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1777051363.384266:0:47827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000060c30f6d/0x85f51a6b96715b31 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x102:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b616b expref: 51 pid: 27887 timeout: 8092 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051363.384296:0:47827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000060c30f6d/0x85f51a6b96715b31 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x102:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b616b expref: 51 pid: 27887 timeout: 8092 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051363.384332:0:47827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000060c30f6d/0x85f51a6b96715b31 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x102:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b616b expref: 51 pid: 27887 timeout: 8092 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051363.384357:0:47827:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051363.384363:0:47827:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051363.384371:0:47827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e41ebf46/0x85f51a6b96715c6c lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0x102:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051363.384388:0:47827:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e41ebf46/0x85f51a6b96715c6c lrc: 4/1,0 mode: PR/PR res: [0x2c0000400:0x102:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051363.384432:0:47827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1777051363.384510:0:47827:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7c9a3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+50:2436:x1863365425932032:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 353us (922us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051363.384533:0:47827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3859 00010000:00010000:1.0:1777051363.384588:0:8628:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e41ebf46/0x85f51a6b96715c6c lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0x102:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051363.384605:0:8628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e41ebf46/0x85f51a6b96715c6c lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0x102:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051363.384637:0:8628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e41ebf46/0x85f51a6b96715c6c lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0x102:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051363.384654:0:8628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e41ebf46/0x85f51a6b96715c6c lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x102:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051363.384668:0:8628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e41ebf46/0x85f51a6b96715c6c lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x102:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051363.384682:0:8628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94e48ae00 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:1.0:1777051363.384691:0:8628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e41ebf46/0x85f51a6b96715c6c lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x102:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051363.384707:0:8628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e41ebf46/0x85f51a6b96715c6c lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x102:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051363.384730:0:8628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e41ebf46/0x85f51a6b96715c6c lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x102:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051363.385103:0:8628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e41ebf46/0x85f51a6b96715c6c lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x102:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051363.385194:0:8628:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da57c85c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+49:2436:x1863365425931904:12345-192.168.201.46@tcp:1:lhsmtool_posix.0 Request processed in 11672us (12155us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051363.385252:0:8628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 7988 00000100:00100000:0.0:1777051363.388859:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051363.388987:0:21368:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425932288 00000100:00100000:1.0:1777051363.389037:0:21368:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425932288 00000100:00100000:1.0:1777051363.389125:0:21368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111950 00000100:00100000:1.0:1777051363.389144:0:21368:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7c9a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+11:134135:x1863365425932288:12345-192.168.201.46@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1777051363.389280:0:21368:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7c9a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+11:134135:x1863365425932288:12345-192.168.201.46@tcp:57:lhsmtool_posix.0 Request processed in 140us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051363.389297:0:21368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111950 00000100:00100000:1.0:1777051363.394210:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051363.394343:0:27887:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425932416 00000100:00100000:0.0:1777051363.394353:0:27887:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425932416 00000100:00100000:0.0:1777051363.394429:0:27887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 7989 00000100:00100000:0.0:1777051363.394454:0:27887:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d943d91880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c11b6966-0775-44d2-bdc6-c74c26eb2226+49:2436:x1863365425932416:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1777051363.394486:0:27887:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051363.394521:0:27887:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009a997f2b/0x85f51a6b96715c73 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x102:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b61e2 expref: -99 pid: 27887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1777051363.394625:0:27887:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x102:0x0] initial LVB size: 1048576, mtime: 0x69eba6e2, atime: 0x0, ctime: 0x69eba6e2, blocks: 0x800 00010000:00010000:1.0:1777051363.394657:0:27887:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051363.394661:0:27887:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051363.394678:0:27887:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009a997f2b/0x85f51a6b96715c73 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x102:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b61e2 expref: 50 pid: 27887 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051363.394715:0:27887:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009a997f2b/0x85f51a6b96715c73 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x102:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b61e2 expref: 50 pid: 27887 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051363.394741:0:27887:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d9559a2000, rc 0) 00000100:00100000:1.0:1777051363.394820:0:27887:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d943d91880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c11b6966-0775-44d2-bdc6-c74c26eb2226+50:2436:x1863365425932416:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 Request processed in 373us (614us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051363.394837:0:27887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 7989 00000100:00100000:0.0:1777051363.402633:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051363.402764:0:6581:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425932672 00000100:00100000:1.0:1777051363.402777:0:6581:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425932672 00000100:00100000:1.0:1777051363.402872:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111951 00000100:00100000:1.0:1777051363.402891:0:6581:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7c9a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+11:134135:x1863365425932672:12345-192.168.201.46@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1777051363.403450:0:6581:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7c9a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+11:134135:x1863365425932672:12345-192.168.201.46@tcp:57:lhsmtool_posix.0 Request processed in 559us (819us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051363.403469:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111951 00010000:00010000:3.0:1777051363.416808:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1777051363.422282:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051363.422417:0:20161:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425932800 00000100:00100000:3.0:1777051363.422433:0:20161:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425932800 00002000:00100000:3.0:1777051363.422508:0:20161:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000400:0x102:0x0] (0->1048575) req@ffff99d943d90a80 x1863365425932800/t0(0) o3->c11b6966-0775-44d2-bdc6-c74c26eb2226@192.168.201.46@tcp:324/0 lens 488/0 e 0 to 0 dl 1777051374 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1777051363.422531:0:20161:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99d943d90a80 with x1863365425932800 ext(0->1048575) 00002000:00010000:3.0:1777051363.422540:0:20161:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99d943d90a80 00000100:00100000:3.0:1777051363.422601:0:20161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 1765 00000100:00100000:3.0:1777051363.422621:0:20161:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d943d90a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+50:2437:x1863365425932800:12345-192.168.201.46@tcp:3:lhsmtool_posix.0 00000100:00100000:3.0:1777051363.444103:0:20161:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d943d90a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+50:2437:x1863365425932800:12345-192.168.201.46@tcp:3:lhsmtool_posix.0 Request processed in 21466us (21813us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1777051363.444132:0:20161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 1765 00002000:00100000:3.0:1777051363.444156:0:20161:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000400:0x102:0x0] (0->1048575) req@ffff99d943d90a80 x1863365425932800/t0(0) o3->c11b6966-0775-44d2-bdc6-c74c26eb2226@192.168.201.46@tcp:324/0 lens 488/440 e 0 to 0 dl 1777051374 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1777051363.444179:0:20161:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99d943d90a80 with x1863365425932800 ext(0->1048575) 00002000:00010000:3.0:1777051363.444191:0:20161:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99d943d90a80 00000100:00100000:1.0:1777051363.476265:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051363.476380:0:27882:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425932928 00000100:00100000:3.0:1777051363.476397:0:27882:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425932928 00000100:00100000:3.0:1777051363.476489:0:27882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111952 00000100:00100000:3.0:1777051363.476505:0:27882:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d943d93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+11:134135:x1863365425932928:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1777051363.476529:0:27882:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777051363.476553:0:27882:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d941ad6400/0x85f51a6b96715c7a lrc: 2/0,0 mode: --/PR res: [0x240000405:0xc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b61e9 expref: -99 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051363.476598:0:27882:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d941ad6e00/0x85f51a6b96715c81 lrc: 3/1,0 mode: --/PR res: [0x240000405:0xc:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051363.476623:0:27882:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d941ad6e00/0x85f51a6b96715c81 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0xc:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 27882 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051363.476652:0:27882:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d941ad6e00/0x85f51a6b96715c81 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0xc:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 27882 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051363.476826:0:27882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d941ad6400/0x85f51a6b96715c7a lrc: 0/0,0 mode: --/PR res: [0x240000405:0xc:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b61e9 expref: 13 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051363.476856:0:27882:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99d941ad6e00/0x85f51a6b96715c81 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0xc:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b61e9 expref: 12 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051363.476867:0:27882:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0xc:0x0].0x0 (ffff99d95c19cb00) 00010000:00010000:3.0:1777051363.476871:0:27882:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1777051363.476876:0:27882:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d941ad6e00, rc 0) 00000100:00100000:3.0:1777051363.476963:0:27882:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d943d93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+12:134135:x1863365425932928:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 Request processed in 461us (707us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051363.476978:0:27882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111952 00000100:00100000:0.0:1777051363.483396:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051363.483513:0:6579:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425933056 00000100:00100000:1.0:1777051363.483525:0:6579:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425933056 00000100:00100000:1.0:1777051363.483610:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111953 00000100:00100000:1.0:1777051363.483629:0:6579:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7c9a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+12:134135:x1863365425933056:12345-192.168.201.46@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1777051363.483665:0:6579:0:(mdt_handler.c:7958:mdt_fid2path()) path get [0x240000405:0xc:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1777051363.483857:0:6579:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7c9a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+12:134135:x1863365425933056:12345-192.168.201.46@tcp:53:lhsmtool_posix.0 Request processed in 231us (467us total) trans 0 rc -66/-66 00000100:00100000:1.0:1777051363.483890:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111953 00000100:00100000:0.0:1777051363.486953:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051363.487067:0:6580:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425933184 00000100:00100000:1.0:1777051363.487077:0:6580:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425933184 00000100:00100000:1.0:1777051363.487158:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111954 00000100:00100000:1.0:1777051363.487171:0:6580:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7c9a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+23:134135:x1863365425933184:12345-192.168.201.46@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1777051363.487203:0:6580:0:(mdt_handler.c:7958:mdt_fid2path()) path get [0x200000bd2:0xd5:0x0] from 18446744073709551615 #-1 00000100:00100000:1.0:1777051363.487307:0:6580:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7c9a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+23:134135:x1863365425933184:12345-192.168.201.46@tcp:53:lhsmtool_posix.0 Request processed in 133us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051363.487348:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111954 00000100:00100000:3.0:1777051363.490691:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051363.490753:0:13320:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425933312 00000100:00100000:1.0:1777051363.490763:0:13320:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425933312 00000100:00100000:1.0:1777051363.490824:0:13320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 7990 00000100:00100000:1.0:1777051363.490840:0:13320:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95fae9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+50:2437:x1863365425933312:12345-192.168.201.46@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1777051363.490905:0:13320:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e41ebf46/0x85f51a6b96715c88 lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0x102:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051363.490933:0:13320:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051363.490937:0:13320:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051363.490946:0:13320:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e41ebf46/0x85f51a6b96715c88 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0x102:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051363.490972:0:13320:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e41ebf46/0x85f51a6b96715c88 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0x102:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051363.491038:0:13320:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e41ebf46/0x85f51a6b96715c88 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0x102:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051363.491055:0:13320:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e41ebf46/0x85f51a6b96715c88 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x102:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051363.491071:0:13320:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e41ebf46/0x85f51a6b96715c88 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x102:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051363.491095:0:13320:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94e48ae00 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:1.0:1777051363.491103:0:13320:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e41ebf46/0x85f51a6b96715c88 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x102:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051363.491119:0:13320:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e41ebf46/0x85f51a6b96715c88 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x102:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051363.491142:0:13320:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e41ebf46/0x85f51a6b96715c88 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x102:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051363.491158:0:13320:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e41ebf46/0x85f51a6b96715c88 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x102:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051363.491284:0:13320:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95fae9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+50:2437:x1863365425933312:12345-192.168.201.46@tcp:1:lhsmtool_posix.0 Request processed in 445us (598us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051363.491302:0:13320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 7990 00000100:00100000:3.0:1777051363.494819:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051363.494908:0:46494:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425933568 00000100:00100000:0.0:1777051363.494919:0:46494:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425933568 00000100:00100000:0.0:1777051363.495034:0:46494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111955 00000100:00100000:0.0:1777051363.495055:0:46494:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95faea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c11b6966-0775-44d2-bdc6-c74c26eb2226+12:134135:x1863365425933568:12345-192.168.201.46@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1777051363.495395:0:46494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94eb2aa00/0x85f51a6b96715c8f lrc: 3/0,1 mode: --/PW res: [0x240000405:0xc:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051363.495424:0:46494:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff99d941ad6e00/0x85f51a6b96715c81 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0xc:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b61e9 expref: 12 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051363.495441:0:46494:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d94eb2aa00/0x85f51a6b96715c8f lrc: 4/0,1 mode: --/PW res: [0x240000405:0xc:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 46494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051363.495492:0:46494:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff99d941ad6e00/0x85f51a6b96715c81 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0xc:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b61e9 expref: 12 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051363.495517:0:46494:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff99d941ad6e00/0x85f51a6b96715c81 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0xc:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b61e9 expref: 12 pid: 27882 timeout: 8092 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051363.495541:0:46494:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7c9a3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_008:lustre-MDT0001_UUID:46494:1863365452597632:192.168.201.46@tcp:104: 00000100:00100000:0.0:1777051363.495735:0:46494:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d95cf51000 going to sleep for 11 seconds 00000100:00100000:3.0:1777051363.499798:0:46494:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7c9a3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_008:lustre-MDT0001_UUID:46494:1863365452597632:192.168.201.46@tcp:104: 00010000:00010000:3.0:1777051363.500429:0:46494:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff99d94eb2aa00/0x85f51a6b96715c8f lrc: 3/0,1 mode: --/PW res: [0x240000405:0xc:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 46494 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051363.500821:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051363.500909:0:6564:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425933696 00000100:00100000:2.0:1777051363.500919:0:6564:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425933696 00010000:00010000:2.0:1777051363.500958:0:6564:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d941ad6e00/0x85f51a6b96715c81 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0xc:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b61e9 expref: 13 pid: 27882 timeout: 8092 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051363.501038:0:6564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3860 00000100:00100000:2.0:1777051363.501053:0:6564:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d943d92300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+13:2436:x1863365425933696:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1777051363.501071:0:6564:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777051363.501082:0:6564:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff99d941ad6e00/0x85f51a6b96715c81 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0xc:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b61e9 expref: 13 pid: 27882 timeout: 8092 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051363.501120:0:6564:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff99d941ad6e00/0x85f51a6b96715c81 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0xc:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b61e9 expref: 13 pid: 27882 timeout: 8092 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051363.501155:0:6564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d941ad6e00/0x85f51a6b96715c81 lrc: 0/0,0 mode: --/PR res: [0x240000405:0xc:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b61e9 expref: 13 pid: 27882 timeout: 8092 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051363.501173:0:6564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0xc:0x0].0x0 (ffff99d95c19cb00) 00010000:00010000:2.0:1777051363.501180:0:6564:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0001_UUID lock: ffff99d94eb2aa00/0x85f51a6b96715c8f lrc: 3/0,1 mode: --/PW res: [0x240000405:0xc:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 46494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051363.501192:0:6564:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff99d94eb2aa00/0x85f51a6b96715c8f lrc: 3/0,1 mode: PW/PW res: [0x240000405:0xc:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 46494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051363.501204:0:6564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d94eb2aa00/0x85f51a6b96715c8f lrc: 4/0,1 mode: PW/PW res: [0x240000405:0xc:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 46494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051363.501247:0:6564:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1777051363.501290:0:46494:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff99d94eb2aa00/0x85f51a6b96715c8f lrc: 3/0,1 mode: PW/PW res: [0x240000405:0xc:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 46494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051363.501308:0:46494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d94eb2aa00/0x85f51a6b96715c8f lrc: 3/0,1 mode: PW/PW res: [0x240000405:0xc:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 46494 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051363.501311:0:6564:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d943d92300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+12:2436:x1863365425933696:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 259us (491us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051363.501337:0:6564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3860 00010000:00010000:2.0:1777051363.501563:0:46494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94eb2aa00/0x85f51a6b96715c8f lrc: 3/0,1 mode: PW/PW res: [0x240000405:0xc:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 46494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051363.501574:0:46494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d94eb2aa00/0x85f51a6b96715c8f lrc: 2/0,0 mode: PW/PW res: [0x240000405:0xc:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 46494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051363.501583:0:46494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99d94eb2aa00/0x85f51a6b96715c8f lrc: 3/0,0 mode: PW/PW res: [0x240000405:0xc:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 46494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051363.501590:0:46494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94eb2aa00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:2.0:1777051363.501595:0:46494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d94eb2aa00/0x85f51a6b96715c8f lrc: 3/0,0 mode: PW/PW res: [0x240000405:0xc:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 46494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051363.501604:0:46494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d94eb2aa00/0x85f51a6b96715c8f lrc: 4/0,0 mode: PW/PW res: [0x240000405:0xc:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 46494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051363.501615:0:46494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0xc:0x0].0x0 (ffff99d95c19cb00) 00010000:00010000:2.0:1777051363.501618:0:46494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1777051363.501622:0:46494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99d94eb2aa00/0x85f51a6b96715c8f lrc: 2/0,0 mode: --/PW res: [0x240000405:0xc:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 46494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051363.501633:0:46494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d94eb2aa00/0x85f51a6b96715c8f lrc: 0/0,0 mode: --/PW res: [0x240000405:0xc:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 46494 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051363.501792:0:46494:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95faea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c11b6966-0775-44d2-bdc6-c74c26eb2226+12:134135:x1863365425933568:12345-192.168.201.46@tcp:57:lhsmtool_posix.0 Request processed in 6744us (6978us total) trans 8589934609 rc 0/0 00000100:00100000:2.0:1777051363.501806:0:46494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111955 00000040:00080000:1.0:1777051363.501875:0:104226:0:(llog.c:801:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1777051363.501883:0:104226:0:(llog_cat.c:158:llog_cat_process_common()) processing log [0x1:0x12:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1777051363.501914:0:104226:0:(llog.c:858:llog_process_thread()) stop processing plain [0x1:0x12:0x0] index 3 count 3 00000040:00080000:1.0:1777051363.501925:0:104226:0:(llog.c:858:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1777051363.506054:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051363.506568:0:6582:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425933952 00000100:00100000:2.0:1777051363.506578:0:6582:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425933952 00000100:00100000:2.0:1777051363.506643:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3337 00000100:00100000:2.0:1777051363.506657:0:6582:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95faeb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+12:134135:x1863365425933952:12345-192.168.201.46@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1777051363.506863:0:6582:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95faeb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+13:134135:x1863365425933952:12345-192.168.201.46@tcp:35:lhsmtool_posix.0 Request processed in 205us (809us total) trans 8589934610 rc 0/0 00000100:00100000:2.0:1777051363.507442:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3337 00000040:00080000:2.0:1777051363.551055:0:105549:0:(llog.c:801:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:2.0:1777051363.551068:0:105549:0:(llog_cat.c:158:llog_cat_process_common()) processing log [0x1:0x2b:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1777051363.551115:0:105549:0:(llog.c:858:llog_process_thread()) stop processing plain [0x1:0x2b:0x0] index 3 count 3 00000040:00080000:2.0:1777051363.551126:0:105549:0:(llog.c:858:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00000040:00080000:1.0:1777051364.305039:0:105600:0:(llog.c:801:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1777051364.305052:0:105600:0:(llog_cat.c:158:llog_cat_process_common()) processing log [0x1:0x12:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1777051364.305100:0:105600:0:(llog.c:858:llog_process_thread()) stop processing plain [0x1:0x12:0x0] index 3 count 3 00000040:00080000:1.0:1777051364.305110:0:105600:0:(llog.c:858:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:2.0:1777051364.439040:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1777051365.142574:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7c9a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3680:1863365452597760:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1777051365.142685:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051365.143062:0:46500:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452597760 00000100:00100000:0.0:1777051365.143077:0:46500:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452597760 00000100:00100000:0.0:1777051365.143181:0:46500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8120 00000100:00100000:0.0:1777051365.143229:0:46500:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da44494000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+6:3680:x1863365452597760:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1777051365.143284:0:46500:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4194304 pending 0 free 1441574912 avail 1295335424 00000100:00100000:0.0:1777051365.143369:0:46500:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da44494000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+6:3680:x1863365452597760:12345-0@lo:41:osp-pre-0-1.0 Request processed in 175us (683us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051365.143381:0:46500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8120 00000100:00100000:1.0:1777051365.143426:0:3680:0:(client.c:3101:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 30064771107 gen 2 00000004:00080000:1.0:1777051365.143436:0:3680:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 30064771107 committed transno 30064771107 00000020:00080000:1.0:1777051365.143446:0:3680:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff99da70a7db40 refcount 2 committed 0 result 0 batchid 4294970576 00000020:00080000:1.0:1777051365.143453:0:3680:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff99da5fa92a00 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff99da7ff82000 00000020:00080000:1.0:1777051365.143458:0:3680:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x2000032e1:0x1:0x0].3 00000020:00080000:1.0:1777051365.143462:0:3680:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff99da5fa92b00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff99d9428ef800 00000020:00080000:1.0:1777051365.143466:0:3680:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x240000bd0:0x1:0x0].3 00000100:00100000:1.0:1777051365.143532:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7c9a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3680:1863365452597760:0@lo:41:osp-pre-0-1.0 00000020:00080000:3.0:1777051365.143560:0:104230:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 4294970576 committed batchid 4294970574 00000020:00080000:3.0:1777051365.143653:0:104230:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 4294970574 00010000:00010000:3.0:1777051365.463422:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1777051365.655470:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95fae9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3677:1863365452597888:0@lo:400:kworker.0 00000100:00100000:0.0:1777051365.655488:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95fae9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3678:1863365452598016:0@lo:400:kworker.0 00000100:00100000:2.0:1777051365.655606:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051365.655615:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051365.655653:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95fae8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3679:1863365452598144:0@lo:400:kworker.0 00000100:00100000:3.0:1777051365.655680:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95faeaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3680:1863365452598272:0@lo:400:kworker.0 00000100:00100000:1.0:1777051365.655722:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051365.655733:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95fae8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3678:1863365452598528:0@lo:400:kworker.0 00000100:00100000:2.0:1777051365.655758:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95faead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3677:1863365452598400:0@lo:400:kworker.0 00000100:00100000:3.0:1777051365.655759:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051365.655772:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95faebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452598656:0@lo:400:kworker.0 00000100:00100000:0.0:1777051365.655799:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051365.655821:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7fd63100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3680:1863365452598784:0@lo:400:kworker.0 00000100:00100000:0.0:1777051365.655849:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7fd60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452599040:0@lo:400:kworker.0 00000100:00100000:2.0:1777051365.655852:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051365.655854:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051365.655901:0:27882:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452598016 00000100:00100000:3.0:1777051365.655914:0:27882:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452598016 00000100:00100000:1.0:1777051365.655922:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7fd61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452599168:0@lo:400:kworker.0 00000100:00100000:2.0:1777051365.655933:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7fd60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3677:1863365452598912:0@lo:400:kworker.0 00000100:00100000:0.0:1777051365.655934:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051365.656013:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051365.656037:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051365.656103:0:46497:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452598144 00000100:00100000:3.0:1777051365.656105:0:27882:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452598272 00000100:00100000:0.0:1777051365.656111:0:46497:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452598144 00000100:00100000:3.0:1777051365.656115:0:27882:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452598272 00000100:00100000:2.0:1777051365.656138:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d943d91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3677:1863365452599424:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1777051365.656469:0:103169:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452597888 00000100:00100000:1.0:1777051365.656478:0:103169:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452597888 00000100:00100000:3.0:1777051365.656501:0:27882:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452598400 00000100:00100000:3.0:1777051365.656511:0:27882:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452598400 00000100:00100000:0.0:1777051365.656515:0:46497:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452598912 00000100:00100000:0.0:1777051365.656525:0:46497:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452598912 00000100:00100000:2.0:1777051365.656532:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051365.656553:0:103169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1777051365.656575:0:103169:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f3dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f9351a01-5b0e-4470-97fd-58b9b4b312a2+23:3677:x1863365452597888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051365.656583:0:27882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13267 00000100:00100000:0.0:1777051365.656596:0:46497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13268 00000100:00100000:3.0:1777051365.656604:0:27882:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7c9a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0000_UUID+5:3678:x1863365452598016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777051365.656614:0:46494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13269 00000100:00100000:0.0:1777051365.656622:0:46497:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d943d91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:lustre-MDT0001-lwp-OST0000_UUID+5:3679:x1863365452598144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777051365.656637:0:46494:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fd61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000-lwp-OST0001_UUID+5:3680:x1863365452598272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777051365.656685:0:103169:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f3dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f9351a01-5b0e-4470-97fd-58b9b4b312a2+23:3677:x1863365452597888:12345-0@lo:400:kworker.0 Request processed in 115us (1081us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051365.656697:0:103169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1777051365.656708:0:27882:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7c9a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0000_UUID+5:3678:x1863365452598016:12345-0@lo:400:kworker.0 Request processed in 108us (1095us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051365.656722:0:27882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13267 00000100:00100000:2.0:1777051365.656731:0:46494:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fd61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000-lwp-OST0001_UUID+5:3680:x1863365452598272:12345-0@lo:400:kworker.0 Request processed in 98us (974us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051365.656744:0:46497:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d943d91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:lustre-MDT0001-lwp-OST0000_UUID+5:3679:x1863365452598144:12345-0@lo:400:kworker.0 Request processed in 127us (1017us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051365.656753:0:46494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13269 00000100:00100000:3.0:1777051365.656766:0:27882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13270 00000100:00100000:0.0:1777051365.656777:0:46497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13268 00000100:00100000:3.0:1777051365.656786:0:27882:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da44495500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0001_UUID+5:3677:x1863365452598400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777051365.656791:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13271 00000100:00100000:1.0:1777051365.656811:0:6581:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da44497800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3677:x1863365452598912:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1777051365.656818:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1777051365.656828:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1777051365.656855:0:8470:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452598656 00000100:00100000:0.0:1777051365.656861:0:8470:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452598656 00000100:00100000:3.0:1777051365.656863:0:27882:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da44495500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0001_UUID+5:3677:x1863365452598400:12345-0@lo:400:kworker.0 Request processed in 83us (1018us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051365.656878:0:27882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13270 00000100:00100000:1.0:1777051365.656890:0:6581:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da44497800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3677:x1863365452598912:12345-0@lo:400:kworker.0 Request processed in 79us (853us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051365.656902:0:8468:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452599040 00000100:00100000:1.0:1777051365.656910:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13271 00000100:00100000:2.0:1777051365.656913:0:8468:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452599040 00000100:00100000:0.0:1777051365.656920:0:8470:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452599168 00000100:00100000:0.0:1777051365.656927:0:8470:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452599168 00000100:00100000:3.0:1777051365.656980:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051365.657014:0:8468:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452598784 00000100:00100000:2.0:1777051365.657022:0:8468:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452598784 00000100:00100000:0.0:1777051365.657028:0:8470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10335 00000100:00100000:3.0:1777051365.657042:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7fd62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3680:1863365452599296:0@lo:400:kworker.0 00000100:00100000:0.0:1777051365.657049:0:8470:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d943d92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3679:x1863365452598656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777051365.657060:0:27887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10336 00000100:00100000:1.0:1777051365.657081:0:27887:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7c9a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+6:3678:x1863365452599040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777051365.657088:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10337 00000100:00100000:2.0:1777051365.657115:0:8468:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d943d92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3679:x1863365452599168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051365.657120:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051365.657131:0:8470:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d943d92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3679:x1863365452598656:12345-0@lo:400:kworker.0 Request processed in 85us (1278us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051365.657143:0:8470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10335 00000100:00100000:0.0:1777051365.657224:0:8470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10338 00000100:00100000:0.0:1777051365.657235:0:8470:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fd63800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3680:x1863365452598784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777051365.657240:0:27887:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7c9a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+6:3678:x1863365452599040:12345-0@lo:400:kworker.0 Request processed in 121us (1268us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051365.657256:0:27887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10336 00000100:00100000:3.0:1777051365.657283:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95faeaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3680:1863365452598272:0@lo:400:kworker.0 00000100:00100000:2.0:1777051365.657290:0:8468:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d943d92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3679:x1863365452599168:12345-0@lo:400:kworker.0 Request processed in 182us (1274us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051365.657299:0:8470:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fd63800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3680:x1863365452598784:12345-0@lo:400:kworker.0 Request processed in 62us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051365.657320:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10337 00000100:00100000:0.0:1777051365.657330:0:8470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10338 00000100:00100000:3.0:1777051365.657336:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7fd63100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3680:1863365452598784:0@lo:400:kworker.0 00000100:00100000:1.0:1777051365.657358:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7fd60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452599040:0@lo:400:kworker.0 00000100:00100000:2.0:1777051365.657375:0:27885:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452599296 00000100:00100000:0.0:1777051365.657382:0:46498:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452598528 00000100:00100000:2.0:1777051365.657383:0:27885:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452599296 00000100:00100000:0.0:1777051365.657389:0:46498:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452598528 00000100:00100000:1.0:1777051365.657392:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95fae9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3678:1863365452598016:0@lo:400:kworker.0 00000100:00100000:0.0:1777051365.657452:0:46498:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452599424 00000100:00100000:3.0:1777051365.657455:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95fae8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3679:1863365452598144:0@lo:400:kworker.0 00000100:00100000:0.0:1777051365.657458:0:46498:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452599424 00000100:00100000:2.0:1777051365.657459:0:27885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13272 00000100:00080000:1.0:1777051365.657474:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1777051365.657484:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1777051365.657487:0:27885:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fd62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000-lwp-MDT0001_UUID+5:3680:x1863365452599296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051365.657489:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95faebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452598656:0@lo:400:kworker.0 00000100:00100000:0.0:1777051365.657503:0:46498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8121 00000100:00100000:0.0:1777051365.657517:0:46498:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7c9a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+7:3678:x1863365452598528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051365.657520:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7fd61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452599168:0@lo:400:kworker.0 00000100:00100000:1.0:1777051365.657534:0:11727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8122 00000100:00100000:1.0:1777051365.657554:0:11727:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da6ff7f850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:3677:x1863365452599424:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1777051365.657585:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95faead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3677:1863365452598400:0@lo:400:kworker.0 00000004:00000024:1.0:1777051365.657601:0:11727:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4194304 pending 0 free 1446150144 avail 1299910656 00000100:00100000:2.0:1777051365.657603:0:27885:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fd62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000-lwp-MDT0001_UUID+5:3680:x1863365452599296:12345-0@lo:400:kworker.0 Request processed in 123us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051365.657604:0:46498:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7c9a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+7:3678:x1863365452598528:12345-0@lo:400:kworker.0 Request processed in 89us (1805us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051365.657615:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7fd60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3677:1863365452598912:0@lo:400:kworker.0 00000100:00100000:0.0:1777051365.657628:0:46498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8121 00000100:00100000:2.0:1777051365.657634:0:27885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13272 00000100:00100000:3.0:1777051365.657652:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95fae9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3677:1863365452597888:0@lo:400:kworker.0 00000100:00100000:1.0:1777051365.657684:0:11727:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da6ff7f850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3677:x1863365452599424:12345-0@lo:41:osp-pre-1-0.0 Request processed in 135us (1153us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051365.657698:0:11727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8122 00000100:00100000:0.0:1777051365.657711:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95fae8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3678:1863365452598528:0@lo:400:kworker.0 00000100:00100000:3.0:1777051365.657724:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d943d91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3677:1863365452599424:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1777051365.657741:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7fd62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3680:1863365452599296:0@lo:400:kworker.0 00000100:00100000:0.0:1777051366.169026:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7fd60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452599552:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1777051366.169028:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da44495880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452599680:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1777051366.169157:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051366.169297:0:8472:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452599680 00000100:00100000:2.0:1777051366.169312:0:8472:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452599680 00000100:00100000:2.0:1777051366.169400:0:8472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5610 00000100:00100000:2.0:1777051366.169417:0:8472:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fd61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3679:x1863365452599680:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1777051366.169472:0:8472:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 455081536 pending 0 free 3862671360 avail 3631149056 00000100:00100000:0.0:1777051366.169474:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051366.169534:0:8473:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452599552 00000100:00100000:3.0:1777051366.169551:0:8473:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452599552 00000100:00100000:2.0:1777051366.169585:0:8472:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fd61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3679:x1863365452599680:12345-0@lo:13:osp-pre-0-1.0 Request processed in 169us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051366.169601:0:8472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5610 00000100:00100000:3.0:1777051366.169615:0:8473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5611 00000100:00100000:3.0:1777051366.169631:0:8473:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7c9a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3678:x1863365452599552:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1777051366.169643:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da44495880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452599680:0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1777051366.169667:0:8473:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 445021760 pending 0 free 3643756544 avail 3412234240 00000100:00100000:3.0:1777051366.169740:0:8473:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7c9a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3678:x1863365452599552:12345-0@lo:13:osp-pre-1-1.0 Request processed in 111us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051366.169755:0:8473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5611 00000100:00100000:0.0:1777051366.170105:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7fd60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452599552:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1777051366.487469:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1777051367.192276:0:103189:0:(llog.c:801:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:0.0:1777051367.192286:0:103189:0:(llog_cat.c:158:llog_cat_process_common()) processing log [0x1:0x2b:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1777051367.192314:0:103189:0:(llog.c:858:llog_process_thread()) stop processing plain [0x1:0x2b:0x0] index 3 count 3 00000040:00080000:0.0:1777051367.192326:0:103189:0:(llog.c:858:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00000100:00100000:3.0:1777051367.330615:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051367.330690:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051367.330738:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051367.330827:0:21368:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425934336 00000100:00100000:2.0:1777051367.330843:0:21368:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425934336 00000100:00100000:3.0:1777051367.330911:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051367.331050:0:103165:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425934080 00000100:00100000:0.0:1777051367.331059:0:103165:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425934080 00000100:00100000:0.0:1777051367.331119:0:103165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 154 00000100:00100000:0.0:1777051367.331134:0:103165:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f3dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29c4352d-3260-4734-909d-9ea5de9e7fa4+12:2438:x1863365425934080:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:0.0:1777051367.331285:0:103165:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f3dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29c4352d-3260-4734-909d-9ea5de9e7fa4+12:2438:x1863365425934080:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 153us (681us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051367.331298:0:103165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 154 00000100:00080000:0.0:1777051367.331374:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1777051367.331684:0:13320:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425934592 00000100:00100000:1.0:1777051367.331693:0:13320:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425934592 00000100:00100000:3.0:1777051367.331708:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051367.331765:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051367.331767:0:13320:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425935104 00000100:00100000:1.0:1777051367.331775:0:13320:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425935104 00000100:00100000:1.0:1777051367.331817:0:13320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10339 00000100:00100000:1.0:1777051367.331829:0:13320:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fd60700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+50:2438:x1863365425934592:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:1.0:1777051367.331889:0:13320:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fd60700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+50:2438:x1863365425934592:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 61us (1151us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051367.331900:0:13320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10339 00000100:00100000:1.0:1777051367.331924:0:13320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10340 00000100:00100000:0.0:1777051367.331976:0:6579:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425934848 00000100:00100000:0.0:1777051367.331983:0:6579:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425934848 00000100:00100000:2.0:1777051367.332008:0:21368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13273 00000100:00100000:2.0:1777051367.332031:0:21368:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fd63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+13:2438:x1863365425934336:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:0.0:1777051367.332045:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13274 00000100:00100000:0.0:1777051367.332061:0:6579:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fd61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+50:2438:x1863365425934848:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:2.0:1777051367.332105:0:21368:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fd63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+13:2438:x1863365425934336:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 79us (1410us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051367.332121:0:21368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13273 00000100:00100000:0.0:1777051367.332127:0:6579:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fd61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+50:2438:x1863365425934848:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 64us (1213us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051367.332142:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13274 00000100:00080000:0.0:1777051367.332176:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1777051367.332180:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1777051367.332455:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051367.332496:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051367.332569:0:24468:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425934464 00000100:00100000:0.0:1777051367.332575:0:24468:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425934464 00000100:00100000:3.0:1777051367.332592:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051367.332644:0:8468:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425934976 00000100:00100000:3.0:1777051367.332662:0:8468:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425934976 00000100:00100000:1.0:1777051367.332671:0:13320:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fd62d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+47:2438:x1863365425935104:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:1.0:1777051367.332735:0:13320:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fd62d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+47:2438:x1863365425935104:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 71us (1030us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051367.332742:0:8628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10341 00000100:00100000:2.0:1777051367.332770:0:8628:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fd62300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+50:2438:x1863365425934976:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:1.0:1777051367.332772:0:13320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10340 00000100:00100000:2.0:1777051367.332838:0:8628:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fd62300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+50:2438:x1863365425934976:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 74us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051367.332841:0:6581:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425934208 00000100:00100000:1.0:1777051367.332850:0:6581:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425934208 00000100:00100000:2.0:1777051367.332859:0:8628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10341 00000100:00100000:1.0:1777051367.332896:0:6581:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425934720 00000100:00100000:1.0:1777051367.332903:0:6581:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425934720 00000100:00100000:1.0:1777051367.332973:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13275 00000100:00100000:1.0:1777051367.332984:0:6581:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fd61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+23:2438:x1863365425934208:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:2.0:1777051367.333026:0:27885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13276 00000100:00100000:1.0:1777051367.333043:0:6581:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fd61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+23:2438:x1863365425934208:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 57us (1279us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051367.333053:0:27885:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fd60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+26:2438:x1863365425934720:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:1.0:1777051367.333066:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13275 00000100:00100000:2.0:1777051367.333124:0:27885:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fd60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+26:2438:x1863365425934720:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 79us (623us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051367.333137:0:27885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13276 00000100:00100000:0.0:1777051367.333484:0:24468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10342 00000100:00100000:0.0:1777051367.333495:0:24468:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fd63b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+50:2438:x1863365425934464:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:0.0:1777051367.333540:0:24468:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fd63b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+50:2438:x1863365425934464:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 49us (1089us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051367.333548:0:24468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10342 00000100:00080000:0.0:1777051367.333567:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1777051367.333570:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1777051367.511000:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777051367.702829:0:3679:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1777051367.702863:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d943d91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452599808:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1777051367.702986:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051367.703077:0:47388:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452599808 00000100:00100000:2.0:1777051367.703091:0:47388:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452599808 00000100:00080000:2.0:1777051367.703189:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1777051367.703267:0:47388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5612 00000100:00100000:3.0:1777051367.703285:0:47388:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fd60380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3679:x1863365452599808:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1777051367.703316:0:47388:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 455081536 pending 0 free 3862671360 avail 3631149056 00000100:00100000:3.0:1777051367.703476:0:47388:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fd60380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3679:x1863365452599808:12345-0@lo:13:osp-pre-0-0.0 Request processed in 195us (490us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051367.703489:0:47388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5612 00000100:00100000:3.0:1777051367.703565:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d943d91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452599808:0@lo:13:osp-pre-0-0.0 00000001:00080000:2.0:1777051367.705576:0:8464:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0000: transno 4294968353 is committed 00000001:00080000:2.0:1777051367.705589:0:8464:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0000: transno 4294968352 is committed 00000100:00100000:2.0:1777051367.705996:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7c9a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3677:1863365452599936:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1777051367.706055:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051367.706216:0:10113:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452599936 00000100:00100000:1.0:1777051367.706224:0:10113:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452599936 00000100:00100000:1.0:1777051367.706288:0:10113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5613 00000100:00100000:1.0:1777051367.706302:0:10113:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da44494e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3677:x1863365452599936:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1777051367.706321:0:10113:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 445021760 pending 0 free 3643756544 avail 3412234240 00000100:00100000:1.0:1777051367.706455:0:10113:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da44494e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3677:x1863365452599936:12345-0@lo:13:osp-pre-1-0.0 Request processed in 154us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051367.706467:0:10113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5613 00000100:00100000:0.0:1777051367.706486:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7c9a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3677:1863365452599936:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1777051367.706591:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1777051368.240647:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051368.240709:0:46494:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425935232 00000100:00100000:2.0:1777051368.240724:0:46494:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425935232 00000100:00100000:2.0:1777051368.240820:0:46494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111956 00000100:00100000:2.0:1777051368.240838:0:46494:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da44495880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+50:134567:x1863365425935232:12345-192.168.201.46@tcp:101:rm.0 00010000:00010000:2.0:1777051368.240865:0:46494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051368.240903:0:46494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d950263a00/0x85f51a6b96715c96 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b61f0 expref: -99 pid: 46494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051368.241049:0:46494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d950262600/0x85f51a6b96715c9d lrc: 3/1,0 mode: --/PR res: [0x240000404:0xf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051368.241072:0:46494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d950262600/0x85f51a6b96715c9d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0xf:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 46494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051368.241095:0:46494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d950262600/0x85f51a6b96715c9d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0xf:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 46494 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1777051368.241154:0:46494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0xf:0x0]: returning size 4096 00000004:00200000:2.0:1777051368.241160:0:46494:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1777051368.241211:0:46494:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff99d950262600/0x85f51a6b96715c9d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0xf:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 46494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051368.241271:0:46494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d950263a00/0x85f51a6b96715c96 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b61f0 expref: 52 pid: 46494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051368.241312:0:46494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99d950262600/0x85f51a6b96715c9d lrc: 3/0,0 mode: PR/PR res: [0x240000404:0xf:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b61f0 expref: 51 pid: 46494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051368.241326:0:46494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0xf:0x0].0x0 (ffff99d9533a8500) 00010000:00010000:2.0:1777051368.241333:0:46494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1777051368.241376:0:46494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d950262600, rc 0) 00000100:00100000:2.0:1777051368.241568:0:46494:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da44495880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+51:134567:x1863365425935232:12345-192.168.201.46@tcp:101:rm.0 Request processed in 732us (931us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051368.241583:0:46494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111956 00000100:00100000:2.0:1777051368.245992:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051368.246127:0:21368:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425935488 00000100:00100000:1.0:1777051368.246137:0:21368:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425935488 00000100:00100000:1.0:1777051368.246350:0:21368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111957 00000100:00100000:1.0:1777051368.246370:0:21368:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da44494700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+51:134567:x1863365425935488:12345-192.168.201.46@tcp:101:rm.0 00010000:00010000:1.0:1777051368.246395:0:21368:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777051368.246419:0:21368:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e48b800/0x85f51a6b96715ca4 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b61f7 expref: -99 pid: 21368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1777051368.246519:0:21368:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0xf:0x0]: returning size 4096 00010000:00010000:1.0:1777051368.246692:0:21368:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e48b800/0x85f51a6b96715ca4 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b61f7 expref: 53 pid: 21368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051368.247002:0:21368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xd5:0x0].0x0 (ffff99d94e629b00) 00010000:00010000:1.0:1777051368.247008:0:21368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1777051368.247019:0:21368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e48b800/0x85f51a6b96715ca4 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b61f7 expref: 53 pid: 21368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051368.247047:0:21368:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d94e48b800, rc 0) 00000100:00100000:1.0:1777051368.247439:0:21368:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da44494700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+52:134567:x1863365425935488:12345-192.168.201.46@tcp:101:rm.0 Request processed in 1074us (1450us total) trans 8589934611 rc 301/301 00000100:00100000:1.0:1777051368.247453:0:21368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111957 00000001:00080000:3.0:1777051368.251754:0:104205:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934611 is committed 00000020:00080000:3.0:1777051368.251769:0:104205:0:(update_trans.c:1333:distribute_txn_batchid_cb()) lustre-MDT0001: 4294970576 batchid updated 00000001:00080000:3.0:1777051368.251778:0:104205:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934610 is committed 00000020:00080000:3.0:1777051368.251799:0:104205:0:(update_trans.c:1333:distribute_txn_batchid_cb()) lustre-MDT0001: 4294970575 batchid updated 00000020:00080000:1.0:1777051368.251873:0:104230:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 4294970576 00000004:00080000:1.0:1777051368.252103:0:104230:0:(osp_trans.c:1582:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff99d944ac00c0 with version 11 00000020:00080000:1.0:1777051368.252130:0:104230:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4294970575 cancel update log [0x2000032e1:0x1:0x0].2: rc = 0 00000020:00080000:1.0:1777051368.252227:0:104230:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4294970575 cancel update log [0x240000bd0:0x1:0x0].2: rc = 0 00000004:00080000:1.0:1777051368.252270:0:104230:0:(osp_trans.c:1582:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff99d944ac0cc0 with version 12 00000020:00080000:1.0:1777051368.252276:0:104230:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4294970576 cancel update log [0x2000032e1:0x1:0x0].3: rc = 0 00000020:00080000:1.0:1777051368.252341:0:104230:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4294970576 cancel update log [0x240000bd0:0x1:0x0].3: rc = 0 00000020:00080000:1.0:1777051368.252353:0:104230:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 4294970576 00000004:00080000:3.0:1777051368.252479:0:104211:0:(osp_trans.c:1330:osp_get_next_request()) ou ffff99d9596fa9c0 version 11 rpc_version 11 00000020:00100000:3.0:1777051368.252524:0:104211:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1777051368.252538:0:104211:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff99d95fae8700 x1863365452600192/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1777051368.252575:0:104211:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95fae8700 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:104211:1863365452600192:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1777051368.252653:0:104211:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051368.252731:0:104211:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d95ba609c0 going to sleep for 11 seconds 00000100:00100000:1.0:1777051368.252765:0:6585:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452600192 00000100:00100000:1.0:1777051368.252777:0:6585:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452600192 00000100:00100000:1.0:1777051368.252848:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8123 00000100:00100000:1.0:1777051368.252863:0:6585:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95fae9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:104211:x1863365452600192:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1777051368.253143:0:6585:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95fae9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:104211:x1863365452600192:12345-0@lo:1000:osp_up0-1.0 Request processed in 281us (489us total) trans 30064771113 rc 0/0 00000100:00100000:1.0:1777051368.253158:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8123 00000100:00100000:2.0:1777051368.254135:0:104211:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95fae8700 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:104211:1863365452600192:0@lo:1000:osp_up0-1.0 00000004:00080000:2.0:1777051368.254154:0:104211:0:(osp_trans.c:1330:osp_get_next_request()) ou ffff99d9596fa9c0 version 12 rpc_version 12 00000020:00100000:2.0:1777051368.254323:0:104211:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1777051368.254389:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051368.254389:0:104211:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff99da44494000 x1863365452600448/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1777051368.254426:0:104211:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da44494000 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:104211:1863365452600448:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1777051368.254485:0:104211:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051368.254485:0:46501:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425935616 00000100:00100000:3.0:1777051368.254497:0:46501:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425935616 00000100:00100000:2.0:1777051368.254551:0:104211:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d95744b300 going to sleep for 11 seconds 00000100:00100000:3.0:1777051368.254567:0:46501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3338 00000100:00100000:3.0:1777051368.254652:0:46501:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d943d90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+51:134567:x1863365425935616:12345-192.168.201.46@tcp:37:rm.0 00000100:00100000:1.0:1777051368.254801:0:46498:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452600448 00000100:00100000:1.0:1777051368.254811:0:46498:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452600448 00000100:00100000:1.0:1777051368.254874:0:46498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8124 00000100:00100000:1.0:1777051368.254887:0:46498:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94ed2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+7:104211:x1863365452600448:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1777051368.255088:0:46498:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94ed2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+8:104211:x1863365452600448:12345-0@lo:1000:osp_up0-1.0 Request processed in 201us (603us total) trans 30064771114 rc 0/0 00000100:00100000:1.0:1777051368.255101:0:46498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8124 00000100:00100000:2.0:1777051368.255169:0:104211:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da44494000 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:104211:1863365452600448:0@lo:1000:osp_up0-1.0 00000001:00080000:2.0:1777051368.262228:0:103159:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771113 is committed 00000001:00080000:2.0:1777051368.262243:0:103159:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771112 is committed 00000100:00100000:3.0:1777051368.264380:0:46501:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d943d90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+51:134567:x1863365425935616:12345-192.168.201.46@tcp:37:rm.0 Request processed in 9793us (9994us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051368.264402:0:46501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3338 00000100:00100000:3.0:1777051368.272533:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051368.273309:0:6583:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425935872 00000100:00100000:0.0:1777051368.273324:0:6583:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425935872 00000100:00100000:0.0:1777051368.273399:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3339 00000100:00100000:0.0:1777051368.273418:0:6583:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95faead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+51:134567:x1863365425935872:12345-192.168.201.46@tcp:35:rm.0 00000100:00100000:0.0:1777051368.273698:0:6583:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95faead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+52:134567:x1863365425935872:12345-192.168.201.46@tcp:35:rm.0 Request processed in 283us (1169us total) trans 8589934612 rc 0/0 00000100:00100000:0.0:1777051368.273714:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3339 00000100:00100000:1.0:1777051368.279343:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051368.279446:0:27882:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425936128 00000100:00100000:3.0:1777051368.279457:0:27882:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425936128 00000100:00100000:3.0:1777051368.279527:0:27882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111958 00000100:00100000:3.0:1777051368.279542:0:27882:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d943d92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+52:134567:x1863365425936128:12345-192.168.201.46@tcp:101:rm.0 00010000:00010000:3.0:1777051368.279568:0:27882:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777051368.279597:0:27882:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d941ad6400/0x85f51a6b96715cb2 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b61fe expref: -99 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051368.280332:0:27882:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d941ad7c00/0x85f51a6b96715cb9 lrc: 3/1,0 mode: --/CR res: [0x240000404:0xf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051368.280356:0:27882:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d941ad7c00/0x85f51a6b96715cb9 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0xf:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 27882 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051368.280376:0:27882:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d941ad7c00/0x85f51a6b96715cb9 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0xf:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 27882 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1777051368.280396:0:27882:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0xf:0x0]: returning size 4096 00010000:00010000:3.0:1777051368.280518:0:27882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d941ad6400/0x85f51a6b96715cb2 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b61fe expref: 55 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051368.280549:0:27882:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99d941ad7c00/0x85f51a6b96715cb9 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0xf:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b61fe expref: 54 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051368.280562:0:27882:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0xf:0x0].0x0 (ffff99d9533a8500) 00010000:00010000:3.0:1777051368.280567:0:27882:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1777051368.280572:0:27882:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d941ad7c00, rc 0) 00000100:00100000:3.0:1777051368.280643:0:27882:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d943d92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+54:134567:x1863365425936128:12345-192.168.201.46@tcp:101:rm.0 Request processed in 1103us (1306us total) trans 8589934613 rc 0/0 00000100:00100000:3.0:1777051368.280654:0:27882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111958 00000100:00100000:3.0:1777051368.285817:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051368.285903:0:10328:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425936256 00000100:00100000:1.0:1777051368.285949:0:10328:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425936256 00000100:00100000:1.0:1777051368.286032:0:10328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111959 00000100:00100000:1.0:1777051368.286058:0:10328:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95faebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+26:134567:x1863365425936256:12345-192.168.201.46@tcp:41:rm.0 00000004:00000024:1.0:1777051368.286126:0:10328:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4194304 pending 0 free 7506427904 avail 7043383296 00000100:00100000:1.0:1777051368.286227:0:10328:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95faebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+26:134567:x1863365425936256:12345-192.168.201.46@tcp:41:rm.0 Request processed in 172us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051368.286653:0:10328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111959 00000100:00100000:0.0:1777051368.296337:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051368.296420:0:8492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425936512 00000100:00100000:1.0:1777051368.296432:0:8492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425936512 00000100:00100000:1.0:1777051368.296496:0:8492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111960 00000100:00100000:1.0:1777051368.296510:0:8492:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7c9a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+54:134567:x1863365425936512:12345-192.168.201.46@tcp:36:rm.0 00010000:00010000:1.0:1777051368.296581:0:8492:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1777051368.296620:0:8492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d95595be00/0x85f51a6b96715be7 lrc: 0/0,0 mode: --/PR res: [0x240000405:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b61a3 expref: 54 pid: 21368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051368.296649:0:8492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0xc:0x0].0x0 (ffff99d95c19cb00) 00010000:00010000:1.0:1777051368.296666:0:8492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d950262600/0x85f51a6b96715c9d lrc: 0/0,0 mode: --/PR res: [0x240000404:0xf:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b61f0 expref: 53 pid: 46494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051368.296681:0:8492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0xf:0x0].0x0 (ffff99d9533a8500) 00010000:00010000:1.0:1777051368.296685:0:8492:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1777051368.296713:0:8492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e48b600/0x85f51a6b96715cc7 lrc: 3/0,1 mode: --/CW res: [0x240000404:0xf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051368.296734:0:8492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e48b600/0x85f51a6b96715cc7 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0xf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8492 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051368.296749:0:8492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e48b600/0x85f51a6b96715cc7 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0xf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8492 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051368.296770:0:8492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e48aa00/0x85f51a6b96715cce lrc: 3/0,1 mode: --/PW res: [0x240000404:0xf:0x0].0xc67b6e72 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051368.296781:0:8492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e48aa00/0x85f51a6b96715cce lrc: 3/0,1 mode: PW/PW res: [0x240000404:0xf:0x0].0xc67b6e72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8492 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051368.296792:0:8492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e48aa00/0x85f51a6b96715cce lrc: 3/0,1 mode: PW/PW res: [0x240000404:0xf:0x0].0xc67b6e72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8492 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051368.296896:0:8492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e48b000/0x85f51a6b96715cd5 lrc: 3/0,1 mode: --/EX res: [0x240000405:0xc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051368.296953:0:8492:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d785a00/0x85f51a6b96715b23 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6164 expref: 8 pid: 27885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051368.296968:0:8492:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e48b000/0x85f51a6b96715cd5 lrc: 4/0,1 mode: --/EX res: [0x240000405:0xc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8492 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051368.297014:0:8492:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d785a00/0x85f51a6b96715b23 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6164 expref: 8 pid: 27885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051368.297037:0:8492:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d785a00/0x85f51a6b96715b23 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6164 expref: 8 pid: 27885 timeout: 8097 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051368.297412:0:8492:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d943d91500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:8492:1863365452600576:192.168.201.46@tcp:104: 00000100:00100000:1.0:1777051368.297541:0:8492:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da4a170180 going to sleep for 11 seconds 00000100:00100000:1.0:1777051368.301090:0:8492:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d943d91500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:8492:1863365452600576:192.168.201.46@tcp:104: 00010000:00010000:1.0:1777051368.301127:0:8492:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e48b000/0x85f51a6b96715cd5 lrc: 3/0,1 mode: --/EX res: [0x240000405:0xc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8492 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051368.302148:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051368.302326:0:6566:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425936640 00000100:00100000:1.0:1777051368.302337:0:6566:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425936640 00010000:00010000:1.0:1777051368.302384:0:6566:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d785a00/0x85f51a6b96715b23 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6164 expref: 9 pid: 27885 timeout: 8097 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051368.302450:0:6566:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3861 00000100:00100000:1.0:1777051368.302465:0:6566:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7c9a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+9:2437:x1863365425936640:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1777051368.302486:0:6566:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1777051368.302499:0:6566:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d785a00/0x85f51a6b96715b23 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6164 expref: 9 pid: 27885 timeout: 8097 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051368.302526:0:6566:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d785a00/0x85f51a6b96715b23 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6164 expref: 9 pid: 27885 timeout: 8097 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051368.302570:0:6566:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d785a00/0x85f51a6b96715b23 lrc: 0/0,0 mode: --/PR res: [0x240000405:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6164 expref: 9 pid: 27885 timeout: 8097 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051368.302596:0:6566:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0xc:0x0].0x0 (ffff99d95c19cb00) 00010000:00010000:1.0:1777051368.302605:0:6566:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e48b000/0x85f51a6b96715cd5 lrc: 3/0,1 mode: --/EX res: [0x240000405:0xc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8492 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051368.302621:0:6566:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e48b000/0x85f51a6b96715cd5 lrc: 3/0,1 mode: EX/EX res: [0x240000405:0xc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8492 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051368.302633:0:6566:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e48b000/0x85f51a6b96715cd5 lrc: 4/0,1 mode: EX/EX res: [0x240000405:0xc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8492 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051368.302681:0:6566:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1777051368.303068:0:6566:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7c9a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+8:2437:x1863365425936640:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 601us (919us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051368.303084:0:6566:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3861 00010000:00010000:2.0:1777051368.303315:0:8492:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e48b000/0x85f51a6b96715cd5 lrc: 3/0,1 mode: EX/EX res: [0x240000405:0xc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8492 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051368.303333:0:8492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e48b000/0x85f51a6b96715cd5 lrc: 3/0,1 mode: EX/EX res: [0x240000405:0xc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8492 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1777051368.304069:0:8492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].2, 64 off8320 00000004:00080000:2.0:1777051368.304089:0:8492:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 7997496890552ns, next at 7998496886806ns, rc = 0 00010000:00010000:2.0:1777051368.304171:0:8492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff99d950263400/0x85f51a6b96715cdc lrc: 3/0,1 mode: --/PW res: [0x240000405:0xc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051368.304193:0:8492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d950263400/0x85f51a6b96715cdc lrc: 3/0,1 mode: PW/PW res: [0x240000405:0xc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 8492 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051368.304277:0:8492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d950263400/0x85f51a6b96715cdc lrc: 3/0,1 mode: PW/PW res: [0x240000405:0xc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8492 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051368.304291:0:8492:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff99d950263400/0x85f51a6b96715cdc lrc: 4/0,1 mode: PW/PW res: [0x240000405:0xc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8492 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051368.304302:0:8492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff99d950263400/0x85f51a6b96715cdc lrc: 4/0,1 mode: PW/PW res: [0x240000405:0xc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8492 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051368.304314:0:8492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d950263400/0x85f51a6b96715cdc lrc: 3/0,0 mode: PW/PW res: [0x240000405:0xc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8492 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051368.304352:0:8492:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1777051368.304380:0:8492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e48b000/0x85f51a6b96715cd5 lrc: 3/0,1 mode: EX/EX res: [0x240000405:0xc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8492 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051368.304394:0:8492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e48b000/0x85f51a6b96715cd5 lrc: 2/0,0 mode: EX/EX res: [0x240000405:0xc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8492 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051368.304406:0:8492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e48b000/0x85f51a6b96715cd5 lrc: 3/0,0 mode: EX/EX res: [0x240000405:0xc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8492 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051368.304417:0:38719:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777051368.304419:0:8492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94e48b000 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:2.0:1777051368.304432:0:8492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e48b000/0x85f51a6b96715cd5 lrc: 3/0,0 mode: EX/EX res: [0x240000405:0xc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8492 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051368.304436:0:38719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99d950263400/0x85f51a6b96715cdc lrc: 2/0,0 mode: PW/PW res: [0x240000405:0xc:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 8492 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051368.304462:0:8492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e48b000/0x85f51a6b96715cd5 lrc: 4/0,0 mode: EX/EX res: [0x240000405:0xc:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8492 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051368.304465:0:38719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d950263400 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:1.0:1777051368.304477:0:38719:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d950263400/0x85f51a6b96715cdc lrc: 2/0,0 mode: PW/PW res: [0x240000405:0xc:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 8492 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051368.304488:0:8492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0xc:0x0].0x0 (ffff99d95c19cb00) 00010000:00010000:2.0:1777051368.304503:0:8492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1777051368.304512:0:8492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e48b000/0x85f51a6b96715cd5 lrc: 2/0,0 mode: --/EX res: [0x240000405:0xc:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8492 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051368.304517:0:38719:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d950263400/0x85f51a6b96715cdc lrc: 3/0,0 mode: PW/PW res: [0x240000405:0xc:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 8492 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051368.304538:0:8492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e48b000/0x85f51a6b96715cd5 lrc: 0/0,0 mode: --/EX res: [0x240000405:0xc:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8492 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051368.304552:0:38719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0xc:0x0].0x0 (ffff99d95c19cb00) 00010000:00010000:1.0:1777051368.304560:0:38719:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1777051368.304568:0:38719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99d950263400/0x85f51a6b96715cdc lrc: 1/0,0 mode: --/PW res: [0x240000405:0xc:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8492 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051368.304574:0:8492:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e48b600/0x85f51a6b96715cc7 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0xf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8492 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051368.304583:0:38719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d950263400/0x85f51a6b96715cdc lrc: 0/0,0 mode: --/PW res: [0x240000405:0xc:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8492 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051368.304596:0:8492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e48b600/0x85f51a6b96715cc7 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0xf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8492 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051368.304614:0:8492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e48b600/0x85f51a6b96715cc7 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0xf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8492 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051368.304622:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777051368.304626:0:8492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e48b600/0x85f51a6b96715cc7 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0xf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8492 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051368.304630:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051368.304636:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777051368.304646:0:8492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94e48b600 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:2.0:1777051368.304653:0:8492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e48b600/0x85f51a6b96715cc7 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0xf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8492 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051368.304672:0:8492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e48b600/0x85f51a6b96715cc7 lrc: 5/0,0 mode: CW/CW res: [0x240000404:0xf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8492 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051368.304687:0:8492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0xf:0x0].0x0 (ffff99d9533a8500) 00010000:00010000:2.0:1777051368.304692:0:8492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777051368.304697:0:8492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e48b600/0x85f51a6b96715cc7 lrc: 3/0,0 mode: --/CW res: [0x240000404:0xf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8492 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051368.304708:0:8492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e48b600/0x85f51a6b96715cc7 lrc: 0/0,0 mode: --/CW res: [0x240000404:0xf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8492 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1777051368.304728:0:8492:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000009f5d8016 reply state 0000000091a67ac6 transno 8589934614 ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e48aa00/0x85f51a6b96715cce lrc: 3/0,1 mode: PW/PW res: [0x240000404:0xf:0x0].0xc67b6e72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8492 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051368.304747:0:8492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e48aa00/0x85f51a6b96715cce lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0xf:0x0].0xc67b6e72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8492 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051368.304759:0:8492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0xf:0x0].0xc67b6e72 (ffff99d94e629b00) 00010000:00010000:2.0:1777051368.304764:0:8492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1777051368.304769:0:8492:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1777051368.304870:0:8492:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7c9a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+54:134567:x1863365425936512:12345-192.168.201.46@tcp:36:rm.0 Request processed in 8359us (8536us total) trans 8589934614 rc 0/0 00000100:00100000:2.0:1777051368.304885:0:8492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111960 00000100:00100000:0.0:1777051368.310890:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051368.311023:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051368.311054:0:47597:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425936768 00000100:00100000:3.0:1777051368.311067:0:47597:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425936768 00000100:00100000:2.0:1777051368.311126:0:24269:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425937024 00000100:00100000:2.0:1777051368.311137:0:24269:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425937024 00000100:00100000:3.0:1777051368.311169:0:47597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13686 00000100:00100000:3.0:1777051368.311192:0:47597:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7c9a1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+26:2436:x1863365425936768:12345-192.168.201.46@tcp:103:rm.0 00000100:00100000:2.0:1777051368.311237:0:24269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3340 00000100:00100000:2.0:1777051368.311263:0:24269:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da6ff04850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+54:134567:x1863365425937024:12345-192.168.201.46@tcp:35:rm.0 00010000:00010000:3.0:1777051368.311268:0:47597:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777051368.311308:0:47597:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3a00/0x85f51a6b96715bbd lrc: 0/0,0 mode: --/PR res: [0x240000404:0xf:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6195 expref: 26 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051368.311340:0:47597:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0xf:0x0].0x0 (ffff99d94e6b6700) 00010000:00010000:3.0:1777051368.311350:0:47597:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1777051368.311440:0:47597:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7c9a1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+25:2436:x1863365425936768:12345-192.168.201.46@tcp:103:rm.0 Request processed in 254us (554us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051368.311454:0:47597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13686 00000100:00100000:2.0:1777051368.311545:0:24269:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da6ff04850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+55:134567:x1863365425937024:12345-192.168.201.46@tcp:35:rm.0 Request processed in 287us (520us total) trans 8589934615 rc 0/0 00000100:00100000:2.0:1777051368.311568:0:24269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3340 00000100:00100000:1.0:1777051368.318837:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051368.319811:0:46497:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425937280 00000100:00100000:3.0:1777051368.319825:0:46497:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425937280 00000100:00100000:3.0:1777051368.319951:0:46497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111961 00000100:00100000:3.0:1777051368.319974:0:46497:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d943d91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+55:134567:x1863365425937280:12345-192.168.201.46@tcp:36:rm.0 00010000:00010000:3.0:1777051368.320049:0:46497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1777051368.320431:0:46497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d941ad7c00/0x85f51a6b96715cb9 lrc: 0/0,0 mode: --/CR res: [0x240000404:0xf:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b61fe expref: 55 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051368.320471:0:46497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e48be00/0x85f51a6b96715bcb lrc: 0/0,0 mode: --/PR res: [0x240000404:0xf:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b619c expref: 54 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051368.320492:0:46497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0xf:0x0].0x0 (ffff99d9533a8500) 00010000:00010000:3.0:1777051368.320501:0:46497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1777051368.320573:0:46497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d941ad6400/0x85f51a6b96715ce3 lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0xd5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051368.320590:0:46497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d941ad6400/0x85f51a6b96715ce3 lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051368.320609:0:46497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d941ad6400/0x85f51a6b96715ce3 lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051368.320646:0:46497:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95fae8000 pname:cluuid:pid:xid:nid:opc:job mdt00_009:lustre-MDT0001-mdtlov_UUID:46497:1863365452600704:0@lo:101:mdt00_009.0 00000100:00100000:3.0:1777051368.320718:0:46497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051368.320768:0:46497:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d95ba60b40 going to sleep for 11 seconds 00000100:00100000:2.0:1777051368.320783:0:6584:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452600704 00000100:00100000:2.0:1777051368.320798:0:6584:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452600704 00000100:00100000:2.0:1777051368.321378:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8125 00000100:00100000:2.0:1777051368.321403:0:6584:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95fae9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:46497:x1863365452600704:12345-0@lo:101:mdt00_009.0 00010000:00010000:2.0:1777051368.321432:0:6584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051368.321461:0:6584:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263800/0x85f51a6b96715cea lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0xd5:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x85f51a6b96715ce3 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051368.321505:0:6584:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d785200/0x85f51a6b96715bfc lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b61b1 expref: 24 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051368.321525:0:6584:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263800/0x85f51a6b96715cea lrc: 4/0,0 mode: --/CW res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x85f51a6b96715ce3 expref: 8 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051368.321598:0:6584:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d785200/0x85f51a6b96715bfc lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b61b1 expref: 24 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051368.321626:0:6584:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d785200/0x85f51a6b96715bfc lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b61b1 expref: 24 pid: 46497 timeout: 8097 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051368.321650:0:6584:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94ed2f480 pname:cluuid:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000_UUID:6584:1863365452600832:192.168.201.46@tcp:104: 00000100:00100000:2.0:1777051368.321852:0:6584:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d95744bd80 going to sleep for 11 seconds 00000100:00100000:0.0:1777051368.327679:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051368.330121:0:6584:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94ed2f480 pname:cluuid:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000_UUID:6584:1863365452600832:192.168.201.46@tcp:104: 00000100:00100000:1.0:1777051368.330152:0:24467:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425937408 00000100:00100000:1.0:1777051368.330166:0:24467:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425937408 00010000:00010000:2.0:1777051368.330179:0:6584:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263800/0x85f51a6b96715cea lrc: 3/0,0 mode: --/CW res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b96715ce3 expref: 8 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051368.330252:0:6584:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xd5:0x0].0x0 (ffff99d9413d2a00) 00010000:00010000:2.0:1777051368.330260:0:6584:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777051368.330270:0:6584:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263800/0x85f51a6b96715cea lrc: 3/0,0 mode: --/CW res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b96715ce3 expref: 8 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051368.330289:0:24467:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d785200/0x85f51a6b96715bfc lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b61b1 expref: 25 pid: 46497 timeout: 8097 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051368.330292:0:6584:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d950263800, rc 0) 00000100:00100000:1.0:1777051368.330387:0:24467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3862 00000100:00100000:1.0:1777051368.330407:0:24467:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7c9a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+25:2437:x1863365425937408:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1777051368.330431:0:24467:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1777051368.330442:0:24467:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d785200/0x85f51a6b96715bfc lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b61b1 expref: 25 pid: 46497 timeout: 8097 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051368.330470:0:24467:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d785200/0x85f51a6b96715bfc lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b61b1 expref: 25 pid: 46497 timeout: 8097 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051368.330518:0:24467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d785200/0x85f51a6b96715bfc lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b61b1 expref: 25 pid: 46497 timeout: 8097 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051368.330546:0:24467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xd5:0x0].0x0 (ffff99d9413d2a00) 00010000:00010000:1.0:1777051368.330557:0:24467:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263800/0x85f51a6b96715cea lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b96715ce3 expref: 8 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051368.330575:0:24467:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263800/0x85f51a6b96715cea lrc: 2/0,0 mode: CW/CW res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x85f51a6b96715ce3 expref: 8 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051368.330593:0:24467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263800/0x85f51a6b96715cea lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x85f51a6b96715ce3 expref: 8 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051368.330644:0:24467:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263800/0x85f51a6b96715cea lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b96715ce3 expref: 8 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051368.331026:0:6584:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95fae9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:46497:x1863365452600704:12345-0@lo:101:mdt00_009.0 Request processed in 9627us (10306us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051368.331042:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8125 00000100:00100000:1.0:1777051368.331352:0:24467:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d943d93480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000_UUID:24467:1863365452600960:0@lo:105: 00000100:00100000:1.0:1777051368.331413:0:24467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051368.331486:0:24467:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da4a170180 going to sleep for 11 seconds 00000100:00100000:0.0:1777051368.331530:0:102039:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452600960 00000100:00100000:0.0:1777051368.331543:0:102039:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452600960 00000100:00100000:0.0:1777051368.331625:0:102039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1777051368.331642:0:102039:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d943d90380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0001-mdtlov_UUID+4:24467:x1863365452600960:12345-0@lo:105: 00010000:00010000:0.0:1777051368.331665:0:102039:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d941ad6400/0x85f51a6b96715ce3 lrc: 4/0,1 mode: --/CW res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x85f51a6b96715cea expref: -99 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051368.331688:0:102039:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d941ad6400/0x85f51a6b96715ce3 lrc: 4/0,1 mode: --/CW res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x85f51a6b96715cea expref: -99 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051368.331704:0:102039:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d941ad6400/0x85f51a6b96715ce3 lrc: 4/0,1 mode: --/CW res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x85f51a6b96715cea expref: -99 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051368.331720:0:102039:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d941ad6400/0x85f51a6b96715ce3 lrc: 4/0,1 mode: CW/CW res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x85f51a6b96715cea expref: -99 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051368.331736:0:102039:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d941ad6400/0x85f51a6b96715ce3 lrc: 5/0,1 mode: CW/CW res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x85f51a6b96715cea expref: -99 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051368.332118:0:102039:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d941ad6400/0x85f51a6b96715ce3 lrc: 5/0,1 mode: CW/CW res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x85f51a6b96715cea expref: -99 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051368.332147:0:102039:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff99d941ad6400) 00000100:00100000:0.0:1777051368.332263:0:102039:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d943d90380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0001-mdtlov_UUID+4:24467:x1863365452600960:12345-0@lo:105: Request processed in 624us (848us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051368.332280:0:102039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1777051368.332536:0:24467:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d943d93480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000_UUID:24467:1863365452600960:0@lo:105: 00010000:00010000:1.0:1777051368.332562:0:24467:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1777051368.332640:0:24467:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7c9a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+24:2437:x1863365425937408:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 2236us (4965us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051368.332987:0:24467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3862 00000100:00100000:2.0:1777051368.333457:0:46497:0:(client.c:3101:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 30064771113 gen 2 00000004:00080000:2.0:1777051368.333468:0:46497:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 30064771113 committed transno 30064771113 00000100:00100000:2.0:1777051368.333503:0:46497:0:(client.c:3145:ptlrpc_free_committed()) @@@ stopping search req@ffff99da44494000 x1863365452600448/t30064771114(30064771114) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 1777051384 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1777051368.333526:0:46497:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95fae8000 pname:cluuid:pid:xid:nid:opc:job mdt00_009:lustre-MDT0001-mdtlov_UUID:46497:1863365452600704:0@lo:101:mdt00_009.0 00010000:00010000:2.0:1777051368.333551:0:46497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d941ad6400/0x85f51a6b96715ce3 lrc: 4/0,1 mode: CW/CW res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x85f51a6b96715cea expref: -99 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1777051368.333582:0:46497:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000bd2:0xd5:0x0] 00010000:00010000:2.0:1777051368.334846:0:46497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950262400/0x85f51a6b96715cf1 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0xd5:0x0].0xceea225b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051368.334864:0:46497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950262400/0x85f51a6b96715cf1 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0xd5:0x0].0xceea225b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051368.334882:0:46497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950262400/0x85f51a6b96715cf1 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0xd5:0x0].0xceea225b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051368.334946:0:46497:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94ed2f480 pname:cluuid:pid:xid:nid:opc:job mdt00_009:lustre-MDT0001-mdtlov_UUID:46497:1863365452601088:0@lo:101:mdt00_009.0 00000100:00100000:2.0:1777051368.335002:0:46497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051368.335031:0:46497:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d95744bd80 going to sleep for 11 seconds 00000100:00100000:3.0:1777051368.335993:0:46500:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452601088 00000100:00100000:3.0:1777051368.336005:0:46500:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452601088 00000100:00100000:3.0:1777051368.336078:0:46500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8126 00000100:00100000:3.0:1777051368.336094:0:46500:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94ed2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+8:46497:x1863365452601088:12345-0@lo:101:mdt00_009.0 00010000:00010000:3.0:1777051368.336634:0:46500:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777051368.336666:0:46500:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7c00/0x85f51a6b96715cf8 lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0xd5:0x0].0xceea225b bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x85f51a6b96715cf1 expref: -99 pid: 46500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051368.336768:0:46500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7c00/0x85f51a6b96715cf8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xd5:0x0].0xceea225b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x85f51a6b96715cf1 expref: 9 pid: 46500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051368.336792:0:46500:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7c00/0x85f51a6b96715cf8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xd5:0x0].0xceea225b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b96715cf1 expref: 9 pid: 46500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051368.336809:0:46500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xd5:0x0].0xceea225b (ffff99d9413d2c00) 00010000:00010000:3.0:1777051368.336816:0:46500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777051368.336823:0:46500:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d941ad7c00, rc 0) 00000100:00100000:3.0:1777051368.336908:0:46500:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94ed2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+9:46497:x1863365452601088:12345-0@lo:101:mdt00_009.0 Request processed in 816us (1905us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051368.336951:0:46500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8126 00000100:00100000:2.0:1777051368.337021:0:46497:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94ed2f480 pname:cluuid:pid:xid:nid:opc:job mdt00_009:lustre-MDT0001-mdtlov_UUID:46497:1863365452601088:0@lo:101:mdt00_009.0 00010000:00010000:2.0:1777051368.337080:0:46497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950262400/0x85f51a6b96715cf1 lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0xd5:0x0].0xceea225b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x85f51a6b96715cf8 expref: -99 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051368.337101:0:46497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950262400/0x85f51a6b96715cf1 lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0xd5:0x0].0xceea225b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x85f51a6b96715cf8 expref: -99 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1777051368.337129:0:46497:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000bd2:0xd5:0x0] 00000100:00100000:2.0:1777051368.337185:0:46497:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94ed2f480 pname:cluuid:pid:xid:nid:opc:job mdt00_009:lustre-MDT0001-mdtlov_UUID:46497:1863365452601216:0@lo:1000:mdt00_009.0 00000100:00100000:2.0:1777051368.337236:0:46497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051368.337273:0:46497:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d95744b780 going to sleep for 11 seconds 00000100:00100000:1.0:1777051368.337695:0:46498:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452601216 00000100:00100000:1.0:1777051368.337707:0:46498:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452601216 00000100:00100000:1.0:1777051368.337785:0:46498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8127 00000100:00100000:1.0:1777051368.337800:0:46498:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94ed2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+9:46497:x1863365452601216:12345-0@lo:1000:mdt00_009.0 00000100:00100000:1.0:1777051368.338006:0:46498:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94ed2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+9:46497:x1863365452601216:12345-0@lo:1000:mdt00_009.0 Request processed in 207us (766us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051368.338026:0:46498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8127 00000100:00100000:2.0:1777051368.338118:0:46497:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94ed2f480 pname:cluuid:pid:xid:nid:opc:job mdt00_009:lustre-MDT0001-mdtlov_UUID:46497:1863365452601216:0@lo:1000:mdt00_009.0 00000100:00100000:2.0:1777051368.338198:0:46497:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94ed2f480 pname:cluuid:pid:xid:nid:opc:job mdt00_009:lustre-MDT0001-mdtlov_UUID:46497:1863365452601344:0@lo:1000:mdt00_009.0 00000100:00100000:2.0:1777051368.338247:0:46497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051368.338297:0:46497:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d95744b780 going to sleep for 11 seconds 00000100:00100000:1.0:1777051368.338663:0:11727:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452601344 00000100:00100000:1.0:1777051368.338673:0:11727:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452601344 00000100:00100000:1.0:1777051368.338775:0:11727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8128 00000100:00100000:1.0:1777051368.338791:0:11727:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94ed2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:46497:x1863365452601344:12345-0@lo:1000:mdt00_009.0 00000100:00100000:1.0:1777051368.339000:0:11727:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94ed2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:46497:x1863365452601344:12345-0@lo:1000:mdt00_009.0 Request processed in 211us (751us total) trans 0 rc 1/1 00000100:00100000:1.0:1777051368.339019:0:11727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8128 00000100:00100000:2.0:1777051368.340812:0:46497:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94ed2f480 pname:cluuid:pid:xid:nid:opc:job mdt00_009:lustre-MDT0001-mdtlov_UUID:46497:1863365452601344:0@lo:1000:mdt00_009.0 00010000:00010000:2.0:1777051368.340889:0:46497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950263e00/0x85f51a6b96715cff lrc: 3/0,1 mode: --/EX res: [0x240000404:0xf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051368.340902:0:46497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950263e00/0x85f51a6b96715cff lrc: 3/0,1 mode: --/EX res: [0x240000404:0xf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051368.340948:0:46497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950263e00/0x85f51a6b96715cff lrc: 3/0,1 mode: --/EX res: [0x240000404:0xf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051368.340976:0:46497:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94ed2f480 pname:cluuid:pid:xid:nid:opc:job mdt00_009:lustre-MDT0001-mdtlov_UUID:46497:1863365452601472:0@lo:101:mdt00_009.0 00000100:00100000:2.0:1777051368.341035:0:46497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051368.341465:0:46497:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d95744bd80 going to sleep for 11 seconds 00000100:00100000:1.0:1777051368.341585:0:6585:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452601472 00000100:00100000:1.0:1777051368.341595:0:6585:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452601472 00000100:00100000:1.0:1777051368.341646:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8129 00000100:00100000:1.0:1777051368.341659:0:6585:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94ed2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:46497:x1863365452601472:12345-0@lo:101:mdt00_009.0 00010000:00010000:1.0:1777051368.341676:0:6585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777051368.341698:0:6585:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48a800/0x85f51a6b96715d06 lrc: 2/0,0 mode: --/EX res: [0x240000404:0xf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x85f51a6b96715cff expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051368.341735:0:6585:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48a400/0x85f51a6b96715ae4 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0xf:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b614f expref: 19 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051368.341755:0:6585:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48a800/0x85f51a6b96715d06 lrc: 4/0,0 mode: --/EX res: [0x240000404:0xf:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x85f51a6b96715cff expref: 10 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051368.341796:0:6585:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48a400/0x85f51a6b96715ae4 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0xf:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b614f expref: 19 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051368.341814:0:6585:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48a400/0x85f51a6b96715ae4 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0xf:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b614f expref: 19 pid: 6580 timeout: 8097 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051368.341829:0:6585:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d943d93480 pname:cluuid:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000_UUID:6585:1863365452601600:192.168.201.46@tcp:104: 00000100:00100000:1.0:1777051368.341961:0:6585:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da4a170180 going to sleep for 11 seconds 00000100:00100000:0.0:1777051368.348161:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051368.348304:0:6585:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d943d93480 pname:cluuid:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000_UUID:6585:1863365452601600:192.168.201.46@tcp:104: 00010000:00010000:1.0:1777051368.348350:0:6585:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48a800/0x85f51a6b96715d06 lrc: 3/0,0 mode: --/EX res: [0x240000404:0xf:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b96715cff expref: 10 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051368.348375:0:6585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0xf:0x0].0x0 (ffff99d94e6b6700) 00010000:00010000:1.0:1777051368.348382:0:6585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1777051368.348391:0:6585:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48a800/0x85f51a6b96715d06 lrc: 3/0,0 mode: --/EX res: [0x240000404:0xf:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b96715cff expref: 10 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051368.348410:0:6585:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d94e48a800, rc 0) 00000100:00100000:1.0:1777051368.348505:0:6585:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94ed2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+10:46497:x1863365452601472:12345-0@lo:101:mdt00_009.0 Request processed in 6845us (7468us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051368.348521:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8129 00000100:00100000:2.0:1777051368.348681:0:6564:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425937536 00000100:00100000:2.0:1777051368.348692:0:6564:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425937536 00010000:00010000:2.0:1777051368.348738:0:6564:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48a400/0x85f51a6b96715ae4 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0xf:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b614f expref: 20 pid: 6580 timeout: 8097 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051368.348810:0:6564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3863 00000100:00100000:2.0:1777051368.348828:0:6564:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da6fd41850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+20:2436:x1863365425937536:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1777051368.348850:0:6564:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777051368.348863:0:6564:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48a400/0x85f51a6b96715ae4 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0xf:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b614f expref: 20 pid: 6580 timeout: 8097 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051368.348892:0:6564:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48a400/0x85f51a6b96715ae4 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0xf:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b614f expref: 20 pid: 6580 timeout: 8097 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051368.348963:0:6564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48a400/0x85f51a6b96715ae4 lrc: 0/0,0 mode: --/PR res: [0x240000404:0xf:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b614f expref: 20 pid: 6580 timeout: 8097 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051368.348991:0:6564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0xf:0x0].0x0 (ffff99d94e6b6700) 00010000:00010000:2.0:1777051368.349001:0:6564:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48a800/0x85f51a6b96715d06 lrc: 2/0,0 mode: --/EX res: [0x240000404:0xf:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b96715cff expref: 9 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051368.349024:0:6564:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48a800/0x85f51a6b96715d06 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0xf:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x85f51a6b96715cff expref: 9 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051368.349044:0:6564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48a800/0x85f51a6b96715d06 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0xf:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x85f51a6b96715cff expref: 9 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051368.349075:0:46497:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94ed2f480 pname:cluuid:pid:xid:nid:opc:job mdt00_009:lustre-MDT0001-mdtlov_UUID:46497:1863365452601472:0@lo:101:mdt00_009.0 00010000:00010000:0.0:1777051368.349108:0:46497:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950263e00/0x85f51a6b96715cff lrc: 4/0,1 mode: --/EX res: [0x240000404:0xf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x85f51a6b96715d06 expref: -99 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051368.349135:0:46497:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950263e00/0x85f51a6b96715cff lrc: 4/0,1 mode: --/EX res: [0x240000404:0xf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x85f51a6b96715d06 expref: -99 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051368.349303:0:6564:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48a800/0x85f51a6b96715d06 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0xf:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b96715cff expref: 9 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051368.349331:0:6564:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95faeaa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000_UUID:6564:1863365452601728:0@lo:105: 00000100:00100000:3.0:1777051368.349387:0:6564:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051368.349434:0:6564:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d95ba60900 going to sleep for 11 seconds 00000100:00100000:0.0:1777051368.349562:0:99220:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452601728 00000100:00100000:0.0:1777051368.349572:0:99220:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452601728 00000100:00100000:0.0:1777051368.349633:0:99220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1777051368.349649:0:99220:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95fae8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:6564:x1863365452601728:12345-0@lo:105: 00010000:00010000:0.0:1777051368.349668:0:99220:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950263e00/0x85f51a6b96715cff lrc: 5/0,1 mode: --/EX res: [0x240000404:0xf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x85f51a6b96715d06 expref: -99 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051368.349687:0:99220:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950263e00/0x85f51a6b96715cff lrc: 5/0,1 mode: --/EX res: [0x240000404:0xf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x85f51a6b96715d06 expref: -99 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051368.349705:0:99220:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950263e00/0x85f51a6b96715cff lrc: 5/0,1 mode: --/EX res: [0x240000404:0xf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x85f51a6b96715d06 expref: -99 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051368.349723:0:99220:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950263e00/0x85f51a6b96715cff lrc: 5/0,1 mode: EX/EX res: [0x240000404:0xf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x85f51a6b96715d06 expref: -99 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051368.349740:0:99220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950263e00/0x85f51a6b96715cff lrc: 6/0,1 mode: EX/EX res: [0x240000404:0xf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x85f51a6b96715d06 expref: -99 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051368.349757:0:99220:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950263e00/0x85f51a6b96715cff lrc: 6/0,1 mode: EX/EX res: [0x240000404:0xf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x85f51a6b96715d06 expref: -99 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051368.349894:0:99220:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff99d950263e00) 00000100:00100000:0.0:1777051368.350014:0:99220:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95fae8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:6564:x1863365452601728:12345-0@lo:105: Request processed in 366us (625us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051368.350031:0:99220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1777051368.350096:0:6564:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95faeaa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000_UUID:6564:1863365452601728:0@lo:105: 00010000:00010000:0.0:1777051368.350123:0:6564:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1777051368.350187:0:6564:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da6fd41850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+19:2436:x1863365425937536:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 1362us (2037us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051368.350208:0:6564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3863 00010000:00010000:3.0:1777051368.351099:0:46497:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950263e00/0x85f51a6b96715cff lrc: 4/0,1 mode: EX/EX res: [0x240000404:0xf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x85f51a6b96715d06 expref: -99 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051368.351126:0:46497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950263e00/0x85f51a6b96715cff lrc: 4/0,1 mode: EX/EX res: [0x240000404:0xf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x85f51a6b96715d06 expref: -99 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051368.353827:0:46497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94eb2b200/0x85f51a6b96715d0d lrc: 3/0,1 mode: --/EX res: [0x240000404:0xf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051368.353852:0:46497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d94eb2b200/0x85f51a6b96715d0d lrc: 3/0,1 mode: EX/EX res: [0x240000404:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051368.353877:0:46497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d94eb2b200/0x85f51a6b96715d0d lrc: 3/0,1 mode: EX/EX res: [0x240000404:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1777051368.360283:0:46497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000bd0:0x1:0x0].4, 416 off35760 00000040:00080000:0.0:1777051368.360387:0:46497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2000032e1:0x1:0x0].4, 496 off36208 00000004:00080000:0.0:1777051368.360406:0:46497:0:(osp_trans.c:1582:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff99da7fc93f00 with version 13 00000004:00080000:2.0:1777051368.360671:0:104211:0:(osp_trans.c:1330:osp_get_next_request()) ou ffff99d9596fa9c0 version 13 rpc_version 13 00000020:00100000:2.0:1777051368.360731:0:104211:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1777051368.360748:0:104211:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff99d94ed2f480 x1863365452601984/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1728/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1777051368.360788:0:104211:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94ed2f480 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:104211:1863365452601984:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1777051368.360872:0:104211:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051368.360984:0:104211:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d95744b780 going to sleep for 11 seconds 00000100:00100000:0.0:1777051368.361140:0:47208:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452601984 00000100:00100000:0.0:1777051368.361153:0:47208:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452601984 00000100:00100000:1.0:1777051368.361363:0:46498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8130 00000100:00100000:1.0:1777051368.361390:0:46498:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f658700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+10:104211:x1863365452601984:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1777051368.362413:0:46498:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f658700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+11:104211:x1863365452601984:12345-0@lo:1000:osp_up0-1.0 Request processed in 1030us (1537us total) trans 30064771115 rc 0/0 00000100:00100000:1.0:1777051368.362430:0:46498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8130 00000100:00100000:2.0:1777051368.362634:0:104211:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94ed2f480 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:104211:1863365452601984:0@lo:1000:osp_up0-1.0 00000004:00200000:0.0:1777051368.362704:0:46497:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0xf:0x0]: returning size 4096 00010000:00010000:0.0:1777051368.362740:0:46497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94eb2b200/0x85f51a6b96715d0d lrc: 3/0,1 mode: EX/EX res: [0x240000404:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051368.362757:0:46497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d94eb2b200/0x85f51a6b96715d0d lrc: 2/0,0 mode: EX/EX res: [0x240000404:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051368.362776:0:46497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99d94eb2b200/0x85f51a6b96715d0d lrc: 3/0,0 mode: EX/EX res: [0x240000404:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051368.363122:0:46497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94eb2b200 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:0.0:1777051368.363130:0:46497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d94eb2b200/0x85f51a6b96715d0d lrc: 3/0,0 mode: EX/EX res: [0x240000404:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051368.363146:0:46497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d94eb2b200/0x85f51a6b96715d0d lrc: 4/0,0 mode: EX/EX res: [0x240000404:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051368.363171:0:46497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0xf:0x0].0x0 (ffff99d9533a8500) 00010000:00010000:0.0:1777051368.363177:0:46497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777051368.363185:0:46497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99d94eb2b200/0x85f51a6b96715d0d lrc: 2/0,0 mode: --/EX res: [0x240000404:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051368.363230:0:46497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d94eb2b200/0x85f51a6b96715d0d lrc: 0/0,0 mode: --/EX res: [0x240000404:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051368.363255:0:46497:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950263e00/0x85f51a6b96715cff lrc: 4/0,1 mode: EX/EX res: [0x240000404:0xf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x85f51a6b96715d06 expref: -99 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051368.363271:0:46497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950263e00/0x85f51a6b96715cff lrc: 4/0,1 mode: EX/EX res: [0x240000404:0xf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x85f51a6b96715d06 expref: -99 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051368.363285:0:46497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950263e00/0x85f51a6b96715cff lrc: 3/0,0 mode: EX/EX res: [0x240000404:0xf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x85f51a6b96715d06 expref: -99 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051368.363325:0:46497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1777051368.363591:0:46497:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000bd2:0xd5:0x0] 00010000:00010000:1.0:1777051368.363794:0:46497:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d941ad6400/0x85f51a6b96715ce3 lrc: 4/0,1 mode: CW/CW res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x85f51a6b96715cea expref: -99 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051368.363818:0:46497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d941ad6400/0x85f51a6b96715ce3 lrc: 4/0,1 mode: CW/CW res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x85f51a6b96715cea expref: -99 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051368.363835:0:46497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d941ad6400/0x85f51a6b96715ce3 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x85f51a6b96715cea expref: -99 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051368.363877:0:46497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000004:00080000:1.0:1777051368.363890:0:46497:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000bd2:0xd5:0x0] 00010000:00010000:1.0:1777051368.363903:0:46497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950262400/0x85f51a6b96715cf1 lrc: 4/0,1 mode: PW/PW res: [0x200000bd2:0xd5:0x0].0xceea225b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x85f51a6b96715cf8 expref: -99 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051368.363956:0:46497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950262400/0x85f51a6b96715cf1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xd5:0x0].0xceea225b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x85f51a6b96715cf8 expref: -99 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051368.363968:0:6568:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1777051368.363985:0:6568:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950263e00/0x85f51a6b96715cff lrc: 2/0,0 mode: EX/EX res: [0x240000404:0xf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x85f51a6b96715d06 expref: -99 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051368.364001:0:6567:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777051368.364006:0:6568:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d950263e00 already unused, calling callback (ffffffffc177eed0) 00010000:00010000:2.0:1777051368.364017:0:6567:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d941ad6400/0x85f51a6b96715ce3 lrc: 2/0,0 mode: CW/CW res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x85f51a6b96715cea expref: -99 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051368.364019:0:6568:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950263e00/0x85f51a6b96715cff lrc: 3/0,0 mode: EX/EX res: [0x240000404:0xf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x85f51a6b96715d06 expref: -99 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777051368.364066:0:6568:0:(mdt_handler.c:3963:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950263e00/0x85f51a6b96715cff lrc: 3/0,0 mode: EX/EX res: [0x240000404:0xf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x85f51a6b96715d06 expref: -99 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051368.364068:0:6567:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d941ad6400 already unused, calling callback (ffffffffc177eed0) 00010000:00010000:2.0:1777051368.364083:0:6567:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d941ad6400/0x85f51a6b96715ce3 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x85f51a6b96715cea expref: -99 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051368.364106:0:46497:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d943d91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+54:134567:x1863365425937280:12345-192.168.201.46@tcp:36:rm.0 Request processed in 44131us (45267us total) trans 8589934616 rc 0/0 00000004:00010000:2.0:1777051368.364111:0:6567:0:(mdt_handler.c:3963:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d941ad6400/0x85f51a6b96715ce3 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x85f51a6b96715cea expref: -99 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051368.364127:0:6568:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950263e00/0x85f51a6b96715cff lrc: 2/0,0 mode: --/EX res: [0x240000404:0xf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x85f51a6b96715d06 expref: -99 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051368.364142:0:46497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111961 00010000:00010000:3.0:1777051368.364164:0:6568:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1777051368.364247:0:6567:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d941ad6400/0x85f51a6b96715ce3 lrc: 2/0,0 mode: --/CW res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x85f51a6b96715cea expref: -99 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051368.364260:0:6568:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950263e00/0x85f51a6b96715cff lrc: 1/0,0 mode: --/EX res: [0x240000404:0xf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x85f51a6b96715d06 expref: -99 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051368.364265:0:6567:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1777051368.364287:0:6568:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950263e00/0x85f51a6b96715cff lrc: 0/0,0 mode: --/EX res: [0x240000404:0xf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x85f51a6b96715d06 expref: -99 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051368.364310:0:6567:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d941ad6400/0x85f51a6b96715ce3 lrc: 1/0,0 mode: --/CW res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x85f51a6b96715cea expref: -99 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051368.364321:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777051368.364372:0:6567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d941ad6400/0x85f51a6b96715ce3 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x85f51a6b96715cea expref: -99 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051368.364595:0:3677:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:3.0:1777051368.364601:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051368.364612:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1777051368.364624:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95fae8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452602112:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1777051368.364654:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95f659c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452602240:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1777051368.364703:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051368.365139:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1777051368.365166:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777051368.365176:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777051368.365184:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1777051368.365186:0:6566:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452602112 00000100:00100000:3.0:1777051368.365240:0:47597:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452602240 00000100:00100000:3.0:1777051368.365251:0:47597:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452602240 00000100:00100000:3.0:1777051368.366080:0:47597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13687 00000100:00100000:3.0:1777051368.366101:0:47597:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95faeb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+11:3679:x1863365452602240:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1777051368.366130:0:47597:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777051368.366162:0:47597:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263800/0x85f51a6b96715cea lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x85f51a6b96715ce3 expref: 11 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051368.366189:0:47597:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xd5:0x0].0x0 (ffff99d9413d2a00) 00010000:00010000:3.0:1777051368.366230:0:47597:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1777051368.366648:0:47597:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95faeb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+10:3679:x1863365452602240:12345-0@lo:103:ldlm_bl.0 Request processed in 551us (1511us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051368.366663:0:47597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13687 00000100:00100000:0.0:1777051368.367248:0:6566:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452602112 00000100:00100000:0.0:1777051368.367322:0:6566:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13688 00000100:00100000:0.0:1777051368.367340:0:6566:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7c9a3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+10:3677:x1863365452602112:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1777051368.367360:0:6566:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777051368.367390:0:6566:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48a800/0x85f51a6b96715d06 lrc: 0/0,0 mode: --/EX res: [0x240000404:0xf:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x85f51a6b96715cff expref: 10 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051368.367418:0:6566:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0xf:0x0].0x0 (ffff99d94e6b6700) 00010000:00010000:0.0:1777051368.367437:0:6566:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1777051368.367451:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95f659c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452602240:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1777051368.367511:0:6566:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7c9a3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+9:3677:x1863365452602112:12345-0@lo:103:ldlm_bl.0 Request processed in 172us (2808us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051368.367527:0:6566:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13688 00000100:00100000:0.0:1777051368.367583:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95fae8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452602112:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1777051368.387872:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051368.387879:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051368.388764:0:11727:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425937920 00000100:00100000:3.0:1777051368.388780:0:11727:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425937920 00000100:00100000:3.0:1777051368.388950:0:11727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 8131 00000100:00100000:3.0:1777051368.388976:0:11727:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d943d93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+24:2439:x1863365425937920:12345-192.168.201.46@tcp:63:ll_sa.0 00000100:00100000:2.0:1777051368.389738:0:6579:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425937792 00000100:00100000:2.0:1777051368.389749:0:6579:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425937792 00010000:00010000:3.0:1777051368.389760:0:11727:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777051368.389803:0:11727:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7600/0x85f51a6b96715d14 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b620c expref: -99 pid: 11727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051368.389847:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111962 00000100:00100000:2.0:1777051368.389958:0:6579:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7c9a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+26:134568:x1863365425937792:12345-192.168.201.46@tcp:101:rm.0 00010000:00010000:2.0:1777051368.389985:0:6579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051368.390014:0:6579:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d950262e00/0x85f51a6b96715d1b lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6205 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1777051368.390164:0:6579:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0xd6:0x0]: returning size 4096 00010000:00010000:2.0:1777051368.390415:0:6579:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950262e00/0x85f51a6b96715d1b lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6205 expref: 28 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051368.390449:0:6579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xd5:0x0].0x0 (ffff99d9413d2a00) 00010000:00010000:2.0:1777051368.390455:0:6579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1777051368.390470:0:6579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d950262e00/0x85f51a6b96715d1b lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6205 expref: 28 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051368.390495:0:6579:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d950262e00, rc 0) 00010000:00010000:3.0:1777051368.390778:0:11727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7200/0x85f51a6b96715d29 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 11727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051368.390810:0:11727:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7200/0x85f51a6b96715d29 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051368.390836:0:11727:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7200/0x85f51a6b96715d29 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051368.390868:0:11727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6000/0x85f51a6b96715d30 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xd5:0x0].0xceea225b bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051368.390903:0:11727:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7c00/0x85f51a6b96715cf8 lrc: 2/0,0 mode: PW/PW res: [0x200000bd2:0xd5:0x0].0xceea225b bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b96715cf1 expref: 8 pid: 46500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051368.390963:0:11727:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6000/0x85f51a6b96715d30 lrc: 4/1,0 mode: --/PR res: [0x200000bd2:0xd5:0x0].0xceea225b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051368.391018:0:11727:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7c00/0x85f51a6b96715cf8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xd5:0x0].0xceea225b bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x85f51a6b96715cf1 expref: 8 pid: 46500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051368.391430:0:11727:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95faeb100 pname:cluuid:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000_UUID:11727:1863365452602368:0@lo:104: 00000100:00100000:3.0:1777051368.391512:0:11727:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051368.391612:0:11727:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d95ba60900 going to sleep for 11 seconds 00000100:00100000:2.0:1777051368.391683:0:6579:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7c9a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+27:134568:x1863365425937792:12345-192.168.201.46@tcp:101:rm.0 Request processed in 1810us (3823us total) trans 30064771116 rc 301/301 00000100:00100000:2.0:1777051368.391702:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111962 00000100:00100000:0.0:1777051368.391980:0:102039:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452602368 00000100:00100000:0.0:1777051368.391997:0:102039:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452602368 00000100:00100000:0.0:1777051368.392100:0:102039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1777051368.392123:0:102039:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95faead80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0001-mdtlov_UUID+4:11727:x1863365452602368:12345-0@lo:104: 00010000:00010000:0.0:1777051368.392500:0:102039:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950262400/0x85f51a6b96715cf1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xd5:0x0].0xceea225b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x85f51a6b96715cf8 expref: -99 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051368.392660:0:102039:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1777051368.392674:0:102039:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95faead80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0001-mdtlov_UUID+4:11727:x1863365452602368:12345-0@lo:104: Request processed in 561us (1161us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051368.392688:0:102039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00010000:00010000:2.0:1777051368.393062:0:13753:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777051368.393079:0:13753:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950262400/0x85f51a6b96715cf1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd2:0xd5:0x0].0xceea225b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x85f51a6b96715cf8 expref: -99 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051368.393104:0:13753:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d950262400 already unused, calling callback (ffffffffc177eed0) 00010000:00010000:2.0:1777051368.393115:0:13753:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950262400/0x85f51a6b96715cf1 lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0xd5:0x0].0xceea225b bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0x85f51a6b96715cf8 expref: -99 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1777051368.393134:0:13753:0:(mdt_handler.c:3963:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950262400/0x85f51a6b96715cf1 lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0xd5:0x0].0xceea225b bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0x85f51a6b96715cf8 expref: -99 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051368.393192:0:13753:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950262400/0x85f51a6b96715cf1 lrc: 2/0,0 mode: --/PW res: [0x200000bd2:0xd5:0x0].0xceea225b bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x85f51a6b96715cf8 expref: -99 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051368.393207:0:13753:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1777051368.393276:0:13753:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950262400/0x85f51a6b96715cf1 lrc: 1/0,0 mode: --/PW res: [0x200000bd2:0xd5:0x0].0xceea225b bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x85f51a6b96715cf8 expref: -99 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051368.393295:0:13753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950262400/0x85f51a6b96715cf1 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0xd5:0x0].0xceea225b bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x85f51a6b96715cf8 expref: -99 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051368.393332:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777051368.393336:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777051368.393340:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1777051368.393363:0:3679:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1777051368.393386:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95f659c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452602496:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1777051368.393458:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051368.393774:0:24467:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452602496 00000100:00100000:0.0:1777051368.393789:0:24467:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452602496 00010000:00010000:0.0:1777051368.393832:0:24467:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7c00/0x85f51a6b96715cf8 lrc: 4/0,0 mode: PW/PW res: [0x200000bd2:0xd5:0x0].0xceea225b bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0x85f51a6b96715cf1 expref: 9 pid: 46500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051368.393942:0:24467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3864 00000100:00100000:0.0:1777051368.393968:0:24467:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f659500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+9:3679:x1863365452602496:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1777051368.393983:0:24467:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1777051368.394126:0:11727:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95faeb100 pname:cluuid:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000_UUID:11727:1863365452602368:0@lo:104: 00010000:00010000:1.0:1777051368.394166:0:11727:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6000/0x85f51a6b96715d30 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xd5:0x0].0xceea225b bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11727 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1777051368.403697:0:103159:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771116 is committed 00000001:00080000:2.0:1777051368.403718:0:103159:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771115 is committed 00000100:00100000:0.0:1777051368.403732:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00010000:00010000:1.0:1777051368.404003:0:24467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7c00/0x85f51a6b96715cf8 lrc: 0/0,0 mode: --/PW res: [0x200000bd2:0xd5:0x0].0xceea225b bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0x85f51a6b96715cf1 expref: 7 pid: 46500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051368.404063:0:6583:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425938048 00000100:00100000:3.0:1777051368.404085:0:6583:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425938048 00010000:00010000:1.0:1777051368.404087:0:24467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xd5:0x0].0xceea225b (ffff99d9413d2c00) 00010000:00010000:1.0:1777051368.404117:0:24467:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6000/0x85f51a6b96715d30 lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xd5:0x0].0xceea225b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051368.404136:0:24467:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6000/0x85f51a6b96715d30 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xd5:0x0].0xceea225b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 11727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051368.404161:0:24467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6000/0x85f51a6b96715d30 lrc: 4/1,0 mode: PR/PR res: [0x200000bd2:0xd5:0x0].0xceea225b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 11727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051368.404405:0:24467:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1777051368.404511:0:24467:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f659500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+6:3679:x1863365452602496:12345-0@lo:103:ldlm_bl.0 Request processed in 10547us (11050us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051368.404541:0:24467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3864 00010000:00010000:0.0:1777051368.404637:0:11727:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6000/0x85f51a6b96715d30 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xd5:0x0].0xceea225b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051368.404669:0:11727:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6000/0x85f51a6b96715d30 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xd5:0x0].0xceea225b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11727 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051368.404701:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95f659c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452602496:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1777051368.404749:0:11727:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7200/0x85f51a6b96715d29 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051368.404777:0:11727:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7200/0x85f51a6b96715d29 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 11727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051368.404790:0:11727:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7200/0x85f51a6b96715d29 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051368.404802:0:11727:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d941ad7200 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:0.0:1777051368.404820:0:11727:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7200/0x85f51a6b96715d29 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051368.404833:0:11727:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7200/0x85f51a6b96715d29 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 11727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051368.404863:0:11727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xd5:0x0].0x0 (ffff99d9413d2a00) 00010000:00010000:0.0:1777051368.404869:0:11727:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777051368.404876:0:11727:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7200/0x85f51a6b96715d29 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051368.404898:0:11727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7200/0x85f51a6b96715d29 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051368.404957:0:11727:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6000/0x85f51a6b96715d30 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xd5:0x0].0xceea225b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051368.404971:0:11727:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6000/0x85f51a6b96715d30 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0xd5:0x0].0xceea225b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051368.404994:0:11727:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6000/0x85f51a6b96715d30 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xd5:0x0].0xceea225b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051368.405005:0:11727:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d941ad6000 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:0.0:1777051368.405011:0:11727:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6000/0x85f51a6b96715d30 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xd5:0x0].0xceea225b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051368.405034:0:11727:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6000/0x85f51a6b96715d30 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0xd5:0x0].0xceea225b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051368.405052:0:11727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xd5:0x0].0xceea225b (ffff99d9413d2c00) 00010000:00010000:0.0:1777051368.405067:0:11727:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777051368.405073:0:11727:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6000/0x85f51a6b96715d30 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0xd5:0x0].0xceea225b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051368.405086:0:11727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6000/0x85f51a6b96715d30 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xd5:0x0].0xceea225b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051368.405203:0:11727:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7600/0x85f51a6b96715d14 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b620c expref: 26 pid: 11727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051368.405277:0:11727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xd5:0x0].0x0 (ffff99d9413d2a00) 00010000:00010000:0.0:1777051368.405283:0:11727:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1777051368.405305:0:11727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7600/0x85f51a6b96715d14 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b620c expref: 26 pid: 11727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051368.405331:0:11727:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d941ad7600, rc -2) 00000100:00100000:0.0:1777051368.405451:0:11727:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d943d93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+25:2439:x1863365425937920:12345-192.168.201.46@tcp:63:ll_sa.0 Request processed in 16483us (17593us total) trans 0 rc -2/-2 00000100:00100000:0.0:1777051368.405467:0:11727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 8131 00000100:00100000:3.0:1777051368.407903:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3341 00000100:00100000:3.0:1777051368.407981:0:6583:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7c9a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+24:134568:x1863365425938048:12345-192.168.201.46@tcp:37:rm.0 00000100:00100000:3.0:1777051368.426401:0:6583:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7c9a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+24:134568:x1863365425938048:12345-192.168.201.46@tcp:37:rm.0 Request processed in 18427us (22683us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051368.426432:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3341 00000100:00100000:1.0:1777051368.437098:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051368.437285:0:46501:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425938304 00000100:00100000:0.0:1777051368.437300:0:46501:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425938304 00000100:00100000:0.0:1777051368.437567:0:46501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3342 00000100:00100000:0.0:1777051368.437587:0:46501:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d943d93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+24:134568:x1863365425938304:12345-192.168.201.46@tcp:35:rm.0 00000100:00100000:0.0:1777051368.438047:0:46501:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d943d93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+25:134568:x1863365425938304:12345-192.168.201.46@tcp:35:rm.0 Request processed in 462us (955us total) trans 30064771117 rc 0/0 00000100:00100000:0.0:1777051368.438531:0:46501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3342 00000100:00100000:1.0:1777051368.448538:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051368.448722:0:6581:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425938560 00000100:00100000:2.0:1777051368.448735:0:6581:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425938560 00000100:00100000:2.0:1777051368.448851:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111963 00000100:00100000:2.0:1777051368.448868:0:6581:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d943d92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+25:134568:x1863365425938560:12345-192.168.201.46@tcp:101:rm.0 00010000:00010000:2.0:1777051368.448955:0:6581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051368.448999:0:6581:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d950262400/0x85f51a6b96715d37 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6244 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051368.449177:0:6581:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950262e00/0x85f51a6b96715d3e lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0xd6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051368.449203:0:6581:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d950262e00/0x85f51a6b96715d3e lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0xd6:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051368.449345:0:6581:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d950262e00/0x85f51a6b96715d3e lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0xd6:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1777051368.449368:0:6581:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0xd6:0x0]: returning size 4096 00010000:00010000:2.0:1777051368.449540:0:6581:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d950262400/0x85f51a6b96715d37 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6244 expref: 28 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051368.449581:0:6581:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950262e00/0x85f51a6b96715d3e lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0xd6:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6244 expref: 27 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051368.449608:0:6581:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xd6:0x0].0x0 (ffff99d94e81c200) 00010000:00010000:2.0:1777051368.449613:0:6581:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1777051368.449620:0:6581:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d950262e00, rc 0) 00000100:00100000:2.0:1777051368.450638:0:6581:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d943d92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+27:134568:x1863365425938560:12345-192.168.201.46@tcp:101:rm.0 Request processed in 1761us (2095us total) trans 30064771118 rc 0/0 00000100:00100000:2.0:1777051368.450655:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111963 00000100:00100000:2.0:1777051368.464686:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051368.465578:0:6580:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425938816 00000100:00100000:1.0:1777051368.465593:0:6580:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425938816 00000100:00100000:1.0:1777051368.465703:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111964 00000100:00100000:1.0:1777051368.465723:0:6580:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f659c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+27:134568:x1863365425938816:12345-192.168.201.46@tcp:36:rm.0 00010000:00010000:1.0:1777051368.466335:0:6580:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1777051368.466381:0:6580:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2a00/0x85f51a6b96715b9a lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0xc5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6187 expref: 27 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051368.466422:0:6580:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0xc5:0x0].0x0 (ffff99d9533a8b00) 00010000:00010000:1.0:1777051368.466448:0:6580:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d955a90400/0x85f51a6b96715c0a lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xd6:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b61b8 expref: 26 pid: 27885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051368.466470:0:6580:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xd6:0x0].0x0 (ffff99d94e81c200) 00010000:00010000:1.0:1777051368.466483:0:6580:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1777051368.466529:0:6580:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48ae00/0x85f51a6b96715d4c lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0xd6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051368.466555:0:6580:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48ae00/0x85f51a6b96715d4c lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051368.466582:0:6580:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48ae00/0x85f51a6b96715d4c lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051368.466616:0:6580:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48a800/0x85f51a6b96715d53 lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0xd6:0x0].0xc67b6e72 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051368.466633:0:6580:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48a800/0x85f51a6b96715d53 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xd6:0x0].0xc67b6e72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051368.466654:0:6580:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48a800/0x85f51a6b96715d53 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xd6:0x0].0xc67b6e72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051368.467256:0:6580:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48bc00/0x85f51a6b96715d5a lrc: 3/0,1 mode: --/EX res: [0x200000bd3:0xc5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051368.467288:0:6580:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d785e00/0x85f51a6b96715a9e lrc: 2/0,0 mode: PR/PR res: [0x200000bd3:0xc5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b613a expref: 18 pid: 46494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051368.467307:0:6580:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48bc00/0x85f51a6b96715d5a lrc: 4/0,1 mode: --/EX res: [0x200000bd3:0xc5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051368.467378:0:6580:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d785e00/0x85f51a6b96715a9e lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0xc5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b613a expref: 18 pid: 46494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051368.467414:0:6580:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d785e00/0x85f51a6b96715a9e lrc: 4/0,0 mode: PR/PR res: [0x200000bd3:0xc5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b613a expref: 18 pid: 46494 timeout: 8097 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051368.467460:0:6580:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d943d90700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6580:1863365452602624:192.168.201.46@tcp:104: 00000100:00100000:1.0:1777051368.467614:0:6580:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da4a170300 going to sleep for 11 seconds 00000100:00100000:2.0:1777051368.477200:0:6580:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d943d90700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6580:1863365452602624:192.168.201.46@tcp:104: 00000100:00100000:3.0:1777051368.477308:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00010000:00010000:2.0:1777051368.477325:0:6580:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48bc00/0x85f51a6b96715d5a lrc: 3/0,1 mode: --/EX res: [0x200000bd3:0xc5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051368.477510:0:9550:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425938944 00000100:00100000:1.0:1777051368.477525:0:9550:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425938944 00010000:00010000:1.0:1777051368.477583:0:9550:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d785e00/0x85f51a6b96715a9e lrc: 4/0,0 mode: PR/PR res: [0x200000bd3:0xc5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b613a expref: 19 pid: 46494 timeout: 8097 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051368.477669:0:9550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3865 00000100:00100000:1.0:1777051368.477694:0:9550:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95faeb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+19:2436:x1863365425938944:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1777051368.477724:0:9550:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1777051368.477737:0:9550:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d785e00/0x85f51a6b96715a9e lrc: 4/0,0 mode: PR/PR res: [0x200000bd3:0xc5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b613a expref: 19 pid: 46494 timeout: 8097 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051368.477772:0:9550:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d785e00/0x85f51a6b96715a9e lrc: 3/0,0 mode: PR/PR res: [0x200000bd3:0xc5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b613a expref: 19 pid: 46494 timeout: 8097 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051368.477814:0:9550:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d785e00/0x85f51a6b96715a9e lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0xc5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b613a expref: 19 pid: 46494 timeout: 8097 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051368.477848:0:9550:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0xc5:0x0].0x0 (ffff99d9533a8b00) 00010000:00010000:1.0:1777051368.477857:0:9550:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48bc00/0x85f51a6b96715d5a lrc: 3/0,1 mode: --/EX res: [0x200000bd3:0xc5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051368.477874:0:9550:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48bc00/0x85f51a6b96715d5a lrc: 3/0,1 mode: EX/EX res: [0x200000bd3:0xc5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051368.477901:0:9550:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48bc00/0x85f51a6b96715d5a lrc: 4/0,1 mode: EX/EX res: [0x200000bd3:0xc5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051368.478000:0:9550:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1777051368.478098:0:6580:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48bc00/0x85f51a6b96715d5a lrc: 3/0,1 mode: EX/EX res: [0x200000bd3:0xc5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051368.478115:0:9550:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95faeb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+18:2436:x1863365425938944:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 418us (812us total) trans 0 rc 0/0 00010000:00010000:2.0:1777051368.478128:0:6580:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48bc00/0x85f51a6b96715d5a lrc: 3/0,1 mode: EX/EX res: [0x200000bd3:0xc5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051368.478145:0:9550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3865 00000040:00080000:2.0:1777051368.478822:0:6580:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x29:0x0].2, 64 off8320 00000004:00080000:2.0:1777051368.478847:0:6580:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 7997671643575ns, next at 7998671639855ns, rc = 0 00010000:00010000:2.0:1777051368.478997:0:6580:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950262400/0x85f51a6b96715d61 lrc: 3/0,1 mode: --/PW res: [0x200000bd3:0xc5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051368.479026:0:6580:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d950262400/0x85f51a6b96715d61 lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0xc5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051368.479044:0:6580:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d950262400/0x85f51a6b96715d61 lrc: 3/0,1 mode: PW/PW res: [0x200000bd3:0xc5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051368.479064:0:6580:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950262400/0x85f51a6b96715d61 lrc: 4/0,1 mode: PW/PW res: [0x200000bd3:0xc5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051368.479077:0:6580:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950262400/0x85f51a6b96715d61 lrc: 4/0,1 mode: PW/PW res: [0x200000bd3:0xc5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051368.479105:0:6580:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d950262400/0x85f51a6b96715d61 lrc: 3/0,0 mode: PW/PW res: [0x200000bd3:0xc5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051368.479155:0:6580:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1777051368.479239:0:38719:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777051368.479258:0:38719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d950262400/0x85f51a6b96715d61 lrc: 2/0,0 mode: PW/PW res: [0x200000bd3:0xc5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051368.479276:0:38719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d950262400 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:1.0:1777051368.479283:0:38719:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d950262400/0x85f51a6b96715d61 lrc: 2/0,0 mode: PW/PW res: [0x200000bd3:0xc5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051368.479305:0:38719:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d950262400/0x85f51a6b96715d61 lrc: 3/0,0 mode: PW/PW res: [0x200000bd3:0xc5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051368.479326:0:38719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0xc5:0x0].0x0 (ffff99d9533a8b00) 00010000:00010000:1.0:1777051368.479332:0:38719:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1777051368.479344:0:38719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d950262400/0x85f51a6b96715d61 lrc: 1/0,0 mode: --/PW res: [0x200000bd3:0xc5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051368.479356:0:38719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d950262400/0x85f51a6b96715d61 lrc: 0/0,0 mode: --/PW res: [0x200000bd3:0xc5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051368.479377:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051368.479386:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051368.479390:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777051368.479613:0:6580:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48bc00/0x85f51a6b96715d5a lrc: 3/0,1 mode: EX/EX res: [0x200000bd3:0xc5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051368.479634:0:6580:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48bc00/0x85f51a6b96715d5a lrc: 2/0,0 mode: EX/EX res: [0x200000bd3:0xc5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051368.479648:0:6580:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48bc00/0x85f51a6b96715d5a lrc: 3/0,0 mode: EX/EX res: [0x200000bd3:0xc5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051368.479658:0:6580:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94e48bc00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:2.0:1777051368.479666:0:6580:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48bc00/0x85f51a6b96715d5a lrc: 3/0,0 mode: EX/EX res: [0x200000bd3:0xc5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051368.479684:0:6580:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48bc00/0x85f51a6b96715d5a lrc: 4/0,0 mode: EX/EX res: [0x200000bd3:0xc5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051368.479704:0:6580:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd3:0xc5:0x0].0x0 (ffff99d9533a8b00) 00010000:00010000:2.0:1777051368.479714:0:6580:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1777051368.481100:0:6580:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48bc00/0x85f51a6b96715d5a lrc: 2/0,0 mode: --/EX res: [0x200000bd3:0xc5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051368.481118:0:6580:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48bc00/0x85f51a6b96715d5a lrc: 0/0,0 mode: --/EX res: [0x200000bd3:0xc5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051368.481171:0:6580:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48ae00/0x85f51a6b96715d4c lrc: 4/0,1 mode: CW/CW res: [0x200000bd2:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051368.481267:0:6580:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48ae00/0x85f51a6b96715d4c lrc: 4/0,1 mode: CW/CW res: [0x200000bd2:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051368.481282:0:6580:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48ae00/0x85f51a6b96715d4c lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051368.481300:0:6580:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48ae00/0x85f51a6b96715d4c lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051368.481311:0:6580:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94e48ae00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:2.0:1777051368.481318:0:6580:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48ae00/0x85f51a6b96715d4c lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051368.481335:0:6580:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48ae00/0x85f51a6b96715d4c lrc: 5/0,0 mode: CW/CW res: [0x200000bd2:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051368.481353:0:6580:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xd6:0x0].0x0 (ffff99d94e81c200) 00010000:00010000:2.0:1777051368.481360:0:6580:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777051368.481366:0:6580:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48ae00/0x85f51a6b96715d4c lrc: 3/0,0 mode: --/CW res: [0x200000bd2:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051368.481381:0:6580:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48ae00/0x85f51a6b96715d4c lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1777051368.481396:0:6580:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000008528ae24 reply state 00000000c3f394bd transno 30064771119 ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48a800/0x85f51a6b96715d53 lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xd6:0x0].0xc67b6e72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051368.481420:0:6580:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48a800/0x85f51a6b96715d53 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0xd6:0x0].0xc67b6e72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051368.481434:0:6580:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xd6:0x0].0xc67b6e72 (ffff99d94e629e00) 00010000:00010000:2.0:1777051368.481439:0:6580:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1777051368.481444:0:6580:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1777051368.481561:0:6580:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f659c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+27:134568:x1863365425938816:12345-192.168.201.46@tcp:36:rm.0 Request processed in 15840us (16884us total) trans 30064771119 rc 0/0 00000100:00100000:2.0:1777051368.481579:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111964 00000100:00100000:0.0:1777051368.489601:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051368.489759:0:6582:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425939200 00000100:00100000:2.0:1777051368.489772:0:6582:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425939200 00000100:00100000:2.0:1777051368.489876:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3343 00000100:00100000:2.0:1777051368.489900:0:6582:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7c9a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+27:134568:x1863365425939200:12345-192.168.201.46@tcp:35:rm.0 00000100:00100000:2.0:1777051368.490344:0:6582:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7c9a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+28:134568:x1863365425939200:12345-192.168.201.46@tcp:35:rm.0 Request processed in 440us (743us total) trans 30064771120 rc 0/0 00000100:00100000:2.0:1777051368.490360:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3343 00000100:00100000:1.0:1777051368.498977:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051368.499379:0:27885:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425939456 00000100:00100000:2.0:1777051368.499392:0:27885:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425939456 00000100:00100000:2.0:1777051368.499493:0:27885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111965 00000100:00100000:2.0:1777051368.500105:0:27885:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d943d91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+28:134568:x1863365425939456:12345-192.168.201.46@tcp:36:rm.0 00010000:00010000:2.0:1777051368.500184:0:27885:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1777051368.500226:0:27885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d950262e00/0x85f51a6b96715d3e lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0xd6:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6244 expref: 28 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051368.500269:0:27885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d784e00/0x85f51a6b96715b7e lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xd6:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6180 expref: 27 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051368.500296:0:27885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xd6:0x0].0x0 (ffff99d94e81c200) 00010000:00010000:2.0:1777051368.500306:0:27885:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1777051368.500339:0:27885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263200/0x85f51a6b96715d68 lrc: 3/0,1 mode: --/CW res: [0x200000bd2:0xd5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051368.500363:0:27885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263200/0x85f51a6b96715d68 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051368.500394:0:27885:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263200/0x85f51a6b96715d68 lrc: 3/0,1 mode: CW/CW res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051368.500422:0:27885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950262200/0x85f51a6b96715d6f lrc: 3/0,1 mode: --/PW res: [0x200000bd2:0xd5:0x0].0xac1bda01 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051368.500436:0:27885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d950262200/0x85f51a6b96715d6f lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xd5:0x0].0xac1bda01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051368.500450:0:27885:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d950262200/0x85f51a6b96715d6f lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xd5:0x0].0xac1bda01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051368.501476:0:27885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950262400/0x85f51a6b96715d76 lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0xd6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051368.501541:0:27885:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2e00/0x85f51a6b96715ac8 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0xd6:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6148 expref: 17 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051368.501559:0:27885:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d950262400/0x85f51a6b96715d76 lrc: 4/0,1 mode: --/EX res: [0x200000bd2:0xd6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051368.501621:0:27885:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2e00/0x85f51a6b96715ac8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xd6:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6148 expref: 17 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051368.501647:0:27885:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2e00/0x85f51a6b96715ac8 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0xd6:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6148 expref: 17 pid: 27882 timeout: 8097 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051368.501678:0:27885:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95f658a80 pname:cluuid:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000_UUID:27885:1863365452602752:192.168.201.46@tcp:104: 00000100:00100000:2.0:1777051368.501795:0:27885:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d95744b3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1777051368.506666:0:27885:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95f658a80 pname:cluuid:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000_UUID:27885:1863365452602752:192.168.201.46@tcp:104: 00010000:00010000:2.0:1777051368.507081:0:27885:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99d950262400/0x85f51a6b96715d76 lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0xd6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051368.507504:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051368.507619:0:47597:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425939584 00000100:00100000:3.0:1777051368.507630:0:47597:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425939584 00010000:00010000:3.0:1777051368.507674:0:47597:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2e00/0x85f51a6b96715ac8 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0xd6:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6148 expref: 18 pid: 27882 timeout: 8097 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051368.508189:0:6566:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3866 00000100:00100000:0.0:1777051368.508274:0:6566:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d943d91f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+18:2437:x1863365425939584:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1777051368.508298:0:6566:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777051368.508311:0:6566:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2e00/0x85f51a6b96715ac8 lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0xd6:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6148 expref: 18 pid: 27882 timeout: 8097 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051368.508337:0:6566:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2e00/0x85f51a6b96715ac8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xd6:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6148 expref: 18 pid: 27882 timeout: 8097 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051368.508368:0:6566:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2e00/0x85f51a6b96715ac8 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xd6:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6148 expref: 18 pid: 27882 timeout: 8097 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051368.508405:0:6566:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xd6:0x0].0x0 (ffff99d94e81c200) 00010000:00010000:0.0:1777051368.508414:0:6566:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99d950262400/0x85f51a6b96715d76 lrc: 3/0,1 mode: --/EX res: [0x200000bd2:0xd6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051368.508430:0:6566:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99d950262400/0x85f51a6b96715d76 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0xd6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051368.508442:0:6566:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d950262400/0x85f51a6b96715d76 lrc: 4/0,1 mode: EX/EX res: [0x200000bd2:0xd6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051368.508493:0:6566:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1777051368.508566:0:6566:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d943d91f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+17:2437:x1863365425939584:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 301us (1064us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051368.508578:0:6566:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3866 00010000:00010000:2.0:1777051368.508639:0:27885:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99d950262400/0x85f51a6b96715d76 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0xd6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051368.508660:0:27885:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d950262400/0x85f51a6b96715d76 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0xd6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1777051368.509475:0:27885:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd2:0xd6:0x0]: returning size 4096 00010000:00010000:2.0:1777051368.509504:0:27885:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950262400/0x85f51a6b96715d76 lrc: 3/0,1 mode: EX/EX res: [0x200000bd2:0xd6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051368.509520:0:27885:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d950262400/0x85f51a6b96715d76 lrc: 2/0,0 mode: EX/EX res: [0x200000bd2:0xd6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051368.509535:0:27885:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d950262400/0x85f51a6b96715d76 lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0xd6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051368.509548:0:27885:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d950262400 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:2.0:1777051368.509557:0:27885:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d950262400/0x85f51a6b96715d76 lrc: 3/0,0 mode: EX/EX res: [0x200000bd2:0xd6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051368.509572:0:27885:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d950262400/0x85f51a6b96715d76 lrc: 4/0,0 mode: EX/EX res: [0x200000bd2:0xd6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051368.509591:0:27885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xd6:0x0].0x0 (ffff99d94e81c200) 00010000:00010000:2.0:1777051368.509597:0:27885:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1777051368.509604:0:27885:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d950262400/0x85f51a6b96715d76 lrc: 2/0,0 mode: --/EX res: [0x200000bd2:0xd6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051368.509625:0:27885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d950262400/0x85f51a6b96715d76 lrc: 0/0,0 mode: --/EX res: [0x200000bd2:0xd6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051368.509987:0:27885:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263200/0x85f51a6b96715d68 lrc: 4/0,1 mode: CW/CW res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051368.510003:0:27885:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263200/0x85f51a6b96715d68 lrc: 4/0,1 mode: CW/CW res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051368.510014:0:27885:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263200/0x85f51a6b96715d68 lrc: 3/0,0 mode: CW/CW res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051368.510027:0:27885:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263200/0x85f51a6b96715d68 lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051368.510039:0:27885:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d950263200 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:2.0:1777051368.510046:0:27885:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263200/0x85f51a6b96715d68 lrc: 4/0,0 mode: CW/CW res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051368.510058:0:27885:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263200/0x85f51a6b96715d68 lrc: 5/0,0 mode: CW/CW res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051368.510076:0:27885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xd5:0x0].0x0 (ffff99d9413d2a00) 00010000:00010000:2.0:1777051368.510081:0:27885:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777051368.510086:0:27885:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263200/0x85f51a6b96715d68 lrc: 3/0,0 mode: --/CW res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051368.510100:0:27885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263200/0x85f51a6b96715d68 lrc: 0/0,0 mode: --/CW res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1777051368.510120:0:27885:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000cfd24218 reply state 0000000085098339 transno 30064771121 ns: mdt-lustre-MDT0000_UUID lock: ffff99d950262200/0x85f51a6b96715d6f lrc: 3/0,1 mode: PW/PW res: [0x200000bd2:0xd5:0x0].0xac1bda01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051368.510141:0:27885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d950262200/0x85f51a6b96715d6f lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0xd5:0x0].0xac1bda01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051368.510503:0:27885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xd5:0x0].0xac1bda01 (ffff99da61538700) 00010000:00010000:2.0:1777051368.510510:0:27885:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1777051368.510516:0:27885:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1777051368.510609:0:27885:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d943d91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+28:134568:x1863365425939456:12345-192.168.201.46@tcp:36:rm.0 Request processed in 10512us (11636us total) trans 30064771121 rc 0/0 00000100:00100000:2.0:1777051368.510625:0:27885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111965 00010000:00010000:3.0:1777051368.535497:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1777051368.622613:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051368.622741:0:46494:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425939712 00000100:00100000:2.0:1777051368.622754:0:46494:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425939712 00000100:00100000:2.0:1777051368.622830:0:46494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111966 00000100:00100000:2.0:1777051368.622848:0:46494:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7c9a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c11b6966-0775-44d2-bdc6-c74c26eb2226+17:134099:x1863365425939712:12345-192.168.201.46@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1777051368.623033:0:46494:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7c9a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c11b6966-0775-44d2-bdc6-c74c26eb2226+17:134099:x1863365425939712:12345-192.168.201.46@tcp:60:lhsmtool_posix.0 Request processed in 188us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051368.623048:0:46494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111966 00000100:00100000:1.0:1777051368.627780:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051368.627877:0:21368:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425939840 00000100:00100000:0.0:1777051368.627886:0:21368:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425939840 00000100:00100000:0.0:1777051368.627990:0:21368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111967 00000100:00100000:0.0:1777051368.628008:0:21368:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d943d90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+8:134099:x1863365425939840:12345-192.168.201.46@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1777051368.628117:0:21368:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d943d90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+8:134099:x1863365425939840:12345-192.168.201.46@tcp:60:lhsmtool_posix.0 Request processed in 112us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051368.628155:0:21368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111967 00000100:00100000:0.0:1777051368.632580:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051368.633028:0:24269:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425940096 00000100:00100000:2.0:1777051368.633056:0:24269:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425940096 00000100:00100000:2.0:1777051368.633135:0:24269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3344 00000100:00100000:2.0:1777051368.633152:0:24269:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7c9a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+17:134099:x1863365425940096:12345-192.168.201.46@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1777051368.633480:0:24269:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7c9a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+18:134099:x1863365425940096:12345-192.168.201.46@tcp:35:lhsmtool_posix.0 Request processed in 330us (905us total) trans 30064771122 rc 0/0 00000100:00100000:2.0:1777051368.633495:0:24269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3344 00010000:00010000:1.0:1777051369.559253:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1777051369.994354:0:105797:0:(debug.c:645:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-hsm test 402a: Copytool start fails if all MDTs are inactive ========================================================== 13:22:48 (1777051368) 00000100:00100000:3.0:1777051370.264572:0:3678:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1777051370.264605:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da44496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452602880:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1777051370.264701:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051370.266053:0:46500:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452602880 00000100:00100000:0.0:1777051370.266066:0:46500:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452602880 00000100:00100000:0.0:1777051370.266446:0:46500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8132 00000100:00100000:0.0:1777051370.266464:0:46500:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95fae8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+6:3678:x1863365452602880:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1777051370.266517:0:46500:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4194304 pending 0 free 1441583104 avail 1295343616 00000100:00100000:0.0:1777051370.266602:0:46500:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95fae8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+6:3678:x1863365452602880:12345-0@lo:41:osp-pre-0-1.0 Request processed in 141us (1900us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051370.266626:0:46500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8132 00000100:00100000:3.0:1777051370.266699:0:3678:0:(client.c:3101:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 30064771115 gen 2 00000004:00080000:3.0:1777051370.266709:0:3678:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 30064771114 committed transno 30064771115 00000004:00080000:3.0:1777051370.266734:0:3678:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 30064771115 committed transno 30064771115 00000100:00100000:3.0:1777051370.266768:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da44496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452602880:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1777051370.582661:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777051370.774547:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da44494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3680:1863365452603264:0@lo:400:kworker.0 00000100:00100000:2.0:1777051370.774602:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f825180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452603136:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1777051370.774643:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051370.774673:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d950266a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3677:1863365452603392:0@lo:400:kworker.0 00000100:00100000:2.0:1777051370.774677:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051370.775113:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d950264a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3680:1863365452603776:0@lo:400:kworker.0 00000100:00100000:0.0:1777051370.775119:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051370.775544:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051370.775709:0:27882:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452603264 00000100:00100000:1.0:1777051370.775720:0:27882:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452603264 00000100:00100000:1.0:1777051370.775790:0:27882:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452603392 00000100:00100000:1.0:1777051370.775794:0:27882:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452603392 00000100:00100000:1.0:1777051370.775850:0:27882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13277 00000100:00100000:1.0:1777051370.775864:0:27882:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95faeaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0000_UUID+5:3680:x1863365452603264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777051370.775908:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d950267b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3679:1863365452603648:0@lo:400:kworker.0 00000100:00100000:0.0:1777051370.775909:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d950265c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3677:1863365452603904:0@lo:400:kworker.0 00000100:00100000:0.0:1777051370.775958:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051370.775959:0:27882:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95faeaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0000_UUID+5:3680:x1863365452603264:12345-0@lo:400:kworker.0 Request processed in 98us (1318us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051370.775969:0:27882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13277 00000100:00100000:1.0:1777051370.775998:0:27882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13278 00000100:00100000:1.0:1777051370.776010:0:27882:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d950264700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0000_UUID+5:3677:x1863365452603392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777051370.776039:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051370.776090:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d950267480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3679:1863365452604160:0@lo:400:kworker.0 00000100:00100000:3.0:1777051370.776251:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d950267100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3680:1863365452604288:0@lo:400:kworker.0 00000100:00100000:1.0:1777051370.777517:0:27882:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d950264700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0000_UUID+5:3677:x1863365452603392:12345-0@lo:400:kworker.0 Request processed in 1508us (2396us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051370.777528:0:27882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13278 00000100:00100000:1.0:1777051370.777549:0:27882:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452603648 00000100:00100000:1.0:1777051370.777554:0:27882:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452603648 00000100:00100000:1.0:1777051370.777608:0:27882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13279 00000100:00100000:0.0:1777051370.777636:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d950265f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452604416:0@lo:400:kworker.0 00000100:00100000:1.0:1777051370.777649:0:27882:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f659f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0001_UUID+5:3679:x1863365452603648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777051370.777655:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051370.777684:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051370.777986:0:6581:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452604160 00000100:00100000:2.0:1777051370.777994:0:6581:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452604160 00000100:00100000:2.0:1777051370.778037:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13280 00000100:00100000:2.0:1777051370.778048:0:6581:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f65b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3679:x1863365452604160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051370.780179:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051370.780237:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da44494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3680:1863365452603264:0@lo:400:kworker.0 00000100:00100000:3.0:1777051370.780303:0:8470:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452603904 00000100:00100000:3.0:1777051370.780309:0:8470:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452603904 00000100:00100000:1.0:1777051370.780387:0:27882:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f659f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0001_UUID+5:3679:x1863365452603648:12345-0@lo:400:kworker.0 Request processed in 2744us (4349us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051370.780417:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d950266a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3677:1863365452603392:0@lo:400:kworker.0 00000100:00100000:1.0:1777051370.780418:0:27882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13279 00000100:00100000:0.0:1777051370.780432:0:3677:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:0.0:1777051370.780443:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da44496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3677:1863365452603008:0@lo:400:kworker.0 00000100:00100000:1.0:1777051370.780453:0:46498:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452603136 00000100:00100000:1.0:1777051370.780458:0:46498:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452603136 00000100:00100000:0.0:1777051370.780484:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051370.780493:0:46498:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452603776 00000100:00100000:1.0:1777051370.780497:0:46498:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452603776 00000100:00100000:0.0:1777051370.780519:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d950265880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3677:1863365452603520:0@lo:400:kworker.0 00000100:00100000:1.0:1777051370.780534:0:46498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8133 00000100:00100000:0.0:1777051370.780543:0:11727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8134 00000100:00100000:1.0:1777051370.780544:0:46498:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f658a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+7:3679:x1863365452603136:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1777051370.780552:0:11727:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94ed2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:3680:x1863365452603776:12345-0@lo:400:kworker.0 00000004:00000024:1.0:1777051370.780578:0:46498:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4194304 pending 0 free 1446154240 avail 1299914752 00000100:00100000:0.0:1777051370.780601:0:11727:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94ed2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:3680:x1863365452603776:12345-0@lo:400:kworker.0 Request processed in 50us (5058us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051370.780611:0:11727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8134 00000100:00100000:1.0:1777051370.780618:0:46498:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f658a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+7:3679:x1863365452603136:12345-0@lo:41:osp-pre-1-0.0 Request processed in 76us (5945us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051370.780626:0:46498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8133 00000100:00100000:0.0:1777051370.780646:0:27887:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452604416 00000100:00080000:1.0:1777051370.780646:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1777051370.780651:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1777051370.780652:0:27887:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452604416 00000100:00080000:1.0:1777051370.780655:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1777051370.780694:0:27887:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452604288 00000100:00100000:0.0:1777051370.780699:0:27887:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452604288 00000100:00100000:1.0:1777051370.780703:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f825180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452603136:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1777051370.780991:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d950267b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3679:1863365452603648:0@lo:400:kworker.0 00000100:00100000:0.0:1777051370.780997:0:27887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10343 00000100:00100000:0.0:1777051370.781007:0:27887:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d950266680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3677:x1863365452604416:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1777051370.781047:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1777051370.781051:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1777051370.781052:0:27887:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d950266680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3677:x1863365452604416:12345-0@lo:400:kworker.0 Request processed in 46us (3373us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051370.781062:0:27887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10343 00000100:00100000:0.0:1777051370.781081:0:27887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10344 00000100:00100000:1.0:1777051370.781083:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051370.781090:0:27887:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d9418f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3680:x1863365452604288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777051370.781109:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d950267800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3677:1863365452604032:0@lo:400:kworker.0 00000100:00100000:0.0:1777051370.781130:0:27887:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d9418f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3680:x1863365452604288:12345-0@lo:400:kworker.0 Request processed in 40us (950us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051370.781136:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051370.781139:0:27887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10344 00000100:00100000:0.0:1777051370.781154:0:27887:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452604032 00000100:00100000:0.0:1777051370.781158:0:27887:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452604032 00000100:00100000:1.0:1777051370.781160:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d950264000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3677:1863365452604544:0@lo:400:kworker.0 00000100:00100000:1.0:1777051370.781189:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051370.781195:0:27887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10345 00000100:00100000:0.0:1777051370.781203:0:27887:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f826680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3677:x1863365452604032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777051370.781244:0:27887:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f826680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3677:x1863365452604032:12345-0@lo:400:kworker.0 Request processed in 41us (106us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051370.781245:0:6579:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452603520 00000100:00100000:1.0:1777051370.781250:0:6579:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452603520 00000100:00100000:0.0:1777051370.781253:0:27887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10345 00000100:00100000:1.0:1777051370.781283:0:6579:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452604544 00000100:00100000:0.0:1777051370.781286:0:21368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13281 00000100:00100000:1.0:1777051370.781287:0:6579:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452604544 00000100:00100000:0.0:1777051370.781295:0:21368:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f825180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3677:x1863365452603520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777051370.781311:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13282 00000100:00100000:1.0:1777051370.781320:0:6579:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f824e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3677:x1863365452604544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777051370.781364:0:21368:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f825180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3677:x1863365452603520:12345-0@lo:400:kworker.0 Request processed in 69us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051370.781365:0:6579:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f824e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3677:x1863365452604544:12345-0@lo:400:kworker.0 Request processed in 45us (175us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051370.781374:0:21368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13281 00000100:00100000:2.0:1777051370.781436:0:6581:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f65b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3679:x1863365452604160:12345-0@lo:400:kworker.0 Request processed in 3390us (3792us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051370.781436:0:8470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10346 00000100:00100000:3.0:1777051370.781445:0:8470:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d950265500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3677:x1863365452603904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051370.781492:0:8470:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d950265500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3677:x1863365452603904:12345-0@lo:400:kworker.0 Request processed in 47us (5533us total) trans 0 rc 0/0 00000100:00080000:0.0:1777051370.781493:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1777051370.781497:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1777051370.781501:0:8470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10346 00000100:00100000:3.0:1777051370.781532:0:103166:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452603008 00000100:00100000:3.0:1777051370.781537:0:103166:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452603008 00000100:00100000:0.0:1777051370.781539:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d950264000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3677:1863365452604544:0@lo:400:kworker.0 00000100:00100000:0.0:1777051370.781553:0:3677:0:(client.c:3101:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968352 gen 2 00000004:00080000:0.0:1777051370.781560:0:3677:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff99da44494380, transno 4294968352 00000100:00100000:0.0:1777051370.781573:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d950265c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3677:1863365452603904:0@lo:400:kworker.0 00000100:00100000:3.0:1777051370.781573:0:103166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1777051370.781582:0:103166:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f3df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9351a01-5b0e-4470-97fd-58b9b4b312a2+23:3677:x1863365452603008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051370.781626:0:103166:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f3df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9351a01-5b0e-4470-97fd-58b9b4b312a2+23:3677:x1863365452603008:12345-0@lo:400:kworker.0 Request processed in 45us (1141us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051370.781634:0:103166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1777051370.781692:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d950264a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3680:1863365452603776:0@lo:400:kworker.0 00000100:00100000:3.0:1777051370.781705:0:3680:0:(client.c:3101:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294968353 gen 2 00000100:00100000:0.0:1777051370.781709:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d950265f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452604416:0@lo:400:kworker.0 00000004:00080000:3.0:1777051370.781710:0:3680:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff99d9533bc380, transno 4294968353 00000100:00100000:3.0:1777051370.781723:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d950267100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3680:1863365452604288:0@lo:400:kworker.0 00000100:00100000:0.0:1777051370.781735:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da44496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3677:1863365452603008:0@lo:400:kworker.0 00000100:00100000:0.0:1777051370.781748:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d950265880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3677:1863365452603520:0@lo:400:kworker.0 00000100:00100000:0.0:1777051370.781760:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d950267800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3677:1863365452604032:0@lo:400:kworker.0 00000100:00100000:0.0:1777051370.781818:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d950267480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3679:1863365452604160:0@lo:400:kworker.0 00000100:00100000:1.0:1777051370.781931:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13282 00000100:00100000:2.0:1777051370.781957:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13280 00000004:00080000:3.0:1777051371.287409:0:104216:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 8000480208101ns, next at 8001480202788ns, rc = 0 00000100:00100000:2.0:1777051371.287435:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d9418f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3680:1863365452604800:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1777051371.287547:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051371.287609:0:3680:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1777051371.287625:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95f65a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3680:1863365452604672:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1777051371.287660:0:8472:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452604800 00000100:00100000:3.0:1777051371.287670:0:8472:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452604800 00000100:00100000:2.0:1777051371.287679:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051371.288011:0:8472:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452604672 00000100:00100000:3.0:1777051371.288019:0:8472:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452604672 00000100:00100000:3.0:1777051371.288063:0:8472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5614 00000100:00100000:3.0:1777051371.288080:0:8472:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d960409c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3680:x1863365452604800:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1777051371.288118:0:8473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5615 00002000:00000024:3.0:1777051371.288140:0:8472:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 445021760 pending 0 free 3643756544 avail 3412234240 00000100:00100000:2.0:1777051371.288154:0:8473:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d960409180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3680:x1863365452604672:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1777051371.288185:0:8473:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 455081536 pending 0 free 3862671360 avail 3631149056 00000100:00100000:3.0:1777051371.288362:0:8472:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d960409c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3680:x1863365452604800:12345-0@lo:13:osp-pre-1-1.0 Request processed in 284us (814us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051371.288376:0:8472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5614 00000100:00100000:2.0:1777051371.288387:0:8473:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d960409180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3680:x1863365452604672:12345-0@lo:13:osp-pre-0-1.0 Request processed in 237us (707us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051371.288398:0:8473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5615 00000100:00100000:3.0:1777051371.288461:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95f65a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3680:1863365452604672:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1777051371.288493:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d9418f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3680:1863365452604800:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1777051371.607776:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1777051371.670590:0:104226:0:(llog.c:801:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1777051371.670601:0:104226:0:(llog_cat.c:158:llog_cat_process_common()) processing log [0x1:0x12:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1777051371.670673:0:104226:0:(llog.c:858:llog_process_thread()) stop processing plain [0x1:0x12:0x0] index 3 count 3 00000040:00080000:2.0:1777051371.670686:0:104226:0:(llog.c:858:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1777051372.451902:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051372.451988:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051372.452039:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051372.452043:0:103168:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425941120 00000100:00100000:0.0:1777051372.452059:0:103168:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425941120 00000100:00100000:3.0:1777051372.452087:0:27887:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425941248 00000100:00100000:1.0:1777051372.452096:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051372.452102:0:27887:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425941248 00000100:00100000:0.0:1777051372.452152:0:103168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 156 00000100:00100000:1.0:1777051372.452169:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051372.452180:0:103168:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f3de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:29c4352d-3260-4734-909d-9ea5de9e7fa4+12:2437:x1863365425941120:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:0.0:1777051372.452331:0:103168:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f3de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:29c4352d-3260-4734-909d-9ea5de9e7fa4+12:2437:x1863365425941120:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 162us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051372.452347:0:103168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 156 00000100:00080000:0.0:1777051372.452402:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1777051372.452490:0:27887:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425941504 00000100:00100000:3.0:1777051372.452500:0:27887:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425941504 00000100:00100000:0.0:1777051372.452569:0:8628:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425941376 00000100:00100000:3.0:1777051372.452569:0:27887:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425941632 00000100:00100000:3.0:1777051372.452579:0:27887:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425941632 00000100:00100000:0.0:1777051372.452583:0:8628:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425941376 00000100:00100000:3.0:1777051372.452640:0:27887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10347 00000100:00100000:1.0:1777051372.453334:0:13320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10348 00000100:00100000:3.0:1777051372.453341:0:27887:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94e626680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c11b6966-0775-44d2-bdc6-c74c26eb2226+50:2436:x1863365425941248:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:1.0:1777051372.453364:0:13320:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94e627b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+50:2436:x1863365425941504:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:0.0:1777051372.453395:0:8628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10349 00000100:00100000:0.0:1777051372.453417:0:8628:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94e625880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+47:2437:x1863365425941632:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:3.0:1777051372.453432:0:27887:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94e626680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c11b6966-0775-44d2-bdc6-c74c26eb2226+50:2436:x1863365425941248:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 99us (1443us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051372.453447:0:13320:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94e627b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+50:2436:x1863365425941504:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 87us (1401us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051372.453461:0:27887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10347 00000100:00100000:1.0:1777051372.453478:0:13320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10348 00000100:00100000:0.0:1777051372.453492:0:8628:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94e625880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+47:2437:x1863365425941632:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 77us (1321us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051372.453509:0:27887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10350 00000100:00100000:0.0:1777051372.453525:0:8628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10349 00000100:00100000:3.0:1777051372.453534:0:27887:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94e627100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c11b6966-0775-44d2-bdc6-c74c26eb2226+50:2437:x1863365425941376:12345-192.168.201.46@tcp:400:kworker.0 00000100:00080000:0.0:1777051372.453592:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1777051372.453602:0:27887:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94e627100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c11b6966-0775-44d2-bdc6-c74c26eb2226+50:2437:x1863365425941376:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 74us (1504us total) trans 0 rc 0/0 00000100:00080000:0.0:1777051372.453604:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1777051372.453622:0:27887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10350 00010000:00010000:2.0:1777051372.630661:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1777051372.641130:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051372.641955:0:8492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425941760 00000100:00100000:2.0:1777051372.641971:0:8492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425941760 00000100:00100000:2.0:1777051372.642080:0:8492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13283 00000100:00100000:2.0:1777051372.642097:0:8492:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942a0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+28:2435:x1863365425941760:12345-192.168.201.46@tcp:38:lctl.0 00010000:02000400:2.0:1777051372.642138:0:8492:0:(ldlm_lib.c:952:target_handle_reconnect()) lustre-MDT0000: Client 2dd4696c-edce-4cd1-86d2-dbd2ff957fa1 (at 192.168.201.46@tcp) reconnecting 00000100:00080000:1.0:1777051372.643699:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1777051372.663048:0:8492:0:(ldlm_lib.c:1431:target_handle_connect()) lustre-MDT0000: connection from 2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp t8590016949 exp ffff99d941c41800 cur 8001 last 1777051372 00000004:00100000:2.0:1777051372.663096:0:8492:0:(mdt_handler.c:7281:mdt_connect_internal()) lustre-MDT0000: cli 192.168.201.46@tcp supports cksum type b7, return b7 00000100:00080000:2.0:1777051372.663131:0:8492:0:(import.c:65:import_set_state_nolock()) ffff99da7b5fd800 : changing import state from FULL to RECOVER 00000100:00080000:2.0:1777051372.663145:0:8492:0:(import.c:65:import_set_state_nolock()) ffff99da7b5fd800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1777051372.663469:0:8492:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942a0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+28:2435:x1863365425941760:12345-192.168.201.46@tcp:38:lctl.0 Request processed in 21371us (22344us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051372.663488:0:8492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13283 00000100:00100000:1.0:1777051372.765660:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051372.766372:0:21368:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425941888 00000100:00100000:0.0:1777051372.766387:0:21368:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425941888 00000100:00080000:1.0:1777051372.766526:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1777051372.766568:0:21368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13284 00000100:00100000:0.0:1777051372.766593:0:21368:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f298a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+54:2435:x1863365425941888:12345-192.168.201.46@tcp:38:lctl.0 00010000:02000400:0.0:1777051372.766642:0:21368:0:(ldlm_lib.c:952:target_handle_reconnect()) lustre-MDT0001: Client 2dd4696c-edce-4cd1-86d2-dbd2ff957fa1 (at 192.168.201.46@tcp) reconnecting 00010000:00080000:0.0:1777051372.766651:0:21368:0:(ldlm_lib.c:1431:target_handle_connect()) lustre-MDT0001: connection from 2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp t0 exp ffff99da4622a000 cur 8001 last 1777051372 00000004:00100000:0.0:1777051372.766690:0:21368:0:(mdt_handler.c:7281:mdt_connect_internal()) lustre-MDT0001: cli 192.168.201.46@tcp supports cksum type b7, return b7 00000100:00080000:0.0:1777051372.767320:0:21368:0:(import.c:65:import_set_state_nolock()) ffff99da7dbeb800 : changing import state from FULL to RECOVER 00000100:00080000:0.0:1777051372.767337:0:21368:0:(import.c:65:import_set_state_nolock()) ffff99da7dbeb800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1777051372.767444:0:21368:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f298a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+54:2435:x1863365425941888:12345-192.168.201.46@tcp:38:lctl.0 Request processed in 860us (1795us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051372.767462:0:21368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13284 00000100:00100000:3.0:1777051372.822934:0:3678:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1777051372.822970:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d9418f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3678:1863365452604928:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1777051372.823112:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1777051372.823292:0:103180:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 8002016091375ns, next at 8003016084081ns, rc = 0 00000100:00100000:3.0:1777051372.823351:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5fbeea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3678:1863365452605056:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1777051372.823409:0:47388:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452604928 00000100:00100000:3.0:1777051372.823421:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051372.823431:0:47388:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452604928 00000100:00100000:2.0:1777051372.823556:0:47388:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452605056 00000100:00100000:2.0:1777051372.823565:0:47388:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452605056 00000100:00100000:3.0:1777051372.823604:0:8472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5616 00000100:00100000:3.0:1777051372.823627:0:8472:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d9418f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3678:x1863365452604928:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1777051372.823683:0:8472:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 455081536 pending 0 free 3862671360 avail 3631149056 00000100:00100000:3.0:1777051372.823770:0:8472:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d9418f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3678:x1863365452604928:12345-0@lo:13:osp-pre-0-0.0 Request processed in 145us (663us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051372.823992:0:10113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5617 00000100:00080000:0.0:1777051372.824097:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1777051372.824109:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1777051372.824145:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d9418f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3678:1863365452604928:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1777051372.824262:0:10113:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d9418f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3678:x1863365452605056:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1777051372.824306:0:10113:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 445021760 pending 0 free 3643756544 avail 3412234240 00000100:00100000:1.0:1777051372.824574:0:10113:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d9418f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3678:x1863365452605056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 556us (1150us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051372.824579:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5fbeea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3678:1863365452605056:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1777051372.824607:0:10113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5617 00000100:00100000:3.0:1777051372.826568:0:8472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5616 00000100:00100000:1.0:1777051372.915537:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051372.916011:0:10328:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425942016 00000100:00100000:0.0:1777051372.916028:0:10328:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425942016 00000100:00080000:1.0:1777051372.916166:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1777051372.916172:0:10328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13285 00000100:00100000:0.0:1777051372.916566:0:10328:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94c12b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+18:2435:x1863365425942016:12345-192.168.201.46@tcp:38:lctl.0 00010000:02000400:0.0:1777051372.916614:0:10328:0:(ldlm_lib.c:952:target_handle_reconnect()) lustre-MDT0000: Client c11b6966-0775-44d2-bdc6-c74c26eb2226 (at 192.168.201.46@tcp) reconnecting 00010000:00080000:0.0:1777051372.916624:0:10328:0:(ldlm_lib.c:1431:target_handle_connect()) lustre-MDT0000: connection from c11b6966-0775-44d2-bdc6-c74c26eb2226@192.168.201.46@tcp t8590016948 exp ffff99d941c41000 cur 8002 last 1777051372 00000004:00100000:0.0:1777051372.916655:0:10328:0:(mdt_handler.c:7281:mdt_connect_internal()) lustre-MDT0000: cli 192.168.201.46@tcp supports cksum type b7, return b7 00000100:00080000:0.0:1777051372.916679:0:10328:0:(import.c:65:import_set_state_nolock()) ffff99d944c1a000 : changing import state from FULL to RECOVER 00000100:00080000:0.0:1777051372.916689:0:10328:0:(import.c:65:import_set_state_nolock()) ffff99d944c1a000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1777051372.916795:0:10328:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94c12b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+18:2435:x1863365425942016:12345-192.168.201.46@tcp:38:lctl.0 Request processed in 312us (2024us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051372.916816:0:10328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13285 00000100:00100000:1.0:1777051373.039476:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051373.039681:0:6580:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425942144 00000100:00100000:3.0:1777051373.039696:0:6580:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425942144 00000100:00100000:3.0:1777051373.039931:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13286 00000100:00100000:3.0:1777051373.039950:0:6580:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94c129500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+8:2435:x1863365425942144:12345-192.168.201.46@tcp:38:lctl.0 00010000:02000400:3.0:1777051373.040005:0:6580:0:(ldlm_lib.c:952:target_handle_reconnect()) lustre-MDT0001: Client c11b6966-0775-44d2-bdc6-c74c26eb2226 (at 192.168.201.46@tcp) reconnecting 00010000:00080000:3.0:1777051373.040013:0:6580:0:(ldlm_lib.c:1431:target_handle_connect()) lustre-MDT0001: connection from c11b6966-0775-44d2-bdc6-c74c26eb2226@192.168.201.46@tcp t0 exp ffff99da4622d800 cur 8002 last 1777051373 00000004:00100000:3.0:1777051373.040043:0:6580:0:(mdt_handler.c:7281:mdt_connect_internal()) lustre-MDT0001: cli 192.168.201.46@tcp supports cksum type b7, return b7 00000100:00080000:3.0:1777051373.040068:0:6580:0:(import.c:65:import_set_state_nolock()) ffff99da71c6c000 : changing import state from FULL to RECOVER 00000100:00080000:3.0:1777051373.040081:0:6580:0:(import.c:65:import_set_state_nolock()) ffff99da71c6c000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1777051373.040179:0:6580:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94c129500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+8:2435:x1863365425942144:12345-192.168.201.46@tcp:38:lctl.0 Request processed in 232us (713us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051373.040194:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13286 00000100:00080000:1.0:1777051373.040286:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1777051373.480356:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051373.480419:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051373.480570:0:103163:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425942272 00000100:00100000:0.0:1777051373.480584:0:103163:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425942272 00000100:00100000:0.0:1777051373.480672:0:103163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 157 00000100:00100000:0.0:1777051373.480688:0:103163:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f3dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29c4352d-3260-4734-909d-9ea5de9e7fa4+12:2438:x1863365425942272:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:0.0:1777051373.480777:0:103163:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f3dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29c4352d-3260-4734-909d-9ea5de9e7fa4+12:2438:x1863365425942272:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 94us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051373.480789:0:103163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 157 00000100:00100000:1.0:1777051373.481006:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051373.484458:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051373.484512:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051373.484550:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051373.484737:0:8471:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425942656 00000100:00100000:0.0:1777051373.485021:0:8471:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425942656 00000100:00100000:0.0:1777051373.485372:0:8471:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425942784 00000100:00100000:0.0:1777051373.485378:0:8471:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425942784 00000100:00100000:0.0:1777051373.485408:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10351 00000100:00100000:0.0:1777051373.485421:0:8471:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94c129f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+50:2439:x1863365425942656:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:0.0:1777051373.485490:0:8471:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94c129f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+50:2439:x1863365425942656:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 71us (1037us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051373.485504:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10351 00000100:00100000:0.0:1777051373.485529:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10352 00000100:00100000:0.0:1777051373.485540:0:8471:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94c128380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+50:2438:x1863365425942784:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:0.0:1777051373.485592:0:8471:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94c128380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+50:2438:x1863365425942784:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 54us (1080us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051373.485603:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10352 00000100:00100000:2.0:1777051373.486749:0:6579:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425942400 00000100:00100000:2.0:1777051373.486759:0:6579:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425942400 00000100:00100000:3.0:1777051373.486792:0:6581:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425942528 00000100:00100000:3.0:1777051373.486803:0:6581:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425942528 00000100:00100000:2.0:1777051373.486967:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13287 00000100:00100000:2.0:1777051373.486982:0:6579:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94c12ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+18:2439:x1863365425942400:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:2.0:1777051373.487059:0:6579:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94c12ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+18:2439:x1863365425942400:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 80us (6637us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051373.487070:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13287 00000100:00100000:2.0:1777051373.487095:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13288 00000100:00100000:2.0:1777051373.487109:0:6579:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94c12a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+8:2438:x1863365425942528:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:2.0:1777051373.487154:0:6579:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94c12a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+8:2438:x1863365425942528:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 50us (6151us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051373.487165:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13288 00000100:00100000:1.0:1777051373.487338:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051373.487396:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051373.487440:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051373.487470:0:21368:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425943040 00000100:00100000:1.0:1777051373.487477:0:21368:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425943040 00000100:00100000:0.0:1777051373.487538:0:46497:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425942912 00000100:00100000:0.0:1777051373.487545:0:46497:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425942912 00000100:00100000:1.0:1777051373.487710:0:21368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13289 00000100:00100000:1.0:1777051373.487724:0:21368:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94c129180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+54:2438:x1863365425943040:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:1.0:1777051373.487789:0:21368:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94c129180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+54:2438:x1863365425943040:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 66us (3237us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051373.487800:0:21368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13289 00000100:00100000:0.0:1777051373.487891:0:46497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13290 00000100:00100000:0.0:1777051373.487905:0:46497:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fd65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+28:2439:x1863365425942912:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:0.0:1777051373.487955:0:46497:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fd65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+28:2439:x1863365425942912:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 54us (560us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051373.487963:0:46497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13290 00000100:00100000:0.0:1777051373.488017:0:27884:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425943296 00000100:00100000:0.0:1777051373.488022:0:27884:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425943296 00000100:00100000:0.0:1777051373.488055:0:27884:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425943168 00000100:00100000:0.0:1777051373.488058:0:27884:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425943168 00000100:00100000:0.0:1777051373.488110:0:27884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10353 00000100:00100000:3.0:1777051373.488129:0:27887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10354 00000100:00100000:0.0:1777051373.488130:0:27884:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94c129c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+47:2438:x1863365425943296:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:3.0:1777051373.488158:0:27887:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fd67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+50:2439:x1863365425943168:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:0.0:1777051373.488198:0:27884:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94c129c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+47:2438:x1863365425943296:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 74us (860us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051373.488212:0:27884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10353 00000100:00100000:3.0:1777051373.488337:0:27887:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fd67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+50:2439:x1863365425943168:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 186us (892us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051373.488352:0:27887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10354 00010000:00010000:1.0:1777051373.654419:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1777051373.853149:0:104205:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3 committed 00000001:00080000:2.0:1777051373.853258:0:104205:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934616 is committed 00000020:00080000:2.0:1777051373.853274:0:104205:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff99da7fc933c0 refcount 2 committed 0 result 0 batchid 4294970577 00000020:00080000:2.0:1777051373.853284:0:104205:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff99da7b2a1b00 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff99da7fc93f00 00000020:00080000:2.0:1777051373.853292:0:104205:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x2000032e1:0x1:0x0].4 00000020:00080000:2.0:1777051373.853299:0:104205:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff99da7b2a1f00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff99d95594de00 00000020:00080000:2.0:1777051373.853305:0:104205:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x240000bd0:0x1:0x0].4 00010000:00010000:1.0:1777051373.853329:0:3664:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e48aa00/0x85f51a6b96715cce lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0xf:0x0].0xc67b6e72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8492 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1777051373.853331:0:104205:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 2 committed 00010000:00010000:1.0:1777051373.853356:0:3664:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e48aa00/0x85f51a6b96715cce lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0xf:0x0].0xc67b6e72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8492 initiator: MDT1 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1777051373.853364:0:104230:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 4294970577 committed batchid 4294970576 00010000:00010000:1.0:1777051373.853375:0:3664:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e48aa00/0x85f51a6b96715cce lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0xf:0x0].0xc67b6e72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8492 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051373.853389:0:3664:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94e48aa00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:1.0:1777051373.853397:0:3664:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e48aa00/0x85f51a6b96715cce lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0xf:0x0].0xc67b6e72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8492 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051373.853410:0:3664:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e48aa00/0x85f51a6b96715cce lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0xf:0x0].0xc67b6e72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8492 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051373.853442:0:3664:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0xf:0x0].0xc67b6e72 (ffff99d94e629b00) 00010000:00010000:1.0:1777051373.853448:0:3664:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000020:00080000:2.0:1777051373.853451:0:104230:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 4294970576 00010000:00010000:1.0:1777051373.853456:0:3664:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e48aa00/0x85f51a6b96715cce lrc: 2/0,0 mode: --/TXN res: [0x240000404:0xf:0x0].0xc67b6e72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8492 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051373.853471:0:3664:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e48aa00/0x85f51a6b96715cce lrc: 0/0,0 mode: --/TXN res: [0x240000404:0xf:0x0].0xc67b6e72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8492 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051373.854531:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d950267480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452605184:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1777051373.854626:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051373.855527:0:8468:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452605184 00000100:00100000:0.0:1777051373.855540:0:8468:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452605184 00000004:00080000:1.0:1777051373.855593:0:103159:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000001:00080000:1.0:1777051373.855627:0:103159:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771122 is committed 00000100:00100000:0.0:1777051373.855642:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7991 00000100:00100000:0.0:1777051373.855660:0:8468:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fd65500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3679:x1863365452605184:12345-0@lo:6:osp-syn-1-1.0 00000001:00080000:1.0:1777051373.855665:0:103159:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771121 is committed 00000004:00080000:1.0:1777051373.855680:0:103159:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00002000:00080000:0.0:1777051373.855700:0:8468:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:258 count 1 00010000:00010000:0.0:1777051373.855736:0:8468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a4cdfccb/0x85f51a6b96715d7d lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x102:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051373.855773:0:8468:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009a997f2b/0x85f51a6b96715c73 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x102:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b61e2 expref: 49 pid: 27887 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051373.855792:0:8468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777051373.855797:0:8468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1777051373.855802:0:3679:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:0.0:1777051373.855806:0:8468:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a4cdfccb/0x85f51a6b96715d7d lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x102:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051373.855847:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d951fa1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452605312:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1777051373.855903:0:8468:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009a997f2b/0x85f51a6b96715c73 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x102:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b61e2 expref: 49 pid: 27887 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051373.855925:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1777051373.855940:0:8468:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009a997f2b/0x85f51a6b96715c73 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x102:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b61e2 expref: 49 pid: 27887 timeout: 8103 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051373.855968:0:8468:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d950267800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8468:1863365452605440:192.168.201.46@tcp:104: 00000100:00100000:1.0:1777051373.855999:0:8628:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452605312 00000100:00100000:1.0:1777051373.856009:0:8628:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452605312 00000100:00100000:0.0:1777051373.856084:0:8468:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d942ae63c0 going to sleep for 11 seconds 00000100:00100000:1.0:1777051373.856085:0:8628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7992 00000100:00100000:1.0:1777051373.856105:0:8628:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d951fa0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3679:x1863365452605312:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1777051373.856133:0:8628:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:482 count 1 00000100:00080000:0.0:1777051373.856141:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1777051373.856160:0:8628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002fab269b/0x85f51a6b96715d84 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1e2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051373.856189:0:8628:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c82c3fc4/0x85f51a6b96715c34 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x1e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b61cd expref: 49 pid: 27884 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051373.856214:0:8628:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051373.856218:0:8628:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051373.856224:0:8628:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002fab269b/0x85f51a6b96715d84 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x1e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051373.856267:0:8628:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c82c3fc4/0x85f51a6b96715c34 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b61cd expref: 49 pid: 27884 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051373.856326:0:8628:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c82c3fc4/0x85f51a6b96715c34 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b61cd expref: 49 pid: 27884 timeout: 8103 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051373.856350:0:8628:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95a581500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8628:1863365452605568:192.168.201.46@tcp:104: 00010000:00010000:0.0:1777051373.856374:0:3663:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48a800/0x85f51a6b96715d53 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0xd6:0x0].0xc67b6e72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051373.856394:0:3663:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48a800/0x85f51a6b96715d53 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd2:0xd6:0x0].0xc67b6e72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051373.856408:0:3663:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48a800/0x85f51a6b96715d53 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0xd6:0x0].0xc67b6e72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051373.856421:0:3663:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94e48a800 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:0.0:1777051373.856429:0:3663:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48a800/0x85f51a6b96715d53 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0xd6:0x0].0xc67b6e72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051373.856443:0:3663:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48a800/0x85f51a6b96715d53 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd2:0xd6:0x0].0xc67b6e72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051373.856448:0:8628:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da7da58c00 going to sleep for 11 seconds 00010000:00010000:0.0:1777051373.856475:0:3663:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xd6:0x0].0xc67b6e72 (ffff99d94e629e00) 00010000:00010000:0.0:1777051373.856484:0:3663:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777051373.856492:0:3663:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48a800/0x85f51a6b96715d53 lrc: 2/0,0 mode: --/TXN res: [0x200000bd2:0xd6:0x0].0xc67b6e72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051373.856506:0:3663:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48a800/0x85f51a6b96715d53 lrc: 0/0,0 mode: --/TXN res: [0x200000bd2:0xd6:0x0].0xc67b6e72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051373.856541:0:3663:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950262200/0x85f51a6b96715d6f lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd2:0xd5:0x0].0xac1bda01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051373.856555:0:3663:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d950262200/0x85f51a6b96715d6f lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd2:0xd5:0x0].0xac1bda01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051373.856568:0:3663:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d950262200/0x85f51a6b96715d6f lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0xd5:0x0].0xac1bda01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051373.856581:0:3663:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d950262200 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:0.0:1777051373.856586:0:3663:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d950262200/0x85f51a6b96715d6f lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd2:0xd5:0x0].0xac1bda01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051373.856598:0:3663:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d950262200/0x85f51a6b96715d6f lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd2:0xd5:0x0].0xac1bda01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051373.856613:0:3663:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xd5:0x0].0xac1bda01 (ffff99da61538700) 00010000:00010000:0.0:1777051373.856618:0:3663:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777051373.856623:0:3663:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d950262200/0x85f51a6b96715d6f lrc: 2/0,0 mode: --/TXN res: [0x200000bd2:0xd5:0x0].0xac1bda01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051373.856635:0:3663:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d950262200/0x85f51a6b96715d6f lrc: 0/0,0 mode: --/TXN res: [0x200000bd2:0xd5:0x0].0xac1bda01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051373.860273:0:8468:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d950267800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8468:1863365452605440:192.168.201.46@tcp:104: 00010000:00010000:0.0:1777051373.860310:0:8468:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a4cdfccb/0x85f51a6b96715d7d lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x102:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051373.862422:0:8628:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95a581500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8628:1863365452605568:192.168.201.46@tcp:104: 00010000:00010000:1.0:1777051373.862452:0:8628:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000002fab269b/0x85f51a6b96715d84 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051373.864508:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051373.864612:0:6565:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425943424 00000100:00100000:3.0:1777051373.864622:0:6565:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425943424 00010000:00010000:3.0:1777051373.864672:0:6565:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009a997f2b/0x85f51a6b96715c73 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x102:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b61e2 expref: 50 pid: 27887 timeout: 8103 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051373.864744:0:6565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3867 00000100:00100000:3.0:1777051373.864761:0:6565:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95a581500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+50:2436:x1863365425943424:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1777051373.864785:0:6565:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777051373.864795:0:6565:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009a997f2b/0x85f51a6b96715c73 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x102:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b61e2 expref: 50 pid: 27887 timeout: 8103 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051373.864854:0:6565:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009a997f2b/0x85f51a6b96715c73 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x102:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b61e2 expref: 50 pid: 27887 timeout: 8103 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051373.864893:0:6565:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009a997f2b/0x85f51a6b96715c73 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x102:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b61e2 expref: 50 pid: 27887 timeout: 8103 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051373.864919:0:6565:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051373.864924:0:6565:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051373.864931:0:6565:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a4cdfccb/0x85f51a6b96715d7d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x102:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051373.864948:0:6565:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a4cdfccb/0x85f51a6b96715d7d lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x102:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051373.865572:0:6565:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1777051373.865958:0:8468:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a4cdfccb/0x85f51a6b96715d7d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x102:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051373.866001:0:8468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a4cdfccb/0x85f51a6b96715d7d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x102:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051373.866016:0:6565:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95a581500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+49:2436:x1863365425943424:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 1249us (1503us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051373.866052:0:6565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3867 00010000:00010000:1.0:1777051373.866053:0:8468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a4cdfccb/0x85f51a6b96715d7d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x102:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051373.866071:0:8468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a4cdfccb/0x85f51a6b96715d7d lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x102:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051373.866125:0:8468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1777051373.866477:0:13753:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1777051373.866492:0:13753:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a4cdfccb/0x85f51a6b96715d7d lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x102:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051373.866498:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00010000:00010000:0.0:1777051373.866517:0:13753:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94eb2ae00 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:0.0:1777051373.866527:0:13753:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a4cdfccb/0x85f51a6b96715d7d lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x102:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051373.866546:0:13753:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a4cdfccb/0x85f51a6b96715d7d lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x102:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051373.866572:0:13753:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a4cdfccb/0x85f51a6b96715d7d lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x102:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051373.866590:0:13753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a4cdfccb/0x85f51a6b96715d7d lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x102:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051373.866623:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777051373.866628:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777051373.866634:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777051373.866657:0:24467:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425943552 00000100:00100000:3.0:1777051373.866668:0:24467:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425943552 00000100:00100000:1.0:1777051373.866701:0:8468:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fd65500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3679:x1863365452605184:12345-0@lo:6:osp-syn-1-1.0 Request processed in 11041us (12071us total) trans 4294968355 rc 0/0 00000100:00100000:1.0:1777051373.866718:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7991 00000004:00080000:0.0:1777051373.866738:0:3679:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99d950267480/2, rc 0, transno 4294968355 00000100:00100000:0.0:1777051373.866753:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d950267480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452605184:0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1777051373.866966:0:24467:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c82c3fc4/0x85f51a6b96715c34 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b61cd expref: 49 pid: 27884 timeout: 8103 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051373.867113:0:24467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3868 00000100:00100000:3.0:1777051373.867132:0:24467:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da6fd40c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+49:2437:x1863365425943552:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1777051373.867151:0:24467:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777051373.867161:0:24467:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c82c3fc4/0x85f51a6b96715c34 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b61cd expref: 49 pid: 27884 timeout: 8103 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051373.867185:0:24467:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c82c3fc4/0x85f51a6b96715c34 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b61cd expref: 49 pid: 27884 timeout: 8103 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051373.867215:0:24467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c82c3fc4/0x85f51a6b96715c34 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x1e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b61cd expref: 49 pid: 27884 timeout: 8103 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051373.867235:0:24467:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051373.867239:0:24467:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051373.867245:0:24467:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002fab269b/0x85f51a6b96715d84 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051373.867311:0:24467:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002fab269b/0x85f51a6b96715d84 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051373.867360:0:24467:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1777051373.867430:0:24467:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da6fd40c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+48:2437:x1863365425943552:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 302us (938us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051373.867443:0:24467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3868 00010000:00010000:1.0:1777051373.867548:0:8628:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000002fab269b/0x85f51a6b96715d84 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051373.867569:0:8628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002fab269b/0x85f51a6b96715d84 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051373.867586:0:8628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002fab269b/0x85f51a6b96715d84 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051373.867602:0:8628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002fab269b/0x85f51a6b96715d84 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051373.867639:0:8628:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1777051373.867687:0:38719:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1777051373.867700:0:38719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002fab269b/0x85f51a6b96715d84 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051373.867716:0:38719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94e48bc00 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:0.0:1777051373.867722:0:38719:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002fab269b/0x85f51a6b96715d84 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051373.867738:0:38719:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002fab269b/0x85f51a6b96715d84 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051373.867761:0:38719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002fab269b/0x85f51a6b96715d84 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051373.867775:0:38719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002fab269b/0x85f51a6b96715d84 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051373.867804:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777051373.867808:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777051373.867813:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1777051373.867887:0:8628:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d951fa0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3679:x1863365452605312:12345-0@lo:6:osp-syn-1-0.0 Request processed in 11782us (11964us total) trans 4294968356 rc 0/0 00000100:00100000:1.0:1777051373.867906:0:8628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7992 00000004:00080000:2.0:1777051373.868012:0:3679:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99d951fa1880/2, rc 0, transno 4294968356 00000100:00100000:2.0:1777051373.868026:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d951fa1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452605312:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1777051374.685189:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1777051375.383465:0:3678:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1777051375.383498:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d9418f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452605696:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1777051375.383626:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051375.383758:0:46500:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452605696 00000100:00100000:3.0:1777051375.383774:0:46500:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452605696 00000100:00100000:3.0:1777051375.383888:0:46500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8135 00000100:00100000:3.0:1777051375.383907:0:46500:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95a581500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+6:3678:x1863365452605696:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1777051375.383964:0:46500:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4194304 pending 0 free 1441583104 avail 1295343616 00000100:00100000:3.0:1777051375.384084:0:46500:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95a581500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+6:3678:x1863365452605696:12345-0@lo:41:osp-pre-0-1.0 Request processed in 181us (457us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051375.384099:0:46500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8135 00000100:00100000:1.0:1777051375.384377:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d9418f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452605696:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1777051375.702505:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1777051375.895402:0:3677:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1777051375.895428:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5fbe1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3677:1863365452605824:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1777051375.895524:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051375.895628:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d9418f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3677:1863365452606208:0@lo:400:kworker.0 00000100:00100000:0.0:1777051375.895642:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d9418f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3678:1863365452606336:0@lo:400:kworker.0 00000100:00100000:3.0:1777051375.895673:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d9418f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3679:1863365452605952:0@lo:400:kworker.0 00000100:00100000:1.0:1777051375.895690:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051375.895752:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051375.895755:0:11727:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452605824 00000100:00100000:1.0:1777051375.895758:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95faeb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3677:1863365452606720:0@lo:400:kworker.0 00000100:00100000:0.0:1777051375.895767:0:11727:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452605824 00000100:00100000:3.0:1777051375.895852:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d9418f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3679:1863365452606464:0@lo:400:kworker.0 00000100:00100000:1.0:1777051375.895861:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051375.895881:0:11727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8136 00000100:00100000:0.0:1777051375.895902:0:11727:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5fbe1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3677:x1863365452605824:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1777051375.895919:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95f65a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452607232:0@lo:400:kworker.0 00000100:00100000:3.0:1777051375.895926:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00000024:0.0:1777051375.895950:0:11727:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4194304 pending 0 free 1446154240 avail 1299914752 00000100:00100000:3.0:1777051375.895975:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d943d91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452606976:0@lo:400:kworker.0 00000100:00100000:1.0:1777051375.895986:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051375.896038:0:11727:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5fbe1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3677:x1863365452605824:12345-0@lo:41:osp-pre-1-0.0 Request processed in 141us (514us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051375.896061:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051375.896074:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5fbe1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3677:1863365452605824:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1777051375.896337:0:11727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8136 00000100:00100000:3.0:1777051375.896401:0:3679:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1777051375.896404:0:3677:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1777051375.896405:0:11727:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452606976 00000100:00100000:0.0:1777051375.896416:0:11727:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452606976 00000100:00100000:3.0:1777051375.896420:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d9418f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3679:1863365452606080:0@lo:400:kworker.0 00000100:00100000:1.0:1777051375.896426:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da44496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3677:1863365452607360:0@lo:400:kworker.0 00000100:00100000:0.0:1777051375.896467:0:11727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8137 00000100:00100000:3.0:1777051375.896488:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051375.896518:0:46494:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452606208 00000100:00100000:0.0:1777051375.896521:0:11727:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da44494000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3679:x1863365452606976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777051375.896527:0:46494:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452606208 00000100:00100000:3.0:1777051375.896542:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7c9a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452606592:0@lo:400:kworker.0 00000100:00100000:1.0:1777051375.896613:0:46494:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452606464 00000100:00100000:1.0:1777051375.896622:0:46494:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452606464 00000100:00100000:3.0:1777051375.896622:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051375.896625:0:11727:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da44494000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3679:x1863365452606976:12345-0@lo:400:kworker.0 Request processed in 142us (561us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051375.896643:0:11727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8137 00000100:00100000:1.0:1777051375.896671:0:46494:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452606080 00000100:00100000:3.0:1777051375.896948:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95f659500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452607104:0@lo:400:kworker.0 00000100:00100000:1.0:1777051375.896966:0:46494:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452606080 00000100:00100000:0.0:1777051375.896980:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051375.897013:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051375.897031:0:46494:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452606336 00000100:00100000:0.0:1777051375.897032:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95faeb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3678:1863365452606848:0@lo:400:kworker.0 00000100:00100000:1.0:1777051375.897040:0:46494:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452606336 00000100:00100000:3.0:1777051375.897081:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d943d91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452606976:0@lo:400:kworker.0 00000100:00100000:0.0:1777051375.897102:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051375.897105:0:46494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13291 00000100:00100000:1.0:1777051375.897121:0:46494:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5fbe1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0001-lwp-OST0000_UUID+5:3677:x1863365452606208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051375.897147:0:103169:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452605952 00000100:00100000:3.0:1777051375.897155:0:103169:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452605952 00000100:00100000:0.0:1777051375.897507:0:27882:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452606848 00000100:00100000:0.0:1777051375.897516:0:27882:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452606848 00000100:00100000:1.0:1777051375.897524:0:46494:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5fbe1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0001-lwp-OST0000_UUID+5:3677:x1863365452606208:12345-0@lo:400:kworker.0 Request processed in 401us (1831us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051375.897539:0:46494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13291 00000100:00100000:3.0:1777051375.897558:0:103169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1777051375.897579:0:103169:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f3dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f9351a01-5b0e-4470-97fd-58b9b4b312a2+23:3679:x1863365452605952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777051375.897586:0:46494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13292 00000100:00100000:0.0:1777051375.897605:0:27882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13293 00000100:00100000:1.0:1777051375.897612:0:46494:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da44494380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0001-lwp-OST0001_UUID+5:3679:x1863365452606464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777051375.897633:0:27882:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955507800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0000_UUID+5:3679:x1863365452606080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051375.897674:0:103169:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f3dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f9351a01-5b0e-4470-97fd-58b9b4b312a2+23:3679:x1863365452605952:12345-0@lo:400:kworker.0 Request processed in 100us (1923us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051375.897694:0:103169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1777051375.897700:0:46494:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da44494380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0001-lwp-OST0001_UUID+5:3679:x1863365452606464:12345-0@lo:400:kworker.0 Request processed in 94us (1778us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051375.897716:0:46494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13292 00000100:00100000:0.0:1777051375.897725:0:27882:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955507800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0000_UUID+5:3679:x1863365452606080:12345-0@lo:400:kworker.0 Request processed in 102us (1235us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051375.897739:0:27882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13293 00000100:00100000:1.0:1777051375.897755:0:46494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13294 00000100:00100000:1.0:1777051375.897778:0:46494:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d950267800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000-lwp-OST0001_UUID+5:3678:x1863365452606336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051375.897778:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13295 00000100:00100000:3.0:1777051375.897832:0:6580:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d950265880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3678:x1863365452606848:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1777051375.897897:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1777051375.897898:0:46494:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d950267800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000-lwp-OST0001_UUID+5:3678:x1863365452606336:12345-0@lo:400:kworker.0 Request processed in 127us (916us total) trans 0 rc 0/0 00000100:00080000:0.0:1777051375.897908:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1777051375.897916:0:46494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13294 00000100:00100000:3.0:1777051375.897922:0:6580:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d950265880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3678:x1863365452606848:12345-0@lo:400:kworker.0 Request processed in 93us (821us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051375.897934:0:27884:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452606720 00000100:00100000:3.0:1777051375.897941:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13295 00000100:00100000:0.0:1777051375.897944:0:27884:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452606720 00000100:00100000:0.0:1777051375.898025:0:27884:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452607232 00000100:00100000:0.0:1777051375.898032:0:27884:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452607232 00000100:00100000:3.0:1777051375.898040:0:8470:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452606592 00000100:00100000:3.0:1777051375.898050:0:8470:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452606592 00000100:00100000:1.0:1777051375.898060:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d9418f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3678:1863365452606336:0@lo:400:kworker.0 00000100:00100000:0.0:1777051375.898085:0:27884:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452607104 00000100:00100000:0.0:1777051375.898093:0:27884:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452607104 00000100:00100000:1.0:1777051375.898096:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95faeb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3678:1863365452606848:0@lo:400:kworker.0 00000100:00100000:3.0:1777051375.898124:0:8470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10355 00000100:00100000:3.0:1777051375.898141:0:8470:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5fbe0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3677:x1863365452606720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777051375.898171:0:27884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10356 00000100:00100000:0.0:1777051375.898190:0:27884:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5fbe2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+6:3677:x1863365452607232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777051375.898191:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10357 00000100:00100000:3.0:1777051375.898262:0:8470:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5fbe0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3677:x1863365452606720:12345-0@lo:400:kworker.0 Request processed in 122us (2403us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051375.898282:0:8470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10355 00000100:00100000:1.0:1777051375.898289:0:8468:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955506300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3679:x1863365452606592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051375.898321:0:8470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10358 00000100:00100000:3.0:1777051375.898338:0:8470:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955505880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3679:x1863365452607104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777051375.898376:0:8468:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955506300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3679:x1863365452606592:12345-0@lo:400:kworker.0 Request processed in 95us (1757us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051375.898392:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10357 00000100:00100000:0.0:1777051375.898397:0:27884:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5fbe2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+6:3677:x1863365452607232:12345-0@lo:400:kworker.0 Request processed in 207us (2410us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051375.898414:0:27884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10356 00000100:00100000:3.0:1777051375.898428:0:8470:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955505880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3679:x1863365452607104:12345-0@lo:400:kworker.0 Request processed in 91us (1414us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051375.898443:0:8470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10358 00000100:00080000:1.0:1777051375.898477:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1777051375.898487:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1777051375.898548:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051375.898597:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95f65a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452607232:0@lo:400:kworker.0 00000100:00100000:3.0:1777051375.898611:0:27882:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452607360 00000100:00100000:1.0:1777051375.898620:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d9418f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3677:1863365452606208:0@lo:400:kworker.0 00000100:00100000:3.0:1777051375.898621:0:27882:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452607360 00000100:00100000:2.0:1777051375.898646:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d9418f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3679:1863365452606080:0@lo:400:kworker.0 00000100:00100000:1.0:1777051375.898650:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95faeb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3677:1863365452606720:0@lo:400:kworker.0 00000100:00100000:3.0:1777051375.898684:0:27882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13296 00000100:00100000:2.0:1777051375.898700:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7c9a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452606592:0@lo:400:kworker.0 00000100:00100000:3.0:1777051375.898706:0:27882:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5fbe1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0001_UUID+5:3677:x1863365452607360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777051375.898730:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95f659500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452607104:0@lo:400:kworker.0 00000100:00100000:2.0:1777051375.898753:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d9418f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3679:1863365452605952:0@lo:400:kworker.0 00000100:00100000:2.0:1777051375.898772:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d9418f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3679:1863365452606464:0@lo:400:kworker.0 00000100:00100000:1.0:1777051375.900076:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da44496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3677:1863365452607360:0@lo:400:kworker.0 00000100:00100000:3.0:1777051375.900501:0:27882:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5fbe1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0001_UUID+5:3677:x1863365452607360:12345-0@lo:400:kworker.0 Request processed in 96us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051375.900516:0:27882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13296 00000100:00100000:1.0:1777051376.407067:0:3680:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1777051376.407098:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955505c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3680:1863365452607488:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1777051376.407187:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051376.407277:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5fbeea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3680:1863365452607616:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1777051376.407314:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051376.407514:0:47388:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452607488 00000100:00100000:2.0:1777051376.407526:0:47388:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452607488 00000100:00100000:2.0:1777051376.407613:0:47388:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452607616 00000100:00100000:2.0:1777051376.407622:0:47388:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452607616 00000100:00100000:3.0:1777051376.407631:0:8473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5618 00000100:00100000:3.0:1777051376.407656:0:8473:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5fbe0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3680:x1863365452607488:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1777051376.407684:0:47388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5619 00000100:00100000:2.0:1777051376.407707:0:47388:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5fbe3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3680:x1863365452607616:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1777051376.407712:0:8473:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 445021760 pending 0 free 3645853696 avail 3414331392 00002000:00000024:2.0:1777051376.407749:0:47388:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 455081536 pending 0 free 3862671360 avail 3631149056 00000100:00100000:3.0:1777051376.407858:0:8473:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5fbe0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3680:x1863365452607488:12345-0@lo:13:osp-pre-1-1.0 Request processed in 207us (667us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051376.407873:0:47388:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5fbe3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3680:x1863365452607616:12345-0@lo:13:osp-pre-0-1.0 Request processed in 172us (555us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051376.407879:0:8473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5618 00000100:00100000:2.0:1777051376.407897:0:47388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5619 00000100:00100000:1.0:1777051376.408050:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5fbeea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3680:1863365452607616:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1777051376.408077:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955505c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3680:1863365452607488:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1777051376.726595:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1777051377.430459:0:103189:0:(llog.c:801:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:1.0:1777051377.430468:0:103189:0:(llog_cat.c:158:llog_cat_process_common()) processing log [0x1:0x2b:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1777051377.430501:0:103189:0:(llog.c:858:llog_process_thread()) stop processing plain [0x1:0x2b:0x0] index 3 count 3 00000040:00080000:1.0:1777051377.430512:0:103189:0:(llog.c:858:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00010000:00010000:0.0:1777051377.751425:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1777051377.942744:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5fbef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3677:1863365452607872:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1777051377.942793:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955507480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3678:1863365452607744:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1777051377.942899:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051377.943004:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051377.945086:0:10113:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452607872 00000100:00100000:3.0:1777051377.945087:0:8472:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452607744 00000100:00100000:3.0:1777051377.945105:0:8472:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452607744 00000100:00100000:2.0:1777051377.945107:0:10113:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452607872 00000100:00080000:0.0:1777051377.945267:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1777051377.945280:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1777051377.945302:0:10113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5620 00000100:00100000:3.0:1777051377.945319:0:8472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5621 00000100:00100000:2.0:1777051377.945331:0:10113:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5fbe2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3677:x1863365452607872:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1777051377.945352:0:8472:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d950265f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3678:x1863365452607744:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1777051377.945406:0:8472:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 455081536 pending 0 free 3862671360 avail 3631149056 00000100:00100000:3.0:1777051377.945520:0:8472:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d950265f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3678:x1863365452607744:12345-0@lo:13:osp-pre-0-0.0 Request processed in 183us (2524us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051377.945534:0:8472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5621 00002000:00000024:2.0:1777051377.945564:0:10113:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 445021760 pending 0 free 3645853696 avail 3414331392 00000100:00100000:1.0:1777051377.945677:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955507480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3678:1863365452607744:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1777051377.945688:0:10113:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5fbe2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3677:x1863365452607872:12345-0@lo:13:osp-pre-1-0.0 Request processed in 362us (2782us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051377.945713:0:10113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5620 00000100:00100000:3.0:1777051377.945829:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5fbef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3677:1863365452607872:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1777051378.596660:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051378.596733:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051378.596818:0:8492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425943808 00000100:00100000:3.0:1777051378.596835:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051378.596841:0:8492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425943808 00000100:00100000:3.0:1777051378.596898:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051378.596950:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051378.596977:0:6579:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425943936 00000100:00100000:0.0:1777051378.596986:0:8492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425944448 00000100:00100000:2.0:1777051378.596988:0:6579:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425943936 00000100:00100000:0.0:1777051378.596995:0:8492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425944448 00000100:00100000:3.0:1777051378.597012:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051378.597052:0:103165:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425943680 00000100:00100000:1.0:1777051378.597064:0:103165:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425943680 00000100:00100000:0.0:1777051378.597082:0:8492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13297 00000100:00100000:3.0:1777051378.597082:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051378.597117:0:8492:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955504700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+17:2437:x1863365425943808:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:2.0:1777051378.597143:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13298 00000100:00100000:3.0:1777051378.597171:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051378.597172:0:103165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 159 00000100:00100000:2.0:1777051378.597173:0:6579:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955505180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+48:2436:x1863365425944448:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:1.0:1777051378.597276:0:103165:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f3de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29c4352d-3260-4734-909d-9ea5de9e7fa4+12:2436:x1863365425943680:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:0.0:1777051378.597296:0:8492:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955504700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+17:2437:x1863365425943808:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 189us (645us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051378.597310:0:8492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13297 00000100:00100000:0.0:1777051378.597345:0:8492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425944320 00000100:00100000:1.0:1777051378.597353:0:103165:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f3de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29c4352d-3260-4734-909d-9ea5de9e7fa4+12:2436:x1863365425943680:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 156us (618us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051378.597355:0:8492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425944320 00000100:00100000:2.0:1777051378.597367:0:6579:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955505180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+48:2436:x1863365425944448:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 207us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051378.597376:0:103165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 159 00000100:00100000:2.0:1777051378.597392:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13298 00000100:00100000:0.0:1777051378.597431:0:8492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13299 00000100:00100000:2.0:1777051378.597443:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13300 00000100:00100000:0.0:1777051378.597447:0:8492:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955504000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+8:2436:x1863365425943936:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:1.0:1777051378.597464:0:8468:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425944192 00000100:00100000:2.0:1777051378.597467:0:6579:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955505f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+21:2437:x1863365425944320:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:1.0:1777051378.597473:0:8468:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425944192 00000100:00100000:3.0:1777051378.597501:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051378.597503:0:8492:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955504000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+8:2436:x1863365425943936:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 60us (668us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051378.597519:0:8492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13299 00000100:00100000:2.0:1777051378.597525:0:6579:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955505f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+21:2437:x1863365425944320:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 66us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051378.597539:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13300 00000100:00100000:0.0:1777051378.597562:0:27884:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425944704 00000100:00100000:0.0:1777051378.597568:0:27884:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425944704 00000100:00100000:2.0:1777051378.597618:0:8628:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425944064 00000100:00100000:2.0:1777051378.597624:0:8628:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425944064 00000100:00100000:1.0:1777051378.597798:0:8468:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425944576 00000100:00100000:1.0:1777051378.597805:0:8468:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425944576 00000100:00100000:0.0:1777051378.597818:0:27884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10359 00000100:00100000:0.0:1777051378.597832:0:27884:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955506d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+48:2436:x1863365425944192:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:1.0:1777051378.597851:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10360 00000100:00100000:1.0:1777051378.597865:0:8468:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955506a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+47:2436:x1863365425944704:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:2.0:1777051378.597987:0:8628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10361 00000100:00100000:2.0:1777051378.597998:0:8628:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955504a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+50:2437:x1863365425944576:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:0.0:1777051378.599132:0:27884:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955506d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+48:2436:x1863365425944192:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 1301us (2232us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051378.599465:0:27884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10359 00000100:00100000:0.0:1777051378.599492:0:27884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10362 00000100:00100000:0.0:1777051378.599504:0:27884:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955507b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+50:2437:x1863365425944064:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:1.0:1777051378.599882:0:8468:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955506a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+47:2436:x1863365425944704:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 2017us (2871us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051378.599895:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10360 00000100:00100000:2.0:1777051378.599942:0:8628:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955504a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+50:2437:x1863365425944576:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 1940us (2447us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051378.599958:0:8628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10361 00000100:00100000:0.0:1777051378.599976:0:27884:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955507b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+50:2437:x1863365425944064:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 470us (2906us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051378.599988:0:27884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10362 00000100:00080000:1.0:1777051378.600031:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1777051378.600041:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1777051378.600048:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1777051378.600059:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1777051378.777014:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1777051379.687239:0:106093:0:(debug.c:645:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-hsm test 402b: CDT must retry request upon slow start of CT ========================================================== 13:22:58 (1777051378) 00010000:00010000:1.0:1777051379.798503:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1777051380.003278:0:104205:0:(update_trans.c:1333:distribute_txn_batchid_cb()) lustre-MDT0001: 4294970577 batchid updated 00000020:00080000:1.0:1777051380.003345:0:104230:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 4294970577 00000004:00080000:1.0:1777051380.003471:0:104230:0:(osp_trans.c:1582:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff99d958f6dd80 with version 14 00000020:00080000:1.0:1777051380.003519:0:104230:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4294970577 cancel update log [0x2000032e1:0x1:0x0].4: rc = 0 00000004:00080000:0.0:1777051380.003800:0:104211:0:(osp_trans.c:1330:osp_get_next_request()) ou ffff99d9596fa9c0 version 14 rpc_version 14 00000020:00100000:0.0:1777051380.003893:0:104211:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1777051380.003923:0:104211:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff99d950265c00 x1863365452608128/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1777051380.003976:0:104211:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d950265c00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:104211:1863365452608128:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1777051380.004112:0:104211:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051380.004699:0:104211:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d942ae6000 going to sleep for 11 seconds 00000020:00080000:1.0:1777051380.005687:0:104230:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4294970577 cancel update log [0x240000bd0:0x1:0x0].4: rc = 0 00000020:00080000:1.0:1777051380.005721:0:104230:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 4294970577 00000100:00100000:1.0:1777051380.005800:0:6585:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452608128 00000100:00100000:1.0:1777051380.005813:0:6585:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452608128 00000100:00100000:1.0:1777051380.005934:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8138 00000100:00100000:1.0:1777051380.005965:0:6585:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d950264000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:104211:x1863365452608128:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1777051380.006384:0:6585:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d950264000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:104211:x1863365452608128:12345-0@lo:1000:osp_up0-1.0 Request processed in 420us (2257us total) trans 30064771123 rc 0/0 00000100:00100000:1.0:1777051380.006402:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8138 00000100:00100000:0.0:1777051380.006441:0:104211:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d950265c00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:104211:1863365452608128:0@lo:1000:osp_up0-1.0 00000001:00080000:3.0:1777051380.026619:0:9540:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0001: transno 4294968356 is committed 00000001:00080000:3.0:1777051380.026646:0:9540:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0001: transno 4294968355 is committed 00000100:00100000:0.0:1777051380.152308:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051380.152479:0:10328:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425944832 00000100:00100000:2.0:1777051380.152510:0:10328:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425944832 00000100:00080000:1.0:1777051380.152806:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1777051380.152882:0:10328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111968 00000100:00100000:2.0:1777051380.152905:0:10328:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d950266a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+17:135475:x1863365425944832:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1777051380.152938:0:10328:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051380.152975:0:10328:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263200/0x85f51a6b96715d8b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6260 expref: -99 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051380.153075:0:10328:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950262400/0x85f51a6b96715d92 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051380.153102:0:10328:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d950262400/0x85f51a6b96715d92 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051380.153126:0:10328:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d950262400/0x85f51a6b96715d92 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1777051380.153199:0:10328:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 12288 00000004:00200000:2.0:1777051380.153206:0:10328:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1777051380.153237:0:10328:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99d950262400/0x85f51a6b96715d92 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051380.153278:0:10328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263200/0x85f51a6b96715d8b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6260 expref: 19 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051380.153382:0:10328:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950262400/0x85f51a6b96715d92 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6260 expref: 18 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051380.153401:0:10328:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d9533ab000) 00010000:00010000:2.0:1777051380.153407:0:10328:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1777051380.153413:0:10328:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d950262400, rc 0) 00000100:00100000:2.0:1777051380.153520:0:10328:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d950266a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+18:135475:x1863365425944832:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 Request processed in 618us (1222us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051380.153535:0:10328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111968 00000100:00100000:3.0:1777051380.163616:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051380.164179:0:8492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425944960 00000100:00100000:0.0:1777051380.164262:0:8492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425944960 00000100:00100000:0.0:1777051380.164360:0:8492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111969 00000100:00100000:0.0:1777051380.164379:0:8492:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955505500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+18:135476:x1863365425944960:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1777051380.164406:0:8492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051380.164438:0:8492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2aa00/0x85f51a6b96715d99 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6267 expref: -99 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051380.164533:0:8492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b400/0x85f51a6b96715da0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051380.164558:0:8492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b400/0x85f51a6b96715da0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051380.164579:0:8492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b400/0x85f51a6b96715da0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051380.164604:0:8492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2ae00/0x85f51a6b96715da7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051380.164620:0:8492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2ae00/0x85f51a6b96715da7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051380.164635:0:8492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2ae00/0x85f51a6b96715da7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051380.165077:0:8492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b000/0x85f51a6b96715dae lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051380.165096:0:8492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b000/0x85f51a6b96715dae lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051380.165113:0:8492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b000/0x85f51a6b96715dae lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1777051380.165170:0:8492:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1777051380.165177:0:8492:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1777051380.165242:0:8492:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b000/0x85f51a6b96715dae lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051380.165261:0:8492:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b400/0x85f51a6b96715da0 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051380.165270:0:8492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b400/0x85f51a6b96715da0 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051380.165278:0:8492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b400/0x85f51a6b96715da0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051380.165286:0:8492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b400/0x85f51a6b96715da0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051380.165294:0:8492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94eb2b400 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:0.0:1777051380.165299:0:8492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b400/0x85f51a6b96715da0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051380.165308:0:8492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b400/0x85f51a6b96715da0 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051380.165321:0:8492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d9533ab000) 00010000:00010000:0.0:1777051380.165325:0:8492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777051380.165330:0:8492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b400/0x85f51a6b96715da0 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051380.165338:0:8492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b400/0x85f51a6b96715da0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051380.165357:0:8492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2ae00/0x85f51a6b96715da7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051380.165365:0:8492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2ae00/0x85f51a6b96715da7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051380.165373:0:8492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2ae00/0x85f51a6b96715da7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051380.165380:0:8492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94eb2ae00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:0.0:1777051380.165383:0:8492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2ae00/0x85f51a6b96715da7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051380.165390:0:8492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2ae00/0x85f51a6b96715da7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051380.165398:0:8492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff99d94e81cf00) 00010000:00010000:0.0:1777051380.165401:0:8492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777051380.165404:0:8492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2ae00/0x85f51a6b96715da7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051380.165410:0:8492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2ae00/0x85f51a6b96715da7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051380.165447:0:8492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2aa00/0x85f51a6b96715d99 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6267 expref: 20 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051380.165463:0:8492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b000/0x85f51a6b96715dae lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6267 expref: 19 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051380.165472:0:8492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff99d94e5e2500) 00010000:00010000:0.0:1777051380.165474:0:8492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1777051380.165478:0:8492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d94eb2b000, rc 0) 00000100:00100000:0.0:1777051380.165572:0:8492:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955505500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+19:135476:x1863365425944960:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 Request processed in 1197us (1968us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051380.165588:0:8492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111969 00000100:00100000:3.0:1777051380.174767:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051380.175455:0:27885:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425945216 00000100:00100000:1.0:1777051380.175469:0:27885:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425945216 00000100:00100000:1.0:1777051380.175573:0:27885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111970 00000100:00100000:1.0:1777051380.175591:0:27885:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955507480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c11b6966-0775-44d2-bdc6-c74c26eb2226+19:135476:x1863365425945216:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1777051380.175619:0:27885:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777051380.175648:0:27885:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48ac00/0x85f51a6b96715db5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b626e expref: -99 pid: 27885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051380.176082:0:27885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48bc00/0x85f51a6b96715dbc lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051380.176107:0:27885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48bc00/0x85f51a6b96715dbc lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051380.176126:0:27885:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48bc00/0x85f51a6b96715dbc lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051380.176149:0:27885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48a800/0x85f51a6b96715dc3 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051380.176162:0:27885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48a800/0x85f51a6b96715dc3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051380.176523:0:27885:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48a800/0x85f51a6b96715dc3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051380.176669:0:27885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48a400/0x85f51a6b96715dca lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051380.176688:0:27885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48a400/0x85f51a6b96715dca lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051380.176704:0:27885:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48a400/0x85f51a6b96715dca lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1777051380.176756:0:27885:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:1.0:1777051380.176880:0:27885:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48bc00/0x85f51a6b96715dbc lrc: 4/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051380.176896:0:27885:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48bc00/0x85f51a6b96715dbc lrc: 4/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051380.176911:0:27885:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48bc00/0x85f51a6b96715dbc lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051380.176924:0:27885:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48bc00/0x85f51a6b96715dbc lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051380.176937:0:27885:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94e48bc00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:1.0:1777051380.176945:0:27885:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48bc00/0x85f51a6b96715dbc lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051380.176960:0:27885:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48bc00/0x85f51a6b96715dbc lrc: 5/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051380.176981:0:27885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff99d94e5e2500) 00010000:00010000:1.0:1777051380.176987:0:27885:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777051380.176995:0:27885:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48bc00/0x85f51a6b96715dbc lrc: 3/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051380.177007:0:27885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48bc00/0x85f51a6b96715dbc lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051380.177412:0:27885:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48a800/0x85f51a6b96715dc3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051380.177430:0:27885:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48a800/0x85f51a6b96715dc3 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051380.177443:0:27885:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48a800/0x85f51a6b96715dc3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051380.177456:0:27885:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94e48a800 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:1.0:1777051380.177464:0:27885:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48a800/0x85f51a6b96715dc3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051380.177480:0:27885:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48a800/0x85f51a6b96715dc3 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051380.177503:0:27885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff99d94e5e2d00) 00010000:00010000:1.0:1777051380.177510:0:27885:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777051380.177517:0:27885:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48a800/0x85f51a6b96715dc3 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051380.177531:0:27885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48a800/0x85f51a6b96715dc3 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051380.178015:0:27885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48ac00/0x85f51a6b96715db5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b626e expref: 22 pid: 27885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051380.178056:0:27885:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48a400/0x85f51a6b96715dca lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b626e expref: 21 pid: 27885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051380.178071:0:27885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99d941e2ea00) 00010000:00010000:1.0:1777051380.178076:0:27885:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777051380.178081:0:27885:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d94e48a400, rc 0) 00000100:00100000:1.0:1777051380.178175:0:27885:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955507480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c11b6966-0775-44d2-bdc6-c74c26eb2226+21:135476:x1863365425945216:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 Request processed in 2586us (3457us total) trans 30064771124 rc 0/0 00000100:00100000:1.0:1777051380.178190:0:27885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111970 00000100:00100000:3.0:1777051380.186808:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051380.186948:0:46497:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425945344 00000100:00100000:1.0:1777051380.186961:0:46497:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425945344 00000100:00100000:1.0:1777051380.187043:0:46497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111971 00000100:00100000:1.0:1777051380.187061:0:46497:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955505c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:c11b6966-0775-44d2-bdc6-c74c26eb2226+21:135476:x1863365425945344:12345-192.168.201.46@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1777051380.187271:0:46497:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955505c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:c11b6966-0775-44d2-bdc6-c74c26eb2226+21:135476:x1863365425945344:12345-192.168.201.46@tcp:59:lhsmtool_posix.0 Request processed in 211us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051380.187288:0:46497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111971 00000100:00100000:3.0:1777051380.191870:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051380.191966:0:6581:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425945472 00000100:00100000:2.0:1777051380.191975:0:6581:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425945472 00000100:00100000:2.0:1777051380.192075:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111972 00000100:00100000:2.0:1777051380.192092:0:6581:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d943d91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+8:135476:x1863365425945472:12345-192.168.201.46@tcp:59:lhsmtool_posix.0 00000100:00080000:1.0:1777051380.192538:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1777051380.192545:0:6581:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d943d91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+8:135476:x1863365425945472:12345-192.168.201.46@tcp:59:lhsmtool_posix.0 Request processed in 455us (679us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051380.192561:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111972 00000100:00100000:3.0:1777051380.204712:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051380.205004:0:27882:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425945600 00000100:00100000:0.0:1777051380.205017:0:27882:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425945600 00000100:00100000:0.0:1777051380.205130:0:27882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111973 00000100:00100000:0.0:1777051380.205153:0:27882:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942d22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+21:135477:x1863365425945600:12345-192.168.201.46@tcp:101:lfs.0 00010000:00010000:0.0:1777051380.205182:0:27882:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:1.0:1777051380.205182:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1777051380.205219:0:27882:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2aa00/0x85f51a6b96715dd8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6275 expref: -99 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051380.205365:0:27882:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2ae00/0x85f51a6b96715ddf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051380.205389:0:27882:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2ae00/0x85f51a6b96715ddf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051380.205408:0:27882:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2ae00/0x85f51a6b96715ddf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1777051380.205473:0:27882:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 12288 00000004:00200000:0.0:1777051380.205481:0:27882:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1777051380.205511:0:27882:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2ae00/0x85f51a6b96715ddf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051380.205542:0:27882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2aa00/0x85f51a6b96715dd8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6275 expref: 23 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051380.205562:0:27882:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2ae00/0x85f51a6b96715ddf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6275 expref: 22 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051380.205583:0:27882:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d9533ab000) 00010000:00010000:0.0:1777051380.205588:0:27882:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1777051380.205594:0:27882:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d94eb2ae00, rc 0) 00000100:00100000:0.0:1777051380.205682:0:27882:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942d22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+22:135477:x1863365425945600:12345-192.168.201.46@tcp:101:lfs.0 Request processed in 536us (980us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051380.205708:0:27882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111973 00000100:00100000:3.0:1777051380.212588:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051380.212753:0:6579:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425945728 00000100:00100000:2.0:1777051380.212765:0:6579:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425945728 00000100:00100000:2.0:1777051380.212837:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111974 00000100:00100000:2.0:1777051380.212851:0:6579:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942d23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+22:135477:x1863365425945728:12345-192.168.201.46@tcp:101:lfs.0 00010000:00010000:2.0:1777051380.212871:0:6579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051380.212896:0:6579:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263200/0x85f51a6b96715de6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b627c expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051380.212986:0:6579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950262e00/0x85f51a6b96715ded lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051380.213007:0:6579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d950262e00/0x85f51a6b96715ded lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051380.213025:0:6579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d950262e00/0x85f51a6b96715ded lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051380.213049:0:6579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263800/0x85f51a6b96715df4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2c29638e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051380.213064:0:6579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263800/0x85f51a6b96715df4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2c29638e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051380.213074:0:6579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263800/0x85f51a6b96715df4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2c29638e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051380.213141:0:6579:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950262e00/0x85f51a6b96715ded lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051380.213154:0:6579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950262e00/0x85f51a6b96715ded lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051380.213173:0:6579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d950262e00/0x85f51a6b96715ded lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051380.213184:0:6579:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d950262e00/0x85f51a6b96715ded lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051380.213245:0:6579:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d950262e00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:2.0:1777051380.213254:0:6579:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d950262e00/0x85f51a6b96715ded lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051380.213269:0:6579:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d950262e00/0x85f51a6b96715ded lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051380.213287:0:6579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d9533ab000) 00010000:00010000:2.0:1777051380.213294:0:6579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777051380.213302:0:6579:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d950262e00/0x85f51a6b96715ded lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051380.213324:0:6579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d950262e00/0x85f51a6b96715ded lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051380.213343:0:6579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263800/0x85f51a6b96715df4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2c29638e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051380.213350:0:6579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263800/0x85f51a6b96715df4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2c29638e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051380.213357:0:6579:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263800/0x85f51a6b96715df4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2c29638e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051380.213363:0:6579:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d950263800 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:2.0:1777051380.213368:0:6579:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263800/0x85f51a6b96715df4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2c29638e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051380.213375:0:6579:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263800/0x85f51a6b96715df4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2c29638e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051380.213384:0:6579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2c29638e (ffff99d9413d0e00) 00010000:00010000:2.0:1777051380.213387:0:6579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777051380.213390:0:6579:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263800/0x85f51a6b96715df4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2c29638e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051380.213402:0:6579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263800/0x85f51a6b96715df4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2c29638e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051380.213438:0:6579:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263200/0x85f51a6b96715de6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b627c expref: 23 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051380.213451:0:6579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d9533ab000) 00010000:00010000:2.0:1777051380.213454:0:6579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777051380.213458:0:6579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263200/0x85f51a6b96715de6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b627c expref: 23 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051380.213468:0:6579:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d950263200, rc 0) 00000100:00100000:2.0:1777051380.213526:0:6579:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942d23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+22:135477:x1863365425945728:12345-192.168.201.46@tcp:101:lfs.0 Request processed in 679us (948us total) trans 0 rc 301/301 00000100:00100000:2.0:1777051380.213535:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111974 00000100:00100000:3.0:1777051380.220025:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051380.220144:0:6588:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425945856 00000100:00100000:2.0:1777051380.220157:0:6588:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425945856 00000100:00100000:2.0:1777051380.220271:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 17 00000100:00100000:2.0:1777051380.220288:0:6588:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942d20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+22:135477:x1863365425945856:12345-192.168.201.46@tcp:700:lfs.0 00000100:00100000:2.0:1777051380.220395:0:6588:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942d20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+22:135477:x1863365425945856:12345-192.168.201.46@tcp:700:lfs.0 Request processed in 108us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051380.220409:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 17 00000100:00100000:3.0:1777051380.224638:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051380.224822:0:27885:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425946112 00000100:00100000:1.0:1777051380.224832:0:27885:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425946112 00000100:00100000:1.0:1777051380.224901:0:27885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111975 00000100:00100000:1.0:1777051380.224912:0:27885:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942d20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+22:135477:x1863365425946112:12345-192.168.201.46@tcp:36:lfs.0 00010000:00010000:1.0:1777051380.224969:0:27885:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1777051380.225005:0:27885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2ae00/0x85f51a6b96715ddf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6275 expref: 22 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051380.225042:0:27885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d9533ab000) 00010000:00010000:1.0:1777051380.225050:0:27885:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1777051380.225156:0:27885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48ac00/0x85f51a6b96715dfb lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051380.225180:0:27885:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48ba00/0x85f51a6b9671591d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b60d1 expref: 21 pid: 21368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051380.225535:0:27885:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48b400/0x85f51a6b9671597f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b60f4 expref: 20 pid: 21368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051380.225558:0:27885:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99d950262400/0x85f51a6b96715d92 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6260 expref: 20 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051380.225575:0:27885:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48ac00/0x85f51a6b96715dfb lrc: 6/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051380.225631:0:27885:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99d950262400/0x85f51a6b96715d92 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6260 expref: 20 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051380.225657:0:27885:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950262400/0x85f51a6b96715d92 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6260 expref: 20 pid: 10328 timeout: 8109 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051380.225680:0:27885:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da44496a00 pname:cluuid:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000_UUID:27885:1863365452608256:192.168.201.46@tcp:104: 00010000:00010000:1.0:1777051380.226201:0:27885:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48b400/0x85f51a6b9671597f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b60f4 expref: 20 pid: 21368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051380.226228:0:27885:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48b400/0x85f51a6b9671597f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b60f4 expref: 20 pid: 21368 timeout: 8109 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051380.226246:0:27885:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95f659500 pname:cluuid:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000_UUID:27885:1863365452608384:192.168.201.46@tcp:104: 00010000:00010000:1.0:1777051380.226370:0:27885:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48ba00/0x85f51a6b9671591d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b60d1 expref: 21 pid: 21368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051380.226382:0:27885:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48ba00/0x85f51a6b9671591d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b60d1 expref: 21 pid: 21368 timeout: 8109 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051380.226393:0:27885:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95f65a300 pname:cluuid:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000_UUID:27885:1863365452608512:192.168.201.46@tcp:104: 00000100:00100000:1.0:1777051380.226419:0:27885:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d958f6d3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1777051380.231644:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051380.231845:0:47597:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425946240 00000100:00100000:0.0:1777051380.231857:0:47597:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425946240 00010000:00010000:0.0:1777051380.231909:0:47597:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d950262400/0x85f51a6b96715d92 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6260 expref: 21 pid: 10328 timeout: 8109 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051380.231924:0:27885:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da44496a00 pname:cluuid:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000_UUID:27885:1863365452608256:192.168.201.46@tcp:104: 00010000:00010000:1.0:1777051380.231955:0:27885:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.201.46@tcp) returned -22 from blocking AST (req@00000000db8089b9 x1863365452608384) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48b400/0x85f51a6b9671597f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b60f4 expref: 21 pid: 21368 timeout: 8109 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051380.231964:0:47597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3869 00000100:00100000:0.0:1777051380.231989:0:47597:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942d20a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+21:2436:x1863365425946240:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1777051380.231997:0:27885:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48b400/0x85f51a6b9671597f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b60f4 expref: 21 pid: 21368 timeout: 8109 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051380.232015:0:47597:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777051380.232031:0:47597:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99d950262400/0x85f51a6b96715d92 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6260 expref: 21 pid: 10328 timeout: 8109 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051380.232035:0:27885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48b400/0x85f51a6b9671597f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b60f4 expref: 21 pid: 21368 timeout: 8109 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051380.232079:0:47597:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99d950262400/0x85f51a6b96715d92 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6260 expref: 20 pid: 10328 timeout: 8109 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051380.232087:0:27885:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95f659500 pname:cluuid:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000_UUID:27885:1863365452608384:192.168.201.46@tcp:104: 00010000:00010000:0.0:1777051380.232449:0:47597:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d950262400/0x85f51a6b96715d92 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6260 expref: 20 pid: 10328 timeout: 8109 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051380.232480:0:47597:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d9533ab000) 00010000:00010000:0.0:1777051380.232490:0:47597:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48ac00/0x85f51a6b96715dfb lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051380.232504:0:27885:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.201.46@tcp) returned -22 from blocking AST (req@00000000235327be x1863365452608512) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48ba00/0x85f51a6b9671591d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b60d1 expref: 21 pid: 21368 timeout: 8109 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051380.232512:0:47597:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1777051380.232534:0:27885:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48ba00/0x85f51a6b9671591d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b60d1 expref: 21 pid: 21368 timeout: 8109 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051380.232560:0:27885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48ba00/0x85f51a6b9671591d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b60d1 expref: 21 pid: 21368 timeout: 8109 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051380.232584:0:47597:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942d20a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+19:2436:x1863365425946240:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 596us (942us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051380.232586:0:27885:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95f65a300 pname:cluuid:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000_UUID:27885:1863365452608512:192.168.201.46@tcp:104: 00000100:00100000:0.0:1777051380.232612:0:47597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3869 00010000:00010000:1.0:1777051380.232646:0:27885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d9533ab000) 00010000:00010000:1.0:1777051380.232656:0:27885:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48ac00/0x85f51a6b96715dfb lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051380.232672:0:27885:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48ac00/0x85f51a6b96715dfb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50290000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051380.232687:0:27885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48ac00/0x85f51a6b96715dfb lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50290000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051380.232715:0:27885:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48ac00/0x85f51a6b96715dfb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051380.232762:0:27885:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48ac00/0x85f51a6b96715dfb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051380.232775:0:27885:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48ac00/0x85f51a6b96715dfb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051380.232805:0:27885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48a800/0x85f51a6b96715e02 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x2c29638e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051380.232829:0:27885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48a800/0x85f51a6b96715e02 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x2c29638e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051380.232842:0:27885:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48a800/0x85f51a6b96715e02 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x2c29638e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051380.236070:0:27885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48bc00/0x85f51a6b96715e09 lrc: 3/0,1 mode: --/PW res: [0x2000032e2:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051380.236093:0:27885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48bc00/0x85f51a6b96715e09 lrc: 3/0,1 mode: PW/PW res: [0x2000032e2:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051380.236109:0:27885:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48bc00/0x85f51a6b96715e09 lrc: 3/0,1 mode: PW/PW res: [0x2000032e2:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1777051380.236130:0:27885:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000d5f890c9 reply state 000000007d4cc9b0 transno 30064771125 ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48bc00/0x85f51a6b96715e09 lrc: 3/0,1 mode: PW/PW res: [0x2000032e2:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051380.236147:0:27885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48bc00/0x85f51a6b96715e09 lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e2:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051380.236159:0:27885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0x1:0x0].0x0 (ffff99d94e5e2200) 00010000:00010000:1.0:1777051380.236163:0:27885:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1777051380.236168:0:27885:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1777051380.236175:0:27885:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000032e2:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1777051380.236186:0:27885:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48ac00/0x85f51a6b96715dfb lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051380.236223:0:27885:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48ac00/0x85f51a6b96715dfb lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051380.236236:0:27885:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48ac00/0x85f51a6b96715dfb lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051380.236248:0:27885:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48ac00/0x85f51a6b96715dfb lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051380.236260:0:27885:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94e48ac00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:1.0:1777051380.236266:0:27885:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48ac00/0x85f51a6b96715dfb lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051380.236279:0:27885:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48ac00/0x85f51a6b96715dfb lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051380.236293:0:27885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d9533ab000) 00010000:00010000:1.0:1777051380.236297:0:27885:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777051380.236302:0:27885:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48ac00/0x85f51a6b96715dfb lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051380.236313:0:27885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48ac00/0x85f51a6b96715dfb lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1777051380.236330:0:27885:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000d5f890c9 reply state 000000007d4cc9b0 transno 30064771125 ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48a800/0x85f51a6b96715e02 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x2c29638e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051380.236344:0:27885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48a800/0x85f51a6b96715e02 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2c29638e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051380.236355:0:27885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2c29638e (ffff99d94e5e2d00) 00010000:00010000:1.0:1777051380.236360:0:27885:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1777051380.236363:0:27885:0:(service.c:177:ptlrpc_save_lock()) nlocks 1 00000100:00100000:1.0:1777051380.236455:0:27885:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942d20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+22:135477:x1863365425946112:12345-192.168.201.46@tcp:36:lfs.0 Request processed in 11540us (11820us total) trans 30064771125 rc 0/0 00000100:00100000:1.0:1777051380.236469:0:27885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111975 00000100:00100000:3.0:1777051380.255535:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051380.255648:0:21368:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425946368 00000100:00100000:2.0:1777051380.255665:0:21368:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425946368 00000100:00100000:2.0:1777051380.256164:0:21368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111976 00000100:00100000:2.0:1777051380.256184:0:21368:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942d21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+22:135478:x1863365425946368:12345-192.168.201.46@tcp:101:touch.0 00010000:00010000:2.0:1777051380.256220:0:21368:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051380.256250:0:21368:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263200/0x85f51a6b96715e10 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6283 expref: -99 pid: 21368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051380.256386:0:21368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263800/0x85f51a6b96715e17 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051380.256409:0:21368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263800/0x85f51a6b96715e17 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051380.256429:0:21368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263800/0x85f51a6b96715e17 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1777051380.256479:0:21368:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 12288 00000004:00200000:2.0:1777051380.256483:0:21368:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1777051380.256529:0:21368:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263800/0x85f51a6b96715e17 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051380.256559:0:21368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263200/0x85f51a6b96715e10 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6283 expref: 24 pid: 21368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051380.256580:0:21368:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263800/0x85f51a6b96715e17 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6283 expref: 23 pid: 21368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051380.256591:0:21368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d9533ab000) 00010000:00010000:2.0:1777051380.256596:0:21368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1777051380.256601:0:21368:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d950263800, rc 0) 00000100:00100000:2.0:1777051380.256695:0:21368:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942d21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+23:135478:x1863365425946368:12345-192.168.201.46@tcp:101:touch.0 Request processed in 515us (1167us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051380.256710:0:21368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111976 00000100:00100000:3.0:1777051380.263921:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051380.264089:0:6580:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425946496 00000100:00100000:2.0:1777051380.264101:0:6580:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425946496 00000100:00100000:2.0:1777051380.264519:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111977 00000100:00100000:2.0:1777051380.264689:0:6580:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942d20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+23:135478:x1863365425946496:12345-192.168.201.46@tcp:101:touch.0 00010000:00010000:2.0:1777051380.264714:0:6580:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051380.264773:0:6580:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263200/0x85f51a6b96715e1e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b628a expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051380.264856:0:6580:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950262e00/0x85f51a6b96715e25 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051380.264878:0:6580:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d950262e00/0x85f51a6b96715e25 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051380.264895:0:6580:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d950262e00/0x85f51a6b96715e25 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051380.264913:0:6580:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263e00/0x85f51a6b96715e2c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2c29638e bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051380.264924:0:6580:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263e00/0x85f51a6b96715e2c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2c29638e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051380.264939:0:6580:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263e00/0x85f51a6b96715e2c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2c29638e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051380.265047:0:6580:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263400/0x85f51a6b96715e33 lrc: 3/1,0 mode: --/PR res: [0x2000032e2:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051380.265063:0:6580:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263400/0x85f51a6b96715e33 lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051380.265420:0:6580:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263400/0x85f51a6b96715e33 lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1777051380.265479:0:6580:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000032e2:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1777051380.265486:0:6580:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1777051380.265513:0:6580:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263400/0x85f51a6b96715e33 lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051380.265535:0:6580:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950262e00/0x85f51a6b96715e25 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051380.265547:0:6580:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950262e00/0x85f51a6b96715e25 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051380.265557:0:6580:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d950262e00/0x85f51a6b96715e25 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051380.265569:0:6580:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d950262e00/0x85f51a6b96715e25 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051380.265580:0:6580:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d950262e00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:2.0:1777051380.265586:0:6580:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d950262e00/0x85f51a6b96715e25 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051380.265601:0:6580:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d950262e00/0x85f51a6b96715e25 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051380.265619:0:6580:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d9533ab000) 00010000:00010000:2.0:1777051380.265624:0:6580:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777051380.265631:0:6580:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d950262e00/0x85f51a6b96715e25 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051380.265643:0:6580:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d950262e00/0x85f51a6b96715e25 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051380.265664:0:6580:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263e00/0x85f51a6b96715e2c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2c29638e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051380.265676:0:6580:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263e00/0x85f51a6b96715e2c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2c29638e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051380.265686:0:6580:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263e00/0x85f51a6b96715e2c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2c29638e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051380.265695:0:6580:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d950263e00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:2.0:1777051380.265700:0:6580:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263e00/0x85f51a6b96715e2c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2c29638e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051380.265710:0:6580:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263e00/0x85f51a6b96715e2c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2c29638e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051380.265755:0:6580:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2c29638e (ffff99d94e5e2d00) 00010000:00010000:2.0:1777051380.265760:0:6580:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777051380.265765:0:6580:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263e00/0x85f51a6b96715e2c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2c29638e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051380.265783:0:6580:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263e00/0x85f51a6b96715e2c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2c29638e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051380.265815:0:6580:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263200/0x85f51a6b96715e1e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b628a expref: 25 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051380.265830:0:6580:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263400/0x85f51a6b96715e33 lrc: 3/0,0 mode: PR/PR res: [0x2000032e2:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b628a expref: 24 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051380.265839:0:6580:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0x1:0x0].0x0 (ffff99d94e5e2200) 00010000:00010000:2.0:1777051380.265842:0:6580:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1777051380.265845:0:6580:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d950263400, rc 0) 00000100:00100000:2.0:1777051380.265930:0:6580:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942d20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+24:135478:x1863365425946496:12345-192.168.201.46@tcp:101:touch.0 Request processed in 1248us (2015us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051380.265943:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111977 00000100:00100000:0.0:1777051380.278568:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051380.279613:0:10328:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425946752 00000100:00100000:2.0:1777051380.279630:0:10328:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425946752 00000100:00100000:2.0:1777051380.279763:0:10328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111978 00000100:00100000:2.0:1777051380.279795:0:10328:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d950266d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+24:135478:x1863365425946752:12345-192.168.201.46@tcp:101:touch.0 00010000:00010000:2.0:1777051380.279828:0:10328:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051380.279861:0:10328:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263200/0x85f51a6b96715e3a lrc: 2/0,0 mode: --/CW res: [0x2000032e2:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6291 expref: -99 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051380.280027:0:10328:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263e00/0x85f51a6b96715e41 lrc: 3/0,1 mode: --/CW res: [0x2000032e2:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051380.280191:0:10328:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263e00/0x85f51a6b96715e41 lrc: 3/0,1 mode: CW/CW res: [0x2000032e2:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051380.280210:0:10328:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263e00/0x85f51a6b96715e41 lrc: 3/0,1 mode: CW/CW res: [0x2000032e2:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051380.280233:0:10328:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950262e00/0x85f51a6b96715e48 lrc: 3/0,1 mode: --/PW res: [0x2000032e2:0x1:0x0].0x86fa115b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051380.280243:0:10328:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d950262e00/0x85f51a6b96715e48 lrc: 3/0,1 mode: PW/PW res: [0x2000032e2:0x1:0x0].0x86fa115b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051380.280252:0:10328:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d950262e00/0x85f51a6b96715e48 lrc: 3/0,1 mode: PW/PW res: [0x2000032e2:0x1:0x0].0x86fa115b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1777051380.280985:0:10328:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x1e3:0x0], index 0: 0 00010000:00010000:2.0:1777051380.281595:0:10328:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950262600/0x85f51a6b96715e4f lrc: 3/1,0 mode: --/PR res: [0x2000032e2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051380.281616:0:10328:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d950262600/0x85f51a6b96715e4f lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051380.281633:0:10328:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d950262600/0x85f51a6b96715e4f lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051380.281689:0:10328:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263e00/0x85f51a6b96715e41 lrc: 4/0,1 mode: CW/CW res: [0x2000032e2:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051380.281705:0:10328:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263e00/0x85f51a6b96715e41 lrc: 4/0,1 mode: CW/CW res: [0x2000032e2:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051380.281717:0:10328:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263e00/0x85f51a6b96715e41 lrc: 3/0,0 mode: CW/CW res: [0x2000032e2:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051380.281767:0:10328:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263e00/0x85f51a6b96715e41 lrc: 4/0,0 mode: CW/CW res: [0x2000032e2:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051380.282097:0:10328:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d950263e00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:2.0:1777051380.282106:0:10328:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263e00/0x85f51a6b96715e41 lrc: 4/0,0 mode: CW/CW res: [0x2000032e2:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051380.282121:0:10328:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263e00/0x85f51a6b96715e41 lrc: 5/0,0 mode: CW/CW res: [0x2000032e2:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051380.282145:0:10328:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0x1:0x0].0x0 (ffff99d94e5e2200) 00010000:00010000:2.0:1777051380.282152:0:10328:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777051380.282160:0:10328:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263e00/0x85f51a6b96715e41 lrc: 3/0,0 mode: --/CW res: [0x2000032e2:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051380.282174:0:10328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263e00/0x85f51a6b96715e41 lrc: 0/0,0 mode: --/CW res: [0x2000032e2:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1777051380.282271:0:10328:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000000c5d522f reply state 000000004c1524e7 transno 30064771126 ns: mdt-lustre-MDT0000_UUID lock: ffff99d950262e00/0x85f51a6b96715e48 lrc: 3/0,1 mode: PW/PW res: [0x2000032e2:0x1:0x0].0x86fa115b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051380.282295:0:10328:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d950262e00/0x85f51a6b96715e48 lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e2:0x1:0x0].0x86fa115b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051380.282311:0:10328:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0x1:0x0].0x86fa115b (ffff99d9413d0e00) 00010000:00010000:2.0:1777051380.282317:0:10328:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1777051380.282324:0:10328:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1777051380.282380:0:10328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263200/0x85f51a6b96715e3a lrc: 0/0,0 mode: --/CW res: [0x2000032e2:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6291 expref: 27 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051380.282410:0:10328:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950262600/0x85f51a6b96715e4f lrc: 3/0,0 mode: PR/PR res: [0x2000032e2:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6291 expref: 26 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051380.282438:0:10328:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0x2:0x0].0x0 (ffff99d9413d0000) 00010000:00010000:2.0:1777051380.282443:0:10328:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1777051380.282448:0:10328:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d950262600, rc 0) 00000100:00100000:2.0:1777051380.282672:0:10328:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d950266d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+27:135478:x1863365425946752:12345-192.168.201.46@tcp:101:touch.0 Request processed in 2889us (4110us total) trans 30064771126 rc 0/0 00000100:00100000:2.0:1777051380.282690:0:10328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111978 00000100:00100000:1.0:1777051380.291342:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051380.291464:0:8492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425947008 00000100:00100000:0.0:1777051380.291476:0:8492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425947008 00000100:00100000:0.0:1777051380.291556:0:8492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111979 00000100:00100000:0.0:1777051380.291573:0:8492:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f65a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+27:135478:x1863365425947008:12345-192.168.201.46@tcp:36:touch.0 00010000:00010000:0.0:1777051380.291642:0:8492:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777051380.292059:0:8492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d950262600/0x85f51a6b96715e4f lrc: 0/0,0 mode: --/PR res: [0x2000032e2:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6291 expref: 27 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051380.292087:0:8492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0x2:0x0].0x0 (ffff99d9413d0000) 00010000:00010000:0.0:1777051380.292103:0:8492:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1777051380.292168:0:8492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2bc00/0x85f51a6b96715e5d lrc: 3/0,1 mode: --/PW res: [0x2000032e2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051380.292270:0:8492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2bc00/0x85f51a6b96715e5d lrc: 3/0,1 mode: PW/PW res: [0x2000032e2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051380.292292:0:8492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2bc00/0x85f51a6b96715e5d lrc: 3/0,1 mode: PW/PW res: [0x2000032e2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1777051380.292455:0:8492:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000235327be reply state 000000007ea5d003 transno 30064771127 ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2bc00/0x85f51a6b96715e5d lrc: 3/0,1 mode: PW/PW res: [0x2000032e2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051380.292478:0:8492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2bc00/0x85f51a6b96715e5d lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051380.292492:0:8492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0x2:0x0].0x0 (ffff99d94e81cf00) 00010000:00010000:0.0:1777051380.292497:0:8492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1777051380.292502:0:8492:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1777051380.292636:0:8492:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f65a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+28:135478:x1863365425947008:12345-192.168.201.46@tcp:36:touch.0 Request processed in 1063us (1300us total) trans 30064771127 rc 0/0 00000100:00100000:0.0:1777051380.292651:0:8492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111979 00000100:00100000:3.0:1777051380.302547:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051380.303002:0:46494:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425947136 00000100:00100000:2.0:1777051380.303015:0:46494:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425947136 00000100:00100000:2.0:1777051380.303100:0:46494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111980 00000100:00100000:2.0:1777051380.303119:0:46494:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942d21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+28:135478:x1863365425947136:12345-192.168.201.46@tcp:101:touch.0 00010000:00010000:2.0:1777051380.303173:0:46494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051380.303249:0:46494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263200/0x85f51a6b96715e64 lrc: 2/0,0 mode: --/CR res: [0x2000032e2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6298 expref: -99 pid: 46494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051380.303325:0:46494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263200/0x85f51a6b96715e64 lrc: 3/0,0 mode: CR/CR res: [0x2000032e2:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6298 expref: 29 pid: 46494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051380.303349:0:46494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263200/0x85f51a6b96715e64 lrc: 3/0,0 mode: CR/CR res: [0x2000032e2:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6298 expref: 29 pid: 46494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051380.303376:0:46494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0x2:0x0].0x0 (ffff99d94e81cf00) 00010000:00010000:2.0:1777051380.303381:0:46494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1777051380.303387:0:46494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d950263200, rc 0) 00000100:00100000:2.0:1777051380.303473:0:46494:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942d21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+29:135478:x1863365425947136:12345-192.168.201.46@tcp:101:touch.0 Request processed in 357us (938us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051380.303495:0:46494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111980 00000100:00100000:3.0:1777051380.309621:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051380.309822:0:24468:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425947264 00000100:00100000:0.0:1777051380.309833:0:24468:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425947264 00000100:00100000:0.0:1777051380.309982:0:24468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 7993 00000100:00100000:0.0:1777051380.310024:0:24468:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942d21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+50:2436:x1863365425947264:12345-192.168.201.46@tcp:2:touch.0 00000100:00100000:0.0:1777051380.310437:0:24468:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942d21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+51:2436:x1863365425947264:12345-192.168.201.46@tcp:2:touch.0 Request processed in 438us (820us total) trans 4294968354 rc 0/0 00000100:00100000:0.0:1777051380.310451:0:24468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 7993 00000100:00080000:1.0:1777051380.310575:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1777051380.313561:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051380.313662:0:6582:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425947520 00000100:00100000:2.0:1777051380.313673:0:6582:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425947520 00000100:00100000:2.0:1777051380.313797:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3345 00000100:00100000:2.0:1777051380.313818:0:6582:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f659500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+29:135478:x1863365425947520:12345-192.168.201.46@tcp:35:touch.0 00000100:00100000:2.0:1777051380.314272:0:6582:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f659500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+30:135478:x1863365425947520:12345-192.168.201.46@tcp:35:touch.0 Request processed in 383us (634us total) trans 30064771128 rc 0/0 00000100:00100000:2.0:1777051380.314293:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3345 00000100:00100000:3.0:1777051380.343106:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051380.343629:0:46497:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425947648 00000100:00100000:1.0:1777051380.343644:0:46497:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425947648 00000100:00100000:1.0:1777051380.343763:0:46497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111981 00000100:00100000:1.0:1777051380.343800:0:46497:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942d22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+30:135480:x1863365425947648:12345-192.168.201.46@tcp:101:lfs.0 00010000:00010000:1.0:1777051380.343838:0:46497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777051380.343870:0:46497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48b400/0x85f51a6b96715e6b lrc: 2/0,0 mode: --/CR res: [0x2000032e2:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b629f expref: -99 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051380.343973:0:46497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48ae00/0x85f51a6b96715e72 lrc: 3/1,0 mode: --/CR res: [0x2000032e2:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051380.344001:0:46497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48ae00/0x85f51a6b96715e72 lrc: 3/1,0 mode: CR/CR res: [0x2000032e2:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051380.344022:0:46497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48ae00/0x85f51a6b96715e72 lrc: 3/1,0 mode: CR/CR res: [0x2000032e2:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051380.344044:0:46497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48be00/0x85f51a6b96715e79 lrc: 3/1,0 mode: --/PR res: [0x2000032e2:0x1:0x0].0x86fa115b bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051380.344061:0:46497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48be00/0x85f51a6b96715e79 lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0x1:0x0].0x86fa115b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051380.344075:0:46497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48be00/0x85f51a6b96715e79 lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0x1:0x0].0x86fa115b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051380.344492:0:46497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48b600/0x85f51a6b96715e80 lrc: 3/1,0 mode: --/PR res: [0x2000032e2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051380.344519:0:46497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48b600/0x85f51a6b96715e80 lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051380.344534:0:46497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48b600/0x85f51a6b96715e80 lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1777051380.344602:0:46497:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000032e2:0x2:0x0]: returning size 0 00000004:00200000:1.0:1777051380.344610:0:46497:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1777051380.344642:0:46497:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48b600/0x85f51a6b96715e80 lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051380.344664:0:46497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48b600/0x85f51a6b96715e80 lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051380.344682:0:46497:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48ae00/0x85f51a6b96715e72 lrc: 4/1,0 mode: CR/CR res: [0x2000032e2:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051380.344695:0:46497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48ae00/0x85f51a6b96715e72 lrc: 4/1,0 mode: CR/CR res: [0x2000032e2:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051380.344706:0:46497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48ae00/0x85f51a6b96715e72 lrc: 3/0,0 mode: CR/CR res: [0x2000032e2:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051380.345023:0:46497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48ae00/0x85f51a6b96715e72 lrc: 4/0,0 mode: CR/CR res: [0x2000032e2:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051380.345037:0:46497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94e48ae00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:1.0:1777051380.345044:0:46497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48ae00/0x85f51a6b96715e72 lrc: 4/0,0 mode: CR/CR res: [0x2000032e2:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051380.345059:0:46497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48ae00/0x85f51a6b96715e72 lrc: 5/0,0 mode: CR/CR res: [0x2000032e2:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051380.345095:0:46497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0x1:0x0].0x0 (ffff99d94e5e2200) 00010000:00010000:1.0:1777051380.345102:0:46497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777051380.345112:0:46497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48ae00/0x85f51a6b96715e72 lrc: 3/0,0 mode: --/CR res: [0x2000032e2:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051380.345125:0:46497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48ae00/0x85f51a6b96715e72 lrc: 0/0,0 mode: --/CR res: [0x2000032e2:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051380.345150:0:46497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48be00/0x85f51a6b96715e79 lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0x1:0x0].0x86fa115b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051380.345163:0:46497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48be00/0x85f51a6b96715e79 lrc: 2/0,0 mode: PR/PR res: [0x2000032e2:0x1:0x0].0x86fa115b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051380.345175:0:46497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48be00/0x85f51a6b96715e79 lrc: 3/0,0 mode: PR/PR res: [0x2000032e2:0x1:0x0].0x86fa115b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051380.345186:0:46497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94e48be00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:1.0:1777051380.345192:0:46497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48be00/0x85f51a6b96715e79 lrc: 3/0,0 mode: PR/PR res: [0x2000032e2:0x1:0x0].0x86fa115b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051380.345270:0:46497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48be00/0x85f51a6b96715e79 lrc: 4/0,0 mode: PR/PR res: [0x2000032e2:0x1:0x0].0x86fa115b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051380.345287:0:46497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0x1:0x0].0x86fa115b (ffff99d9413d0e00) 00010000:00010000:1.0:1777051380.345292:0:46497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777051380.345298:0:46497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48be00/0x85f51a6b96715e79 lrc: 2/0,0 mode: --/PR res: [0x2000032e2:0x1:0x0].0x86fa115b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051380.345310:0:46497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48be00/0x85f51a6b96715e79 lrc: 0/0,0 mode: --/PR res: [0x2000032e2:0x1:0x0].0x86fa115b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051380.345375:0:46497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48b400/0x85f51a6b96715e6b lrc: 0/0,0 mode: --/CR res: [0x2000032e2:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b629f expref: 32 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051380.345404:0:46497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48b600/0x85f51a6b96715e80 lrc: 3/0,0 mode: PR/PR res: [0x2000032e2:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b629f expref: 31 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051380.345420:0:46497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0x2:0x0].0x0 (ffff99d94e81cf00) 00010000:00010000:1.0:1777051380.345425:0:46497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1777051380.345430:0:46497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d94e48b600, rc 0) 00000100:00100000:1.0:1777051380.345532:0:46497:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942d22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+31:135480:x1863365425947648:12345-192.168.201.46@tcp:101:lfs.0 Request processed in 1752us (2435us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051380.345547:0:46497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111981 00000100:00100000:3.0:1777051380.492867:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051380.492994:0:13320:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425947776 00000100:00100000:1.0:1777051380.493009:0:13320:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425947776 00000100:00100000:1.0:1777051380.493123:0:13320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 7994 00000100:00100000:1.0:1777051380.493523:0:13320:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942d22d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+51:2439:x1863365425947776:12345-192.168.201.46@tcp:101:lfs.0 00010000:00010000:1.0:1777051380.493552:0:13320:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777051380.493583:0:13320:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db813c71/0x85f51a6b96715e87 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x1e3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b62a6 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1777051380.493647:0:13320:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x1e3:0x0] initial LVB size: 0, mtime: 0x69eba6f4, atime: 0x69eba6f4, ctime: 0x69eba6f4, blocks: 0x0 00010000:00010000:1.0:1777051380.493678:0:13320:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051380.493682:0:13320:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051380.493696:0:13320:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db813c71/0x85f51a6b96715e87 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x1e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b62a6 expref: 52 pid: 13320 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051380.493765:0:13320:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000db813c71/0x85f51a6b96715e87 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x1e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b62a6 expref: 52 pid: 13320 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051380.493788:0:13320:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d94e48b400, rc 0) 00000100:00100000:1.0:1777051380.493885:0:13320:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942d22d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+52:2439:x1863365425947776:12345-192.168.201.46@tcp:101:lfs.0 Request processed in 747us (1029us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051380.493899:0:13320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 7994 00000100:00100000:3.0:1777051380.501112:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051380.501286:0:6581:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425947904 00000100:00100000:2.0:1777051380.501297:0:6581:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425947904 00000100:00100000:2.0:1777051380.501400:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111982 00000100:00100000:2.0:1777051380.501417:0:6581:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942d21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+31:135488:x1863365425947904:12345-192.168.201.46@tcp:101:lfs.0 00010000:00010000:2.0:1777051380.501439:0:6581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051380.501465:0:6581:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263e00/0x85f51a6b96715e8e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b62ad expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051380.501558:0:6581:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950262c00/0x85f51a6b96715e95 lrc: 3/1,0 mode: --/PR res: [0x2000032e2:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051380.501582:0:6581:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d950262c00/0x85f51a6b96715e95 lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051380.501602:0:6581:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d950262c00/0x85f51a6b96715e95 lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1777051380.501663:0:6581:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000032e2:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1777051380.501670:0:6581:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1777051380.501699:0:6581:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99d950262c00/0x85f51a6b96715e95 lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051380.501776:0:6581:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263e00/0x85f51a6b96715e8e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b62ad expref: 33 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051380.501807:0:6581:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950262c00/0x85f51a6b96715e95 lrc: 3/0,0 mode: PR/PR res: [0x2000032e2:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b62ad expref: 32 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051380.501822:0:6581:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0x1:0x0].0x0 (ffff99d94e5e2200) 00010000:00010000:2.0:1777051380.501828:0:6581:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1777051380.501834:0:6581:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d950262c00, rc 0) 00000100:00100000:2.0:1777051380.501918:0:6581:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942d21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+32:135488:x1863365425947904:12345-192.168.201.46@tcp:101:lfs.0 Request processed in 504us (810us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051380.501932:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111982 00000040:00080000:1.0:1777051380.502501:0:103189:0:(llog.c:801:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:1.0:1777051380.502508:0:103189:0:(llog_cat.c:158:llog_cat_process_common()) processing log [0x1:0x2b:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1777051380.502548:0:103189:0:(llog.c:858:llog_process_thread()) stop processing plain [0x1:0x2b:0x0] index 3 count 3 00000040:00080000:1.0:1777051380.502561:0:103189:0:(llog.c:858:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00000100:00100000:0.0:1777051380.502636:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95aecd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452608640:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1777051380.502707:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051380.503270:0:11727:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452608640 00000100:00100000:1.0:1777051380.503280:0:11727:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452608640 00000100:00100000:1.0:1777051380.503347:0:11727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8139 00000100:00100000:1.0:1777051380.503362:0:11727:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d950264380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:3679:x1863365452608640:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1777051380.503402:0:11727:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4194304 pending 0 free 1441579008 avail 1295339520 00000100:00100000:1.0:1777051380.503487:0:11727:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d950264380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:3679:x1863365452608640:12345-0@lo:41:osp-pre-0-1.0 Request processed in 126us (777us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051380.503504:0:11727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8139 00000100:00100000:3.0:1777051380.503617:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95aecd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452608640:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1777051380.511902:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051380.512027:0:27882:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425948160 00000100:00100000:0.0:1777051380.512039:0:27882:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425948160 00000100:00100000:0.0:1777051380.512132:0:27882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111983 00000100:00100000:0.0:1777051380.512148:0:27882:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95aecd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+32:135488:x1863365425948160:12345-192.168.201.46@tcp:58:lfs.0 00000040:00080000:0.0:1777051380.512401:0:27882:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2b:0x0].3, 136 off8600 00000100:00100000:0.0:1777051380.512543:0:27882:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95aecd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+32:135488:x1863365425948160:12345-192.168.201.46@tcp:58:lfs.0 Request processed in 395us (643us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051380.512559:0:27882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111983 00010000:00010000:0.0:1777051380.823314:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1777051380.887171:0:104226:0:(llog.c:801:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1777051380.887188:0:104226:0:(llog_cat.c:158:llog_cat_process_common()) processing log [0x1:0x12:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1777051380.887296:0:104226:0:(llog.c:858:llog_process_thread()) stop processing plain [0x1:0x12:0x0] index 3 count 3 00000040:00080000:1.0:1777051380.887314:0:104226:0:(llog.c:858:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1777051381.014751:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95aecc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3680:1863365452608768:0@lo:400:kworker.0 00000100:00100000:0.0:1777051381.014814:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95aecce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3678:1863365452609024:0@lo:400:kworker.0 00000100:00100000:2.0:1777051381.014885:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051381.014920:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051381.015581:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95aecf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3677:1863365452608896:0@lo:400:kworker.0 00000100:00100000:3.0:1777051381.015582:0:103163:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452608768 00000100:00100000:3.0:1777051381.015597:0:103163:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452608768 00000100:00100000:1.0:1777051381.015668:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051381.015688:0:103163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1777051381.015762:0:8492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452609024 00000100:00100000:0.0:1777051381.015775:0:8492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452609024 00000100:00100000:3.0:1777051381.015787:0:103163:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f3dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9351a01-5b0e-4470-97fd-58b9b4b312a2+23:3680:x1863365452608768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777051381.015844:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95aece300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3679:1863365452609152:0@lo:400:kworker.0 00000100:00100000:2.0:1777051381.015937:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95aecc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3680:1863365452608768:0@lo:400:kworker.0 00000100:00100000:1.0:1777051381.015938:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051381.015968:0:8492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452608896 00000100:00100000:0.0:1777051381.015979:0:8492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452608896 00000100:00100000:2.0:1777051381.015997:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95aecc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3680:1863365452609280:0@lo:400:kworker.0 00000100:00100000:1.0:1777051381.016010:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95aecdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452609664:0@lo:400:kworker.0 00000100:00100000:0.0:1777051381.016040:0:8492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452609152 00000100:00100000:0.0:1777051381.016049:0:8492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452609152 00000100:00100000:2.0:1777051381.016078:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051381.016433:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051381.016465:0:103163:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f3dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9351a01-5b0e-4470-97fd-58b9b4b312a2+23:3680:x1863365452608768:12345-0@lo:400:kworker.0 Request processed in 216us (1043us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051381.016475:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95aecf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3680:1863365452609792:0@lo:400:kworker.0 00000100:00100000:3.0:1777051381.016497:0:103163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1777051381.016505:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95aecea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452610176:0@lo:400:kworker.0 00000100:00100000:2.0:1777051381.016544:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051381.016594:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051381.016607:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95aecc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3680:1863365452610304:0@lo:400:kworker.0 00000100:00100000:3.0:1777051381.016639:0:46494:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452609280 00000100:00100000:3.0:1777051381.016651:0:46494:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452609280 00000100:00100000:2.0:1777051381.016679:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051381.016703:0:8492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452609792 00000100:00100000:1.0:1777051381.016744:0:27885:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452610304 00000100:00100000:1.0:1777051381.016758:0:27885:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452610304 00000100:00100000:0.0:1777051381.016789:0:8492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452609792 00000100:00100000:2.0:1777051381.016817:0:46497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13301 00000100:00100000:1.0:1777051381.016838:0:27885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13302 00000100:00100000:2.0:1777051381.016843:0:46497:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d950267100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:lustre-MDT0001-lwp-OST0000_UUID+5:3678:x1863365452609024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051381.016858:0:46494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13303 00000100:00100000:1.0:1777051381.016869:0:27885:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da44496a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000-lwp-OST0000_UUID+5:3677:x1863365452608896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777051381.016887:0:8492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13304 00000100:00100000:3.0:1777051381.016890:0:46494:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95faeb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000-lwp-OST0001_UUID+5:3679:x1863365452609152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777051381.016915:0:8492:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5fbee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3680:x1863365452609280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777051381.016944:0:46497:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d950267100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:lustre-MDT0001-lwp-OST0000_UUID+5:3678:x1863365452609024:12345-0@lo:400:kworker.0 Request processed in 109us (2024us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051381.016963:0:46497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13301 00000100:00100000:1.0:1777051381.016984:0:27885:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da44496a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000-lwp-OST0000_UUID+5:3677:x1863365452608896:12345-0@lo:400:kworker.0 Request processed in 125us (1315us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051381.017002:0:27885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13302 00000100:00100000:2.0:1777051381.017018:0:46497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13305 00000100:00100000:2.0:1777051381.017043:0:46497:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5fbedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:lustre-MDT0000-lwp-MDT0001_UUID+5:3680:x1863365452610304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777051381.017059:0:8492:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5fbee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3680:x1863365452609280:12345-0@lo:400:kworker.0 Request processed in 146us (975us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051381.017059:0:27885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13306 00000100:00100000:3.0:1777051381.017062:0:46494:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95faeb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000-lwp-OST0001_UUID+5:3679:x1863365452609152:12345-0@lo:400:kworker.0 Request processed in 178us (1123us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051381.017091:0:27885:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5fbee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000-lwp-MDT0000_UUID+5:3680:x1863365452609792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051381.017102:0:46494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13303 00000100:00100000:2.0:1777051381.017141:0:46497:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5fbedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:lustre-MDT0000-lwp-MDT0001_UUID+5:3680:x1863365452610304:12345-0@lo:400:kworker.0 Request processed in 106us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051381.017158:0:46497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13305 00000100:00100000:1.0:1777051381.017194:0:27885:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5fbee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000-lwp-MDT0000_UUID+5:3680:x1863365452609792:12345-0@lo:400:kworker.0 Request processed in 109us (645us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051381.017291:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95aece300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3679:1863365452609152:0@lo:400:kworker.0 00000100:00100000:1.0:1777051381.017355:0:27885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13306 00000100:00100000:0.0:1777051381.017371:0:8492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13304 00000100:00100000:3.0:1777051381.017380:0:8470:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452609664 00000100:00100000:3.0:1777051381.017393:0:8470:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452609664 00000100:00100000:2.0:1777051381.017429:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95aecc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3680:1863365452609280:0@lo:400:kworker.0 00000100:00080000:0.0:1777051381.017439:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1777051381.017484:0:8470:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452610176 00000100:00100000:1.0:1777051381.017488:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95aecf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3677:1863365452608896:0@lo:400:kworker.0 00000100:00100000:2.0:1777051381.017488:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95aecf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3680:1863365452609792:0@lo:400:kworker.0 00000100:00100000:3.0:1777051381.017494:0:8470:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452610176 00000100:00100000:1.0:1777051381.017530:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95aecca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3677:1863365452609408:0@lo:400:kworker.0 00000100:00100000:2.0:1777051381.017542:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95aecc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3680:1863365452610304:0@lo:400:kworker.0 00000100:00100000:3.0:1777051381.017573:0:8470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10363 00000100:00080000:0.0:1777051381.017582:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1777051381.017594:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1777051381.017600:0:8470:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d9418f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3679:x1863365452609664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777051381.017613:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051381.017628:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10364 00000100:00100000:2.0:1777051381.017653:0:8471:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d9418f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3679:x1863365452610176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777051381.017685:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95aecd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452609920:0@lo:400:kworker.0 00000100:00100000:3.0:1777051381.017771:0:8470:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d9418f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3679:x1863365452609664:12345-0@lo:400:kworker.0 Request processed in 178us (1665us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051381.017790:0:8470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10363 00000100:00100000:2.0:1777051381.017817:0:8471:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d9418f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3679:x1863365452610176:12345-0@lo:400:kworker.0 Request processed in 167us (1221us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051381.017829:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051381.017846:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10364 00000100:00100000:3.0:1777051381.017882:0:46498:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452609408 00000100:00100000:0.0:1777051381.017887:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95aecce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3678:1863365452609024:0@lo:400:kworker.0 00000100:00100000:3.0:1777051381.017893:0:46498:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452609408 00000100:00100000:1.0:1777051381.017927:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95faeb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3677:1863365452610432:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1777051381.017947:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95aeced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3678:1863365452609536:0@lo:400:kworker.0 00000100:00100000:2.0:1777051381.017964:0:3679:0:(client.c:3101:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968356 gen 2 00000100:00100000:3.0:1777051381.017974:0:46498:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452609920 00000004:00080000:2.0:1777051381.017976:0:3679:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff99d951fa1880, transno 4294968356 00000100:00100000:3.0:1777051381.017984:0:46498:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452609920 00000100:00100000:1.0:1777051381.018008:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051381.018015:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95aecdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452609664:0@lo:400:kworker.0 00000100:00100000:0.0:1777051381.018034:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051381.018049:0:3679:0:(client.c:3101:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294968355 gen 2 00000100:00100000:3.0:1777051381.018050:0:46498:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452610432 00000004:00080000:2.0:1777051381.018062:0:3679:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff99d950267480, transno 4294968355 00000100:00100000:3.0:1777051381.018063:0:46498:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452610432 00000100:00100000:2.0:1777051381.018099:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95aecea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452610176:0@lo:400:kworker.0 00000100:00100000:0.0:1777051381.018126:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95aece680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452610048:0@lo:400:kworker.0 00000100:00100000:3.0:1777051381.018146:0:46498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8140 00000100:00100000:3.0:1777051381.018169:0:46498:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d9418f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+7:3677:x1863365452609408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777051381.018193:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051381.018346:0:27887:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452609536 00000100:00100000:3.0:1777051381.018355:0:46498:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d9418f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+7:3677:x1863365452609408:12345-0@lo:400:kworker.0 Request processed in 190us (746us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051381.018359:0:27887:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452609536 00000100:00100000:3.0:1777051381.018380:0:46498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8140 00000100:00100000:1.0:1777051381.018396:0:11727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8141 00000100:00100000:1.0:1777051381.018422:0:11727:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d9418f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:3677:x1863365452609920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051381.018433:0:46498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8142 00000100:00100000:0.0:1777051381.018455:0:27887:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452610048 00000100:00100000:3.0:1777051381.018462:0:46498:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d9418f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+6:3677:x1863365452610432:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1777051381.018467:0:27887:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452610048 00000100:00100000:2.0:1777051381.018505:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10365 00000004:00000024:3.0:1777051381.018516:0:46498:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4194304 pending 0 free 1446154240 avail 1299914752 00000100:00100000:1.0:1777051381.018528:0:11727:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d9418f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:3677:x1863365452609920:12345-0@lo:400:kworker.0 Request processed in 111us (705us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051381.018534:0:8468:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d950264a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3678:x1863365452609536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777051381.018568:0:27887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10366 00000100:00100000:1.0:1777051381.018568:0:11727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8141 00000100:00100000:0.0:1777051381.018603:0:27887:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d950267b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3678:x1863365452610048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051381.018622:0:46498:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d9418f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+6:3677:x1863365452610432:12345-0@lo:41:osp-pre-1-0.0 Request processed in 165us (611us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051381.018640:0:46498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8142 00000100:00100000:2.0:1777051381.018666:0:8468:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d950264a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3678:x1863365452609536:12345-0@lo:400:kworker.0 Request processed in 139us (633us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051381.018682:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10365 00000100:00100000:0.0:1777051381.019182:0:27887:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d950267b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3678:x1863365452610048:12345-0@lo:400:kworker.0 Request processed in 589us (989us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051381.019201:0:27887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10366 00000100:00080000:0.0:1777051381.019265:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1777051381.019345:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95aeced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3678:1863365452609536:0@lo:400:kworker.0 00000100:00100000:0.0:1777051381.019373:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95faeb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3677:1863365452610432:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1777051381.019392:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95aece680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452610048:0@lo:400:kworker.0 00000100:00100000:0.0:1777051381.019416:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95aecca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3677:1863365452609408:0@lo:400:kworker.0 00000100:00100000:0.0:1777051381.019447:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95aecd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452609920:0@lo:400:kworker.0 00000100:00100000:1.0:1777051381.530588:0:3677:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1777051381.530633:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d944d28a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452610560:0@lo:13:osp-pre-0-1.0 00000040:00080000:0.0:1777051381.530747:0:103189:0:(llog.c:801:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:0.0:1777051381.530791:0:103189:0:(llog_cat.c:158:llog_cat_process_common()) processing log [0x1:0x2b:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000100:00100000:1.0:1777051381.530812:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:0.0:1777051381.530854:0:103189:0:(llog.c:858:llog_process_thread()) stop processing plain [0x1:0x2b:0x0] index 4 count 4 00000040:00080000:0.0:1777051381.530879:0:103189:0:(llog.c:858:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00000100:00100000:1.0:1777051381.530982:0:47388:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452610560 00000100:00100000:1.0:1777051381.531006:0:47388:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452610560 00000100:00100000:1.0:1777051381.531126:0:47388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5622 00000100:00100000:1.0:1777051381.531151:0:47388:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d944d28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3677:x1863365452610560:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1777051381.531220:0:47388:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 455081536 pending 0 free 3862671360 avail 3631149056 00000100:00100000:0.0:1777051381.531311:0:103189:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d950267480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:103189:1863365452610688:192.168.201.46@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1777051381.531411:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95aece680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452610816:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1777051381.531426:0:47388:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d944d28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3677:x1863365452610560:12345-0@lo:13:osp-pre-0-1.0 Request processed in 279us (609us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051381.531455:0:47388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5622 00000100:00100000:0.0:1777051381.531552:0:103189:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d942ae6cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1777051381.531631:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d944d28a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452610560:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1777051381.534151:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051381.536584:0:8472:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452610816 00000100:00100000:1.0:1777051381.536595:0:8472:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452610816 00000100:00100000:1.0:1777051381.536675:0:8472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5623 00000100:00100000:1.0:1777051381.536692:0:8472:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95aeced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3679:x1863365452610816:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1777051381.536793:0:8472:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 445021760 pending 0 free 3645853696 avail 3414331392 00000100:00100000:1.0:1777051381.537142:0:8472:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95aeced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3679:x1863365452610816:12345-0@lo:13:osp-pre-1-1.0 Request processed in 452us (3473us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051381.537167:0:8472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5623 00000100:00100000:3.0:1777051381.537486:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95aece680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452610816:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1777051381.555748:0:103189:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d950267480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:103189:1863365452610688:192.168.201.46@tcp:107:hsm_cdtr.0 00000004:00020000:2.0:1777051381.555793:0:103189:0:(mdt_hsm_cdt_agent.c:589:mdt_hsm_agent_send()) lustre-MDT0000: cannot send request to agent 'c11b6966-0775-44d2-bdc6-c74c26eb2226': rc = -11 00010000:00010000:0.0:1777051381.846993:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1777051381.910481:0:104226:0:(llog.c:801:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1777051381.910491:0:104226:0:(llog_cat.c:158:llog_cat_process_common()) processing log [0x1:0x12:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1777051381.910517:0:104226:0:(llog.c:858:llog_process_thread()) stop processing plain [0x1:0x12:0x0] index 3 count 3 00000040:00080000:1.0:1777051381.910529:0:104226:0:(llog.c:858:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:3.0:1777051382.871088:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1777051383.065002:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5fbec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3677:1863365452611072:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1777051383.065007:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95aece680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3680:1863365452610944:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1777051383.065346:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051383.065562:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051383.065731:0:8473:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452611072 00000100:00100000:2.0:1777051383.065744:0:8473:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452611072 00000100:00100000:1.0:1777051383.066402:0:47388:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452610944 00000100:00100000:1.0:1777051383.066414:0:47388:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452610944 00000100:00080000:0.0:1777051383.066447:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1777051383.066459:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1777051383.066513:0:47388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5624 00000100:00100000:1.0:1777051383.066533:0:47388:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d950267480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3680:x1863365452610944:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1777051383.066580:0:47388:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 455081536 pending 0 free 3862671360 avail 3631149056 00000100:00100000:3.0:1777051383.066583:0:10113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5625 00000100:00100000:3.0:1777051383.066615:0:10113:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5fbed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3677:x1863365452611072:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1777051383.066656:0:10113:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 445021760 pending 0 free 3645853696 avail 3414331392 00000100:00100000:1.0:1777051383.066723:0:47388:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d950267480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3680:x1863365452610944:12345-0@lo:13:osp-pre-0-0.0 Request processed in 192us (1159us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051383.066740:0:47388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5624 00000100:00100000:2.0:1777051383.066782:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95aece680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3680:1863365452610944:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1777051383.066939:0:10113:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5fbed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3677:x1863365452611072:12345-0@lo:13:osp-pre-1-0.0 Request processed in 336us (1592us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051383.066952:0:10113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5625 00000100:00100000:2.0:1777051383.067491:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5fbec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3677:1863365452611072:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1777051383.717719:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051383.718096:0:103168:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425948288 00000100:00100000:0.0:1777051383.718113:0:103168:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425948288 00000100:00100000:0.0:1777051383.718829:0:103168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 161 00000100:00100000:0.0:1777051383.718846:0:103168:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5cdb4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:29c4352d-3260-4734-909d-9ea5de9e7fa4+12:2438:x1863365425948288:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:0.0:1777051383.718975:0:103168:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5cdb4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:29c4352d-3260-4734-909d-9ea5de9e7fa4+12:2438:x1863365425948288:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 132us (1274us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051383.718985:0:103168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 161 00000100:00100000:3.0:1777051383.719519:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051383.719568:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051383.719609:0:46494:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425948544 00000100:00100000:2.0:1777051383.719619:0:46494:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425948544 00000100:00100000:3.0:1777051383.719626:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00080000:3.0:1777051383.719714:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1777051383.719723:0:46494:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425948416 00000100:00100000:2.0:1777051383.719730:0:46494:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425948416 00000100:00100000:3.0:1777051383.719764:0:46497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13307 00000100:00100000:3.0:1777051383.719784:0:46497:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95aece300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:c11b6966-0775-44d2-bdc6-c74c26eb2226+8:2438:x1863365425948544:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:0.0:1777051383.719800:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13308 00000100:00100000:1.0:1777051383.719809:0:13320:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425948800 00000100:00100000:0.0:1777051383.719818:0:6579:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95aece680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+19:2439:x1863365425948416:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:1.0:1777051383.719819:0:13320:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425948800 00000100:00080000:2.0:1777051383.719831:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1777051383.719840:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1777051383.719892:0:6579:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95aece680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+19:2439:x1863365425948416:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 77us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051383.719896:0:13320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10367 00000100:00100000:3.0:1777051383.719896:0:46497:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95aece300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:c11b6966-0775-44d2-bdc6-c74c26eb2226+8:2438:x1863365425948544:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 117us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051383.719912:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051383.719918:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13308 00000100:00100000:3.0:1777051383.719932:0:46497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13307 00000100:00100000:1.0:1777051383.719938:0:13320:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95aecd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+48:2438:x1863365425948800:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:0.0:1777051383.719964:0:55805:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425948672 00000100:00100000:0.0:1777051383.719971:0:55805:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425948672 00000100:00100000:1.0:1777051383.719993:0:13320:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95aecd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+48:2438:x1863365425948800:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 82us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051383.720005:0:13320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10367 00000100:00100000:1.0:1777051383.720039:0:13320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10368 00000100:00100000:2.0:1777051383.720395:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051383.720410:0:13320:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5fbec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+50:2439:x1863365425948672:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:1.0:1777051383.720455:0:13320:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5fbec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+50:2439:x1863365425948672:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 406us (552us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051383.720461:0:27885:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425949056 00000100:00100000:1.0:1777051383.720466:0:13320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10368 00000100:00100000:2.0:1777051383.720469:0:27885:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425949056 00000100:00080000:1.0:1777051383.720512:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1777051383.720519:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1777051383.720528:0:27885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13309 00000100:00100000:2.0:1777051383.720540:0:27885:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5fbec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+48:2438:x1863365425949056:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:2.0:1777051383.720589:0:27885:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5fbec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+48:2438:x1863365425949056:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 52us (536us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051383.720605:0:27885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13309 00000100:00100000:1.0:1777051383.720646:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051383.720712:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051383.720742:0:21368:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425948928 00000100:00100000:0.0:1777051383.720750:0:21368:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425948928 00000100:00100000:1.0:1777051383.720774:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051383.720796:0:8471:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425949312 00000100:00100000:2.0:1777051383.720804:0:8471:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425949312 00000100:00100000:1.0:1777051383.720817:0:27887:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425949184 00000100:00100000:1.0:1777051383.720824:0:27887:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425949184 00000100:00100000:0.0:1777051383.720831:0:21368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13310 00000100:00100000:0.0:1777051383.720845:0:21368:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d944d28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+32:2439:x1863365425948928:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:2.0:1777051383.720861:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10369 00000100:00100000:2.0:1777051383.720875:0:8471:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d944d2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+47:2438:x1863365425949312:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:1.0:1777051383.720881:0:27887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10370 00000100:00100000:1.0:1777051383.720906:0:27887:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d944d2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+52:2439:x1863365425949184:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:0.0:1777051383.720916:0:21368:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d944d28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+32:2439:x1863365425948928:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 69us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051383.720928:0:21368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13310 00000100:00100000:2.0:1777051383.720939:0:8471:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d944d2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+47:2438:x1863365425949312:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 66us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051383.720950:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10369 00000100:00100000:1.0:1777051383.720963:0:27887:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d944d2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+52:2439:x1863365425949184:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 67us (187us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051383.720974:0:27887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10370 00000100:00080000:3.0:1777051383.722454:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1777051383.722458:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1777051383.722461:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1777051383.894593:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777051384.918437:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1777051385.623255:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95aecca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452611200:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1777051385.623341:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051385.624990:0:11727:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452611200 00000100:00100000:3.0:1777051385.625008:0:11727:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452611200 00000100:00100000:3.0:1777051385.625122:0:11727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8143 00000100:00100000:3.0:1777051385.625491:0:11727:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5fbec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:3678:x1863365452611200:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1777051385.625553:0:11727:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4194304 pending 0 free 1441579008 avail 1295339520 00000100:00100000:3.0:1777051385.625957:0:11727:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5fbec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:3678:x1863365452611200:12345-0@lo:41:osp-pre-0-1.0 Request processed in 475us (2613us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051385.625974:0:11727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8143 00000100:00100000:2.0:1777051385.626465:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95aecca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452611200:0@lo:41:osp-pre-0-1.0 00000001:00080000:2.0:1777051385.627458:0:8464:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0000: transno 4294968354 is committed 00000001:00080000:0.0:1777051385.628030:0:103159:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771128 is committed 00000001:00080000:0.0:1777051385.628049:0:103159:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771124 is committed 00000001:00080000:0.0:1777051385.628056:0:103159:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771123 is committed 00010000:00010000:1.0:1777051385.629156:0:3664:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48a800/0x85f51a6b96715e02 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2c29638e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051385.629176:0:3664:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48a800/0x85f51a6b96715e02 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2c29638e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051385.629229:0:3664:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48a800/0x85f51a6b96715e02 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2c29638e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051385.629239:0:3664:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94e48a800 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:1.0:1777051385.629245:0:3664:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48a800/0x85f51a6b96715e02 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2c29638e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051385.629257:0:3664:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48a800/0x85f51a6b96715e02 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2c29638e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051385.629277:0:3664:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2c29638e (ffff99d94e5e2d00) 00010000:00010000:1.0:1777051385.629282:0:3664:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777051385.629287:0:3664:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48a800/0x85f51a6b96715e02 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x2c29638e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051385.629303:0:3664:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48a800/0x85f51a6b96715e02 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x2c29638e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051385.629328:0:3664:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48bc00/0x85f51a6b96715e09 lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e2:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051385.629337:0:3664:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48bc00/0x85f51a6b96715e09 lrc: 2/0,0 mode: TXN/TXN res: [0x2000032e2:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051385.629346:0:3664:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48bc00/0x85f51a6b96715e09 lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e2:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051385.629352:0:3664:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94e48bc00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:1.0:1777051385.629356:0:3664:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48bc00/0x85f51a6b96715e09 lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e2:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051385.629364:0:3664:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48bc00/0x85f51a6b96715e09 lrc: 4/0,0 mode: TXN/TXN res: [0x2000032e2:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051385.629372:0:3664:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0x1:0x0].0x0 (ffff99d94e5e2200) 00010000:00010000:1.0:1777051385.629376:0:3664:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777051385.629379:0:3664:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48bc00/0x85f51a6b96715e09 lrc: 2/0,0 mode: --/TXN res: [0x2000032e2:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051385.629387:0:3664:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48bc00/0x85f51a6b96715e09 lrc: 0/0,0 mode: --/TXN res: [0x2000032e2:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051385.629402:0:3664:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950262e00/0x85f51a6b96715e48 lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e2:0x1:0x0].0x86fa115b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051385.629411:0:3664:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d950262e00/0x85f51a6b96715e48 lrc: 2/0,0 mode: TXN/TXN res: [0x2000032e2:0x1:0x0].0x86fa115b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051385.629420:0:3664:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d950262e00/0x85f51a6b96715e48 lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e2:0x1:0x0].0x86fa115b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051385.629428:0:3664:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d950262e00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:1.0:1777051385.629431:0:3664:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d950262e00/0x85f51a6b96715e48 lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e2:0x1:0x0].0x86fa115b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051385.629439:0:3664:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d950262e00/0x85f51a6b96715e48 lrc: 4/0,0 mode: TXN/TXN res: [0x2000032e2:0x1:0x0].0x86fa115b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051385.629447:0:3664:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0x1:0x0].0x86fa115b (ffff99d9413d0e00) 00010000:00010000:1.0:1777051385.629450:0:3664:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777051385.629454:0:3664:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d950262e00/0x85f51a6b96715e48 lrc: 2/0,0 mode: --/TXN res: [0x2000032e2:0x1:0x0].0x86fa115b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051385.629461:0:3664:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d950262e00/0x85f51a6b96715e48 lrc: 0/0,0 mode: --/TXN res: [0x2000032e2:0x1:0x0].0x86fa115b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051385.629479:0:3664:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2bc00/0x85f51a6b96715e5d lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051385.629488:0:3664:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2bc00/0x85f51a6b96715e5d lrc: 2/0,0 mode: TXN/TXN res: [0x2000032e2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051385.629496:0:3664:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2bc00/0x85f51a6b96715e5d lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051385.629502:0:3664:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94eb2bc00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:1.0:1777051385.629505:0:3664:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2bc00/0x85f51a6b96715e5d lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051385.629520:0:3664:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2bc00/0x85f51a6b96715e5d lrc: 4/0,0 mode: TXN/TXN res: [0x2000032e2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051385.629530:0:3664:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0x2:0x0].0x0 (ffff99d94e81cf00) 00010000:00010000:1.0:1777051385.629533:0:3664:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777051385.629537:0:3664:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2bc00/0x85f51a6b96715e5d lrc: 2/0,0 mode: --/TXN res: [0x2000032e2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051385.629544:0:3664:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2bc00/0x85f51a6b96715e5d lrc: 0/0,0 mode: --/TXN res: [0x2000032e2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051385.942721:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1777051386.134738:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5fbeed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3679:1863365452611328:0@lo:400:kworker.0 00000100:00100000:3.0:1777051386.134754:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95aecea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3677:1863365452611584:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1777051386.134820:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5fbef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3678:1863365452611712:0@lo:400:kworker.0 00000100:00100000:1.0:1777051386.134845:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051386.134920:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051386.134931:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5fbed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3680:1863365452611456:0@lo:400:kworker.0 00000100:00100000:1.0:1777051386.134960:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5fbeca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3679:1863365452611840:0@lo:400:kworker.0 00000100:00100000:0.0:1777051386.134969:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5fbef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3678:1863365452612224:0@lo:400:kworker.0 00000100:00100000:3.0:1777051386.134982:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051386.135327:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5fbefb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3677:1863365452612096:0@lo:400:kworker.0 00000100:00100000:0.0:1777051386.135329:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051386.135343:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051386.135366:0:103166:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452611328 00000100:00100000:0.0:1777051386.135374:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94f169500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452612736:0@lo:400:kworker.0 00000100:00100000:1.0:1777051386.135379:0:103166:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452611328 00000100:00100000:2.0:1777051386.135403:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5fbef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3680:1863365452611968:0@lo:400:kworker.0 00000100:00100000:3.0:1777051386.135417:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051386.135423:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051386.135466:0:103166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1777051386.135480:0:103166:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7c978050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9351a01-5b0e-4470-97fd-58b9b4b312a2+23:3679:x1863365452611328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051386.136353:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7c9a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452612608:0@lo:400:kworker.0 00000100:00100000:2.0:1777051386.136401:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051386.136405:0:27882:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452611712 00000100:00100000:0.0:1777051386.136415:0:27882:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452611712 00000100:00100000:1.0:1777051386.136417:0:103166:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7c978050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9351a01-5b0e-4470-97fd-58b9b4b312a2+23:3679:x1863365452611328:12345-0@lo:400:kworker.0 Request processed in 936us (1573us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051386.136432:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051386.136439:0:103166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1777051386.136448:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d951fa1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3680:1863365452612480:0@lo:400:kworker.0 00000100:00100000:0.0:1777051386.136488:0:27882:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452611456 00000100:00100000:0.0:1777051386.136495:0:27882:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452611456 00000100:00100000:2.0:1777051386.136506:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051386.136536:0:6584:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452611584 00000100:00100000:1.0:1777051386.136541:0:24468:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452612224 00000100:00100000:3.0:1777051386.136544:0:6584:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452611584 00000100:00100000:0.0:1777051386.136551:0:27882:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452611968 00000100:00100000:1.0:1777051386.136551:0:24468:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452612224 00000100:00100000:0.0:1777051386.136560:0:27882:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452611968 00000100:00100000:2.0:1777051386.136568:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94f168e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3680:1863365452612992:0@lo:400:kworker.0 00000100:00100000:3.0:1777051386.136594:0:6584:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452612096 00000100:00100000:3.0:1777051386.136601:0:6584:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452612096 00000100:00100000:2.0:1777051386.136618:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051386.136654:0:24468:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452612736 00000100:00100000:1.0:1777051386.136662:0:24468:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452612736 00000100:00100000:0.0:1777051386.136663:0:27882:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452612480 00000100:00100000:3.0:1777051386.136664:0:6584:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452612608 00000100:00100000:0.0:1777051386.136671:0:27882:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452612480 00000100:00100000:3.0:1777051386.136671:0:6584:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452612608 00000100:00100000:2.0:1777051386.136724:0:46494:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452612992 00000100:00100000:1.0:1777051386.136732:0:24468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10371 00000100:00100000:0.0:1777051386.136733:0:27882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13311 00000100:00100000:3.0:1777051386.136733:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8144 00000100:00100000:2.0:1777051386.136735:0:46494:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452612992 00000100:00100000:0.0:1777051386.136759:0:27882:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95faeb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0000_UUID+5:3678:x1863365452611712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777051386.136766:0:24468:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f42c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3678:x1863365452612224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051386.136766:0:6584:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95aecdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:3677:x1863365452611584:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1777051386.136798:0:46494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13312 00000004:00000024:3.0:1777051386.136809:0:6584:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4194304 pending 0 free 1446154240 avail 1299914752 00000100:00100000:2.0:1777051386.136818:0:46494:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f168000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000-lwp-OST0000_UUID+5:3680:x1863365452611456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777051386.136842:0:27882:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95faeb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0000_UUID+5:3678:x1863365452611712:12345-0@lo:400:kworker.0 Request processed in 89us (1922us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051386.136854:0:27882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13311 00000100:00100000:1.0:1777051386.136862:0:24468:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f42c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3678:x1863365452612224:12345-0@lo:400:kworker.0 Request processed in 109us (1529us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051386.136876:0:24468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10371 00000100:00100000:0.0:1777051386.136887:0:27882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13313 00000100:00100000:3.0:1777051386.136897:0:6584:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95aecdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:3677:x1863365452611584:12345-0@lo:41:osp-pre-1-0.0 Request processed in 147us (1914us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051386.136904:0:27882:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f16a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0001_UUID+5:3680:x1863365452611968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777051386.136913:0:46494:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f168000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000-lwp-OST0000_UUID+5:3680:x1863365452611456:12345-0@lo:400:kworker.0 Request processed in 99us (1568us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051386.136915:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8144 00000100:00100000:1.0:1777051386.136918:0:24468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10372 00000100:00100000:2.0:1777051386.136937:0:46494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13312 00000100:00100000:1.0:1777051386.136943:0:24468:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f42c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3678:x1863365452612736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051386.136955:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8145 00000100:00100000:3.0:1777051386.136970:0:6584:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95aecce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3677:x1863365452612096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777051386.136975:0:27882:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f16a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0001_UUID+5:3680:x1863365452611968:12345-0@lo:400:kworker.0 Request processed in 76us (580us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051386.136984:0:46494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13314 00000100:00100000:0.0:1777051386.136997:0:27882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13313 00000100:00100000:2.0:1777051386.137006:0:46494:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f16b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000-lwp-MDT0000_UUID+5:3680:x1863365452612480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777051386.137027:0:24468:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f42c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3678:x1863365452612736:12345-0@lo:400:kworker.0 Request processed in 89us (1598us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051386.137033:0:27882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13315 00000100:00100000:3.0:1777051386.137040:0:6584:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95aecce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3677:x1863365452612096:12345-0@lo:400:kworker.0 Request processed in 72us (1649us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051386.137051:0:24468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10372 00000100:00100000:0.0:1777051386.137053:0:27882:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f169180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0001_UUID+5:3680:x1863365452612992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051386.137058:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8145 00000100:00100000:2.0:1777051386.137081:0:46494:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f16b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000-lwp-MDT0000_UUID+5:3680:x1863365452612480:12345-0@lo:400:kworker.0 Request processed in 81us (576us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051386.137091:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8146 00000100:00100000:2.0:1777051386.137103:0:46494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13314 00000100:00100000:3.0:1777051386.137109:0:6584:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95aecf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3677:x1863365452612608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777051386.137113:0:27882:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f169180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0001_UUID+5:3680:x1863365452612992:12345-0@lo:400:kworker.0 Request processed in 65us (497us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051386.137126:0:27882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13315 00000100:00100000:3.0:1777051386.137159:0:6584:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95aecf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3677:x1863365452612608:12345-0@lo:400:kworker.0 Request processed in 55us (729us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051386.137171:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8146 00000100:00100000:0.0:1777051386.137260:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94f169500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452612736:0@lo:400:kworker.0 00000100:00100000:0.0:1777051386.137279:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5fbef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3678:1863365452611712:0@lo:400:kworker.0 00000100:00100000:3.0:1777051386.137285:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5fbefb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3677:1863365452612096:0@lo:400:kworker.0 00000100:00100000:3.0:1777051386.137305:0:3677:0:(client.c:3101:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 30064771123 gen 2 00000100:00100000:0.0:1777051386.137306:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5fbef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3678:1863365452612224:0@lo:400:kworker.0 00000004:00080000:3.0:1777051386.137312:0:3677:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 30064771123 committed transno 30064771123 00000100:00100000:2.0:1777051386.137321:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1777051386.137329:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1777051386.137338:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1777051386.137339:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7c9a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452612608:0@lo:400:kworker.0 00000100:00080000:1.0:1777051386.137347:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1777051386.137373:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5fbeea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452612352:0@lo:400:kworker.0 00000100:00100000:3.0:1777051386.137380:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95aecea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3677:1863365452611584:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1777051386.137427:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051386.137453:0:46494:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452611840 00000100:00100000:3.0:1777051386.137461:0:46494:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452611840 00000100:00100000:1.0:1777051386.137475:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5fbed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3680:1863365452611456:0@lo:400:kworker.0 00000100:00100000:2.0:1777051386.137484:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94f16a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452612864:0@lo:400:kworker.0 00000100:00100000:1.0:1777051386.137506:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5fbef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3680:1863365452611968:0@lo:400:kworker.0 00000100:00100000:0.0:1777051386.137508:0:27884:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452612352 00000100:00100000:0.0:1777051386.137517:0:27884:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452612352 00000100:00100000:3.0:1777051386.137526:0:46494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13316 00000100:00100000:2.0:1777051386.137535:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051386.137538:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d951fa1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3680:1863365452612480:0@lo:400:kworker.0 00000100:00100000:3.0:1777051386.137544:0:46494:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f169c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000-lwp-OST0001_UUID+5:3679:x1863365452611840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777051386.137571:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94f168e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3680:1863365452612992:0@lo:400:kworker.0 00000100:00100000:0.0:1777051386.137580:0:27884:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452612864 00000100:00100000:0.0:1777051386.137586:0:27884:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452612864 00000100:00100000:2.0:1777051386.137601:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5fbeed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3679:1863365452611328:0@lo:400:kworker.0 00000100:00100000:3.0:1777051386.137657:0:46494:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f169c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000-lwp-OST0001_UUID+5:3679:x1863365452611840:12345-0@lo:400:kworker.0 Request processed in 89us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051386.137669:0:46494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13316 00000100:00100000:2.0:1777051386.137676:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5fbeca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3679:1863365452611840:0@lo:400:kworker.0 00000100:00080000:3.0:1777051386.137701:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1777051386.137708:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1777051386.138024:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10373 00000100:00100000:2.0:1777051386.138041:0:8471:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f16bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3679:x1863365452612352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051386.138064:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10374 00000100:00100000:3.0:1777051386.138081:0:8468:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f168700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3679:x1863365452612864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777051386.138126:0:8471:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f16bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3679:x1863365452612352:12345-0@lo:400:kworker.0 Request processed in 86us (698us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051386.138140:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10373 00000100:00100000:1.0:1777051386.138154:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5fbeea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452612352:0@lo:400:kworker.0 00000100:00100000:3.0:1777051386.138157:0:8468:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f168700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3679:x1863365452612864:12345-0@lo:400:kworker.0 Request processed in 80us (623us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051386.138173:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10374 00000100:00100000:1.0:1777051386.138186:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94f16a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452612864:0@lo:400:kworker.0 00000100:00100000:0.0:1777051386.646487:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d944d28e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452613248:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1777051386.646505:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95aecea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452613120:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1777051386.646591:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051386.646698:0:8473:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452613248 00000100:00100000:2.0:1777051386.646728:0:8473:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452613248 00000100:00100000:3.0:1777051386.646747:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051386.646815:0:8473:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452613120 00000100:00100000:2.0:1777051386.646823:0:8473:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452613120 00000100:00100000:0.0:1777051386.646848:0:8472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5626 00000100:00100000:0.0:1777051386.646871:0:8472:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f42fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3678:x1863365452613248:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1777051386.646891:0:8473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5627 00000100:00100000:2.0:1777051386.646911:0:8473:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95aecc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3677:x1863365452613120:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1777051386.646919:0:8472:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 455081536 pending 0 free 3862671360 avail 3631149056 00002000:00000024:2.0:1777051386.646948:0:8473:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 445021760 pending 0 free 3645853696 avail 3414331392 00000100:00100000:0.0:1777051386.647027:0:8472:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f42fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3678:x1863365452613248:12345-0@lo:13:osp-pre-0-1.0 Request processed in 162us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051386.647042:0:8472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5626 00000100:00100000:2.0:1777051386.647078:0:8473:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95aecc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3677:x1863365452613120:12345-0@lo:13:osp-pre-1-1.0 Request processed in 170us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051386.647421:0:8473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5627 00000100:00100000:3.0:1777051386.647467:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95aecea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452613120:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1777051386.647672:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d944d28e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452613248:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1777051386.966839:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1777051387.734712:0:103189:0:(llog.c:801:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:3.0:1777051387.734725:0:103189:0:(llog_cat.c:158:llog_cat_process_common()) processing log [0x1:0x2b:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1777051387.734766:0:103189:0:(llog.c:858:llog_process_thread()) stop processing plain [0x1:0x2b:0x0] index 4 count 4 00000040:00080000:3.0:1777051387.734782:0:103189:0:(llog.c:858:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00000100:00100000:3.0:1777051387.735019:0:103189:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95aecea00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:103189:1863365452613376:192.168.201.46@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1777051387.735183:0:103189:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d95744bd80 going to sleep for 11 seconds 00000100:00100000:3.0:1777051387.746932:0:103189:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95aecea00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:103189:1863365452613376:192.168.201.46@tcp:107:hsm_cdtr.0 00000004:00020000:3.0:1777051387.746968:0:103189:0:(mdt_hsm_cdt_agent.c:589:mdt_hsm_agent_send()) lustre-MDT0000: cannot send request to agent 'c11b6966-0775-44d2-bdc6-c74c26eb2226': rc = -11 00010000:00010000:2.0:1777051387.990710:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1777051388.182586:0:3680:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1777051388.182659:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95aecea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3680:1863365452613632:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1777051388.182780:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051388.182845:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94f16ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3680:1863365452613504:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1777051388.182880:0:47388:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452613632 00000100:00100000:2.0:1777051388.182891:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051388.182898:0:47388:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452613632 00000100:00100000:3.0:1777051388.182999:0:10113:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452613504 00000100:00100000:3.0:1777051388.183010:0:10113:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452613504 00000100:00080000:0.0:1777051388.183042:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1777051388.183051:0:47388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5628 00000100:00080000:0.0:1777051388.183054:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1777051388.183179:0:47388:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f168a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3680:x1863365452613632:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1777051388.183550:0:10113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5629 00000100:00100000:3.0:1777051388.183570:0:10113:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f168380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3680:x1863365452613504:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1777051388.183635:0:10113:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 445021760 pending 0 free 3645853696 avail 3414331392 00002000:00000024:1.0:1777051388.183636:0:47388:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 455081536 pending 0 free 3862671360 avail 3631149056 00000100:00100000:3.0:1777051388.183735:0:10113:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f168380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3680:x1863365452613504:12345-0@lo:13:osp-pre-1-0.0 Request processed in 171us (844us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051388.184253:0:47388:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f168a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3680:x1863365452613632:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1081us (1472us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051388.186430:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95aecea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3680:1863365452613632:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1777051388.186453:0:10113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5629 00000100:00100000:2.0:1777051388.186460:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94f16ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3680:1863365452613504:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1777051388.186584:0:47388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5628 00000100:00100000:0.0:1777051388.834506:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051388.835402:0:103169:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425949440 00000100:00100000:3.0:1777051388.835420:0:103169:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425949440 00000100:00100000:3.0:1777051388.836562:0:103169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 163 00000100:00100000:0.0:1777051388.836571:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051388.836616:0:103169:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7c978c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:29c4352d-3260-4734-909d-9ea5de9e7fa4+12:2439:x1863365425949440:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:2.0:1777051388.836723:0:27882:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425949696 00000100:00100000:2.0:1777051388.836731:0:27882:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425949696 00000100:00100000:2.0:1777051388.836813:0:27882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13317 00000100:00080000:0.0:1777051388.836820:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1777051388.836826:0:27882:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f42f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+8:2439:x1863365425949696:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:3.0:1777051388.837620:0:103169:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7c978c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:29c4352d-3260-4734-909d-9ea5de9e7fa4+12:2439:x1863365425949440:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 994us (3085us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051388.837645:0:103169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 163 00000100:00100000:2.0:1777051388.838338:0:27882:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f42f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+8:2439:x1863365425949696:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 1510us (1769us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051388.838348:0:27882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13317 00000100:00100000:0.0:1777051388.838910:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051388.838948:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051388.838972:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051388.839001:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051388.839042:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051388.839060:0:27885:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425950208 00000100:00100000:2.0:1777051388.839071:0:27885:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425950208 00000100:00100000:0.0:1777051388.839396:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051388.839466:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051388.839472:0:27885:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425949568 00000100:00100000:2.0:1777051388.839481:0:27885:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425949568 00000100:00100000:0.0:1777051388.839512:0:21368:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425950080 00000100:00100000:0.0:1777051388.839521:0:21368:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425950080 00000100:00100000:2.0:1777051388.839538:0:27885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13318 00000100:00100000:2.0:1777051388.839558:0:27885:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f42ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+48:2439:x1863365425950208:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:0.0:1777051388.839616:0:21368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13319 00000100:00100000:0.0:1777051388.839636:0:21368:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f42d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+18:2439:x1863365425949568:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:3.0:1777051388.839675:0:8628:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425949952 00000100:00100000:2.0:1777051388.839683:0:27885:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f42ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+48:2439:x1863365425950208:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 125us (725us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051388.839692:0:8628:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425949952 00000100:00100000:2.0:1777051388.839703:0:27885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13318 00000100:00100000:0.0:1777051388.839707:0:21368:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f42d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+18:2439:x1863365425949568:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 74us (700us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051388.839726:0:21368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13319 00000100:00100000:2.0:1777051388.839763:0:27885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13320 00000100:00100000:1.0:1777051388.839768:0:24468:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425950464 00000100:00100000:1.0:1777051388.839781:0:24468:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425950464 00000100:00100000:2.0:1777051388.839783:0:27885:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f42dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+25:2439:x1863365425950080:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:0.0:1777051388.839841:0:55805:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425949824 00000100:00100000:3.0:1777051388.839850:0:8628:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425950336 00000100:00100000:0.0:1777051388.839852:0:55805:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425949824 00000100:00100000:2.0:1777051388.839858:0:27885:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f42dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+25:2439:x1863365425950080:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 75us (771us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051388.839869:0:8628:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425950336 00000100:00100000:2.0:1777051388.839879:0:27885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13320 00000100:00100000:1.0:1777051388.839906:0:24468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10375 00000100:00100000:1.0:1777051388.839932:0:24468:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f42e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+48:2439:x1863365425949952:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:0.0:1777051388.839942:0:55805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10376 00000100:00100000:0.0:1777051388.839964:0:55805:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f42d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+47:2439:x1863365425950464:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:2.0:1777051388.839972:0:8470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10377 00000100:00100000:3.0:1777051388.839996:0:8628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10378 00000100:00100000:2.0:1777051388.840004:0:8470:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f42df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+50:2439:x1863365425949824:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:1.0:1777051388.840012:0:24468:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f42e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+48:2439:x1863365425949952:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 86us (1100us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051388.840052:0:24468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10375 00000100:00100000:3.0:1777051388.840055:0:8628:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f42d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+51:2439:x1863365425950336:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:0.0:1777051388.840056:0:55805:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f42d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+47:2439:x1863365425950464:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 76us (1059us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051388.840089:0:8470:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f42df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+50:2439:x1863365425949824:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 85us (1031us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051388.840104:0:55805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10376 00000100:00100000:2.0:1777051388.840122:0:8470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10377 00000100:00080000:1.0:1777051388.840152:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1777051388.840160:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1777051388.840541:0:8628:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f42d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+51:2439:x1863365425950336:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 516us (1067us total) trans 0 rc 0/0 00000100:00080000:1.0:1777051388.840542:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1777051388.840552:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1777051388.840575:0:8628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10378 00010000:00010000:0.0:1777051389.015501:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777051390.039787:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1777051390.370741:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051390.370889:0:6584:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425950592 00000100:00100000:3.0:1777051390.370907:0:6584:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425950592 00000100:00080000:1.0:1777051390.371026:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1777051390.371035:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 8147 00000100:00100000:3.0:1777051390.371057:0:6584:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d944d28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+25:2436:x1863365425950592:12345-192.168.201.46@tcp:63:ll_sa.0 00010000:00010000:3.0:1777051390.371122:0:6584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777051390.371160:0:6584:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7a00/0x85f51a6b96715e9c lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b62b4 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051390.371311:0:6584:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7400/0x85f51a6b96715ea3 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051390.371337:0:6584:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7400/0x85f51a6b96715ea3 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051390.371359:0:6584:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7400/0x85f51a6b96715ea3 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051390.371384:0:6584:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6800/0x85f51a6b96715eaa lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xd3:0x0].0xe55c6528 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051390.371397:0:6584:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6800/0x85f51a6b96715eaa lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xd3:0x0].0xe55c6528 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051390.371407:0:6584:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6800/0x85f51a6b96715eaa lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xd3:0x0].0xe55c6528 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051390.371477:0:6584:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7400/0x85f51a6b96715ea3 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051390.371489:0:6584:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7400/0x85f51a6b96715ea3 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051390.371499:0:6584:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7400/0x85f51a6b96715ea3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051390.371509:0:6584:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d941ad7400 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:3.0:1777051390.371516:0:6584:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7400/0x85f51a6b96715ea3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051390.371535:0:6584:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7400/0x85f51a6b96715ea3 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051390.371589:0:6584:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xd3:0x0].0x0 (ffff99d94e6b6b00) 00010000:00010000:3.0:1777051390.371595:0:6584:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777051390.371604:0:6584:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7400/0x85f51a6b96715ea3 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051390.371614:0:6584:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7400/0x85f51a6b96715ea3 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051390.371637:0:6584:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6800/0x85f51a6b96715eaa lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xd3:0x0].0xe55c6528 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051390.371647:0:6584:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6800/0x85f51a6b96715eaa lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0xd3:0x0].0xe55c6528 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051390.371655:0:6584:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6800/0x85f51a6b96715eaa lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xd3:0x0].0xe55c6528 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051390.371662:0:6584:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d941ad6800 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:3.0:1777051390.371667:0:6584:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6800/0x85f51a6b96715eaa lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xd3:0x0].0xe55c6528 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051390.371675:0:6584:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6800/0x85f51a6b96715eaa lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0xd3:0x0].0xe55c6528 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051390.371703:0:6584:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xd3:0x0].0xe55c6528 (ffff99d9533abf00) 00010000:00010000:3.0:1777051390.371707:0:6584:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777051390.371711:0:6584:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6800/0x85f51a6b96715eaa lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0xd3:0x0].0xe55c6528 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051390.371726:0:6584:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6800/0x85f51a6b96715eaa lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xd3:0x0].0xe55c6528 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051390.371773:0:6584:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7a00/0x85f51a6b96715e9c lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b62b4 expref: 26 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051390.371789:0:6584:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xd3:0x0].0x0 (ffff99d94e6b6b00) 00010000:00010000:3.0:1777051390.371792:0:6584:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1777051390.371798:0:6584:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7a00/0x85f51a6b96715e9c lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b62b4 expref: 26 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051390.371812:0:6584:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d941ad7a00, rc -2) 00000100:00100000:3.0:1777051390.371916:0:6584:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d944d28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+25:2436:x1863365425950592:12345-192.168.201.46@tcp:63:ll_sa.0 Request processed in 865us (1191us total) trans 0 rc -2/-2 00000100:00100000:3.0:1777051390.371929:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 8147 00000100:00100000:3.0:1777051390.742646:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95aecf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3680:1863365452613760:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1777051390.742755:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051390.743629:0:11727:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452613760 00000100:00100000:0.0:1777051390.743644:0:11727:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452613760 00000100:00100000:0.0:1777051390.743732:0:11727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8148 00000100:00100000:0.0:1777051390.743747:0:11727:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95aecc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3680:x1863365452613760:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1777051390.743805:0:11727:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4194304 pending 0 free 1441579008 avail 1295339520 00000100:00100000:0.0:1777051390.743896:0:11727:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95aecc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3680:x1863365452613760:12345-0@lo:41:osp-pre-0-1.0 Request processed in 151us (1140us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051390.743909:0:11727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8148 00000100:00100000:3.0:1777051390.743982:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95aecf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3680:1863365452613760:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1777051391.063488:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1777051391.126747:0:104226:0:(llog.c:801:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1777051391.126761:0:104226:0:(llog_cat.c:158:llog_cat_process_common()) processing log [0x1:0x12:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1777051391.126796:0:104226:0:(llog.c:858:llog_process_thread()) stop processing plain [0x1:0x12:0x0] index 3 count 3 00000040:00080000:2.0:1777051391.126810:0:104226:0:(llog.c:858:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1777051391.254866:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95aecf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3677:1863365452613888:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1777051391.254999:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051391.255002:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94f16ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3678:1863365452614016:0@lo:400:kworker.0 00000100:00100000:1.0:1777051391.255092:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051391.255129:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94f168e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3677:1863365452614400:0@lo:400:kworker.0 00000100:00100000:1.0:1777051391.255185:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94f169500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3678:1863365452614528:0@lo:400:kworker.0 00000100:00100000:0.0:1777051391.255242:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051391.255284:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95f97c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3677:1863365452614912:0@lo:400:kworker.0 00000100:00100000:1.0:1777051391.255285:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051391.255285:0:103168:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452614016 00000100:00100000:2.0:1777051391.255300:0:103168:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452614016 00000100:00100000:1.0:1777051391.255333:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95f97f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452615040:0@lo:400:kworker.0 00000100:00100000:0.0:1777051391.255348:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051391.255392:0:103168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1777051391.255401:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95f97ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3677:1863365452615424:0@lo:400:kworker.0 00000100:00100000:1.0:1777051391.255415:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051391.255417:0:103168:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7c979450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f9351a01-5b0e-4470-97fd-58b9b4b312a2+23:3678:x1863365452614016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777051391.255470:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051391.255485:0:6585:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452613888 00000100:00100000:1.0:1777051391.255494:0:6585:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452613888 00000100:00100000:2.0:1777051391.255526:0:103168:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7c979450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f9351a01-5b0e-4470-97fd-58b9b4b312a2+23:3678:x1863365452614016:12345-0@lo:400:kworker.0 Request processed in 120us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051391.255540:0:103168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1777051391.255576:0:6579:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452614400 00000100:00100000:1.0:1777051391.255580:0:6585:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452615040 00000100:00100000:0.0:1777051391.255585:0:6579:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452614400 00000100:00100000:1.0:1777051391.255589:0:6585:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452615040 00000100:00100000:2.0:1777051391.255637:0:27882:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452614528 00000100:00100000:1.0:1777051391.255645:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8149 00000100:00100000:2.0:1777051391.255646:0:27882:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452614528 00000100:00100000:0.0:1777051391.255672:0:6579:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452614912 00000100:00100000:0.0:1777051391.255679:0:6579:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452614912 00000100:00100000:0.0:1777051391.255712:0:6579:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452615424 00000100:00100000:0.0:1777051391.255716:0:6579:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452615424 00000100:00100000:3.0:1777051391.255748:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94f169880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3679:1863365452614144:0@lo:400:kworker.0 00000100:00100000:0.0:1777051391.255760:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13321 00000100:00100000:0.0:1777051391.255775:0:6579:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f42ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3677:x1863365452614400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051391.255810:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051391.255897:0:27882:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452614144 00000100:00100000:2.0:1777051391.255903:0:27882:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452614144 00000100:00100000:2.0:1777051391.255941:0:27882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13322 00000100:00100000:2.0:1777051391.255951:0:27882:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f42ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0000_UUID+5:3677:x1863365452614912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777051391.256341:0:6579:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f42ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3677:x1863365452614400:12345-0@lo:400:kworker.0 Request processed in 568us (1148us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051391.256341:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95f97fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452614656:0@lo:400:kworker.0 00000100:00100000:0.0:1777051391.256362:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13321 00000100:00100000:1.0:1777051391.256378:0:6585:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f42e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3677:x1863365452613888:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1777051391.256393:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13323 00000100:00100000:3.0:1777051391.256400:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051391.256409:0:6579:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5fbeea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3677:x1863365452615424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051391.256443:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95f97f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452615168:0@lo:400:kworker.0 00000004:00000024:1.0:1777051391.256476:0:6585:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4194304 pending 0 free 1446154240 avail 1299914752 00000100:00100000:0.0:1777051391.256483:0:6579:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5fbeea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3677:x1863365452615424:12345-0@lo:400:kworker.0 Request processed in 77us (1012us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051391.256497:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051391.256504:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13323 00000100:00100000:0.0:1777051391.256532:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13324 00000100:00100000:0.0:1777051391.256573:0:6579:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d944d2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3678:x1863365452614528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777051391.256589:0:6585:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f42e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3677:x1863365452613888:12345-0@lo:41:osp-pre-1-0.0 Request processed in 926us (1590us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051391.256602:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8149 00000100:00100000:1.0:1777051391.256638:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8150 00000100:00100000:2.0:1777051391.256653:0:27882:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f42ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0000_UUID+5:3677:x1863365452614912:12345-0@lo:400:kworker.0 Request processed in 698us (1307us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051391.256657:0:6579:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d944d2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3678:x1863365452614528:12345-0@lo:400:kworker.0 Request processed in 109us (1372us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051391.256657:0:6585:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d944d29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3678:x1863365452615040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777051391.256678:0:27882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13322 00000100:00100000:0.0:1777051391.256689:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13324 00000100:00100000:2.0:1777051391.256970:0:27882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13325 00000100:00100000:1.0:1777051391.256994:0:6585:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d944d29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3678:x1863365452615040:12345-0@lo:400:kworker.0 Request processed in 339us (1596us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051391.256994:0:27882:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95aecc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0000_UUID+5:3679:x1863365452614144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777051391.257017:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8150 00000100:00100000:0.0:1777051391.257053:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95f97ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3677:1863365452615424:0@lo:400:kworker.0 00000100:00100000:2.0:1777051391.257068:0:27882:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95aecc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0000_UUID+5:3679:x1863365452614144:12345-0@lo:400:kworker.0 Request processed in 82us (1258us total) trans 0 rc 0/0 00000100:00080000:1.0:1777051391.257081:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1777051391.257081:0:27882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13325 00000100:00100000:0.0:1777051391.257084:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94f168e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3677:1863365452614400:0@lo:400:kworker.0 00000100:00100000:0.0:1777051391.257469:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95f97c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3677:1863365452614912:0@lo:400:kworker.0 00000100:00100000:0.0:1777051391.257501:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95aecf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3677:1863365452613888:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1777051391.257520:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94f16a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3680:1863365452614272:0@lo:400:kworker.0 00000100:00100000:2.0:1777051391.257594:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051391.257619:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94f169500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3678:1863365452614528:0@lo:400:kworker.0 00000100:00100000:2.0:1777051391.257633:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95f97e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3680:1863365452614784:0@lo:400:kworker.0 00000100:00100000:0.0:1777051391.257640:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95f97f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452615040:0@lo:400:kworker.0 00000100:00100000:0.0:1777051391.257659:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94f16ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3678:1863365452614016:0@lo:400:kworker.0 00000100:00100000:2.0:1777051391.257682:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1777051391.257684:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1777051391.257701:0:6579:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452614272 00000100:00100000:0.0:1777051391.257708:0:6579:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452614272 00000100:00100000:3.0:1777051391.257786:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94f169880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3679:1863365452614144:0@lo:400:kworker.0 00000100:00100000:2.0:1777051391.257879:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95f97d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3680:1863365452615296:0@lo:400:kworker.0 00000100:00100000:0.0:1777051391.257903:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13326 00000100:00100000:0.0:1777051391.257916:0:6579:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f97ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3680:x1863365452614272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777051391.257926:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051391.257974:0:6579:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f97ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3680:x1863365452614272:12345-0@lo:400:kworker.0 Request processed in 60us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051391.257984:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13326 00000100:00080000:0.0:1777051391.258020:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1777051391.258722:0:13320:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452615168 00000100:00100000:3.0:1777051391.258722:0:27884:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452614656 00000100:00100000:0.0:1777051391.258724:0:24468:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452614784 00000100:00100000:3.0:1777051391.258731:0:27884:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452614656 00000100:00100000:1.0:1777051391.258734:0:13320:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452615168 00000100:00100000:0.0:1777051391.258735:0:24468:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452614784 00000100:00100000:0.0:1777051391.259711:0:24468:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452615296 00000100:00100000:2.0:1777051391.259711:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94f16a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3680:1863365452614272:0@lo:400:kworker.0 00000100:00100000:0.0:1777051391.259734:0:24468:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452615296 00000100:00080000:2.0:1777051391.259757:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1777051391.259763:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1777051391.259791:0:27887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10379 00000100:00100000:2.0:1777051391.259804:0:27887:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f97f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3680:x1863365452614784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777051391.259914:0:27887:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f97f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3680:x1863365452614784:12345-0@lo:400:kworker.0 Request processed in 112us (2236us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051391.259925:0:27887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10379 00000100:00100000:0.0:1777051391.260213:0:24468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10382 00000100:00100000:0.0:1777051391.260213:0:24468:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f97df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3680:x1863365452615296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777051391.260213:0:24468:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f97df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3680:x1863365452615296:12345-0@lo:400:kworker.0 Request processed in 0us (2298us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051391.260213:0:13320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10381 00000100:00100000:1.0:1777051391.260213:0:13320:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95aecca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3679:x1863365452615168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777051391.260213:0:13320:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95aecca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3679:x1863365452615168:12345-0@lo:400:kworker.0 Request processed in 0us (3725us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051391.260213:0:13320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10381 00000100:00100000:3.0:1777051391.260213:0:27884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10380 00000100:00100000:3.0:1777051391.260213:0:27884:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95aecea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3679:x1863365452614656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051391.260213:0:27884:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95aecea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3679:x1863365452614656:12345-0@lo:400:kworker.0 Request processed in 0us (3819us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051391.260213:0:27884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10380 00000100:00100000:0.0:1777051391.260452:0:24468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10382 00000100:00100000:3.0:1777051391.260455:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95f97fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452614656:0@lo:400:kworker.0 00000100:00100000:3.0:1777051391.260484:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95f97f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452615168:0@lo:400:kworker.0 00000100:00100000:0.0:1777051391.260579:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95f97e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3680:1863365452614784:0@lo:400:kworker.0 00000100:00100000:0.0:1777051391.260597:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95f97d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3680:1863365452615296:0@lo:400:kworker.0 00000100:00100000:1.0:1777051391.767742:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95aecf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452615552:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1777051391.767871:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051391.767980:0:8472:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452615552 00000100:00100000:3.0:1777051391.768001:0:8472:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452615552 00000100:00100000:1.0:1777051391.768053:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d944d2a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452615680:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1777051391.768096:0:8472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5630 00000100:00100000:1.0:1777051391.768106:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051391.768119:0:8472:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d944d28700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3678:x1863365452615552:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1777051391.768173:0:8472:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 445021760 pending 0 free 3645853696 avail 3414331392 00000100:00100000:1.0:1777051391.768246:0:10113:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452615680 00000100:00100000:1.0:1777051391.768255:0:10113:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452615680 00000100:00100000:3.0:1777051391.768277:0:8472:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d944d28700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3678:x1863365452615552:12345-0@lo:13:osp-pre-1-1.0 Request processed in 164us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051391.768288:0:8472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5630 00000100:00100000:1.0:1777051391.768317:0:10113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5631 00000100:00100000:1.0:1777051391.768332:0:10113:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d944d29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3679:x1863365452615680:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1777051391.768363:0:10113:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 455081536 pending 0 free 3862671360 avail 3631149056 00000100:00100000:3.0:1777051391.768380:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95aecf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452615552:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1777051391.768429:0:10113:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d944d29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3679:x1863365452615680:12345-0@lo:13:osp-pre-0-1.0 Request processed in 99us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051391.768443:0:10113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5631 00000100:00100000:1.0:1777051391.768512:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d944d2a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452615680:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1777051392.087286:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1777051392.940442:0:106210:0:(llog.c:801:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:3.0:1777051392.940453:0:106210:0:(llog_cat.c:158:llog_cat_process_common()) processing log [0x1:0x2b:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1777051392.940506:0:106210:0:(llog.c:858:llog_process_thread()) stop processing plain [0x1:0x2b:0x0] index 4 count 4 00000040:00080000:3.0:1777051392.940545:0:106210:0:(llog.c:858:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00010000:00010000:0.0:1777051393.111687:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1777051393.302503:0:3679:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1777051393.302584:0:3678:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1777051393.302610:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95aecf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3678:1863365452615936:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1777051393.302613:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95f97dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452615808:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1777051393.302729:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051393.302787:0:8472:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452615936 00000100:00100000:3.0:1777051393.302801:0:8472:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452615936 00000100:00100000:2.0:1777051393.302840:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1777051393.302893:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1777051393.302912:0:10113:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452615808 00000100:00100000:2.0:1777051393.302921:0:10113:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452615808 00000100:00100000:3.0:1777051393.302924:0:8472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5632 00000100:00100000:3.0:1777051393.302948:0:8472:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d944d2a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3678:x1863365452615936:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1777051393.302993:0:8472:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 455081536 pending 0 free 3862671360 avail 3631149056 00000100:00080000:1.0:1777051393.303001:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1777051393.303023:0:10113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5633 00000100:00100000:2.0:1777051393.303040:0:10113:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f97e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3679:x1863365452615808:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1777051393.303100:0:10113:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 445021760 pending 0 free 3645853696 avail 3414331392 00000100:00100000:3.0:1777051393.303101:0:8472:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d944d2a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3678:x1863365452615936:12345-0@lo:13:osp-pre-0-0.0 Request processed in 157us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051393.303120:0:8472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5632 00000100:00100000:2.0:1777051393.303189:0:10113:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f97e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3679:x1863365452615808:12345-0@lo:13:osp-pre-1-0.0 Request processed in 153us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051393.303239:0:10113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5633 00000100:00100000:3.0:1777051393.303306:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95f97dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452615808:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1777051393.303320:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95aecf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3678:1863365452615936:0@lo:13:osp-pre-0-0.0 00000040:00080000:2.0:1777051393.747816:0:106262:0:(llog.c:801:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:2.0:1777051393.747826:0:106262:0:(llog_cat.c:158:llog_cat_process_common()) processing log [0x1:0x2b:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1777051393.747876:0:106262:0:(llog.c:858:llog_process_thread()) stop processing plain [0x1:0x2b:0x0] index 4 count 4 00000040:00080000:2.0:1777051393.747885:0:106262:0:(llog.c:858:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00000100:00100000:0.0:1777051393.955573:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051393.955638:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051393.955870:0:103163:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425950720 00000100:00100000:3.0:1777051393.955883:0:103163:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425950720 00000100:00100000:3.0:1777051393.955970:0:103163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 165 00000100:00100000:3.0:1777051393.955985:0:103163:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7c97b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29c4352d-3260-4734-909d-9ea5de9e7fa4+12:2438:x1863365425950720:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:1.0:1777051393.956791:0:8492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425950848 00000100:00100000:1.0:1777051393.956799:0:8492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425950848 00000100:00100000:3.0:1777051393.956832:0:103163:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7c97b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29c4352d-3260-4734-909d-9ea5de9e7fa4+12:2438:x1863365425950720:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 845us (1266us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051393.956848:0:103163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 165 00000100:00100000:1.0:1777051393.956878:0:8492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13327 00000100:00100000:1.0:1777051393.956894:0:8492:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5fbeca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+18:2439:x1863365425950848:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:1.0:1777051393.957089:0:8492:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5fbeca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+18:2439:x1863365425950848:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 197us (1448us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051393.957384:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051393.957471:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051393.957575:0:27885:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425950976 00000100:00100000:3.0:1777051393.957583:0:27885:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425950976 00000100:00100000:3.0:1777051393.957630:0:27885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13328 00000100:00100000:3.0:1777051393.957645:0:27885:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f97d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c11b6966-0775-44d2-bdc6-c74c26eb2226+8:2438:x1863365425950976:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:1.0:1777051393.957657:0:8492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13327 00000100:00080000:1.0:1777051393.957696:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1777051393.957707:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1777051393.957722:0:27885:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f97d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c11b6966-0775-44d2-bdc6-c74c26eb2226+8:2438:x1863365425950976:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 59us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051393.957738:0:27885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13328 00000100:00100000:1.0:1777051393.957741:0:8628:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425951232 00000100:00100000:1.0:1777051393.957750:0:8628:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425951232 00000100:00100000:1.0:1777051393.957842:0:8628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10383 00000100:00100000:1.0:1777051393.957855:0:8628:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f97c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+48:2438:x1863365425951232:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:1.0:1777051393.957904:0:8628:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f97c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+48:2438:x1863365425951232:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 51us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051393.957918:0:8628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10383 00000100:00080000:1.0:1777051393.957944:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1777051393.958595:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051393.958654:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051393.958705:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051393.958755:0:10328:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425951488 00000100:00100000:2.0:1777051393.958755:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051393.958766:0:10328:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425951488 00000100:00100000:2.0:1777051393.958806:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051393.958840:0:55805:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425951104 00000100:00100000:0.0:1777051393.958847:0:10328:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425951360 00000100:00100000:0.0:1777051393.958854:0:10328:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425951360 00000100:00100000:0.0:1777051393.958904:0:10328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13329 00000100:00100000:0.0:1777051393.958923:0:10328:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f97ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+48:2438:x1863365425951488:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:2.0:1777051393.958932:0:46497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13330 00000100:00100000:2.0:1777051393.958954:0:46497:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f97dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+25:2439:x1863365425951360:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:0.0:1777051393.958998:0:10328:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f97ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+48:2438:x1863365425951488:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 79us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051393.959012:0:10328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13329 00000100:00100000:2.0:1777051393.959023:0:46497:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f97dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+25:2439:x1863365425951360:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 70us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051393.959038:0:46497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13330 00000100:00080000:0.0:1777051393.959051:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1777051393.959057:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1777051393.959161:0:55805:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425951104 00000100:00100000:1.0:1777051393.959166:0:13320:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425951744 00000100:00100000:1.0:1777051393.959176:0:13320:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425951744 00000100:00100000:3.0:1777051393.959245:0:55805:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425951616 00000100:00100000:3.0:1777051393.959252:0:55805:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425951616 00000100:00100000:0.0:1777051393.959256:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10384 00000100:00080000:2.0:1777051393.959268:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1777051393.959276:0:8471:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f97ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+50:2439:x1863365425951104:12345-192.168.201.46@tcp:400:kworker.0 00000100:00080000:2.0:1777051393.959277:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1777051393.959323:0:13320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10385 00000100:00100000:1.0:1777051393.959341:0:13320:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f97d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+47:2438:x1863365425951744:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:0.0:1777051393.959363:0:8471:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f97ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+50:2439:x1863365425951104:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 88us (766us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051393.959378:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10384 00000100:00100000:1.0:1777051393.959407:0:13320:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f97d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+47:2438:x1863365425951744:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 67us (649us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051393.959422:0:13320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10385 00000100:00100000:3.0:1777051393.959729:0:55805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10386 00000100:00100000:3.0:1777051393.959742:0:55805:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f97e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+51:2439:x1863365425951616:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:3.0:1777051393.959821:0:55805:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f97e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+51:2439:x1863365425951616:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 79us (1017us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051393.959833:0:55805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10386 00010000:00010000:0.0:1777051394.135088:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777051395.159056:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1777051395.384865:0:106313:0:(llog.c:801:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:2.0:1777051395.384872:0:106313:0:(llog_cat.c:158:llog_cat_process_common()) processing log [0x1:0x2b:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1777051395.384906:0:106313:0:(llog.c:858:llog_process_thread()) stop processing plain [0x1:0x2b:0x0] index 4 count 4 00000040:00080000:2.0:1777051395.384913:0:106313:0:(llog.c:858:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00000100:00100000:2.0:1777051395.862616:0:3677:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1777051395.862650:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95aecf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452616064:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1777051395.863032:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051395.863269:0:46498:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452616064 00000100:00100000:3.0:1777051395.863282:0:46498:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452616064 00000100:00100000:3.0:1777051395.863378:0:46498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8151 00000100:00100000:3.0:1777051395.863397:0:46498:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f97f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:3677:x1863365452616064:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1777051395.863447:0:46498:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4194304 pending 0 free 1441579008 avail 1295339520 00000100:00100000:3.0:1777051395.863567:0:46498:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f97f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:3677:x1863365452616064:12345-0@lo:41:osp-pre-0-1.0 Request processed in 173us (534us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051395.863581:0:46498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8151 00000100:00100000:2.0:1777051395.863662:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95aecf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452616064:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1777051396.182412:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777051396.374561:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d944d2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3679:1863365452616192:0@lo:400:kworker.0 00000100:00100000:2.0:1777051396.374618:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d944d2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3677:1863365452616448:0@lo:400:kworker.0 00000100:00100000:0.0:1777051396.374625:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d944d2bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3680:1863365452616320:0@lo:400:kworker.0 00000100:00100000:3.0:1777051396.374699:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051396.374700:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d944d29f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3678:1863365452616576:0@lo:400:kworker.0 00000100:00100000:2.0:1777051396.374724:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051396.374787:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051396.374811:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d944d28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3677:1863365452616960:0@lo:400:kworker.0 00000100:00100000:0.0:1777051396.374820:0:6579:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452616448 00000100:00100000:3.0:1777051396.374821:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d944d29c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3679:1863365452616704:0@lo:400:kworker.0 00000100:00100000:0.0:1777051396.374830:0:6579:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452616448 00000100:00100000:1.0:1777051396.374841:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d951fa1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3678:1863365452617088:0@lo:400:kworker.0 00000100:00100000:3.0:1777051396.374891:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051396.374939:0:6579:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452616576 00000100:00100000:2.0:1777051396.374939:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051396.374948:0:6579:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452616576 00000100:00100000:3.0:1777051396.374956:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f9bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3679:1863365452617216:0@lo:400:kworker.0 00000100:00100000:1.0:1777051396.374960:0:8492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452616704 00000100:00100000:1.0:1777051396.374970:0:8492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452616704 00000100:00100000:0.0:1777051396.375007:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13331 00000100:00100000:2.0:1777051396.375011:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f9b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452617472:0@lo:400:kworker.0 00000100:00100000:3.0:1777051396.375025:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051396.375033:0:6579:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f97fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3677:x1863365452616448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777051396.375390:0:8492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452617216 00000100:00100000:2.0:1777051396.375399:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051396.375402:0:8492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452617216 00000100:00100000:3.0:1777051396.375424:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5fbeed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452617728:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1777051396.375501:0:8492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13332 00000100:00100000:0.0:1777051396.375522:0:6579:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f97fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3677:x1863365452616448:12345-0@lo:400:kworker.0 Request processed in 491us (791us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051396.375523:0:8492:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3678:x1863365452616576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777051396.375525:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d944d2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3677:1863365452616448:0@lo:400:kworker.0 00000100:00100000:3.0:1777051396.375539:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051396.375558:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13331 00000100:00100000:3.0:1777051396.375605:0:3679:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1777051396.375608:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13333 00000100:00080000:2.0:1777051396.375611:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1777051396.375623:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1777051396.375625:0:8492:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3678:x1863365452616576:12345-0@lo:400:kworker.0 Request processed in 110us (842us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051396.375625:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f9b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452617344:0@lo:400:kworker.0 00000100:00100000:0.0:1777051396.375636:0:6579:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95aecf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3679:x1863365452616704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777051396.375644:0:27887:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452616960 00000100:00100000:2.0:1777051396.375654:0:27887:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452616960 00000100:00100000:1.0:1777051396.375655:0:8492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13332 00000100:00100000:1.0:1777051396.375701:0:8492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13334 00000100:00100000:3.0:1777051396.375702:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051396.375730:0:8492:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7c9a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3679:x1863365452617216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777051396.375736:0:27887:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452617472 00000100:00100000:0.0:1777051396.375737:0:6579:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95aecf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3679:x1863365452616704:12345-0@lo:400:kworker.0 Request processed in 107us (842us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051396.375746:0:27887:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452617472 00000100:00100000:0.0:1777051396.375759:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13333 00000100:00100000:3.0:1777051396.375775:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d944d29c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3679:1863365452616704:0@lo:400:kworker.0 00000100:00100000:2.0:1777051396.375813:0:27887:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452617344 00000100:00100000:3.0:1777051396.375818:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f9bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3679:1863365452617216:0@lo:400:kworker.0 00000100:00100000:2.0:1777051396.375823:0:27887:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452617344 00000100:00100000:1.0:1777051396.375829:0:8492:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7c9a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3679:x1863365452617216:12345-0@lo:400:kworker.0 Request processed in 103us (804us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051396.375837:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10387 00000100:00100000:1.0:1777051396.375858:0:8492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13334 00000100:00100000:0.0:1777051396.375866:0:8471:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f97f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3677:x1863365452616960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051396.375867:0:103169:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452616192 00000100:00100000:3.0:1777051396.375877:0:103169:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452616192 00000100:00100000:2.0:1777051396.375892:0:27887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10388 00000100:00100000:2.0:1777051396.375914:0:27887:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f97c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3677:x1863365452617472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777051396.375920:0:6585:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452617728 00000100:00100000:1.0:1777051396.375930:0:6585:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452617728 00000100:00100000:3.0:1777051396.375955:0:103169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1777051396.375963:0:8471:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f97f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3677:x1863365452616960:12345-0@lo:400:kworker.0 Request processed in 105us (1025us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051396.375977:0:103169:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7c979850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f9351a01-5b0e-4470-97fd-58b9b4b312a2+23:3679:x1863365452616192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777051396.375981:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10387 00000100:00100000:1.0:1777051396.376002:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8152 00000100:00100000:2.0:1777051396.376004:0:27887:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f97c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3677:x1863365452617472:12345-0@lo:400:kworker.0 Request processed in 93us (605us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051396.376017:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10389 00000100:00100000:1.0:1777051396.376025:0:6585:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d950265c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3679:x1863365452617728:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1777051396.376035:0:8471:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f518e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3679:x1863365452617344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777051396.376044:0:27887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10388 00000100:00100000:3.0:1777051396.376064:0:103169:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7c979850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f9351a01-5b0e-4470-97fd-58b9b4b312a2+23:3679:x1863365452616192:12345-0@lo:400:kworker.0 Request processed in 92us (1368us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051396.376079:0:103169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000004:00000024:1.0:1777051396.376081:0:6585:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4194304 pending 0 free 1446154240 avail 1299914752 00000100:00080000:2.0:1777051396.376386:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1777051396.376394:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1777051396.376398:0:8471:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f518e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3679:x1863365452617344:12345-0@lo:400:kworker.0 Request processed in 367us (704us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051396.376413:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10389 00000100:00100000:2.0:1777051396.376431:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051396.376444:0:6585:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d950265c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3679:x1863365452617728:12345-0@lo:41:osp-pre-1-0.0 Request processed in 424us (911us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051396.376497:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8152 00000100:00100000:2.0:1777051396.376517:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d944d29500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3680:1863365452616832:0@lo:400:kworker.0 00000100:00100000:3.0:1777051396.376519:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f9b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452617344:0@lo:400:kworker.0 00000100:00100000:0.0:1777051396.376542:0:46494:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452616320 00000100:00100000:0.0:1777051396.376552:0:46494:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452616320 00000100:00100000:3.0:1777051396.376563:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5fbeed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452617728:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1777051396.376576:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051396.376590:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051396.376598:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d944d2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3679:1863365452616192:0@lo:400:kworker.0 00000100:00100000:1.0:1777051396.376627:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f9bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3678:1863365452617600:0@lo:400:kworker.0 00000100:00100000:0.0:1777051396.376634:0:46494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13335 00000100:00100000:0.0:1777051396.376650:0:46494:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f97ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000-lwp-OST0000_UUID+5:3680:x1863365452616320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777051396.376687:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051396.376707:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f9b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452617472:0@lo:400:kworker.0 00000100:00100000:2.0:1777051396.376718:0:6580:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452617600 00000100:00100000:2.0:1777051396.376728:0:6580:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452617600 00000100:00100000:3.0:1777051396.376742:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d944d28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3677:1863365452616960:0@lo:400:kworker.0 00000100:00100000:0.0:1777051396.376745:0:46494:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f97ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000-lwp-OST0000_UUID+5:3680:x1863365452616320:12345-0@lo:400:kworker.0 Request processed in 94us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051396.376763:0:46494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13335 00000100:00100000:1.0:1777051396.376769:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d944d29f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3678:1863365452616576:0@lo:400:kworker.0 00000100:00080000:3.0:1777051396.376795:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1777051396.376797:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13336 00000100:00100000:2.0:1777051396.376820:0:6580:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3678:x1863365452617600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777051396.376836:0:13320:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452617088 00000100:00100000:1.0:1777051396.376844:0:13320:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452617088 00000100:00100000:3.0:1777051396.376847:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d944d2bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3680:1863365452616320:0@lo:400:kworker.0 00000100:00100000:0.0:1777051396.376871:0:47208:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452616832 00000100:00100000:0.0:1777051396.376881:0:47208:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452616832 00000100:00100000:2.0:1777051396.376912:0:6580:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3678:x1863365452617600:12345-0@lo:400:kworker.0 Request processed in 96us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051396.376930:0:13320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10390 00000100:00100000:2.0:1777051396.376933:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13336 00000100:00100000:0.0:1777051396.376958:0:47208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8153 00000100:00100000:1.0:1777051396.376958:0:13320:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3678:x1863365452617088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051396.376965:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f9bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3678:1863365452617600:0@lo:400:kworker.0 00000100:00100000:0.0:1777051396.376984:0:47208:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d944d29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+6:3680:x1863365452616832:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1777051396.377009:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1777051396.377061:0:13320:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3678:x1863365452617088:12345-0@lo:400:kworker.0 Request processed in 112us (489us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051396.377390:0:13320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10390 00000100:00100000:3.0:1777051396.377395:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d951fa1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3678:1863365452617088:0@lo:400:kworker.0 00000100:00100000:2.0:1777051396.377421:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d944d29500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3680:1863365452616832:0@lo:400:kworker.0 00000100:00100000:0.0:1777051396.377624:0:47208:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d944d29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+6:3680:x1863365452616832:12345-0@lo:400:kworker.0 Request processed in 96us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051396.377638:0:47208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8153 00000100:00100000:1.0:1777051396.886542:0:3679:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1777051396.886579:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f9b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452617856:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1777051396.886581:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94f518380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452617984:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1777051396.886701:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051396.886793:0:47388:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452617984 00000100:00100000:0.0:1777051396.886809:0:47388:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452617984 00000100:00100000:0.0:1777051396.886902:0:47388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5634 00000100:00100000:0.0:1777051396.886920:0:47388:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f519f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3677:x1863365452617984:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1777051396.886961:0:47388:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 445021760 pending 0 free 3645853696 avail 3414331392 00000100:00100000:0.0:1777051396.887656:0:47388:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f519f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3677:x1863365452617984:12345-0@lo:13:osp-pre-1-1.0 Request processed in 736us (953us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051396.887673:0:47388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5634 00000100:00100000:2.0:1777051396.888598:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94f518380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452617984:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1777051396.888682:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051396.888809:0:8472:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452617856 00000100:00100000:3.0:1777051396.888819:0:8472:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452617856 00000100:00100000:3.0:1777051396.888909:0:8472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5635 00000100:00100000:3.0:1777051396.888924:0:8472:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3679:x1863365452617856:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1777051396.888957:0:8472:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 455081536 pending 0 free 3862671360 avail 3631149056 00000100:00100000:3.0:1777051396.889041:0:8472:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3679:x1863365452617856:12345-0@lo:13:osp-pre-0-1.0 Request processed in 120us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051396.889082:0:8472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5635 00000100:00100000:1.0:1777051396.889140:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f9b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452617856:0@lo:13:osp-pre-0-1.0 00000040:00080000:3.0:1777051397.014695:0:103189:0:(llog.c:801:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:3.0:1777051397.014706:0:103189:0:(llog_cat.c:158:llog_cat_process_common()) processing log [0x1:0x2b:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1777051397.014749:0:103189:0:(llog.c:858:llog_process_thread()) stop processing plain [0x1:0x2b:0x0] index 4 count 4 00000040:00080000:3.0:1777051397.014761:0:103189:0:(llog.c:858:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00000100:00100000:3.0:1777051397.014971:0:103189:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94f519180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:103189:1863365452618112:192.168.201.46@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1777051397.015105:0:103189:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d95cb32600 going to sleep for 11 seconds 00000100:00100000:0.0:1777051397.022596:0:103189:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94f519180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:103189:1863365452618112:192.168.201.46@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1777051397.024404:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051397.024531:0:10328:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425951872 00000100:00100000:0.0:1777051397.024542:0:10328:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425951872 00000100:00100000:0.0:1777051397.024640:0:10328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111984 00000100:00100000:0.0:1777051397.024655:0:10328:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d944d29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+18:135543:x1863365425951872:12345-192.168.201.46@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1777051397.024697:0:10328:0:(mdt_handler.c:7958:mdt_fid2path()) path get [0x2000032e2:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1777051397.025293:0:10328:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d944d29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+18:135543:x1863365425951872:12345-192.168.201.46@tcp:53:lhsmtool_posix.0 Request processed in 638us (890us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051397.025306:0:10328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111984 00000100:00080000:2.0:1777051397.025322:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1777051397.034027:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051397.034317:0:46497:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425952128 00000100:00100000:1.0:1777051397.034330:0:46497:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425952128 00000100:00100000:1.0:1777051397.034418:0:46497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111985 00000100:00100000:1.0:1777051397.034434:0:46497:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d944d2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:c11b6966-0775-44d2-bdc6-c74c26eb2226+18:135543:x1863365425952128:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1777051397.034487:0:46497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777051397.034517:0:46497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48be00/0x85f51a6b96715eb1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b62bb expref: -99 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051397.038649:0:46497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48ae00/0x85f51a6b96715eb8 lrc: 3/1,0 mode: --/PR res: [0x2000032e2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051397.038678:0:46497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48ae00/0x85f51a6b96715eb8 lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051397.038699:0:46497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48ae00/0x85f51a6b96715eb8 lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1777051397.038715:0:46497:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000032e2:0x2:0x0]: returning size 0 00010000:00010000:1.0:1777051397.038883:0:46497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48be00/0x85f51a6b96715eb1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b62bb expref: 21 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051397.038908:0:46497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48ae00/0x85f51a6b96715eb8 lrc: 3/0,0 mode: PR/PR res: [0x2000032e2:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b62bb expref: 20 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051397.038922:0:46497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0x2:0x0].0x0 (ffff99d94e81cf00) 00010000:00010000:1.0:1777051397.038927:0:46497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1777051397.038932:0:46497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d94e48ae00, rc 0) 00000100:00100000:1.0:1777051397.039012:0:46497:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d944d2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:c11b6966-0775-44d2-bdc6-c74c26eb2226+20:135543:x1863365425952128:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 Request processed in 4581us (4992us total) trans 30064771129 rc 0/0 00000100:00100000:1.0:1777051397.039027:0:46497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111985 00000100:00100000:1.0:1777051397.044642:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051397.044730:0:8468:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425952256 00000100:00100000:2.0:1777051397.044742:0:8468:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425952256 00000100:00080000:3.0:1777051397.044826:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1777051397.044852:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 7995 00000100:00100000:2.0:1777051397.044871:0:8468:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da57c86450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+50:2436:x1863365425952256:12345-192.168.201.46@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1777051397.044922:0:8468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000035a66c1c/0x85f51a6b96715ec6 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x1e3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051397.044947:0:8468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777051397.044952:0:8468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777051397.044960:0:8468:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000035a66c1c/0x85f51a6b96715ec6 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x1e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051397.044985:0:8468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000035a66c1c/0x85f51a6b96715ec6 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x1e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051397.045019:0:8468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000035a66c1c/0x85f51a6b96715ec6 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x1e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051397.045034:0:8468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000035a66c1c/0x85f51a6b96715ec6 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x1e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051397.045058:0:8468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000035a66c1c/0x85f51a6b96715ec6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x1e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051397.045070:0:8468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d950262200 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:2.0:1777051397.045077:0:8468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000035a66c1c/0x85f51a6b96715ec6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x1e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051397.045091:0:8468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000035a66c1c/0x85f51a6b96715ec6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x1e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051397.045122:0:8468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000035a66c1c/0x85f51a6b96715ec6 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x1e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051397.045134:0:8468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000035a66c1c/0x85f51a6b96715ec6 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x1e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051397.045222:0:8468:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da57c86450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+50:2436:x1863365425952256:12345-192.168.201.46@tcp:1:lhsmtool_posix.0 Request processed in 356us (585us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051397.045236:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 7995 00000100:00100000:1.0:1777051397.049860:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051397.049906:0:27885:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425952512 00000100:00100000:3.0:1777051397.049915:0:27885:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425952512 00000100:00100000:3.0:1777051397.049994:0:27885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111986 00000100:00100000:3.0:1777051397.050008:0:27885:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c11b6966-0775-44d2-bdc6-c74c26eb2226+20:135543:x1863365425952512:12345-192.168.201.46@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1777051397.050122:0:27885:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c11b6966-0775-44d2-bdc6-c74c26eb2226+20:135543:x1863365425952512:12345-192.168.201.46@tcp:57:lhsmtool_posix.0 Request processed in 116us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051397.050136:0:27885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111986 00000100:00100000:0.0:1777051397.053540:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051397.053627:0:27884:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425952640 00000100:00100000:3.0:1777051397.053637:0:27884:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425952640 00000100:00100000:3.0:1777051397.053717:0:27884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 7996 00000100:00100000:3.0:1777051397.053733:0:27884:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5fbef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+50:2437:x1863365425952640:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1777051397.053751:0:27884:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777051397.053775:0:27884:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f2fd58b2/0x85f51a6b96715ecd lrc: 2/0,0 mode: --/PR res: [0x280000401:0x1e3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b62c2 expref: -99 pid: 27884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051397.053818:0:27884:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051397.053822:0:27884:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051397.053851:0:27884:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f2fd58b2/0x85f51a6b96715ecd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x1e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b62c2 expref: 51 pid: 27884 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051397.053878:0:27884:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f2fd58b2/0x85f51a6b96715ecd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x1e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b62c2 expref: 51 pid: 27884 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051397.053899:0:27884:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d941ad7a00, rc 0) 00000100:00100000:3.0:1777051397.053975:0:27884:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5fbef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+51:2437:x1863365425952640:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 Request processed in 244us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051397.053989:0:27884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 7996 00000100:00100000:1.0:1777051397.055875:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051397.055999:0:46494:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425952896 00000100:00100000:0.0:1777051397.056008:0:46494:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425952896 00000100:00100000:0.0:1777051397.056076:0:46494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111987 00000100:00100000:0.0:1777051397.056093:0:46494:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c11b6966-0775-44d2-bdc6-c74c26eb2226+20:135543:x1863365425952896:12345-192.168.201.46@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1777051397.058651:0:46494:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c11b6966-0775-44d2-bdc6-c74c26eb2226+20:135543:x1863365425952896:12345-192.168.201.46@tcp:57:lhsmtool_posix.0 Request processed in 2558us (2773us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051397.058667:0:46494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111987 00000100:00100000:2.0:1777051397.063316:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051397.063399:0:6579:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425953024 00000100:00100000:0.0:1777051397.063410:0:6579:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425953024 00000100:00100000:0.0:1777051397.063507:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111988 00000100:00100000:0.0:1777051397.063523:0:6579:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d944d2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+20:135543:x1863365425953024:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1777051397.063544:0:6579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051397.063588:0:6579:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b400/0x85f51a6b96715ed4 lrc: 2/0,0 mode: --/PR res: [0x2000032e2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b62c9 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051397.063634:0:6579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b800/0x85f51a6b96715edb lrc: 3/1,0 mode: --/PR res: [0x2000032e2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051397.063654:0:6579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b800/0x85f51a6b96715edb lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051397.063673:0:6579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b800/0x85f51a6b96715edb lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051397.064060:0:6579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b400/0x85f51a6b96715ed4 lrc: 0/0,0 mode: --/PR res: [0x2000032e2:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b62c9 expref: 22 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051397.064079:0:6579:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b800/0x85f51a6b96715edb lrc: 3/0,0 mode: PR/PR res: [0x2000032e2:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b62c9 expref: 21 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051397.064100:0:6579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0x2:0x0].0x0 (ffff99d94e81cf00) 00010000:00010000:0.0:1777051397.064106:0:6579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1777051397.064110:0:6579:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d94eb2b800, rc 0) 00000100:00100000:0.0:1777051397.064440:0:6579:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d944d2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+21:135543:x1863365425953024:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 Request processed in 918us (1122us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051397.064482:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111988 00000100:00100000:2.0:1777051397.068070:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051397.068427:0:8492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425953152 00000100:00100000:1.0:1777051397.068436:0:8492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425953152 00000100:00100000:1.0:1777051397.068524:0:8492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111989 00000100:00100000:1.0:1777051397.068538:0:8492:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d944d2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+21:135543:x1863365425953152:12345-192.168.201.46@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1777051397.068561:0:8492:0:(mdt_handler.c:7958:mdt_fid2path()) path get [0x2000032e2:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1777051397.068654:0:8492:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d944d2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+21:135543:x1863365425953152:12345-192.168.201.46@tcp:53:lhsmtool_posix.0 Request processed in 120us (587us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051397.068661:0:8492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111989 00000100:00100000:1.0:1777051397.071325:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051397.071426:0:24468:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425953280 00000100:00100000:3.0:1777051397.071436:0:24468:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425953280 00000100:00100000:3.0:1777051397.071524:0:24468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 7997 00000100:00100000:3.0:1777051397.071537:0:24468:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+51:2437:x1863365425953280:12345-192.168.201.46@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1777051397.071579:0:24468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a8efa856/0x85f51a6b96715ee2 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x1e3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051397.071601:0:24468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051397.071605:0:24468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051397.071613:0:24468:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a8efa856/0x85f51a6b96715ee2 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x1e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051397.071632:0:24468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a8efa856/0x85f51a6b96715ee2 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x1e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051397.071673:0:24468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a8efa856/0x85f51a6b96715ee2 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x1e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051397.071687:0:24468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a8efa856/0x85f51a6b96715ee2 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x1e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051397.071702:0:24468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a8efa856/0x85f51a6b96715ee2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x1e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051397.071715:0:24468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d941ad6800 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:3.0:1777051397.071722:0:24468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a8efa856/0x85f51a6b96715ee2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x1e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051397.071737:0:24468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a8efa856/0x85f51a6b96715ee2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x1e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051397.071759:0:24468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a8efa856/0x85f51a6b96715ee2 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x1e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051397.071772:0:24468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a8efa856/0x85f51a6b96715ee2 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x1e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051397.071861:0:24468:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+51:2437:x1863365425953280:12345-192.168.201.46@tcp:1:lhsmtool_posix.0 Request processed in 325us (535us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051397.071880:0:24468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 7997 00000100:00100000:1.0:1777051397.074439:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051397.074537:0:27882:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425953536 00000100:00100000:3.0:1777051397.074546:0:27882:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425953536 00000100:00100000:3.0:1777051397.074619:0:27882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111990 00000100:00100000:3.0:1777051397.074634:0:27882:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+21:135543:x1863365425953536:12345-192.168.201.46@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1777051397.074716:0:27882:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7400/0x85f51a6b96715ee9 lrc: 3/0,1 mode: --/PW res: [0x2000032e2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051397.074738:0:27882:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b800/0x85f51a6b96715edb lrc: 2/0,0 mode: PR/PR res: [0x2000032e2:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b62c9 expref: 21 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051397.074753:0:27882:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7400/0x85f51a6b96715ee9 lrc: 4/0,1 mode: --/PW res: [0x2000032e2:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051397.074797:0:27882:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b800/0x85f51a6b96715edb lrc: 3/0,0 mode: PR/PR res: [0x2000032e2:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b62c9 expref: 21 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051397.074816:0:27882:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b800/0x85f51a6b96715edb lrc: 4/0,0 mode: PR/PR res: [0x2000032e2:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b62c9 expref: 21 pid: 6579 timeout: 8126 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051397.074839:0:27882:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94f51aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27882:1863365452618240:192.168.201.46@tcp:104: 00000100:00100000:3.0:1777051397.074952:0:27882:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d95cb329c0 going to sleep for 11 seconds 00000100:00100000:3.0:1777051397.081486:0:27882:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94f51aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27882:1863365452618240:192.168.201.46@tcp:104: 00010000:00010000:3.0:1777051397.081517:0:27882:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7400/0x85f51a6b96715ee9 lrc: 3/0,1 mode: --/PW res: [0x2000032e2:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051397.082020:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051397.082104:0:6565:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425953664 00000100:00100000:3.0:1777051397.082114:0:6565:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425953664 00010000:00010000:3.0:1777051397.082162:0:6565:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b800/0x85f51a6b96715edb lrc: 4/0,0 mode: PR/PR res: [0x2000032e2:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b62c9 expref: 22 pid: 6579 timeout: 8126 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051397.082637:0:6565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3870 00000100:00100000:3.0:1777051397.082653:0:6565:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+22:2436:x1863365425953664:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1777051397.082673:0:6565:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777051397.082683:0:6565:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b800/0x85f51a6b96715edb lrc: 4/0,0 mode: PR/PR res: [0x2000032e2:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b62c9 expref: 22 pid: 6579 timeout: 8126 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051397.082706:0:6565:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b800/0x85f51a6b96715edb lrc: 3/0,0 mode: PR/PR res: [0x2000032e2:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b62c9 expref: 22 pid: 6579 timeout: 8126 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051397.082735:0:6565:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b800/0x85f51a6b96715edb lrc: 0/0,0 mode: --/PR res: [0x2000032e2:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b62c9 expref: 22 pid: 6579 timeout: 8126 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051397.082758:0:6565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0x2:0x0].0x0 (ffff99d94e81cf00) 00010000:00010000:3.0:1777051397.082764:0:6565:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7400/0x85f51a6b96715ee9 lrc: 3/0,1 mode: --/PW res: [0x2000032e2:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051397.082775:0:6565:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7400/0x85f51a6b96715ee9 lrc: 3/0,1 mode: PW/PW res: [0x2000032e2:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051397.082784:0:6565:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7400/0x85f51a6b96715ee9 lrc: 4/0,1 mode: PW/PW res: [0x2000032e2:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051397.082816:0:6565:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1777051397.082874:0:6565:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+21:2436:x1863365425953664:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 225us (853us total) trans 0 rc 0/0 00010000:00010000:0.0:1777051397.082876:0:27882:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7400/0x85f51a6b96715ee9 lrc: 3/0,1 mode: PW/PW res: [0x2000032e2:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051397.082906:0:6565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3870 00010000:00010000:0.0:1777051397.082907:0:27882:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7400/0x85f51a6b96715ee9 lrc: 3/0,1 mode: PW/PW res: [0x2000032e2:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051397.083424:0:27882:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7400/0x85f51a6b96715ee9 lrc: 3/0,1 mode: PW/PW res: [0x2000032e2:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051397.083439:0:27882:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7400/0x85f51a6b96715ee9 lrc: 2/0,0 mode: PW/PW res: [0x2000032e2:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051397.083478:0:27882:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7400/0x85f51a6b96715ee9 lrc: 3/0,0 mode: PW/PW res: [0x2000032e2:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051397.083490:0:27882:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d941ad7400 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:0.0:1777051397.083498:0:27882:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7400/0x85f51a6b96715ee9 lrc: 3/0,0 mode: PW/PW res: [0x2000032e2:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051397.083509:0:27882:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7400/0x85f51a6b96715ee9 lrc: 4/0,0 mode: PW/PW res: [0x2000032e2:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051397.083523:0:27882:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0x2:0x0].0x0 (ffff99d94e81cf00) 00010000:00010000:0.0:1777051397.083527:0:27882:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1777051397.083532:0:27882:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7400/0x85f51a6b96715ee9 lrc: 2/0,0 mode: --/PW res: [0x2000032e2:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051397.083540:0:27882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7400/0x85f51a6b96715ee9 lrc: 0/0,0 mode: --/PW res: [0x2000032e2:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051397.083673:0:27882:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+21:135543:x1863365425953536:12345-192.168.201.46@tcp:57:lhsmtool_posix.0 Request processed in 9040us (9236us total) trans 30064771130 rc 0/0 00000100:00100000:0.0:1777051397.083687:0:27882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111990 00000040:00080000:0.0:1777051397.084083:0:103189:0:(llog.c:801:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:0.0:1777051397.084088:0:103189:0:(llog_cat.c:158:llog_cat_process_common()) processing log [0x1:0x2b:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1777051397.084107:0:103189:0:(llog.c:858:llog_process_thread()) stop processing plain [0x1:0x2b:0x0] index 4 count 4 00000040:00080000:0.0:1777051397.084114:0:103189:0:(llog.c:858:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00000040:00080000:1.0:1777051397.084501:0:106364:0:(llog.c:801:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:1.0:1777051397.084508:0:106364:0:(llog_cat.c:158:llog_cat_process_common()) processing log [0x1:0x2b:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1777051397.084558:0:106364:0:(llog.c:858:llog_process_thread()) stop processing plain [0x1:0x2b:0x0] index 4 count 4 00000040:00080000:1.0:1777051397.084569:0:106364:0:(llog.c:858:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00000100:00100000:1.0:1777051397.090395:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051397.090491:0:6583:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425953920 00000100:00100000:3.0:1777051397.090501:0:6583:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425953920 00000100:00100000:3.0:1777051397.090570:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3346 00000100:00100000:3.0:1777051397.090584:0:6583:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da6ff05c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+21:135543:x1863365425953920:12345-192.168.201.46@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1777051397.091369:0:6583:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da6ff05c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+22:135543:x1863365425953920:12345-192.168.201.46@tcp:35:lhsmtool_posix.0 Request processed in 784us (975us total) trans 30064771131 rc 0/0 00000100:00100000:3.0:1777051397.091385:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3346 00010000:00010000:0.0:1777051397.207114:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777051398.230632:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1777051398.423302:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94f51aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3678:1863365452618368:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1777051398.423374:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94f51b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452618496:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1777051398.423396:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051398.423608:0:8473:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452618368 00000100:00100000:0.0:1777051398.423620:0:8473:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452618368 00000100:00100000:0.0:1777051398.423701:0:8473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5636 00000100:00100000:3.0:1777051398.423702:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051398.423726:0:8473:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d944d2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3678:x1863365452618368:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1777051398.423766:0:8473:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 455081536 pending 0 free 3862671360 avail 3631149056 00000100:00100000:0.0:1777051398.423838:0:8473:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d944d2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3678:x1863365452618368:12345-0@lo:13:osp-pre-0-0.0 Request processed in 119us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051398.423851:0:8473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5636 00000100:00100000:0.0:1777051398.423873:0:8473:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452618496 00000100:00100000:0.0:1777051398.423880:0:8473:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452618496 00000100:00100000:2.0:1777051398.423930:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94f51aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3678:1863365452618368:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1777051398.423942:0:8473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5637 00000100:00100000:0.0:1777051398.423958:0:8473:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f51bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3679:x1863365452618496:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1777051398.423996:0:8473:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 445021760 pending 0 free 3645853696 avail 3414331392 00000100:00100000:0.0:1777051398.424417:0:8473:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f51bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3679:x1863365452618496:12345-0@lo:13:osp-pre-1-0.0 Request processed in 462us (720us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051398.424459:0:8473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5637 00000100:00080000:0.0:1777051398.424490:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1777051398.424496:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1777051398.424578:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94f51b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452618496:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1777051398.564051:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051398.564531:0:11727:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425954048 00000100:00100000:0.0:1777051398.564547:0:11727:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425954048 00000100:00100000:0.0:1777051398.565024:0:11727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 8154 00000100:00100000:0.0:1777051398.565045:0:11727:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f51b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+25:2439:x1863365425954048:12345-192.168.201.46@tcp:63:ll_sa.0 00010000:00010000:0.0:1777051398.565097:0:11727:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051398.565127:0:11727:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2a000/0x85f51a6b96715ef0 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b62d0 expref: -99 pid: 11727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051398.565247:0:11727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b800/0x85f51a6b96715ef7 lrc: 3/1,0 mode: --/CR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 11727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051398.565272:0:11727:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b800/0x85f51a6b96715ef7 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051398.565295:0:11727:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b800/0x85f51a6b96715ef7 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051398.565347:0:11727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b400/0x85f51a6b96715efe lrc: 3/1,0 mode: --/PR res: [0x200000bd2:0xd5:0x0].0xe55c6528 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051398.565362:0:11727:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b400/0x85f51a6b96715efe lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xd5:0x0].0xe55c6528 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051398.565375:0:11727:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b400/0x85f51a6b96715efe lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xd5:0x0].0xe55c6528 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051398.565467:0:11727:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b800/0x85f51a6b96715ef7 lrc: 3/1,0 mode: CR/CR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051398.565482:0:11727:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b800/0x85f51a6b96715ef7 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 11727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051398.565494:0:11727:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b800/0x85f51a6b96715ef7 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051398.565506:0:11727:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94eb2b800 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:0.0:1777051398.565514:0:11727:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b800/0x85f51a6b96715ef7 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051398.565527:0:11727:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b800/0x85f51a6b96715ef7 lrc: 4/0,0 mode: CR/CR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 11727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051398.565548:0:11727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xd5:0x0].0x0 (ffff99d9413d2a00) 00010000:00010000:0.0:1777051398.565554:0:11727:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777051398.565562:0:11727:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b800/0x85f51a6b96715ef7 lrc: 2/0,0 mode: --/CR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051398.565574:0:11727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b800/0x85f51a6b96715ef7 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051398.565597:0:11727:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b400/0x85f51a6b96715efe lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0xd5:0x0].0xe55c6528 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051398.565609:0:11727:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b400/0x85f51a6b96715efe lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0xd5:0x0].0xe55c6528 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051398.565621:0:11727:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b400/0x85f51a6b96715efe lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xd5:0x0].0xe55c6528 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051398.565633:0:11727:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94eb2b400 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:0.0:1777051398.565640:0:11727:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b400/0x85f51a6b96715efe lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0xd5:0x0].0xe55c6528 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051398.565652:0:11727:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b400/0x85f51a6b96715efe lrc: 4/0,0 mode: PR/PR res: [0x200000bd2:0xd5:0x0].0xe55c6528 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051398.565668:0:11727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xd5:0x0].0xe55c6528 (ffff99d94e81ca00) 00010000:00010000:0.0:1777051398.565674:0:11727:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777051398.565679:0:11727:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b400/0x85f51a6b96715efe lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0xd5:0x0].0xe55c6528 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051398.565691:0:11727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b400/0x85f51a6b96715efe lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xd5:0x0].0xe55c6528 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051398.565749:0:11727:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2a000/0x85f51a6b96715ef0 lrc: 1/0,0 mode: --/CR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b62d0 expref: 26 pid: 11727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051398.565770:0:11727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd2:0xd5:0x0].0x0 (ffff99d9413d2a00) 00010000:00010000:0.0:1777051398.565773:0:11727:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1777051398.565779:0:11727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2a000/0x85f51a6b96715ef0 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b62d0 expref: 26 pid: 11727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051398.565793:0:11727:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d94eb2a000, rc -2) 00000100:00100000:0.0:1777051398.565877:0:11727:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f51b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+25:2439:x1863365425954048:12345-192.168.201.46@tcp:63:ll_sa.0 Request processed in 838us (1838us total) trans 0 rc -2/-2 00000100:00100000:0.0:1777051398.565896:0:11727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 8154 00000100:00080000:3.0:1777051398.566545:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1777051399.076692:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051399.076757:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051399.076957:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051399.077053:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051399.077143:0:6581:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425954304 00000100:00100000:2.0:1777051399.077176:0:6581:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425954304 00000100:00100000:3.0:1777051399.077213:0:27885:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425954816 00000100:00100000:3.0:1777051399.077342:0:27885:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425954816 00000100:00100000:2.0:1777051399.077406:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13337 00000100:00100000:3.0:1777051399.077457:0:27885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13338 00000100:00100000:2.0:1777051399.077460:0:6581:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+22:2437:x1863365425954304:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:3.0:1777051399.077483:0:27885:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+48:2437:x1863365425954816:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:3.0:1777051399.077589:0:27885:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+48:2437:x1863365425954816:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 112us (629us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051399.077604:0:27885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13338 00000100:00080000:3.0:1777051399.077647:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1777051399.077653:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1777051399.077694:0:6581:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+22:2437:x1863365425954304:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 271us (1013us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051399.077713:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13337 00000100:00100000:0.0:1777051399.078173:0:8628:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425954560 00000100:00100000:0.0:1777051399.078183:0:8628:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425954560 00000100:00100000:0.0:1777051399.078292:0:8628:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425955072 00000100:00100000:0.0:1777051399.078299:0:8628:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425955072 00000100:00100000:0.0:1777051399.078341:0:8628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10391 00000100:00100000:0.0:1777051399.078359:0:8628:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+51:2437:x1863365425954560:12345-192.168.201.46@tcp:400:kworker.0 00000100:00080000:3.0:1777051399.078384:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1777051399.078392:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1777051399.078471:0:13320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10392 00000100:00100000:0.0:1777051399.078488:0:8628:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+51:2437:x1863365425954560:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 130us (1728us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051399.078496:0:13320:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+47:2437:x1863365425955072:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:0.0:1777051399.078516:0:8628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10391 00000100:00100000:3.0:1777051399.078563:0:13320:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+47:2437:x1863365425955072:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 76us (1507us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051399.078576:0:13320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10392 00000100:00100000:3.0:1777051399.080042:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051399.080547:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051399.080606:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051399.080665:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051399.081075:0:6580:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425954432 00000100:00100000:2.0:1777051399.081083:0:6580:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425954432 00000100:00100000:2.0:1777051399.081486:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13339 00000100:00100000:2.0:1777051399.081500:0:6580:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f51b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+8:2437:x1863365425954432:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:2.0:1777051399.081560:0:6580:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f51b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+8:2437:x1863365425954432:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 61us (1014us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051399.081573:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13339 00000100:00100000:0.0:1777051399.082098:0:8468:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425954688 00000100:00100000:0.0:1777051399.082106:0:8468:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425954688 00000100:00100000:0.0:1777051399.082166:0:8468:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425954944 00000100:00100000:0.0:1777051399.082172:0:8468:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425954944 00000100:00100000:0.0:1777051399.082247:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10393 00000100:00100000:0.0:1777051399.082261:0:8468:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f51a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+48:2437:x1863365425954688:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:0.0:1777051399.082309:0:8468:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f51a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+48:2437:x1863365425954688:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 51us (1703us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051399.082321:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10393 00000100:00100000:0.0:1777051399.082343:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10394 00000100:00100000:0.0:1777051399.082354:0:8468:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f518700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+51:2437:x1863365425954944:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:0.0:1777051399.082397:0:8468:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f518700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+51:2437:x1863365425954944:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 45us (1732us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051399.082408:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10394 00000100:00100000:1.0:1777051399.083361:0:103166:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425954176 00000100:00100000:1.0:1777051399.083371:0:103166:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425954176 00000100:00100000:1.0:1777051399.083467:0:103166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 167 00000100:00100000:1.0:1777051399.083486:0:103166:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7c97a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29c4352d-3260-4734-909d-9ea5de9e7fa4+12:2437:x1863365425954176:12345-192.168.201.46@tcp:400:kworker.0 00000100:00080000:3.0:1777051399.083526:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1777051399.083534:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1777051399.083540:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1777051399.083568:0:103166:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7c97a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29c4352d-3260-4734-909d-9ea5de9e7fa4+12:2437:x1863365425954176:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 87us (3525us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051399.083582:0:103166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 167 00010000:00010000:2.0:1777051399.255047:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777051400.280298:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1777051400.982446:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94f51b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3680:1863365452618624:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1777051400.982545:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051400.982663:0:46500:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452618624 00000100:00100000:1.0:1777051400.982943:0:46500:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452618624 00000100:00100000:1.0:1777051400.983084:0:46500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8155 00000100:00100000:1.0:1777051400.983099:0:46500:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5fbed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+6:3680:x1863365452618624:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1777051400.983154:0:46500:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4194304 pending 0 free 1441579008 avail 1295339520 00000100:00100000:1.0:1777051400.983240:0:46500:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5fbed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+6:3680:x1863365452618624:12345-0@lo:41:osp-pre-0-1.0 Request processed in 142us (692us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051400.983252:0:46500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8155 00000100:00100000:0.0:1777051400.983941:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94f51b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3680:1863365452618624:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1777051401.302433:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1777051401.367627:0:104226:0:(llog.c:801:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1777051401.367640:0:104226:0:(llog_cat.c:158:llog_cat_process_common()) processing log [0x1:0x12:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1777051401.367675:0:104226:0:(llog.c:858:llog_process_thread()) stop processing plain [0x1:0x12:0x0] index 3 count 3 00000040:00080000:2.0:1777051401.367688:0:104226:0:(llog.c:858:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1777051401.495475:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94f518a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3677:1863365452618752:0@lo:400:kworker.0 00000100:00100000:2.0:1777051401.495586:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051401.495668:0:3677:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1777051401.495678:0:103165:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452618752 00000100:00100000:2.0:1777051401.495679:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5fbefb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3677:1863365452618880:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1777051401.495693:0:103165:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452618752 00000100:00100000:2.0:1777051401.496001:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051401.496063:0:6584:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452618880 00000100:00100000:1.0:1777051401.496074:0:6584:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452618880 00000100:00100000:0.0:1777051401.496084:0:103165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1777051401.496106:0:103165:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7c97bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9351a01-5b0e-4470-97fd-58b9b4b312a2+23:3677:x1863365452618752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777051401.496151:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8156 00000100:00100000:1.0:1777051401.496174:0:6584:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d944d29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3677:x1863365452618880:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1777051401.496189:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94f519c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3679:1863365452619008:0@lo:400:kworker.0 00000100:00100000:0.0:1777051401.496269:0:103165:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7c97bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9351a01-5b0e-4470-97fd-58b9b4b312a2+23:3677:x1863365452618752:12345-0@lo:400:kworker.0 Request processed in 168us (681us total) trans 0 rc 0/0 00000004:00000024:1.0:1777051401.496270:0:6584:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4194304 pending 0 free 1446154240 avail 1299914752 00000100:00100000:0.0:1777051401.496291:0:103165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1777051401.496322:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051401.496369:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94f51b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3680:1863365452619136:0@lo:400:kworker.0 00000100:00100000:1.0:1777051401.496405:0:6584:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d944d29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3677:x1863365452618880:12345-0@lo:41:osp-pre-1-0.0 Request processed in 211us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051401.496407:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94f519180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452619520:0@lo:400:kworker.0 00000100:00100000:1.0:1777051401.496433:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8156 00000100:00100000:0.0:1777051401.496474:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051401.496488:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94f518e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3678:1863365452619392:0@lo:400:kworker.0 00000100:00100000:2.0:1777051401.496491:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051401.496507:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94f51aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3677:1863365452619264:0@lo:400:kworker.0 00000100:00100000:0.0:1777051401.496528:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94f518380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3680:1863365452619648:0@lo:400:kworker.0 00000100:00100000:2.0:1777051401.496544:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d951fa1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452620032:0@lo:400:kworker.0 00000100:00100000:3.0:1777051401.496585:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051401.496611:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051401.496619:0:10328:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452619008 00000100:00100000:2.0:1777051401.496626:0:10328:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452619008 00000100:00100000:3.0:1777051401.496639:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95f659500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3677:1863365452619776:0@lo:400:kworker.0 00000100:00100000:0.0:1777051401.496681:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95f865180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3680:1863365452620160:0@lo:400:kworker.0 00000100:00100000:3.0:1777051401.496699:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051401.496722:0:10328:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452619136 00000100:00100000:2.0:1777051401.496731:0:10328:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452619136 00000100:00100000:0.0:1777051401.496765:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051401.496789:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5fbefb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3677:1863365452618880:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1777051401.496799:0:10328:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452619264 00000100:00100000:2.0:1777051401.496807:0:10328:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452619264 00000100:00100000:1.0:1777051401.496814:0:8492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452619776 00000100:00100000:1.0:1777051401.496825:0:8492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452619776 00000100:00100000:3.0:1777051401.496827:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94f518a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3677:1863365452618752:0@lo:400:kworker.0 00000100:00100000:2.0:1777051401.496868:0:10328:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452620160 00000100:00100000:2.0:1777051401.496878:0:10328:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452620160 00000100:00100000:1.0:1777051401.496899:0:8492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13340 00000100:00100000:0.0:1777051401.496905:0:8628:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452619520 00000100:00100000:0.0:1777051401.496916:0:8628:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452619520 00000100:00100000:1.0:1777051401.496917:0:8492:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d944d28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3679:x1863365452619008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051401.496959:0:27885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13341 00000100:00100000:3.0:1777051401.496982:0:27885:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5fbef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:lustre-MDT0001-lwp-OST0000_UUID+5:3680:x1863365452619136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777051401.496994:0:8628:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452619648 00000100:00100000:1.0:1777051401.497001:0:8492:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d944d28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3679:x1863365452619008:12345-0@lo:400:kworker.0 Request processed in 86us (678us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051401.497003:0:8628:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452619648 00000100:00100000:1.0:1777051401.497020:0:8492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13340 00000100:00100000:1.0:1777051401.497063:0:8492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13342 00000100:00100000:3.0:1777051401.497075:0:27885:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5fbef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:lustre-MDT0001-lwp-OST0000_UUID+5:3680:x1863365452619136:12345-0@lo:400:kworker.0 Request processed in 98us (601us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051401.497083:0:8628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10395 00000100:00100000:1.0:1777051401.497087:0:8492:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f867800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3677:x1863365452619264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051401.497101:0:27885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13341 00000100:00100000:0.0:1777051401.497109:0:8628:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d944d2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3679:x1863365452619520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051401.497141:0:27885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13343 00000100:00100000:3.0:1777051401.497156:0:27885:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f867100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000-lwp-MDT0000_UUID+5:3677:x1863365452619776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777051401.497509:0:8628:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d944d2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3679:x1863365452619520:12345-0@lo:400:kworker.0 Request processed in 405us (1022us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051401.497526:0:8628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10395 00000100:00100000:3.0:1777051401.497542:0:27885:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f867100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000-lwp-MDT0000_UUID+5:3677:x1863365452619776:12345-0@lo:400:kworker.0 Request processed in 385us (842us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051401.497556:0:27885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13343 00000100:00100000:0.0:1777051401.497563:0:8628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10396 00000100:00100000:0.0:1777051401.497582:0:8628:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5fbef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3680:x1863365452619648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051401.497592:0:27885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13344 00000100:00100000:3.0:1777051401.497607:0:27885:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5fbec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000-lwp-MDT0001_UUID+5:3680:x1863365452620160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777051401.497672:0:8628:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5fbef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3680:x1863365452619648:12345-0@lo:400:kworker.0 Request processed in 93us (1064us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051401.497680:0:27885:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5fbec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000-lwp-MDT0001_UUID+5:3680:x1863365452620160:12345-0@lo:400:kworker.0 Request processed in 73us (918us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051401.497706:0:8628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10396 00000100:00100000:1.0:1777051401.497708:0:8492:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f867800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3677:x1863365452619264:12345-0@lo:400:kworker.0 Request processed in 411us (906us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051401.497708:0:27885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13344 00000100:00100000:1.0:1777051401.497733:0:8492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13342 00000100:00100000:1.0:1777051401.498374:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051401.498450:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95f865180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3680:1863365452620160:0@lo:400:kworker.0 00000100:00080000:3.0:1777051401.498452:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1777051401.498466:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1777051401.498474:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1777051401.498482:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1777051401.498488:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94f51b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3680:1863365452619136:0@lo:400:kworker.0 00000100:00100000:0.0:1777051401.498538:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94f518380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3680:1863365452619648:0@lo:400:kworker.0 00000100:00100000:3.0:1777051401.498540:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051401.498541:0:10328:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452619392 00000100:00100000:1.0:1777051401.498547:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d951fa0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452619904:0@lo:400:kworker.0 00000100:00100000:2.0:1777051401.498554:0:10328:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452619392 00000100:00100000:3.0:1777051401.498625:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94f519c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3679:1863365452619008:0@lo:400:kworker.0 00000100:00100000:1.0:1777051401.498641:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051401.498655:0:10328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13345 00000100:00100000:0.0:1777051401.498662:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94f51aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3677:1863365452619264:0@lo:400:kworker.0 00000100:00100000:2.0:1777051401.498680:0:10328:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3678:x1863365452619392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051401.498968:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94f519180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452619520:0@lo:400:kworker.0 00000100:00100000:0.0:1777051401.498983:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95f659500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3677:1863365452619776:0@lo:400:kworker.0 00000100:00100000:1.0:1777051401.499033:0:8468:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452620032 00000100:00100000:1.0:1777051401.499043:0:8468:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452620032 00000100:00100000:2.0:1777051401.499099:0:10328:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3678:x1863365452619392:12345-0@lo:400:kworker.0 Request processed in 426us (722us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051401.499116:0:10328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13345 00000100:00100000:3.0:1777051401.499116:0:55805:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452619904 00000100:00100000:1.0:1777051401.499127:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10397 00000100:00100000:3.0:1777051401.499133:0:55805:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452619904 00000100:00100000:1.0:1777051401.499153:0:8468:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f864e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3679:x1863365452620032:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1777051401.499161:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1777051401.499170:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94f518e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3678:1863365452619392:0@lo:400:kworker.0 00000100:00080000:2.0:1777051401.499172:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1777051401.499181:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1777051401.499544:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10398 00000100:00100000:0.0:1777051401.499563:0:8471:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da444a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3678:x1863365452619904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777051401.499643:0:8471:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da444a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3678:x1863365452619904:12345-0@lo:400:kworker.0 Request processed in 86us (1012us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051401.499654:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10398 00000100:00100000:1.0:1777051401.499762:0:8468:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f864e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3679:x1863365452620032:12345-0@lo:400:kworker.0 Request processed in 615us (1227us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051401.499775:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10397 00000100:00100000:0.0:1777051401.500283:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d951fa1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452620032:0@lo:400:kworker.0 00000100:00100000:2.0:1777051401.500483:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d951fa0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452619904:0@lo:400:kworker.0 00000100:00100000:3.0:1777051401.546815:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051401.546934:0:46497:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425955200 00000100:00100000:1.0:1777051401.546946:0:46497:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425955200 00000100:00100000:1.0:1777051401.547507:0:46497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111991 00000100:00100000:1.0:1777051401.547525:0:46497:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f866a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:c11b6966-0775-44d2-bdc6-c74c26eb2226+22:135476:x1863365425955200:12345-192.168.201.46@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1777051401.547655:0:46497:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f866a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:c11b6966-0775-44d2-bdc6-c74c26eb2226+22:135476:x1863365425955200:12345-192.168.201.46@tcp:60:lhsmtool_posix.0 Request processed in 133us (850us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051401.547667:0:46497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111991 00000100:00080000:2.0:1777051401.547984:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1777051401.551529:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051401.551674:0:27882:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425955328 00000100:00100000:3.0:1777051401.551681:0:27882:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425955328 00000100:00080000:2.0:1777051401.552073:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1777051401.552167:0:27882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111992 00000100:00100000:3.0:1777051401.552184:0:27882:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95fae9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+8:135476:x1863365425955328:12345-192.168.201.46@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1777051401.552280:0:27882:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95fae9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+8:135476:x1863365425955328:12345-192.168.201.46@tcp:60:lhsmtool_posix.0 Request processed in 98us (753us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051401.552351:0:27882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111992 00000100:00100000:0.0:1777051401.555643:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051401.555749:0:6582:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425955584 00000100:00100000:2.0:1777051401.555759:0:6582:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425955584 00000100:00100000:2.0:1777051401.555850:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3347 00000100:00100000:2.0:1777051401.555865:0:6582:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5fbeed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+22:135476:x1863365425955584:12345-192.168.201.46@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1777051401.556114:0:6582:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5fbeed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+23:135476:x1863365425955584:12345-192.168.201.46@tcp:35:lhsmtool_posix.0 Request processed in 251us (474us total) trans 30064771132 rc 0/0 00000100:00100000:2.0:1777051401.556124:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3347 00000100:00100000:0.0:1777051402.006603:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da444a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452620288:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1777051402.006645:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95f865f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452620416:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1777051402.006747:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051402.007934:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051402.008274:0:10113:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452620288 00000100:00100000:3.0:1777051402.008290:0:10113:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452620288 00000100:00100000:3.0:1777051402.008414:0:10113:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452620416 00000100:00100000:3.0:1777051402.008423:0:10113:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452620416 00000100:00100000:0.0:1777051402.008462:0:8473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5638 00000100:00100000:0.0:1777051402.008489:0:8473:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5fbefb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3677:x1863365452620288:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1777051402.008493:0:10113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5639 00000100:00100000:3.0:1777051402.008515:0:10113:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7c9a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3678:x1863365452620416:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1777051402.008561:0:10113:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 445021760 pending 0 free 3645853696 avail 3414331392 00000100:00100000:3.0:1777051402.008648:0:10113:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7c9a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3678:x1863365452620416:12345-0@lo:13:osp-pre-1-1.0 Request processed in 138us (714us total) trans 0 rc 0/0 00002000:00000024:0.0:1777051402.008656:0:8473:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 455081536 pending 0 free 3862671360 avail 3631149056 00000100:00100000:3.0:1777051402.008667:0:10113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5639 00000100:00100000:0.0:1777051402.008747:0:8473:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5fbefb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3677:x1863365452620288:12345-0@lo:13:osp-pre-0-1.0 Request processed in 264us (1998us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051402.008771:0:8473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5638 00000100:00100000:2.0:1777051402.009564:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95f865f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452620416:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1777051402.009669:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da444a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452620288:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1777051402.326621:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1777051402.527442:0:103159:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771132 is committed 00000001:02000400:2.0:1777051403.080529:0:106562:0:(debug.c:645:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-hsm test 403: Copytool starts with inactive MDT and register on reconnect ========================================================== 13:23:21 (1777051401) 00010000:00010000:2.0:1777051403.351789:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1777051403.543558:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7c9a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452620544:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1777051403.543558:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da444a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3680:1863365452620672:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1777051403.544270:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051403.544418:0:47388:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452620672 00000100:00100000:1.0:1777051403.544433:0:47388:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452620672 00000100:00100000:1.0:1777051403.544585:0:47388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5640 00000100:00100000:1.0:1777051403.544626:0:47388:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f865500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3680:x1863365452620672:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1777051403.544693:0:47388:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 445021760 pending 0 free 3645853696 avail 3414331392 00000100:00080000:2.0:1777051403.544713:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1777051403.544829:0:47388:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f865500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3680:x1863365452620672:12345-0@lo:13:osp-pre-1-0.0 Request processed in 228us (559us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051403.544844:0:47388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5640 00000100:00100000:3.0:1777051403.544917:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da444a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3680:1863365452620672:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1777051403.545559:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051403.546433:0:10113:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452620544 00000100:00100000:3.0:1777051403.546442:0:10113:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452620544 00000100:00080000:2.0:1777051403.547413:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1777051403.547523:0:10113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5641 00000100:00100000:3.0:1777051403.547542:0:10113:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d951fa0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3679:x1863365452620544:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1777051403.547568:0:10113:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 455081536 pending 0 free 3862671360 avail 3631149056 00000100:00100000:3.0:1777051403.547666:0:10113:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d951fa0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3679:x1863365452620544:12345-0@lo:13:osp-pre-0-0.0 Request processed in 129us (2155us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051403.547679:0:10113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5641 00000100:00100000:1.0:1777051403.547829:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7c9a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452620544:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1777051403.702601:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051403.702816:0:21368:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425955712 00000100:00100000:3.0:1777051403.702833:0:21368:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425955712 00000100:00100000:3.0:1777051403.702961:0:21368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111993 00000100:00100000:3.0:1777051403.702980:0:21368:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da444a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+19:136179:x1863365425955712:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1777051403.703018:0:21368:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777051403.703090:0:21368:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6800/0x85f51a6b96715f05 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b62d7 expref: -99 pid: 21368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051403.703190:0:21368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7e00/0x85f51a6b96715f0c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1777051403.703284:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1777051403.703295:0:21368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7e00/0x85f51a6b96715f0c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051403.703318:0:21368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7e00/0x85f51a6b96715f0c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1777051403.703459:0:21368:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 12288 00000004:00200000:3.0:1777051403.703467:0:21368:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1777051403.703498:0:21368:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7e00/0x85f51a6b96715f0c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051403.703541:0:21368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6800/0x85f51a6b96715f05 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b62d7 expref: 21 pid: 21368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051403.703572:0:21368:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7e00/0x85f51a6b96715f0c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b62d7 expref: 20 pid: 21368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051403.703588:0:21368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d9533ab000) 00010000:00010000:3.0:1777051403.703591:0:21368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1777051403.703596:0:21368:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d941ad7e00, rc 0) 00000100:00100000:3.0:1777051403.703680:0:21368:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da444a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+20:136179:x1863365425955712:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 Request processed in 704us (1090us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051403.703694:0:21368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111993 00000100:00100000:1.0:1777051403.713461:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051403.713719:0:27885:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425955968 00000100:00100000:0.0:1777051403.713730:0:27885:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425955968 00000100:00100000:0.0:1777051403.713800:0:27885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111994 00000100:00100000:0.0:1777051403.713817:0:27885:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da444a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c11b6966-0775-44d2-bdc6-c74c26eb2226+20:136180:x1863365425955968:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1777051403.714230:0:27885:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051403.714331:0:27885:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b200/0x85f51a6b96715f13 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b62de expref: -99 pid: 27885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051403.714488:0:27885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2ac00/0x85f51a6b96715f1a lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051403.714511:0:27885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2ac00/0x85f51a6b96715f1a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051403.714529:0:27885:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2ac00/0x85f51a6b96715f1a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051403.714556:0:27885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2a200/0x85f51a6b96715f21 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051403.714571:0:27885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2a200/0x85f51a6b96715f21 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051403.714585:0:27885:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2a200/0x85f51a6b96715f21 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051403.715069:0:27885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2be00/0x85f51a6b96715f28 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051403.715089:0:27885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2be00/0x85f51a6b96715f28 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051403.715105:0:27885:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2be00/0x85f51a6b96715f28 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1777051403.715440:0:27885:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:0.0:1777051403.715578:0:27885:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2ac00/0x85f51a6b96715f1a lrc: 4/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051403.715593:0:27885:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2ac00/0x85f51a6b96715f1a lrc: 4/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051403.715607:0:27885:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2ac00/0x85f51a6b96715f1a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051403.715623:0:27885:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2ac00/0x85f51a6b96715f1a lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051403.715635:0:27885:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94eb2ac00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:0.0:1777051403.715641:0:27885:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2ac00/0x85f51a6b96715f1a lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051403.715654:0:27885:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2ac00/0x85f51a6b96715f1a lrc: 5/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051403.715674:0:27885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff99d94e5e2500) 00010000:00010000:0.0:1777051403.715680:0:27885:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777051403.715688:0:27885:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2ac00/0x85f51a6b96715f1a lrc: 3/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051403.715700:0:27885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2ac00/0x85f51a6b96715f1a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051403.715721:0:27885:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2a200/0x85f51a6b96715f21 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051403.715734:0:27885:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2a200/0x85f51a6b96715f21 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051403.715744:0:27885:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2a200/0x85f51a6b96715f21 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051403.715754:0:27885:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94eb2a200 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:0.0:1777051403.715760:0:27885:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2a200/0x85f51a6b96715f21 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051403.715772:0:27885:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2a200/0x85f51a6b96715f21 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051403.715787:0:27885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff99d94e81ce00) 00010000:00010000:0.0:1777051403.715793:0:27885:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777051403.715799:0:27885:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2a200/0x85f51a6b96715f21 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051403.715810:0:27885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2a200/0x85f51a6b96715f21 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051403.716296:0:27885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b200/0x85f51a6b96715f13 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b62de expref: 23 pid: 27885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051403.716336:0:27885:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2be00/0x85f51a6b96715f28 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b62de expref: 22 pid: 27885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051403.716387:0:27885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99d941e2ea00) 00010000:00010000:0.0:1777051403.716394:0:27885:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777051403.716401:0:27885:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d94eb2be00, rc 0) 00000100:00100000:0.0:1777051403.716480:0:27885:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da444a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c11b6966-0775-44d2-bdc6-c74c26eb2226+22:136180:x1863365425955968:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 Request processed in 2665us (3027us total) trans 30064771133 rc 0/0 00000100:00100000:0.0:1777051403.716495:0:27885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111994 00000100:00100000:0.0:1777051403.725869:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051403.726017:0:9550:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425956096 00000100:00100000:1.0:1777051403.726028:0:9550:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425956096 00000100:00100000:1.0:1777051403.726183:0:9550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13689 00000100:00100000:1.0:1777051403.726200:0:9550:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d951fa1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+22:2436:x1863365425956096:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1777051403.726244:0:9550:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1777051403.726322:0:9550:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2be00/0x85f51a6b96715f28 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b62de expref: 22 pid: 27885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051403.726381:0:9550:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99d941e2ea00) 00010000:00010000:1.0:1777051403.726390:0:9550:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1777051403.726464:0:9550:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d951fa1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+21:2436:x1863365425956096:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 267us (613us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051403.726477:0:9550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13689 00000100:00100000:3.0:1777051403.727649:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051403.727991:0:10328:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425956224 00000100:00100000:2.0:1777051403.728002:0:10328:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425956224 00000100:00100000:2.0:1777051403.728078:0:10328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111995 00000100:00100000:2.0:1777051403.728095:0:10328:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f864000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+21:136180:x1863365425956224:12345-192.168.201.46@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1777051403.728550:0:10328:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f864000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+21:136180:x1863365425956224:12345-192.168.201.46@tcp:59:lhsmtool_posix.0 Request processed in 457us (903us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051403.728565:0:10328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111995 00000100:00100000:0.0:1777051404.198617:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051404.202518:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051404.202692:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051404.202759:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051404.202807:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051404.202867:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051404.202914:0:8628:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425956736 00000100:00100000:0.0:1777051404.202928:0:8628:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425956736 00000100:00100000:0.0:1777051404.203079:0:8628:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425956864 00000100:00100000:0.0:1777051404.203086:0:8628:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425956864 00000100:00100000:0.0:1777051404.203130:0:8628:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425957120 00000100:00100000:0.0:1777051404.203136:0:8628:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425957120 00000100:00100000:0.0:1777051404.203260:0:8628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10399 00000100:00100000:0.0:1777051404.203284:0:8628:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f659500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+51:2437:x1863365425956736:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:0.0:1777051404.203448:0:8628:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f659500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+51:2437:x1863365425956736:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 167us (927us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051404.203461:0:46497:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425956992 00000100:00100000:0.0:1777051404.203473:0:8628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10399 00000100:00100000:1.0:1777051404.203500:0:46497:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425956992 00000100:00100000:0.0:1777051404.203517:0:8628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10400 00000100:00100000:0.0:1777051404.203541:0:8628:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f16a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+48:2437:x1863365425956864:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:0.0:1777051404.203597:0:8628:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f16a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+48:2437:x1863365425956864:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 63us (789us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051404.203597:0:46497:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425956608 00000100:00100000:1.0:1777051404.203610:0:46497:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425956608 00000100:00100000:0.0:1777051404.203623:0:8628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10400 00000100:00100000:0.0:1777051404.203659:0:8628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10401 00000100:00100000:0.0:1777051404.203679:0:8628:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f169880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+51:2436:x1863365425957120:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:1.0:1777051404.203680:0:46497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13346 00000100:00100000:1.0:1777051404.203710:0:46497:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f16bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+25:2437:x1863365425956992:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:0.0:1777051404.203743:0:8628:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f169880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+51:2436:x1863365425957120:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 68us (872us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051404.203756:0:8628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10401 00000100:00100000:1.0:1777051404.203804:0:46497:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f16bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+25:2437:x1863365425956992:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 97us (1112us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051404.203833:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13347 00000100:00080000:2.0:1777051404.203946:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1777051404.203955:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1777051404.203959:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1777051404.204768:0:6580:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f168700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+21:2437:x1863365425956608:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:0.0:1777051404.204873:0:6580:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f168700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+21:2437:x1863365425956608:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 119us (2111us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051404.205819:0:46497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13346 00000100:00100000:0.0:1777051404.206057:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13347 00000100:00100000:3.0:1777051404.206661:0:103168:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425956480 00000100:00100000:3.0:1777051404.206672:0:103168:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425956480 00000100:00100000:3.0:1777051404.206786:0:103168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 169 00000100:00100000:3.0:1777051404.206804:0:103168:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94ba5c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:29c4352d-3260-4734-909d-9ea5de9e7fa4+12:2437:x1863365425956480:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:3.0:1777051404.207579:0:103168:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94ba5c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:29c4352d-3260-4734-909d-9ea5de9e7fa4+12:2437:x1863365425956480:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 775us (8976us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051404.207597:0:103168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 169 00000100:00100000:0.0:1777051404.210461:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051404.210620:0:8470:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425957248 00000100:00100000:1.0:1777051404.210658:0:8470:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425957248 00000100:00100000:1.0:1777051404.210775:0:8470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10402 00000100:00100000:1.0:1777051404.210793:0:8470:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f16ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+47:2437:x1863365425957248:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:1.0:1777051404.210864:0:8470:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f16ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+47:2437:x1863365425957248:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 75us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051404.210879:0:8470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10402 00000100:00080000:3.0:1777051404.212291:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000040:00080000:3.0:1777051404.246546:0:103189:0:(llog.c:801:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:3.0:1777051404.246561:0:103189:0:(llog_cat.c:158:llog_cat_process_common()) processing log [0x1:0x2b:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1777051404.246595:0:103189:0:(llog.c:858:llog_process_thread()) stop processing plain [0x1:0x2b:0x0] index 4 count 4 00000040:00080000:3.0:1777051404.246609:0:103189:0:(llog.c:858:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00010000:00010000:0.0:1777051404.374858:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777051405.398528:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1777051406.104577:0:3678:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1777051406.104613:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95f867480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452620800:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1777051406.104764:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051406.107444:0:11727:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452620800 00000100:00100000:0.0:1777051406.107459:0:11727:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452620800 00000100:00100000:0.0:1777051406.107550:0:11727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8157 00000100:00100000:0.0:1777051406.107567:0:11727:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7c9a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3678:x1863365452620800:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1777051406.107623:0:11727:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4194304 pending 0 free 1441579008 avail 1295339520 00000100:00100000:0.0:1777051406.107725:0:11727:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7c9a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3678:x1863365452620800:12345-0@lo:41:osp-pre-0-1.0 Request processed in 159us (2959us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051406.107739:0:11727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8157 00000100:00100000:3.0:1777051406.107825:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95f867480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452620800:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1777051406.242699:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051406.242786:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051406.242856:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051406.242930:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051406.242992:0:6581:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425957888 00000100:00100000:1.0:1777051406.243009:0:6581:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425957888 00000100:00100000:2.0:1777051406.243063:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051406.243091:0:55805:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425957632 00000100:00100000:3.0:1777051406.243104:0:55805:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425957632 00000100:00100000:1.0:1777051406.243123:0:6581:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425957504 00000100:00100000:1.0:1777051406.243134:0:6581:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425957504 00000100:00080000:2.0:1777051406.243148:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1777051406.243162:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1777051406.243190:0:55805:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425958144 00000100:00100000:3.0:1777051406.243247:0:55805:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425958144 00000100:00100000:1.0:1777051406.243270:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13348 00000100:00100000:1.0:1777051406.243296:0:6581:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7c9a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+25:2436:x1863365425957888:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:3.0:1777051406.243334:0:55805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10403 00000100:00100000:3.0:1777051406.243369:0:55805:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7c9a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c11b6966-0775-44d2-bdc6-c74c26eb2226+51:2436:x1863365425957632:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:0.0:1777051406.243396:0:103163:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425957376 00000100:00100000:0.0:1777051406.243407:0:103163:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425957376 00000100:00100000:1.0:1777051406.243471:0:6581:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7c9a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+25:2436:x1863365425957888:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 179us (609us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051406.243492:0:103163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 170 00000100:00100000:3.0:1777051406.243509:0:55805:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7c9a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c11b6966-0775-44d2-bdc6-c74c26eb2226+51:2436:x1863365425957632:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 114us (680us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051406.243528:0:103163:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94ba5c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29c4352d-3260-4734-909d-9ea5de9e7fa4+12:2436:x1863365425957376:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:3.0:1777051406.243537:0:55805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10403 00000100:00100000:3.0:1777051406.243583:0:55805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10404 00000100:00100000:3.0:1777051406.243601:0:55805:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+47:2436:x1863365425958144:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:0.0:1777051406.243609:0:103163:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94ba5c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29c4352d-3260-4734-909d-9ea5de9e7fa4+12:2436:x1863365425957376:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 86us (919us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051406.243627:0:103163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 170 00000100:00100000:3.0:1777051406.243667:0:55805:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+47:2436:x1863365425958144:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 68us (733us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051406.243925:0:55805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10404 00000100:00080000:3.0:1777051406.243974:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1777051406.243976:0:21368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13349 00000100:00100000:2.0:1777051406.244003:0:21368:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d944071f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+21:2436:x1863365425957504:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:2.0:1777051406.244076:0:21368:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d944071f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+21:2436:x1863365425957504:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 81us (1015us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051406.244093:0:21368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13349 00000100:00100000:3.0:1777051406.246531:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051406.246591:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051406.246683:0:27884:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425957760 00000100:00100000:2.0:1777051406.246694:0:27884:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425957760 00000100:00100000:0.0:1777051406.246739:0:8471:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425958016 00000100:00100000:0.0:1777051406.246748:0:8471:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425958016 00000100:00100000:1.0:1777051406.246859:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13348 00000100:00100000:2.0:1777051406.246911:0:27884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10405 00000100:00100000:2.0:1777051406.246929:0:27884:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f867480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+48:2436:x1863365425957760:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:2.0:1777051406.247016:0:27884:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f867480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+48:2436:x1863365425957760:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 90us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051406.247031:0:27884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10405 00000100:00100000:0.0:1777051406.247072:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10406 00000100:00100000:0.0:1777051406.247092:0:8471:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f864a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+51:2436:x1863365425958016:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:0.0:1777051406.247152:0:8471:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f864a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+51:2436:x1863365425958016:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 67us (559us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051406.247166:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10406 00000100:00080000:3.0:1777051406.247193:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1777051406.247203:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1777051406.423509:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777051406.614455:0:3677:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1777051406.614512:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95f866d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3677:1863365452620928:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1777051406.614606:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051406.614731:0:46500:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452620928 00000100:00100000:1.0:1777051406.614744:0:46500:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452620928 00000100:00100000:1.0:1777051406.614828:0:46500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8158 00000100:00100000:1.0:1777051406.614847:0:46500:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f864380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+6:3677:x1863365452620928:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1777051406.614898:0:46500:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4194304 pending 0 free 1446154240 avail 1299914752 00000100:00100000:3.0:1777051406.615005:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d944072300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3679:1863365452621056:0@lo:400:kworker.0 00000100:00100000:1.0:1777051406.615025:0:46500:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f864380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+6:3677:x1863365452620928:12345-0@lo:41:osp-pre-1-0.0 Request processed in 179us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051406.615044:0:46500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8158 00000100:00100000:1.0:1777051406.615095:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d944071180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3678:1863365452621440:0@lo:400:kworker.0 00000100:00100000:3.0:1777051406.615098:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051406.615190:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051406.615195:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d944070e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3679:1863365452621568:0@lo:400:kworker.0 00000100:00100000:2.0:1777051406.615261:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d944070000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3680:1863365452621184:0@lo:400:kworker.0 00000100:00100000:1.0:1777051406.615326:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95fbaf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3678:1863365452621952:0@lo:400:kworker.0 00000100:00100000:3.0:1777051406.615339:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051406.615387:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95fbace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452622080:0@lo:400:kworker.0 00000100:00100000:2.0:1777051406.615399:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051406.615426:0:6579:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452621440 00000100:00100000:1.0:1777051406.615434:0:6579:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452621440 00000100:00100000:3.0:1777051406.615455:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051406.615465:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95fbad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3680:1863365452621696:0@lo:400:kworker.0 00000100:00100000:1.0:1777051406.615519:0:6579:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452621568 00000100:00100000:1.0:1777051406.615526:0:6579:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452621568 00000100:00100000:3.0:1777051406.615532:0:103165:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452621056 00000100:00100000:3.0:1777051406.615541:0:103165:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452621056 00000100:00100000:2.0:1777051406.615556:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051406.615581:0:6579:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452621184 00000100:00100000:1.0:1777051406.615590:0:6579:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452621184 00000100:00100000:2.0:1777051406.615609:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95fbadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3680:1863365452622208:0@lo:400:kworker.0 00000100:00100000:3.0:1777051406.615634:0:103165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1777051406.615654:0:103165:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94ba5d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9351a01-5b0e-4470-97fd-58b9b4b312a2+23:3679:x1863365452621056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777051406.615660:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13350 00000100:00100000:2.0:1777051406.615672:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051406.615686:0:6579:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da444a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3678:x1863365452621440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051406.616025:0:103165:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94ba5d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9351a01-5b0e-4470-97fd-58b9b4b312a2+23:3679:x1863365452621056:12345-0@lo:400:kworker.0 Request processed in 375us (929us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051406.616032:0:10328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13351 00000100:00100000:1.0:1777051406.616040:0:6579:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da444a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3678:x1863365452621440:12345-0@lo:400:kworker.0 Request processed in 355us (865us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051406.616052:0:103165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1777051406.616062:0:10328:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f867b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3679:x1863365452621568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777051406.616068:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13350 00000100:00100000:1.0:1777051406.616114:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13352 00000100:00100000:3.0:1777051406.616122:0:8468:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452622080 00000100:00100000:3.0:1777051406.616131:0:8468:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452622080 00000100:00100000:1.0:1777051406.616134:0:6579:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da45f77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3680:x1863365452621184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777051406.616152:0:10328:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f867b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3679:x1863365452621568:12345-0@lo:400:kworker.0 Request processed in 99us (817us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051406.616167:0:10328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13351 00000100:00100000:3.0:1777051406.616232:0:8468:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452621696 00000100:00100000:3.0:1777051406.616239:0:8468:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452621696 00000100:00100000:1.0:1777051406.616270:0:6579:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da45f77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3680:x1863365452621184:12345-0@lo:400:kworker.0 Request processed in 140us (876us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051406.616273:0:55805:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452622208 00000100:00100000:2.0:1777051406.616285:0:55805:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452622208 00000100:00100000:1.0:1777051406.616320:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13352 00000100:00080000:1.0:1777051406.616369:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1777051406.616377:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1777051406.616385:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1777051406.616390:0:55805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10407 00000100:00080000:1.0:1777051406.616394:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1777051406.616405:0:55805:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f865f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3679:x1863365452622080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777051406.616451:0:24468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10408 00000100:00100000:2.0:1777051406.616468:0:55805:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f865f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3679:x1863365452622080:12345-0@lo:400:kworker.0 Request processed in 65us (1014us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051406.616473:0:24468:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da45f76d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3680:x1863365452621696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777051406.616494:0:55805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10407 00000100:00100000:2.0:1777051406.616531:0:55805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10409 00000100:00100000:2.0:1777051406.616551:0:55805:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d9600bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3680:x1863365452622208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777051406.616566:0:24468:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da45f76d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3680:x1863365452621696:12345-0@lo:400:kworker.0 Request processed in 100us (1010us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051406.616579:0:24468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10408 00000100:00100000:2.0:1777051406.616627:0:55805:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d9600bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3680:x1863365452622208:12345-0@lo:400:kworker.0 Request processed in 79us (960us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051406.616635:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d944072d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3677:1863365452621312:0@lo:400:kworker.0 00000100:00100000:2.0:1777051406.616647:0:55805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10409 00000100:00100000:1.0:1777051406.616699:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051406.616752:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95fbaca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3677:1863365452621824:0@lo:400:kworker.0 00000100:00100000:2.0:1777051406.616766:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d944070e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3679:1863365452621568:0@lo:400:kworker.0 00000100:00100000:2.0:1777051406.616797:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95fbace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452622080:0@lo:400:kworker.0 00000100:00100000:1.0:1777051406.616805:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051406.616837:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d944072300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3679:1863365452621056:0@lo:400:kworker.0 00000100:00100000:1.0:1777051406.616859:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da45f76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3677:1863365452622336:0@lo:400:kworker.0 00000100:00100000:3.0:1777051406.616901:0:8468:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452621824 00000100:00100000:3.0:1777051406.616911:0:8468:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452621824 00000100:00100000:1.0:1777051406.616912:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1777051406.616977:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1777051406.616997:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95f866d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3677:1863365452620928:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1777051406.617008:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10410 00000100:00100000:3.0:1777051406.617028:0:8468:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da444a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3677:x1863365452621824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777051406.617071:0:21368:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452621312 00000100:00100000:1.0:1777051406.617079:0:21368:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452621312 00000100:00100000:3.0:1777051406.617103:0:8468:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da444a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3677:x1863365452621824:12345-0@lo:400:kworker.0 Request processed in 80us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051406.617115:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10410 00000100:00100000:1.0:1777051406.617462:0:21368:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452622336 00000100:00100000:1.0:1777051406.617470:0:21368:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452622336 00000100:00100000:0.0:1777051406.617485:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051406.617494:0:8492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13353 00000100:00100000:3.0:1777051406.617513:0:8492:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da444a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3677:x1863365452621312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777051406.617556:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d944071180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3678:1863365452621440:0@lo:400:kworker.0 00000100:00100000:3.0:1777051406.617876:0:8492:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da444a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3677:x1863365452621312:12345-0@lo:400:kworker.0 Request processed in 365us (1177us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051406.617887:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d944070000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3680:1863365452621184:0@lo:400:kworker.0 00000100:00100000:3.0:1777051406.617896:0:8492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13353 00000100:00100000:0.0:1777051406.617921:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95fbad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3680:1863365452621696:0@lo:400:kworker.0 00000100:00100000:3.0:1777051406.617930:0:8492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452621952 00000100:00100000:3.0:1777051406.617939:0:8492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452621952 00000100:00100000:0.0:1777051406.617949:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95fbadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3680:1863365452622208:0@lo:400:kworker.0 00000100:00100000:0.0:1777051406.618033:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d944072d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3677:1863365452621312:0@lo:400:kworker.0 00000100:00100000:0.0:1777051406.618059:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95fbaca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3677:1863365452621824:0@lo:400:kworker.0 00000100:00100000:1.0:1777051406.618069:0:21368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13354 00000100:00100000:3.0:1777051406.618084:0:8492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13355 00000100:00100000:1.0:1777051406.618092:0:21368:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da444a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3677:x1863365452622336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051406.618109:0:8492:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f169500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3678:x1863365452621952:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1777051406.618474:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1777051406.618479:0:8492:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f169500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3678:x1863365452621952:12345-0@lo:400:kworker.0 Request processed in 375us (996us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051406.618493:0:8492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13355 00000100:00100000:0.0:1777051406.618553:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95fbaf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3678:1863365452621952:0@lo:400:kworker.0 00000100:00100000:1.0:1777051406.618559:0:21368:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da444a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3677:x1863365452622336:12345-0@lo:400:kworker.0 Request processed in 472us (1645us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051406.618577:0:21368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13354 00000100:00100000:0.0:1777051406.618642:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da45f76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3677:1863365452622336:0@lo:400:kworker.0 00000100:00100000:3.0:1777051407.126726:0:3680:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1777051407.126738:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da444a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452622464:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1777051407.126759:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95f865180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3680:1863365452622592:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1777051407.126861:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051407.127139:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051407.127318:0:8472:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452622592 00000100:00100000:2.0:1777051407.127335:0:8472:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452622592 00000100:00100000:3.0:1777051407.127360:0:47388:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452622464 00000100:00100000:3.0:1777051407.127369:0:47388:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452622464 00000100:00100000:2.0:1777051407.127453:0:8472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5642 00000100:00100000:2.0:1777051407.127475:0:8472:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f866d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3680:x1863365452622592:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1777051407.127475:0:47388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5643 00000100:00100000:3.0:1777051407.127502:0:47388:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da444a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3678:x1863365452622464:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1777051407.127543:0:47388:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 455081536 pending 0 free 3862671360 avail 3631149056 00002000:00000024:2.0:1777051407.127560:0:8472:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 445021760 pending 0 free 3645853696 avail 3414331392 00000100:00100000:3.0:1777051407.127629:0:47388:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da444a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3678:x1863365452622464:12345-0@lo:13:osp-pre-0-1.0 Request processed in 131us (489us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051407.127642:0:47388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5643 00000100:00100000:2.0:1777051407.127648:0:8472:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f866d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3680:x1863365452622592:12345-0@lo:13:osp-pre-1-1.0 Request processed in 178us (786us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051407.127664:0:8472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5642 00000100:00100000:0.0:1777051407.127702:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da444a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452622464:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1777051407.128016:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95f865180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3680:1863365452622592:0@lo:13:osp-pre-1-1.0 00000001:02000400:2.0:1777051407.148282:0:106658:0:(debug.c:645:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg146-client.virtnet: executing pgrep --pidfile=/var/run/lhsmtool_posix.pid --list-full hsmtool 00000040:00080000:2.0:1777051407.318573:0:103189:0:(llog.c:801:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:2.0:1777051407.318584:0:103189:0:(llog_cat.c:158:llog_cat_process_common()) processing log [0x1:0x2b:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1777051407.318620:0:103189:0:(llog.c:858:llog_process_thread()) stop processing plain [0x1:0x2b:0x0] index 4 count 4 00000040:00080000:2.0:1777051407.318631:0:103189:0:(llog.c:858:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00010000:00010000:3.0:1777051407.450811:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777051408.470446:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1777051408.662403:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95f865180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3680:1863365452622720:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1777051408.662485:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051408.662583:0:8473:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452622720 00000100:00100000:3.0:1777051408.662593:0:8473:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452622720 00000100:00100000:3.0:1777051408.662656:0:8473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5644 00000100:00100000:3.0:1777051408.662672:0:8473:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f168e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3680:x1863365452622720:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1777051408.662702:0:8473:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 445021760 pending 0 free 3645853696 avail 3414331392 00000100:00100000:2.0:1777051408.662728:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d9600b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3677:1863365452622848:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1777051408.662777:0:8473:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f168e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3680:x1863365452622720:12345-0@lo:13:osp-pre-1-0.0 Request processed in 108us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051408.662791:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051408.662791:0:8473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5644 00000100:00100000:3.0:1777051408.662822:0:8473:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452622848 00000100:00100000:3.0:1777051408.662829:0:8473:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452622848 00000100:00100000:3.0:1777051408.662879:0:8473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5645 00000100:00100000:3.0:1777051408.662892:0:8473:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d9600b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3677:x1863365452622848:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1777051408.662912:0:8473:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 455081536 pending 0 free 3862671360 avail 3631149056 00000100:00100000:3.0:1777051408.662981:0:8473:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d9600b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3677:x1863365452622848:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (194us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051408.662992:0:8473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5645 00000100:00100000:2.0:1777051408.663326:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d9600b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3677:1863365452622848:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1777051408.664343:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1777051408.664350:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1777051408.664399:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95f865180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3680:1863365452622720:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1777051409.495305:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1777051409.691405:0:103159:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771133 is committed 00000001:02000400:0.0:1777051410.515969:0:106755:0:(debug.c:645:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg146-client.virtnet: executing get_client_uuid /mnt/lustre2 00010000:00010000:0.0:1777051410.527370:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1777051411.223641:0:3677:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1777051411.223747:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95f865180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452622976:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1777051411.223841:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051411.223946:0:6584:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452622976 00000100:00100000:3.0:1777051411.223959:0:6584:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452622976 00000100:00100000:3.0:1777051411.224299:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8159 00000100:00100000:3.0:1777051411.224319:0:6584:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d9600b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3677:x1863365452622976:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1777051411.224367:0:6584:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4194304 pending 0 free 1441579008 avail 1295339520 00000100:00100000:3.0:1777051411.224483:0:6584:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d9600b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3677:x1863365452622976:12345-0@lo:41:osp-pre-0-1.0 Request processed in 168us (641us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051411.224497:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8159 00000100:00100000:2.0:1777051411.224572:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95f865180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452622976:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1777051411.363639:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051411.363715:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051411.363743:0:103166:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425958272 00000100:00100000:3.0:1777051411.363760:0:103166:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425958272 00000100:00100000:1.0:1777051411.363770:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051411.363818:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051411.363838:0:103166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 172 00000100:00100000:3.0:1777051411.363854:0:103166:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94ba5d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29c4352d-3260-4734-909d-9ea5de9e7fa4+12:2437:x1863365425958272:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:1.0:1777051411.363871:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051411.363945:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051411.363998:0:103166:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94ba5d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29c4352d-3260-4734-909d-9ea5de9e7fa4+12:2437:x1863365425958272:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 145us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051411.364014:0:103166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 172 00000100:00100000:0.0:1777051411.364179:0:6579:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425958400 00000100:00100000:0.0:1777051411.364189:0:6579:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425958400 00000100:00100000:0.0:1777051411.364335:0:6579:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425958784 00000100:00100000:0.0:1777051411.364342:0:6579:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425958784 00000100:00100000:0.0:1777051411.364399:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13356 00000100:00100000:3.0:1777051411.364415:0:27882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13357 00000100:00100000:0.0:1777051411.364420:0:6579:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da444a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+20:2436:x1863365425958400:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:3.0:1777051411.364440:0:27882:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da444a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+25:2437:x1863365425958784:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:0.0:1777051411.364492:0:6579:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da444a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+20:2436:x1863365425958400:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 78us (776us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051411.364511:0:27882:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da444a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+25:2437:x1863365425958784:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 76us (636us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051411.364523:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13356 00000100:00100000:3.0:1777051411.364537:0:27882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13357 00000100:00080000:0.0:1777051411.364574:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1777051411.364600:0:24468:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425958528 00000100:00100000:3.0:1777051411.364608:0:24468:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425958528 00000100:00100000:0.0:1777051411.364645:0:55805:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425958656 00000100:00100000:0.0:1777051411.364654:0:55805:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425958656 00000100:00100000:2.0:1777051411.364913:0:8471:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425959040 00000100:00100000:2.0:1777051411.364922:0:8471:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425959040 00000100:00100000:3.0:1777051411.364926:0:24468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10411 00000100:00100000:3.0:1777051411.364950:0:24468:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da444a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+51:2437:x1863365425958528:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:0.0:1777051411.364952:0:55805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10412 00000100:00100000:0.0:1777051411.364977:0:55805:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da444a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c11b6966-0775-44d2-bdc6-c74c26eb2226+48:2436:x1863365425958656:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:2.0:1777051411.365005:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10413 00000100:00100000:2.0:1777051411.365025:0:8471:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da444a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+47:2437:x1863365425959040:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:3.0:1777051411.365037:0:24468:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da444a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+51:2437:x1863365425958528:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 91us (1262us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051411.365048:0:55805:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da444a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c11b6966-0775-44d2-bdc6-c74c26eb2226+48:2436:x1863365425958656:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 75us (1225us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051411.365062:0:24468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10411 00000100:00100000:0.0:1777051411.365381:0:55805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10412 00000100:00100000:2.0:1777051411.365401:0:8471:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da444a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+47:2437:x1863365425959040:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 377us (1451us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051411.365418:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10413 00000100:00080000:3.0:1777051411.365418:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1777051411.365430:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1777051411.368385:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051411.368454:0:8470:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425958912 00000100:00100000:2.0:1777051411.368463:0:8470:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425958912 00000100:00100000:2.0:1777051411.368555:0:8470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10414 00000100:00100000:2.0:1777051411.368565:0:8470:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da45f76a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+51:2436:x1863365425958912:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:2.0:1777051411.368624:0:8470:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da45f76a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+51:2436:x1863365425958912:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 61us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051411.368632:0:8470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10414 00000100:00080000:0.0:1777051411.369273:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1777051411.543578:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1777051411.606455:0:104226:0:(llog.c:801:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1777051411.606462:0:104226:0:(llog_cat.c:158:llog_cat_process_common()) processing log [0x1:0x12:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1777051411.606486:0:104226:0:(llog.c:858:llog_process_thread()) stop processing plain [0x1:0x12:0x0] index 3 count 3 00000040:00080000:3.0:1777051411.606494:0:104226:0:(llog.c:858:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1777051411.734778:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da444a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3679:1863365452623104:0@lo:400:kworker.0 00000100:00100000:0.0:1777051411.734879:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95f865180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3680:1863365452623232:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1777051411.734919:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d9533bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3677:1863365452623360:0@lo:400:kworker.0 00000100:00100000:1.0:1777051411.735189:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d9533bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3678:1863365452623488:0@lo:400:kworker.0 00000100:00100000:0.0:1777051411.735588:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051411.735600:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051411.735620:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051411.735719:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d9533bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3680:1863365452623744:0@lo:400:kworker.0 00000100:00100000:1.0:1777051411.736061:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051411.736109:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da4384e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3678:1863365452624000:0@lo:400:kworker.0 00000100:00100000:1.0:1777051411.736174:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051411.736249:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da4384f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3677:1863365452623872:0@lo:400:kworker.0 00000100:00100000:1.0:1777051411.736254:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da4384ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452624512:0@lo:400:kworker.0 00000100:00100000:0.0:1777051411.736274:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051411.736356:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d9533bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3679:1863365452623616:0@lo:400:kworker.0 00000100:00100000:0.0:1777051411.737193:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da4384d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3680:1863365452624256:0@lo:400:kworker.0 00000100:00100000:2.0:1777051411.738310:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051411.738352:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da4384fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452624128:0@lo:400:kworker.0 00000100:00100000:3.0:1777051411.738403:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051411.738424:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051411.738466:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da4384df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452624384:0@lo:400:kworker.0 00000100:00100000:2.0:1777051411.738483:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da4384ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3679:1863365452624640:0@lo:400:kworker.0 00000100:00100000:3.0:1777051411.738569:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051411.738582:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051411.738656:0:27887:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452624000 00000100:00100000:3.0:1777051411.738667:0:27887:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452624000 00000100:00100000:2.0:1777051411.738688:0:103169:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452623104 00000100:00100000:2.0:1777051411.738713:0:103169:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452623104 00000100:00100000:3.0:1777051411.738737:0:27887:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452624128 00000100:00100000:3.0:1777051411.738743:0:27887:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452624128 00000100:00100000:3.0:1777051411.738798:0:27887:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452624384 00000100:00100000:3.0:1777051411.738805:0:27887:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452624384 00000100:00100000:2.0:1777051411.738810:0:103169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1777051411.738828:0:103169:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94ba5ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f9351a01-5b0e-4470-97fd-58b9b4b312a2+23:3679:x1863365452623104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051411.738865:0:27887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10415 00000100:00100000:3.0:1777051411.738886:0:27887:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d944e10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3678:x1863365452624000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777051411.738924:0:103169:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94ba5ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f9351a01-5b0e-4470-97fd-58b9b4b312a2+23:3679:x1863365452623104:12345-0@lo:400:kworker.0 Request processed in 97us (3303us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051411.738941:0:103169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1777051411.738978:0:27887:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d944e10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3678:x1863365452624000:12345-0@lo:400:kworker.0 Request processed in 96us (2801us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051411.738994:0:27887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10415 00000100:00100000:2.0:1777051411.739030:0:24468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10416 00000100:00100000:3.0:1777051411.739044:0:27887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10417 00000100:00100000:2.0:1777051411.739055:0:24468:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95fbaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3679:x1863365452624128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051411.739070:0:27887:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f519180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3677:x1863365452624384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777051411.739147:0:24468:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95fbaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3679:x1863365452624128:12345-0@lo:400:kworker.0 Request processed in 98us (722us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051411.739162:0:24468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10416 00000100:00100000:3.0:1777051411.739522:0:27887:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f519180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3677:x1863365452624384:12345-0@lo:400:kworker.0 Request processed in 457us (953us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051411.739538:0:27887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10417 00000100:00100000:2.0:1777051411.739574:0:8492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452623360 00000100:00100000:2.0:1777051411.739586:0:8492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452623360 00000100:00100000:1.0:1777051411.739608:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051411.739623:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051411.739636:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da4384df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452624384:0@lo:400:kworker.0 00000100:00100000:2.0:1777051411.739687:0:8492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452623488 00000100:00100000:2.0:1777051411.739695:0:8492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452623488 00000100:00100000:3.0:1777051411.739735:0:8471:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452624512 00000100:00100000:3.0:1777051411.739744:0:8471:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452624512 00000100:00100000:1.0:1777051411.739746:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da4384e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3678:1863365452624000:0@lo:400:kworker.0 00000100:00100000:2.0:1777051411.739749:0:8492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452623744 00000100:00100000:2.0:1777051411.739757:0:8492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452623744 00000100:00100000:0.0:1777051411.739774:0:46498:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452623232 00000100:00100000:0.0:1777051411.739786:0:46498:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452623232 00000100:00100000:3.0:1777051411.739820:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10418 00000100:00100000:2.0:1777051411.739829:0:8492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452623616 00000100:00100000:2.0:1777051411.739839:0:8492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452623616 00000100:00100000:3.0:1777051411.739841:0:8471:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7cd9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3678:x1863365452624512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777051411.739862:0:21368:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452624640 00000100:00100000:1.0:1777051411.739873:0:21368:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452624640 00000100:00100000:0.0:1777051411.739881:0:46498:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452623872 00000100:00100000:0.0:1777051411.739892:0:46498:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452623872 00000100:00100000:2.0:1777051411.739913:0:8492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452624256 00000100:00100000:1.0:1777051411.739920:0:21368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13358 00000100:00100000:2.0:1777051411.739922:0:8492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452624256 00000100:00100000:1.0:1777051411.739940:0:21368:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f518e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3677:x1863365452623360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051411.739948:0:8471:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7cd9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3678:x1863365452624512:12345-0@lo:400:kworker.0 Request processed in 110us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051411.739977:0:46498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8160 00000100:00100000:3.0:1777051411.739977:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10418 00000100:00100000:2.0:1777051411.739979:0:8492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13359 00000100:00100000:0.0:1777051411.740016:0:46498:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d956129180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+7:3680:x1863365452623232:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1777051411.740017:0:8492:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d944e11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3678:x1863365452623488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777051411.740043:0:21368:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f518e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3677:x1863365452623360:12345-0@lo:400:kworker.0 Request processed in 108us (4452us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051411.740058:0:21368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13358 00000100:00100000:3.0:1777051411.740468:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13360 00000004:00000024:0.0:1777051411.740469:0:46498:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4194304 pending 0 free 1446154240 avail 1299914752 00000100:00100000:1.0:1777051411.740494:0:21368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13361 00000100:00100000:3.0:1777051411.740498:0:6579:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d956129880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3680:x1863365452623744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777051411.740511:0:8492:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d944e11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3678:x1863365452623488:12345-0@lo:400:kworker.0 Request processed in 506us (4444us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051411.740520:0:21368:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d9600b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3679:x1863365452623616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777051411.740537:0:8492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13359 00000100:00100000:0.0:1777051411.740568:0:46498:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d956129180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+7:3680:x1863365452623232:12345-0@lo:41:osp-pre-1-0.0 Request processed in 567us (4980us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051411.740576:0:8492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13362 00000100:00100000:0.0:1777051411.740603:0:46498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8160 00000100:00100000:2.0:1777051411.740605:0:8492:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95fbaca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3679:x1863365452624640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777051411.740607:0:21368:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d9600b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3679:x1863365452623616:12345-0@lo:400:kworker.0 Request processed in 95us (2297us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051411.740625:0:21368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13361 00000100:00100000:3.0:1777051411.740652:0:6579:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d956129880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3680:x1863365452623744:12345-0@lo:400:kworker.0 Request processed in 162us (4382us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051411.740670:0:46498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8161 00000100:00100000:3.0:1777051411.740673:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13360 00000100:00100000:1.0:1777051411.740986:0:21368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13363 00000100:00100000:2.0:1777051411.740986:0:8492:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95fbaca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3679:x1863365452624640:12345-0@lo:400:kworker.0 Request processed in 97us (2112us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051411.741001:0:8492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13362 00000100:00100000:0.0:1777051411.741011:0:46498:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f51aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+6:3677:x1863365452623872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777051411.741014:0:21368:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95612a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3680:x1863365452624256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051411.741084:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d9533bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3679:1863365452623616:0@lo:400:kworker.0 00000100:00080000:2.0:1777051411.741126:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1777051411.741129:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da4384fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452624128:0@lo:400:kworker.0 00000100:00080000:2.0:1777051411.741139:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1777051411.741143:0:46498:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f51aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+6:3677:x1863365452623872:12345-0@lo:400:kworker.0 Request processed in 446us (2735us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051411.741145:0:21368:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95612a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3680:x1863365452624256:12345-0@lo:400:kworker.0 Request processed in 139us (1524us total) trans 0 rc 0/0 00000100:00080000:2.0:1777051411.741149:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1777051411.741158:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1777051411.741506:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da4384ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3679:1863365452624640:0@lo:400:kworker.0 00000100:00100000:0.0:1777051411.741507:0:46498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8161 00000100:00100000:3.0:1777051411.741551:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da444a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3679:1863365452623104:0@lo:400:kworker.0 00000100:00100000:2.0:1777051411.741613:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da4384d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3680:1863365452624256:0@lo:400:kworker.0 00000100:00100000:2.0:1777051411.741654:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95f865180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3680:1863365452623232:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1777051411.742037:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d9533bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3678:1863365452623488:0@lo:400:kworker.0 00000100:00100000:2.0:1777051411.742074:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d9533bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3680:1863365452623744:0@lo:400:kworker.0 00000100:00100000:3.0:1777051411.742082:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da4384ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452624512:0@lo:400:kworker.0 00000100:00100000:0.0:1777051411.742541:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da4384f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3677:1863365452623872:0@lo:400:kworker.0 00000100:00100000:0.0:1777051411.742567:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d9533bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3677:1863365452623360:0@lo:400:kworker.0 00000100:00100000:1.0:1777051411.742676:0:21368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13363 00000100:00100000:3.0:1777051412.246382:0:3679:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1777051412.246411:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94f519c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452624768:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1777051412.246499:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051412.246533:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7cd9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452624896:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1777051412.246581:0:10113:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452624768 00000100:00100000:1.0:1777051412.246592:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051412.246592:0:10113:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452624768 00000100:00100000:3.0:1777051412.246660:0:10113:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452624896 00000100:00100000:3.0:1777051412.246666:0:10113:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452624896 00000100:00100000:1.0:1777051412.246684:0:47388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5646 00000100:00100000:1.0:1777051412.246703:0:47388:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f518380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3679:x1863365452624768:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1777051412.246715:0:10113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5647 00000100:00100000:3.0:1777051412.246731:0:10113:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7cd9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3677:x1863365452624896:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1777051412.246744:0:47388:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 445021760 pending 0 free 3645853696 avail 3414331392 00002000:00000024:3.0:1777051412.246761:0:10113:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 455081536 pending 0 free 3862671360 avail 3631149056 00000100:00100000:1.0:1777051412.246822:0:47388:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f518380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3679:x1863365452624768:12345-0@lo:13:osp-pre-1-1.0 Request processed in 125us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051412.247389:0:10113:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7cd9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3677:x1863365452624896:12345-0@lo:13:osp-pre-0-1.0 Request processed in 114us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051412.247409:0:47388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5646 00000100:00100000:3.0:1777051412.247420:0:10113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5647 00000100:00100000:3.0:1777051412.248872:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7cd9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452624896:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1777051412.248922:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94f519c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452624768:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1777051412.542159:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051412.542437:0:6579:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425959168 00000100:00100000:3.0:1777051412.542454:0:6579:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425959168 00000100:00080000:2.0:1777051412.542575:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1777051412.542655:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13364 00000100:00100000:3.0:1777051412.542673:0:6579:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d956128000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+48:2435:x1863365425959168:12345-192.168.201.46@tcp:38:lctl.0 00010000:02000400:3.0:1777051412.542718:0:6579:0:(ldlm_lib.c:952:target_handle_reconnect()) lustre-MDT0001: Client 2dd4696c-edce-4cd1-86d2-dbd2ff957fa1 (at 192.168.201.46@tcp) reconnecting 00010000:00010000:0.0:1777051412.567715:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00080000:3.0:1777051412.571614:0:6579:0:(ldlm_lib.c:1431:target_handle_connect()) lustre-MDT0001: connection from 2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp t0 exp ffff99da4622a000 cur 8041 last 1777051412 00000004:00100000:3.0:1777051412.571694:0:6579:0:(mdt_handler.c:7281:mdt_connect_internal()) lustre-MDT0001: cli 192.168.201.46@tcp supports cksum type b7, return b7 00000100:00080000:3.0:1777051412.571731:0:6579:0:(import.c:65:import_set_state_nolock()) ffff99da7dbeb800 : changing import state from FULL to RECOVER 00000100:00080000:3.0:1777051412.571748:0:6579:0:(import.c:65:import_set_state_nolock()) ffff99da7dbeb800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1777051412.571865:0:6579:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d956128000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+48:2435:x1863365425959168:12345-192.168.201.46@tcp:38:lctl.0 Request processed in 29193us (29716us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051412.571884:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13364 00000100:00100000:1.0:1777051412.672054:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051412.672680:0:27882:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425959296 00000100:00100000:2.0:1777051412.672694:0:27882:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425959296 00000100:00100000:2.0:1777051412.673123:0:27882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13365 00000100:00100000:2.0:1777051412.673140:0:27882:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7cd9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+8:2435:x1863365425959296:12345-192.168.201.46@tcp:38:lctl.0 00010000:02000400:2.0:1777051412.673180:0:27882:0:(ldlm_lib.c:952:target_handle_reconnect()) lustre-MDT0001: Client c11b6966-0775-44d2-bdc6-c74c26eb2226 (at 192.168.201.46@tcp) reconnecting 00010000:00080000:2.0:1777051412.673187:0:27882:0:(ldlm_lib.c:1431:target_handle_connect()) lustre-MDT0001: connection from c11b6966-0775-44d2-bdc6-c74c26eb2226@192.168.201.46@tcp t0 exp ffff99da4622d800 cur 8041 last 1777051412 00000004:00100000:2.0:1777051412.673287:0:27882:0:(mdt_handler.c:7281:mdt_connect_internal()) lustre-MDT0001: cli 192.168.201.46@tcp supports cksum type b7, return b7 00000100:00080000:2.0:1777051412.673310:0:27882:0:(import.c:65:import_set_state_nolock()) ffff99da71c6c000 : changing import state from FULL to RECOVER 00000100:00080000:2.0:1777051412.673914:0:27882:0:(import.c:65:import_set_state_nolock()) ffff99da71c6c000 : changing import state from RECOVER to FULL 00000100:00080000:0.0:1777051412.674445:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1777051412.674510:0:27882:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7cd9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+8:2435:x1863365425959296:12345-192.168.201.46@tcp:38:lctl.0 Request processed in 1372us (2466us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051412.674525:0:27882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13365 00000100:00100000:0.0:1777051412.712896:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051412.713029:0:46494:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425959424 00000100:00100000:2.0:1777051412.713044:0:46494:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425959424 00000100:00100000:2.0:1777051412.713126:0:46494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111996 00000100:00100000:2.0:1777051412.713142:0:46494:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95612a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c11b6966-0775-44d2-bdc6-c74c26eb2226+8:136691:x1863365425959424:12345-192.168.201.46@tcp:59:kuc_reregister.0 00000100:00100000:2.0:1777051412.713373:0:46494:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95612a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c11b6966-0775-44d2-bdc6-c74c26eb2226+8:136691:x1863365425959424:12345-192.168.201.46@tcp:59:kuc_reregister.0 Request processed in 233us (488us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051412.713386:0:46494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111996 00010000:00010000:2.0:1777051413.590914:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1777051413.654955:0:104226:0:(llog.c:801:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1777051413.654967:0:104226:0:(llog_cat.c:158:llog_cat_process_common()) processing log [0x1:0x12:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1777051413.655004:0:104226:0:(llog.c:858:llog_process_thread()) stop processing plain [0x1:0x12:0x0] index 3 count 3 00000040:00080000:3.0:1777051413.655018:0:104226:0:(llog.c:858:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1777051413.782664:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94f519c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3678:1863365452625024:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1777051413.783120:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051413.783552:0:3680:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1777051413.783587:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7cd9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3680:1863365452625152:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1777051413.783718:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051413.784065:0:47388:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452625024 00000100:00100000:2.0:1777051413.784080:0:47388:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452625024 00000100:00100000:2.0:1777051413.784246:0:47388:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452625152 00000100:00100000:2.0:1777051413.784254:0:47388:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452625152 00000100:00100000:2.0:1777051413.784307:0:47388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5648 00000100:00100000:2.0:1777051413.784330:0:47388:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d956128a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3678:x1863365452625024:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1777051413.784370:0:47388:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 445021760 pending 0 free 3645853696 avail 3414331392 00000100:00100000:3.0:1777051413.784424:0:8472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5649 00000100:00100000:3.0:1777051413.784451:0:8472:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955ebdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3680:x1863365452625152:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1777051413.784473:0:47388:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d956128a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3678:x1863365452625024:12345-0@lo:13:osp-pre-1-0.0 Request processed in 145us (1359us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051413.784492:0:47388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5648 00002000:00000024:3.0:1777051413.784493:0:8472:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 455081536 pending 0 free 3862671360 avail 3631149056 00000100:00100000:2.0:1777051413.784625:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94f519c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3678:1863365452625024:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1777051413.784627:0:8472:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955ebdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3680:x1863365452625152:12345-0@lo:13:osp-pre-0-0.0 Request processed in 161us (886us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051413.784652:0:8472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5649 00000100:00080000:1.0:1777051413.784678:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1777051413.784689:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1777051413.786240:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7cd9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3680:1863365452625152:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1777051414.617247:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777051415.639778:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1777051416.343391:0:3679:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1777051416.343422:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94f51b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452625280:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1777051416.343512:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051416.343592:0:47208:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452625280 00000100:00100000:0.0:1777051416.343604:0:47208:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452625280 00000100:00100000:0.0:1777051416.343673:0:47208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8162 00000100:00100000:0.0:1777051416.343689:0:47208:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955ebd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+6:3679:x1863365452625280:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1777051416.343732:0:47208:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4194304 pending 0 free 1441579008 avail 1295339520 00000100:00100000:0.0:1777051416.343834:0:47208:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955ebd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+6:3679:x1863365452625280:12345-0@lo:41:osp-pre-0-1.0 Request processed in 148us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051416.343847:0:47208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8162 00000100:00100000:1.0:1777051416.343930:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94f51b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452625280:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1777051416.483955:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051416.484060:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051416.484419:0:103168:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425959552 00000100:00100000:2.0:1777051416.484435:0:103168:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425959552 00000100:00100000:2.0:1777051416.484551:0:103168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 174 00000100:00100000:2.0:1777051416.484571:0:103168:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94ba5f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:29c4352d-3260-4734-909d-9ea5de9e7fa4+12:2436:x1863365425959552:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:2.0:1777051416.484714:0:103168:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94ba5f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:29c4352d-3260-4734-909d-9ea5de9e7fa4+12:2436:x1863365425959552:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 146us (774us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051416.484730:0:103168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 174 00000100:00100000:0.0:1777051416.484972:0:10328:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425959680 00000100:00100000:0.0:1777051416.484982:0:10328:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425959680 00000100:00100000:0.0:1777051416.485119:0:10328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13366 00000100:00080000:1.0:1777051416.485171:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1777051416.485176:0:10328:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955ebdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+20:2436:x1863365425959680:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:0.0:1777051416.485273:0:10328:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955ebdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+20:2436:x1863365425959680:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 138us (1212us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051416.485296:0:10328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13366 00000100:00100000:1.0:1777051416.487278:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051416.487352:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051416.487442:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051416.487475:0:6580:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425959808 00000100:00100000:0.0:1777051416.487493:0:6580:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425959808 00000100:00100000:1.0:1777051416.487509:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051416.487573:0:8470:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425959936 00000100:00100000:2.0:1777051416.487588:0:8470:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425959936 00000100:00100000:1.0:1777051416.487590:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051416.487651:0:21368:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425960192 00000100:00100000:3.0:1777051416.487667:0:21368:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425960192 00000100:00100000:2.0:1777051416.487685:0:8470:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425960448 00000100:00100000:1.0:1777051416.487691:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051416.487698:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13367 00000100:00100000:2.0:1777051416.487702:0:8470:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425960448 00000100:00100000:0.0:1777051416.487741:0:6580:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fdf0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+8:2436:x1863365425959808:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:3.0:1777051416.487777:0:21368:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425960320 00000100:00100000:1.0:1777051416.487779:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051416.487792:0:21368:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425960320 00000100:00100000:2.0:1777051416.487812:0:8470:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425960064 00000100:00100000:2.0:1777051416.487834:0:8470:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425960064 00000100:00100000:0.0:1777051416.487848:0:6580:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fdf0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+8:2436:x1863365425959808:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 123us (570us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051416.487873:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13367 00000100:00100000:3.0:1777051416.487899:0:21368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13368 00000100:00100000:2.0:1777051416.487914:0:8470:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425960576 00000100:00100000:2.0:1777051416.487922:0:8470:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425960576 00000100:00100000:0.0:1777051416.487932:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13369 00000100:00100000:0.0:1777051416.487963:0:6580:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955612a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+48:2437:x1863365425960320:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:2.0:1777051416.487999:0:8470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10419 00000100:00100000:1.0:1777051416.488019:0:27884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10420 00000100:00100000:2.0:1777051416.488029:0:8470:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fdf3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+51:2436:x1863365425959936:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:1.0:1777051416.488060:0:27884:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fdf3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+51:2437:x1863365425960448:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:0.0:1777051416.488068:0:6580:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955612a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+48:2437:x1863365425960320:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 100us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051416.488087:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13369 00000100:00100000:2.0:1777051416.488122:0:8470:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fdf3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+51:2436:x1863365425959936:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 99us (760us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051416.488181:0:8470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10419 00000100:00100000:1.0:1777051416.488195:0:27884:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fdf3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+51:2437:x1863365425960448:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 151us (688us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051416.488269:0:8628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10421 00000100:00100000:0.0:1777051416.488296:0:8628:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955612680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+48:2437:x1863365425960064:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:0.0:1777051416.488362:0:8628:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955612680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+48:2437:x1863365425960064:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 67us (777us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051416.489106:0:21368:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fdf2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+25:2437:x1863365425960192:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:3.0:1777051416.489232:0:21368:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fdf2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+25:2437:x1863365425960192:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 1315us (1789us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051416.489248:0:21368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13368 00000100:00100000:1.0:1777051416.491129:0:27884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10420 00000100:00100000:1.0:1777051416.491265:0:27884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10422 00000100:00100000:1.0:1777051416.491294:0:27884:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955612300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+47:2437:x1863365425960576:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:1.0:1777051416.491377:0:27884:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955612300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+47:2437:x1863365425960576:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 88us (3595us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051416.491405:0:8628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10421 00000100:00080000:2.0:1777051416.491611:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1777051416.491622:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1777051416.491628:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1777051416.491633:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1777051416.492442:0:27884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10422 00010000:00010000:0.0:1777051416.663363:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1777051416.855574:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d943d93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3678:1863365452625536:0@lo:400:kworker.0 00000100:00100000:1.0:1777051416.855667:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051416.855738:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7fd63800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3678:1863365452626048:0@lo:400:kworker.0 00000100:00100000:1.0:1777051416.855801:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051416.855852:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7fd63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452626560:0@lo:400:kworker.0 00000100:00100000:1.0:1777051416.855891:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051416.855937:0:3678:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:1.0:1777051416.855948:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955613100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3678:1863365452625408:0@lo:400:kworker.0 00000100:00100000:1.0:1777051416.855998:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051416.856069:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d943d92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3678:1863365452625920:0@lo:400:kworker.0 00000100:00100000:1.0:1777051416.856115:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051416.856180:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7fd62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3678:1863365452626432:0@lo:400:kworker.0 00000100:00100000:1.0:1777051416.856248:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051416.856279:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94c128380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3678:1863365452626944:0@lo:400:kworker.0 00000100:00100000:1.0:1777051416.856314:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051416.856355:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d943d91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3679:1863365452625664:0@lo:400:kworker.0 00000100:00100000:1.0:1777051416.856391:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051416.856422:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7fd60700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452626176:0@lo:400:kworker.0 00000100:00100000:1.0:1777051416.856465:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051416.856502:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f826680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452626688:0@lo:400:kworker.0 00000100:00100000:1.0:1777051416.856548:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051416.856572:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94f518a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3678:1863365452627072:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1777051416.856588:0:3679:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1777051416.856603:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d943d92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3679:1863365452625792:0@lo:400:kworker.0 00000100:00100000:3.0:1777051416.856654:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051416.856668:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051416.856724:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7fd62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452626304:0@lo:400:kworker.0 00000100:00100000:0.0:1777051416.856736:0:46494:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452625536 00000100:00100000:0.0:1777051416.857046:0:46494:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452625536 00000100:00100000:3.0:1777051416.857076:0:6585:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452626048 00000100:00100000:3.0:1777051416.857090:0:6585:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452626048 00000100:00100000:1.0:1777051416.857114:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051416.857491:0:46494:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452625920 00000100:00100000:3.0:1777051416.857495:0:6585:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452626560 00000100:00100000:0.0:1777051416.857501:0:46494:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452625920 00000100:00100000:3.0:1777051416.857507:0:6585:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452626560 00000100:00100000:1.0:1777051416.857508:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94c129f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452626816:0@lo:400:kworker.0 00000100:00100000:1.0:1777051416.857572:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051416.857573:0:46494:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452626432 00000100:00100000:3.0:1777051416.857580:0:6585:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452627072 00000100:00100000:0.0:1777051416.857582:0:46494:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452626432 00000100:00100000:3.0:1777051416.857589:0:6585:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452627072 00000100:00100000:0.0:1777051416.857638:0:46494:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452626944 00000100:00100000:0.0:1777051416.857645:0:46494:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452626944 00000100:00100000:1.0:1777051416.857648:0:10328:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452625664 00000100:00100000:1.0:1777051416.857659:0:10328:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452625664 00000100:00100000:3.0:1777051416.857660:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8163 00000100:00100000:3.0:1777051416.857691:0:6585:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94e626680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:3678:x1863365452626048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777051416.857694:0:46494:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452625792 00000100:00100000:0.0:1777051416.857706:0:46494:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452625792 00000100:00100000:1.0:1777051416.857731:0:10328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13370 00000100:00100000:1.0:1777051416.858091:0:10328:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94c129c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3678:x1863365452625536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777051416.858103:0:46494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13371 00000100:00100000:3.0:1777051416.858157:0:6585:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94e626680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:3678:x1863365452626048:12345-0@lo:400:kworker.0 Request processed in 446us (2341us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051416.858165:0:46494:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94e625880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0001-lwp-OST0001_UUID+5:3678:x1863365452625920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051416.858177:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8163 00000100:00100000:3.0:1777051416.858251:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8164 00000100:00100000:0.0:1777051416.858287:0:46494:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94e625880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0001-lwp-OST0001_UUID+5:3678:x1863365452625920:12345-0@lo:400:kworker.0 Request processed in 167us (2167us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051416.858306:0:46494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13371 00000100:00100000:3.0:1777051416.858316:0:6585:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94e627b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3678:x1863365452626560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777051416.858346:0:46494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13372 00000100:00100000:0.0:1777051416.858361:0:46494:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94e627100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000-lwp-MDT0000_UUID+5:3678:x1863365452626432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051416.858395:0:6585:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94e627b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3678:x1863365452626560:12345-0@lo:400:kworker.0 Request processed in 87us (2499us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051416.858408:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8164 00000100:00100000:0.0:1777051416.858434:0:46494:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94e627100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000-lwp-MDT0000_UUID+5:3678:x1863365452626432:12345-0@lo:400:kworker.0 Request processed in 74us (2182us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051416.858451:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8165 00000100:00100000:0.0:1777051416.858452:0:46494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13372 00000100:00100000:3.0:1777051416.858477:0:6585:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f51b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3678:x1863365452627072:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1777051416.858491:0:46494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13373 00000100:00100000:0.0:1777051416.858507:0:46494:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fd67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000-lwp-MDT0001_UUID+5:3678:x1863365452626944:12345-0@lo:400:kworker.0 00000004:00000024:3.0:1777051416.858522:0:6585:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4194304 pending 0 free 1446154240 avail 1299914752 00000100:00100000:0.0:1777051416.858578:0:46494:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fd67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000-lwp-MDT0001_UUID+5:3678:x1863365452626944:12345-0@lo:400:kworker.0 Request processed in 74us (2261us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051416.858592:0:46494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13373 00000100:00100000:3.0:1777051416.858602:0:6585:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f51b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3678:x1863365452627072:12345-0@lo:41:osp-pre-1-0.0 Request processed in 131us (1948us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051416.858617:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8165 00000100:00100000:0.0:1777051416.858625:0:46494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13374 00000100:00100000:0.0:1777051416.858644:0:46494:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fd65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0001-lwp-OST0000_UUID+5:3679:x1863365452625664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051416.858689:0:46497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13375 00000100:00100000:3.0:1777051416.858708:0:46497:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955506d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:lustre-MDT0000-lwp-OST0001_UUID+5:3679:x1863365452625792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777051416.858722:0:46494:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fd65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0001-lwp-OST0000_UUID+5:3679:x1863365452625664:12345-0@lo:400:kworker.0 Request processed in 81us (2326us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051416.858734:0:46494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13374 00000100:00100000:0.0:1777051416.859078:0:103163:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452625408 00000100:00100000:3.0:1777051416.859081:0:46497:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955506d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:lustre-MDT0000-lwp-OST0001_UUID+5:3679:x1863365452625792:12345-0@lo:400:kworker.0 Request processed in 374us (2411us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051416.859091:0:103163:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452625408 00000100:00100000:3.0:1777051416.859100:0:46497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13375 00000100:00100000:0.0:1777051416.859193:0:103163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1777051416.859250:0:103163:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94ba5cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9351a01-5b0e-4470-97fd-58b9b4b312a2+23:3678:x1863365452625408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051416.859261:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94f518a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3678:1863365452627072:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1777051416.859294:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d943d92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3678:1863365452625920:0@lo:400:kworker.0 00000100:00100000:3.0:1777051416.859322:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7fd62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3678:1863365452626432:0@lo:400:kworker.0 00000100:00100000:0.0:1777051416.859331:0:103163:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94ba5cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9351a01-5b0e-4470-97fd-58b9b4b312a2+23:3678:x1863365452625408:12345-0@lo:400:kworker.0 Request processed in 82us (3329us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051416.859347:0:103163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1777051416.859353:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94c128380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3678:1863365452626944:0@lo:400:kworker.0 00000100:00100000:3.0:1777051416.859379:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7fd63800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3678:1863365452626048:0@lo:400:kworker.0 00000100:00100000:3.0:1777051416.859400:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7fd63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452626560:0@lo:400:kworker.0 00000100:00100000:3.0:1777051416.859458:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955613100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3678:1863365452625408:0@lo:400:kworker.0 00000100:00100000:0.0:1777051416.859470:0:8470:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452626176 00000100:00100000:0.0:1777051416.859479:0:8470:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452626176 00000100:00080000:3.0:1777051416.859546:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1777051416.859554:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1777051416.859558:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1777051416.859937:0:10328:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94c129c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3678:x1863365452625536:12345-0@lo:400:kworker.0 Request processed in 2191us (4269us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051416.860016:0:10328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13370 00000100:00100000:0.0:1777051416.863211:0:8470:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452626688 00000100:00100000:0.0:1777051416.863223:0:8470:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452626688 00000100:00100000:1.0:1777051416.863257:0:24468:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452626304 00000100:00100000:1.0:1777051416.863269:0:24468:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452626304 00000100:00080000:3.0:1777051416.863295:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1777051416.863299:0:8470:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452626816 00000100:00080000:3.0:1777051416.863306:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1777051416.863309:0:8470:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452626816 00000100:00100000:1.0:1777051416.863344:0:24468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10423 00000100:00100000:1.0:1777051416.863366:0:24468:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955506300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3679:x1863365452626176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051416.863377:0:55805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10424 00000100:00100000:0.0:1777051416.863398:0:8470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10425 00000100:00100000:3.0:1777051416.863403:0:55805:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955505880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3679:x1863365452626688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777051416.863424:0:8470:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955506a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3679:x1863365452626304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777051416.863448:0:24468:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955506300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3679:x1863365452626176:12345-0@lo:400:kworker.0 Request processed in 89us (6981us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051416.863462:0:24468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10423 00000100:00100000:1.0:1777051416.863492:0:24468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10426 00000100:00100000:1.0:1777051416.863506:0:24468:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955504a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3679:x1863365452626816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051416.863523:0:55805:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955505880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3679:x1863365452626688:12345-0@lo:400:kworker.0 Request processed in 129us (6976us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051416.863538:0:55805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10424 00000100:00100000:1.0:1777051416.863580:0:24468:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955504a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3679:x1863365452626816:12345-0@lo:400:kworker.0 Request processed in 74us (6010us total) trans 0 rc 0/0 00000100:00080000:3.0:1777051416.863586:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1777051416.863595:0:24468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10426 00000100:00100000:1.0:1777051416.863685:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d943d92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3679:1863365452625792:0@lo:400:kworker.0 00000100:00100000:1.0:1777051416.863708:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94c129f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452626816:0@lo:400:kworker.0 00000100:00100000:1.0:1777051416.863732:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d943d91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3679:1863365452625664:0@lo:400:kworker.0 00000100:00100000:1.0:1777051416.863755:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7fd60700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452626176:0@lo:400:kworker.0 00000100:00100000:1.0:1777051416.863774:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f826680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452626688:0@lo:400:kworker.0 00000100:00100000:1.0:1777051416.863846:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d943d93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3678:1863365452625536:0@lo:400:kworker.0 00000100:00100000:0.0:1777051416.864608:0:8470:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955506a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3679:x1863365452626304:12345-0@lo:400:kworker.0 Request processed in 1191us (7528us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051416.864626:0:8470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10425 00000100:00100000:1.0:1777051416.864679:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7fd62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452626304:0@lo:400:kworker.0 00000100:00100000:3.0:1777051417.366571:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94f518a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452627200:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1777051417.366979:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051417.367252:0:47388:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452627200 00000100:00100000:2.0:1777051417.367264:0:47388:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452627200 00000100:00100000:0.0:1777051417.367282:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95fbadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3680:1863365452627328:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1777051417.367344:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051417.367349:0:47388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5650 00000100:00100000:2.0:1777051417.367370:0:47388:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f519c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3679:x1863365452627200:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1777051417.367417:0:8472:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452627328 00002000:00000024:2.0:1777051417.367418:0:47388:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 445021760 pending 0 free 3645853696 avail 3414331392 00000100:00100000:0.0:1777051417.367427:0:8472:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452627328 00000100:00100000:0.0:1777051417.367488:0:8472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5651 00000100:00100000:0.0:1777051417.367504:0:8472:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d956128380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3680:x1863365452627328:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1777051417.367521:0:47388:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f519c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3679:x1863365452627200:12345-0@lo:13:osp-pre-1-1.0 Request processed in 155us (542us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051417.367538:0:47388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5650 00002000:00000024:0.0:1777051417.367539:0:8472:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 455081536 pending 0 free 3862671360 avail 3631149056 00000100:00100000:0.0:1777051417.367609:0:8472:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d956128380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3680:x1863365452627328:12345-0@lo:13:osp-pre-0-1.0 Request processed in 109us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051417.367621:0:8472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5651 00000100:00100000:2.0:1777051417.367647:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94f518a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452627200:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1777051417.367694:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95fbadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3680:1863365452627328:0@lo:13:osp-pre-0-1.0 00000040:00080000:3.0:1777051417.558886:0:103189:0:(llog.c:801:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:3.0:1777051417.558897:0:103189:0:(llog_cat.c:158:llog_cat_process_common()) processing log [0x1:0x2b:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1777051417.559035:0:103189:0:(llog.c:858:llog_process_thread()) stop processing plain [0x1:0x2b:0x0] index 4 count 3 00000040:00080000:3.0:1777051417.559047:0:103189:0:(llog.c:858:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00010000:00010000:2.0:1777051417.690522:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777051418.710751:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1777051418.902484:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95fbad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3677:1863365452627456:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1777051418.902595:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051418.902650:0:8473:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452627456 00000100:00100000:1.0:1777051418.902662:0:8473:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452627456 00000100:00080000:0.0:1777051418.903074:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1777051418.903075:0:8473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5652 00000100:00100000:1.0:1777051418.903130:0:8473:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942d21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3677:x1863365452627456:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1777051418.903177:0:8473:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 455081536 pending 0 free 3862671360 avail 3631149056 00000100:00100000:1.0:1777051418.903340:0:8473:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942d21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3677:x1863365452627456:12345-0@lo:13:osp-pre-0-0.0 Request processed in 245us (746us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051418.903355:0:8473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5652 00000100:00100000:0.0:1777051418.903904:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95fbad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3677:1863365452627456:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1777051418.905879:0:3677:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1777051418.905900:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94f518a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3677:1863365452627584:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1777051418.905946:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051418.906057:0:8472:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452627584 00000100:00100000:3.0:1777051418.906068:0:8472:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452627584 00000100:00100000:3.0:1777051418.906551:0:8472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5653 00000100:00100000:3.0:1777051418.906568:0:8472:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942d22d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3677:x1863365452627584:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1777051418.906600:0:8472:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 445021760 pending 0 free 3645853696 avail 3414331392 00000100:00080000:0.0:1777051418.906961:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1777051418.907013:0:8472:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942d22d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3677:x1863365452627584:12345-0@lo:13:osp-pre-1-0.0 Request processed in 445us (1060us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051418.907028:0:8472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5653 00000100:00100000:0.0:1777051418.907041:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94f518a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3677:1863365452627584:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1777051419.339302:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051419.339385:0:46494:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425960704 00000100:00100000:0.0:1777051419.339408:0:46494:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425960704 00000100:00080000:3.0:1777051419.339594:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1777051419.340076:0:46494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111997 00000100:00100000:0.0:1777051419.340528:0:46494:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955507b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c11b6966-0775-44d2-bdc6-c74c26eb2226+20:136180:x1863365425960704:12345-192.168.201.46@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1777051419.340721:0:46494:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955507b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c11b6966-0775-44d2-bdc6-c74c26eb2226+20:136180:x1863365425960704:12345-192.168.201.46@tcp:60:lhsmtool_posix.0 Request processed in 627us (1428us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051419.340741:0:46494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111997 00000100:00100000:3.0:1777051419.345007:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051419.347833:0:21368:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425960832 00000100:00100000:1.0:1777051419.347845:0:21368:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425960832 00000100:00100000:1.0:1777051419.348002:0:21368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111998 00000100:00100000:1.0:1777051419.348032:0:21368:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f518a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+8:136180:x1863365425960832:12345-192.168.201.46@tcp:60:lhsmtool_posix.0 00000100:00080000:3.0:1777051419.348248:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1777051419.350274:0:21368:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f518a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+8:136180:x1863365425960832:12345-192.168.201.46@tcp:60:lhsmtool_posix.0 Request processed in 2247us (5262us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051419.350294:0:21368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111998 00000100:00100000:2.0:1777051419.361335:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051419.363169:0:6583:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425961088 00000100:00100000:3.0:1777051419.363183:0:6583:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425961088 00000100:00100000:3.0:1777051419.363349:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3348 00000100:00100000:3.0:1777051419.363367:0:6583:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95fbace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+20:136180:x1863365425961088:12345-192.168.201.46@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1777051419.363734:0:6583:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95fbace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+21:136180:x1863365425961088:12345-192.168.201.46@tcp:35:lhsmtool_posix.0 Request processed in 369us (2410us total) trans 30064771134 rc 0/0 00000100:00100000:3.0:1777051419.363755:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3348 00010000:00010000:0.0:1777051419.734564:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051420.759493:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1777051421.216931:0:107150:0:(debug.c:645:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-hsm test 404: Inactive MDT does not block requests for active MDTs ========================================================== 13:23:39 (1777051419) 00000100:00100000:2.0:1777051421.462632:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955613100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452627712:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1777051421.463111:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051421.463266:0:6585:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452627712 00000100:00100000:3.0:1777051421.463288:0:6585:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452627712 00000100:00100000:3.0:1777051421.463409:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8166 00000100:00100000:3.0:1777051421.463428:0:6585:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95fbad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3679:x1863365452627712:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1777051421.463787:0:6585:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4194304 pending 0 free 1441579008 avail 1295339520 00000100:00100000:3.0:1777051421.463879:0:6585:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95fbad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3679:x1863365452627712:12345-0@lo:41:osp-pre-0-1.0 Request processed in 455us (785us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051421.463895:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8166 00000100:00100000:2.0:1777051421.463971:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955613100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452627712:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1777051421.473260:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051421.473387:0:27882:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425961344 00000100:00100000:3.0:1777051421.473404:0:27882:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425961344 00000100:00080000:0.0:1777051421.473491:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1777051421.473652:0:27882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 111999 00000100:00100000:2.0:1777051421.473669:0:27882:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95fbadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+21:137321:x1863365425961344:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1777051421.473722:0:27882:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051421.473756:0:27882:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263c00/0x85f51a6b96715f36 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b62e5 expref: -99 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051421.473887:0:27882:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950262e00/0x85f51a6b96715f3d lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051421.473911:0:27882:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d950262e00/0x85f51a6b96715f3d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051421.473934:0:27882:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d950262e00/0x85f51a6b96715f3d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051421.473957:0:27882:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263600/0x85f51a6b96715f44 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051421.473975:0:27882:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263600/0x85f51a6b96715f44 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051421.473985:0:27882:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263600/0x85f51a6b96715f44 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051421.474159:0:27882:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950262200/0x85f51a6b96715f4b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051421.474173:0:27882:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d950262200/0x85f51a6b96715f4b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051421.474184:0:27882:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d950262200/0x85f51a6b96715f4b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1777051421.474228:0:27882:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:2.0:1777051421.474358:0:27882:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950262e00/0x85f51a6b96715f3d lrc: 4/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051421.474371:0:27882:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950262e00/0x85f51a6b96715f3d lrc: 4/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051421.474380:0:27882:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d950262e00/0x85f51a6b96715f3d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051421.474390:0:27882:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d950262e00/0x85f51a6b96715f3d lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051421.474400:0:27882:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d950262e00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:2.0:1777051421.474407:0:27882:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d950262e00/0x85f51a6b96715f3d lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051421.474425:0:27882:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d950262e00/0x85f51a6b96715f3d lrc: 5/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051421.474443:0:27882:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff99d94e5e2500) 00010000:00010000:2.0:1777051421.474448:0:27882:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777051421.474456:0:27882:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d950262e00/0x85f51a6b96715f3d lrc: 3/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051421.474465:0:27882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d950262e00/0x85f51a6b96715f3d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051421.474487:0:27882:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263600/0x85f51a6b96715f44 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051421.474496:0:27882:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263600/0x85f51a6b96715f44 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051421.474506:0:27882:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263600/0x85f51a6b96715f44 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051421.474514:0:27882:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d950263600 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:2.0:1777051421.474519:0:27882:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263600/0x85f51a6b96715f44 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051421.474528:0:27882:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263600/0x85f51a6b96715f44 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051421.474540:0:27882:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff99d9413d0a00) 00010000:00010000:2.0:1777051421.474544:0:27882:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777051421.474548:0:27882:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263600/0x85f51a6b96715f44 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051421.474564:0:27882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263600/0x85f51a6b96715f44 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051421.475046:0:27882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263c00/0x85f51a6b96715f36 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b62e5 expref: 24 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051421.475109:0:27882:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950262200/0x85f51a6b96715f4b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b62e5 expref: 23 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051421.475122:0:27882:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99d941e2ea00) 00010000:00010000:2.0:1777051421.475126:0:27882:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777051421.475130:0:27882:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d950262200, rc 0) 00000100:00100000:2.0:1777051421.475313:0:27882:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95fbadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+23:137321:x1863365425961344:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 Request processed in 1645us (2123us total) trans 30064771135 rc 0/0 00000100:00100000:2.0:1777051421.475327:0:27882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 111999 00000100:00100000:0.0:1777051421.479131:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051421.479423:0:6564:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425961472 00000100:00100000:2.0:1777051421.479439:0:6564:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425961472 00000100:00100000:2.0:1777051421.479571:0:6564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13690 00000100:00100000:2.0:1777051421.479591:0:6564:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d950266680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+23:2438:x1863365425961472:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1777051421.479621:0:6564:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777051421.479663:0:6564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d950262200/0x85f51a6b96715f4b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b62e5 expref: 23 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051421.479693:0:6564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99d941e2ea00) 00010000:00010000:2.0:1777051421.479702:0:6564:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1777051421.479879:0:6564:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d950266680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+22:2438:x1863365425961472:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 292us (759us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051421.479896:0:6564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13690 00000100:00100000:1.0:1777051421.483592:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051421.483720:0:8492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425961600 00000100:00100000:0.0:1777051421.483732:0:8492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425961600 00000100:00100000:0.0:1777051421.483810:0:8492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112000 00000100:00100000:0.0:1777051421.483824:0:8492:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f826680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+22:137321:x1863365425961600:12345-192.168.201.46@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1777051421.483966:0:8492:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f826680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+22:137321:x1863365425961600:12345-192.168.201.46@tcp:59:lhsmtool_posix.0 Request processed in 141us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051421.483980:0:8492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112000 00000100:00100000:0.0:1777051421.488580:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051421.489024:0:6581:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425961728 00000100:00100000:3.0:1777051421.489035:0:6581:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425961728 00000100:00100000:3.0:1777051421.489483:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112001 00000100:00100000:3.0:1777051421.489501:0:6581:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d950265500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+8:137321:x1863365425961728:12345-192.168.201.46@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1777051421.489615:0:6581:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d950265500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+8:137321:x1863365425961728:12345-192.168.201.46@tcp:59:lhsmtool_posix.0 Request processed in 117us (1038us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051421.489629:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112001 00000100:00080000:0.0:1777051421.489706:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1777051421.504983:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051421.505497:0:46494:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425961856 00000100:00100000:0.0:1777051421.505511:0:46494:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425961856 00000100:00100000:0.0:1777051421.505643:0:46494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112002 00000100:00080000:3.0:1777051421.505647:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1777051421.505668:0:46494:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955613100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+25:137322:x1863365425961856:12345-192.168.201.46@tcp:101:lfs.0 00010000:00010000:0.0:1777051421.505696:0:46494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051421.505727:0:46494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b400/0x85f51a6b96715f59 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b62ec expref: -99 pid: 46494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051421.505807:0:46494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2a000/0x85f51a6b96715f60 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051421.505825:0:46494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2a000/0x85f51a6b96715f60 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051421.505839:0:46494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2a000/0x85f51a6b96715f60 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051421.505860:0:46494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2a600/0x85f51a6b96715f67 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x661a78f4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051421.505869:0:46494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2a600/0x85f51a6b96715f67 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x661a78f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051421.505877:0:46494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2a600/0x85f51a6b96715f67 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x661a78f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051421.505940:0:46494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2a000/0x85f51a6b96715f60 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051421.505952:0:46494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2a000/0x85f51a6b96715f60 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051421.505964:0:46494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2a000/0x85f51a6b96715f60 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051421.505975:0:46494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94eb2a000 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:0.0:1777051421.505982:0:46494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2a000/0x85f51a6b96715f60 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051421.505995:0:46494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2a000/0x85f51a6b96715f60 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051421.506015:0:46494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d9533ab000) 00010000:00010000:0.0:1777051421.506021:0:46494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777051421.506029:0:46494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2a000/0x85f51a6b96715f60 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051421.506041:0:46494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2a000/0x85f51a6b96715f60 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051421.506093:0:46494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2a600/0x85f51a6b96715f67 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x661a78f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051421.506105:0:46494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2a600/0x85f51a6b96715f67 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x661a78f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051421.506116:0:46494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2a600/0x85f51a6b96715f67 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x661a78f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051421.506126:0:46494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94eb2a600 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:0.0:1777051421.506132:0:46494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2a600/0x85f51a6b96715f67 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x661a78f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051421.506143:0:46494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2a600/0x85f51a6b96715f67 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x661a78f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051421.506157:0:46494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x661a78f4 (ffff99d94e81c200) 00010000:00010000:0.0:1777051421.506161:0:46494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777051421.506166:0:46494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2a600/0x85f51a6b96715f67 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x661a78f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051421.506177:0:46494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2a600/0x85f51a6b96715f67 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x661a78f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051421.506336:0:46494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b400/0x85f51a6b96715f59 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b62ec expref: 26 pid: 46494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051421.506358:0:46494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d9533ab000) 00010000:00010000:0.0:1777051421.506365:0:46494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777051421.506376:0:46494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b400/0x85f51a6b96715f59 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b62ec expref: 26 pid: 46494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051421.506402:0:46494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d94eb2b400, rc 0) 00000100:00100000:0.0:1777051421.506498:0:46494:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955613100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+25:137322:x1863365425961856:12345-192.168.201.46@tcp:101:lfs.0 Request processed in 838us (1523us total) trans 0 rc 301/301 00000100:00100000:0.0:1777051421.506522:0:46494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112002 00000100:00100000:2.0:1777051421.511536:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051421.512081:0:27885:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425962112 00000100:00100000:0.0:1777051421.512093:0:27885:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425962112 00000100:00100000:0.0:1777051421.513712:0:27885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112003 00000100:00100000:0.0:1777051421.513729:0:27885:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7cd9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+25:137322:x1863365425962112:12345-192.168.201.46@tcp:36:lfs.0 00010000:00010000:0.0:1777051421.513798:0:27885:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777051421.513829:0:27885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263800/0x85f51a6b96715e17 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6283 expref: 25 pid: 21368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051421.513857:0:27885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d9533ab000) 00010000:00010000:0.0:1777051421.513865:0:27885:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1777051421.513934:0:27885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b600/0x85f51a6b96715f6e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051421.513953:0:27885:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7e00/0x85f51a6b96715f0c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b62d7 expref: 21 pid: 21368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051421.513968:0:27885:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b600/0x85f51a6b96715f6e lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051421.514013:0:27885:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7e00/0x85f51a6b96715f0c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b62d7 expref: 21 pid: 21368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051421.514039:0:27885:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7e00/0x85f51a6b96715f0c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b62d7 expref: 21 pid: 21368 timeout: 8150 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051421.514092:0:27885:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d950264a80 pname:cluuid:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000_UUID:27885:1863365452627840:192.168.201.46@tcp:104: 00000100:00100000:0.0:1777051421.514278:0:27885:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d944a9fa80 going to sleep for 11 seconds 00000100:00100000:2.0:1777051421.517788:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051421.517864:0:27885:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d950264a80 pname:cluuid:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000_UUID:27885:1863365452627840:192.168.201.46@tcp:104: 00010000:00010000:0.0:1777051421.517915:0:27885:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b600/0x85f51a6b96715f6e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051421.522036:0:47827:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425962240 00000100:00100000:3.0:1777051421.522049:0:47827:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425962240 00010000:00010000:3.0:1777051421.522131:0:47827:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7e00/0x85f51a6b96715f0c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b62d7 expref: 22 pid: 21368 timeout: 8150 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051421.522217:0:47827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3871 00000100:00100000:3.0:1777051421.522234:0:47827:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f865180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+22:2437:x1863365425962240:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1777051421.522256:0:47827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777051421.522268:0:47827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7e00/0x85f51a6b96715f0c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b62d7 expref: 22 pid: 21368 timeout: 8150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051421.522311:0:47827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7e00/0x85f51a6b96715f0c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b62d7 expref: 22 pid: 21368 timeout: 8150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051421.522345:0:47827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7e00/0x85f51a6b96715f0c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b62d7 expref: 22 pid: 21368 timeout: 8150 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051421.522370:0:47827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d9533ab000) 00010000:00010000:3.0:1777051421.522378:0:47827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b600/0x85f51a6b96715f6e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051421.522394:0:47827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b600/0x85f51a6b96715f6e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051421.522407:0:47827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b600/0x85f51a6b96715f6e lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051421.522455:0:47827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1777051421.522517:0:27885:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b600/0x85f51a6b96715f6e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051421.522542:0:47827:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f865180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+21:2437:x1863365425962240:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 309us (4758us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051421.522561:0:47827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3871 00010000:00010000:0.0:1777051421.522563:0:27885:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b600/0x85f51a6b96715f6e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051421.522603:0:27885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2a000/0x85f51a6b96715f75 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x661a78f4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051421.522621:0:27885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2a000/0x85f51a6b96715f75 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x661a78f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051421.522639:0:27885:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2a000/0x85f51a6b96715f75 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x661a78f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051421.523695:0:27885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b400/0x85f51a6b96715f7c lrc: 3/0,1 mode: --/PW res: [0x2000032e2:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051421.523715:0:27885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b400/0x85f51a6b96715f7c lrc: 3/0,1 mode: PW/PW res: [0x2000032e2:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051421.523729:0:27885:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b400/0x85f51a6b96715f7c lrc: 3/0,1 mode: PW/PW res: [0x2000032e2:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1777051421.523752:0:27885:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000e331778b reply state 000000004f6860e4 transno 30064771136 ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b400/0x85f51a6b96715f7c lrc: 3/0,1 mode: PW/PW res: [0x2000032e2:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051421.523771:0:27885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b400/0x85f51a6b96715f7c lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e2:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051421.523782:0:27885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0x3:0x0].0x0 (ffff99d94e81c200) 00010000:00010000:0.0:1777051421.523787:0:27885:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1777051421.523791:0:27885:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1777051421.523799:0:27885:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000032e2:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1777051421.523812:0:27885:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b600/0x85f51a6b96715f6e lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051421.523819:0:27885:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b600/0x85f51a6b96715f6e lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051421.523829:0:27885:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b600/0x85f51a6b96715f6e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051421.523840:0:27885:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b600/0x85f51a6b96715f6e lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051421.523850:0:27885:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94eb2b600 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:0.0:1777051421.523857:0:27885:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b600/0x85f51a6b96715f6e lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051421.523868:0:27885:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b600/0x85f51a6b96715f6e lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051421.523889:0:27885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d9533ab000) 00010000:00010000:0.0:1777051421.523893:0:27885:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777051421.523898:0:27885:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b600/0x85f51a6b96715f6e lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051421.523909:0:27885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b600/0x85f51a6b96715f6e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1777051421.523954:0:27885:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000e331778b reply state 000000004f6860e4 transno 30064771136 ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2a000/0x85f51a6b96715f75 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x661a78f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051421.523970:0:27885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2a000/0x85f51a6b96715f75 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x661a78f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051421.523980:0:27885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x661a78f4 (ffff99d94e81c800) 00010000:00010000:0.0:1777051421.523984:0:27885:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1777051421.523987:0:27885:0:(service.c:177:ptlrpc_save_lock()) nlocks 1 00000100:00100000:0.0:1777051421.524417:0:27885:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7cd9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+26:137322:x1863365425962112:12345-192.168.201.46@tcp:36:lfs.0 Request processed in 10688us (12885us total) trans 30064771136 rc 0/0 00000100:00100000:0.0:1777051421.524431:0:27885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112003 00000100:00100000:2.0:1777051421.552286:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051421.552422:0:10328:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425962368 00000100:00100000:1.0:1777051421.552437:0:10328:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425962368 00000100:00100000:1.0:1777051421.552530:0:10328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112004 00000100:00100000:1.0:1777051421.552546:0:10328:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d944072d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+26:137325:x1863365425962368:12345-192.168.201.46@tcp:101:lfs.0 00010000:00010000:1.0:1777051421.552581:0:10328:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777051421.552613:0:10328:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48aa00/0x85f51a6b96715f83 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b62f3 expref: -99 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051421.552743:0:10328:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48b200/0x85f51a6b96715f8a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051421.552767:0:10328:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48b200/0x85f51a6b96715f8a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051421.552784:0:10328:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48b200/0x85f51a6b96715f8a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1777051421.552847:0:10328:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 12288 00000004:00200000:1.0:1777051421.552854:0:10328:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1777051421.552885:0:10328:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48b200/0x85f51a6b96715f8a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051421.552923:0:10328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48aa00/0x85f51a6b96715f83 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b62f3 expref: 28 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051421.552984:0:10328:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48b200/0x85f51a6b96715f8a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b62f3 expref: 27 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051421.552999:0:10328:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d9533ab000) 00010000:00010000:1.0:1777051421.553004:0:10328:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1777051421.553009:0:10328:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d94e48b200, rc 0) 00000100:00100000:1.0:1777051421.553150:0:10328:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d944072d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+27:137325:x1863365425962368:12345-192.168.201.46@tcp:101:lfs.0 Request processed in 603us (889us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051421.553164:0:10328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112004 00000100:00100000:2.0:1777051421.557427:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051421.557529:0:6579:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425962496 00000100:00100000:3.0:1777051421.557545:0:6579:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425962496 00000100:00100000:3.0:1777051421.557618:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112005 00000100:00100000:3.0:1777051421.557628:0:6579:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d944070000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+27:137325:x1863365425962496:12345-192.168.201.46@tcp:101:lfs.0 00010000:00010000:3.0:1777051421.557653:0:6579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777051421.557679:0:6579:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7e00/0x85f51a6b96715f91 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b62fa expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051421.557752:0:6579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6c00/0x85f51a6b96715f98 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051421.557769:0:6579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6c00/0x85f51a6b96715f98 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051421.557782:0:6579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6c00/0x85f51a6b96715f98 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051421.557800:0:6579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6800/0x85f51a6b96715f9f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x661a78f4 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051421.557807:0:6579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6800/0x85f51a6b96715f9f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x661a78f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051421.557814:0:6579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6800/0x85f51a6b96715f9f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x661a78f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051421.557979:0:6579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6200/0x85f51a6b96715fa6 lrc: 3/1,0 mode: --/PR res: [0x2000032e2:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051421.557998:0:6579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6200/0x85f51a6b96715fa6 lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051421.558010:0:6579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6200/0x85f51a6b96715fa6 lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1777051421.558082:0:6579:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000032e2:0x3:0x0]: returning size 4096 00000004:00200000:3.0:1777051421.558092:0:6579:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1777051421.558125:0:6579:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6200/0x85f51a6b96715fa6 lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051421.558164:0:6579:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6c00/0x85f51a6b96715f98 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051421.558176:0:6579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6c00/0x85f51a6b96715f98 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051421.558186:0:6579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6c00/0x85f51a6b96715f98 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051421.558256:0:6579:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6c00/0x85f51a6b96715f98 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051421.558269:0:6579:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d941ad6c00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:3.0:1777051421.558277:0:6579:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6c00/0x85f51a6b96715f98 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051421.558289:0:6579:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6c00/0x85f51a6b96715f98 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051421.558312:0:6579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d9533ab000) 00010000:00010000:3.0:1777051421.558318:0:6579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777051421.558328:0:6579:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6c00/0x85f51a6b96715f98 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051421.558339:0:6579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6c00/0x85f51a6b96715f98 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051421.558361:0:6579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6800/0x85f51a6b96715f9f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x661a78f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051421.558369:0:6579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6800/0x85f51a6b96715f9f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x661a78f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051421.558377:0:6579:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6800/0x85f51a6b96715f9f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x661a78f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051421.558384:0:6579:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d941ad6800 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:3.0:1777051421.558388:0:6579:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6800/0x85f51a6b96715f9f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x661a78f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051421.558397:0:6579:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6800/0x85f51a6b96715f9f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x661a78f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051421.558409:0:6579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x661a78f4 (ffff99d94e81c800) 00010000:00010000:3.0:1777051421.558413:0:6579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777051421.558425:0:6579:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6800/0x85f51a6b96715f9f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x661a78f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051421.558435:0:6579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6800/0x85f51a6b96715f9f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x661a78f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051421.558475:0:6579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7e00/0x85f51a6b96715f91 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b62fa expref: 29 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051421.558504:0:6579:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6200/0x85f51a6b96715fa6 lrc: 3/0,0 mode: PR/PR res: [0x2000032e2:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b62fa expref: 28 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051421.558517:0:6579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0x3:0x0].0x0 (ffff99d94e81c200) 00010000:00010000:3.0:1777051421.558521:0:6579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1777051421.558524:0:6579:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d941ad6200, rc 0) 00000100:00100000:2.0:1777051421.558721:0:6579:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d944070000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+28:137325:x1863365425962496:12345-192.168.201.46@tcp:101:lfs.0 Request processed in 1090us (1304us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051421.558733:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112005 00000100:00100000:3.0:1777051421.561793:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051421.561886:0:6581:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425962624 00000100:00100000:2.0:1777051421.561914:0:6581:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425962624 00000100:00100000:2.0:1777051421.561990:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112006 00000100:00100000:2.0:1777051421.562003:0:6581:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94c129f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+28:137325:x1863365425962624:12345-192.168.201.46@tcp:101:lfs.0 00010000:00010000:2.0:1777051421.562036:0:6581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051421.562092:0:6581:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d950262e00/0x85f51a6b96715fad lrc: 2/0,0 mode: --/CR res: [0x2000032e2:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6301 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051421.562507:0:6581:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263a00/0x85f51a6b96715fb4 lrc: 3/1,0 mode: --/CR res: [0x2000032e2:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051421.562524:0:6581:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263a00/0x85f51a6b96715fb4 lrc: 3/1,0 mode: CR/CR res: [0x2000032e2:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051421.562538:0:6581:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263a00/0x85f51a6b96715fb4 lrc: 3/1,0 mode: CR/CR res: [0x2000032e2:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051421.562559:0:6581:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263e00/0x85f51a6b96715fbb lrc: 3/1,0 mode: --/PR res: [0x2000032e2:0x3:0x0].0xac1bda01 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051421.562577:0:6581:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263e00/0x85f51a6b96715fbb lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0x3:0x0].0xac1bda01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051421.562587:0:6581:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263e00/0x85f51a6b96715fbb lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0x3:0x0].0xac1bda01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051421.562638:0:6581:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263a00/0x85f51a6b96715fb4 lrc: 3/1,0 mode: CR/CR res: [0x2000032e2:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051421.562648:0:6581:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263a00/0x85f51a6b96715fb4 lrc: 2/0,0 mode: CR/CR res: [0x2000032e2:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051421.562658:0:6581:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263a00/0x85f51a6b96715fb4 lrc: 3/0,0 mode: CR/CR res: [0x2000032e2:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051421.562668:0:6581:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d950263a00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:2.0:1777051421.562966:0:6581:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263a00/0x85f51a6b96715fb4 lrc: 3/0,0 mode: CR/CR res: [0x2000032e2:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051421.562979:0:6581:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263a00/0x85f51a6b96715fb4 lrc: 4/0,0 mode: CR/CR res: [0x2000032e2:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051421.562994:0:6581:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0x3:0x0].0x0 (ffff99d94e81c200) 00010000:00010000:2.0:1777051421.562999:0:6581:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777051421.563005:0:6581:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263a00/0x85f51a6b96715fb4 lrc: 2/0,0 mode: --/CR res: [0x2000032e2:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051421.563014:0:6581:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263a00/0x85f51a6b96715fb4 lrc: 0/0,0 mode: --/CR res: [0x2000032e2:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051421.563033:0:6581:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263e00/0x85f51a6b96715fbb lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0x3:0x0].0xac1bda01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051421.563043:0:6581:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263e00/0x85f51a6b96715fbb lrc: 2/0,0 mode: PR/PR res: [0x2000032e2:0x3:0x0].0xac1bda01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051421.563078:0:6581:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263e00/0x85f51a6b96715fbb lrc: 3/0,0 mode: PR/PR res: [0x2000032e2:0x3:0x0].0xac1bda01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051421.563088:0:6581:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d950263e00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:2.0:1777051421.563092:0:6581:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263e00/0x85f51a6b96715fbb lrc: 3/0,0 mode: PR/PR res: [0x2000032e2:0x3:0x0].0xac1bda01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051421.563101:0:6581:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263e00/0x85f51a6b96715fbb lrc: 4/0,0 mode: PR/PR res: [0x2000032e2:0x3:0x0].0xac1bda01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051421.563113:0:6581:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0x3:0x0].0xac1bda01 (ffff99d9413d0a00) 00010000:00010000:2.0:1777051421.563117:0:6581:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777051421.563121:0:6581:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263e00/0x85f51a6b96715fbb lrc: 2/0,0 mode: --/PR res: [0x2000032e2:0x3:0x0].0xac1bda01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051421.563130:0:6581:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263e00/0x85f51a6b96715fbb lrc: 0/0,0 mode: --/PR res: [0x2000032e2:0x3:0x0].0xac1bda01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051421.563176:0:6581:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950262e00/0x85f51a6b96715fad lrc: 1/0,0 mode: --/CR res: [0x2000032e2:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6301 expref: 29 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051421.563192:0:6581:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0x3:0x0].0x0 (ffff99d94e81c200) 00010000:00010000:2.0:1777051421.563222:0:6581:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777051421.563229:0:6581:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d950262e00/0x85f51a6b96715fad lrc: 0/0,0 mode: --/CR res: [0x2000032e2:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6301 expref: 29 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051421.563246:0:6581:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d950262e00, rc 0) 00000100:00100000:2.0:1777051421.563304:0:6581:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94c129f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+28:137325:x1863365425962624:12345-192.168.201.46@tcp:101:lfs.0 Request processed in 1303us (1518us total) trans 0 rc 301/301 00000100:00100000:2.0:1777051421.563316:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112006 00000100:00100000:1.0:1777051421.570458:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051421.570540:0:46497:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425962752 00000100:00100000:3.0:1777051421.570559:0:46497:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425962752 00000100:00100000:3.0:1777051421.570651:0:46497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112007 00000100:00100000:3.0:1777051421.570669:0:46497:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5fbe0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+28:137325:x1863365425962752:12345-192.168.201.46@tcp:101:lfs.0 00010000:00010000:3.0:1777051421.570698:0:46497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777051421.570729:0:46497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7400/0x85f51a6b96715fc2 lrc: 2/0,0 mode: --/CR res: [0x2000032e2:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6308 expref: -99 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051421.570820:0:46497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7600/0x85f51a6b96715fc9 lrc: 3/1,0 mode: --/CR res: [0x2000032e2:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051421.570841:0:46497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7600/0x85f51a6b96715fc9 lrc: 3/1,0 mode: CR/CR res: [0x2000032e2:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051421.570860:0:46497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7600/0x85f51a6b96715fc9 lrc: 3/1,0 mode: CR/CR res: [0x2000032e2:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051421.570881:0:46497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6000/0x85f51a6b96715fd0 lrc: 3/1,0 mode: --/PR res: [0x2000032e2:0x3:0x0].0xac1bda01 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051421.570894:0:46497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6000/0x85f51a6b96715fd0 lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0x3:0x0].0xac1bda01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051421.570907:0:46497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6000/0x85f51a6b96715fd0 lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0x3:0x0].0xac1bda01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051421.570963:0:46497:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7600/0x85f51a6b96715fc9 lrc: 4/1,0 mode: CR/CR res: [0x2000032e2:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051421.570975:0:46497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7600/0x85f51a6b96715fc9 lrc: 4/1,0 mode: CR/CR res: [0x2000032e2:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051421.570986:0:46497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7600/0x85f51a6b96715fc9 lrc: 3/0,0 mode: CR/CR res: [0x2000032e2:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051421.570997:0:46497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7600/0x85f51a6b96715fc9 lrc: 4/0,0 mode: CR/CR res: [0x2000032e2:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051421.571007:0:46497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d941ad7600 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:3.0:1777051421.571013:0:46497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7600/0x85f51a6b96715fc9 lrc: 4/0,0 mode: CR/CR res: [0x2000032e2:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051421.571026:0:46497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7600/0x85f51a6b96715fc9 lrc: 5/0,0 mode: CR/CR res: [0x2000032e2:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051421.571044:0:46497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0x3:0x0].0x0 (ffff99d94e81c200) 00010000:00010000:3.0:1777051421.571050:0:46497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777051421.571087:0:46497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7600/0x85f51a6b96715fc9 lrc: 3/0,0 mode: --/CR res: [0x2000032e2:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051421.571099:0:46497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7600/0x85f51a6b96715fc9 lrc: 0/0,0 mode: --/CR res: [0x2000032e2:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051421.571122:0:46497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6000/0x85f51a6b96715fd0 lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0x3:0x0].0xac1bda01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051421.571134:0:46497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6000/0x85f51a6b96715fd0 lrc: 2/0,0 mode: PR/PR res: [0x2000032e2:0x3:0x0].0xac1bda01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051421.571145:0:46497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6000/0x85f51a6b96715fd0 lrc: 3/0,0 mode: PR/PR res: [0x2000032e2:0x3:0x0].0xac1bda01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051421.571154:0:46497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d941ad6000 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:3.0:1777051421.571159:0:46497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6000/0x85f51a6b96715fd0 lrc: 3/0,0 mode: PR/PR res: [0x2000032e2:0x3:0x0].0xac1bda01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051421.571170:0:46497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6000/0x85f51a6b96715fd0 lrc: 4/0,0 mode: PR/PR res: [0x2000032e2:0x3:0x0].0xac1bda01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051421.571184:0:46497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0x3:0x0].0xac1bda01 (ffff99d9533ab600) 00010000:00010000:3.0:1777051421.571188:0:46497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777051421.571193:0:46497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6000/0x85f51a6b96715fd0 lrc: 2/0,0 mode: --/PR res: [0x2000032e2:0x3:0x0].0xac1bda01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051421.571256:0:46497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6000/0x85f51a6b96715fd0 lrc: 0/0,0 mode: --/PR res: [0x2000032e2:0x3:0x0].0xac1bda01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051421.571310:0:46497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7400/0x85f51a6b96715fc2 lrc: 1/0,0 mode: --/CR res: [0x2000032e2:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6308 expref: 29 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051421.571327:0:46497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0x3:0x0].0x0 (ffff99d94e81c200) 00010000:00010000:3.0:1777051421.571332:0:46497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777051421.571339:0:46497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7400/0x85f51a6b96715fc2 lrc: 0/0,0 mode: --/CR res: [0x2000032e2:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6308 expref: 29 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051421.571373:0:46497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d941ad7400, rc 0) 00000100:00100000:3.0:1777051421.571469:0:46497:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5fbe0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+28:137325:x1863365425962752:12345-192.168.201.46@tcp:101:lfs.0 Request processed in 803us (1027us total) trans 0 rc 301/301 00000100:00100000:3.0:1777051421.571482:0:46497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112007 00000100:00100000:0.0:1777051421.579511:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051421.579711:0:21368:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425962880 00000100:00100000:2.0:1777051421.579726:0:21368:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425962880 00000100:00100000:2.0:1777051421.579931:0:21368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112008 00000100:00100000:2.0:1777051421.579951:0:21368:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d950264a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+28:137325:x1863365425962880:12345-192.168.201.46@tcp:101:lfs.0 00010000:00010000:2.0:1777051421.579978:0:21368:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051421.580006:0:21368:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d950262e00/0x85f51a6b96715fd7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b630f expref: -99 pid: 21368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051421.580140:0:21368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263e00/0x85f51a6b96715fde lrc: 3/1,0 mode: --/PR res: [0x2000032e2:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051421.580165:0:21368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263e00/0x85f51a6b96715fde lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051421.580183:0:21368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263e00/0x85f51a6b96715fde lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1777051421.580254:0:21368:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000032e2:0x3:0x0]: returning size 4096 00000004:00200000:2.0:1777051421.580261:0:21368:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1777051421.580348:0:21368:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263e00/0x85f51a6b96715fde lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051421.580393:0:21368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d950262e00/0x85f51a6b96715fd7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b630f expref: 30 pid: 21368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051421.580427:0:21368:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263e00/0x85f51a6b96715fde lrc: 3/0,0 mode: PR/PR res: [0x2000032e2:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b630f expref: 29 pid: 21368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051421.580454:0:21368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0x3:0x0].0x0 (ffff99d94e81c200) 00010000:00010000:2.0:1777051421.580459:0:21368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1777051421.580466:0:21368:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d950263e00, rc 0) 00000100:00100000:2.0:1777051421.580561:0:21368:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d950264a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+29:137325:x1863365425962880:12345-192.168.201.46@tcp:101:lfs.0 Request processed in 614us (1061us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051421.580577:0:21368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112008 00000100:00100000:1.0:1777051421.593864:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051421.594221:0:27882:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425963008 00000100:00100000:2.0:1777051421.594236:0:27882:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425963008 00000100:00100000:2.0:1777051421.594334:0:27882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112009 00000100:00100000:2.0:1777051421.594351:0:27882:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5fbe2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+21:137325:x1863365425963008:12345-192.168.201.46@tcp:101:lfs.0 00010000:00010000:2.0:1777051421.594376:0:27882:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051421.594453:0:27882:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d950262e00/0x85f51a6b96715fe5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6316 expref: -99 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051421.594540:0:27882:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263a00/0x85f51a6b96715fec lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051421.594562:0:27882:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263a00/0x85f51a6b96715fec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051421.594581:0:27882:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263a00/0x85f51a6b96715fec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1777051421.594646:0:27882:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 12288 00000004:00200000:2.0:1777051421.594653:0:27882:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1777051421.594680:0:27882:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263a00/0x85f51a6b96715fec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051421.594725:0:27882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d950262e00/0x85f51a6b96715fe5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6316 expref: 23 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051421.594754:0:27882:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263a00/0x85f51a6b96715fec lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6316 expref: 22 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051421.594766:0:27882:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d9533ab000) 00010000:00010000:2.0:1777051421.594769:0:27882:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1777051421.594774:0:27882:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d950263a00, rc 0) 00000100:00100000:2.0:1777051421.594835:0:27882:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5fbe2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+22:137325:x1863365425963008:12345-192.168.201.46@tcp:101:lfs.0 Request processed in 488us (983us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051421.594849:0:27882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112009 00000100:00100000:1.0:1777051421.601965:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051421.602033:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051421.602115:0:103165:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425963136 00000100:00100000:3.0:1777051421.602130:0:103165:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425963136 00000100:00100000:1.0:1777051421.602154:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051421.602261:0:27884:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425963264 00000100:00100000:2.0:1777051421.602273:0:27884:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425963264 00000100:00100000:3.0:1777051421.602290:0:103165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 176 00000100:00100000:1.0:1777051421.602303:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051421.602306:0:55805:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425963392 00000100:00100000:3.0:1777051421.602319:0:103165:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29c4352d-3260-4734-909d-9ea5de9e7fa4+12:2436:x1863365425963136:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:0.0:1777051421.602321:0:55805:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425963392 00000100:00100000:2.0:1777051421.602376:0:27884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10427 00000100:00100000:2.0:1777051421.602398:0:27884:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f42c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+51:2437:x1863365425963264:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:0.0:1777051421.602432:0:55805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10428 00000100:00100000:0.0:1777051421.602455:0:55805:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f42c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c11b6966-0775-44d2-bdc6-c74c26eb2226+48:2436:x1863365425963392:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:1.0:1777051421.602568:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051421.602619:0:103165:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29c4352d-3260-4734-909d-9ea5de9e7fa4+12:2436:x1863365425963136:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 305us (656us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051421.602624:0:27884:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f42c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+51:2437:x1863365425963264:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 226us (584us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051421.602627:0:55805:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f42c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c11b6966-0775-44d2-bdc6-c74c26eb2226+48:2436:x1863365425963392:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 172us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051421.602634:0:13320:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425963776 00000100:00100000:1.0:1777051421.602656:0:13320:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425963776 00000100:00100000:3.0:1777051421.602665:0:103165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 176 00000100:00100000:2.0:1777051421.602668:0:27884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10427 00000100:00100000:0.0:1777051421.602687:0:55805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10428 00000100:00100000:2.0:1777051421.602731:0:27884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10429 00000100:00100000:0.0:1777051421.602773:0:8492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425963520 00000100:00100000:2.0:1777051421.602778:0:27884:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f42d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+47:2437:x1863365425963776:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:0.0:1777051421.602784:0:8492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425963520 00000100:00080000:3.0:1777051421.602784:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1777051421.602799:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1777051421.602811:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1777051421.602856:0:27884:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f42d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+47:2437:x1863365425963776:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 108us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051421.602880:0:8492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13376 00000100:00100000:2.0:1777051421.602881:0:27884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10429 00000100:00100000:1.0:1777051421.602978:0:8492:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f42e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+48:2437:x1863365425963520:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:3.0:1777051421.603004:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051421.603079:0:8492:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f42e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+48:2437:x1863365425963520:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 146us (751us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051421.603099:0:8492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13376 00000100:00100000:0.0:1777051421.603292:0:8628:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425963648 00000100:00100000:0.0:1777051421.603300:0:8628:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425963648 00000100:00080000:1.0:1777051421.603413:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1777051421.604367:0:8628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10430 00000100:00100000:0.0:1777051421.604389:0:8628:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94c128380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+51:2436:x1863365425963648:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:0.0:1777051421.604460:0:8628:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94c128380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+51:2436:x1863365425963648:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 78us (1463us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051421.604474:0:8628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10430 00000100:00100000:2.0:1777051421.604940:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051421.605297:0:6580:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425964032 00000100:00100000:3.0:1777051421.605308:0:6580:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425964032 00000100:00100000:2.0:1777051421.605518:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112010 00000100:00100000:2.0:1777051421.605536:0:6581:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d944071180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+29:137325:x1863365425964032:12345-192.168.201.46@tcp:101:lfs.0 00010000:00010000:2.0:1777051421.605556:0:6581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051421.605582:0:6581:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d950262e00/0x85f51a6b96715ff3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b631d expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1777051421.606043:0:6581:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000032e2:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1777051421.606362:0:6581:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950262e00/0x85f51a6b96715ff3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b631d expref: 31 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051421.606388:0:6581:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d9533ab000) 00010000:00010000:2.0:1777051421.606394:0:6581:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1777051421.606404:0:6581:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d950262e00/0x85f51a6b96715ff3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b631d expref: 31 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051421.606428:0:6581:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d950262e00, rc 0) 00000100:00100000:2.0:1777051421.606506:0:6581:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d944071180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+30:137325:x1863365425964032:12345-192.168.201.46@tcp:101:lfs.0 Request processed in 973us (1570us total) trans 30064771137 rc 301/301 00000100:00100000:2.0:1777051421.606519:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112010 00000100:00100000:1.0:1777051421.611162:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051421.611316:0:46494:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425964288 00000100:00100000:0.0:1777051421.611330:0:46494:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425964288 00000100:00100000:0.0:1777051421.611414:0:46494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112011 00000100:00100000:0.0:1777051421.611434:0:46494:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f42df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+30:137325:x1863365425964288:12345-192.168.201.46@tcp:36:lfs.0 00010000:00010000:0.0:1777051421.611522:0:46494:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777051421.611556:0:46494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263e00/0x85f51a6b96715fde lrc: 0/0,0 mode: --/PR res: [0x2000032e2:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b630f expref: 30 pid: 21368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051421.611585:0:46494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0x3:0x0].0x0 (ffff99d94e81c200) 00010000:00010000:0.0:1777051421.611593:0:46494:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1777051421.611686:0:46494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2a800/0x85f51a6b96716001 lrc: 3/0,1 mode: --/CW res: [0x2000032e2:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051421.611712:0:46494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2a800/0x85f51a6b96716001 lrc: 3/0,1 mode: CW/CW res: [0x2000032e2:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051421.611729:0:46494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2a800/0x85f51a6b96716001 lrc: 3/0,1 mode: CW/CW res: [0x2000032e2:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051421.612096:0:46494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2a400/0x85f51a6b96716008 lrc: 3/0,1 mode: --/PW res: [0x2000032e2:0x3:0x0].0xac1bda01 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051421.612116:0:46494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2a400/0x85f51a6b96716008 lrc: 3/0,1 mode: PW/PW res: [0x2000032e2:0x3:0x0].0xac1bda01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051421.612132:0:46494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2a400/0x85f51a6b96716008 lrc: 3/0,1 mode: PW/PW res: [0x2000032e2:0x3:0x0].0xac1bda01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051421.612872:0:46494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2bc00/0x85f51a6b9671600f lrc: 3/0,1 mode: --/PW res: [0x2000032e2:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051421.612893:0:46494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2bc00/0x85f51a6b9671600f lrc: 3/0,1 mode: PW/PW res: [0x2000032e2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051421.612908:0:46494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2bc00/0x85f51a6b9671600f lrc: 3/0,1 mode: PW/PW res: [0x2000032e2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1777051421.612934:0:46494:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000007a48909 reply state 00000000cbc00708 transno 30064771138 ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2bc00/0x85f51a6b9671600f lrc: 3/0,1 mode: PW/PW res: [0x2000032e2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051421.612953:0:46494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2bc00/0x85f51a6b9671600f lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051421.612965:0:46494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0x4:0x0].0x0 (ffff99d94e81c700) 00010000:00010000:0.0:1777051421.612971:0:46494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1777051421.612976:0:46494:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1777051421.612984:0:46494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000032e2:0x4:0x0]: returning size 4096 00010000:00010000:0.0:1777051421.612995:0:46494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2a800/0x85f51a6b96716001 lrc: 3/0,1 mode: CW/CW res: [0x2000032e2:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051421.613007:0:46494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2a800/0x85f51a6b96716001 lrc: 2/0,0 mode: CW/CW res: [0x2000032e2:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051421.613023:0:46494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2a800/0x85f51a6b96716001 lrc: 3/0,0 mode: CW/CW res: [0x2000032e2:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051421.613035:0:46494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94eb2a800 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:0.0:1777051421.613043:0:46494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2a800/0x85f51a6b96716001 lrc: 3/0,0 mode: CW/CW res: [0x2000032e2:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051421.613089:0:46494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2a800/0x85f51a6b96716001 lrc: 4/0,0 mode: CW/CW res: [0x2000032e2:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051421.613106:0:46494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0x3:0x0].0x0 (ffff99d94e81c200) 00010000:00010000:0.0:1777051421.613111:0:46494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777051421.613127:0:46494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2a800/0x85f51a6b96716001 lrc: 2/0,0 mode: --/CW res: [0x2000032e2:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051421.613139:0:46494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2a800/0x85f51a6b96716001 lrc: 0/0,0 mode: --/CW res: [0x2000032e2:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1777051421.613167:0:46494:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000007a48909 reply state 00000000cbc00708 transno 30064771138 ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2a400/0x85f51a6b96716008 lrc: 3/0,1 mode: PW/PW res: [0x2000032e2:0x3:0x0].0xac1bda01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051421.613186:0:46494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2a400/0x85f51a6b96716008 lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e2:0x3:0x0].0xac1bda01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051421.613230:0:46494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0x3:0x0].0xac1bda01 (ffff99d94e81ca00) 00010000:00010000:0.0:1777051421.613235:0:46494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1777051421.613238:0:46494:0:(service.c:177:ptlrpc_save_lock()) nlocks 1 00000100:00100000:0.0:1777051421.613349:0:46494:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f42df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+31:137325:x1863365425964288:12345-192.168.201.46@tcp:36:lfs.0 Request processed in 1918us (2192us total) trans 30064771138 rc 0/0 00000100:00100000:0.0:1777051421.613364:0:46494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112011 00000100:00100000:0.0:1777051421.617370:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051421.617488:0:6582:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425964544 00000100:00100000:2.0:1777051421.617499:0:6582:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425964544 00000100:00100000:2.0:1777051421.617585:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3349 00000100:00100000:2.0:1777051421.617602:0:6582:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d950267b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+31:137325:x1863365425964544:12345-192.168.201.46@tcp:35:lfs.0 00000100:00100000:2.0:1777051421.617872:0:6582:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d950267b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+32:137325:x1863365425964544:12345-192.168.201.46@tcp:35:lfs.0 Request processed in 271us (505us total) trans 30064771139 rc 0/0 00000100:00100000:2.0:1777051421.617894:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3349 00000040:00080000:2.0:1777051421.654448:0:103189:0:(llog.c:801:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:2.0:1777051421.654460:0:103189:0:(llog_cat.c:158:llog_cat_process_common()) processing log [0x1:0x2b:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1777051421.654490:0:103189:0:(llog.c:858:llog_process_thread()) stop processing plain [0x1:0x2b:0x0] index 4 count 3 00000040:00080000:2.0:1777051421.654503:0:103189:0:(llog.c:858:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00000100:00100000:2.0:1777051421.660393:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051421.660453:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051421.660505:0:6588:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425964800 00000100:00100000:0.0:1777051421.660521:0:6588:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425964800 00000100:00100000:1.0:1777051421.660550:0:27885:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425964672 00000100:00100000:1.0:1777051421.660580:0:27885:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425964672 00000100:00100000:0.0:1777051421.660602:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 18 00000100:00100000:0.0:1777051421.660616:0:6588:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d944072300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:c11b6966-0775-44d2-bdc6-c74c26eb2226+23:137329:x1863365425964800:12345-192.168.201.46@tcp:700:mkdir.0 00000100:00100000:1.0:1777051421.660677:0:27885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112012 00000100:00100000:1.0:1777051421.660697:0:27885:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d944070e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c11b6966-0775-44d2-bdc6-c74c26eb2226+23:2439:x1863365425964672:12345-192.168.201.46@tcp:41:mkdir.0 00000004:00000024:1.0:1777051421.660730:0:27885:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4194304 pending 0 free 1441579008 avail 1295339520 00000100:00100000:0.0:1777051421.660751:0:6588:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d944072300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:c11b6966-0775-44d2-bdc6-c74c26eb2226+23:137329:x1863365425964800:12345-192.168.201.46@tcp:700:mkdir.0 Request processed in 133us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051421.660768:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 18 00000100:00100000:1.0:1777051421.660803:0:27885:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d944070e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c11b6966-0775-44d2-bdc6-c74c26eb2226+22:2439:x1863365425964672:12345-192.168.201.46@tcp:41:mkdir.0 Request processed in 107us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051421.660813:0:27885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112012 00000100:00100000:1.0:1777051421.663412:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051421.664452:0:10328:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425965056 00000100:00100000:0.0:1777051421.664461:0:10328:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425965056 00000100:00100000:0.0:1777051421.664550:0:10328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112013 00000100:00100000:0.0:1777051421.664566:0:10328:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f42d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+22:137329:x1863365425965056:12345-192.168.201.46@tcp:36:mkdir.0 00010000:00010000:0.0:1777051421.664631:0:10328:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777051421.664667:0:10328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263a00/0x85f51a6b96715fec lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6316 expref: 22 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051421.664693:0:10328:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d9533ab000) 00010000:00010000:0.0:1777051421.664701:0:10328:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1777051421.665191:0:10328:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f42d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+21:137329:x1863365425965056:12345-192.168.201.46@tcp:36:mkdir.0 Request processed in 626us (1784us total) trans 0 rc -17/-17 00000100:00100000:0.0:1777051421.665244:0:10328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112013 00000100:00100000:2.0:1777051421.667780:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051421.670254:0:6579:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425965184 00000100:00100000:1.0:1777051421.670264:0:6579:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425965184 00000100:00100000:1.0:1777051421.670335:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112014 00000100:00100000:1.0:1777051421.670350:0:6579:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95088b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+21:137329:x1863365425965184:12345-192.168.201.46@tcp:101:mkdir.0 00010000:00010000:1.0:1777051421.670372:0:6579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777051421.670399:0:6579:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48ba00/0x85f51a6b96716016 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6324 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051421.670474:0:6579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48b000/0x85f51a6b9671601d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051421.670495:0:6579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48b000/0x85f51a6b9671601d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051421.670514:0:6579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48b000/0x85f51a6b9671601d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1777051421.670565:0:6579:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 12288 00000004:00200000:1.0:1777051421.670570:0:6579:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1777051421.670592:0:6579:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48b000/0x85f51a6b9671601d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051421.670618:0:6579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48ba00/0x85f51a6b96716016 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6324 expref: 23 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051421.670636:0:6579:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48b000/0x85f51a6b9671601d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6324 expref: 22 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051421.670645:0:6579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d9533ab000) 00010000:00010000:1.0:1777051421.670649:0:6579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1777051421.670653:0:6579:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d94e48b000, rc 0) 00000100:00100000:1.0:1777051421.670720:0:6579:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95088b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+22:137329:x1863365425965184:12345-192.168.201.46@tcp:101:mkdir.0 Request processed in 374us (2945us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051421.670728:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112014 00000100:00100000:2.0:1777051421.674472:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051421.675743:0:6580:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425965312 00000100:00100000:1.0:1777051421.675767:0:6580:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425965312 00000100:00100000:1.0:1777051421.675857:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112015 00000100:00100000:1.0:1777051421.675875:0:6580:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d950889500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+22:137329:x1863365425965312:12345-192.168.201.46@tcp:101:mkdir.0 00010000:00010000:1.0:1777051421.675898:0:6580:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777051421.675923:0:6580:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48be00/0x85f51a6b96716024 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b632b expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051421.676021:0:6580:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48bc00/0x85f51a6b9671602b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051421.676043:0:6580:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48bc00/0x85f51a6b9671602b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051421.676100:0:6580:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48bc00/0x85f51a6b9671602b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051421.676121:0:6580:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48a800/0x85f51a6b96716032 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x661a78f4 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051421.676152:0:6580:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48a800/0x85f51a6b96716032 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x661a78f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051421.676164:0:6580:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48a800/0x85f51a6b96716032 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x661a78f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051421.676322:0:6580:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48b800/0x85f51a6b96716039 lrc: 3/1,0 mode: --/PR res: [0x2000032e2:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051421.676339:0:6580:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48b800/0x85f51a6b96716039 lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051421.676353:0:6580:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48b800/0x85f51a6b96716039 lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1777051421.676399:0:6580:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000032e2:0x3:0x0]: returning size 4096 00000004:00200000:1.0:1777051421.676406:0:6580:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1777051421.676432:0:6580:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48b800/0x85f51a6b96716039 lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051421.676450:0:6580:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48bc00/0x85f51a6b9671602b lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051421.676482:0:6580:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48bc00/0x85f51a6b9671602b lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051421.676502:0:6580:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48bc00/0x85f51a6b9671602b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051421.676514:0:6580:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48bc00/0x85f51a6b9671602b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051421.676524:0:6580:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94e48bc00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:1.0:1777051421.676532:0:6580:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48bc00/0x85f51a6b9671602b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051421.676544:0:6580:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48bc00/0x85f51a6b9671602b lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051421.676563:0:6580:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d9533ab000) 00010000:00010000:1.0:1777051421.676568:0:6580:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777051421.676575:0:6580:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48bc00/0x85f51a6b9671602b lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051421.676587:0:6580:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48bc00/0x85f51a6b9671602b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051421.676604:0:6580:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48a800/0x85f51a6b96716032 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x661a78f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051421.676616:0:6580:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48a800/0x85f51a6b96716032 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x661a78f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051421.676626:0:6580:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48a800/0x85f51a6b96716032 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x661a78f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051421.676637:0:6580:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94e48a800 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:1.0:1777051421.676642:0:6580:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48a800/0x85f51a6b96716032 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x661a78f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051421.676653:0:6580:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48a800/0x85f51a6b96716032 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x661a78f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051421.676667:0:6580:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x661a78f4 (ffff99d94e81c800) 00010000:00010000:1.0:1777051421.676672:0:6580:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777051421.676677:0:6580:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48a800/0x85f51a6b96716032 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x661a78f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051421.676687:0:6580:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48a800/0x85f51a6b96716032 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x661a78f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051421.676725:0:6580:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48be00/0x85f51a6b96716024 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b632b expref: 24 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051421.676748:0:6580:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48b800/0x85f51a6b96716039 lrc: 3/0,0 mode: PR/PR res: [0x2000032e2:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b632b expref: 23 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051421.676762:0:6580:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0x3:0x0].0x0 (ffff99d94e81c200) 00010000:00010000:1.0:1777051421.676766:0:6580:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1777051421.676771:0:6580:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d94e48b800, rc 0) 00000100:00100000:1.0:1777051421.676851:0:6580:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d950889500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+23:137329:x1863365425965312:12345-192.168.201.46@tcp:101:mkdir.0 Request processed in 979us (2386us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051421.676865:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112015 00000100:00100000:2.0:1777051421.681103:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051421.681262:0:46497:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425965568 00000100:00100000:3.0:1777051421.681275:0:46497:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425965568 00000100:00100000:3.0:1777051421.681357:0:46497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112016 00000100:00100000:3.0:1777051421.681374:0:46497:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95088aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:c11b6966-0775-44d2-bdc6-c74c26eb2226+23:137329:x1863365425965568:12345-192.168.201.46@tcp:36:mkdir.0 00010000:00010000:3.0:1777051421.681433:0:46497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777051421.681470:0:46497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48b800/0x85f51a6b96716039 lrc: 0/0,0 mode: --/PR res: [0x2000032e2:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b632b expref: 23 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051421.681496:0:46497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0x3:0x0].0x0 (ffff99d94e81c200) 00010000:00010000:3.0:1777051421.681504:0:46497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1777051421.681646:0:46497:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95088aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:c11b6966-0775-44d2-bdc6-c74c26eb2226+22:137329:x1863365425965568:12345-192.168.201.46@tcp:36:mkdir.0 Request processed in 275us (548us total) trans 0 rc -17/-17 00000100:00100000:3.0:1777051421.681661:0:46497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112016 00000100:00100000:0.0:1777051421.685551:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051421.685750:0:21368:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425965696 00000100:00100000:3.0:1777051421.685759:0:21368:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425965696 00000100:00100000:3.0:1777051421.685820:0:21368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112017 00000100:00100000:3.0:1777051421.685835:0:21368:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d9418f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+22:137329:x1863365425965696:12345-192.168.201.46@tcp:101:mkdir.0 00010000:00010000:3.0:1777051421.685851:0:21368:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777051421.685874:0:21368:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7400/0x85f51a6b96716040 lrc: 2/0,0 mode: --/CR res: [0x2000032e2:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6332 expref: -99 pid: 21368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051421.685938:0:21368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6000/0x85f51a6b96716047 lrc: 3/1,0 mode: --/CR res: [0x2000032e2:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051421.685954:0:21368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6000/0x85f51a6b96716047 lrc: 3/1,0 mode: CR/CR res: [0x2000032e2:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051421.685964:0:21368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6000/0x85f51a6b96716047 lrc: 3/1,0 mode: CR/CR res: [0x2000032e2:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051421.685974:0:21368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7600/0x85f51a6b9671604e lrc: 3/1,0 mode: --/PR res: [0x2000032e2:0x3:0x0].0xac1bda01 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051421.685982:0:21368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7600/0x85f51a6b9671604e lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0x3:0x0].0xac1bda01 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051421.685991:0:21368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7600/0x85f51a6b9671604e lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0x3:0x0].0xac1bda01 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051421.686190:0:21368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7e00/0x85f51a6b96716055 lrc: 3/1,0 mode: --/PR res: [0x2000032e2:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051421.686210:0:21368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7e00/0x85f51a6b96716055 lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051421.686223:0:21368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7e00/0x85f51a6b96716055 lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1777051421.686270:0:21368:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000032e2:0x4:0x0]: returning size 4096 00000004:00200000:3.0:1777051421.686277:0:21368:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1777051421.686302:0:21368:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7e00/0x85f51a6b96716055 lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051421.686320:0:21368:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6000/0x85f51a6b96716047 lrc: 3/1,0 mode: CR/CR res: [0x2000032e2:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051421.686334:0:21368:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6000/0x85f51a6b96716047 lrc: 2/0,0 mode: CR/CR res: [0x2000032e2:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051421.686346:0:21368:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6000/0x85f51a6b96716047 lrc: 3/0,0 mode: CR/CR res: [0x2000032e2:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051421.686357:0:21368:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d941ad6000 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:3.0:1777051421.686364:0:21368:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6000/0x85f51a6b96716047 lrc: 3/0,0 mode: CR/CR res: [0x2000032e2:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051421.686378:0:21368:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6000/0x85f51a6b96716047 lrc: 4/0,0 mode: CR/CR res: [0x2000032e2:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051421.686394:0:21368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0x3:0x0].0x0 (ffff99d94e81c200) 00010000:00010000:3.0:1777051421.686400:0:21368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777051421.686406:0:21368:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6000/0x85f51a6b96716047 lrc: 2/0,0 mode: --/CR res: [0x2000032e2:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051421.686427:0:21368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6000/0x85f51a6b96716047 lrc: 0/0,0 mode: --/CR res: [0x2000032e2:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051421.686507:0:21368:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7600/0x85f51a6b9671604e lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0x3:0x0].0xac1bda01 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051421.686520:0:21368:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7600/0x85f51a6b9671604e lrc: 2/0,0 mode: PR/PR res: [0x2000032e2:0x3:0x0].0xac1bda01 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051421.686532:0:21368:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7600/0x85f51a6b9671604e lrc: 3/0,0 mode: PR/PR res: [0x2000032e2:0x3:0x0].0xac1bda01 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051421.686542:0:21368:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d941ad7600 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:3.0:1777051421.686548:0:21368:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7600/0x85f51a6b9671604e lrc: 3/0,0 mode: PR/PR res: [0x2000032e2:0x3:0x0].0xac1bda01 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051421.686558:0:21368:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7600/0x85f51a6b9671604e lrc: 4/0,0 mode: PR/PR res: [0x2000032e2:0x3:0x0].0xac1bda01 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051421.686571:0:21368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0x3:0x0].0xac1bda01 (ffff99d94e81ca00) 00010000:00010000:3.0:1777051421.686575:0:21368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777051421.686580:0:21368:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7600/0x85f51a6b9671604e lrc: 2/0,0 mode: --/PR res: [0x2000032e2:0x3:0x0].0xac1bda01 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051421.686589:0:21368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7600/0x85f51a6b9671604e lrc: 0/0,0 mode: --/PR res: [0x2000032e2:0x3:0x0].0xac1bda01 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051421.686626:0:21368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7400/0x85f51a6b96716040 lrc: 0/0,0 mode: --/CR res: [0x2000032e2:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6332 expref: 24 pid: 21368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051421.686656:0:21368:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7e00/0x85f51a6b96716055 lrc: 3/0,0 mode: PR/PR res: [0x2000032e2:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6332 expref: 23 pid: 21368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051421.686671:0:21368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0x4:0x0].0x0 (ffff99d94e81c700) 00010000:00010000:3.0:1777051421.686675:0:21368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1777051421.686680:0:21368:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d941ad7e00, rc 0) 00000100:00100000:3.0:1777051421.686770:0:21368:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d9418f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+23:137329:x1863365425965696:12345-192.168.201.46@tcp:101:mkdir.0 Request processed in 936us (1221us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051421.686783:0:21368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112017 00000100:00100000:2.0:1777051421.702272:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051421.702342:0:27882:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425965824 00000100:00100000:0.0:1777051421.702354:0:27882:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425965824 00000100:00100000:0.0:1777051421.702425:0:27882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112018 00000100:00100000:0.0:1777051421.702436:0:27882:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95088ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+23:137330:x1863365425965824:12345-192.168.201.46@tcp:101:rm.0 00010000:00010000:0.0:1777051421.702461:0:27882:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051421.702487:0:27882:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2a600/0x85f51a6b9671605c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6339 expref: -99 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051421.702570:0:27882:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b600/0x85f51a6b96716063 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051421.702592:0:27882:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b600/0x85f51a6b96716063 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051421.702610:0:27882:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b600/0x85f51a6b96716063 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051421.702627:0:27882:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b800/0x85f51a6b9671606a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x661a78f4 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051421.702639:0:27882:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b800/0x85f51a6b9671606a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x661a78f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051421.702651:0:27882:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b800/0x85f51a6b9671606a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x661a78f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051421.702753:0:27882:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2aa00/0x85f51a6b96716071 lrc: 3/1,0 mode: --/PR res: [0x2000032e2:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051421.702764:0:27882:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2aa00/0x85f51a6b96716071 lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0x3:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051421.702772:0:27882:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2aa00/0x85f51a6b96716071 lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0x3:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1777051421.702807:0:27882:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000032e2:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1777051421.702812:0:27882:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1777051421.702851:0:27882:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2aa00/0x85f51a6b96716071 lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0x3:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051421.702864:0:27882:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b600/0x85f51a6b96716063 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051421.702872:0:27882:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b600/0x85f51a6b96716063 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051421.702879:0:27882:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b600/0x85f51a6b96716063 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051421.702886:0:27882:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b600/0x85f51a6b96716063 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051421.702893:0:27882:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94eb2b600 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:0.0:1777051421.702897:0:27882:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b600/0x85f51a6b96716063 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051421.702905:0:27882:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b600/0x85f51a6b96716063 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051421.702916:0:27882:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d9533ab000) 00010000:00010000:0.0:1777051421.702919:0:27882:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777051421.702924:0:27882:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b600/0x85f51a6b96716063 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051421.702931:0:27882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b600/0x85f51a6b96716063 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051421.702944:0:27882:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b800/0x85f51a6b9671606a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x661a78f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051421.702959:0:27882:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b800/0x85f51a6b9671606a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x661a78f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051421.702970:0:27882:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b800/0x85f51a6b9671606a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x661a78f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051421.702979:0:27882:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94eb2b800 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:0.0:1777051421.702984:0:27882:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b800/0x85f51a6b9671606a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x661a78f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051421.702994:0:27882:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b800/0x85f51a6b9671606a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x661a78f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051421.703006:0:27882:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x661a78f4 (ffff99d94e81c800) 00010000:00010000:0.0:1777051421.703010:0:27882:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777051421.703015:0:27882:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b800/0x85f51a6b9671606a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x661a78f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051421.703024:0:27882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b800/0x85f51a6b9671606a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x661a78f4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051421.703094:0:27882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2a600/0x85f51a6b9671605c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6339 expref: 25 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051421.703116:0:27882:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2aa00/0x85f51a6b96716071 lrc: 3/0,0 mode: PR/PR res: [0x2000032e2:0x3:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6339 expref: 24 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051421.703129:0:27882:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0x3:0x0].0x0 (ffff99d94e81c200) 00010000:00010000:0.0:1777051421.703133:0:27882:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1777051421.703139:0:27882:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d94eb2aa00, rc 0) 00000100:00100000:0.0:1777051421.703310:0:27882:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95088ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+24:137330:x1863365425965824:12345-192.168.201.46@tcp:101:rm.0 Request processed in 871us (1044us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051421.703324:0:27882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112018 00000100:00100000:2.0:1777051421.710946:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051421.711093:0:6579:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425965952 00000100:00100000:3.0:1777051421.711106:0:6579:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425965952 00000100:00100000:2.0:1777051421.711240:0:8492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112019 00000100:00100000:2.0:1777051421.711262:0:8492:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d950889c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+24:137330:x1863365425965952:12345-192.168.201.46@tcp:101:rm.0 00010000:00010000:2.0:1777051421.711286:0:8492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051421.711310:0:8492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263800/0x85f51a6b96716078 lrc: 2/0,0 mode: --/CR res: [0x2000032e2:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6340 expref: -99 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051421.711390:0:8492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263600/0x85f51a6b9671607f lrc: 3/1,0 mode: --/CR res: [0x2000032e2:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051421.711411:0:8492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263600/0x85f51a6b9671607f lrc: 3/1,0 mode: CR/CR res: [0x2000032e2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051421.711428:0:8492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263600/0x85f51a6b9671607f lrc: 3/1,0 mode: CR/CR res: [0x2000032e2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051421.711450:0:8492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263c00/0x85f51a6b96716086 lrc: 3/1,0 mode: --/PR res: [0x2000032e2:0x4:0x0].0x4b5e7af5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051421.711462:0:8492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263c00/0x85f51a6b96716086 lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0x4:0x0].0x4b5e7af5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051421.711472:0:8492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263c00/0x85f51a6b96716086 lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0x4:0x0].0x4b5e7af5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051421.711522:0:8492:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263600/0x85f51a6b9671607f lrc: 4/1,0 mode: CR/CR res: [0x2000032e2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051421.711534:0:8492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263600/0x85f51a6b9671607f lrc: 4/1,0 mode: CR/CR res: [0x2000032e2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051421.711544:0:8492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263600/0x85f51a6b9671607f lrc: 3/0,0 mode: CR/CR res: [0x2000032e2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051421.711554:0:8492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263600/0x85f51a6b9671607f lrc: 4/0,0 mode: CR/CR res: [0x2000032e2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051421.711563:0:8492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d950263600 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:2.0:1777051421.711569:0:8492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263600/0x85f51a6b9671607f lrc: 4/0,0 mode: CR/CR res: [0x2000032e2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051421.711579:0:8492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263600/0x85f51a6b9671607f lrc: 5/0,0 mode: CR/CR res: [0x2000032e2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051421.711596:0:8492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0x4:0x0].0x0 (ffff99d94e81c700) 00010000:00010000:2.0:1777051421.711600:0:8492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777051421.711607:0:8492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263600/0x85f51a6b9671607f lrc: 3/0,0 mode: --/CR res: [0x2000032e2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051421.711618:0:8492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263600/0x85f51a6b9671607f lrc: 0/0,0 mode: --/CR res: [0x2000032e2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051421.711636:0:8492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263c00/0x85f51a6b96716086 lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0x4:0x0].0x4b5e7af5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051421.711646:0:8492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263c00/0x85f51a6b96716086 lrc: 2/0,0 mode: PR/PR res: [0x2000032e2:0x4:0x0].0x4b5e7af5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051421.711655:0:8492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263c00/0x85f51a6b96716086 lrc: 3/0,0 mode: PR/PR res: [0x2000032e2:0x4:0x0].0x4b5e7af5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051421.711663:0:8492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d950263c00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:2.0:1777051421.711668:0:8492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263c00/0x85f51a6b96716086 lrc: 3/0,0 mode: PR/PR res: [0x2000032e2:0x4:0x0].0x4b5e7af5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051421.711677:0:8492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263c00/0x85f51a6b96716086 lrc: 4/0,0 mode: PR/PR res: [0x2000032e2:0x4:0x0].0x4b5e7af5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051421.711690:0:8492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0x4:0x0].0x4b5e7af5 (ffff99d9413d0a00) 00010000:00010000:2.0:1777051421.711694:0:8492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777051421.711698:0:8492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263c00/0x85f51a6b96716086 lrc: 2/0,0 mode: --/PR res: [0x2000032e2:0x4:0x0].0x4b5e7af5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051421.711707:0:8492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263c00/0x85f51a6b96716086 lrc: 0/0,0 mode: --/PR res: [0x2000032e2:0x4:0x0].0x4b5e7af5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051421.711750:0:8492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263800/0x85f51a6b96716078 lrc: 1/0,0 mode: --/CR res: [0x2000032e2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6340 expref: 25 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051421.712105:0:8492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0x4:0x0].0x0 (ffff99d94e81c700) 00010000:00010000:2.0:1777051421.712110:0:8492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777051421.712118:0:8492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263800/0x85f51a6b96716078 lrc: 0/0,0 mode: --/CR res: [0x2000032e2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6340 expref: 25 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051421.712136:0:8492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d950263800, rc 0) 00000100:00100000:2.0:1777051421.712277:0:8492:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d950889c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+24:137330:x1863365425965952:12345-192.168.201.46@tcp:101:rm.0 Request processed in 1020us (1338us total) trans 0 rc 301/301 00000100:00100000:2.0:1777051421.712290:0:8492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112019 00000100:00100000:2.0:1777051421.724028:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051421.724157:0:6580:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425966208 00000100:00100000:1.0:1777051421.724171:0:6580:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425966208 00000100:00100000:1.0:1777051421.724305:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112020 00000100:00100000:1.0:1777051421.724320:0:6580:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f97df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+24:137331:x1863365425966208:12345-192.168.201.46@tcp:101:dd.0 00010000:00010000:1.0:1777051421.724346:0:6580:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777051421.724351:0:6580:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1777051421.724383:0:6580:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7e00/0x85f51a6b96716055 lrc: 0/0,0 mode: --/PR res: [0x2000032e2:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6332 expref: 24 pid: 21368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051421.724408:0:6580:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0x4:0x0].0x0 (ffff99d94e81c700) 00010000:00010000:1.0:1777051421.724415:0:6580:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1777051421.724431:0:6580:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48a800/0x85f51a6b9671608d lrc: 2/0,0 mode: --/CW res: [0x2000032e2:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6347 expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051421.724545:0:6580:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48bc00/0x85f51a6b96716094 lrc: 3/0,1 mode: --/CW res: [0x2000032e2:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051421.724564:0:6580:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48bc00/0x85f51a6b96716094 lrc: 3/0,1 mode: CW/CW res: [0x2000032e2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051421.724580:0:6580:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48bc00/0x85f51a6b96716094 lrc: 3/0,1 mode: CW/CW res: [0x2000032e2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051421.724601:0:6580:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48ba00/0x85f51a6b9671609b lrc: 3/0,1 mode: --/PW res: [0x2000032e2:0x4:0x0].0x4b5e7af5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051421.724612:0:6580:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48ba00/0x85f51a6b9671609b lrc: 3/0,1 mode: PW/PW res: [0x2000032e2:0x4:0x0].0x4b5e7af5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051421.724623:0:6580:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48ba00/0x85f51a6b9671609b lrc: 3/0,1 mode: PW/PW res: [0x2000032e2:0x4:0x0].0x4b5e7af5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1777051421.727286:0:6580:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x1e3:0x0], index 1: 0 00010000:00010000:1.0:1777051421.727536:0:6580:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48a600/0x85f51a6b967160a2 lrc: 3/1,0 mode: --/PR res: [0x2000032e3:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051421.727555:0:6580:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48a600/0x85f51a6b967160a2 lrc: 3/1,0 mode: PR/PR res: [0x2000032e3:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051421.727568:0:6580:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48a600/0x85f51a6b967160a2 lrc: 3/1,0 mode: PR/PR res: [0x2000032e3:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051421.727615:0:6580:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48bc00/0x85f51a6b96716094 lrc: 4/0,1 mode: CW/CW res: [0x2000032e2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051421.727627:0:6580:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48bc00/0x85f51a6b96716094 lrc: 4/0,1 mode: CW/CW res: [0x2000032e2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051421.727638:0:6580:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48bc00/0x85f51a6b96716094 lrc: 3/0,0 mode: CW/CW res: [0x2000032e2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051421.727648:0:6580:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48bc00/0x85f51a6b96716094 lrc: 4/0,0 mode: CW/CW res: [0x2000032e2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051421.727658:0:6580:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94e48bc00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:1.0:1777051421.727936:0:6580:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48bc00/0x85f51a6b96716094 lrc: 4/0,0 mode: CW/CW res: [0x2000032e2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051421.727950:0:6580:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48bc00/0x85f51a6b96716094 lrc: 5/0,0 mode: CW/CW res: [0x2000032e2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051421.727966:0:6580:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0x4:0x0].0x0 (ffff99d94e81c700) 00010000:00010000:1.0:1777051421.727971:0:6580:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777051421.727977:0:6580:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48bc00/0x85f51a6b96716094 lrc: 3/0,0 mode: --/CW res: [0x2000032e2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051421.727987:0:6580:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48bc00/0x85f51a6b96716094 lrc: 0/0,0 mode: --/CW res: [0x2000032e2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1777051421.728006:0:6580:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000077e6a919 reply state 000000000dd17014 transno 30064771140 ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48ba00/0x85f51a6b9671609b lrc: 3/0,1 mode: PW/PW res: [0x2000032e2:0x4:0x0].0x4b5e7af5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051421.728024:0:6580:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48ba00/0x85f51a6b9671609b lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e2:0x4:0x0].0x4b5e7af5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051421.728034:0:6580:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0x4:0x0].0x4b5e7af5 (ffff99d94e6b6c00) 00010000:00010000:1.0:1777051421.728038:0:6580:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1777051421.728042:0:6580:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1777051421.728111:0:6580:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48a800/0x85f51a6b9671608d lrc: 0/0,0 mode: --/CW res: [0x2000032e2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6347 expref: 26 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051421.728134:0:6580:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48a600/0x85f51a6b967160a2 lrc: 3/0,0 mode: PR/PR res: [0x2000032e3:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6347 expref: 25 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051421.728147:0:6580:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e3:0x3:0x0].0x0 (ffff99d94e6b6f00) 00010000:00010000:1.0:1777051421.728150:0:6580:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1777051421.728154:0:6580:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d94e48a600, rc 0) 00000100:00100000:1.0:1777051421.728516:0:6580:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f97df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+26:137331:x1863365425966208:12345-192.168.201.46@tcp:101:dd.0 Request processed in 4197us (4495us total) trans 30064771140 rc 0/0 00000100:00100000:1.0:1777051421.728536:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112020 00000100:00100000:1.0:1777051421.762088:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051421.762474:0:8470:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425966336 00000100:00100000:0.0:1777051421.762488:0:8470:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425966336 00000100:00100000:0.0:1777051421.762571:0:8470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 7998 00000100:00100000:0.0:1777051421.762587:0:8470:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95aecd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+48:137331:x1863365425966336:12345-192.168.201.46@tcp:101:dd.0 00010000:00010000:0.0:1777051421.762609:0:8470:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051421.762639:0:8470:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d630161e/0x85f51a6b967160b0 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x1e3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b634e expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1777051421.762702:0:8470:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x1e3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1777051421.762732:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777051421.762736:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777051421.762749:0:8470:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d630161e/0x85f51a6b967160b0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b634e expref: 49 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051421.762778:0:8470:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d630161e/0x85f51a6b967160b0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b634e expref: 49 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051421.762800:0:8470:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d94eb2a600, rc 0) 00000100:00100000:0.0:1777051421.762889:0:8470:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95aecd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+49:137331:x1863365425966336:12345-192.168.201.46@tcp:101:dd.0 Request processed in 303us (835us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051421.762901:0:8470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 7998 00010000:00010000:2.0:1777051421.783226:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1777051421.796364:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051421.796490:0:27888:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425966464 00000100:00100000:1.0:1777051421.796503:0:27888:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425966464 00002000:00100000:1.0:1777051421.796563:0:27888:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x1e3:0x0] (0->1048575) req@ffff99d95f97f480 x1863365425966464/t0(0) o4->c11b6966-0775-44d2-bdc6-c74c26eb2226@192.168.201.46@tcp:382/0 lens 488/0 e 0 to 0 dl 1777051432 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1777051421.796581:0:27888:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99d95f97f480 with x1863365425966464 ext(0->1048575) 00002000:00010000:1.0:1777051421.796590:0:27888:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99d95f97f480 00000100:00100000:1.0:1777051421.796663:0:27888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 1766 00000100:00100000:1.0:1777051421.796699:0:27888:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f97f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+49:2436:x1863365425966464:12345-192.168.201.46@tcp:4:dd.0 00000100:00100000:0.0:1777051421.823631:0:27888:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f97f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+51:2436:x1863365425966464:12345-192.168.201.46@tcp:4:dd.0 Request processed in 26942us (27570us total) trans 4294968357 rc 0/0 00000100:00100000:0.0:1777051421.823658:0:27888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 1766 00002000:00100000:0.0:1777051421.823678:0:27888:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x1e3:0x0] (0->1048575) req@ffff99d95f97f480 x1863365425966464/t4294968357(0) o4->c11b6966-0775-44d2-bdc6-c74c26eb2226@192.168.201.46@tcp:382/0 lens 488/448 e 0 to 0 dl 1777051432 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1777051421.823696:0:27888:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99d95f97f480 with x1863365425966464 ext(0->1048575) 00002000:00010000:0.0:1777051421.823705:0:27888:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99d95f97f480 00000100:00100000:2.0:1777051421.827037:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051421.827320:0:46494:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425966592 00000100:00100000:0.0:1777051421.827333:0:46494:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425966592 00000100:00100000:0.0:1777051421.827393:0:46494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112021 00000100:00100000:0.0:1777051421.827404:0:46494:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f97c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c11b6966-0775-44d2-bdc6-c74c26eb2226+26:137331:x1863365425966592:12345-192.168.201.46@tcp:44:dd.0 00000001:00080000:1.0:1777051421.833356:0:103159:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771140 is committed 00000001:00080000:1.0:1777051421.833405:0:103159:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771139 is committed 00010000:00010000:2.0:1777051421.833505:0:3664:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2a000/0x85f51a6b96715f75 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x661a78f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051421.833526:0:3664:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2a000/0x85f51a6b96715f75 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x661a78f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051421.833538:0:3664:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2a000/0x85f51a6b96715f75 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x661a78f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051421.833549:0:3664:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94eb2a000 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:2.0:1777051421.833557:0:3664:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2a000/0x85f51a6b96715f75 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x661a78f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051421.833570:0:3664:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2a000/0x85f51a6b96715f75 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x661a78f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051421.833595:0:3664:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x661a78f4 (ffff99d94e81c800) 00010000:00010000:2.0:1777051421.833600:0:3664:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777051421.833607:0:3664:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2a000/0x85f51a6b96715f75 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x661a78f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051421.833619:0:3664:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2a000/0x85f51a6b96715f75 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x661a78f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051421.833677:0:3664:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b400/0x85f51a6b96715f7c lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e2:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051421.833684:0:3663:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48ba00/0x85f51a6b9671609b lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e2:0x4:0x0].0x4b5e7af5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051421.833693:0:3664:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b400/0x85f51a6b96715f7c lrc: 2/0,0 mode: TXN/TXN res: [0x2000032e2:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051421.833715:0:46494:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f97c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c11b6966-0775-44d2-bdc6-c74c26eb2226+23:137331:x1863365425966592:12345-192.168.201.46@tcp:44:dd.0 Request processed in 6298us (6670us total) trans 0 rc 0/0 00010000:00010000:0.0:1777051421.834004:0:3663:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48ba00/0x85f51a6b9671609b lrc: 2/0,0 mode: TXN/TXN res: [0x2000032e2:0x4:0x0].0x4b5e7af5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051421.834018:0:3663:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48ba00/0x85f51a6b9671609b lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e2:0x4:0x0].0x4b5e7af5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051421.834046:0:3663:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94e48ba00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:0.0:1777051421.834092:0:3663:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48ba00/0x85f51a6b9671609b lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e2:0x4:0x0].0x4b5e7af5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051421.834107:0:3663:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48ba00/0x85f51a6b9671609b lrc: 4/0,0 mode: TXN/TXN res: [0x2000032e2:0x4:0x0].0x4b5e7af5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051421.834131:0:3663:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0x4:0x0].0x4b5e7af5 (ffff99d94e6b6c00) 00010000:00010000:0.0:1777051421.834137:0:3663:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777051421.834145:0:3663:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48ba00/0x85f51a6b9671609b lrc: 2/0,0 mode: --/TXN res: [0x2000032e2:0x4:0x0].0x4b5e7af5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051421.834156:0:3663:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48ba00/0x85f51a6b9671609b lrc: 0/0,0 mode: --/TXN res: [0x2000032e2:0x4:0x0].0x4b5e7af5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051421.834422:0:3664:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b400/0x85f51a6b96715f7c lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e2:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051421.834434:0:3664:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94eb2b400 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:2.0:1777051421.834440:0:3664:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b400/0x85f51a6b96715f7c lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e2:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051421.834453:0:3664:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b400/0x85f51a6b96715f7c lrc: 4/0,0 mode: TXN/TXN res: [0x2000032e2:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051421.834471:0:3664:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0x3:0x0].0x0 (ffff99d94e81c200) 00010000:00010000:2.0:1777051421.834478:0:3664:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777051421.834484:0:3664:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b400/0x85f51a6b96715f7c lrc: 2/0,0 mode: --/TXN res: [0x2000032e2:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051421.834496:0:3664:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b400/0x85f51a6b96715f7c lrc: 0/0,0 mode: --/TXN res: [0x2000032e2:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051421.834534:0:3664:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2a400/0x85f51a6b96716008 lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e2:0x3:0x0].0xac1bda01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051421.834545:0:3664:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2a400/0x85f51a6b96716008 lrc: 2/0,0 mode: TXN/TXN res: [0x2000032e2:0x3:0x0].0xac1bda01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051421.834555:0:3664:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2a400/0x85f51a6b96716008 lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e2:0x3:0x0].0xac1bda01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051421.834564:0:3664:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94eb2a400 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:2.0:1777051421.834571:0:3664:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2a400/0x85f51a6b96716008 lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e2:0x3:0x0].0xac1bda01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051421.834582:0:3664:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2a400/0x85f51a6b96716008 lrc: 4/0,0 mode: TXN/TXN res: [0x2000032e2:0x3:0x0].0xac1bda01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051421.834657:0:3664:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0x3:0x0].0xac1bda01 (ffff99d94e81ca00) 00010000:00010000:2.0:1777051421.834664:0:3664:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777051421.834670:0:3664:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2a400/0x85f51a6b96716008 lrc: 2/0,0 mode: --/TXN res: [0x2000032e2:0x3:0x0].0xac1bda01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051421.834681:0:3664:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2a400/0x85f51a6b96716008 lrc: 0/0,0 mode: --/TXN res: [0x2000032e2:0x3:0x0].0xac1bda01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051421.834702:0:3664:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2bc00/0x85f51a6b9671600f lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051421.834712:0:3664:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2bc00/0x85f51a6b9671600f lrc: 2/0,0 mode: TXN/TXN res: [0x2000032e2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051421.834721:0:3664:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2bc00/0x85f51a6b9671600f lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051421.834729:0:3664:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94eb2bc00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:2.0:1777051421.834734:0:3664:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2bc00/0x85f51a6b9671600f lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051421.834750:0:3664:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2bc00/0x85f51a6b9671600f lrc: 4/0,0 mode: TXN/TXN res: [0x2000032e2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051421.834763:0:3664:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0x4:0x0].0x0 (ffff99d94e81c700) 00010000:00010000:2.0:1777051421.834767:0:3664:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777051421.834772:0:3664:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2bc00/0x85f51a6b9671600f lrc: 2/0,0 mode: --/TXN res: [0x2000032e2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051421.834781:0:3664:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2bc00/0x85f51a6b9671600f lrc: 0/0,0 mode: --/TXN res: [0x2000032e2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051421.835113:0:46494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112021 00000100:00100000:2.0:1777051421.837705:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051421.837835:0:55805:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425966720 00000100:00100000:0.0:1777051421.837854:0:55805:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425966720 00000100:00100000:0.0:1777051421.837977:0:55805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 7999 00000100:00100000:0.0:1777051421.837996:0:55805:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f97ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c11b6966-0775-44d2-bdc6-c74c26eb2226+51:2437:x1863365425966720:12345-192.168.201.46@tcp:16:dd.0 00000001:00080000:1.0:1777051421.845858:0:9540:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0001: transno 4294968357 is committed 00000100:00100000:0.0:1777051421.846387:0:55805:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f97ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c11b6966-0775-44d2-bdc6-c74c26eb2226+49:2437:x1863365425966720:12345-192.168.201.46@tcp:16:dd.0 Request processed in 8386us (8675us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051421.846408:0:55805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 7999 00000040:00080000:2.0:1777051421.846465:0:104226:0:(llog.c:801:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1777051421.846477:0:104226:0:(llog_cat.c:158:llog_cat_process_common()) processing log [0x1:0x12:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1777051421.846608:0:104226:0:(llog.c:858:llog_process_thread()) stop processing plain [0x1:0x12:0x0] index 3 count 2 00000040:00080000:2.0:1777051421.846621:0:104226:0:(llog.c:858:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1777051421.854123:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051421.854287:0:24269:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425966976 00000100:00100000:0.0:1777051421.854302:0:24269:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425966976 00000100:00100000:0.0:1777051421.854376:0:24269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3350 00000100:00100000:0.0:1777051421.854394:0:24269:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95aecea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+22:137331:x1863365425966976:12345-192.168.201.46@tcp:35:dd.0 00000100:00100000:0.0:1777051421.855121:0:24269:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95aecea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+23:137331:x1863365425966976:12345-192.168.201.46@tcp:35:dd.0 Request processed in 728us (1006us total) trans 30064771141 rc 0/0 00000100:00100000:0.0:1777051421.855138:0:24269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3350 00000100:00100000:1.0:1777051421.877013:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051421.878096:0:27885:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425967104 00000100:00100000:0.0:1777051421.878113:0:27885:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425967104 00000100:00100000:0.0:1777051421.878245:0:27885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112022 00000100:00100000:0.0:1777051421.878265:0:27885:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95aecca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c11b6966-0775-44d2-bdc6-c74c26eb2226+23:137332:x1863365425967104:12345-192.168.201.46@tcp:101:lfs.0 00010000:00010000:0.0:1777051421.878299:0:27885:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051421.878327:0:27885:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b800/0x85f51a6b967160b7 lrc: 2/0,0 mode: --/CR res: [0x2000032e2:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6355 expref: -99 pid: 27885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051421.878430:0:27885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b600/0x85f51a6b967160be lrc: 3/1,0 mode: --/CR res: [0x2000032e2:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051421.878453:0:27885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b600/0x85f51a6b967160be lrc: 3/1,0 mode: CR/CR res: [0x2000032e2:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051421.878470:0:27885:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b600/0x85f51a6b967160be lrc: 3/1,0 mode: CR/CR res: [0x2000032e2:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051421.878493:0:27885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2ae00/0x85f51a6b967160c5 lrc: 3/1,0 mode: --/PR res: [0x2000032e2:0x3:0x0].0xac1bda01 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051421.878506:0:27885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2ae00/0x85f51a6b967160c5 lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0x3:0x0].0xac1bda01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051421.878517:0:27885:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2ae00/0x85f51a6b967160c5 lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0x3:0x0].0xac1bda01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051421.878647:0:27885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2ac00/0x85f51a6b967160cc lrc: 3/1,0 mode: --/PR res: [0x2000032e2:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051421.878659:0:27885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2ac00/0x85f51a6b967160cc lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0x4:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051421.878667:0:27885:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2ac00/0x85f51a6b967160cc lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0x4:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1777051421.878702:0:27885:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000032e2:0x4:0x0]: returning size 4096 00000004:00200000:0.0:1777051421.878706:0:27885:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1777051421.878728:0:27885:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2ac00/0x85f51a6b967160cc lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0x4:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051421.878746:0:27885:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b600/0x85f51a6b967160be lrc: 4/1,0 mode: CR/CR res: [0x2000032e2:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051421.878754:0:27885:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b600/0x85f51a6b967160be lrc: 4/1,0 mode: CR/CR res: [0x2000032e2:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051421.878761:0:27885:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b600/0x85f51a6b967160be lrc: 3/0,0 mode: CR/CR res: [0x2000032e2:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051421.878770:0:27885:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b600/0x85f51a6b967160be lrc: 4/0,0 mode: CR/CR res: [0x2000032e2:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051421.878780:0:27885:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94eb2b600 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:0.0:1777051421.878786:0:27885:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b600/0x85f51a6b967160be lrc: 4/0,0 mode: CR/CR res: [0x2000032e2:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051421.878799:0:27885:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b600/0x85f51a6b967160be lrc: 5/0,0 mode: CR/CR res: [0x2000032e2:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051421.878815:0:27885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0x3:0x0].0x0 (ffff99d94e81c200) 00010000:00010000:0.0:1777051421.878821:0:27885:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777051421.878828:0:27885:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b600/0x85f51a6b967160be lrc: 3/0,0 mode: --/CR res: [0x2000032e2:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051421.878839:0:27885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b600/0x85f51a6b967160be lrc: 0/0,0 mode: --/CR res: [0x2000032e2:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051421.878859:0:27885:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2ae00/0x85f51a6b967160c5 lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0x3:0x0].0xac1bda01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051421.878870:0:27885:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2ae00/0x85f51a6b967160c5 lrc: 2/0,0 mode: PR/PR res: [0x2000032e2:0x3:0x0].0xac1bda01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051421.878883:0:27885:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2ae00/0x85f51a6b967160c5 lrc: 3/0,0 mode: PR/PR res: [0x2000032e2:0x3:0x0].0xac1bda01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051421.878891:0:27885:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94eb2ae00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:0.0:1777051421.878894:0:27885:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2ae00/0x85f51a6b967160c5 lrc: 3/0,0 mode: PR/PR res: [0x2000032e2:0x3:0x0].0xac1bda01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051421.878901:0:27885:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2ae00/0x85f51a6b967160c5 lrc: 4/0,0 mode: PR/PR res: [0x2000032e2:0x3:0x0].0xac1bda01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051421.878910:0:27885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0x3:0x0].0xac1bda01 (ffff99d943f76500) 00010000:00010000:0.0:1777051421.878913:0:27885:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777051421.878916:0:27885:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2ae00/0x85f51a6b967160c5 lrc: 2/0,0 mode: --/PR res: [0x2000032e2:0x3:0x0].0xac1bda01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051421.878923:0:27885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2ae00/0x85f51a6b967160c5 lrc: 0/0,0 mode: --/PR res: [0x2000032e2:0x3:0x0].0xac1bda01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051421.878959:0:27885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b800/0x85f51a6b967160b7 lrc: 0/0,0 mode: --/CR res: [0x2000032e2:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6355 expref: 25 pid: 27885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051421.878973:0:27885:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2ac00/0x85f51a6b967160cc lrc: 3/0,0 mode: PR/PR res: [0x2000032e2:0x4:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6355 expref: 24 pid: 27885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051421.878981:0:27885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0x4:0x0].0x0 (ffff99d943f76900) 00010000:00010000:0.0:1777051421.878984:0:27885:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1777051421.878986:0:27885:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d94eb2ac00, rc 0) 00000100:00100000:0.0:1777051421.879094:0:27885:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95aecca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c11b6966-0775-44d2-bdc6-c74c26eb2226+24:137332:x1863365425967104:12345-192.168.201.46@tcp:101:lfs.0 Request processed in 833us (2090us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051421.879114:0:27885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112022 00000100:00100000:3.0:1777051421.974560:0:3678:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1777051421.974608:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95f97e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3678:1863365452628224:0@lo:400:kworker.0 00000100:00100000:1.0:1777051421.974611:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95f97d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3680:1863365452627968:0@lo:400:kworker.0 00000100:00100000:0.0:1777051421.974772:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f9fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3677:1863365452628608:0@lo:400:kworker.0 00000100:00100000:2.0:1777051421.974778:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95f97f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3679:1863365452628352:0@lo:400:kworker.0 00000100:00100000:3.0:1777051421.976534:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051421.976600:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7fd62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3678:1863365452628096:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1777051421.976649:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051421.976679:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f9fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3678:1863365452628736:0@lo:400:kworker.0 00000100:00100000:3.0:1777051421.976700:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051421.976715:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f9fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452629248:0@lo:400:kworker.0 00000100:00100000:3.0:1777051421.976983:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051421.977081:0:47208:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452628096 00000100:00100000:3.0:1777051421.977096:0:47208:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452628096 00000100:00100000:1.0:1777051421.977097:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051421.977179:0:47208:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452628736 00000100:00100000:3.0:1777051421.977187:0:47208:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452628736 00000100:00100000:3.0:1777051421.977257:0:47208:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452629248 00000100:00100000:3.0:1777051421.977262:0:47208:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452629248 00000100:00100000:3.0:1777051421.977303:0:47208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8167 00000100:00100000:3.0:1777051421.977319:0:47208:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fd63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+7:3678:x1863365452628096:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1777051421.977345:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95f97c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3680:1863365452628480:0@lo:400:kworker.0 00000004:00000024:3.0:1777051421.977371:0:47208:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4194304 pending 0 free 1446154240 avail 1299914752 00000100:00100000:1.0:1777051421.977426:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051421.977487:0:47208:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fd63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+7:3678:x1863365452628096:12345-0@lo:41:osp-pre-1-0.0 Request processed in 169us (832us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051421.977490:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f9fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3680:1863365452628992:0@lo:400:kworker.0 00000100:00100000:3.0:1777051421.977512:0:47208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8167 00000100:00100000:3.0:1777051421.977563:0:47208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8168 00000100:00100000:1.0:1777051421.977567:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051421.977587:0:47208:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fd63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+6:3678:x1863365452628736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777051421.977619:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f9fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3680:1863365452629504:0@lo:400:kworker.0 00000100:00100000:3.0:1777051421.977934:0:47208:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fd63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+6:3678:x1863365452628736:12345-0@lo:400:kworker.0 Request processed in 351us (1228us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051421.977946:0:47208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8168 00000100:00100000:3.0:1777051421.977975:0:47208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8169 00000100:00100000:1.0:1777051421.977988:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051421.977997:0:47208:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fd62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+6:3678:x1863365452629248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777051421.978093:0:103168:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452627968 00000100:00100000:3.0:1777051421.978106:0:47208:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fd62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+6:3678:x1863365452629248:12345-0@lo:400:kworker.0 Request processed in 114us (1116us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051421.978110:0:103168:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452627968 00000100:00100000:3.0:1777051421.978125:0:47208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8169 00000100:00100000:3.0:1777051421.978322:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f9fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3678:1863365452628736:0@lo:400:kworker.0 00000100:00100000:3.0:1777051421.978345:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f9fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452629248:0@lo:400:kworker.0 00000100:00100000:0.0:1777051421.978367:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051421.978378:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7fd62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3678:1863365452628096:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1777051421.978423:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f9fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3677:1863365452629120:0@lo:400:kworker.0 00000100:00100000:0.0:1777051421.978465:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051421.978497:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f9fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3677:1863365452629632:0@lo:400:kworker.0 00000100:00100000:0.0:1777051421.978599:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051421.978654:0:8492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452628224 00000100:00100000:2.0:1777051421.978664:0:8492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452628224 00000100:00100000:0.0:1777051421.978715:0:6579:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452628480 00000100:00100000:0.0:1777051421.978724:0:6579:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452628480 00000100:00100000:3.0:1777051421.979020:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051421.979081:0:8492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452628608 00000100:00100000:2.0:1777051421.979091:0:8492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452628608 00000100:00100000:1.0:1777051421.979423:0:103168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1777051421.979441:0:103168:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f9351a01-5b0e-4470-97fd-58b9b4b312a2+23:3680:x1863365452627968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777051421.979527:0:103168:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f9351a01-5b0e-4470-97fd-58b9b4b312a2+23:3680:x1863365452627968:12345-0@lo:400:kworker.0 Request processed in 89us (2432us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051421.979539:0:103168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1777051421.979590:0:27887:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452628992 00000100:00100000:1.0:1777051421.979597:0:27887:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452628992 00000100:00100000:1.0:1777051421.979655:0:27887:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452629504 00000100:00100000:1.0:1777051421.979661:0:27887:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452629504 00000100:00100000:1.0:1777051421.979703:0:27887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10431 00000100:00100000:1.0:1777051421.979714:0:27887:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7e24f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3680:x1863365452628992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777051421.979765:0:27887:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7e24f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3680:x1863365452628992:12345-0@lo:400:kworker.0 Request processed in 52us (2212us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051421.979776:0:27887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10431 00000100:00100000:1.0:1777051421.979798:0:27887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10432 00000100:00100000:1.0:1777051421.979809:0:27887:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7e24ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3680:x1863365452629504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777051421.979857:0:27887:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7e24ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3680:x1863365452629504:12345-0@lo:400:kworker.0 Request processed in 49us (1874us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051421.979869:0:27887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10432 00000100:00080000:1.0:1777051421.979919:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1777051421.979927:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1777051421.979930:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1777051421.979983:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f9fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3680:1863365452628992:0@lo:400:kworker.0 00000100:00100000:1.0:1777051421.980010:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f9fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3680:1863365452629504:0@lo:400:kworker.0 00000100:00100000:1.0:1777051421.980029:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95f97d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3680:1863365452627968:0@lo:400:kworker.0 00000100:00100000:0.0:1777051421.980147:0:6579:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452629120 00000100:00100000:0.0:1777051421.980157:0:6579:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452629120 00000100:00100000:1.0:1777051421.980185:0:10328:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452629632 00000100:00100000:1.0:1777051421.980191:0:10328:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452629632 00000100:00100000:0.0:1777051421.980212:0:6579:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452628352 00000100:00100000:0.0:1777051421.980218:0:6579:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452628352 00000100:00100000:3.0:1777051421.980258:0:46497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13377 00000100:00100000:2.0:1777051421.980276:0:8492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13378 00000100:00100000:3.0:1777051421.980290:0:46497:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fd60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:lustre-MDT0000-lwp-OST0000_UUID+5:3678:x1863365452628224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777051421.980308:0:10328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13379 00000100:00100000:2.0:1777051421.980311:0:8492:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7e24f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3680:x1863365452628480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777051421.980325:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13380 00000100:00100000:1.0:1777051421.980331:0:10328:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d9418f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3677:x1863365452628608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777051421.980338:0:6579:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d9418f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3677:x1863365452629120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051421.980696:0:46497:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fd60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:lustre-MDT0000-lwp-OST0000_UUID+5:3678:x1863365452628224:12345-0@lo:400:kworker.0 Request processed in 416us (4157us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051421.980704:0:8492:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7e24f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3680:x1863365452628480:12345-0@lo:400:kworker.0 Request processed in 400us (3272us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051421.980706:0:6579:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d9418f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3677:x1863365452629120:12345-0@lo:400:kworker.0 Request processed in 363us (2233us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051421.980706:0:10328:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d9418f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3677:x1863365452628608:12345-0@lo:400:kworker.0 Request processed in 373us (2333us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051421.980745:0:46497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13377 00000100:00100000:1.0:1777051421.980759:0:10328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13379 00000100:00100000:3.0:1777051421.981093:0:46497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13381 00000100:00100000:0.0:1777051421.981109:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13380 00000100:00100000:3.0:1777051421.981118:0:46497:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da445de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:lustre-MDT0000-lwp-MDT0001_UUID+5:3677:x1863365452629632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777051421.981124:0:10328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13382 00000100:00100000:1.0:1777051421.981148:0:10328:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fd62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3679:x1863365452628352:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1777051421.981156:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1777051421.981190:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f9fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3677:1863365452628608:0@lo:400:kworker.0 00000100:00100000:2.0:1777051421.981311:0:8492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13378 00000100:00100000:0.0:1777051421.981358:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f9fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3677:1863365452629120:0@lo:400:kworker.0 00000100:00100000:0.0:1777051421.981394:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f9fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3677:1863365452629632:0@lo:400:kworker.0 00000100:00100000:3.0:1777051421.981399:0:46497:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da445de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:lustre-MDT0000-lwp-MDT0001_UUID+5:3677:x1863365452629632:12345-0@lo:400:kworker.0 Request processed in 280us (2789us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051421.981401:0:10328:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fd62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3679:x1863365452628352:12345-0@lo:400:kworker.0 Request processed in 252us (2380us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051421.981441:0:10328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13382 00000100:00100000:3.0:1777051421.981456:0:46497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13381 00000100:00100000:1.0:1777051421.981504:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95f97c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3680:1863365452628480:0@lo:400:kworker.0 00000100:00100000:0.0:1777051421.981560:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95f97e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3678:1863365452628224:0@lo:400:kworker.0 00000100:00100000:1.0:1777051421.981591:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95f97f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3679:1863365452628352:0@lo:400:kworker.0 00000100:00100000:1.0:1777051421.981610:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f9fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452628864:0@lo:400:kworker.0 00000100:00100000:1.0:1777051421.981667:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051421.981717:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f9fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452629376:0@lo:400:kworker.0 00000100:00100000:1.0:1777051421.981764:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051421.981767:0:8628:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452628864 00000100:00100000:0.0:1777051421.981775:0:8628:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452628864 00000100:00100000:0.0:1777051421.981833:0:8628:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452629376 00000100:00100000:0.0:1777051421.981839:0:8628:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452629376 00000100:00100000:1.0:1777051421.981857:0:13320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10433 00000100:00080000:3.0:1777051421.981880:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1777051421.981882:0:13320:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7e24fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3679:x1863365452628864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777051421.981891:0:8470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10434 00000100:00100000:2.0:1777051421.981910:0:8470:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7e24f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3679:x1863365452629376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777051421.981968:0:13320:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7e24fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3679:x1863365452628864:12345-0@lo:400:kworker.0 Request processed in 98us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051421.981981:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f9fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452628864:0@lo:400:kworker.0 00000100:00100000:1.0:1777051421.981981:0:13320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10433 00000100:00100000:2.0:1777051421.981994:0:8470:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7e24f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3679:x1863365452629376:12345-0@lo:400:kworker.0 Request processed in 85us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051421.982006:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f9fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452629376:0@lo:400:kworker.0 00000100:00100000:2.0:1777051421.982014:0:8470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10434 00000100:00100000:2.0:1777051422.212576:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051422.212703:0:6579:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425967232 00000100:00100000:0.0:1777051422.212721:0:6579:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425967232 00000100:00100000:0.0:1777051422.212834:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112023 00000100:00100000:0.0:1777051422.212852:0:6579:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+26:137359:x1863365425967232:12345-192.168.201.46@tcp:101:lfs.0 00010000:00010000:0.0:1777051422.212909:0:6579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051422.212950:0:6579:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b800/0x85f51a6b967160d3 lrc: 2/0,0 mode: --/CR res: [0x2000032e2:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b635c expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051422.213431:0:6579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2ae00/0x85f51a6b967160da lrc: 3/1,0 mode: --/CR res: [0x2000032e2:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051422.213458:0:6579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2ae00/0x85f51a6b967160da lrc: 3/1,0 mode: CR/CR res: [0x2000032e2:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051422.213478:0:6579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2ae00/0x85f51a6b967160da lrc: 3/1,0 mode: CR/CR res: [0x2000032e2:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051422.213504:0:6579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b600/0x85f51a6b967160e1 lrc: 3/1,0 mode: --/PR res: [0x2000032e2:0x3:0x0].0xac1bda01 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051422.213516:0:6579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b600/0x85f51a6b967160e1 lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0x3:0x0].0xac1bda01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051422.213528:0:6579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b600/0x85f51a6b967160e1 lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0x3:0x0].0xac1bda01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051422.213656:0:6579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2a200/0x85f51a6b967160e8 lrc: 3/1,0 mode: --/PR res: [0x2000032e2:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051422.213669:0:6579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2a200/0x85f51a6b967160e8 lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0x4:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051422.213680:0:6579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2a200/0x85f51a6b967160e8 lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0x4:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1777051422.213733:0:6579:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000032e2:0x4:0x0]: returning size 4096 00000004:00200000:0.0:1777051422.213738:0:6579:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1777051422.213772:0:6579:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2a200/0x85f51a6b967160e8 lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0x4:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051422.213791:0:6579:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2ae00/0x85f51a6b967160da lrc: 4/1,0 mode: CR/CR res: [0x2000032e2:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051422.213801:0:6579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2ae00/0x85f51a6b967160da lrc: 4/1,0 mode: CR/CR res: [0x2000032e2:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051422.213811:0:6579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2ae00/0x85f51a6b967160da lrc: 3/0,0 mode: CR/CR res: [0x2000032e2:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051422.214135:0:6579:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2ae00/0x85f51a6b967160da lrc: 4/0,0 mode: CR/CR res: [0x2000032e2:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051422.214148:0:6579:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94eb2ae00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:0.0:1777051422.214155:0:6579:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2ae00/0x85f51a6b967160da lrc: 4/0,0 mode: CR/CR res: [0x2000032e2:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051422.214167:0:6579:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2ae00/0x85f51a6b967160da lrc: 5/0,0 mode: CR/CR res: [0x2000032e2:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051422.214186:0:6579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0x3:0x0].0x0 (ffff99d94e81c200) 00010000:00010000:0.0:1777051422.214191:0:6579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777051422.214225:0:6579:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2ae00/0x85f51a6b967160da lrc: 3/0,0 mode: --/CR res: [0x2000032e2:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051422.214236:0:6579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2ae00/0x85f51a6b967160da lrc: 0/0,0 mode: --/CR res: [0x2000032e2:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051422.214259:0:6579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b600/0x85f51a6b967160e1 lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0x3:0x0].0xac1bda01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051422.214267:0:6579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b600/0x85f51a6b967160e1 lrc: 2/0,0 mode: PR/PR res: [0x2000032e2:0x3:0x0].0xac1bda01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051422.214275:0:6579:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b600/0x85f51a6b967160e1 lrc: 3/0,0 mode: PR/PR res: [0x2000032e2:0x3:0x0].0xac1bda01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051422.214282:0:6579:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94eb2b600 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:0.0:1777051422.214285:0:6579:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b600/0x85f51a6b967160e1 lrc: 3/0,0 mode: PR/PR res: [0x2000032e2:0x3:0x0].0xac1bda01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051422.214293:0:6579:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b600/0x85f51a6b967160e1 lrc: 4/0,0 mode: PR/PR res: [0x2000032e2:0x3:0x0].0xac1bda01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051422.214304:0:6579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0x3:0x0].0xac1bda01 (ffff99d943f76500) 00010000:00010000:0.0:1777051422.214308:0:6579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777051422.214312:0:6579:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b600/0x85f51a6b967160e1 lrc: 2/0,0 mode: --/PR res: [0x2000032e2:0x3:0x0].0xac1bda01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051422.214320:0:6579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b600/0x85f51a6b967160e1 lrc: 0/0,0 mode: --/PR res: [0x2000032e2:0x3:0x0].0xac1bda01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051422.214378:0:6579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b800/0x85f51a6b967160d3 lrc: 0/0,0 mode: --/CR res: [0x2000032e2:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b635c expref: 28 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051422.214400:0:6579:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2a200/0x85f51a6b967160e8 lrc: 3/0,0 mode: PR/PR res: [0x2000032e2:0x4:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b635c expref: 27 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051422.214411:0:6579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0x4:0x0].0x0 (ffff99d943f76900) 00010000:00010000:0.0:1777051422.214414:0:6579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1777051422.214418:0:6579:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d94eb2a200, rc 0) 00000100:00100000:0.0:1777051422.214526:0:6579:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+27:137359:x1863365425967232:12345-192.168.201.46@tcp:101:lfs.0 Request processed in 1676us (1965us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051422.214537:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112023 00000100:00100000:2.0:1777051422.220459:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051422.220575:0:21368:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425967360 00000100:00100000:3.0:1777051422.220592:0:21368:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425967360 00000100:00100000:3.0:1777051422.220679:0:21368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112024 00000100:00100000:3.0:1777051422.220696:0:21368:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+27:137359:x1863365425967360:12345-192.168.201.46@tcp:101:lfs.0 00010000:00010000:3.0:1777051422.220729:0:21368:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777051422.220765:0:21368:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7400/0x85f51a6b967160ef lrc: 2/0,0 mode: --/CR res: [0x2000032e2:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6363 expref: -99 pid: 21368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051422.220866:0:21368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7600/0x85f51a6b967160f6 lrc: 3/1,0 mode: --/CR res: [0x2000032e2:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051422.220890:0:21368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7600/0x85f51a6b967160f6 lrc: 3/1,0 mode: CR/CR res: [0x2000032e2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051422.220908:0:21368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7600/0x85f51a6b967160f6 lrc: 3/1,0 mode: CR/CR res: [0x2000032e2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051422.220928:0:21368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6000/0x85f51a6b967160fd lrc: 3/1,0 mode: --/PR res: [0x2000032e2:0x4:0x0].0x4b5e7af5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051422.220943:0:21368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6000/0x85f51a6b967160fd lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0x4:0x0].0x4b5e7af5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051422.220952:0:21368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6000/0x85f51a6b967160fd lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0x4:0x0].0x4b5e7af5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051422.221094:0:21368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6800/0x85f51a6b96716104 lrc: 3/1,0 mode: --/PR res: [0x2000032e3:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051422.221107:0:21368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6800/0x85f51a6b96716104 lrc: 3/1,0 mode: PR/PR res: [0x2000032e3:0x3:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051422.221116:0:21368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6800/0x85f51a6b96716104 lrc: 3/1,0 mode: PR/PR res: [0x2000032e3:0x3:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1777051422.222601:0:21368:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000032e3:0x3:0x0]: returning size 1048576 00000004:00200000:3.0:1777051422.222609:0:21368:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1777051422.222642:0:21368:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6800/0x85f51a6b96716104 lrc: 3/1,0 mode: PR/PR res: [0x2000032e3:0x3:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051422.222661:0:21368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6800/0x85f51a6b96716104 lrc: 3/1,0 mode: PR/PR res: [0x2000032e3:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051422.222674:0:21368:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7600/0x85f51a6b967160f6 lrc: 3/1,0 mode: CR/CR res: [0x2000032e2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051422.222682:0:21368:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7600/0x85f51a6b967160f6 lrc: 2/0,0 mode: CR/CR res: [0x2000032e2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051422.222690:0:21368:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7600/0x85f51a6b967160f6 lrc: 3/0,0 mode: CR/CR res: [0x2000032e2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051422.222703:0:21368:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d941ad7600 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:3.0:1777051422.222709:0:21368:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7600/0x85f51a6b967160f6 lrc: 3/0,0 mode: CR/CR res: [0x2000032e2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051422.222720:0:21368:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7600/0x85f51a6b967160f6 lrc: 4/0,0 mode: CR/CR res: [0x2000032e2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051422.222735:0:21368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0x4:0x0].0x0 (ffff99d943f76900) 00010000:00010000:3.0:1777051422.222739:0:21368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777051422.222744:0:21368:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7600/0x85f51a6b967160f6 lrc: 2/0,0 mode: --/CR res: [0x2000032e2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051422.222752:0:21368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7600/0x85f51a6b967160f6 lrc: 0/0,0 mode: --/CR res: [0x2000032e2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051422.223418:0:21368:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6000/0x85f51a6b967160fd lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0x4:0x0].0x4b5e7af5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051422.223427:0:21368:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6000/0x85f51a6b967160fd lrc: 2/0,0 mode: PR/PR res: [0x2000032e2:0x4:0x0].0x4b5e7af5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051422.223433:0:21368:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6000/0x85f51a6b967160fd lrc: 3/0,0 mode: PR/PR res: [0x2000032e2:0x4:0x0].0x4b5e7af5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051422.223437:0:21368:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d941ad6000 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:3.0:1777051422.223440:0:21368:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6000/0x85f51a6b967160fd lrc: 3/0,0 mode: PR/PR res: [0x2000032e2:0x4:0x0].0x4b5e7af5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051422.223448:0:21368:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6000/0x85f51a6b967160fd lrc: 4/0,0 mode: PR/PR res: [0x2000032e2:0x4:0x0].0x4b5e7af5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051422.223467:0:21368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0x4:0x0].0x4b5e7af5 (ffff99d9533abb00) 00010000:00010000:3.0:1777051422.223470:0:21368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777051422.223474:0:21368:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6000/0x85f51a6b967160fd lrc: 2/0,0 mode: --/PR res: [0x2000032e2:0x4:0x0].0x4b5e7af5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051422.223483:0:21368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6000/0x85f51a6b967160fd lrc: 0/0,0 mode: --/PR res: [0x2000032e2:0x4:0x0].0x4b5e7af5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051422.223529:0:21368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad7400/0x85f51a6b967160ef lrc: 0/0,0 mode: --/CR res: [0x2000032e2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6363 expref: 29 pid: 21368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051422.223546:0:21368:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6800/0x85f51a6b96716104 lrc: 3/0,0 mode: PR/PR res: [0x2000032e3:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6363 expref: 28 pid: 21368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051422.223556:0:21368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e3:0x3:0x0].0x0 (ffff99d94e6b6f00) 00010000:00010000:3.0:1777051422.223559:0:21368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1777051422.223563:0:21368:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d941ad6800, rc 0) 00000100:00100000:3.0:1777051422.223653:0:21368:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+28:137359:x1863365425967360:12345-192.168.201.46@tcp:101:lfs.0 Request processed in 2961us (3210us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051422.223664:0:21368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112024 00000100:00100000:1.0:1777051422.232137:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051422.232450:0:55805:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425967488 00000100:00100000:0.0:1777051422.232467:0:55805:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425967488 00000100:00100000:0.0:1777051422.232564:0:55805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 8000 00000100:00100000:0.0:1777051422.232579:0:55805:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7e24e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+47:2436:x1863365425967488:12345-192.168.201.46@tcp:101:lfs.0 00010000:00010000:0.0:1777051422.232609:0:55805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051422.232637:0:55805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005f8300a0/0x85f51a6b9671610b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x1e3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b636a expref: -99 pid: 55805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051422.232988:0:55805:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da445dd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:55805:1863365452629760:192.168.201.46@tcp:106: 00000100:00100000:0.0:1777051422.233507:0:55805:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d944a9fe40 going to sleep for 11 seconds 00002000:00010000:0.0:1777051422.237521:0:55805:0:(ofd_lvb.c:259:ofd_lvbo_update()) res: [0x2c0000401:0x1e3:0x0] updating lvb size: 0 -> 1048576 00002000:00010000:0.0:1777051422.237531:0:55805:0:(ofd_lvb.c:265:ofd_lvbo_update()) res: [0x2c0000401:0x1e3:0x0] updating lvb mtime: 0 -> 1777051421 00002000:00010000:0.0:1777051422.237536:0:55805:0:(ofd_lvb.c:271:ofd_lvbo_update()) res: [0x2c0000401:0x1e3:0x0] updating lvb atime: 0 -> 1777051421 00002000:00010000:0.0:1777051422.237539:0:55805:0:(ofd_lvb.c:277:ofd_lvbo_update()) res: [0x2c0000401:0x1e3:0x0] updating lvb ctime: 0 -> 1777051421 00002000:00010000:0.0:1777051422.237544:0:55805:0:(ofd_lvb.c:283:ofd_lvbo_update()) res: [0x2c0000401:0x1e3:0x0] updating lvb blocks: 0 -> 2048 00000100:00100000:0.0:1777051422.237579:0:55805:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da445dd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:55805:1863365452629760:192.168.201.46@tcp:106: 00010000:00010000:0.0:1777051422.237649:0:55805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005f8300a0/0x85f51a6b9671610b lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x1e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b636a expref: 48 pid: 55805 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051422.237688:0:55805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005f8300a0/0x85f51a6b9671610b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x1e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b636a expref: 48 pid: 55805 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051422.237709:0:55805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d94eb2b800, rc 0) 00000100:00100000:0.0:1777051422.237794:0:55805:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7e24e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+47:2436:x1863365425967488:12345-192.168.201.46@tcp:101:lfs.0 Request processed in 5216us (5670us total) trans 0 rc 301/301 00000100:00100000:0.0:1777051422.237807:0:55805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 8000 00000100:00100000:2.0:1777051422.245503:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051422.245758:0:27882:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425967616 00000100:00100000:0.0:1777051422.245773:0:27882:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425967616 00000100:00100000:0.0:1777051422.245868:0:27882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112025 00000100:00100000:0.0:1777051422.245886:0:27882:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+28:137359:x1863365425967616:12345-192.168.201.46@tcp:101:lfs.0 00010000:00010000:0.0:1777051422.245913:0:27882:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051422.245942:0:27882:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b800/0x85f51a6b96716112 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6371 expref: -99 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051422.246028:0:27882:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b600/0x85f51a6b96716119 lrc: 3/1,0 mode: --/PR res: [0x2000032e2:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051422.246077:0:27882:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b600/0x85f51a6b96716119 lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051422.246093:0:27882:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b600/0x85f51a6b96716119 lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1777051422.246147:0:27882:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000032e2:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1777051422.246153:0:27882:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1777051422.246182:0:27882:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b600/0x85f51a6b96716119 lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051422.246265:0:27882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b800/0x85f51a6b96716112 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6371 expref: 30 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051422.246304:0:27882:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b600/0x85f51a6b96716119 lrc: 3/0,0 mode: PR/PR res: [0x2000032e2:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6371 expref: 29 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051422.246318:0:27882:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0x3:0x0].0x0 (ffff99d94e81c200) 00010000:00010000:0.0:1777051422.246324:0:27882:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1777051422.246329:0:27882:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d94eb2b600, rc 0) 00000100:00100000:0.0:1777051422.246420:0:27882:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+29:137359:x1863365425967616:12345-192.168.201.46@tcp:101:lfs.0 Request processed in 537us (927us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051422.246432:0:27882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112025 00000100:00100000:1.0:1777051422.250685:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051422.250775:0:46494:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425967744 00000100:00100000:0.0:1777051422.250787:0:46494:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425967744 00000100:00100000:0.0:1777051422.250865:0:46494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112026 00000100:00100000:0.0:1777051422.250882:0:46494:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7e24d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+29:137359:x1863365425967744:12345-192.168.201.46@tcp:101:lfs.0 00010000:00010000:0.0:1777051422.250905:0:46494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051422.250928:0:46494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2ae00/0x85f51a6b96716120 lrc: 2/0,0 mode: --/CR res: [0x2000032e2:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6378 expref: -99 pid: 46494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051422.251012:0:46494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b200/0x85f51a6b96716127 lrc: 3/1,0 mode: --/PR res: [0x2000032e2:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051422.251040:0:46494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b200/0x85f51a6b96716127 lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051422.251105:0:46494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b200/0x85f51a6b96716127 lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1777051422.251442:0:46494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000032e2:0x4:0x0]: returning size 4096 00000004:00200000:0.0:1777051422.251450:0:46494:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1777051422.251479:0:46494:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b200/0x85f51a6b96716127 lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051422.251517:0:46494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2ae00/0x85f51a6b96716120 lrc: 0/0,0 mode: --/CR res: [0x2000032e2:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6378 expref: 31 pid: 46494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051422.251580:0:46494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b200/0x85f51a6b96716127 lrc: 3/0,0 mode: PR/PR res: [0x2000032e2:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6378 expref: 30 pid: 46494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051422.251595:0:46494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0x4:0x0].0x0 (ffff99d943f76900) 00010000:00010000:0.0:1777051422.251600:0:46494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1777051422.251605:0:46494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d94eb2b200, rc 0) 00000100:00100000:0.0:1777051422.251684:0:46494:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7e24d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+30:137359:x1863365425967744:12345-192.168.201.46@tcp:101:lfs.0 Request processed in 804us (1006us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051422.251697:0:46494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112026 00000100:00100000:3.0:1777051422.258781:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051422.258902:0:8468:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425967872 00000100:00100000:1.0:1777051422.258916:0:8468:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425967872 00000100:00100000:1.0:1777051422.259008:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 8001 00000100:00100000:1.0:1777051422.259026:0:8468:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d943d93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+47:2437:x1863365425967872:12345-192.168.201.46@tcp:101:lfs.0 00010000:00010000:1.0:1777051422.259079:0:8468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777051422.259102:0:8468:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c5ef989b/0x85f51a6b9671612e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x1e3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b637f expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051422.259285:0:8468:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7e24c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8468:1863365452629888:192.168.201.46@tcp:106: 00000100:00100000:1.0:1777051422.259396:0:8468:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d95cb32f00 going to sleep for 11 seconds 00000100:00100000:1.0:1777051422.264883:0:8468:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7e24c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8468:1863365452629888:192.168.201.46@tcp:106: 00010000:00010000:1.0:1777051422.264932:0:8468:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c5ef989b/0x85f51a6b9671612e lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x1e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b637f expref: 48 pid: 8468 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051422.264966:0:8468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c5ef989b/0x85f51a6b9671612e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x1e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b637f expref: 48 pid: 8468 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051422.264985:0:8468:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d94e48be00, rc 0) 00000100:00100000:1.0:1777051422.265119:0:8468:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d943d93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+47:2437:x1863365425967872:12345-192.168.201.46@tcp:101:lfs.0 Request processed in 6098us (6347us total) trans 0 rc 301/301 00000100:00100000:1.0:1777051422.265129:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 8001 00000100:00100000:2.0:1777051422.271389:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051422.271570:0:6580:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425968128 00000100:00100000:0.0:1777051422.271583:0:6580:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425968128 00000100:00100000:0.0:1777051422.271672:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112027 00000100:00100000:0.0:1777051422.271692:0:6580:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+30:137359:x1863365425968128:12345-192.168.201.46@tcp:58:lfs.0 00000040:00080000:0.0:1777051422.272263:0:6580:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2b:0x0].4, 136 off8736 00000100:00100000:0.0:1777051422.272389:0:6580:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+30:137359:x1863365425968128:12345-192.168.201.46@tcp:58:lfs.0 Request processed in 701us (1007us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051422.272404:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112027 00000100:00100000:2.0:1777051422.488877:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f9ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452630016:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1777051422.488992:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051422.489101:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7e24c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452630144:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1777051422.489110:0:47388:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452630016 00000100:00100000:2.0:1777051422.489124:0:47388:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452630016 00000100:00100000:1.0:1777051422.489457:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051422.492383:0:47388:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452630144 00000100:00100000:2.0:1777051422.492394:0:47388:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452630144 00000100:00100000:1.0:1777051422.492422:0:8473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5654 00000100:00100000:1.0:1777051422.492449:0:8473:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3678:x1863365452630016:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1777051422.492522:0:8473:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 455081536 pending 0 free 3862671360 avail 3631149056 00000100:00100000:2.0:1777051422.492570:0:47388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5655 00000100:00100000:2.0:1777051422.492588:0:47388:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7e24ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3679:x1863365452630144:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1777051422.492617:0:8473:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3678:x1863365452630016:12345-0@lo:13:osp-pre-0-1.0 Request processed in 176us (3625us total) trans 0 rc 0/0 00002000:00000024:2.0:1777051422.492617:0:47388:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 452386368 pending 0 free 3645853696 avail 3413258240 00000100:00100000:1.0:1777051422.492638:0:8473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5654 00000100:00100000:2.0:1777051422.492711:0:47388:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7e24ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3679:x1863365452630144:12345-0@lo:13:osp-pre-1-1.0 Request processed in 125us (3255us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051422.492725:0:47388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5655 00000100:00100000:2.0:1777051422.492803:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7e24c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452630144:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1777051422.492895:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f9ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452630016:0@lo:13:osp-pre-0-1.0 00000040:00080000:3.0:1777051422.678446:0:103189:0:(llog.c:801:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:3.0:1777051422.678459:0:103189:0:(llog_cat.c:158:llog_cat_process_common()) processing log [0x1:0x2b:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1777051422.678501:0:103189:0:(llog.c:858:llog_process_thread()) stop processing plain [0x1:0x2b:0x0] index 5 count 4 00000040:00080000:3.0:1777051422.678511:0:103189:0:(llog.c:858:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00000100:00100000:3.0:1777051422.678822:0:103189:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d943d91880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:103189:1863365452630272:192.168.201.46@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1777051422.678954:0:103189:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da70a7db40 going to sleep for 11 seconds 00000100:00100000:3.0:1777051422.684164:0:103189:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d943d91880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:103189:1863365452630272:192.168.201.46@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1777051422.685220:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051422.685330:0:8492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425968256 00000100:00100000:0.0:1777051422.685343:0:8492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425968256 00000100:00100000:0.0:1777051422.685436:0:8492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112028 00000100:00100000:0.0:1777051422.685458:0:8492:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d943d91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+24:137369:x1863365425968256:12345-192.168.201.46@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1777051422.685499:0:8492:0:(mdt_handler.c:7958:mdt_fid2path()) path get [0x2000032e3:0x3:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1777051422.685661:0:8492:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d943d91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+24:137369:x1863365425968256:12345-192.168.201.46@tcp:53:lhsmtool_posix.0 Request processed in 212us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051422.685672:0:8492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112028 00000100:00100000:1.0:1777051422.692696:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051422.692811:0:6581:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425968512 00000100:00100000:0.0:1777051422.692824:0:6581:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425968512 00000100:00100000:0.0:1777051422.692932:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112029 00000100:00100000:0.0:1777051422.692952:0:6581:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7e24d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+24:137369:x1863365425968512:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1777051422.692975:0:6581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051422.693003:0:6581:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2be00/0x85f51a6b96716135 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6386 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051422.693185:0:6581:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b800/0x85f51a6b9671613c lrc: 3/1,0 mode: --/PR res: [0x2000032e3:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051422.693244:0:6581:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b800/0x85f51a6b9671613c lrc: 3/1,0 mode: PR/PR res: [0x2000032e3:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051422.693266:0:6581:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b800/0x85f51a6b9671613c lrc: 3/1,0 mode: PR/PR res: [0x2000032e3:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1777051422.693285:0:6581:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000032e3:0x3:0x0]: returning size 1048576 00010000:00010000:0.0:1777051422.693450:0:6581:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2be00/0x85f51a6b96716135 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6386 expref: 27 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051422.693483:0:6581:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b800/0x85f51a6b9671613c lrc: 3/0,0 mode: PR/PR res: [0x2000032e3:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6386 expref: 26 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051422.693498:0:6581:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e3:0x3:0x0].0x0 (ffff99d94e6b6f00) 00010000:00010000:0.0:1777051422.693504:0:6581:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1777051422.693509:0:6581:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d94eb2b800, rc 0) 00000100:00100000:0.0:1777051422.693597:0:6581:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7e24d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+26:137369:x1863365425968512:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 Request processed in 649us (913us total) trans 30064771142 rc 0/0 00000100:00100000:0.0:1777051422.693611:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112029 00000100:00100000:0.0:1777051422.698297:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051422.698381:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051422.698387:0:27884:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425968640 00000100:00100000:1.0:1777051422.698400:0:27884:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425968640 00000100:00100000:2.0:1777051422.698465:0:47597:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425968768 00000100:00100000:1.0:1777051422.698477:0:27884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 8002 00000100:00100000:2.0:1777051422.698478:0:47597:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425968768 00000100:00100000:1.0:1777051422.698497:0:27884:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da445dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+49:2438:x1863365425968640:12345-192.168.201.46@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1777051422.698546:0:27884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c5ef989b/0x85f51a6b9671614a lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x1e3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 27884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051422.698568:0:47597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13691 00010000:00010000:1.0:1777051422.698582:0:27884:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d630161e/0x85f51a6b967160b0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b634e expref: 49 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051422.698595:0:47597:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da445dc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+26:2439:x1863365425968768:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1777051422.698607:0:27884:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1777051422.698613:0:27884:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1777051422.698619:0:27884:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c5ef989b/0x85f51a6b9671614a lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x1e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 27884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051422.698620:0:47597:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777051422.698656:0:47597:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b800/0x85f51a6b9671613c lrc: 0/0,0 mode: --/PR res: [0x2000032e3:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6386 expref: 26 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051422.698676:0:27884:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d630161e/0x85f51a6b967160b0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b634e expref: 49 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051422.698685:0:47597:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e3:0x3:0x0].0x0 (ffff99d94e6b6f00) 00010000:00010000:2.0:1777051422.698696:0:47597:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1777051422.698707:0:27884:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d630161e/0x85f51a6b967160b0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b634e expref: 49 pid: 8470 timeout: 8151 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051422.698734:0:27884:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7e24e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:27884:1863365452630400:192.168.201.46@tcp:104: 00000100:00100000:2.0:1777051422.698778:0:47597:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da445dc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+25:2439:x1863365425968768:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 191us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051422.698792:0:47597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13691 00000100:00100000:1.0:1777051422.698844:0:27884:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d95cb32f00 going to sleep for 11 seconds 00000100:00100000:0.0:1777051422.702727:0:27884:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7e24e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:27884:1863365452630400:192.168.201.46@tcp:104: 00010000:00010000:0.0:1777051422.702767:0:27884:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c5ef989b/0x85f51a6b9671614a lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x1e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 27884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051422.704571:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051422.704861:0:6566:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425968896 00000100:00100000:2.0:1777051422.704871:0:6566:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425968896 00010000:00010000:2.0:1777051422.704907:0:6566:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d630161e/0x85f51a6b967160b0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b634e expref: 50 pid: 8470 timeout: 8151 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051422.704978:0:6566:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3872 00000100:00100000:2.0:1777051422.704994:0:6566:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da6fd42c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+50:2437:x1863365425968896:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1777051422.705012:0:6566:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777051422.705070:0:6566:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d630161e/0x85f51a6b967160b0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b634e expref: 50 pid: 8470 timeout: 8151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051422.705094:0:6566:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d630161e/0x85f51a6b967160b0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b634e expref: 50 pid: 8470 timeout: 8151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051422.705125:0:6566:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d630161e/0x85f51a6b967160b0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b634e expref: 50 pid: 8470 timeout: 8151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051422.705147:0:6566:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777051422.705150:0:6566:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777051422.705157:0:6566:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c5ef989b/0x85f51a6b9671614a lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x1e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 27884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051422.705174:0:6566:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c5ef989b/0x85f51a6b9671614a lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x1e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 27884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051422.705246:0:6566:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1777051422.705298:0:27884:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c5ef989b/0x85f51a6b9671614a lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x1e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 27884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051422.705311:0:6566:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da6fd42c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+49:2437:x1863365425968896:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 317us (742us total) trans 0 rc 0/0 00010000:00010000:0.0:1777051422.705333:0:27884:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c5ef989b/0x85f51a6b9671614a lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x1e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 27884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051422.705340:0:6566:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3872 00010000:00010000:0.0:1777051422.705377:0:27884:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c5ef989b/0x85f51a6b9671614a lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x1e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 27884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051422.705393:0:27884:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c5ef989b/0x85f51a6b9671614a lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x1e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 27884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051422.705409:0:27884:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c5ef989b/0x85f51a6b9671614a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 27884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051422.705423:0:27884:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94e48be00 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:0.0:1777051422.705432:0:27884:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c5ef989b/0x85f51a6b9671614a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 27884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051422.705447:0:27884:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c5ef989b/0x85f51a6b9671614a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 27884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051422.705469:0:27884:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c5ef989b/0x85f51a6b9671614a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x1e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 27884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051422.705483:0:27884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c5ef989b/0x85f51a6b9671614a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x1e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 27884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051422.705580:0:27884:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da445dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+48:2438:x1863365425968640:12345-192.168.201.46@tcp:1:lhsmtool_posix.0 Request processed in 7087us (7290us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051422.705593:0:27884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 8002 00000100:00100000:0.0:1777051422.710920:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051422.711066:0:27882:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425969152 00000100:00100000:2.0:1777051422.711077:0:27882:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425969152 00000100:00100000:2.0:1777051422.711164:0:27882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112030 00000100:00100000:2.0:1777051422.711181:0:27882:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da445dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+25:137369:x1863365425969152:12345-192.168.201.46@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1777051422.711321:0:27882:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da445dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+25:137369:x1863365425969152:12345-192.168.201.46@tcp:57:lhsmtool_posix.0 Request processed in 143us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051422.711334:0:27882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112030 00000100:00100000:0.0:1777051422.715365:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051422.715457:0:24468:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425969280 00000100:00100000:1.0:1777051422.715469:0:24468:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425969280 00000100:00100000:1.0:1777051422.715533:0:24468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 8003 00000100:00100000:1.0:1777051422.715547:0:24468:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da445dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+48:2436:x1863365425969280:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1777051422.715564:0:24468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777051422.715584:0:24468:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000036b4d075/0x85f51a6b96716151 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x1e3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b638d expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1777051422.715618:0:24468:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x1e3:0x0] initial LVB size: 1048576, mtime: 0x69eba71d, atime: 0x0, ctime: 0x69eba71d, blocks: 0x800 00010000:00010000:1.0:1777051422.715643:0:24468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051422.715647:0:24468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051422.715659:0:24468:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000036b4d075/0x85f51a6b96716151 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b638d expref: 49 pid: 24468 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051422.715685:0:24468:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000036b4d075/0x85f51a6b96716151 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b638d expref: 49 pid: 24468 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051422.715724:0:24468:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d94e48b800, rc 0) 00000100:00100000:1.0:1777051422.716098:0:24468:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da445dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+49:2436:x1863365425969280:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 Request processed in 552us (738us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051422.716111:0:24468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 8003 00000100:00100000:3.0:1777051422.721463:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051422.725628:0:10328:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425969536 00000100:00100000:0.0:1777051422.725645:0:10328:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425969536 00000100:00100000:0.0:1777051422.725744:0:10328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112031 00000100:00100000:0.0:1777051422.725760:0:10328:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d943d92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+25:137369:x1863365425969536:12345-192.168.201.46@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1777051422.726485:0:10328:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d943d92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+25:137369:x1863365425969536:12345-192.168.201.46@tcp:57:lhsmtool_posix.0 Request processed in 726us (5372us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051422.726500:0:10328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112031 00000100:00100000:3.0:1777051422.735195:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051422.735270:0:46207:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425969664 00000100:00100000:0.0:1777051422.735282:0:46207:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425969664 00002000:00100000:0.0:1777051422.735341:0:46207:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x1e3:0x0] (0->1048575) req@ffff99d943d92680 x1863365425969664/t0(0) o3->c11b6966-0775-44d2-bdc6-c74c26eb2226@192.168.201.46@tcp:383/0 lens 488/0 e 0 to 0 dl 1777051433 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1777051422.735354:0:46207:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99d943d92680 with x1863365425969664 ext(0->1048575) 00002000:00010000:0.0:1777051422.735362:0:46207:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99d943d92680 00000100:00100000:0.0:1777051422.735403:0:46207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 1767 00000100:00100000:0.0:1777051422.735418:0:46207:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d943d92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c11b6966-0775-44d2-bdc6-c74c26eb2226+49:2437:x1863365425969664:12345-192.168.201.46@tcp:3:lhsmtool_posix.0 00000100:00100000:0.0:1777051422.748007:0:46207:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d943d92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c11b6966-0775-44d2-bdc6-c74c26eb2226+49:2437:x1863365425969664:12345-192.168.201.46@tcp:3:lhsmtool_posix.0 Request processed in 12300us (12529us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1777051422.748027:0:46207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 1767 00002000:00100000:0.0:1777051422.748069:0:46207:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x1e3:0x0] (0->1048575) req@ffff99d943d92680 x1863365425969664/t0(0) o3->c11b6966-0775-44d2-bdc6-c74c26eb2226@192.168.201.46@tcp:383/0 lens 488/440 e 0 to 0 dl 1777051433 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1777051422.748085:0:46207:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99d943d92680 with x1863365425969664 ext(0->1048575) 00002000:00010000:0.0:1777051422.748094:0:46207:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99d943d92680 00000100:00100000:3.0:1777051422.764654:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051422.765138:0:46497:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425969792 00000100:00100000:2.0:1777051422.765153:0:46497:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425969792 00000100:00100000:2.0:1777051422.765257:0:46497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112032 00000100:00100000:2.0:1777051422.765278:0:46497:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da444a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:c11b6966-0775-44d2-bdc6-c74c26eb2226+25:137369:x1863365425969792:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1777051422.765305:0:46497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051422.765334:0:46497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d950262400/0x85f51a6b96716158 lrc: 2/0,0 mode: --/PR res: [0x2000032e3:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6394 expref: -99 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051422.765384:0:46497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263a00/0x85f51a6b9671615f lrc: 3/1,0 mode: --/PR res: [0x2000032e3:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051422.765410:0:46497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263a00/0x85f51a6b9671615f lrc: 3/1,0 mode: PR/PR res: [0x2000032e3:0x3:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051422.765427:0:46497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263a00/0x85f51a6b9671615f lrc: 3/1,0 mode: PR/PR res: [0x2000032e3:0x3:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051422.765586:0:46497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d950262400/0x85f51a6b96716158 lrc: 0/0,0 mode: --/PR res: [0x2000032e3:0x3:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6394 expref: 27 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051422.765611:0:46497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263a00/0x85f51a6b9671615f lrc: 3/0,0 mode: PR/PR res: [0x2000032e3:0x3:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6394 expref: 26 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051422.765624:0:46497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e3:0x3:0x0].0x0 (ffff99d94e6b6f00) 00010000:00010000:2.0:1777051422.765629:0:46497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1777051422.765635:0:46497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d950263a00, rc 0) 00000100:00100000:2.0:1777051422.765719:0:46497:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da444a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:c11b6966-0775-44d2-bdc6-c74c26eb2226+26:137369:x1863365425969792:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 Request processed in 447us (1128us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051422.765731:0:46497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112032 00000100:00100000:3.0:1777051422.771190:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051422.771333:0:6579:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425969920 00000100:00100000:0.0:1777051422.771344:0:6579:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425969920 00000100:00100000:0.0:1777051422.771423:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112033 00000100:00100000:0.0:1777051422.771437:0:6579:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d9533bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+26:137369:x1863365425969920:12345-192.168.201.46@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1777051422.771478:0:6579:0:(mdt_handler.c:7958:mdt_fid2path()) path get [0x2000032e3:0x3:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1777051422.771663:0:6579:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d9533bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+26:137369:x1863365425969920:12345-192.168.201.46@tcp:53:lhsmtool_posix.0 Request processed in 227us (484us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051422.771682:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112033 00000100:00100000:0.0:1777051422.778493:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051422.778643:0:8470:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425970048 00000100:00100000:2.0:1777051422.778654:0:8470:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425970048 00000100:00100000:2.0:1777051422.778707:0:8470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 8004 00000100:00100000:2.0:1777051422.778720:0:8470:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da445de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+49:2436:x1863365425970048:12345-192.168.201.46@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1777051422.778769:0:8470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000001d3be32f/0x85f51a6b96716166 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x1e3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051422.778791:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777051422.778811:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777051422.778819:0:8470:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001d3be32f/0x85f51a6b96716166 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x1e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051422.778841:0:8470:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001d3be32f/0x85f51a6b96716166 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x1e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051422.778876:0:8470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000001d3be32f/0x85f51a6b96716166 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x1e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051422.778891:0:8470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001d3be32f/0x85f51a6b96716166 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x1e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051422.778905:0:8470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001d3be32f/0x85f51a6b96716166 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051422.778940:0:8470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d950262400 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:2.0:1777051422.778954:0:8470:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001d3be32f/0x85f51a6b96716166 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051422.778969:0:8470:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001d3be32f/0x85f51a6b96716166 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051422.778992:0:8470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001d3be32f/0x85f51a6b96716166 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x1e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051422.779007:0:8470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001d3be32f/0x85f51a6b96716166 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x1e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051422.779465:0:8470:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da445de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+49:2436:x1863365425970048:12345-192.168.201.46@tcp:1:lhsmtool_posix.0 Request processed in 745us (978us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051422.779479:0:8470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 8004 00000100:00100000:1.0:1777051422.782863:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051422.782953:0:21368:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425970304 00000100:00100000:2.0:1777051422.782981:0:21368:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425970304 00000100:00100000:2.0:1777051422.783180:0:21368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112034 00000100:00100000:2.0:1777051422.783196:0:21368:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7e24dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+26:137369:x1863365425970304:12345-192.168.201.46@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1777051422.783317:0:21368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263e00/0x85f51a6b9671616d lrc: 3/0,1 mode: --/PW res: [0x2000032e3:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051422.783337:0:21368:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263a00/0x85f51a6b9671615f lrc: 2/0,0 mode: PR/PR res: [0x2000032e3:0x3:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6394 expref: 26 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051422.783348:0:21368:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263e00/0x85f51a6b9671616d lrc: 4/0,1 mode: --/PW res: [0x2000032e3:0x3:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051422.783385:0:21368:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263a00/0x85f51a6b9671615f lrc: 3/0,0 mode: PR/PR res: [0x2000032e3:0x3:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6394 expref: 26 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051422.783403:0:21368:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263a00/0x85f51a6b9671615f lrc: 4/0,0 mode: PR/PR res: [0x2000032e3:0x3:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6394 expref: 26 pid: 46497 timeout: 8151 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051422.783443:0:21368:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f9ffb80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:21368:1863365452630528:192.168.201.46@tcp:104: 00000100:00100000:2.0:1777051422.783565:0:21368:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d958f6d480 going to sleep for 11 seconds 00000100:00100000:1.0:1777051422.786176:0:21368:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f9ffb80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:21368:1863365452630528:192.168.201.46@tcp:104: 00010000:00010000:1.0:1777051422.786234:0:21368:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263e00/0x85f51a6b9671616d lrc: 3/0,1 mode: --/PW res: [0x2000032e3:0x3:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051422.786952:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051422.787487:0:6564:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425970432 00000100:00100000:0.0:1777051422.787497:0:6564:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425970432 00010000:00010000:0.0:1777051422.787605:0:6564:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263a00/0x85f51a6b9671615f lrc: 4/0,0 mode: PR/PR res: [0x2000032e3:0x3:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6394 expref: 27 pid: 46497 timeout: 8151 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051422.787658:0:6564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3873 00000100:00100000:0.0:1777051422.787671:0:6564:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7e24c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+27:2437:x1863365425970432:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1777051422.787703:0:6564:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777051422.787719:0:6564:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263a00/0x85f51a6b9671615f lrc: 4/0,0 mode: PR/PR res: [0x2000032e3:0x3:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6394 expref: 27 pid: 46497 timeout: 8151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051422.787739:0:6564:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263a00/0x85f51a6b9671615f lrc: 3/0,0 mode: PR/PR res: [0x2000032e3:0x3:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6394 expref: 27 pid: 46497 timeout: 8151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051422.787766:0:6564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263a00/0x85f51a6b9671615f lrc: 0/0,0 mode: --/PR res: [0x2000032e3:0x3:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6394 expref: 27 pid: 46497 timeout: 8151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051422.787786:0:6564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e3:0x3:0x0].0x0 (ffff99d94e6b6f00) 00010000:00010000:0.0:1777051422.787794:0:6564:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263e00/0x85f51a6b9671616d lrc: 3/0,1 mode: --/PW res: [0x2000032e3:0x3:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051422.787808:0:6564:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263e00/0x85f51a6b9671616d lrc: 3/0,1 mode: PW/PW res: [0x2000032e3:0x3:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051422.787822:0:6564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263e00/0x85f51a6b9671616d lrc: 4/0,1 mode: PW/PW res: [0x2000032e3:0x3:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051422.787859:0:6564:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1777051422.787878:0:21368:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263e00/0x85f51a6b9671616d lrc: 3/0,1 mode: PW/PW res: [0x2000032e3:0x3:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051422.787901:0:21368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263e00/0x85f51a6b9671616d lrc: 3/0,1 mode: PW/PW res: [0x2000032e3:0x3:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051422.787915:0:6564:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7e24c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+26:2437:x1863365425970432:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 242us (964us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051422.787929:0:6564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3873 00010000:00010000:2.0:1777051422.788432:0:21368:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263e00/0x85f51a6b9671616d lrc: 3/0,1 mode: PW/PW res: [0x2000032e3:0x3:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051422.788443:0:21368:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263e00/0x85f51a6b9671616d lrc: 2/0,0 mode: PW/PW res: [0x2000032e3:0x3:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051422.788453:0:21368:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263e00/0x85f51a6b9671616d lrc: 3/0,0 mode: PW/PW res: [0x2000032e3:0x3:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051422.788462:0:21368:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d950263e00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:2.0:1777051422.788469:0:21368:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263e00/0x85f51a6b9671616d lrc: 3/0,0 mode: PW/PW res: [0x2000032e3:0x3:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051422.788480:0:21368:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263e00/0x85f51a6b9671616d lrc: 4/0,0 mode: PW/PW res: [0x2000032e3:0x3:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051422.788494:0:21368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e3:0x3:0x0].0x0 (ffff99d94e6b6f00) 00010000:00010000:2.0:1777051422.788499:0:21368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1777051422.788505:0:21368:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263e00/0x85f51a6b9671616d lrc: 2/0,0 mode: --/PW res: [0x2000032e3:0x3:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051422.788515:0:21368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263e00/0x85f51a6b9671616d lrc: 0/0,0 mode: --/PW res: [0x2000032e3:0x3:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051422.788647:0:21368:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7e24dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+26:137369:x1863365425970304:12345-192.168.201.46@tcp:57:lhsmtool_posix.0 Request processed in 5452us (5783us total) trans 30064771143 rc 0/0 00000100:00100000:2.0:1777051422.788662:0:21368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112034 00000040:00080000:1.0:1777051422.788756:0:103189:0:(llog.c:801:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:1.0:1777051422.788764:0:103189:0:(llog_cat.c:158:llog_cat_process_common()) processing log [0x1:0x2b:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1777051422.788795:0:103189:0:(llog.c:858:llog_process_thread()) stop processing plain [0x1:0x2b:0x0] index 5 count 4 00000040:00080000:1.0:1777051422.788804:0:103189:0:(llog.c:858:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00000100:00100000:1.0:1777051422.792729:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051422.792814:0:6582:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425970688 00000100:00100000:3.0:1777051422.792825:0:6582:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425970688 00000100:00100000:3.0:1777051422.792976:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3351 00000100:00100000:3.0:1777051422.792992:0:6582:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7e24d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+26:137369:x1863365425970688:12345-192.168.201.46@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1777051422.793577:0:6582:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7e24d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+27:137369:x1863365425970688:12345-192.168.201.46@tcp:35:lhsmtool_posix.0 Request processed in 586us (851us total) trans 30064771144 rc 0/0 00000100:00100000:3.0:1777051422.793590:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3351 00010000:00010000:0.0:1777051422.806419:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1777051423.006236:0:107200:0:(llog.c:801:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:3.0:1777051423.006250:0:107200:0:(llog_cat.c:158:llog_cat_process_common()) processing log [0x1:0x2b:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1777051423.006306:0:107200:0:(llog.c:858:llog_process_thread()) stop processing plain [0x1:0x2b:0x0] index 5 count 4 00000040:00080000:3.0:1777051423.006315:0:107200:0:(llog.c:858:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00000100:00100000:0.0:1777051423.268678:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051423.268813:0:27882:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425970816 00000100:00100000:2.0:1777051423.268831:0:27882:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425970816 00000100:00100000:2.0:1777051423.268946:0:27882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13383 00000100:00100000:2.0:1777051423.268967:0:27882:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da445ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+48:2435:x1863365425970816:12345-192.168.201.46@tcp:38:lctl.0 00010000:02000400:2.0:1777051423.269016:0:27882:0:(ldlm_lib.c:952:target_handle_reconnect()) lustre-MDT0001: Client 2dd4696c-edce-4cd1-86d2-dbd2ff957fa1 (at 192.168.201.46@tcp) reconnecting 00000100:00080000:3.0:1777051423.269072:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1777051423.291881:0:27882:0:(ldlm_lib.c:1431:target_handle_connect()) lustre-MDT0001: connection from 2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp t0 exp ffff99da4622a000 cur 8052 last 1777051423 00000004:00100000:2.0:1777051423.291929:0:27882:0:(mdt_handler.c:7281:mdt_connect_internal()) lustre-MDT0001: cli 192.168.201.46@tcp supports cksum type b7, return b7 00000100:00080000:2.0:1777051423.291964:0:27882:0:(import.c:65:import_set_state_nolock()) ffff99da7dbeb800 : changing import state from FULL to RECOVER 00000100:00080000:2.0:1777051423.291978:0:27882:0:(import.c:65:import_set_state_nolock()) ffff99da7dbeb800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1777051423.292126:0:27882:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da445ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+48:2435:x1863365425970816:12345-192.168.201.46@tcp:38:lctl.0 Request processed in 23163us (23457us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051423.292144:0:27882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13383 00000100:00100000:1.0:1777051423.381954:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051423.382188:0:46494:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425970944 00000100:00100000:3.0:1777051423.382520:0:46494:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425970944 00000100:00100000:3.0:1777051423.382624:0:46494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13384 00000100:00100000:3.0:1777051423.382640:0:46494:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7e24c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c11b6966-0775-44d2-bdc6-c74c26eb2226+8:2435:x1863365425970944:12345-192.168.201.46@tcp:38:lctl.0 00010000:02000400:3.0:1777051423.382682:0:46494:0:(ldlm_lib.c:952:target_handle_reconnect()) lustre-MDT0001: Client c11b6966-0775-44d2-bdc6-c74c26eb2226 (at 192.168.201.46@tcp) reconnecting 00010000:00080000:3.0:1777051423.382689:0:46494:0:(ldlm_lib.c:1431:target_handle_connect()) lustre-MDT0001: connection from c11b6966-0775-44d2-bdc6-c74c26eb2226@192.168.201.46@tcp t0 exp ffff99da4622d800 cur 8052 last 1777051423 00000004:00100000:3.0:1777051423.382719:0:46494:0:(mdt_handler.c:7281:mdt_connect_internal()) lustre-MDT0001: cli 192.168.201.46@tcp supports cksum type b7, return b7 00000100:00080000:3.0:1777051423.382743:0:46494:0:(import.c:65:import_set_state_nolock()) ffff99da71c6c000 : changing import state from FULL to RECOVER 00000100:00080000:3.0:1777051423.382756:0:46494:0:(import.c:65:import_set_state_nolock()) ffff99da71c6c000 : changing import state from RECOVER to FULL 00000100:00080000:0.0:1777051423.382825:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1777051423.382844:0:46494:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7e24c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c11b6966-0775-44d2-bdc6-c74c26eb2226+8:2435:x1863365425970944:12345-192.168.201.46@tcp:38:lctl.0 Request processed in 206us (895us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051423.382860:0:46494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13384 00000100:00100000:3.0:1777051423.405590:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051423.405735:0:6580:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425971072 00000100:00100000:1.0:1777051423.405749:0:6580:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425971072 00000100:00100000:1.0:1777051423.405832:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112035 00000100:00100000:1.0:1777051423.405848:0:6580:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d9533bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+8:137398:x1863365425971072:12345-192.168.201.46@tcp:59:kuc_reregister.0 00000004:02000400:1.0:1777051423.405906:0:6580:0:(mdt_hsm_cdt_agent.c:99:mdt_hsm_agent_register()) HSM agent c11b6966-0775-44d2-bdc6-c74c26eb2226 already registered 00000100:00100000:1.0:1777051423.414991:0:6580:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d9533bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+8:137398:x1863365425971072:12345-192.168.201.46@tcp:59:kuc_reregister.0 Request processed in 9140us (9402us total) trans 0 rc -17/-17 00000100:00100000:1.0:1777051423.415007:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112035 00010000:00010000:0.0:1777051423.830440:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1777051423.894635:0:104226:0:(llog.c:801:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1777051423.894647:0:104226:0:(llog_cat.c:158:llog_cat_process_common()) processing log [0x1:0x12:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1777051423.894678:0:104226:0:(llog.c:858:llog_process_thread()) stop processing plain [0x1:0x12:0x0] index 3 count 2 00000040:00080000:2.0:1777051423.894689:0:104226:0:(llog.c:858:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1777051424.022541:0:3679:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1777051424.022573:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f9ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452630656:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1777051424.022659:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051424.022763:0:8473:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452630656 00000100:00100000:0.0:1777051424.022776:0:8473:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452630656 00000100:00100000:0.0:1777051424.022876:0:8473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5656 00000100:00100000:0.0:1777051424.022895:0:8473:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3679:x1863365452630656:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1777051424.022901:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:0.0:1777051424.022954:0:8473:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 455081536 pending 0 free 3862671360 avail 3631149056 00000100:00100000:0.0:1777051424.023060:0:8473:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3679:x1863365452630656:12345-0@lo:13:osp-pre-0-0.0 Request processed in 171us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051424.023074:0:8473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5656 00000100:00100000:2.0:1777051424.023402:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f9ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452630656:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1777051424.024613:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d9533bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3677:1863365452630784:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1777051424.024677:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051424.024735:0:10113:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452630784 00000100:00100000:1.0:1777051424.024745:0:10113:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452630784 00000100:00080000:2.0:1777051424.025337:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1777051424.025366:0:10113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5657 00000100:00100000:1.0:1777051424.025384:0:10113:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da57e97050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3677:x1863365452630784:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1777051424.025417:0:10113:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 452386368 pending 0 free 3644805120 avail 3413282816 00000100:00100000:1.0:1777051424.025592:0:10113:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da57e97050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3677:x1863365452630784:12345-0@lo:13:osp-pre-1-0.0 Request processed in 212us (913us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051424.025603:0:10113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5657 00000100:00100000:3.0:1777051424.026419:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d9533bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3677:1863365452630784:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1777051424.856179:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051425.878947:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1777051426.583452:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d9533bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452630912:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1777051426.583553:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051426.583931:0:47208:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452630912 00000100:00100000:3.0:1777051426.583947:0:47208:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452630912 00000100:00100000:3.0:1777051426.584177:0:47208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8170 00000100:00100000:3.0:1777051426.584196:0:47208:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7e24ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+6:3678:x1863365452630912:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1777051426.584243:0:47208:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4194304 pending 0 free 1441570816 avail 1295331328 00000100:00100000:3.0:1777051426.584365:0:47208:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7e24ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+6:3678:x1863365452630912:12345-0@lo:41:osp-pre-0-1.0 Request processed in 171us (810us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051426.584390:0:47208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8170 00000100:00100000:1.0:1777051426.584486:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d9533bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452630912:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1777051426.728495:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051426.728574:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051426.728631:0:8492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425971328 00000100:00100000:2.0:1777051426.728647:0:8492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425971328 00000100:00100000:3.0:1777051426.728654:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051426.728698:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051426.728742:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051426.728760:0:8492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425971840 00000100:00100000:2.0:1777051426.728769:0:8492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425971840 00000100:00100000:3.0:1777051426.728779:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051426.728817:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051426.728826:0:8492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425971456 00000100:00100000:2.0:1777051426.728834:0:8492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425971456 00000100:00100000:3.0:1777051426.728856:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051426.728893:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051426.728906:0:8492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425971968 00000100:00100000:2.0:1777051426.728914:0:8492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425971968 00000100:00100000:3.0:1777051426.728953:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13385 00000100:00100000:2.0:1777051426.728995:0:8492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13386 00000100:00100000:2.0:1777051426.729015:0:8492:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d9533bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+30:2439:x1863365425971840:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:3.0:1777051426.729113:0:6579:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d9533bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+27:2439:x1863365425971328:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:2.0:1777051426.729137:0:8492:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d9533bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+30:2439:x1863365425971840:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 125us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051426.729171:0:8492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13386 00000100:00100000:3.0:1777051426.729232:0:6579:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d9533bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+27:2439:x1863365425971328:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 231us (718us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051426.729250:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13385 00000100:00100000:2.0:1777051426.729263:0:8492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13387 00000100:00100000:2.0:1777051426.729279:0:8492:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da4384f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+8:2439:x1863365425971456:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:3.0:1777051426.729297:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13388 00000100:00100000:3.0:1777051426.729314:0:6579:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da4384ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+48:2439:x1863365425971968:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:2.0:1777051426.729336:0:8492:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da4384f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+8:2439:x1863365425971456:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 57us (556us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051426.729349:0:8492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13387 00000100:00100000:3.0:1777051426.729374:0:6579:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da4384ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+48:2439:x1863365425971968:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 61us (513us total) trans 0 rc 0/0 00000100:00080000:2.0:1777051426.729387:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1777051426.729389:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13388 00000100:00080000:2.0:1777051426.729398:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1777051426.729445:0:8471:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425971584 00000100:00100000:3.0:1777051426.729453:0:8471:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425971584 00000100:00100000:3.0:1777051426.729530:0:8471:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425972096 00000100:00100000:3.0:1777051426.729537:0:8471:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425972096 00000100:00100000:3.0:1777051426.729572:0:8471:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425971712 00000100:00100000:3.0:1777051426.729576:0:8471:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425971712 00000100:00100000:3.0:1777051426.729618:0:8471:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425972224 00000100:00100000:3.0:1777051426.729623:0:8471:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425972224 00000100:00100000:2.0:1777051426.729631:0:13320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10435 00000100:00100000:2.0:1777051426.729651:0:13320:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d9533bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+51:2439:x1863365425971584:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:3.0:1777051426.729666:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10436 00000100:00100000:3.0:1777051426.729680:0:8471:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da4384ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+51:2439:x1863365425972096:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:2.0:1777051426.729724:0:13320:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d9533bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+51:2439:x1863365425971584:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 78us (1147us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051426.729736:0:8471:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da4384ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+51:2439:x1863365425972096:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 58us (1034us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051426.729743:0:13320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10435 00000100:00100000:3.0:1777051426.729760:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10436 00000100:00100000:2.0:1777051426.729785:0:13320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10437 00000100:00100000:2.0:1777051426.729807:0:13320:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da4384d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+49:2439:x1863365425971712:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:2.0:1777051426.729858:0:13320:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da4384d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+49:2439:x1863365425971712:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 62us (1044us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051426.730006:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10438 00000100:00100000:2.0:1777051426.730021:0:13320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10437 00000100:00100000:3.0:1777051426.730035:0:8471:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da4384fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+47:2439:x1863365425972224:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:1.0:1777051426.730100:0:103169:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425971200 00000100:00100000:3.0:1777051426.730104:0:8471:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da4384fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+47:2439:x1863365425972224:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 78us (1206us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051426.730111:0:103169:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425971200 00000100:00100000:3.0:1777051426.730125:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10438 00000100:00100000:1.0:1777051426.730176:0:103169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 178 00000100:00080000:2.0:1777051426.730185:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1777051426.730190:0:103169:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:29c4352d-3260-4734-909d-9ea5de9e7fa4+12:2439:x1863365425971200:12345-192.168.201.46@tcp:400:kworker.0 00000100:00080000:2.0:1777051426.730191:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1777051426.730299:0:103169:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:29c4352d-3260-4734-909d-9ea5de9e7fa4+12:2439:x1863365425971200:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 109us (1552us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051426.730313:0:103169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 178 00010000:00010000:1.0:1777051426.904151:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1777051427.095565:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da445dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3679:1863365452631040:0@lo:400:kworker.0 00000100:00100000:1.0:1777051427.095612:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da445dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3677:1863365452631296:0@lo:400:kworker.0 00000100:00100000:3.0:1777051427.096260:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da445dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3678:1863365452631424:0@lo:400:kworker.0 00000100:00100000:0.0:1777051427.096383:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051427.097079:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051427.097169:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da445df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3677:1863365452631808:0@lo:400:kworker.0 00000100:00100000:1.0:1777051427.097277:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051427.097311:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da445df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452632320:0@lo:400:kworker.0 00000100:00100000:0.0:1777051427.097349:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da445ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3679:1863365452631552:0@lo:400:kworker.0 00000100:00100000:1.0:1777051427.097382:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051427.097453:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da445dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3680:1863365452631168:0@lo:400:kworker.0 00000100:00100000:3.0:1777051427.097467:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051427.097514:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051427.097553:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da445ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3680:1863365452631680:0@lo:400:kworker.0 00000100:00100000:1.0:1777051427.097605:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051427.097631:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051427.097650:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da445dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3680:1863365452632192:0@lo:400:kworker.0 00000100:00100000:0.0:1777051427.097689:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da445dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3679:1863365452632064:0@lo:400:kworker.0 00000100:00100000:1.0:1777051427.098016:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051427.098041:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051427.098068:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da4384e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3680:1863365452632704:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1777051427.098068:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da445df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3678:1863365452631936:0@lo:400:kworker.0 00000100:00100000:0.0:1777051427.098093:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5fbe0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3679:1863365452632576:0@lo:400:kworker.0 00000100:00100000:1.0:1777051427.098141:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051427.098141:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051427.098161:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051427.098192:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da445dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452632448:0@lo:400:kworker.0 00000100:00100000:1.0:1777051427.098260:0:46497:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452631296 00000100:00100000:3.0:1777051427.098265:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051427.098270:0:46497:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452631296 00000100:00100000:0.0:1777051427.098283:0:6581:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452631424 00000100:00100000:0.0:1777051427.098294:0:6581:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452631424 00000100:00100000:3.0:1777051427.098340:0:103166:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452631040 00000100:00100000:3.0:1777051427.098350:0:103166:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452631040 00000100:00100000:1.0:1777051427.098356:0:46497:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452631168 00000100:00100000:1.0:1777051427.098361:0:46497:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452631168 00000100:00100000:0.0:1777051427.098377:0:6581:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452631552 00000100:00100000:0.0:1777051427.098386:0:6581:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452631552 00000100:00100000:1.0:1777051427.098412:0:46497:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452632064 00000100:00100000:3.0:1777051427.098416:0:103166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1777051427.098420:0:46497:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452632064 00000100:00100000:3.0:1777051427.098434:0:103166:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9351a01-5b0e-4470-97fd-58b9b4b312a2+23:3679:x1863365452631040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777051427.098449:0:6581:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452632576 00000100:00100000:0.0:1777051427.098457:0:6581:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452632576 00000100:00100000:1.0:1777051427.098465:0:46497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13389 00000100:00100000:1.0:1777051427.098483:0:46497:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7e24ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:lustre-MDT0001-lwp-OST0000_UUID+5:3677:x1863365452631296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777051427.098509:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13390 00000100:00100000:3.0:1777051427.098528:0:103166:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9351a01-5b0e-4470-97fd-58b9b4b312a2+23:3679:x1863365452631040:12345-0@lo:400:kworker.0 Request processed in 98us (2149us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051427.098531:0:6581:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da4384df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3678:x1863365452631424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777051427.098554:0:46497:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7e24ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:lustre-MDT0001-lwp-OST0000_UUID+5:3677:x1863365452631296:12345-0@lo:400:kworker.0 Request processed in 75us (1474us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051427.098555:0:103166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1777051427.098566:0:46497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13389 00000100:00100000:1.0:1777051427.098595:0:46497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13391 00000100:00100000:1.0:1777051427.098611:0:46497:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7e24e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:lustre-MDT0000-lwp-OST0000_UUID+5:3680:x1863365452631168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051427.098639:0:6585:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452631680 00000100:00100000:0.0:1777051427.098640:0:6581:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da4384df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3678:x1863365452631424:12345-0@lo:400:kworker.0 Request processed in 113us (1167us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051427.098648:0:6585:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452631680 00000100:00100000:0.0:1777051427.098661:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13390 00000100:00100000:1.0:1777051427.098697:0:46497:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7e24e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:lustre-MDT0000-lwp-OST0000_UUID+5:3680:x1863365452631168:12345-0@lo:400:kworker.0 Request processed in 89us (1180us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051427.098706:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13392 00000100:00100000:3.0:1777051427.098708:0:6585:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452632192 00000100:00100000:3.0:1777051427.098716:0:6585:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452632192 00000100:00100000:1.0:1777051427.098722:0:46497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13391 00000100:00100000:0.0:1777051427.098730:0:6581:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5fbe3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3679:x1863365452631552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777051427.098754:0:46497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13393 00000100:00100000:1.0:1777051427.098771:0:46497:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5fbe2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:lustre-MDT0000-lwp-MDT0000_UUID+5:3679:x1863365452632064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051427.098800:0:6585:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452632704 00000100:00100000:0.0:1777051427.098807:0:6581:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5fbe3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3679:x1863365452631552:12345-0@lo:400:kworker.0 Request processed in 81us (1177us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051427.098809:0:6585:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452632704 00000100:00100000:0.0:1777051427.098825:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13392 00000100:00100000:1.0:1777051427.098858:0:46497:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5fbe2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:lustre-MDT0000-lwp-MDT0000_UUID+5:3679:x1863365452632064:12345-0@lo:400:kworker.0 Request processed in 88us (817us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051427.098874:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13394 00000100:00100000:3.0:1777051427.098876:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8171 00000100:00100000:1.0:1777051427.098888:0:46497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13393 00000100:00100000:0.0:1777051427.098901:0:6581:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d944d28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3679:x1863365452632576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051427.098904:0:6585:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7e24c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:3680:x1863365452631680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777051427.098926:0:27887:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452631808 00000100:00100000:1.0:1777051427.098933:0:27887:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452631808 00000100:00100000:0.0:1777051427.099017:0:6581:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d944d28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3679:x1863365452632576:12345-0@lo:400:kworker.0 Request processed in 124us (855us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051427.099024:0:27887:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452632320 00000100:00100000:1.0:1777051427.099033:0:27887:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452632320 00000100:00100000:0.0:1777051427.099038:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13394 00000100:00100000:3.0:1777051427.099038:0:6585:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7e24c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:3680:x1863365452631680:12345-0@lo:400:kworker.0 Request processed in 140us (1427us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051427.099058:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8171 00000100:00100000:1.0:1777051427.099081:0:27887:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452631936 00000100:00100000:1.0:1777051427.099086:0:27887:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452631936 00000100:00100000:3.0:1777051427.099086:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8172 00000100:00100000:0.0:1777051427.099104:0:46498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8173 00000100:00100000:3.0:1777051427.099106:0:6585:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f299880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3680:x1863365452632192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777051427.099129:0:46498:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95088b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+6:3680:x1863365452632704:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1777051427.099132:0:27887:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452632448 00000100:00100000:1.0:1777051427.099141:0:27887:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452632448 00000100:00100000:3.0:1777051427.099168:0:6585:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f299880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3680:x1863365452632192:12345-0@lo:400:kworker.0 Request processed in 71us (1461us total) trans 0 rc 0/0 00000004:00000024:0.0:1777051427.099176:0:46498:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4194304 pending 0 free 1446154240 avail 1299914752 00000100:00100000:3.0:1777051427.099184:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8172 00000100:00100000:1.0:1777051427.099192:0:27887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10439 00000100:00100000:1.0:1777051427.099239:0:27887:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7e24df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3677:x1863365452631808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051427.099262:0:13320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10440 00000100:00100000:3.0:1777051427.099276:0:13320:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7e24ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3677:x1863365452632320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777051427.099288:0:46498:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95088b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+6:3680:x1863365452632704:12345-0@lo:41:osp-pre-1-0.0 Request processed in 166us (1148us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051427.099302:0:46498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8173 00000100:00100000:1.0:1777051427.099321:0:27887:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7e24df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3677:x1863365452631808:12345-0@lo:400:kworker.0 Request processed in 83us (2042us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051427.099333:0:27887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10439 00000100:00100000:3.0:1777051427.099333:0:13320:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7e24ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3677:x1863365452632320:12345-0@lo:400:kworker.0 Request processed in 59us (1952us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051427.099342:0:13320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10440 00000100:00100000:1.0:1777051427.099365:0:27887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10441 00000100:00100000:3.0:1777051427.099371:0:13320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10442 00000100:00100000:1.0:1777051427.099377:0:27887:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7c9a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3678:x1863365452631936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051427.099383:0:13320:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7c9a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3678:x1863365452632448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777051427.099426:0:27887:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7c9a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3678:x1863365452631936:12345-0@lo:400:kworker.0 Request processed in 51us (1288us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051427.099426:0:13320:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7c9a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3678:x1863365452632448:12345-0@lo:400:kworker.0 Request processed in 44us (1163us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051427.099437:0:13320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10442 00000100:00100000:1.0:1777051427.099445:0:27887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10441 00000100:00080000:0.0:1777051427.099550:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1777051427.099559:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1777051427.099566:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1777051427.099571:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1777051427.099574:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da445dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3680:1863365452631168:0@lo:400:kworker.0 00000100:00100000:3.0:1777051427.099574:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da445dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3678:1863365452631424:0@lo:400:kworker.0 00000100:00100000:1.0:1777051427.099600:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da445ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3680:1863365452631680:0@lo:400:kworker.0 00000100:00100000:3.0:1777051427.099600:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da445df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3678:1863365452631936:0@lo:400:kworker.0 00000100:00100000:0.0:1777051427.099638:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da445dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3677:1863365452631296:0@lo:400:kworker.0 00000100:00100000:3.0:1777051427.099639:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da445dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452632448:0@lo:400:kworker.0 00000100:00100000:1.0:1777051427.099640:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da445dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3680:1863365452632192:0@lo:400:kworker.0 00000100:00100000:1.0:1777051427.099684:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da4384e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3680:1863365452632704:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1777051427.099696:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da445df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3677:1863365452631808:0@lo:400:kworker.0 00000100:00100000:3.0:1777051427.099729:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da445dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3679:1863365452631040:0@lo:400:kworker.0 00000100:00100000:0.0:1777051427.099737:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da445df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452632320:0@lo:400:kworker.0 00000100:00100000:3.0:1777051427.099764:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da445ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3679:1863365452631552:0@lo:400:kworker.0 00000100:00100000:3.0:1777051427.099788:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da445dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3679:1863365452632064:0@lo:400:kworker.0 00000100:00100000:3.0:1777051427.099808:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5fbe0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3679:1863365452632576:0@lo:400:kworker.0 00000100:00100000:2.0:1777051427.581162:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051427.581591:0:46497:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425972480 00000100:00100000:1.0:1777051427.581609:0:46497:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425972480 00000100:00100000:1.0:1777051427.581984:0:46497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112036 00000100:00100000:1.0:1777051427.582004:0:46497:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+30:137822:x1863365425972480:12345-192.168.201.46@tcp:101:rm.0 00010000:00010000:1.0:1777051427.582034:0:46497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777051427.582066:0:46497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48a000/0x85f51a6b96716174 lrc: 2/0,0 mode: --/CR res: [0x2000032e2:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b639b expref: -99 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1777051427.582536:0:46497:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000032e2:0x4:0x0]: returning size 4096 00010000:00010000:1.0:1777051427.583016:0:46497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48a000/0x85f51a6b96716174 lrc: 1/0,0 mode: --/CR res: [0x2000032e2:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b639b expref: 32 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051427.583041:0:46497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0x3:0x0].0x0 (ffff99d94e81c200) 00010000:00010000:1.0:1777051427.583045:0:46497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1777051427.583053:0:46497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48a000/0x85f51a6b96716174 lrc: 0/0,0 mode: --/CR res: [0x2000032e2:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b639b expref: 32 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051427.583073:0:46497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d94e48a000, rc 0) 00000100:00100000:1.0:1777051427.583532:0:46497:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+31:137822:x1863365425972480:12345-192.168.201.46@tcp:101:rm.0 Request processed in 1533us (2387us total) trans 30064771145 rc 301/301 00000100:00100000:1.0:1777051427.583545:0:46497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112036 00000001:00080000:2.0:1777051427.587253:0:103159:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771145 is committed 00000001:00080000:2.0:1777051427.587272:0:103159:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771144 is committed 00000100:00100000:2.0:1777051427.589455:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051427.589666:0:6583:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425972608 00000100:00100000:3.0:1777051427.589683:0:6583:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425972608 00000100:00100000:3.0:1777051427.589789:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3352 00000100:00100000:3.0:1777051427.589814:0:6583:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da6ff06450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+30:137822:x1863365425972608:12345-192.168.201.46@tcp:37:rm.0 00000100:00100000:0.0:1777051427.596053:0:6583:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da6ff06450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+30:137822:x1863365425972608:12345-192.168.201.46@tcp:37:rm.0 Request processed in 6238us (6599us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051427.596074:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3352 00000100:00100000:2.0:1777051427.599441:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051427.599590:0:46501:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425972864 00000100:00100000:0.0:1777051427.599604:0:46501:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425972864 00000100:00100000:0.0:1777051427.599677:0:46501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3353 00000100:00100000:0.0:1777051427.599690:0:46501:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+30:137822:x1863365425972864:12345-192.168.201.46@tcp:35:rm.0 00000100:00100000:0.0:1777051427.600006:0:46501:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+31:137822:x1863365425972864:12345-192.168.201.46@tcp:35:rm.0 Request processed in 317us (572us total) trans 30064771146 rc 0/0 00000100:00100000:0.0:1777051427.600018:0:46501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3353 00000100:00100000:2.0:1777051427.602912:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051427.603010:0:21368:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425973120 00000100:00100000:0.0:1777051427.603019:0:21368:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425973120 00000100:00100000:0.0:1777051427.603097:0:21368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112037 00000100:00100000:0.0:1777051427.603112:0:21368:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+31:137822:x1863365425973120:12345-192.168.201.46@tcp:101:rm.0 00010000:00010000:0.0:1777051427.603137:0:21368:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051427.603163:0:21368:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2bc00/0x85f51a6b96716182 lrc: 2/0,0 mode: --/CR res: [0x2000032e2:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b63a2 expref: -99 pid: 21368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051427.603294:0:21368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2a400/0x85f51a6b96716189 lrc: 3/1,0 mode: --/CR res: [0x2000032e2:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051427.603315:0:21368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2a400/0x85f51a6b96716189 lrc: 3/1,0 mode: CR/CR res: [0x2000032e2:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051427.603333:0:21368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2a400/0x85f51a6b96716189 lrc: 3/1,0 mode: CR/CR res: [0x2000032e2:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1777051427.603364:0:21368:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000032e2:0x4:0x0]: returning size 4096 00010000:00010000:0.0:1777051427.603479:0:21368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2bc00/0x85f51a6b96716182 lrc: 0/0,0 mode: --/CR res: [0x2000032e2:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b63a2 expref: 34 pid: 21368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051427.603495:0:21368:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2a400/0x85f51a6b96716189 lrc: 3/0,0 mode: CR/CR res: [0x2000032e2:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b63a2 expref: 33 pid: 21368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051427.603505:0:21368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0x4:0x0].0x0 (ffff99d943f76900) 00010000:00010000:0.0:1777051427.603508:0:21368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1777051427.603511:0:21368:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d94eb2a400, rc 0) 00000100:00100000:0.0:1777051427.603556:0:21368:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+33:137822:x1863365425973120:12345-192.168.201.46@tcp:101:rm.0 Request processed in 450us (651us total) trans 30064771147 rc 0/0 00000100:00100000:0.0:1777051427.603563:0:21368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112037 00000100:00100000:2.0:1777051427.606652:0:3678:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1777051427.606682:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d950888a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452632960:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1777051427.606763:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051427.606818:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f9ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452632832:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1777051427.606854:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051427.606901:0:47388:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452632960 00000100:00100000:3.0:1777051427.606914:0:47388:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452632960 00000100:00100000:1.0:1777051427.606928:0:8473:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452632832 00000100:00100000:1.0:1777051427.606939:0:8473:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452632832 00000100:00100000:1.0:1777051427.607021:0:8473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5658 00000100:00100000:1.0:1777051427.607033:0:8473:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3678:x1863365452632832:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1777051427.607091:0:8473:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 455081536 pending 0 free 3862671360 avail 3631149056 00000100:00100000:1.0:1777051427.607182:0:8473:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3678:x1863365452632832:12345-0@lo:13:osp-pre-0-1.0 Request processed in 151us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051427.607194:0:8473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5658 00000100:00100000:2.0:1777051427.607334:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f9ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452632832:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1777051427.607668:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051427.607722:0:47388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5659 00000100:00100000:3.0:1777051427.608037:0:47388:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3678:x1863365452632960:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1777051427.608057:0:10328:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425973248 00000100:00100000:0.0:1777051427.608066:0:10328:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425973248 00002000:00000024:3.0:1777051427.608092:0:47388:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 452386368 pending 0 free 3644805120 avail 3413282816 00000100:00100000:0.0:1777051427.608135:0:10328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112038 00000100:00100000:0.0:1777051427.608152:0:10328:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+33:137822:x1863365425973248:12345-192.168.201.46@tcp:41:rm.0 00000004:00000024:0.0:1777051427.608222:0:10328:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4194304 pending 0 free 7507476480 avail 7044431872 00000100:00100000:3.0:1777051427.608265:0:47388:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3678:x1863365452632960:12345-0@lo:13:osp-pre-1-1.0 Request processed in 237us (1495us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051427.608284:0:47388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5659 00000100:00100000:2.0:1777051427.608315:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d950888a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452632960:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1777051427.608399:0:10328:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+33:137822:x1863365425973248:12345-192.168.201.46@tcp:41:rm.0 Request processed in 250us (735us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051427.608411:0:10328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112038 00000100:00100000:2.0:1777051427.611845:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051427.611908:0:46494:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425973504 00000100:00100000:0.0:1777051427.611915:0:46494:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425973504 00000100:00100000:0.0:1777051427.611986:0:46494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112039 00000100:00100000:0.0:1777051427.612000:0:46494:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+33:137822:x1863365425973504:12345-192.168.201.46@tcp:36:rm.0 00010000:00010000:0.0:1777051427.612053:0:46494:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1777051427.612090:0:46494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6800/0x85f51a6b96716104 lrc: 0/0,0 mode: --/PR res: [0x2000032e3:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6363 expref: 33 pid: 21368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051427.612116:0:46494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e3:0x3:0x0].0x0 (ffff99d94e6b6f00) 00010000:00010000:0.0:1777051427.612129:0:46494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b200/0x85f51a6b96716127 lrc: 0/0,0 mode: --/PR res: [0x2000032e2:0x4:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6378 expref: 32 pid: 46494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051427.612142:0:46494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0x4:0x0].0x0 (ffff99d943f76900) 00010000:00010000:0.0:1777051427.612146:0:46494:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1777051427.612174:0:46494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2bc00/0x85f51a6b96716197 lrc: 3/0,1 mode: --/CW res: [0x2000032e2:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051427.612211:0:46494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2bc00/0x85f51a6b96716197 lrc: 3/0,1 mode: CW/CW res: [0x2000032e2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051427.612226:0:46494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2bc00/0x85f51a6b96716197 lrc: 3/0,1 mode: CW/CW res: [0x2000032e2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051427.612260:0:46494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b400/0x85f51a6b9671619e lrc: 3/0,1 mode: --/PW res: [0x2000032e2:0x4:0x0].0x4b5e7af5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051427.612284:0:46494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b400/0x85f51a6b9671619e lrc: 3/0,1 mode: PW/PW res: [0x2000032e2:0x4:0x0].0x4b5e7af5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051427.612296:0:46494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b400/0x85f51a6b9671619e lrc: 3/0,1 mode: PW/PW res: [0x2000032e2:0x4:0x0].0x4b5e7af5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051427.612417:0:46494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2a000/0x85f51a6b967161a5 lrc: 3/0,1 mode: --/EX res: [0x2000032e3:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051427.612433:0:46494:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48a600/0x85f51a6b967160a2 lrc: 2/0,0 mode: PR/PR res: [0x2000032e3:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6347 expref: 22 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051427.612444:0:46494:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2a000/0x85f51a6b967161a5 lrc: 4/0,1 mode: --/EX res: [0x2000032e3:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051427.612484:0:46494:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48a600/0x85f51a6b967160a2 lrc: 3/0,0 mode: PR/PR res: [0x2000032e3:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6347 expref: 22 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051427.612506:0:46494:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48a600/0x85f51a6b967160a2 lrc: 4/0,0 mode: PR/PR res: [0x2000032e3:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6347 expref: 22 pid: 6580 timeout: 8156 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051427.612524:0:46494:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d944d28700 pname:cluuid:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000_UUID:46494:1863365452633088:192.168.201.46@tcp:104: 00000100:00100000:0.0:1777051427.612628:0:46494:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d94eea9780 going to sleep for 11 seconds 00000100:00100000:1.0:1777051427.618527:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051427.618535:0:46494:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d944d28700 pname:cluuid:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000_UUID:46494:1863365452633088:192.168.201.46@tcp:104: 00010000:00010000:0.0:1777051427.618573:0:46494:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2a000/0x85f51a6b967161a5 lrc: 3/0,1 mode: --/EX res: [0x2000032e3:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051427.618627:0:47827:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425973632 00000100:00100000:3.0:1777051427.618638:0:47827:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425973632 00010000:00010000:3.0:1777051427.618806:0:47827:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48a600/0x85f51a6b967160a2 lrc: 4/0,0 mode: PR/PR res: [0x2000032e3:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6347 expref: 23 pid: 6580 timeout: 8156 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051427.618858:0:47827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3874 00000100:00100000:3.0:1777051427.618873:0:47827:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d950888380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+23:2436:x1863365425973632:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1777051427.618895:0:47827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777051427.618905:0:47827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48a600/0x85f51a6b967160a2 lrc: 4/0,0 mode: PR/PR res: [0x2000032e3:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6347 expref: 23 pid: 6580 timeout: 8156 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051427.618924:0:47827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48a600/0x85f51a6b967160a2 lrc: 3/0,0 mode: PR/PR res: [0x2000032e3:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6347 expref: 23 pid: 6580 timeout: 8156 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051427.618993:0:47827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48a600/0x85f51a6b967160a2 lrc: 0/0,0 mode: --/PR res: [0x2000032e3:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6347 expref: 23 pid: 6580 timeout: 8156 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051427.619015:0:47827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e3:0x3:0x0].0x0 (ffff99d94e6b6f00) 00010000:00010000:3.0:1777051427.619021:0:47827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2a000/0x85f51a6b967161a5 lrc: 3/0,1 mode: --/EX res: [0x2000032e3:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051427.619034:0:47827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2a000/0x85f51a6b967161a5 lrc: 3/0,1 mode: EX/EX res: [0x2000032e3:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051427.619044:0:47827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2a000/0x85f51a6b967161a5 lrc: 4/0,1 mode: EX/EX res: [0x2000032e3:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051427.619099:0:47827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1777051427.619135:0:46494:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2a000/0x85f51a6b967161a5 lrc: 3/0,1 mode: EX/EX res: [0x2000032e3:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051427.619147:0:46494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2a000/0x85f51a6b967161a5 lrc: 3/0,1 mode: EX/EX res: [0x2000032e3:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051427.619178:0:47827:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d950888380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+22:2436:x1863365425973632:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 302us (656us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051427.619190:0:47827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3874 00000040:00080000:0.0:1777051427.619571:0:46494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x29:0x0].3, 64 off8384 00000004:00080000:0.0:1777051427.619587:0:46494:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 8056812388590ns, next at 8057812385074ns, rc = 0 00010000:00010000:0.0:1777051427.619660:0:46494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2a800/0x85f51a6b967161ac lrc: 3/0,1 mode: --/PW res: [0x2000032e3:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051427.619675:0:46494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2a800/0x85f51a6b967161ac lrc: 3/0,1 mode: PW/PW res: [0x2000032e3:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051427.619687:0:46494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2a800/0x85f51a6b967161ac lrc: 3/0,1 mode: PW/PW res: [0x2000032e3:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051427.619940:0:46494:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2a800/0x85f51a6b967161ac lrc: 4/0,1 mode: PW/PW res: [0x2000032e3:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051427.619949:0:46494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2a800/0x85f51a6b967161ac lrc: 4/0,1 mode: PW/PW res: [0x2000032e3:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051427.619998:0:46494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2a800/0x85f51a6b967161ac lrc: 3/0,0 mode: PW/PW res: [0x2000032e3:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051427.620035:0:46494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1777051427.620067:0:46494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2a000/0x85f51a6b967161a5 lrc: 3/0,1 mode: EX/EX res: [0x2000032e3:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051427.620103:0:6568:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1777051427.620107:0:46494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2a000/0x85f51a6b967161a5 lrc: 2/0,0 mode: EX/EX res: [0x2000032e3:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051427.620115:0:6568:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2a800/0x85f51a6b967161ac lrc: 2/0,0 mode: PW/PW res: [0x2000032e3:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051427.620118:0:46494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2a000/0x85f51a6b967161a5 lrc: 3/0,0 mode: EX/EX res: [0x2000032e3:0x3:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051427.620143:0:6568:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94eb2a800 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:0.0:1777051427.620145:0:46494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94eb2a000 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:3.0:1777051427.620154:0:6568:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2a800/0x85f51a6b967161ac lrc: 2/0,0 mode: PW/PW res: [0x2000032e3:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051427.620156:0:46494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2a000/0x85f51a6b967161a5 lrc: 3/0,0 mode: EX/EX res: [0x2000032e3:0x3:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051427.620183:0:46494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2a000/0x85f51a6b967161a5 lrc: 4/0,0 mode: EX/EX res: [0x2000032e3:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051427.620184:0:6568:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2a800/0x85f51a6b967161ac lrc: 3/0,0 mode: PW/PW res: [0x2000032e3:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051427.620205:0:6568:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e3:0x3:0x0].0x0 (ffff99d94e6b6f00) 00010000:00010000:3.0:1777051427.620211:0:6568:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1777051427.620217:0:6568:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2a800/0x85f51a6b967161ac lrc: 1/0,0 mode: --/PW res: [0x2000032e3:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051427.620235:0:6568:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2a800/0x85f51a6b967161ac lrc: 0/0,0 mode: --/PW res: [0x2000032e3:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051427.620243:0:46494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e3:0x3:0x0].0x0 (ffff99d94e6b6f00) 00010000:00010000:0.0:1777051427.620248:0:46494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1777051427.620252:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777051427.620254:0:46494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2a000/0x85f51a6b967161a5 lrc: 2/0,0 mode: --/EX res: [0x2000032e3:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051427.620256:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051427.620261:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777051427.620269:0:46494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2a000/0x85f51a6b967161a5 lrc: 0/0,0 mode: --/EX res: [0x2000032e3:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051427.620304:0:46494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2bc00/0x85f51a6b96716197 lrc: 3/0,1 mode: CW/CW res: [0x2000032e2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051427.620314:0:46494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2bc00/0x85f51a6b96716197 lrc: 2/0,0 mode: CW/CW res: [0x2000032e2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051427.620324:0:46494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2bc00/0x85f51a6b96716197 lrc: 3/0,0 mode: CW/CW res: [0x2000032e2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051427.620333:0:46494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94eb2bc00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:0.0:1777051427.620338:0:46494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2bc00/0x85f51a6b96716197 lrc: 3/0,0 mode: CW/CW res: [0x2000032e2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051427.620346:0:46494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2bc00/0x85f51a6b96716197 lrc: 4/0,0 mode: CW/CW res: [0x2000032e2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051427.620363:0:46494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0x4:0x0].0x0 (ffff99d943f76900) 00010000:00010000:0.0:1777051427.620366:0:46494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777051427.620370:0:46494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2bc00/0x85f51a6b96716197 lrc: 2/0,0 mode: --/CW res: [0x2000032e2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051427.620379:0:46494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2bc00/0x85f51a6b96716197 lrc: 0/0,0 mode: --/CW res: [0x2000032e2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1777051427.620394:0:46494:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000a95bc723 reply state 00000000af34e017 transno 30064771148 ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b400/0x85f51a6b9671619e lrc: 3/0,1 mode: PW/PW res: [0x2000032e2:0x4:0x0].0x4b5e7af5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051427.620409:0:46494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b400/0x85f51a6b9671619e lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e2:0x4:0x0].0x4b5e7af5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051427.620418:0:46494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0x4:0x0].0x4b5e7af5 (ffff99d943f76500) 00010000:00010000:0.0:1777051427.620421:0:46494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1777051427.620424:0:46494:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1777051427.620497:0:46494:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+33:137822:x1863365425973504:12345-192.168.201.46@tcp:36:rm.0 Request processed in 8497us (8654us total) trans 30064771148 rc 0/0 00000100:00100000:0.0:1777051427.620508:0:46494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112039 00000100:00100000:1.0:1777051427.624056:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051427.624157:0:24269:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425973888 00000100:00100000:2.0:1777051427.624169:0:24269:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425973888 00000100:00100000:2.0:1777051427.624266:0:24269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3354 00000100:00100000:2.0:1777051427.624282:0:24269:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d950888a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+33:137822:x1863365425973888:12345-192.168.201.46@tcp:35:rm.0 00000100:00100000:2.0:1777051427.624558:0:24269:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d950888a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+34:137822:x1863365425973888:12345-192.168.201.46@tcp:35:rm.0 Request processed in 279us (505us total) trans 30064771149 rc 0/0 00000100:00100000:2.0:1777051427.624570:0:24269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3354 00000100:00100000:2.0:1777051427.629444:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051427.629534:0:8492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425974144 00000100:00100000:0.0:1777051427.629546:0:8492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425974144 00000100:00100000:0.0:1777051427.629626:0:8492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112040 00000100:00100000:0.0:1777051427.629641:0:8492:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+34:137822:x1863365425974144:12345-192.168.201.46@tcp:36:rm.0 00010000:00010000:0.0:1777051427.629714:0:8492:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1777051427.630055:0:8492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2a400/0x85f51a6b96716189 lrc: 0/0,0 mode: --/CR res: [0x2000032e2:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b63a2 expref: 34 pid: 21368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051427.630097:0:8492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2a200/0x85f51a6b967160e8 lrc: 0/0,0 mode: --/PR res: [0x2000032e2:0x4:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b635c expref: 33 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051427.630469:0:8492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0x4:0x0].0x0 (ffff99d943f76900) 00010000:00010000:0.0:1777051427.630491:0:8492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b600/0x85f51a6b96716119 lrc: 0/0,0 mode: --/PR res: [0x2000032e2:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6371 expref: 32 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051427.630509:0:8492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0x3:0x0].0x0 (ffff99d94e81c200) 00010000:00010000:0.0:1777051427.630515:0:8492:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1777051427.630547:0:8492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b200/0x85f51a6b967161b3 lrc: 3/0,1 mode: --/CW res: [0x2000032e2:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051427.630566:0:8492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b200/0x85f51a6b967161b3 lrc: 3/0,1 mode: CW/CW res: [0x2000032e2:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051427.630582:0:8492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b200/0x85f51a6b967161b3 lrc: 3/0,1 mode: CW/CW res: [0x2000032e2:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051427.630604:0:8492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2a800/0x85f51a6b967161ba lrc: 3/0,1 mode: --/PW res: [0x2000032e2:0x3:0x0].0xac1bda01 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051427.630616:0:8492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2a800/0x85f51a6b967161ba lrc: 3/0,1 mode: PW/PW res: [0x2000032e2:0x3:0x0].0xac1bda01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051427.630625:0:8492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2a800/0x85f51a6b967161ba lrc: 3/0,1 mode: PW/PW res: [0x2000032e2:0x3:0x0].0xac1bda01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051427.630737:0:8492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2be00/0x85f51a6b967161c1 lrc: 3/0,1 mode: --/EX res: [0x2000032e2:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051427.630757:0:8492:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2ac00/0x85f51a6b967160cc lrc: 2/0,0 mode: PR/PR res: [0x2000032e2:0x4:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6355 expref: 21 pid: 27885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051427.630768:0:8492:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2be00/0x85f51a6b967161c1 lrc: 4/0,1 mode: --/EX res: [0x2000032e2:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051427.631369:0:8492:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2ac00/0x85f51a6b967160cc lrc: 3/0,0 mode: PR/PR res: [0x2000032e2:0x4:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6355 expref: 21 pid: 27885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051427.631394:0:8492:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2ac00/0x85f51a6b967160cc lrc: 4/0,0 mode: PR/PR res: [0x2000032e2:0x4:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6355 expref: 21 pid: 27885 timeout: 8156 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051427.631418:0:8492:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d944d28700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8492:1863365452633216:192.168.201.46@tcp:104: 00000100:00100000:0.0:1777051427.631537:0:8492:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d94eea9780 going to sleep for 11 seconds 00000100:00100000:0.0:1777051427.634659:0:8492:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d944d28700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8492:1863365452633216:192.168.201.46@tcp:104: 00010000:00010000:0.0:1777051427.634693:0:8492:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2be00/0x85f51a6b967161c1 lrc: 3/0,1 mode: --/EX res: [0x2000032e2:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051427.634831:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051427.634901:0:47597:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425974272 00000100:00100000:0.0:1777051427.634907:0:47597:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425974272 00010000:00010000:0.0:1777051427.634937:0:47597:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2ac00/0x85f51a6b967160cc lrc: 4/0,0 mode: PR/PR res: [0x2000032e2:0x4:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6355 expref: 22 pid: 27885 timeout: 8156 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051427.635019:0:47597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3875 00000100:00100000:0.0:1777051427.635032:0:47597:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9fe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+22:2436:x1863365425974272:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1777051427.635049:0:47597:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777051427.635057:0:47597:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2ac00/0x85f51a6b967160cc lrc: 4/0,0 mode: PR/PR res: [0x2000032e2:0x4:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6355 expref: 22 pid: 27885 timeout: 8156 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051427.635085:0:47597:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2ac00/0x85f51a6b967160cc lrc: 3/0,0 mode: PR/PR res: [0x2000032e2:0x4:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6355 expref: 22 pid: 27885 timeout: 8156 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051427.635110:0:47597:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2ac00/0x85f51a6b967160cc lrc: 0/0,0 mode: --/PR res: [0x2000032e2:0x4:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6355 expref: 22 pid: 27885 timeout: 8156 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051427.635129:0:47597:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0x4:0x0].0x0 (ffff99d943f76900) 00010000:00010000:0.0:1777051427.635135:0:47597:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2be00/0x85f51a6b967161c1 lrc: 3/0,1 mode: --/EX res: [0x2000032e2:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051427.635146:0:47597:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2be00/0x85f51a6b967161c1 lrc: 3/0,1 mode: EX/EX res: [0x2000032e2:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051427.635155:0:47597:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2be00/0x85f51a6b967161c1 lrc: 4/0,1 mode: EX/EX res: [0x2000032e2:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051427.635206:0:47597:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1777051427.635266:0:47597:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9fe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+21:2436:x1863365425974272:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 235us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051427.635276:0:47597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3875 00010000:00010000:2.0:1777051427.635410:0:8492:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2be00/0x85f51a6b967161c1 lrc: 3/0,1 mode: EX/EX res: [0x2000032e2:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051427.635421:0:8492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2be00/0x85f51a6b967161c1 lrc: 3/0,1 mode: EX/EX res: [0x2000032e2:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1777051427.635764:0:8492:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000032e2:0x4:0x0]: returning size 4096 00010000:00010000:2.0:1777051427.635784:0:8492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2be00/0x85f51a6b967161c1 lrc: 3/0,1 mode: EX/EX res: [0x2000032e2:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051427.635792:0:8492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2be00/0x85f51a6b967161c1 lrc: 2/0,0 mode: EX/EX res: [0x2000032e2:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051427.635799:0:8492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2be00/0x85f51a6b967161c1 lrc: 3/0,0 mode: EX/EX res: [0x2000032e2:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051427.635804:0:8492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94eb2be00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:2.0:1777051427.635809:0:8492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2be00/0x85f51a6b967161c1 lrc: 3/0,0 mode: EX/EX res: [0x2000032e2:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051427.635816:0:8492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2be00/0x85f51a6b967161c1 lrc: 4/0,0 mode: EX/EX res: [0x2000032e2:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051427.635824:0:8492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0x4:0x0].0x0 (ffff99d943f76900) 00010000:00010000:2.0:1777051427.635827:0:8492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1777051427.635830:0:8492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2be00/0x85f51a6b967161c1 lrc: 2/0,0 mode: --/EX res: [0x2000032e2:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051427.635836:0:8492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2be00/0x85f51a6b967161c1 lrc: 0/0,0 mode: --/EX res: [0x2000032e2:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051427.635863:0:8492:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b200/0x85f51a6b967161b3 lrc: 4/0,1 mode: CW/CW res: [0x2000032e2:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051427.635878:0:8492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b200/0x85f51a6b967161b3 lrc: 4/0,1 mode: CW/CW res: [0x2000032e2:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051427.635885:0:8492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b200/0x85f51a6b967161b3 lrc: 3/0,0 mode: CW/CW res: [0x2000032e2:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051427.635892:0:8492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b200/0x85f51a6b967161b3 lrc: 4/0,0 mode: CW/CW res: [0x2000032e2:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051427.635899:0:8492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94eb2b200 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:2.0:1777051427.635902:0:8492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b200/0x85f51a6b967161b3 lrc: 4/0,0 mode: CW/CW res: [0x2000032e2:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051427.635911:0:8492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b200/0x85f51a6b967161b3 lrc: 5/0,0 mode: CW/CW res: [0x2000032e2:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051427.635921:0:8492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0x3:0x0].0x0 (ffff99d94e81c200) 00010000:00010000:2.0:1777051427.635924:0:8492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777051427.635928:0:8492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b200/0x85f51a6b967161b3 lrc: 3/0,0 mode: --/CW res: [0x2000032e2:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051427.635936:0:8492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b200/0x85f51a6b967161b3 lrc: 0/0,0 mode: --/CW res: [0x2000032e2:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1777051427.635949:0:8492:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000006119a3e reply state 00000000024f7a86 transno 30064771150 ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2a800/0x85f51a6b967161ba lrc: 3/0,1 mode: PW/PW res: [0x2000032e2:0x3:0x0].0xac1bda01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051427.635988:0:8492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2a800/0x85f51a6b967161ba lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e2:0x3:0x0].0xac1bda01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051427.635997:0:8492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0x3:0x0].0xac1bda01 (ffff99d943f76a00) 00010000:00010000:2.0:1777051427.636001:0:8492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1777051427.636004:0:8492:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1777051427.636073:0:8492:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+33:137822:x1863365425974144:12345-192.168.201.46@tcp:36:rm.0 Request processed in 6436us (6639us total) trans 30064771150 rc 0/0 00000100:00100000:2.0:1777051427.636084:0:8492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112040 00000100:00100000:2.0:1777051427.725675:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051427.726425:0:6581:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425974400 00000100:00100000:0.0:1777051427.726446:0:6581:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425974400 00000100:00100000:0.0:1777051427.726564:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112041 00000100:00100000:0.0:1777051427.726583:0:6581:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+21:137321:x1863365425974400:12345-192.168.201.46@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1777051427.726760:0:6581:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+21:137321:x1863365425974400:12345-192.168.201.46@tcp:60:lhsmtool_posix.0 Request processed in 180us (1098us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051427.726782:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112041 00000100:00100000:3.0:1777051427.734282:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051427.734405:0:27882:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425974528 00000100:00100000:2.0:1777051427.734422:0:27882:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425974528 00000100:00100000:2.0:1777051427.734531:0:27882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112042 00000100:00100000:2.0:1777051427.734545:0:27882:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5fbe0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+8:137321:x1863365425974528:12345-192.168.201.46@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1777051427.734702:0:27882:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5fbe0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+8:137321:x1863365425974528:12345-192.168.201.46@tcp:60:lhsmtool_posix.0 Request processed in 158us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051427.734714:0:27882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112042 00000100:00100000:1.0:1777051427.739123:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051427.739575:0:6582:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425974784 00000100:00100000:3.0:1777051427.739589:0:6582:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425974784 00000100:00100000:3.0:1777051427.739759:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3355 00000100:00100000:3.0:1777051427.739778:0:6582:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da4384e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+21:137321:x1863365425974784:12345-192.168.201.46@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1777051427.740074:0:6582:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da4384e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+22:137321:x1863365425974784:12345-192.168.201.46@tcp:35:lhsmtool_posix.0 Request processed in 299us (960us total) trans 30064771151 rc 0/0 00000100:00100000:3.0:1777051427.740088:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3355 00000040:00080000:0.0:1777051427.926545:0:103189:0:(llog.c:801:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:0.0:1777051427.926560:0:103189:0:(llog_cat.c:158:llog_cat_process_common()) processing log [0x1:0x2b:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1777051427.926689:0:103189:0:(llog.c:858:llog_process_thread()) stop processing plain [0x1:0x2b:0x0] index 5 count 3 00000040:00080000:0.0:1777051427.926704:0:103189:0:(llog.c:858:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00010000:00010000:1.0:1777051427.927682:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051428.950657:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1777051429.143561:0:3677:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1777051429.143592:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d944d28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3677:1863365452633344:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1777051429.143686:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051429.143787:0:8472:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452633344 00000100:00100000:0.0:1777051429.143800:0:8472:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452633344 00000100:00100000:0.0:1777051429.143894:0:8472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5660 00000100:00080000:2.0:1777051429.143912:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1777051429.143913:0:8472:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d944d29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3677:x1863365452633344:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1777051429.143992:0:8472:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 455081536 pending 0 free 3862671360 avail 3631149056 00000100:00100000:0.0:1777051429.144086:0:8472:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d944d29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3677:x1863365452633344:12345-0@lo:13:osp-pre-0-0.0 Request processed in 178us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051429.144100:0:8472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5660 00000100:00100000:2.0:1777051429.144573:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d944d28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3677:1863365452633344:0@lo:13:osp-pre-0-0.0 00000004:00080000:0.0:1777051429.146134:0:103180:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 8058338934041ns, next at 8059338928809ns, rc = 0 00000100:00100000:1.0:1777051429.146190:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d944d2a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452633472:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1777051429.146314:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051429.146415:0:10113:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452633472 00000100:00100000:2.0:1777051429.146428:0:10113:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452633472 00000100:00080000:1.0:1777051429.146527:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1777051429.146529:0:10113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5661 00000100:00100000:2.0:1777051429.146555:0:10113:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955612d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3679:x1863365452633472:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1777051429.146601:0:10113:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 452386368 pending 0 free 3644805120 avail 3413282816 00000100:00100000:1.0:1777051429.146755:0:10113:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955612d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3679:x1863365452633472:12345-0@lo:13:osp-pre-1-0.0 Request processed in 206us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051429.146770:0:10113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5661 00000100:00100000:2.0:1777051429.146901:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d944d2a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452633472:0@lo:13:osp-pre-1-0.0 00000001:02000400:1.0:1777051429.552293:0:107397:0:(debug.c:645:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-hsm test 405: archive and release under striped directory ========================================================== 13:23:47 (1777051427) 00000100:00100000:3.0:1777051429.966143:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051429.966413:0:6579:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425975040 00000100:00100000:2.0:1777051429.966426:0:6579:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425975040 00000100:00100000:2.0:1777051429.966518:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112043 00000100:00100000:2.0:1777051429.966539:0:6579:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da445dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+22:138009:x1863365425975040:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 00000100:00080000:1.0:1777051429.966567:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1777051429.966576:0:6579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051429.966610:0:6579:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d950262e00/0x85f51a6b967161c8 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b63a9 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051429.966710:0:6579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263e00/0x85f51a6b967161cf lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051429.966730:0:6579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263e00/0x85f51a6b967161cf lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051429.966752:0:6579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263e00/0x85f51a6b967161cf lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051429.966777:0:6579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950262400/0x85f51a6b967161d6 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051429.966791:0:6579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d950262400/0x85f51a6b967161d6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051429.966802:0:6579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d950262400/0x85f51a6b967161d6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051429.966961:0:6579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263800/0x85f51a6b967161dd lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051429.966979:0:6579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263800/0x85f51a6b967161dd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051429.966994:0:6579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263800/0x85f51a6b967161dd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1777051429.967011:0:6579:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:2.0:1777051429.967126:0:6579:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263e00/0x85f51a6b967161cf lrc: 4/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051429.967149:0:6579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263e00/0x85f51a6b967161cf lrc: 4/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051429.967162:0:6579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263e00/0x85f51a6b967161cf lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051429.967174:0:6579:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263e00/0x85f51a6b967161cf lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051429.967185:0:6579:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d950263e00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:2.0:1777051429.967192:0:6579:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263e00/0x85f51a6b967161cf lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051429.967249:0:6579:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263e00/0x85f51a6b967161cf lrc: 5/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051429.967271:0:6579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff99d94e5e2500) 00010000:00010000:2.0:1777051429.967278:0:6579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777051429.967286:0:6579:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263e00/0x85f51a6b967161cf lrc: 3/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051429.967297:0:6579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263e00/0x85f51a6b967161cf lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051429.967319:0:6579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950262400/0x85f51a6b967161d6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051429.967331:0:6579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d950262400/0x85f51a6b967161d6 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051429.967343:0:6579:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d950262400/0x85f51a6b967161d6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051429.967354:0:6579:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d950262400 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:2.0:1777051429.967359:0:6579:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d950262400/0x85f51a6b967161d6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051429.967371:0:6579:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d950262400/0x85f51a6b967161d6 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051429.967385:0:6579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff99d9413d0700) 00010000:00010000:2.0:1777051429.967390:0:6579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777051429.967395:0:6579:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d950262400/0x85f51a6b967161d6 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051429.967407:0:6579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d950262400/0x85f51a6b967161d6 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051429.967891:0:6579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d950262e00/0x85f51a6b967161c8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b63a9 expref: 25 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051429.967952:0:6579:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263800/0x85f51a6b967161dd lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b63a9 expref: 24 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051429.967967:0:6579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99d941e2ea00) 00010000:00010000:2.0:1777051429.967972:0:6579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777051429.967977:0:6579:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d950263800, rc 0) 00000100:00100000:2.0:1777051429.968084:0:6579:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da445dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+24:138009:x1863365425975040:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 Request processed in 1551us (1952us total) trans 30064771152 rc 0/0 00000100:00100000:2.0:1777051429.968100:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112043 00010000:00010000:1.0:1777051429.974685:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1777051429.978053:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051429.978137:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051429.978553:0:27885:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425975296 00000100:00100000:0.0:1777051429.978571:0:27885:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425975296 00000100:00100000:0.0:1777051429.978675:0:27885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112044 00000100:00100000:0.0:1777051429.978697:0:27885:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c11b6966-0775-44d2-bdc6-c74c26eb2226+24:138009:x1863365425975296:12345-192.168.201.46@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1777051429.978863:0:27885:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c11b6966-0775-44d2-bdc6-c74c26eb2226+24:138009:x1863365425975296:12345-192.168.201.46@tcp:59:lhsmtool_posix.0 Request processed in 171us (816us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051429.978878:0:27885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112044 00000100:00100000:3.0:1777051429.979081:0:6566:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425975168 00000100:00100000:3.0:1777051429.979092:0:6566:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425975168 00000100:00100000:3.0:1777051429.979176:0:6566:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13692 00000100:00100000:3.0:1777051429.979247:0:6566:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9fd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+24:2439:x1863365425975168:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1777051429.979268:0:6566:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777051429.979303:0:6566:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263800/0x85f51a6b967161dd lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b63a9 expref: 24 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051429.979343:0:6566:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99d941e2ea00) 00010000:00010000:3.0:1777051429.979353:0:6566:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1777051429.979401:0:6566:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9fd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+23:2439:x1863365425975168:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 158us (1264us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051429.979416:0:6566:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13692 00000100:00100000:1.0:1777051429.984972:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051429.985116:0:6580:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425975424 00000100:00100000:0.0:1777051429.985132:0:6580:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425975424 00000100:00100000:0.0:1777051429.985319:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112045 00000100:00100000:0.0:1777051429.985339:0:6580:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fd66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+8:138009:x1863365425975424:12345-192.168.201.46@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1777051429.985485:0:6580:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fd66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+8:138009:x1863365425975424:12345-192.168.201.46@tcp:59:lhsmtool_posix.0 Request processed in 150us (525us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051429.985501:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112045 00000100:00080000:1.0:1777051429.985684:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1777051429.996733:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051429.996848:0:46497:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425975552 00000100:00100000:1.0:1777051429.996860:0:46497:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425975552 00000100:00080000:2.0:1777051429.996983:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1777051429.996989:0:46497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112046 00000100:00100000:1.0:1777051429.997012:0:46497:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+33:138010:x1863365425975552:12345-192.168.201.46@tcp:101:lfs.0 00010000:00010000:1.0:1777051429.997046:0:46497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777051429.997076:0:46497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48bc00/0x85f51a6b967161eb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b63b0 expref: -99 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051429.997537:0:46497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48ba00/0x85f51a6b967161f2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051429.997561:0:46497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48ba00/0x85f51a6b967161f2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051429.997580:0:46497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48ba00/0x85f51a6b967161f2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051429.997604:0:46497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48a800/0x85f51a6b967161f9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc9adb04b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051429.997618:0:46497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48a800/0x85f51a6b967161f9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc9adb04b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051429.997630:0:46497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48a800/0x85f51a6b967161f9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc9adb04b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051429.997698:0:46497:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48ba00/0x85f51a6b967161f2 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051429.997711:0:46497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48ba00/0x85f51a6b967161f2 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051429.997722:0:46497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48ba00/0x85f51a6b967161f2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051429.997733:0:46497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48ba00/0x85f51a6b967161f2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051429.997742:0:46497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94e48ba00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:1.0:1777051429.997749:0:46497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48ba00/0x85f51a6b967161f2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051429.997761:0:46497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48ba00/0x85f51a6b967161f2 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051429.997778:0:46497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d9533ab000) 00010000:00010000:1.0:1777051429.997784:0:46497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777051429.997791:0:46497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48ba00/0x85f51a6b967161f2 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051429.997801:0:46497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48ba00/0x85f51a6b967161f2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051429.997821:0:46497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48a800/0x85f51a6b967161f9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc9adb04b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051429.997832:0:46497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48a800/0x85f51a6b967161f9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc9adb04b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051429.997843:0:46497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48a800/0x85f51a6b967161f9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc9adb04b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051429.997852:0:46497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94e48a800 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:1.0:1777051429.997857:0:46497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48a800/0x85f51a6b967161f9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc9adb04b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051429.997870:0:46497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48a800/0x85f51a6b967161f9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc9adb04b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051429.997879:0:46497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc9adb04b (ffff99d94e5e2600) 00010000:00010000:1.0:1777051429.997882:0:46497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777051429.997885:0:46497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48a800/0x85f51a6b967161f9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc9adb04b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051429.997892:0:46497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48a800/0x85f51a6b967161f9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc9adb04b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051429.997965:0:46497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48bc00/0x85f51a6b967161eb lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b63b0 expref: 34 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051429.997982:0:46497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d9533ab000) 00010000:00010000:1.0:1777051429.997987:0:46497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777051429.997993:0:46497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48bc00/0x85f51a6b967161eb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b63b0 expref: 34 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051429.998011:0:46497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d94e48bc00, rc 0) 00000100:00100000:1.0:1777051429.998408:0:46497:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+33:138010:x1863365425975552:12345-192.168.201.46@tcp:101:lfs.0 Request processed in 1401us (1683us total) trans 0 rc 301/301 00000100:00100000:1.0:1777051429.998424:0:46497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112046 00000100:00100000:3.0:1777051430.006316:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051430.006389:0:21368:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425975808 00000100:00100000:0.0:1777051430.006403:0:21368:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425975808 00000100:00100000:0.0:1777051430.006499:0:21368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112047 00000100:00100000:0.0:1777051430.006518:0:21368:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da445ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+33:138010:x1863365425975808:12345-192.168.201.46@tcp:36:lfs.0 00010000:00010000:0.0:1777051430.006606:0:21368:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777051430.006637:0:21368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48b200/0x85f51a6b96715f8a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b62f3 expref: 33 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.006665:0:21368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d9533ab000) 00010000:00010000:0.0:1777051430.006672:0:21368:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1777051430.006746:0:21368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b600/0x85f51a6b96716200 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.007108:0:21368:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48b000/0x85f51a6b9671601d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6324 expref: 22 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.007473:0:21368:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b600/0x85f51a6b96716200 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.007529:0:21368:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48b000/0x85f51a6b9671601d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6324 expref: 22 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.007562:0:21368:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48b000/0x85f51a6b9671601d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6324 expref: 22 pid: 6579 timeout: 8159 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051430.007587:0:21368:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d944d2bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:21368:1863365452633600:192.168.201.46@tcp:104: 00000100:00100000:0.0:1777051430.007710:0:21368:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d94eea9c00 going to sleep for 11 seconds 00000100:00100000:0.0:1777051430.010971:0:21368:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d944d2bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:21368:1863365452633600:192.168.201.46@tcp:104: 00010000:00010000:0.0:1777051430.011002:0:21368:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b600/0x85f51a6b96716200 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051430.011169:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051430.011275:0:6564:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425975936 00000100:00100000:0.0:1777051430.011284:0:6564:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425975936 00010000:00010000:0.0:1777051430.011323:0:6564:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48b000/0x85f51a6b9671601d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6324 expref: 23 pid: 6579 timeout: 8159 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051430.011383:0:6564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3876 00000100:00100000:0.0:1777051430.011400:0:6564:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da445dc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+23:2437:x1863365425975936:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1777051430.011419:0:6564:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777051430.011429:0:6564:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48b000/0x85f51a6b9671601d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6324 expref: 23 pid: 6579 timeout: 8159 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.011450:0:6564:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48b000/0x85f51a6b9671601d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6324 expref: 23 pid: 6579 timeout: 8159 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.011474:0:6564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48b000/0x85f51a6b9671601d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6324 expref: 23 pid: 6579 timeout: 8159 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.011560:0:6564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d9533ab000) 00010000:00010000:0.0:1777051430.011566:0:6564:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b600/0x85f51a6b96716200 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.011577:0:6564:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b600/0x85f51a6b96716200 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.011586:0:6564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b600/0x85f51a6b96716200 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.011622:0:6564:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1777051430.011669:0:6564:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da445dc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+22:2437:x1863365425975936:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 274us (504us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051430.011681:0:6564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3876 00010000:00010000:2.0:1777051430.011693:0:21368:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b600/0x85f51a6b96716200 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.011712:0:21368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b600/0x85f51a6b96716200 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.011748:0:21368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950262600/0x85f51a6b96716207 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xc9adb04b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.011764:0:21368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d950262600/0x85f51a6b96716207 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc9adb04b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.011778:0:21368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d950262600/0x85f51a6b96716207 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc9adb04b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.012468:0:21368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263600/0x85f51a6b9671620e lrc: 3/0,1 mode: --/PW res: [0x2000032e2:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.012489:0:21368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263600/0x85f51a6b9671620e lrc: 3/0,1 mode: PW/PW res: [0x2000032e2:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.012504:0:21368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263600/0x85f51a6b9671620e lrc: 3/0,1 mode: PW/PW res: [0x2000032e2:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1777051430.012530:0:21368:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000ed7f7659 reply state 00000000a495c25c transno 30064771153 ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263600/0x85f51a6b9671620e lrc: 3/0,1 mode: PW/PW res: [0x2000032e2:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.012548:0:21368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263600/0x85f51a6b9671620e lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e2:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.012566:0:21368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0x5:0x0].0x0 (ffff99d9413d0100) 00010000:00010000:2.0:1777051430.012571:0:21368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1777051430.012575:0:21368:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1777051430.012583:0:21368:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000032e2:0x5:0x0]: returning size 4096 00010000:00010000:2.0:1777051430.012594:0:21368:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b600/0x85f51a6b96716200 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.012607:0:21368:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b600/0x85f51a6b96716200 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.012620:0:21368:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b600/0x85f51a6b96716200 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.012631:0:21368:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94eb2b600 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:2.0:1777051430.012637:0:21368:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b600/0x85f51a6b96716200 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.012649:0:21368:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b600/0x85f51a6b96716200 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.012663:0:21368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d9533ab000) 00010000:00010000:2.0:1777051430.012666:0:21368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777051430.012670:0:21368:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b600/0x85f51a6b96716200 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.012677:0:21368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b600/0x85f51a6b96716200 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1777051430.012692:0:21368:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000ed7f7659 reply state 00000000a495c25c transno 30064771153 ns: mdt-lustre-MDT0000_UUID lock: ffff99d950262600/0x85f51a6b96716207 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc9adb04b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.012716:0:21368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d950262600/0x85f51a6b96716207 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc9adb04b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.012726:0:21368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc9adb04b (ffff99d9413d0700) 00010000:00010000:2.0:1777051430.012730:0:21368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1777051430.012733:0:21368:0:(service.c:177:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1777051430.012819:0:21368:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da445ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+34:138010:x1863365425975808:12345-192.168.201.46@tcp:36:lfs.0 Request processed in 6305us (6512us total) trans 30064771153 rc 0/0 00000100:00100000:2.0:1777051430.012832:0:21368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112047 00000100:00100000:3.0:1777051430.030562:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051430.030690:0:10328:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425976064 00000100:00100000:0.0:1777051430.030705:0:10328:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425976064 00000100:00100000:0.0:1777051430.030794:0:10328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112048 00000100:00100000:0.0:1777051430.030812:0:10328:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da445df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+34:138011:x1863365425976064:12345-192.168.201.46@tcp:101:lfs.0 00010000:00010000:0.0:1777051430.030848:0:10328:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051430.030879:0:10328:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2a200/0x85f51a6b96716215 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b63b7 expref: -99 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.031008:0:10328:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2a400/0x85f51a6b9671621c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.031041:0:10328:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2a400/0x85f51a6b9671621c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.031067:0:10328:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2a400/0x85f51a6b9671621c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1777051430.031129:0:10328:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 12288 00000004:00200000:0.0:1777051430.031136:0:10328:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1777051430.031162:0:10328:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2a400/0x85f51a6b9671621c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.031255:0:10328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2a200/0x85f51a6b96716215 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b63b7 expref: 36 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.031290:0:10328:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2a400/0x85f51a6b9671621c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b63b7 expref: 35 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.031315:0:10328:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d9533ab000) 00010000:00010000:0.0:1777051430.031321:0:10328:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1777051430.031327:0:10328:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d94eb2a400, rc 0) 00000100:00100000:0.0:1777051430.031418:0:10328:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da445df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+35:138011:x1863365425976064:12345-192.168.201.46@tcp:101:lfs.0 Request processed in 608us (865us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051430.031433:0:10328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112048 00000040:00080000:3.0:1777051430.039798:0:104226:0:(llog.c:801:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1777051430.039811:0:104226:0:(llog_cat.c:158:llog_cat_process_common()) processing log [0x1:0x12:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1777051430.039855:0:104226:0:(llog.c:858:llog_process_thread()) stop processing plain [0x1:0x12:0x0] index 3 count 2 00000040:00080000:3.0:1777051430.039870:0:104226:0:(llog.c:858:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1777051430.039911:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051430.040081:0:46494:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425976192 00000100:00100000:2.0:1777051430.040094:0:46494:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425976192 00000100:00100000:2.0:1777051430.040183:0:46494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112049 00000100:00100000:2.0:1777051430.040247:0:46494:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fd64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+35:138011:x1863365425976192:12345-192.168.201.46@tcp:101:lfs.0 00010000:00010000:2.0:1777051430.040271:0:46494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051430.040299:0:46494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d950262200/0x85f51a6b96716223 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b63be expref: -99 pid: 46494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.040384:0:46494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263c00/0x85f51a6b9671622a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.040407:0:46494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263c00/0x85f51a6b9671622a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.040425:0:46494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263c00/0x85f51a6b9671622a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.040445:0:46494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263e00/0x85f51a6b96716231 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc9adb04b bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.040466:0:46494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263e00/0x85f51a6b96716231 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc9adb04b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.040479:0:46494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263e00/0x85f51a6b96716231 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc9adb04b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.040595:0:46494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263800/0x85f51a6b96716238 lrc: 3/1,0 mode: --/PR res: [0x2000032e2:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.040612:0:46494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263800/0x85f51a6b96716238 lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0x5:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.040626:0:46494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263800/0x85f51a6b96716238 lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0x5:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1777051430.040674:0:46494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000032e2:0x5:0x0]: returning size 4096 00000004:00200000:2.0:1777051430.040681:0:46494:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1777051430.040708:0:46494:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263800/0x85f51a6b96716238 lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0x5:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.040728:0:46494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263c00/0x85f51a6b9671622a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.040740:0:46494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263c00/0x85f51a6b9671622a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.040751:0:46494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263c00/0x85f51a6b9671622a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.040762:0:46494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d950263c00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:2.0:1777051430.040769:0:46494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263c00/0x85f51a6b9671622a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.040783:0:46494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263c00/0x85f51a6b9671622a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.040802:0:46494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d9533ab000) 00010000:00010000:2.0:1777051430.040808:0:46494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777051430.040816:0:46494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263c00/0x85f51a6b9671622a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.040827:0:46494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263c00/0x85f51a6b9671622a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.040847:0:46494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263e00/0x85f51a6b96716231 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc9adb04b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.040860:0:46494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263e00/0x85f51a6b96716231 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc9adb04b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.040871:0:46494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263e00/0x85f51a6b96716231 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc9adb04b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.040880:0:46494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d950263e00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:2.0:1777051430.040885:0:46494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263e00/0x85f51a6b96716231 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc9adb04b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.040898:0:46494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263e00/0x85f51a6b96716231 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc9adb04b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.040912:0:46494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc9adb04b (ffff99d9413d0700) 00010000:00010000:2.0:1777051430.040954:0:46494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777051430.040960:0:46494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263e00/0x85f51a6b96716231 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc9adb04b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.040982:0:46494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263e00/0x85f51a6b96716231 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc9adb04b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.041026:0:46494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d950262200/0x85f51a6b96716223 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b63be expref: 37 pid: 46494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.041051:0:46494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263800/0x85f51a6b96716238 lrc: 3/0,0 mode: PR/PR res: [0x2000032e2:0x5:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b63be expref: 36 pid: 46494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.041066:0:46494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0x5:0x0].0x0 (ffff99d9413d0100) 00010000:00010000:2.0:1777051430.041070:0:46494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1777051430.041075:0:46494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d950263800, rc 0) 00000100:00100000:2.0:1777051430.041500:0:46494:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fd64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+36:138011:x1863365425976192:12345-192.168.201.46@tcp:101:lfs.0 Request processed in 1299us (1592us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051430.041516:0:46494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112049 00000100:00100000:3.0:1777051430.046328:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051430.046448:0:6580:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425976320 00000100:00100000:0.0:1777051430.046460:0:6580:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425976320 00000100:00100000:0.0:1777051430.046534:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112050 00000100:00100000:0.0:1777051430.046550:0:6580:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da445df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+36:138011:x1863365425976320:12345-192.168.201.46@tcp:101:lfs.0 00010000:00010000:0.0:1777051430.046572:0:6580:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051430.046595:0:6580:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2a200/0x85f51a6b9671623f lrc: 2/0,0 mode: --/CR res: [0x2000032e2:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b63c5 expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.046676:0:6580:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2bc00/0x85f51a6b96716246 lrc: 3/1,0 mode: --/CR res: [0x2000032e2:0x5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.046695:0:6580:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2bc00/0x85f51a6b96716246 lrc: 3/1,0 mode: CR/CR res: [0x2000032e2:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.046712:0:6580:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2bc00/0x85f51a6b96716246 lrc: 3/1,0 mode: CR/CR res: [0x2000032e2:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.047060:0:6580:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2a000/0x85f51a6b9671624d lrc: 3/1,0 mode: --/PR res: [0x2000032e2:0x5:0x0].0xd1d4b922 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.047077:0:6580:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2a000/0x85f51a6b9671624d lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0x5:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.047092:0:6580:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2a000/0x85f51a6b9671624d lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0x5:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.047141:0:6580:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2bc00/0x85f51a6b96716246 lrc: 4/1,0 mode: CR/CR res: [0x2000032e2:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.047154:0:6580:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2bc00/0x85f51a6b96716246 lrc: 4/1,0 mode: CR/CR res: [0x2000032e2:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.047166:0:6580:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2bc00/0x85f51a6b96716246 lrc: 3/0,0 mode: CR/CR res: [0x2000032e2:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.047177:0:6580:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2bc00/0x85f51a6b96716246 lrc: 4/0,0 mode: CR/CR res: [0x2000032e2:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.047187:0:6580:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94eb2bc00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:0.0:1777051430.047194:0:6580:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2bc00/0x85f51a6b96716246 lrc: 4/0,0 mode: CR/CR res: [0x2000032e2:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.047263:0:6580:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2bc00/0x85f51a6b96716246 lrc: 5/0,0 mode: CR/CR res: [0x2000032e2:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.047281:0:6580:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0x5:0x0].0x0 (ffff99d9413d0100) 00010000:00010000:0.0:1777051430.047286:0:6580:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777051430.047293:0:6580:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2bc00/0x85f51a6b96716246 lrc: 3/0,0 mode: --/CR res: [0x2000032e2:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.047306:0:6580:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2bc00/0x85f51a6b96716246 lrc: 0/0,0 mode: --/CR res: [0x2000032e2:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.047328:0:6580:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2a000/0x85f51a6b9671624d lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0x5:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.047341:0:6580:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2a000/0x85f51a6b9671624d lrc: 2/0,0 mode: PR/PR res: [0x2000032e2:0x5:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.047352:0:6580:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2a000/0x85f51a6b9671624d lrc: 3/0,0 mode: PR/PR res: [0x2000032e2:0x5:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.047361:0:6580:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94eb2a000 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:0.0:1777051430.047366:0:6580:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2a000/0x85f51a6b9671624d lrc: 3/0,0 mode: PR/PR res: [0x2000032e2:0x5:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.047378:0:6580:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2a000/0x85f51a6b9671624d lrc: 4/0,0 mode: PR/PR res: [0x2000032e2:0x5:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.047391:0:6580:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0x5:0x0].0xd1d4b922 (ffff99d943f76e00) 00010000:00010000:0.0:1777051430.047396:0:6580:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777051430.047401:0:6580:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2a000/0x85f51a6b9671624d lrc: 2/0,0 mode: --/PR res: [0x2000032e2:0x5:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.047412:0:6580:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2a000/0x85f51a6b9671624d lrc: 0/0,0 mode: --/PR res: [0x2000032e2:0x5:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.047453:0:6580:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2a200/0x85f51a6b9671623f lrc: 1/0,0 mode: --/CR res: [0x2000032e2:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b63c5 expref: 37 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.047466:0:6580:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0x5:0x0].0x0 (ffff99d9413d0100) 00010000:00010000:0.0:1777051430.047469:0:6580:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777051430.047473:0:6580:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2a200/0x85f51a6b9671623f lrc: 0/0,0 mode: --/CR res: [0x2000032e2:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b63c5 expref: 37 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.047483:0:6580:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d94eb2a200, rc 0) 00000100:00100000:0.0:1777051430.047551:0:6580:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da445df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+36:138011:x1863365425976320:12345-192.168.201.46@tcp:101:lfs.0 Request processed in 1005us (1228us total) trans 0 rc 301/301 00000100:00100000:0.0:1777051430.047564:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112050 00000100:00100000:1.0:1777051430.051683:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051430.051779:0:6581:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425976448 00000100:00100000:0.0:1777051430.051790:0:6581:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425976448 00000100:00100000:0.0:1777051430.051855:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112051 00000100:00100000:0.0:1777051430.051869:0:6581:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fd66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+36:138011:x1863365425976448:12345-192.168.201.46@tcp:101:lfs.0 00010000:00010000:0.0:1777051430.051888:0:6581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051430.051907:0:6581:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2a600/0x85f51a6b96716254 lrc: 2/0,0 mode: --/CR res: [0x2000032e2:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b63cc expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.052005:0:6581:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b800/0x85f51a6b9671625b lrc: 3/1,0 mode: --/CR res: [0x2000032e2:0x5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.052033:0:6581:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b800/0x85f51a6b9671625b lrc: 3/1,0 mode: CR/CR res: [0x2000032e2:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.052072:0:6581:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b800/0x85f51a6b9671625b lrc: 3/1,0 mode: CR/CR res: [0x2000032e2:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.052096:0:6581:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2ae00/0x85f51a6b96716262 lrc: 3/1,0 mode: --/PR res: [0x2000032e2:0x5:0x0].0xd1d4b922 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.052108:0:6581:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2ae00/0x85f51a6b96716262 lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0x5:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.052120:0:6581:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2ae00/0x85f51a6b96716262 lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0x5:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.052151:0:6581:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b800/0x85f51a6b9671625b lrc: 3/1,0 mode: CR/CR res: [0x2000032e2:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.052162:0:6581:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b800/0x85f51a6b9671625b lrc: 2/0,0 mode: CR/CR res: [0x2000032e2:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.052173:0:6581:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b800/0x85f51a6b9671625b lrc: 3/0,0 mode: CR/CR res: [0x2000032e2:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.052183:0:6581:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94eb2b800 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:0.0:1777051430.052189:0:6581:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b800/0x85f51a6b9671625b lrc: 3/0,0 mode: CR/CR res: [0x2000032e2:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.052198:0:6581:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b800/0x85f51a6b9671625b lrc: 4/0,0 mode: CR/CR res: [0x2000032e2:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.052209:0:6581:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0x5:0x0].0x0 (ffff99d9413d0100) 00010000:00010000:0.0:1777051430.052213:0:6581:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777051430.052218:0:6581:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b800/0x85f51a6b9671625b lrc: 2/0,0 mode: --/CR res: [0x2000032e2:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.052226:0:6581:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b800/0x85f51a6b9671625b lrc: 0/0,0 mode: --/CR res: [0x2000032e2:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.052245:0:6581:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2ae00/0x85f51a6b96716262 lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0x5:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.052255:0:6581:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2ae00/0x85f51a6b96716262 lrc: 2/0,0 mode: PR/PR res: [0x2000032e2:0x5:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.052265:0:6581:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2ae00/0x85f51a6b96716262 lrc: 3/0,0 mode: PR/PR res: [0x2000032e2:0x5:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.052274:0:6581:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94eb2ae00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:0.0:1777051430.052279:0:6581:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2ae00/0x85f51a6b96716262 lrc: 3/0,0 mode: PR/PR res: [0x2000032e2:0x5:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.052288:0:6581:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2ae00/0x85f51a6b96716262 lrc: 4/0,0 mode: PR/PR res: [0x2000032e2:0x5:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.052299:0:6581:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0x5:0x0].0xd1d4b922 (ffff99d943f76700) 00010000:00010000:0.0:1777051430.052304:0:6581:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777051430.052309:0:6581:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2ae00/0x85f51a6b96716262 lrc: 2/0,0 mode: --/PR res: [0x2000032e2:0x5:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.052320:0:6581:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2ae00/0x85f51a6b96716262 lrc: 0/0,0 mode: --/PR res: [0x2000032e2:0x5:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.052384:0:6581:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2a600/0x85f51a6b96716254 lrc: 1/0,0 mode: --/CR res: [0x2000032e2:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b63cc expref: 37 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.052411:0:6581:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0x5:0x0].0x0 (ffff99d9413d0100) 00010000:00010000:0.0:1777051430.052415:0:6581:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777051430.052421:0:6581:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2a600/0x85f51a6b96716254 lrc: 0/0,0 mode: --/CR res: [0x2000032e2:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b63cc expref: 37 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.052437:0:6581:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d94eb2a600, rc 0) 00000100:00100000:0.0:1777051430.052506:0:6581:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fd66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+36:138011:x1863365425976448:12345-192.168.201.46@tcp:101:lfs.0 Request processed in 639us (825us total) trans 0 rc 301/301 00000100:00100000:0.0:1777051430.052518:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112051 00000100:00100000:1.0:1777051430.060351:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051430.060494:0:27882:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425976576 00000100:00100000:2.0:1777051430.060529:0:27882:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425976576 00000100:00100000:2.0:1777051430.060603:0:27882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112052 00000100:00100000:2.0:1777051430.060619:0:27882:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7b5e8850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+36:138011:x1863365425976576:12345-192.168.201.46@tcp:101:lfs.0 00010000:00010000:2.0:1777051430.060640:0:27882:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051430.060663:0:27882:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d950262200/0x85f51a6b96716269 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b63d3 expref: -99 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.060755:0:27882:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263e00/0x85f51a6b96716270 lrc: 3/1,0 mode: --/PR res: [0x2000032e2:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.060776:0:27882:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263e00/0x85f51a6b96716270 lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0x5:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.060794:0:27882:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263e00/0x85f51a6b96716270 lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0x5:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1777051430.060847:0:27882:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000032e2:0x5:0x0]: returning size 4096 00000004:00200000:2.0:1777051430.060854:0:27882:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1777051430.060880:0:27882:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263e00/0x85f51a6b96716270 lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0x5:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.060954:0:27882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d950262200/0x85f51a6b96716269 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b63d3 expref: 38 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.060982:0:27882:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263e00/0x85f51a6b96716270 lrc: 3/0,0 mode: PR/PR res: [0x2000032e2:0x5:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b63d3 expref: 37 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.060996:0:27882:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0x5:0x0].0x0 (ffff99d9413d0100) 00010000:00010000:2.0:1777051430.061001:0:27882:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1777051430.061006:0:27882:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d950263e00, rc 0) 00000100:00100000:2.0:1777051430.061078:0:27882:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7b5e8850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+37:138011:x1863365425976576:12345-192.168.201.46@tcp:101:lfs.0 Request processed in 462us (736us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051430.061092:0:27882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112052 00000100:00100000:3.0:1777051430.067878:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051430.067999:0:6579:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425976704 00000100:00100000:2.0:1777051430.068010:0:6579:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425976704 00000100:00100000:2.0:1777051430.068079:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112053 00000100:00100000:2.0:1777051430.068093:0:6579:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da445dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+22:138011:x1863365425976704:12345-192.168.201.46@tcp:101:lfs.0 00010000:00010000:2.0:1777051430.068112:0:6579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051430.068133:0:6579:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263c00/0x85f51a6b96716277 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b63da expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.068209:0:6579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950262400/0x85f51a6b9671627e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.068227:0:6579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d950262400/0x85f51a6b9671627e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.068243:0:6579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d950262400/0x85f51a6b9671627e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1777051430.068289:0:6579:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 12288 00000004:00200000:2.0:1777051430.068295:0:6579:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1777051430.068320:0:6579:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99d950262400/0x85f51a6b9671627e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.068354:0:6579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263c00/0x85f51a6b96716277 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b63da expref: 24 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.068379:0:6579:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950262400/0x85f51a6b9671627e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b63da expref: 23 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.068394:0:6579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d9533ab000) 00010000:00010000:2.0:1777051430.068398:0:6579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1777051430.068403:0:6579:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d950262400, rc 0) 00000100:00100000:2.0:1777051430.068469:0:6579:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da445dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+23:138011:x1863365425976704:12345-192.168.201.46@tcp:101:lfs.0 Request processed in 377us (595us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051430.068482:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112053 00000100:00100000:1.0:1777051430.071993:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051430.072176:0:46494:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425976960 00000100:00100000:2.0:1777051430.072186:0:46494:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425976960 00000100:00100000:2.0:1777051430.072263:0:46494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112054 00000100:00100000:2.0:1777051430.072321:0:46494:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fd67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+37:138011:x1863365425976960:12345-192.168.201.46@tcp:101:lfs.0 00010000:00010000:2.0:1777051430.072342:0:46494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051430.072363:0:46494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d950262200/0x85f51a6b96716285 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b63e1 expref: -99 pid: 46494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1777051430.072441:0:46494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000032e2:0x5:0x0]: returning size 4096 00010000:00010000:2.0:1777051430.072545:0:46494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950262200/0x85f51a6b96716285 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b63e1 expref: 39 pid: 46494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.072560:0:46494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d9533ab000) 00010000:00010000:2.0:1777051430.072564:0:46494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1777051430.072568:0:46494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d950262200/0x85f51a6b96716285 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b63e1 expref: 39 pid: 46494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.072581:0:46494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d950262200, rc 0) 00000100:00100000:2.0:1777051430.072632:0:46494:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fd67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+38:138011:x1863365425976960:12345-192.168.201.46@tcp:101:lfs.0 Request processed in 359us (652us total) trans 30064771154 rc 301/301 00000100:00100000:2.0:1777051430.072641:0:46494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112054 00000100:00100000:1.0:1777051430.079427:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051430.079639:0:8492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425977216 00000100:00100000:2.0:1777051430.079652:0:8492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425977216 00000100:00100000:2.0:1777051430.079730:0:8492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112055 00000100:00100000:2.0:1777051430.079744:0:8492:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fd64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+38:138011:x1863365425977216:12345-192.168.201.46@tcp:36:lfs.0 00010000:00010000:2.0:1777051430.079817:0:8492:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777051430.079850:0:8492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263e00/0x85f51a6b96716270 lrc: 0/0,0 mode: --/PR res: [0x2000032e2:0x5:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b63d3 expref: 38 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.079887:0:8492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0x5:0x0].0x0 (ffff99d9413d0100) 00010000:00010000:2.0:1777051430.079895:0:8492:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1777051430.079994:0:8492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263c00/0x85f51a6b96716293 lrc: 3/0,1 mode: --/CW res: [0x2000032e2:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.080015:0:8492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263c00/0x85f51a6b96716293 lrc: 3/0,1 mode: CW/CW res: [0x2000032e2:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.080030:0:8492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263c00/0x85f51a6b96716293 lrc: 3/0,1 mode: CW/CW res: [0x2000032e2:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.080051:0:8492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950262e00/0x85f51a6b9671629a lrc: 3/0,1 mode: --/PW res: [0x2000032e2:0x5:0x0].0xd1d4b922 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.080062:0:8492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d950262e00/0x85f51a6b9671629a lrc: 3/0,1 mode: PW/PW res: [0x2000032e2:0x5:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.080073:0:8492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d950262e00/0x85f51a6b9671629a lrc: 3/0,1 mode: PW/PW res: [0x2000032e2:0x5:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051430.080259:0:8492:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f9fce00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8492:1863365452633728:0@lo:700:mdt00_003.0 00000100:00100000:2.0:1777051430.080324:0:8492:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051430.080367:0:8492:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d95c67b900 going to sleep for 11 seconds 00000100:00100000:0.0:1777051430.080415:0:6588:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452633728 00000100:00100000:0.0:1777051430.080424:0:6588:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452633728 00000100:00100000:0.0:1777051430.080485:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1777051430.080497:0:6588:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0000-mdtlov_UUID+6:8492:x1863365452633728:12345-0@lo:700:mdt00_003.0 00000100:00100000:0.0:1777051430.080597:0:6588:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0000-mdtlov_UUID+6:8492:x1863365452633728:12345-0@lo:700:mdt00_003.0 Request processed in 101us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051430.080614:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1777051430.080699:0:8492:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f9fce00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8492:1863365452633728:0@lo:700:mdt00_003.0 00000100:00100000:1.0:1777051430.081576:0:8492:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7fd67480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8492:1863365452633856:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1777051430.081625:0:8492:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051430.081678:0:8492:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d95cf51780 going to sleep for 11 seconds 00000100:00100000:3.0:1777051430.081889:0:6585:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452633856 00000100:00100000:3.0:1777051430.081898:0:6585:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452633856 00000100:00100000:3.0:1777051430.081998:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8174 00000100:00100000:3.0:1777051430.082011:0:6585:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fd64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:8492:x1863365452633856:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1777051430.082129:0:6585:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fd64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:8492:x1863365452633856:12345-0@lo:1000:mdt00_003.0 Request processed in 118us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051430.082143:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8174 00000100:00100000:0.0:1777051430.082240:0:8492:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7fd67480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8492:1863365452633856:0@lo:1000:mdt00_003.0 00000040:00080000:0.0:1777051430.082342:0:8492:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1777051430.082371:0:8492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000401:0x1:0x0].3, 64 off32960 00000004:00080000:0.0:1777051430.082382:0:8492:0:(osp_trans.c:1582:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff99d95cf51e40 with version 1 00000040:00080000:0.0:1777051430.082533:0:8492:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1777051430.082553:0:8492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000401:0x1:0x0].4, 64 off33024 00000004:00080000:0.0:1777051430.082562:0:8492:0:(osp_trans.c:1582:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff99d94eea9c00 with version 2 00000004:00080000:2.0:1777051430.083278:0:103175:0:(osp_trans.c:1330:osp_get_next_request()) ou ffff99d9594cf180 version 1 rpc_version 1 00000020:00100000:2.0:1777051430.083312:0:103175:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1777051430.083326:0:103175:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff99da5f9fed80 x1863365452634112/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 1312/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1777051430.083355:0:103175:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f9fed80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:103175:1863365452634112:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1777051430.083412:0:103175:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051430.083462:0:103175:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d95c67bb40 going to sleep for 11 seconds 00000100:00100000:0.0:1777051430.083589:0:11727:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452634112 00000100:00100000:0.0:1777051430.083595:0:11727:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452634112 00000100:00100000:0.0:1777051430.083642:0:11727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8175 00000100:00100000:0.0:1777051430.083658:0:11727:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:103175:x1863365452634112:12345-0@lo:1000:osp_up1-0.0 00000040:00080000:1.0:1777051430.089004:0:8492:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1777051430.090463:0:8492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000400:0x1:0x0].2, 64 off32896 00000040:00080000:0.0:1777051430.090975:0:8492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2000032e0:0x2:0x0].1, 2152 off34920 00000040:00080000:0.0:1777051430.091177:0:8492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000bd1:0x2:0x0].1, 2352 off35120 00000004:00080000:0.0:1777051430.091190:0:8492:0:(osp_trans.c:1582:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff99d95cf51f00 with version 3 00000001:00080000:1.0:1777051430.093692:0:104205:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934617 is committed 00000100:00100000:2.0:1777051430.093901:0:11727:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:103175:x1863365452634112:12345-0@lo:1000:osp_up1-0.0 Request processed in 10238us (10483us total) trans 8589934617 rc 0/0 00000100:00100000:2.0:1777051430.093949:0:11727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8175 00000004:00080000:1.0:1777051430.093994:0:103175:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 8589934617 committed transno 8589934617 00000100:00100000:1.0:1777051430.094003:0:103175:0:(client.c:3101:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 8589934617 gen 2 00000100:00100000:1.0:1777051430.094032:0:103175:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f9fed80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:103175:1863365452634112:0@lo:1000:osp_up1-0.0 00000004:00080000:1.0:1777051430.094082:0:103175:0:(osp_trans.c:1330:osp_get_next_request()) ou ffff99d9594cf180 version 2 rpc_version 2 00000020:00100000:1.0:1777051430.094111:0:103175:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1777051430.094122:0:103175:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff99da7fd65f80 x1863365452634368/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 1312/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1777051430.094149:0:103175:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7fd65f80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:103175:1863365452634368:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1777051430.094240:0:103175:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051430.094283:0:103175:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d95cf51e40 going to sleep for 11 seconds 00000100:00100000:3.0:1777051430.094340:0:6584:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452634368 00000100:00100000:3.0:1777051430.094351:0:6584:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452634368 00000100:00100000:3.0:1777051430.094427:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8176 00000100:00100000:3.0:1777051430.094441:0:6584:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fd65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:103175:x1863365452634368:12345-0@lo:1000:osp_up1-0.0 00000001:00080000:1.0:1777051430.102635:0:104205:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934618 is committed 00000100:00100000:3.0:1777051430.102853:0:6584:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fd65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:103175:x1863365452634368:12345-0@lo:1000:osp_up1-0.0 Request processed in 8411us (8651us total) trans 8589934618 rc 0/0 00000100:00100000:3.0:1777051430.102871:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8176 00000004:00080000:1.0:1777051430.102959:0:103175:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 8589934618 committed transno 8589934618 00000100:00100000:1.0:1777051430.102968:0:103175:0:(client.c:3101:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 8589934618 gen 2 00000100:00100000:1.0:1777051430.102996:0:103175:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7fd65f80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:103175:1863365452634368:0@lo:1000:osp_up1-0.0 00000004:00080000:1.0:1777051430.103030:0:103175:0:(osp_trans.c:1330:osp_get_next_request()) ou ffff99d9594cf180 version 3 rpc_version 3 00000020:00100000:1.0:1777051430.103088:0:103175:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1777051430.103099:0:103175:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff99da7fd65f80 x1863365452634624/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 264/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1777051430.103128:0:103175:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7fd65f80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:103175:1863365452634624:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1777051430.103183:0:103175:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051430.103275:0:103175:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d95cf51240 going to sleep for 11 seconds 00000100:00100000:3.0:1777051430.103283:0:6585:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452634624 00000100:00100000:3.0:1777051430.103294:0:6585:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452634624 00000100:00100000:2.0:1777051430.103457:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8177 00000100:00100000:2.0:1777051430.103472:0:6585:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fd67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:103175:x1863365452634624:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1777051430.105003:0:6585:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fd67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:103175:x1863365452634624:12345-0@lo:1000:osp_up1-0.0 Request processed in 1533us (1817us total) trans 8589934619 rc 0/0 00000100:00100000:2.0:1777051430.105016:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8177 00000100:00100000:1.0:1777051430.105144:0:103175:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7fd65f80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:103175:1863365452634624:0@lo:1000:osp_up1-0.0 00010000:00010000:0.0:1777051430.105346:0:8492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2a600/0x85f51a6b967162a1 lrc: 3/0,1 mode: --/PW res: [0x2000032e2:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.105370:0:8492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2a600/0x85f51a6b967162a1 lrc: 3/0,1 mode: PW/PW res: [0x2000032e2:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.105390:0:8492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2a600/0x85f51a6b967162a1 lrc: 3/0,1 mode: PW/PW res: [0x2000032e2:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.105422:0:8492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2ae00/0x85f51a6b967162a8 lrc: 3/0,1 mode: --/PW res: [0x2000032e0:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.105434:0:8492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2ae00/0x85f51a6b967162a8 lrc: 3/0,1 mode: PW/PW res: [0x2000032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.105445:0:8492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2ae00/0x85f51a6b967162a8 lrc: 3/0,1 mode: PW/PW res: [0x2000032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.105483:0:8492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff99d94eb2b800/0x85f51a6b967162af lrc: 3/0,1 mode: --/PW res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.105494:0:8492:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff99d94eb2b800/0x85f51a6b967162af lrc: 3/0,1 mode: --/PW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.105510:0:8492:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff99d94eb2b800/0x85f51a6b967162af lrc: 3/0,1 mode: --/PW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051430.105533:0:8492:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d944d2bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8492:1863365452634752:0@lo:101:mdt00_003.0 00000100:00100000:0.0:1777051430.105580:0:8492:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051430.105618:0:8492:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d94eea9180 going to sleep for 11 seconds 00000100:00100000:3.0:1777051430.105666:0:46500:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452634752 00000100:00100000:3.0:1777051430.105690:0:46500:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452634752 00000100:00100000:3.0:1777051430.105741:0:46500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8178 00000100:00100000:3.0:1777051430.105752:0:46500:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d944d28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+7:8492:x1863365452634752:12345-0@lo:101:mdt00_003.0 00010000:00010000:3.0:1777051430.105772:0:46500:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777051430.105796:0:46500:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a2200/0x85f51a6b967162b6 lrc: 2/0,0 mode: --/PW res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x85f51a6b967162af expref: -99 pid: 46500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051430.105827:0:46500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a2200/0x85f51a6b967162b6 lrc: 3/0,0 mode: PW/PW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x85f51a6b967162af expref: 8 pid: 46500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051430.105847:0:46500:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a2200/0x85f51a6b967162b6 lrc: 3/0,0 mode: PW/PW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b967162af expref: 8 pid: 46500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051430.105859:0:46500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff99d9533abb00) 00010000:00010000:3.0:1777051430.105865:0:46500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777051430.105869:0:46500:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d9559a2200, rc 0) 00000100:00100000:3.0:1777051430.105972:0:46500:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d944d28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+8:8492:x1863365452634752:12345-0@lo:101:mdt00_003.0 Request processed in 219us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051430.105984:0:46500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8178 00000100:00100000:0.0:1777051430.106041:0:8492:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d944d2bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8492:1863365452634752:0@lo:101:mdt00_003.0 00010000:00010000:0.0:1777051430.106063:0:8492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff99d94eb2b800/0x85f51a6b967162af lrc: 4/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x85f51a6b967162b6 expref: -99 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.106084:0:8492:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff99d94eb2b800/0x85f51a6b967162af lrc: 4/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x85f51a6b967162b6 expref: -99 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1777051430.106109:0:8492:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000fae317f4 reply state 000000005c11d0c5 transno 30064771155 ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2ae00/0x85f51a6b967162a8 lrc: 3/0,1 mode: PW/PW res: [0x2000032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.106122:0:8492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2ae00/0x85f51a6b967162a8 lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.106131:0:8492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e0:0x1:0x0].0x0 (ffff99d943f76200) 00010000:00010000:0.0:1777051430.106136:0:8492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1777051430.106141:0:8492:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1777051430.106149:0:8492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff99d94eb2b800/0x85f51a6b967162af lrc: 4/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x85f51a6b967162b6 expref: -99 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.106162:0:8492:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff99d94eb2b800/0x85f51a6b967162af lrc: 3/0,0 mode: PW/PW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x85f51a6b967162b6 expref: -99 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1777051430.106187:0:8492:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000bd1:0x1:0x0] 00000004:00010000:0.0:1777051430.106223:0:8492:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000fae317f4 reply state 000000005c11d0c5 transno 30064771155 ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2a600/0x85f51a6b967162a1 lrc: 3/0,1 mode: PW/PW res: [0x2000032e2:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.106237:0:8492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2a600/0x85f51a6b967162a1 lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e2:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.106254:0:8492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0x6:0x0].0x0 (ffff99d943f76700) 00010000:00010000:0.0:1777051430.106259:0:8492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1777051430.106262:0:8492:0:(service.c:177:ptlrpc_save_lock()) nlocks 1 00000004:00200000:0.0:1777051430.106270:0:8492:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000032e2:0x6:0x0]: returning size 4096 00010000:00010000:0.0:1777051430.106281:0:8492:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263c00/0x85f51a6b96716293 lrc: 4/0,1 mode: CW/CW res: [0x2000032e2:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.106291:0:8492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263c00/0x85f51a6b96716293 lrc: 4/0,1 mode: CW/CW res: [0x2000032e2:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.106301:0:8492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263c00/0x85f51a6b96716293 lrc: 3/0,0 mode: CW/CW res: [0x2000032e2:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.106311:0:8492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263c00/0x85f51a6b96716293 lrc: 4/0,0 mode: CW/CW res: [0x2000032e2:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.106320:0:8492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d950263c00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:0.0:1777051430.106326:0:8492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263c00/0x85f51a6b96716293 lrc: 4/0,0 mode: CW/CW res: [0x2000032e2:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.106339:0:8492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263c00/0x85f51a6b96716293 lrc: 5/0,0 mode: CW/CW res: [0x2000032e2:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.106354:0:8492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0x5:0x0].0x0 (ffff99d9413d0100) 00010000:00010000:0.0:1777051430.106358:0:8492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777051430.106364:0:8492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263c00/0x85f51a6b96716293 lrc: 3/0,0 mode: --/CW res: [0x2000032e2:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.106371:0:8492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263c00/0x85f51a6b96716293 lrc: 0/0,0 mode: --/CW res: [0x2000032e2:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1777051430.106389:0:8492:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000fae317f4 reply state 000000005c11d0c5 transno 30064771155 ns: mdt-lustre-MDT0000_UUID lock: ffff99d950262e00/0x85f51a6b9671629a lrc: 3/0,1 mode: PW/PW res: [0x2000032e2:0x5:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.106403:0:8492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d950262e00/0x85f51a6b9671629a lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e2:0x5:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.106414:0:8492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0x5:0x0].0xd1d4b922 (ffff99d9413d0500) 00010000:00010000:0.0:1777051430.106417:0:8492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1777051430.106421:0:8492:0:(service.c:177:ptlrpc_save_lock()) nlocks 2 00000100:00100000:0.0:1777051430.106528:0:8492:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fd64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+39:138011:x1863365425977216:12345-192.168.201.46@tcp:36:lfs.0 Request processed in 26783us (27108us total) trans 30064771155 rc 0/0 00000100:00100000:0.0:1777051430.106541:0:8492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112055 00000100:00100000:3.0:1777051430.110074:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051430.110256:0:6583:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425977472 00000100:00100000:0.0:1777051430.110265:0:6583:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425977472 00000100:00100000:0.0:1777051430.110382:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3356 00000100:00100000:0.0:1777051430.110396:0:6583:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da445dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+39:138011:x1863365425977472:12345-192.168.201.46@tcp:35:lfs.0 00000100:00100000:0.0:1777051430.110601:0:6583:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da445dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+40:138011:x1863365425977472:12345-192.168.201.46@tcp:35:lfs.0 Request processed in 205us (526us total) trans 30064771156 rc 0/0 00000100:00100000:0.0:1777051430.110613:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3356 00000100:00100000:1.0:1777051430.144564:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051430.145436:0:46497:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425977728 00000100:00100000:2.0:1777051430.145450:0:46497:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425977728 00000100:00100000:2.0:1777051430.145541:0:46497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112056 00000100:00100000:2.0:1777051430.145556:0:46497:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fd64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:c11b6966-0775-44d2-bdc6-c74c26eb2226+23:138015:x1863365425977728:12345-192.168.201.46@tcp:36:mkdir.0 00010000:00010000:2.0:1777051430.145628:0:46497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777051430.145663:0:46497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d950262400/0x85f51a6b9671627e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b63da expref: 23 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.145689:0:46497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d9533ab000) 00010000:00010000:2.0:1777051430.145696:0:46497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1777051430.145876:0:46497:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fd64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:c11b6966-0775-44d2-bdc6-c74c26eb2226+22:138015:x1863365425977728:12345-192.168.201.46@tcp:36:mkdir.0 Request processed in 322us (1321us total) trans 0 rc -17/-17 00000100:00100000:2.0:1777051430.145895:0:46497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112056 00000100:00100000:1.0:1777051430.149260:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051430.149467:0:21368:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425977856 00000100:00100000:0.0:1777051430.149476:0:21368:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425977856 00000100:00100000:0.0:1777051430.149548:0:21368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112057 00000100:00100000:0.0:1777051430.149561:0:21368:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fd65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+22:138015:x1863365425977856:12345-192.168.201.46@tcp:101:mkdir.0 00010000:00010000:0.0:1777051430.149581:0:21368:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051430.149605:0:21368:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2a200/0x85f51a6b967162bd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b63e8 expref: -99 pid: 21368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.149670:0:21368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2a000/0x85f51a6b967162c4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.149695:0:21368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2a000/0x85f51a6b967162c4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.149711:0:21368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2a000/0x85f51a6b967162c4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1777051430.149764:0:21368:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 12288 00000004:00200000:0.0:1777051430.149770:0:21368:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1777051430.149796:0:21368:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2a000/0x85f51a6b967162c4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.149826:0:21368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2a200/0x85f51a6b967162bd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b63e8 expref: 24 pid: 21368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.149848:0:21368:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2a000/0x85f51a6b967162c4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b63e8 expref: 23 pid: 21368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.149859:0:21368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d9533ab000) 00010000:00010000:0.0:1777051430.149863:0:21368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1777051430.149868:0:21368:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d94eb2a000, rc 0) 00000100:00100000:0.0:1777051430.149972:0:21368:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fd65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+23:138015:x1863365425977856:12345-192.168.201.46@tcp:101:mkdir.0 Request processed in 413us (716us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051430.149989:0:21368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112057 00000100:00100000:3.0:1777051430.154691:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051430.155799:0:10328:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425977984 00000100:00100000:0.0:1777051430.155806:0:10328:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425977984 00000100:00100000:0.0:1777051430.155854:0:10328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112058 00000100:00100000:0.0:1777051430.155864:0:10328:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da445ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+23:138015:x1863365425977984:12345-192.168.201.46@tcp:101:mkdir.0 00010000:00010000:0.0:1777051430.155878:0:10328:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051430.155897:0:10328:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2bc00/0x85f51a6b967162cb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b63ef expref: -99 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.156010:0:10328:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b600/0x85f51a6b967162d2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.156027:0:10328:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b600/0x85f51a6b967162d2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.156041:0:10328:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b600/0x85f51a6b967162d2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.156055:0:10328:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2ac00/0x85f51a6b967162d9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc9adb04b bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.156066:0:10328:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2ac00/0x85f51a6b967162d9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc9adb04b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.156075:0:10328:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2ac00/0x85f51a6b967162d9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc9adb04b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.156170:0:10328:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b200/0x85f51a6b967162e0 lrc: 3/1,0 mode: --/PR res: [0x2000032e2:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.156183:0:10328:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b200/0x85f51a6b967162e0 lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0x5:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.156193:0:10328:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b200/0x85f51a6b967162e0 lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0x5:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1777051430.156257:0:10328:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000032e2:0x5:0x0]: returning size 4096 00000004:00200000:0.0:1777051430.156262:0:10328:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1777051430.156284:0:10328:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b200/0x85f51a6b967162e0 lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0x5:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.156303:0:10328:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b600/0x85f51a6b967162d2 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.156311:0:10328:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b600/0x85f51a6b967162d2 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.156320:0:10328:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b600/0x85f51a6b967162d2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.156329:0:10328:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b600/0x85f51a6b967162d2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.156338:0:10328:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94eb2b600 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:0.0:1777051430.156343:0:10328:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b600/0x85f51a6b967162d2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.156361:0:10328:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b600/0x85f51a6b967162d2 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.156376:0:10328:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d9533ab000) 00010000:00010000:0.0:1777051430.156381:0:10328:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777051430.156387:0:10328:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b600/0x85f51a6b967162d2 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.156397:0:10328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b600/0x85f51a6b967162d2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.156414:0:10328:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2ac00/0x85f51a6b967162d9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc9adb04b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.156424:0:10328:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2ac00/0x85f51a6b967162d9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc9adb04b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.156433:0:10328:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2ac00/0x85f51a6b967162d9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc9adb04b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.156441:0:10328:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94eb2ac00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:0.0:1777051430.156445:0:10328:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2ac00/0x85f51a6b967162d9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc9adb04b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.156453:0:10328:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2ac00/0x85f51a6b967162d9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc9adb04b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.156463:0:10328:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc9adb04b (ffff99d9413d0700) 00010000:00010000:0.0:1777051430.156467:0:10328:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777051430.156470:0:10328:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2ac00/0x85f51a6b967162d9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc9adb04b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.156478:0:10328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2ac00/0x85f51a6b967162d9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc9adb04b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.156509:0:10328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2bc00/0x85f51a6b967162cb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b63ef expref: 25 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.156524:0:10328:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b200/0x85f51a6b967162e0 lrc: 3/0,0 mode: PR/PR res: [0x2000032e2:0x5:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b63ef expref: 24 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.156534:0:10328:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0x5:0x0].0x0 (ffff99d9413d0100) 00010000:00010000:0.0:1777051430.156538:0:10328:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1777051430.156541:0:10328:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d94eb2b200, rc 0) 00000100:00100000:0.0:1777051430.156602:0:10328:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da445ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+24:138015:x1863365425977984:12345-192.168.201.46@tcp:101:mkdir.0 Request processed in 738us (1914us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051430.156616:0:10328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112058 00000100:00100000:1.0:1777051430.160241:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051430.160307:0:27885:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425978240 00000100:00100000:0.0:1777051430.160316:0:27885:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425978240 00000100:00100000:0.0:1777051430.160390:0:27885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112059 00000100:00100000:0.0:1777051430.160405:0:27885:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fd67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c11b6966-0775-44d2-bdc6-c74c26eb2226+24:138015:x1863365425978240:12345-192.168.201.46@tcp:36:mkdir.0 00010000:00010000:0.0:1777051430.160456:0:27885:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777051430.160486:0:27885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b200/0x85f51a6b967162e0 lrc: 0/0,0 mode: --/PR res: [0x2000032e2:0x5:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b63ef expref: 24 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.160507:0:27885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0x5:0x0].0x0 (ffff99d9413d0100) 00010000:00010000:0.0:1777051430.160514:0:27885:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1777051430.160636:0:27885:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fd67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c11b6966-0775-44d2-bdc6-c74c26eb2226+23:138015:x1863365425978240:12345-192.168.201.46@tcp:36:mkdir.0 Request processed in 232us (435us total) trans 0 rc -17/-17 00000100:00100000:0.0:1777051430.160647:0:27885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112059 00000100:00100000:1.0:1777051430.162383:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051430.164653:0:6580:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425978368 00000100:00100000:0.0:1777051430.164664:0:6580:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425978368 00000100:00100000:0.0:1777051430.164720:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112060 00000100:00100000:0.0:1777051430.164731:0:6580:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fd65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+23:138015:x1863365425978368:12345-192.168.201.46@tcp:101:mkdir.0 00010000:00010000:0.0:1777051430.164747:0:6580:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051430.164769:0:6580:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2bc00/0x85f51a6b967162e7 lrc: 2/0,0 mode: --/CR res: [0x2000032e2:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b63f6 expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.165124:0:6580:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2ac00/0x85f51a6b967162ee lrc: 3/1,0 mode: --/CR res: [0x2000032e2:0x5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.165141:0:6580:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2ac00/0x85f51a6b967162ee lrc: 3/1,0 mode: CR/CR res: [0x2000032e2:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.165154:0:6580:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2ac00/0x85f51a6b967162ee lrc: 3/1,0 mode: CR/CR res: [0x2000032e2:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.165169:0:6580:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b600/0x85f51a6b967162f5 lrc: 3/1,0 mode: --/PR res: [0x2000032e2:0x5:0x0].0xd1d4b922 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.165179:0:6580:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b600/0x85f51a6b967162f5 lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0x5:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.165187:0:6580:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b600/0x85f51a6b967162f5 lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0x5:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.165271:0:6580:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2a200/0x85f51a6b967162fc lrc: 3/1,0 mode: --/PR res: [0x2000032e2:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.165283:0:6580:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2a200/0x85f51a6b967162fc lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0x6:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.165293:0:6580:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2a200/0x85f51a6b967162fc lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0x6:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1777051430.165377:0:6580:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000032e2:0x6:0x0]: returning size 4096 00000004:00200000:0.0:1777051430.165384:0:6580:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:0.0:1777051430.165408:0:6580:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2a200/0x85f51a6b967162fc lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0x6:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.165424:0:6580:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2ac00/0x85f51a6b967162ee lrc: 4/1,0 mode: CR/CR res: [0x2000032e2:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.165434:0:6580:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2ac00/0x85f51a6b967162ee lrc: 4/1,0 mode: CR/CR res: [0x2000032e2:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.165450:0:6580:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2ac00/0x85f51a6b967162ee lrc: 3/0,0 mode: CR/CR res: [0x2000032e2:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.165460:0:6580:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2ac00/0x85f51a6b967162ee lrc: 4/0,0 mode: CR/CR res: [0x2000032e2:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.165470:0:6580:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94eb2ac00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:0.0:1777051430.165476:0:6580:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2ac00/0x85f51a6b967162ee lrc: 4/0,0 mode: CR/CR res: [0x2000032e2:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.165486:0:6580:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2ac00/0x85f51a6b967162ee lrc: 5/0,0 mode: CR/CR res: [0x2000032e2:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.165500:0:6580:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0x5:0x0].0x0 (ffff99d9413d0100) 00010000:00010000:0.0:1777051430.165504:0:6580:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777051430.165510:0:6580:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2ac00/0x85f51a6b967162ee lrc: 3/0,0 mode: --/CR res: [0x2000032e2:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.165521:0:6580:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2ac00/0x85f51a6b967162ee lrc: 0/0,0 mode: --/CR res: [0x2000032e2:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.165555:0:6580:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b600/0x85f51a6b967162f5 lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0x5:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.165565:0:6580:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b600/0x85f51a6b967162f5 lrc: 2/0,0 mode: PR/PR res: [0x2000032e2:0x5:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.165574:0:6580:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b600/0x85f51a6b967162f5 lrc: 3/0,0 mode: PR/PR res: [0x2000032e2:0x5:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.165582:0:6580:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94eb2b600 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:0.0:1777051430.165586:0:6580:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b600/0x85f51a6b967162f5 lrc: 3/0,0 mode: PR/PR res: [0x2000032e2:0x5:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.165595:0:6580:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b600/0x85f51a6b967162f5 lrc: 4/0,0 mode: PR/PR res: [0x2000032e2:0x5:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.165606:0:6580:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0x5:0x0].0xd1d4b922 (ffff99d9413d0500) 00010000:00010000:0.0:1777051430.165609:0:6580:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777051430.165613:0:6580:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b600/0x85f51a6b967162f5 lrc: 2/0,0 mode: --/PR res: [0x2000032e2:0x5:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.165622:0:6580:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b600/0x85f51a6b967162f5 lrc: 0/0,0 mode: --/PR res: [0x2000032e2:0x5:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.165656:0:6580:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2bc00/0x85f51a6b967162e7 lrc: 0/0,0 mode: --/CR res: [0x2000032e2:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b63f6 expref: 25 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.165674:0:6580:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2a200/0x85f51a6b967162fc lrc: 3/0,0 mode: PR/PR res: [0x2000032e2:0x6:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b63f6 expref: 24 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.165685:0:6580:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0x6:0x0].0x0 (ffff99d943f76700) 00010000:00010000:0.0:1777051430.165688:0:6580:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1777051430.165692:0:6580:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d94eb2a200, rc 0) 00000100:00100000:0.0:1777051430.165758:0:6580:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fd65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+24:138015:x1863365425978368:12345-192.168.201.46@tcp:101:mkdir.0 Request processed in 1028us (3376us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051430.165769:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112060 00000100:00100000:3.0:1777051430.168152:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051430.168332:0:6581:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425978496 00000100:00100000:0.0:1777051430.168342:0:6581:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425978496 00000100:00100000:0.0:1777051430.168407:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112061 00000100:00100000:0.0:1777051430.168420:0:6581:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da445dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+24:138015:x1863365425978496:12345-192.168.201.46@tcp:101:mkdir.0 00010000:00010000:0.0:1777051430.168437:0:6581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051430.168457:0:6581:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2be00/0x85f51a6b96716303 lrc: 2/0,0 mode: --/CR res: [0x2000032e0:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b63fd expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.168509:0:6581:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e61a200/0x85f51a6b9671630a lrc: 3/1,0 mode: --/PR res: [0x2000032e0:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.168526:0:6581:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e61a200/0x85f51a6b9671630a lrc: 3/1,0 mode: PR/PR res: [0x2000032e0:0x1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.168539:0:6581:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e61a200/0x85f51a6b9671630a lrc: 3/1,0 mode: PR/PR res: [0x2000032e0:0x1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1777051430.168579:0:6581:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000032e0:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1777051430.168585:0:6581:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1777051430.168614:0:6581:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2be00/0x85f51a6b96716303 lrc: 0/0,0 mode: --/CR res: [0x2000032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b63fd expref: 26 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.168630:0:6581:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e61a200/0x85f51a6b9671630a lrc: 3/0,0 mode: PR/PR res: [0x2000032e0:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b63fd expref: 25 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.168638:0:6581:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e0:0x1:0x0].0x0 (ffff99d943f76200) 00010000:00010000:0.0:1777051430.168641:0:6581:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1777051430.168644:0:6581:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d94e61a200, rc 0) 00000100:00100000:0.0:1777051430.168675:0:6581:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da445dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+25:138015:x1863365425978496:12345-192.168.201.46@tcp:101:mkdir.0 Request processed in 260us (531us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051430.168682:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112061 00000100:00100000:1.0:1777051430.172333:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051430.172404:0:21368:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425978624 00000100:00100000:0.0:1777051430.172415:0:21368:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425978624 00000100:00100000:0.0:1777051430.172495:0:21368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112062 00000100:00100000:0.0:1777051430.172512:0:21368:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fd66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+8:138015:x1863365425978624:12345-192.168.201.46@tcp:101:mkdir.0 00010000:00010000:0.0:1777051430.172531:0:21368:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051430.172552:0:21368:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61b600/0x85f51a6b96716311 lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6404 expref: -99 pid: 21368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.172608:0:21368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61a600/0x85f51a6b96716318 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.172626:0:21368:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a2200/0x85f51a6b967162b6 lrc: 2/0,0 mode: PW/PW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b967162af expref: 7 pid: 46500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.172637:0:21368:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61a600/0x85f51a6b96716318 lrc: 4/1,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 21368 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.172675:0:21368:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a2200/0x85f51a6b967162b6 lrc: 3/0,0 mode: PW/PW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x85f51a6b967162af expref: 7 pid: 46500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051430.172694:0:21368:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d944d2bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001_UUID:21368:1863365452634880:0@lo:104: 00000100:00100000:0.0:1777051430.172754:0:21368:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051430.172803:0:21368:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d94eea9780 going to sleep for 11 seconds 00000100:00100000:2.0:1777051430.172853:0:6563:0:(service.c:153:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1777051430.172873:0:6563:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452634880 00000100:00100000:2.0:1777051430.172878:0:6563:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452634880 00000100:00100000:2.0:1777051430.172965:0:6563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1777051430.172982:0:6563:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7f988850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-mdtlov_UUID+4:21368:x1863365452634880:12345-0@lo:104: 00010000:00010000:2.0:1777051430.172999:0:6563:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff99d94eb2b800/0x85f51a6b967162af lrc: 3/0,0 mode: PW/PW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x85f51a6b967162b6 expref: -99 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.173179:0:6563:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1777051430.173191:0:6563:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7f988850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-mdtlov_UUID+4:21368:x1863365452634880:12345-0@lo:104: Request processed in 214us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051430.173203:0:6563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1777051430.173241:0:21368:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d944d2bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001_UUID:21368:1863365452634880:0@lo:104: 00010000:00010000:0.0:1777051430.173271:0:21368:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61a600/0x85f51a6b96716318 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21368 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051430.173368:0:6568:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777051430.173379:0:6568:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff99d94eb2b800/0x85f51a6b967162af lrc: 3/0,0 mode: PW/PW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x85f51a6b967162b6 expref: -99 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051430.177613:0:6568:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94eb2b800 already unused, calling callback (ffffffffc177eed0) 00010000:00010000:3.0:1777051430.177627:0:6568:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff99d94eb2b800/0x85f51a6b967162af lrc: 4/0,0 mode: PW/PW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0x85f51a6b967162b6 expref: -99 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777051430.177643:0:6568:0:(mdt_handler.c:3963:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff99d94eb2b800/0x85f51a6b967162af lrc: 4/0,0 mode: PW/PW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0x85f51a6b967162b6 expref: -99 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051430.177696:0:6568:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff99d94eb2b800/0x85f51a6b967162af lrc: 2/0,0 mode: --/PW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x85f51a6b967162b6 expref: -99 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051430.177706:0:6568:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1777051430.177739:0:6568:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff99d94eb2b800/0x85f51a6b967162af lrc: 1/0,0 mode: --/PW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x85f51a6b967162b6 expref: -99 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051430.177750:0:6568:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff99d94eb2b800/0x85f51a6b967162af lrc: 0/0,0 mode: --/PW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x85f51a6b967162b6 expref: -99 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051430.177789:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051430.177793:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051430.177799:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777051430.177814:0:3679:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1777051430.177836:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da445dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452635008:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1777051430.177899:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051430.178691:0:47827:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452635008 00000100:00100000:0.0:1777051430.178702:0:47827:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452635008 00010000:00010000:0.0:1777051430.178738:0:47827:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a2200/0x85f51a6b967162b6 lrc: 3/0,0 mode: PW/PW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0x85f51a6b967162af expref: 8 pid: 46500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051430.178796:0:47827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3877 00000100:00100000:0.0:1777051430.178808:0:47827:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da445df480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:lustre-MDT0000-mdtlov_UUID+8:3679:x1863365452635008:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1777051430.178831:0:47827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000001:00080000:1.0:1777051430.181943:0:104205:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934619 is committed 00010000:00010000:0.0:1777051430.182113:0:47827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a2200/0x85f51a6b967162b6 lrc: 0/0,0 mode: --/PW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0x85f51a6b967162af expref: 7 pid: 46500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.182138:0:47827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff99d9533abb00) 00010000:00010000:0.0:1777051430.182146:0:47827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61a600/0x85f51a6b96716318 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21368 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.182159:0:47827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61a600/0x85f51a6b96716318 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 21368 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.182461:0:47827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61a600/0x85f51a6b96716318 lrc: 4/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 21368 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.182526:0:47827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1777051430.182574:0:21368:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61a600/0x85f51a6b96716318 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21368 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.182589:0:21368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61a600/0x85f51a6b96716318 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21368 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051430.182613:0:47827:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da445df480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:lustre-MDT0000-mdtlov_UUID+6:3679:x1863365452635008:12345-0@lo:103:ldlm_bl.0 Request processed in 3805us (4711us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051430.182628:0:47827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3877 00000004:00200000:2.0:1777051430.182657:0:21368:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000bd1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1777051430.182665:0:21368:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:2.0:1777051430.182738:0:21368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61b600/0x85f51a6b96716311 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6404 expref: 10 pid: 21368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.182763:0:21368:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61a600/0x85f51a6b96716318 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6404 expref: 9 pid: 21368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.182775:0:21368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff99d9533abb00) 00010000:00010000:2.0:1777051430.182779:0:21368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1777051430.182783:0:21368:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d94e61a600, rc 0) 00000100:00100000:2.0:1777051430.183249:0:21368:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fd66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+9:138015:x1863365425978624:12345-192.168.201.46@tcp:101:mkdir.0 Request processed in 10740us (10921us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051430.183253:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da445dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452635008:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1777051430.183271:0:21368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112062 00000100:00100000:1.0:1777051430.194567:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051430.194675:0:6579:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425978752 00000100:00100000:2.0:1777051430.194688:0:6579:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425978752 00000100:00100000:2.0:1777051430.194761:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112063 00000100:00100000:2.0:1777051430.194775:0:6579:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fd64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+25:138016:x1863365425978752:12345-192.168.201.46@tcp:101:rm.0 00010000:00010000:2.0:1777051430.194801:0:6579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051430.194828:0:6579:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d950262400/0x85f51a6b9671631f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b640b expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.194907:0:6579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263e00/0x85f51a6b96716326 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.194958:0:6579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263e00/0x85f51a6b96716326 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.194974:0:6579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263e00/0x85f51a6b96716326 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.194992:0:6579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950262200/0x85f51a6b9671632d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc9adb04b bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.195003:0:6579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d950262200/0x85f51a6b9671632d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc9adb04b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.195014:0:6579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d950262200/0x85f51a6b9671632d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc9adb04b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.195118:0:6579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263a00/0x85f51a6b96716334 lrc: 3/1,0 mode: --/PR res: [0x2000032e2:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.195133:0:6579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263a00/0x85f51a6b96716334 lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0x5:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.195152:0:6579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263a00/0x85f51a6b96716334 lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0x5:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1777051430.195240:0:6579:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000032e2:0x5:0x0]: returning size 4096 00000004:00200000:2.0:1777051430.195245:0:6579:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1777051430.195273:0:6579:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263a00/0x85f51a6b96716334 lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0x5:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.195290:0:6579:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263e00/0x85f51a6b96716326 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.195320:0:6579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263e00/0x85f51a6b96716326 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.195329:0:6579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263e00/0x85f51a6b96716326 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.195338:0:6579:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263e00/0x85f51a6b96716326 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.195347:0:6579:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d950263e00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:2.0:1777051430.195353:0:6579:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263e00/0x85f51a6b96716326 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.195364:0:6579:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263e00/0x85f51a6b96716326 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.195380:0:6579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d9533ab000) 00010000:00010000:2.0:1777051430.195384:0:6579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777051430.195390:0:6579:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263e00/0x85f51a6b96716326 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.195406:0:6579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263e00/0x85f51a6b96716326 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.195427:0:6579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950262200/0x85f51a6b9671632d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc9adb04b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.195435:0:6579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d950262200/0x85f51a6b9671632d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc9adb04b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.195444:0:6579:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d950262200/0x85f51a6b9671632d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc9adb04b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.195451:0:6579:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d950262200 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:2.0:1777051430.195455:0:6579:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d950262200/0x85f51a6b9671632d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc9adb04b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.195464:0:6579:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d950262200/0x85f51a6b9671632d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc9adb04b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.195475:0:6579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc9adb04b (ffff99d9413d0700) 00010000:00010000:2.0:1777051430.195479:0:6579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777051430.195483:0:6579:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d950262200/0x85f51a6b9671632d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc9adb04b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.195491:0:6579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d950262200/0x85f51a6b9671632d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc9adb04b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.195526:0:6579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d950262400/0x85f51a6b9671631f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b640b expref: 27 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.195544:0:6579:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263a00/0x85f51a6b96716334 lrc: 3/0,0 mode: PR/PR res: [0x2000032e2:0x5:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b640b expref: 26 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.195555:0:6579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0x5:0x0].0x0 (ffff99d9413d0100) 00010000:00010000:2.0:1777051430.195559:0:6579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1777051430.195562:0:6579:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d950263a00, rc 0) 00000100:00100000:2.0:1777051430.195638:0:6579:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fd64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+26:138016:x1863365425978752:12345-192.168.201.46@tcp:101:rm.0 Request processed in 865us (1082us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051430.195649:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112063 00000100:00100000:0.0:1777051430.198510:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051430.198655:0:27885:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425978880 00000100:00100000:2.0:1777051430.198663:0:27885:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425978880 00000100:00100000:2.0:1777051430.198710:0:27885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112064 00000100:00100000:2.0:1777051430.198724:0:27885:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d944d2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c11b6966-0775-44d2-bdc6-c74c26eb2226+9:138016:x1863365425978880:12345-192.168.201.46@tcp:101:rm.0 00010000:00010000:2.0:1777051430.198738:0:27885:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051430.198756:0:27885:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d950263c00/0x85f51a6b9671633b lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6412 expref: -99 pid: 27885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.199422:0:27885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94eccd000/0x85f51a6b96716342 lrc: 3/1,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.199440:0:27885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d94eccd000/0x85f51a6b96716342 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 27885 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.199454:0:27885:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d94eccd000/0x85f51a6b96716342 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 27885 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.199476:0:27885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94eccd400/0x85f51a6b96716349 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0xa30099d5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.199486:0:27885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d94eccd400/0x85f51a6b96716349 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xa30099d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27885 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.199503:0:27885:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d94eccd400/0x85f51a6b96716349 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xa30099d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27885 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.199557:0:27885:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94eccd000/0x85f51a6b96716342 lrc: 4/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 27885 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.199567:0:27885:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94eccd000/0x85f51a6b96716342 lrc: 4/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 27885 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.199576:0:27885:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d94eccd000/0x85f51a6b96716342 lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 27885 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.199585:0:27885:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99d94eccd000/0x85f51a6b96716342 lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 27885 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.199593:0:27885:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94eccd000 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:2.0:1777051430.199597:0:27885:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d94eccd000/0x85f51a6b96716342 lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 27885 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.199606:0:27885:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d94eccd000/0x85f51a6b96716342 lrc: 5/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 27885 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.199618:0:27885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff99d9533abb00) 00010000:00010000:2.0:1777051430.199623:0:27885:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777051430.199627:0:27885:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99d94eccd000/0x85f51a6b96716342 lrc: 3/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 27885 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.199637:0:27885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d94eccd000/0x85f51a6b96716342 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 27885 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.199653:0:27885:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94eccd400/0x85f51a6b96716349 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xa30099d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27885 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.199664:0:27885:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d94eccd400/0x85f51a6b96716349 lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xa30099d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 27885 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.199673:0:27885:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99d94eccd400/0x85f51a6b96716349 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xa30099d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27885 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.199681:0:27885:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94eccd400 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:2.0:1777051430.199685:0:27885:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d94eccd400/0x85f51a6b96716349 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xa30099d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27885 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.199695:0:27885:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d94eccd400/0x85f51a6b96716349 lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xa30099d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 27885 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.199708:0:27885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0xa30099d5 (ffff99d9413d0f00) 00010000:00010000:2.0:1777051430.199712:0:27885:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777051430.199716:0:27885:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99d94eccd400/0x85f51a6b96716349 lrc: 2/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0xa30099d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27885 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.199725:0:27885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d94eccd400/0x85f51a6b96716349 lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0xa30099d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27885 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.199766:0:27885:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99d950263c00/0x85f51a6b9671633b lrc: 1/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6412 expref: 10 pid: 27885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.199780:0:27885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff99d9533abb00) 00010000:00010000:2.0:1777051430.199784:0:27885:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777051430.199789:0:27885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d950263c00/0x85f51a6b9671633b lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6412 expref: 10 pid: 27885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.199810:0:27885:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d950263c00, rc 0) 00000100:00100000:2.0:1777051430.200322:0:27885:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d944d2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c11b6966-0775-44d2-bdc6-c74c26eb2226+9:138016:x1863365425978880:12345-192.168.201.46@tcp:101:rm.0 Request processed in 1595us (1813us total) trans 0 rc 301/301 00000100:00100000:2.0:1777051430.200334:0:27885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112064 00000100:00100000:1.0:1777051430.212052:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051430.212464:0:6588:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425979008 00000100:00100000:0.0:1777051430.212477:0:6588:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425979008 00000100:00100000:0.0:1777051430.212651:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 20 00000100:00100000:0.0:1777051430.212674:0:6588:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fd66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:c11b6966-0775-44d2-bdc6-c74c26eb2226+9:138017:x1863365425979008:12345-192.168.201.46@tcp:700:dd.0 00000100:00100000:0.0:1777051430.212835:0:6588:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fd66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:c11b6966-0775-44d2-bdc6-c74c26eb2226+9:138017:x1863365425979008:12345-192.168.201.46@tcp:700:dd.0 Request processed in 165us (788us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051430.212857:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 20 00000100:00100000:1.0:1777051430.215320:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051430.215394:0:8492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425979264 00000100:00100000:0.0:1777051430.215403:0:8492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425979264 00000100:00100000:0.0:1777051430.215462:0:8492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112065 00000100:00100000:0.0:1777051430.215488:0:8492:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fd67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+9:138017:x1863365425979264:12345-192.168.201.46@tcp:101:dd.0 00010000:00010000:0.0:1777051430.215513:0:8492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051430.215518:0:8492:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1777051430.215550:0:8492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61a600/0x85f51a6b96716318 lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6404 expref: 9 pid: 21368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.215572:0:8492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff99d9533abb00) 00010000:00010000:0.0:1777051430.215584:0:8492:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1777051430.215599:0:8492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61ac00/0x85f51a6b96716350 lrc: 2/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6419 expref: -99 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.215699:0:8492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61be00/0x85f51a6b96716357 lrc: 3/0,1 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.215712:0:8492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61be00/0x85f51a6b96716357 lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8492 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.215723:0:8492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61be00/0x85f51a6b96716357 lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8492 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.215735:0:8492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61a400/0x85f51a6b9671635e lrc: 3/0,1 mode: --/PW res: [0x240000bd1:0x1:0x0].0xa30099d5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.215742:0:8492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61a400/0x85f51a6b9671635e lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0xa30099d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8492 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.215754:0:8492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61a400/0x85f51a6b9671635e lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0xa30099d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8492 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1777051430.217740:0:8492:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x103:0x0], index 0: 0 00010000:00010000:0.0:1777051430.218850:0:8492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61b200/0x85f51a6b96716365 lrc: 3/1,0 mode: --/PR res: [0x240000bd2:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.218870:0:8492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61b200/0x85f51a6b96716365 lrc: 3/1,0 mode: PR/PR res: [0x240000bd2:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8492 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.218885:0:8492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61b200/0x85f51a6b96716365 lrc: 3/1,0 mode: PR/PR res: [0x240000bd2:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8492 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.218954:0:8492:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61be00/0x85f51a6b96716357 lrc: 4/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8492 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.218967:0:8492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61be00/0x85f51a6b96716357 lrc: 4/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8492 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.218978:0:8492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61be00/0x85f51a6b96716357 lrc: 3/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8492 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.218989:0:8492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61be00/0x85f51a6b96716357 lrc: 4/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8492 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.219000:0:8492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94e61be00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:0.0:1777051430.219006:0:8492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61be00/0x85f51a6b96716357 lrc: 4/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8492 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.219018:0:8492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61be00/0x85f51a6b96716357 lrc: 5/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8492 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.219040:0:8492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff99d943f76c00) 00010000:00010000:0.0:1777051430.219045:0:8492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777051430.219051:0:8492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61be00/0x85f51a6b96716357 lrc: 3/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8492 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.219061:0:8492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61be00/0x85f51a6b96716357 lrc: 0/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8492 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1777051430.219080:0:8492:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000727bcfa2 reply state 00000000e01bab64 transno 8589934620 ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61a400/0x85f51a6b9671635e lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0xa30099d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8492 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.219095:0:8492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61a400/0x85f51a6b9671635e lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0xa30099d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8492 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.219105:0:8492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0xa30099d5 (ffff99d943f76800) 00010000:00010000:0.0:1777051430.219110:0:8492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1777051430.219113:0:8492:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1777051430.219152:0:8492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61ac00/0x85f51a6b96716350 lrc: 0/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6419 expref: 11 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.219440:0:8492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61b200/0x85f51a6b96716365 lrc: 3/0,0 mode: PR/PR res: [0x240000bd2:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6419 expref: 10 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.219451:0:8492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x1:0x0].0x0 (ffff99d943f76b00) 00010000:00010000:0.0:1777051430.219454:0:8492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1777051430.219457:0:8492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d94e61b200, rc 0) 00000100:00100000:0.0:1777051430.219539:0:8492:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fd67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+11:138017:x1863365425979264:12345-192.168.201.46@tcp:101:dd.0 Request processed in 4066us (4220us total) trans 8589934620 rc 0/0 00000100:00100000:0.0:1777051430.219559:0:8492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112065 00000100:00100000:3.0:1777051430.254992:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051430.255113:0:8471:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425979392 00000100:00100000:0.0:1777051430.255128:0:8471:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425979392 00000100:00080000:2.0:1777051430.255521:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1777051430.255607:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 8005 00000100:00100000:0.0:1777051430.255627:0:8471:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da57c84050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+51:138017:x1863365425979392:12345-192.168.201.46@tcp:101:dd.0 00010000:00010000:0.0:1777051430.255653:0:8471:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051430.255682:0:8471:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002b072fde/0x85f51a6b96716373 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x103:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6420 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1777051430.255719:0:8471:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x103:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1777051430.255750:0:8471:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777051430.255755:0:8471:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777051430.255770:0:8471:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002b072fde/0x85f51a6b96716373 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x103:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6420 expref: 52 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.255799:0:8471:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002b072fde/0x85f51a6b96716373 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x103:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6420 expref: 52 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.255822:0:8471:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d94e61ac00, rc 0) 00000100:00100000:0.0:1777051430.255959:0:8471:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da57c84050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+52:138017:x1863365425979392:12345-192.168.201.46@tcp:101:dd.0 Request processed in 335us (973us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051430.255975:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 8005 00000100:00100000:1.0:1777051430.286091:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051430.286250:0:46501:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425979648 00000100:00100000:0.0:1777051430.286263:0:46501:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425979648 00000100:00100000:0.0:1777051430.286338:0:46501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3357 00000100:00100000:1.0:1777051430.286440:0:46501:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d944e10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+11:138017:x1863365425979648:12345-192.168.201.46@tcp:35:dd.0 00000100:00100000:1.0:1777051430.286863:0:46501:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d944e10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+12:138017:x1863365425979648:12345-192.168.201.46@tcp:35:dd.0 Request processed in 509us (776us total) trans 8589934621 rc 0/0 00000100:00100000:1.0:1777051430.286879:0:46501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3357 00000100:00100000:1.0:1777051430.342437:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051430.342595:0:46497:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425979776 00000100:00100000:2.0:1777051430.342610:0:46497:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425979776 00000100:00100000:2.0:1777051430.342695:0:46497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112066 00000100:00100000:2.0:1777051430.342711:0:46497:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d944e11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:c11b6966-0775-44d2-bdc6-c74c26eb2226+12:138023:x1863365425979776:12345-192.168.201.46@tcp:101:mkdir.0 00010000:00010000:2.0:1777051430.342742:0:46497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051430.342773:0:46497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d94eccd400/0x85f51a6b9671637a lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6427 expref: -99 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.342854:0:46497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94eccd000/0x85f51a6b96716381 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.342876:0:46497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d94eccd000/0x85f51a6b96716381 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.342941:0:46497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d94eccd000/0x85f51a6b96716381 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1777051430.342998:0:46497:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000bd1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1777051430.343005:0:46497:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:2.0:1777051430.343054:0:46497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d94eccd400/0x85f51a6b9671637a lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6427 expref: 14 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.343084:0:46497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94eccd000/0x85f51a6b96716381 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6427 expref: 13 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.343098:0:46497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff99d9413d0f00) 00010000:00010000:2.0:1777051430.343451:0:46497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1777051430.343459:0:46497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d94eccd000, rc 0) 00000100:00100000:2.0:1777051430.343546:0:46497:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d944e11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:c11b6966-0775-44d2-bdc6-c74c26eb2226+13:138023:x1863365425979776:12345-192.168.201.46@tcp:101:mkdir.0 Request processed in 837us (1119us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051430.343576:0:46497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112066 00000100:00100000:3.0:1777051430.356038:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051430.357031:0:27882:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425979904 00000100:00100000:2.0:1777051430.357047:0:27882:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425979904 00000100:00100000:2.0:1777051430.357484:0:27882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112067 00000100:00100000:2.0:1777051430.357501:0:27882:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da445dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+13:138024:x1863365425979904:12345-192.168.201.46@tcp:101:rm.0 00010000:00010000:2.0:1777051430.357532:0:27882:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051430.357564:0:27882:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d94eccd400/0x85f51a6b96716388 lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b642e expref: -99 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.357655:0:27882:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94eccc800/0x85f51a6b9671638f lrc: 3/1,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.357679:0:27882:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d94eccc800/0x85f51a6b9671638f lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 27882 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.357697:0:27882:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d94eccc800/0x85f51a6b9671638f lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 27882 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.357777:0:27882:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94eccda00/0x85f51a6b96716396 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x50a12932 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.357791:0:27882:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d94eccda00/0x85f51a6b96716396 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x50a12932 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27882 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.357804:0:27882:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d94eccda00/0x85f51a6b96716396 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x50a12932 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27882 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.357851:0:27882:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94eccc800/0x85f51a6b9671638f lrc: 4/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 27882 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.357864:0:27882:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94eccc800/0x85f51a6b9671638f lrc: 4/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 27882 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.357875:0:27882:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d94eccc800/0x85f51a6b9671638f lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 27882 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.357886:0:27882:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99d94eccc800/0x85f51a6b9671638f lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 27882 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.357896:0:27882:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94eccc800 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:2.0:1777051430.357903:0:27882:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d94eccc800/0x85f51a6b9671638f lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 27882 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.357943:0:27882:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d94eccc800/0x85f51a6b9671638f lrc: 5/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 27882 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.357963:0:27882:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff99d9413d0f00) 00010000:00010000:2.0:1777051430.357969:0:27882:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777051430.357976:0:27882:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99d94eccc800/0x85f51a6b9671638f lrc: 3/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 27882 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.357988:0:27882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d94eccc800/0x85f51a6b9671638f lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 27882 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.358010:0:27882:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94eccda00/0x85f51a6b96716396 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x50a12932 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27882 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.358022:0:27882:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d94eccda00/0x85f51a6b96716396 lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x50a12932 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 27882 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.358032:0:27882:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99d94eccda00/0x85f51a6b96716396 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x50a12932 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27882 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.358040:0:27882:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94eccda00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:2.0:1777051430.358045:0:27882:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d94eccda00/0x85f51a6b96716396 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x50a12932 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27882 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.358054:0:27882:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d94eccda00/0x85f51a6b96716396 lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x50a12932 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 27882 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.358065:0:27882:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x50a12932 (ffff99d9413d0800) 00010000:00010000:2.0:1777051430.358069:0:27882:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777051430.358073:0:27882:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99d94eccda00/0x85f51a6b96716396 lrc: 2/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x50a12932 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27882 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.358082:0:27882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d94eccda00/0x85f51a6b96716396 lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x50a12932 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27882 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.358128:0:27882:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94eccd400/0x85f51a6b96716388 lrc: 1/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b642e expref: 14 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.358146:0:27882:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff99d9413d0f00) 00010000:00010000:2.0:1777051430.358149:0:27882:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777051430.358155:0:27882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d94eccd400/0x85f51a6b96716388 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b642e expref: 14 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.358181:0:27882:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d94eccd400, rc 0) 00000100:00100000:2.0:1777051430.358323:0:27882:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da445dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+13:138024:x1863365425979904:12345-192.168.201.46@tcp:101:rm.0 Request processed in 823us (2294us total) trans 0 rc 301/301 00000100:00100000:2.0:1777051430.358339:0:27882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112067 00000100:00100000:1.0:1777051430.380498:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051430.381433:0:10328:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425980160 00000100:00100000:0.0:1777051430.381449:0:10328:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425980160 00000100:00100000:0.0:1777051430.381540:0:10328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112068 00000100:00100000:0.0:1777051430.381557:0:10328:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d944e11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+13:138025:x1863365425980160:12345-192.168.201.46@tcp:101:dd.0 00010000:00010000:0.0:1777051430.381586:0:10328:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051430.381593:0:10328:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1777051430.381631:0:10328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d94eccd000/0x85f51a6b96716381 lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6427 expref: 13 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.381663:0:10328:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff99d9413d0f00) 00010000:00010000:0.0:1777051430.381680:0:10328:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1777051430.381704:0:10328:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61be00/0x85f51a6b9671639d lrc: 2/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6435 expref: -99 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.381832:0:10328:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61a600/0x85f51a6b967163a4 lrc: 3/0,1 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.381854:0:10328:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61a600/0x85f51a6b967163a4 lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10328 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.381870:0:10328:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61a600/0x85f51a6b967163a4 lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10328 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.381891:0:10328:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61bc00/0x85f51a6b967163ab lrc: 3/0,1 mode: --/PW res: [0x240000bd1:0x1:0x0].0x50a12932 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.381902:0:10328:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61bc00/0x85f51a6b967163ab lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0x50a12932 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10328 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.381940:0:10328:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61bc00/0x85f51a6b967163ab lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0x50a12932 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10328 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1777051430.382655:0:10328:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x103:0x0], index 1: 0 00010000:00010000:0.0:1777051430.383281:0:10328:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61b000/0x85f51a6b967163b2 lrc: 3/1,0 mode: --/PR res: [0x240000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.383299:0:10328:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61b000/0x85f51a6b967163b2 lrc: 3/1,0 mode: PR/PR res: [0x240000bd2:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10328 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.383312:0:10328:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61b000/0x85f51a6b967163b2 lrc: 3/1,0 mode: PR/PR res: [0x240000bd2:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10328 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.383396:0:10328:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61a600/0x85f51a6b967163a4 lrc: 4/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10328 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.383410:0:10328:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61a600/0x85f51a6b967163a4 lrc: 4/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10328 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.383422:0:10328:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61a600/0x85f51a6b967163a4 lrc: 3/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10328 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.383433:0:10328:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61a600/0x85f51a6b967163a4 lrc: 4/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10328 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.383444:0:10328:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94e61a600 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:0.0:1777051430.383451:0:10328:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61a600/0x85f51a6b967163a4 lrc: 4/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10328 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.383460:0:10328:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61a600/0x85f51a6b967163a4 lrc: 5/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10328 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.383471:0:10328:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff99d943f76100) 00010000:00010000:0.0:1777051430.383475:0:10328:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777051430.383479:0:10328:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61a600/0x85f51a6b967163a4 lrc: 3/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10328 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.383486:0:10328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61a600/0x85f51a6b967163a4 lrc: 0/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10328 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1777051430.383501:0:10328:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000577026b0 reply state 00000000717a2bc8 transno 8589934622 ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61bc00/0x85f51a6b967163ab lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0x50a12932 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10328 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.383513:0:10328:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61bc00/0x85f51a6b967163ab lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x50a12932 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10328 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.383520:0:10328:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x50a12932 (ffff99d943f76d00) 00010000:00010000:0.0:1777051430.383523:0:10328:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1777051430.383526:0:10328:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1777051430.383557:0:10328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61be00/0x85f51a6b9671639d lrc: 0/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6435 expref: 15 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.383579:0:10328:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61b000/0x85f51a6b967163b2 lrc: 3/0,0 mode: PR/PR res: [0x240000bd2:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6435 expref: 14 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.383588:0:10328:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x2:0x0].0x0 (ffff99d943f76e00) 00010000:00010000:0.0:1777051430.383591:0:10328:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1777051430.383593:0:10328:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d94e61b000, rc 0) 00000100:00100000:0.0:1777051430.383665:0:10328:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d944e11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+15:138025:x1863365425980160:12345-192.168.201.46@tcp:101:dd.0 Request processed in 2113us (3180us total) trans 8589934622 rc 0/0 00000100:00100000:0.0:1777051430.383675:0:10328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112068 00000100:00100000:1.0:1777051430.419509:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051430.419616:0:27887:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425980288 00000100:00100000:2.0:1777051430.419629:0:27887:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425980288 00000100:00100000:2.0:1777051430.419718:0:27887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 8006 00000100:00080000:1.0:1777051430.419736:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1777051430.419736:0:27887:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d944e10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c11b6966-0775-44d2-bdc6-c74c26eb2226+49:138025:x1863365425980288:12345-192.168.201.46@tcp:101:dd.0 00010000:00010000:2.0:1777051430.420119:0:27887:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051430.420153:0:27887:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005bb71356/0x85f51a6b967163c0 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x103:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b643c expref: -99 pid: 27887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1777051430.420257:0:27887:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x103:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1777051430.420289:0:27887:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777051430.420294:0:27887:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777051430.420307:0:27887:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005bb71356/0x85f51a6b967163c0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x103:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b643c expref: 50 pid: 27887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.420334:0:27887:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005bb71356/0x85f51a6b967163c0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x103:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b643c expref: 50 pid: 27887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.420368:0:27887:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d94eccd400, rc 0) 00000100:00100000:2.0:1777051430.420465:0:27887:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d944e10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c11b6966-0775-44d2-bdc6-c74c26eb2226+50:138025:x1863365425980288:12345-192.168.201.46@tcp:101:dd.0 Request processed in 732us (967us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051430.420479:0:27887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 8006 00000100:00100000:3.0:1777051430.462038:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051430.462190:0:6583:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425980544 00000100:00100000:0.0:1777051430.462250:0:6583:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425980544 00000100:00100000:0.0:1777051430.462350:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3358 00000100:00100000:0.0:1777051430.462510:0:6583:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da6ff04050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+15:138025:x1863365425980544:12345-192.168.201.46@tcp:35:dd.0 00000100:00100000:0.0:1777051430.463009:0:6583:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da6ff04050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+16:138025:x1863365425980544:12345-192.168.201.46@tcp:35:dd.0 Request processed in 508us (981us total) trans 8589934623 rc 0/0 00000100:00100000:0.0:1777051430.463034:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3358 00000100:00100000:1.0:1777051430.524148:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051430.524643:0:46494:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425980672 00000100:00100000:0.0:1777051430.524659:0:46494:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425980672 00000100:00100000:0.0:1777051430.524749:0:46494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112069 00000100:00100000:0.0:1777051430.524770:0:46494:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d944e12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c11b6966-0775-44d2-bdc6-c74c26eb2226+16:138031:x1863365425980672:12345-192.168.201.46@tcp:101:mkdir.0 00010000:00010000:0.0:1777051430.524824:0:46494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051430.524883:0:46494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61be00/0x85f51a6b967163c7 lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6443 expref: -99 pid: 46494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.525002:0:46494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61a600/0x85f51a6b967163ce lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.525050:0:46494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61a600/0x85f51a6b967163ce lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 46494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.525072:0:46494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61a600/0x85f51a6b967163ce lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 46494 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1777051430.525134:0:46494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000bd1:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1777051430.525144:0:46494:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1777051430.525253:0:46494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61be00/0x85f51a6b967163c7 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6443 expref: 18 pid: 46494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.525288:0:46494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61a600/0x85f51a6b967163ce lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6443 expref: 17 pid: 46494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.525305:0:46494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff99d943f76100) 00010000:00010000:0.0:1777051430.525311:0:46494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1777051430.525318:0:46494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d94e61a600, rc 0) 00000100:00100000:0.0:1777051430.525409:0:46494:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d944e12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c11b6966-0775-44d2-bdc6-c74c26eb2226+17:138031:x1863365425980672:12345-192.168.201.46@tcp:101:mkdir.0 Request processed in 644us (1280us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051430.525424:0:46494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112069 00000100:00100000:1.0:1777051430.543133:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051430.543302:0:6580:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425980800 00000100:00100000:0.0:1777051430.543319:0:6580:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425980800 00000100:00100000:0.0:1777051430.543429:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112070 00000100:00100000:0.0:1777051430.543454:0:6580:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d944e13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+17:138032:x1863365425980800:12345-192.168.201.46@tcp:101:rm.0 00010000:00010000:0.0:1777051430.543485:0:6580:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051430.543546:0:6580:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61be00/0x85f51a6b967163d5 lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b644a expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.543656:0:6580:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61ba00/0x85f51a6b967163dc lrc: 3/1,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.543682:0:6580:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61ba00/0x85f51a6b967163dc lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6580 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.543703:0:6580:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61ba00/0x85f51a6b967163dc lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6580 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.543722:0:6580:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61a000/0x85f51a6b967163e3 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x999b0966 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.543731:0:6580:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61a000/0x85f51a6b967163e3 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x999b0966 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6580 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.543747:0:6580:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61a000/0x85f51a6b967163e3 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x999b0966 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6580 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.543802:0:6580:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61ba00/0x85f51a6b967163dc lrc: 4/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6580 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.543846:0:6580:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61ba00/0x85f51a6b967163dc lrc: 4/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6580 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.543859:0:6580:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61ba00/0x85f51a6b967163dc lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6580 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.543878:0:6580:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61ba00/0x85f51a6b967163dc lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6580 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.543891:0:6580:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94e61ba00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:0.0:1777051430.543899:0:6580:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61ba00/0x85f51a6b967163dc lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6580 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.543960:0:6580:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61ba00/0x85f51a6b967163dc lrc: 5/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6580 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.543982:0:6580:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff99d943f76100) 00010000:00010000:0.0:1777051430.543993:0:6580:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777051430.544001:0:6580:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61ba00/0x85f51a6b967163dc lrc: 3/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6580 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.544014:0:6580:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61ba00/0x85f51a6b967163dc lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6580 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.544043:0:6580:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61a000/0x85f51a6b967163e3 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x999b0966 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6580 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.544055:0:6580:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61a000/0x85f51a6b967163e3 lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x999b0966 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6580 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.544067:0:6580:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61a000/0x85f51a6b967163e3 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x999b0966 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6580 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.544084:0:6580:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94e61a000 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:0.0:1777051430.544091:0:6580:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61a000/0x85f51a6b967163e3 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x999b0966 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6580 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.544104:0:6580:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61a000/0x85f51a6b967163e3 lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x999b0966 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6580 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.544125:0:6580:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x999b0966 (ffff99d943f76400) 00010000:00010000:0.0:1777051430.544130:0:6580:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777051430.544136:0:6580:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61a000/0x85f51a6b967163e3 lrc: 2/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x999b0966 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6580 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.544150:0:6580:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61a000/0x85f51a6b967163e3 lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x999b0966 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6580 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.544218:0:6580:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61be00/0x85f51a6b967163d5 lrc: 1/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b644a expref: 18 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.544317:0:6580:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff99d943f76100) 00010000:00010000:0.0:1777051430.544327:0:6580:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777051430.544336:0:6580:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61be00/0x85f51a6b967163d5 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b644a expref: 18 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.544364:0:6580:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d94e61be00, rc 0) 00000100:00100000:0.0:1777051430.544471:0:6580:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d944e13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+17:138032:x1863365425980800:12345-192.168.201.46@tcp:101:rm.0 Request processed in 1024us (1354us total) trans 0 rc 301/301 00000100:00100000:0.0:1777051430.544492:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112070 00000100:00100000:3.0:1777051430.564370:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051430.564549:0:6581:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425981056 00000100:00100000:0.0:1777051430.564566:0:6581:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425981056 00000100:00100000:0.0:1777051430.564704:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112071 00000100:00100000:0.0:1777051430.564730:0:6581:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da445dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+17:138033:x1863365425981056:12345-192.168.201.46@tcp:101:dd.0 00010000:00010000:0.0:1777051430.564783:0:6581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051430.564801:0:6581:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1777051430.564846:0:6581:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61a600/0x85f51a6b967163ce lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6443 expref: 17 pid: 46494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.564891:0:6581:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff99d943f76100) 00010000:00010000:0.0:1777051430.564938:0:6581:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1777051430.564967:0:6581:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61be00/0x85f51a6b967163ea lrc: 2/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6451 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.565178:0:6581:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61a000/0x85f51a6b967163f1 lrc: 3/0,1 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.566214:0:6581:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61a000/0x85f51a6b967163f1 lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6581 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.566239:0:6581:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61a000/0x85f51a6b967163f1 lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6581 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.566275:0:6581:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61ba00/0x85f51a6b967163f8 lrc: 3/0,1 mode: --/PW res: [0x240000bd1:0x1:0x0].0x999b0966 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.566296:0:6581:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61ba00/0x85f51a6b967163f8 lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0x999b0966 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6581 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.566312:0:6581:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61ba00/0x85f51a6b967163f8 lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0x999b0966 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6581 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1777051430.567338:0:6581:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x104:0x0], index 0: 0 00010000:00010000:0.0:1777051430.567575:0:6581:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61b400/0x85f51a6b967163ff lrc: 3/1,0 mode: --/PR res: [0x240000bd2:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.567599:0:6581:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61b400/0x85f51a6b967163ff lrc: 3/1,0 mode: PR/PR res: [0x240000bd2:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6581 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.567615:0:6581:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61b400/0x85f51a6b967163ff lrc: 3/1,0 mode: PR/PR res: [0x240000bd2:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6581 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.567678:0:6581:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61a000/0x85f51a6b967163f1 lrc: 3/0,1 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6581 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.567691:0:6581:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61a000/0x85f51a6b967163f1 lrc: 2/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6581 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.567709:0:6581:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61a000/0x85f51a6b967163f1 lrc: 3/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6581 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.567722:0:6581:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94e61a000 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:0.0:1777051430.567730:0:6581:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61a000/0x85f51a6b967163f1 lrc: 3/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6581 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.567743:0:6581:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61a000/0x85f51a6b967163f1 lrc: 4/0,0 mode: CW/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6581 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.567766:0:6581:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff99d943f76400) 00010000:00010000:0.0:1777051430.567772:0:6581:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777051430.567778:0:6581:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61a000/0x85f51a6b967163f1 lrc: 2/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6581 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.567803:0:6581:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61a000/0x85f51a6b967163f1 lrc: 0/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6581 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1777051430.567823:0:6581:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000006f171d32 reply state 000000004a141916 transno 8589934624 ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61ba00/0x85f51a6b967163f8 lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x1:0x0].0x999b0966 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6581 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.567847:0:6581:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61ba00/0x85f51a6b967163f8 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x999b0966 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6581 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.567859:0:6581:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x999b0966 (ffff99d943f76600) 00010000:00010000:0.0:1777051430.567864:0:6581:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1777051430.567868:0:6581:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1777051430.568792:0:6581:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61be00/0x85f51a6b967163ea lrc: 0/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6451 expref: 19 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.568837:0:6581:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61b400/0x85f51a6b967163ff lrc: 3/0,0 mode: PR/PR res: [0x240000bd2:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6451 expref: 18 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.568852:0:6581:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x3:0x0].0x0 (ffff99d943f76f00) 00010000:00010000:0.0:1777051430.568857:0:6581:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1777051430.568861:0:6581:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d94e61b400, rc 0) 00000100:00100000:0.0:1777051430.569521:0:6581:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da445dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+19:138033:x1863365425981056:12345-192.168.201.46@tcp:101:dd.0 Request processed in 4793us (5160us total) trans 8589934624 rc 0/0 00000100:00100000:0.0:1777051430.569538:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112071 00000100:00100000:1.0:1777051430.631655:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051430.631818:0:8468:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425981184 00000100:00100000:3.0:1777051430.631841:0:8468:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425981184 00000100:00100000:3.0:1777051430.631974:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 8007 00000100:00100000:3.0:1777051430.632035:0:8468:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d944e10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+52:138033:x1863365425981184:12345-192.168.201.46@tcp:101:dd.0 00010000:00010000:3.0:1777051430.632066:0:8468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777051430.632108:0:8468:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a997f2b/0x85f51a6b9671640d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x104:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6458 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1777051430.632161:0:8468:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x104:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777051430.632199:0:8468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051430.632204:0:8468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051430.632262:0:8468:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009a997f2b/0x85f51a6b9671640d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x104:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6458 expref: 53 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051430.632299:0:8468:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009a997f2b/0x85f51a6b9671640d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x104:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6458 expref: 53 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051430.632329:0:8468:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d9559a2000, rc 0) 00000100:00100000:3.0:1777051430.632471:0:8468:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d944e10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+53:138033:x1863365425981184:12345-192.168.201.46@tcp:101:dd.0 Request processed in 480us (825us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051430.632492:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 8007 00000100:00100000:1.0:1777051430.689844:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051430.690005:0:6582:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425981440 00000100:00100000:3.0:1777051430.690024:0:6582:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425981440 00000100:00100000:3.0:1777051430.690124:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3359 00000100:00100000:3.0:1777051430.690145:0:6582:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d944e11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+19:138033:x1863365425981440:12345-192.168.201.46@tcp:35:dd.0 00000100:00100000:3.0:1777051430.690689:0:6582:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d944e11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+20:138033:x1863365425981440:12345-192.168.201.46@tcp:35:dd.0 Request processed in 545us (1669us total) trans 8589934625 rc 0/0 00000100:00100000:3.0:1777051430.691058:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3359 00000100:00100000:0.0:1777051430.776996:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051430.777122:0:21368:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425981568 00000100:00100000:2.0:1777051430.777138:0:21368:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425981568 00000100:00100000:2.0:1777051430.777605:0:21368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112072 00000100:00100000:2.0:1777051430.777625:0:21368:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d944d2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+20:138039:x1863365425981568:12345-192.168.201.46@tcp:101:mkdir.0 00010000:00010000:2.0:1777051430.777660:0:21368:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051430.777693:0:21368:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d94eccda00/0x85f51a6b96716414 lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b645f expref: -99 pid: 21368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.777779:0:21368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94eccc800/0x85f51a6b9671641b lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.777801:0:21368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d94eccc800/0x85f51a6b9671641b lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21368 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.777839:0:21368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d94eccc800/0x85f51a6b9671641b lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21368 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1777051430.777895:0:21368:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000bd1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1777051430.777936:0:21368:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:2.0:1777051430.777999:0:21368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d94eccda00/0x85f51a6b96716414 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b645f expref: 22 pid: 21368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.778031:0:21368:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94eccc800/0x85f51a6b9671641b lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b645f expref: 21 pid: 21368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.778047:0:21368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff99d9413d0300) 00010000:00010000:2.0:1777051430.778053:0:21368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1777051430.778058:0:21368:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d94eccc800, rc 0) 00000100:00100000:2.0:1777051430.778150:0:21368:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d944d2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+21:138039:x1863365425981568:12345-192.168.201.46@tcp:101:mkdir.0 Request processed in 529us (1163us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051430.778160:0:21368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112072 00000100:00100000:1.0:1777051430.792936:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051430.793104:0:6579:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425981696 00000100:00100000:2.0:1777051430.793118:0:6579:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425981696 00000100:00100000:2.0:1777051430.793361:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112073 00000100:00100000:2.0:1777051430.793380:0:6579:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d944e11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+26:138040:x1863365425981696:12345-192.168.201.46@tcp:101:rm.0 00010000:00010000:2.0:1777051430.793410:0:6579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051430.793440:0:6579:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eccda00/0x85f51a6b96716422 lrc: 2/0,0 mode: --/CR res: [0x2000032e0:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6466 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.793555:0:6579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eccc000/0x85f51a6b96716429 lrc: 3/1,0 mode: --/CR res: [0x2000032e0:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.793586:0:6579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eccc000/0x85f51a6b96716429 lrc: 3/1,0 mode: CR/CR res: [0x2000032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.793605:0:6579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eccc000/0x85f51a6b96716429 lrc: 3/1,0 mode: CR/CR res: [0x2000032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.793631:0:6579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eccc200/0x85f51a6b96716430 lrc: 3/1,0 mode: --/PR res: [0x2000032e0:0x1:0x0].0xab04085a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.793645:0:6579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eccc200/0x85f51a6b96716430 lrc: 3/1,0 mode: PR/PR res: [0x2000032e0:0x1:0x0].0xab04085a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.793657:0:6579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eccc200/0x85f51a6b96716430 lrc: 3/1,0 mode: PR/PR res: [0x2000032e0:0x1:0x0].0xab04085a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.793743:0:6579:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eccc000/0x85f51a6b96716429 lrc: 4/1,0 mode: CR/CR res: [0x2000032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.793759:0:6579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eccc000/0x85f51a6b96716429 lrc: 4/1,0 mode: CR/CR res: [0x2000032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.793766:0:6579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eccc000/0x85f51a6b96716429 lrc: 3/0,0 mode: CR/CR res: [0x2000032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.793773:0:6579:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eccc000/0x85f51a6b96716429 lrc: 4/0,0 mode: CR/CR res: [0x2000032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.793780:0:6579:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94eccc000 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:2.0:1777051430.793785:0:6579:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eccc000/0x85f51a6b96716429 lrc: 4/0,0 mode: CR/CR res: [0x2000032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.793798:0:6579:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eccc000/0x85f51a6b96716429 lrc: 5/0,0 mode: CR/CR res: [0x2000032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.793817:0:6579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e0:0x1:0x0].0x0 (ffff99d943f76200) 00010000:00010000:2.0:1777051430.793822:0:6579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777051430.793830:0:6579:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eccc000/0x85f51a6b96716429 lrc: 3/0,0 mode: --/CR res: [0x2000032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.793840:0:6579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eccc000/0x85f51a6b96716429 lrc: 0/0,0 mode: --/CR res: [0x2000032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.793863:0:6579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eccc200/0x85f51a6b96716430 lrc: 3/1,0 mode: PR/PR res: [0x2000032e0:0x1:0x0].0xab04085a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.793873:0:6579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eccc200/0x85f51a6b96716430 lrc: 2/0,0 mode: PR/PR res: [0x2000032e0:0x1:0x0].0xab04085a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.794065:0:6579:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eccc200/0x85f51a6b96716430 lrc: 3/0,0 mode: PR/PR res: [0x2000032e0:0x1:0x0].0xab04085a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.794076:0:6579:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94eccc200 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:2.0:1777051430.794082:0:6579:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eccc200/0x85f51a6b96716430 lrc: 3/0,0 mode: PR/PR res: [0x2000032e0:0x1:0x0].0xab04085a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.794092:0:6579:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eccc200/0x85f51a6b96716430 lrc: 4/0,0 mode: PR/PR res: [0x2000032e0:0x1:0x0].0xab04085a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.794106:0:6579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e0:0x1:0x0].0xab04085a (ffff99d9413d0f00) 00010000:00010000:2.0:1777051430.794111:0:6579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777051430.794116:0:6579:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eccc200/0x85f51a6b96716430 lrc: 2/0,0 mode: --/PR res: [0x2000032e0:0x1:0x0].0xab04085a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.794126:0:6579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eccc200/0x85f51a6b96716430 lrc: 0/0,0 mode: --/PR res: [0x2000032e0:0x1:0x0].0xab04085a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.794176:0:6579:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eccda00/0x85f51a6b96716422 lrc: 1/0,0 mode: --/CR res: [0x2000032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6466 expref: 27 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.794220:0:6579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e0:0x1:0x0].0x0 (ffff99d943f76200) 00010000:00010000:2.0:1777051430.794225:0:6579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777051430.794232:0:6579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eccda00/0x85f51a6b96716422 lrc: 0/0,0 mode: --/CR res: [0x2000032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6466 expref: 27 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.794248:0:6579:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d94eccda00, rc 0) 00000100:00100000:2.0:1777051430.794342:0:6579:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d944e11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+26:138040:x1863365425981696:12345-192.168.201.46@tcp:101:rm.0 Request processed in 964us (1438us total) trans 0 rc 301/301 00000100:00100000:2.0:1777051430.794355:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112073 00000100:00100000:1.0:1777051430.808960:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051430.809674:0:27885:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425981952 00000100:00100000:2.0:1777051430.809689:0:27885:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425981952 00000100:00100000:2.0:1777051430.811230:0:27885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112074 00000100:00100000:2.0:1777051430.811251:0:27885:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d944e13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c11b6966-0775-44d2-bdc6-c74c26eb2226+26:138041:x1863365425981952:12345-192.168.201.46@tcp:101:dd.0 00010000:00010000:2.0:1777051430.811278:0:27885:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051430.811303:0:27885:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1777051430.811346:0:27885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e61a200/0x85f51a6b9671630a lrc: 0/0,0 mode: --/PR res: [0x2000032e0:0x1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b63fd expref: 26 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.811378:0:27885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e0:0x1:0x0].0x0 (ffff99d943f76200) 00010000:00010000:2.0:1777051430.811387:0:27885:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1777051430.811407:0:27885:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eccda00/0x85f51a6b96716437 lrc: 2/0,0 mode: --/CW res: [0x2000032e0:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b646d expref: -99 pid: 27885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.811528:0:27885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eccc200/0x85f51a6b9671643e lrc: 3/0,1 mode: --/CW res: [0x2000032e0:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.811550:0:27885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eccc200/0x85f51a6b9671643e lrc: 3/0,1 mode: CW/CW res: [0x2000032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.811567:0:27885:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eccc200/0x85f51a6b9671643e lrc: 3/0,1 mode: CW/CW res: [0x2000032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.811589:0:27885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eccc000/0x85f51a6b96716445 lrc: 3/0,1 mode: --/PW res: [0x2000032e0:0x1:0x0].0xab04085a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.811601:0:27885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eccc000/0x85f51a6b96716445 lrc: 3/0,1 mode: PW/PW res: [0x2000032e0:0x1:0x0].0xab04085a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.811612:0:27885:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eccc000/0x85f51a6b96716445 lrc: 3/0,1 mode: PW/PW res: [0x2000032e0:0x1:0x0].0xab04085a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1777051430.812079:0:27885:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x1e4:0x0], index 0: 0 00010000:00010000:2.0:1777051430.812339:0:27885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eccc400/0x85f51a6b9671644c lrc: 3/1,0 mode: --/PR res: [0x2000032e3:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.812358:0:27885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eccc400/0x85f51a6b9671644c lrc: 3/1,0 mode: PR/PR res: [0x2000032e3:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.812374:0:27885:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eccc400/0x85f51a6b9671644c lrc: 3/1,0 mode: PR/PR res: [0x2000032e3:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.812420:0:27885:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eccc200/0x85f51a6b9671643e lrc: 4/0,1 mode: CW/CW res: [0x2000032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.812433:0:27885:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eccc200/0x85f51a6b9671643e lrc: 4/0,1 mode: CW/CW res: [0x2000032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.812443:0:27885:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eccc200/0x85f51a6b9671643e lrc: 3/0,0 mode: CW/CW res: [0x2000032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.812454:0:27885:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eccc200/0x85f51a6b9671643e lrc: 4/0,0 mode: CW/CW res: [0x2000032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.812464:0:27885:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94eccc200 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:2.0:1777051430.812471:0:27885:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eccc200/0x85f51a6b9671643e lrc: 4/0,0 mode: CW/CW res: [0x2000032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.812484:0:27885:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eccc200/0x85f51a6b9671643e lrc: 5/0,0 mode: CW/CW res: [0x2000032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.812498:0:27885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e0:0x1:0x0].0x0 (ffff99d943f76200) 00010000:00010000:2.0:1777051430.812503:0:27885:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777051430.812510:0:27885:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eccc200/0x85f51a6b9671643e lrc: 3/0,0 mode: --/CW res: [0x2000032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.812522:0:27885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eccc200/0x85f51a6b9671643e lrc: 0/0,0 mode: --/CW res: [0x2000032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1777051430.812542:0:27885:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000008cb56ba5 reply state 000000005ba35e7d transno 30064771157 ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eccc000/0x85f51a6b96716445 lrc: 3/0,1 mode: PW/PW res: [0x2000032e0:0x1:0x0].0xab04085a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.812559:0:27885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eccc000/0x85f51a6b96716445 lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e0:0x1:0x0].0xab04085a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.812571:0:27885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e0:0x1:0x0].0xab04085a (ffff99d9413d0f00) 00010000:00010000:2.0:1777051430.812575:0:27885:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1777051430.812580:0:27885:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1777051430.812613:0:27885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eccda00/0x85f51a6b96716437 lrc: 0/0,0 mode: --/CW res: [0x2000032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b646d expref: 28 pid: 27885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.812629:0:27885:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eccc400/0x85f51a6b9671644c lrc: 3/0,0 mode: PR/PR res: [0x2000032e3:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b646d expref: 27 pid: 27885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.812638:0:27885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e3:0x6:0x0].0x0 (ffff99d9413d0c00) 00010000:00010000:2.0:1777051430.812640:0:27885:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1777051430.812643:0:27885:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d94eccc400, rc 0) 00000100:00100000:2.0:1777051430.813034:0:27885:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d944e13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c11b6966-0775-44d2-bdc6-c74c26eb2226+28:138041:x1863365425981952:12345-192.168.201.46@tcp:101:dd.0 Request processed in 1787us (4082us total) trans 30064771157 rc 0/0 00000100:00100000:2.0:1777051430.813048:0:27885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112074 00000100:00100000:3.0:1777051430.846022:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051430.846165:0:24468:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425982080 00000100:00100000:1.0:1777051430.846180:0:24468:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425982080 00000100:00100000:1.0:1777051430.846319:0:24468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 8008 00000100:00100000:1.0:1777051430.846337:0:24468:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da445dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+53:138041:x1863365425982080:12345-192.168.201.46@tcp:101:dd.0 00010000:00010000:1.0:1777051430.846364:0:24468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777051430.846393:0:24468:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c82c3fc4/0x85f51a6b9671645a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1e4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6474 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1777051430.846431:0:24468:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x1e4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777051430.846460:0:24468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051430.846464:0:24468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051430.846477:0:24468:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c82c3fc4/0x85f51a6b9671645a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6474 expref: 54 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051430.846526:0:24468:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c82c3fc4/0x85f51a6b9671645a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6474 expref: 54 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051430.846549:0:24468:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d94e48ac00, rc 0) 00000100:00100000:1.0:1777051430.846641:0:24468:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da445dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+54:138041:x1863365425982080:12345-192.168.201.46@tcp:101:dd.0 Request processed in 307us (631us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051430.846655:0:24468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 8008 00000100:00100000:1.0:1777051430.873767:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051430.874532:0:24269:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425982336 00000100:00100000:2.0:1777051430.874548:0:24269:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425982336 00000100:00100000:2.0:1777051430.874644:0:24269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3360 00000100:00100000:2.0:1777051430.874663:0:24269:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d944e11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+28:138041:x1863365425982336:12345-192.168.201.46@tcp:35:dd.0 00000100:00100000:2.0:1777051430.875677:0:24269:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d944e11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+29:138041:x1863365425982336:12345-192.168.201.46@tcp:35:dd.0 Request processed in 1016us (1919us total) trans 30064771158 rc 0/0 00000100:00100000:2.0:1777051430.875693:0:24269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3360 00000100:00100000:2.0:1777051430.919089:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051430.919234:0:8492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425982464 00000100:00100000:1.0:1777051430.919249:0:8492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425982464 00000100:00100000:1.0:1777051430.919318:0:8492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112075 00000100:00100000:1.0:1777051430.919330:0:8492:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+40:138044:x1863365425982464:12345-192.168.201.46@tcp:101:lfs.0 00010000:00010000:1.0:1777051430.919361:0:8492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777051430.919388:0:8492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48a000/0x85f51a6b96716461 lrc: 2/0,0 mode: --/CR res: [0x2000032e2:0x5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b647b expref: -99 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051430.919487:0:8492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48a600/0x85f51a6b96716468 lrc: 3/1,0 mode: --/CR res: [0x2000032e2:0x5:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051430.919508:0:8492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48a600/0x85f51a6b96716468 lrc: 3/1,0 mode: CR/CR res: [0x2000032e2:0x5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051430.919525:0:8492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48a600/0x85f51a6b96716468 lrc: 3/1,0 mode: CR/CR res: [0x2000032e2:0x5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051430.919541:0:8492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48aa00/0x85f51a6b9671646f lrc: 3/1,0 mode: --/PR res: [0x2000032e2:0x5:0x0].0xd1d4b922 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051430.919553:0:8492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48aa00/0x85f51a6b9671646f lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0x5:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051430.919565:0:8492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48aa00/0x85f51a6b9671646f lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0x5:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051430.919650:0:8492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48be00/0x85f51a6b96716476 lrc: 3/1,0 mode: --/PR res: [0x2000032e2:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051430.919660:0:8492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48be00/0x85f51a6b96716476 lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0x6:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051430.919667:0:8492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48be00/0x85f51a6b96716476 lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0x6:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1777051430.919744:0:8492:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000032e2:0x6:0x0]: returning size 4096 00000004:00200000:1.0:1777051430.919749:0:8492:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:1.0:1777051430.919769:0:8492:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48be00/0x85f51a6b96716476 lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0x6:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051430.919787:0:8492:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48a600/0x85f51a6b96716468 lrc: 4/1,0 mode: CR/CR res: [0x2000032e2:0x5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051430.919794:0:8492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48a600/0x85f51a6b96716468 lrc: 4/1,0 mode: CR/CR res: [0x2000032e2:0x5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051430.919801:0:8492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48a600/0x85f51a6b96716468 lrc: 3/0,0 mode: CR/CR res: [0x2000032e2:0x5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051430.919807:0:8492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48a600/0x85f51a6b96716468 lrc: 4/0,0 mode: CR/CR res: [0x2000032e2:0x5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051430.919813:0:8492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94e48a600 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:1.0:1777051430.919818:0:8492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48a600/0x85f51a6b96716468 lrc: 4/0,0 mode: CR/CR res: [0x2000032e2:0x5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051430.919825:0:8492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48a600/0x85f51a6b96716468 lrc: 5/0,0 mode: CR/CR res: [0x2000032e2:0x5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051430.919837:0:8492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0x5:0x0].0x0 (ffff99d9413d0100) 00010000:00010000:1.0:1777051430.919840:0:8492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777051430.919845:0:8492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48a600/0x85f51a6b96716468 lrc: 3/0,0 mode: --/CR res: [0x2000032e2:0x5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051430.919851:0:8492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48a600/0x85f51a6b96716468 lrc: 0/0,0 mode: --/CR res: [0x2000032e2:0x5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051430.919863:0:8492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48aa00/0x85f51a6b9671646f lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0x5:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051430.919870:0:8492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48aa00/0x85f51a6b9671646f lrc: 2/0,0 mode: PR/PR res: [0x2000032e2:0x5:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051430.919879:0:8492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48aa00/0x85f51a6b9671646f lrc: 3/0,0 mode: PR/PR res: [0x2000032e2:0x5:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051430.919887:0:8492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94e48aa00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:1.0:1777051430.919892:0:8492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48aa00/0x85f51a6b9671646f lrc: 3/0,0 mode: PR/PR res: [0x2000032e2:0x5:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051430.919929:0:8492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48aa00/0x85f51a6b9671646f lrc: 4/0,0 mode: PR/PR res: [0x2000032e2:0x5:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051430.919944:0:8492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0x5:0x0].0xd1d4b922 (ffff99d9413d0500) 00010000:00010000:1.0:1777051430.919948:0:8492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777051430.919953:0:8492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48aa00/0x85f51a6b9671646f lrc: 2/0,0 mode: --/PR res: [0x2000032e2:0x5:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051430.919963:0:8492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48aa00/0x85f51a6b9671646f lrc: 0/0,0 mode: --/PR res: [0x2000032e2:0x5:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051430.920004:0:8492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48a000/0x85f51a6b96716461 lrc: 0/0,0 mode: --/CR res: [0x2000032e2:0x5:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b647b expref: 42 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051430.920027:0:8492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48be00/0x85f51a6b96716476 lrc: 3/0,0 mode: PR/PR res: [0x2000032e2:0x6:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b647b expref: 41 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051430.920040:0:8492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0x6:0x0].0x0 (ffff99d943f76700) 00010000:00010000:1.0:1777051430.920044:0:8492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1777051430.920049:0:8492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d94e48be00, rc 0) 00000100:00100000:1.0:1777051430.920133:0:8492:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+41:138044:x1863365425982464:12345-192.168.201.46@tcp:101:lfs.0 Request processed in 803us (1053us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051430.920153:0:8492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112075 00000100:00100000:0.0:1777051430.925429:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051430.925477:0:46497:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425982592 00000100:00100000:2.0:1777051430.925487:0:46497:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425982592 00000100:00100000:2.0:1777051430.925566:0:46497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112076 00000100:00100000:2.0:1777051430.925581:0:46497:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d944d2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+41:138044:x1863365425982592:12345-192.168.201.46@tcp:101:lfs.0 00010000:00010000:2.0:1777051430.925599:0:46497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051430.925618:0:46497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eccc200/0x85f51a6b9671647d lrc: 2/0,0 mode: --/CR res: [0x2000032e0:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6482 expref: -99 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.925669:0:46497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eccca00/0x85f51a6b96716484 lrc: 3/1,0 mode: --/PR res: [0x2000032e0:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.925685:0:46497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eccca00/0x85f51a6b96716484 lrc: 3/1,0 mode: PR/PR res: [0x2000032e0:0x1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.925700:0:46497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eccca00/0x85f51a6b96716484 lrc: 3/1,0 mode: PR/PR res: [0x2000032e0:0x1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1777051430.925738:0:46497:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000032e0:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1777051430.925744:0:46497:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:2.0:1777051430.925780:0:46497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eccc200/0x85f51a6b9671647d lrc: 0/0,0 mode: --/CR res: [0x2000032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6482 expref: 43 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.925802:0:46497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eccca00/0x85f51a6b96716484 lrc: 3/0,0 mode: PR/PR res: [0x2000032e0:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6482 expref: 42 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.925823:0:46497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e0:0x1:0x0].0x0 (ffff99d943f76200) 00010000:00010000:2.0:1777051430.925827:0:46497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1777051430.925831:0:46497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d94eccca00, rc 0) 00000100:00100000:2.0:1777051430.925892:0:46497:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d944d2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+42:138044:x1863365425982592:12345-192.168.201.46@tcp:101:lfs.0 Request processed in 314us (466us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051430.925937:0:46497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112076 00000100:00100000:3.0:1777051430.927704:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051430.927796:0:27882:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425982720 00000100:00100000:0.0:1777051430.927805:0:27882:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425982720 00000100:00100000:0.0:1777051430.927886:0:27882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112077 00000100:00080000:1.0:1777051430.927891:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1777051430.927929:0:27882:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da445dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+48:138044:x1863365425982720:12345-192.168.201.46@tcp:101:lfs.0 00010000:00010000:0.0:1777051430.927947:0:27882:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051430.927968:0:27882:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61a000/0x85f51a6b9671648b lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6489 expref: -99 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.928021:0:27882:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61a600/0x85f51a6b96716492 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.928036:0:27882:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61a600/0x85f51a6b96716492 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 27882 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.928053:0:27882:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61a600/0x85f51a6b96716492 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 27882 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1777051430.928092:0:27882:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000bd1:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1777051430.928098:0:27882:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1777051430.928137:0:27882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61a000/0x85f51a6b9671648b lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6489 expref: 50 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.928161:0:27882:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61a600/0x85f51a6b96716492 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6489 expref: 49 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.928174:0:27882:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff99d9413d0300) 00010000:00010000:0.0:1777051430.928179:0:27882:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1777051430.928183:0:27882:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d94e61a600, rc 0) 00000100:00100000:0.0:1777051430.928284:0:27882:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da445dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+49:138044:x1863365425982720:12345-192.168.201.46@tcp:101:lfs.0 Request processed in 384us (579us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051430.928307:0:27882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112077 00000100:00100000:1.0:1777051430.931726:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051430.931817:0:10328:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425982976 00000100:00100000:0.0:1777051430.931825:0:10328:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425982976 00000100:00100000:0.0:1777051430.931874:0:10328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112078 00000100:00100000:0.0:1777051430.931889:0:10328:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d944e13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+49:138044:x1863365425982976:12345-192.168.201.46@tcp:101:lfs.0 00010000:00010000:0.0:1777051430.931936:0:10328:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051430.931957:0:10328:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61b600/0x85f51a6b96716499 lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6490 expref: -99 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.932034:0:10328:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61a200/0x85f51a6b967164a0 lrc: 3/1,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.932052:0:10328:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61a200/0x85f51a6b967164a0 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10328 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.932065:0:10328:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61a200/0x85f51a6b967164a0 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10328 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.932082:0:10328:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61be00/0x85f51a6b967164a7 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0xa30099d5 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.932093:0:10328:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61be00/0x85f51a6b967164a7 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xa30099d5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10328 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.932104:0:10328:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61be00/0x85f51a6b967164a7 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xa30099d5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10328 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.932180:0:10328:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61a200/0x85f51a6b967164a0 lrc: 4/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10328 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.932192:0:10328:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61a200/0x85f51a6b967164a0 lrc: 4/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10328 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.932209:0:10328:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61a200/0x85f51a6b967164a0 lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10328 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.932219:0:10328:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61a200/0x85f51a6b967164a0 lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10328 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.932229:0:10328:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94e61a200 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:0.0:1777051430.932235:0:10328:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61a200/0x85f51a6b967164a0 lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10328 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.932243:0:10328:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61a200/0x85f51a6b967164a0 lrc: 5/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10328 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.932257:0:10328:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff99d9413d0300) 00010000:00010000:0.0:1777051430.932262:0:10328:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777051430.932268:0:10328:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61a200/0x85f51a6b967164a0 lrc: 3/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10328 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.932289:0:10328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61a200/0x85f51a6b967164a0 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10328 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.932307:0:10328:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61be00/0x85f51a6b967164a7 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xa30099d5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10328 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.932318:0:10328:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61be00/0x85f51a6b967164a7 lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xa30099d5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10328 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.932329:0:10328:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61be00/0x85f51a6b967164a7 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xa30099d5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10328 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.932337:0:10328:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94e61be00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:0.0:1777051430.932343:0:10328:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61be00/0x85f51a6b967164a7 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xa30099d5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10328 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.932353:0:10328:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61be00/0x85f51a6b967164a7 lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xa30099d5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10328 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.932365:0:10328:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0xa30099d5 (ffff99d943f76800) 00010000:00010000:0.0:1777051430.932370:0:10328:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777051430.932375:0:10328:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61be00/0x85f51a6b967164a7 lrc: 2/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0xa30099d5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10328 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.932385:0:10328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61be00/0x85f51a6b967164a7 lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0xa30099d5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10328 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.932454:0:10328:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61b600/0x85f51a6b96716499 lrc: 1/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6490 expref: 50 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.932471:0:10328:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff99d9413d0300) 00010000:00010000:0.0:1777051430.932475:0:10328:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1777051430.932482:0:10328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61b600/0x85f51a6b96716499 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6490 expref: 50 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.932497:0:10328:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d94e61b600, rc 0) 00000100:00100000:0.0:1777051430.932560:0:10328:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d944e13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+49:138044:x1863365425982976:12345-192.168.201.46@tcp:101:lfs.0 Request processed in 672us (837us total) trans 0 rc 301/301 00000100:00100000:0.0:1777051430.932572:0:10328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112078 00000100:00100000:3.0:1777051430.936311:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051430.936449:0:46494:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425983232 00000100:00100000:0.0:1777051430.936458:0:46494:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425983232 00000100:00100000:0.0:1777051430.936532:0:46494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112079 00000100:00100000:0.0:1777051430.936546:0:46494:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da445dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+42:138044:x1863365425983232:12345-192.168.201.46@tcp:101:lfs.0 00010000:00010000:0.0:1777051430.936566:0:46494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051430.936591:0:46494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b800/0x85f51a6b967164ae lrc: 2/0,0 mode: --/CR res: [0x2000032e2:0x5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6497 expref: -99 pid: 46494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1777051430.937157:0:46494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000032e2:0x6:0x0]: returning size 4096 00010000:00010000:0.0:1777051430.937290:0:46494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b800/0x85f51a6b967164ae lrc: 1/0,0 mode: --/CR res: [0x2000032e2:0x5:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6497 expref: 44 pid: 46494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.937311:0:46494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0x5:0x0].0x0 (ffff99d9413d0100) 00010000:00010000:0.0:1777051430.937352:0:46494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1777051430.937362:0:46494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b800/0x85f51a6b967164ae lrc: 0/0,0 mode: --/CR res: [0x2000032e2:0x5:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6497 expref: 44 pid: 46494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.937382:0:46494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d94eb2b800, rc 0) 00000100:00100000:0.0:1777051430.937447:0:46494:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da445dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+43:138044:x1863365425983232:12345-192.168.201.46@tcp:101:lfs.0 Request processed in 903us (1158us total) trans 30064771159 rc 301/301 00000100:00100000:0.0:1777051430.937459:0:46494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112079 00000100:00100000:3.0:1777051430.942156:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051430.942296:0:6580:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425983488 00000100:00100000:0.0:1777051430.942305:0:6580:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425983488 00000100:00100000:0.0:1777051430.942364:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112080 00000100:00100000:0.0:1777051430.942375:0:6580:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da445de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+49:138044:x1863365425983488:12345-192.168.201.46@tcp:101:lfs.0 00010000:00010000:0.0:1777051430.942394:0:6580:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051430.942410:0:6580:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d94eb2be00/0x85f51a6b967164bc lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b649e expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.942462:0:6580:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94eb2bc00/0x85f51a6b967164c3 lrc: 3/1,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.942481:0:6580:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d94eb2bc00/0x85f51a6b967164c3 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6580 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.942492:0:6580:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d94eb2bc00/0x85f51a6b967164c3 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6580 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.942501:0:6580:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94eb2b600/0x85f51a6b967164ca lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0xa30099d5 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.942508:0:6580:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d94eb2b600/0x85f51a6b967164ca lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xa30099d5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6580 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.942514:0:6580:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d94eb2b600/0x85f51a6b967164ca lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xa30099d5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6580 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.942603:0:6580:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94eb2ac00/0x85f51a6b967164d1 lrc: 3/1,0 mode: --/PR res: [0x240000bd2:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.942617:0:6580:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d94eb2ac00/0x85f51a6b967164d1 lrc: 3/1,0 mode: PR/PR res: [0x240000bd2:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6580 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.942629:0:6580:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d94eb2ac00/0x85f51a6b967164d1 lrc: 3/1,0 mode: PR/PR res: [0x240000bd2:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6580 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1777051430.942640:0:6580:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000bd2:0x1:0x0]: returning size 1048576 00010000:00010000:0.0:1777051430.942717:0:6580:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94eb2bc00/0x85f51a6b967164c3 lrc: 4/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6580 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.942726:0:6580:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94eb2bc00/0x85f51a6b967164c3 lrc: 4/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6580 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.942732:0:6580:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d94eb2bc00/0x85f51a6b967164c3 lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6580 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.942739:0:6580:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99d94eb2bc00/0x85f51a6b967164c3 lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6580 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.943019:0:6580:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94eb2bc00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:0.0:1777051430.943025:0:6580:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d94eb2bc00/0x85f51a6b967164c3 lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6580 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.943037:0:6580:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d94eb2bc00/0x85f51a6b967164c3 lrc: 5/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6580 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.943052:0:6580:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff99d9413d0300) 00010000:00010000:0.0:1777051430.943057:0:6580:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777051430.943062:0:6580:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99d94eb2bc00/0x85f51a6b967164c3 lrc: 3/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6580 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.943071:0:6580:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d94eb2bc00/0x85f51a6b967164c3 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6580 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.943086:0:6580:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94eb2b600/0x85f51a6b967164ca lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xa30099d5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6580 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.943095:0:6580:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d94eb2b600/0x85f51a6b967164ca lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xa30099d5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6580 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.943104:0:6580:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99d94eb2b600/0x85f51a6b967164ca lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xa30099d5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6580 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.943112:0:6580:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94eb2b600 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:0.0:1777051430.943117:0:6580:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d94eb2b600/0x85f51a6b967164ca lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xa30099d5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6580 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.943131:0:6580:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d94eb2b600/0x85f51a6b967164ca lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xa30099d5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6580 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.943143:0:6580:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0xa30099d5 (ffff99d943f76800) 00010000:00010000:0.0:1777051430.943146:0:6580:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777051430.943151:0:6580:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99d94eb2b600/0x85f51a6b967164ca lrc: 2/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0xa30099d5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6580 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.943426:0:6580:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d94eb2b600/0x85f51a6b967164ca lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0xa30099d5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6580 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.943474:0:6580:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d94eb2be00/0x85f51a6b967164bc lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b649e expref: 52 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.943495:0:6580:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94eb2ac00/0x85f51a6b967164d1 lrc: 3/0,0 mode: PR/PR res: [0x240000bd2:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b649e expref: 51 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.943507:0:6580:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x1:0x0].0x0 (ffff99d943f76b00) 00010000:00010000:0.0:1777051430.943511:0:6580:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1777051430.943514:0:6580:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d94eb2ac00, rc 0) 00000100:00100000:0.0:1777051430.943581:0:6580:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da445de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+51:138044:x1863365425983488:12345-192.168.201.46@tcp:101:lfs.0 Request processed in 1207us (1428us total) trans 8589934626 rc 0/0 00000100:00100000:0.0:1777051430.943593:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112080 00000100:00100000:1.0:1777051430.946891:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051430.947054:0:46501:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425983744 00000100:00100000:3.0:1777051430.947065:0:46501:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425983744 00000100:00100000:3.0:1777051430.947414:0:46501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3361 00000100:00100000:3.0:1777051430.947432:0:46501:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d944e10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+51:138044:x1863365425983744:12345-192.168.201.46@tcp:35:lfs.0 00000100:00100000:3.0:1777051430.947639:0:46501:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d944e10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+52:138044:x1863365425983744:12345-192.168.201.46@tcp:35:lfs.0 Request processed in 211us (767us total) trans 8589934627 rc 0/0 00000100:00100000:3.0:1777051430.947653:0:46501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3361 00000100:00100000:3.0:1777051430.950670:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051430.950738:0:6583:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425984000 00000100:00100000:0.0:1777051430.950745:0:6583:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425984000 00000100:00100000:0.0:1777051430.950789:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3362 00000100:00100000:0.0:1777051430.950811:0:6583:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da445de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+43:138044:x1863365425984000:12345-192.168.201.46@tcp:35:lfs.0 00000100:00100000:0.0:1777051430.951040:0:6583:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da445de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+44:138044:x1863365425984000:12345-192.168.201.46@tcp:35:lfs.0 Request processed in 226us (370us total) trans 30064771160 rc 0/0 00000100:00100000:0.0:1777051430.951053:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3362 00000100:00100000:1.0:1777051430.966396:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051430.966726:0:6581:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425984256 00000100:00100000:0.0:1777051430.966741:0:6581:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425984256 00000100:00100000:0.0:1777051430.967141:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112081 00000100:00100000:0.0:1777051430.967159:0:6581:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d944e10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+52:138045:x1863365425984256:12345-192.168.201.46@tcp:101:lfs.0 00010000:00010000:0.0:1777051430.967481:0:6581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051430.967510:0:6581:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d94eb2be00/0x85f51a6b967164df lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b64a5 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.967605:0:6581:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94eb2b600/0x85f51a6b967164e6 lrc: 3/1,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.967628:0:6581:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d94eb2b600/0x85f51a6b967164e6 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6581 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.967644:0:6581:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d94eb2b600/0x85f51a6b967164e6 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6581 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.967661:0:6581:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94eb2bc00/0x85f51a6b967164ed lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x50a12932 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.967674:0:6581:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d94eb2bc00/0x85f51a6b967164ed lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x50a12932 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6581 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.967686:0:6581:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d94eb2bc00/0x85f51a6b967164ed lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x50a12932 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6581 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.967775:0:6581:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94eb2b600/0x85f51a6b967164e6 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6581 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.967789:0:6581:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d94eb2b600/0x85f51a6b967164e6 lrc: 2/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6581 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.967800:0:6581:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99d94eb2b600/0x85f51a6b967164e6 lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6581 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.967810:0:6581:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94eb2b600 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:0.0:1777051430.967817:0:6581:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d94eb2b600/0x85f51a6b967164e6 lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6581 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.967828:0:6581:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d94eb2b600/0x85f51a6b967164e6 lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6581 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.967845:0:6581:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff99d9413d0300) 00010000:00010000:0.0:1777051430.967850:0:6581:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777051430.967858:0:6581:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99d94eb2b600/0x85f51a6b967164e6 lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6581 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.967868:0:6581:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d94eb2b600/0x85f51a6b967164e6 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6581 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.967889:0:6581:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94eb2bc00/0x85f51a6b967164ed lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x50a12932 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6581 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.967899:0:6581:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d94eb2bc00/0x85f51a6b967164ed lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x50a12932 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6581 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.967944:0:6581:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99d94eb2bc00/0x85f51a6b967164ed lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x50a12932 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6581 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.967952:0:6581:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94eb2bc00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:0.0:1777051430.967958:0:6581:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d94eb2bc00/0x85f51a6b967164ed lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x50a12932 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6581 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.967968:0:6581:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d94eb2bc00/0x85f51a6b967164ed lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x50a12932 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6581 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.967980:0:6581:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x50a12932 (ffff99d943f76d00) 00010000:00010000:0.0:1777051430.967984:0:6581:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777051430.967989:0:6581:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99d94eb2bc00/0x85f51a6b967164ed lrc: 2/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x50a12932 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6581 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.967999:0:6581:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d94eb2bc00/0x85f51a6b967164ed lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x50a12932 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6581 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.968045:0:6581:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94eb2be00/0x85f51a6b967164df lrc: 1/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b64a5 expref: 53 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.968063:0:6581:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff99d9413d0300) 00010000:00010000:0.0:1777051430.968067:0:6581:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1777051430.968074:0:6581:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d94eb2be00/0x85f51a6b967164df lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b64a5 expref: 53 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051430.968090:0:6581:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d94eb2be00, rc 0) 00000100:00100000:0.0:1777051430.968170:0:6581:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d944e10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+52:138045:x1863365425984256:12345-192.168.201.46@tcp:101:lfs.0 Request processed in 1014us (1778us total) trans 0 rc 301/301 00000100:00100000:0.0:1777051430.968182:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112081 00000100:00100000:1.0:1777051430.970805:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051430.971001:0:21368:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425984512 00000100:00100000:2.0:1777051430.971012:0:21368:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425984512 00000100:00100000:2.0:1777051430.971087:0:21368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112082 00000100:00100000:2.0:1777051430.971102:0:21368:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+44:138045:x1863365425984512:12345-192.168.201.46@tcp:101:lfs.0 00010000:00010000:2.0:1777051430.971125:0:21368:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051430.971146:0:21368:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eccc200/0x85f51a6b967164f4 lrc: 2/0,0 mode: --/CR res: [0x2000032e2:0x5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b64ac expref: -99 pid: 21368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.971372:0:21368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eccde00/0x85f51a6b967164fb lrc: 3/1,0 mode: --/CR res: [0x2000032e2:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.971391:0:21368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eccde00/0x85f51a6b967164fb lrc: 3/1,0 mode: CR/CR res: [0x2000032e2:0x6:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.971407:0:21368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eccde00/0x85f51a6b967164fb lrc: 3/1,0 mode: CR/CR res: [0x2000032e2:0x6:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1777051430.971424:0:21368:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000032e2:0x6:0x0]: returning size 4096 00010000:00010000:2.0:1777051430.971554:0:21368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eccc200/0x85f51a6b967164f4 lrc: 0/0,0 mode: --/CR res: [0x2000032e2:0x5:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b64ac expref: 47 pid: 21368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.971589:0:21368:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eccde00/0x85f51a6b967164fb lrc: 3/0,0 mode: CR/CR res: [0x2000032e2:0x6:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b64ac expref: 46 pid: 21368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.971601:0:21368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0x6:0x0].0x0 (ffff99d943f76700) 00010000:00010000:2.0:1777051430.971606:0:21368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1777051430.971610:0:21368:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d94eccde00, rc 0) 00000100:00100000:2.0:1777051430.971669:0:21368:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+46:138045:x1863365425984512:12345-192.168.201.46@tcp:101:lfs.0 Request processed in 570us (867us total) trans 30064771161 rc 0/0 00000100:00100000:2.0:1777051430.971681:0:21368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112082 00000100:00100000:3.0:1777051430.974347:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051430.974431:0:6579:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425984768 00000100:00100000:2.0:1777051430.974440:0:6579:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425984768 00000100:00100000:2.0:1777051430.974500:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112083 00000100:00100000:2.0:1777051430.974514:0:6579:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da445dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+52:138045:x1863365425984768:12345-192.168.201.46@tcp:101:lfs.0 00010000:00010000:2.0:1777051430.974530:0:6579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051430.974549:0:6579:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d94ecccc00/0x85f51a6b96716509 lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b64b3 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.974613:0:6579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94eccda00/0x85f51a6b96716510 lrc: 3/1,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.974631:0:6579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d94eccda00/0x85f51a6b96716510 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.974645:0:6579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d94eccda00/0x85f51a6b96716510 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.974661:0:6579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94eccd000/0x85f51a6b96716517 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x50a12932 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.974675:0:6579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d94eccd000/0x85f51a6b96716517 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x50a12932 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.974687:0:6579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d94eccd000/0x85f51a6b96716517 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x50a12932 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.974795:0:6579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d950263c00/0x85f51a6b9671651e lrc: 3/1,0 mode: --/PR res: [0x240000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.974809:0:6579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d950263c00/0x85f51a6b9671651e lrc: 3/1,0 mode: PR/PR res: [0x240000bd2:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.974822:0:6579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d950263c00/0x85f51a6b9671651e lrc: 3/1,0 mode: PR/PR res: [0x240000bd2:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1777051430.974834:0:6579:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000bd2:0x2:0x0]: returning size 1048576 00010000:00010000:2.0:1777051430.974966:0:6579:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94eccda00/0x85f51a6b96716510 lrc: 4/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.974979:0:6579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94eccda00/0x85f51a6b96716510 lrc: 4/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6579 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.974989:0:6579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d94eccda00/0x85f51a6b96716510 lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6579 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.975001:0:6579:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99d94eccda00/0x85f51a6b96716510 lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6579 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.975011:0:6579:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94eccda00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:2.0:1777051430.975017:0:6579:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d94eccda00/0x85f51a6b96716510 lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6579 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.975035:0:6579:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d94eccda00/0x85f51a6b96716510 lrc: 5/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6579 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.975050:0:6579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff99d9413d0300) 00010000:00010000:2.0:1777051430.975054:0:6579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777051430.975060:0:6579:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99d94eccda00/0x85f51a6b96716510 lrc: 3/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6579 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.975079:0:6579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d94eccda00/0x85f51a6b96716510 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6579 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.975096:0:6579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94eccd000/0x85f51a6b96716517 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x50a12932 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.975107:0:6579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d94eccd000/0x85f51a6b96716517 lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x50a12932 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6579 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.975117:0:6579:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99d94eccd000/0x85f51a6b96716517 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x50a12932 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6579 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.975126:0:6579:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94eccd000 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:2.0:1777051430.975131:0:6579:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d94eccd000/0x85f51a6b96716517 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x50a12932 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6579 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.975141:0:6579:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d94eccd000/0x85f51a6b96716517 lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x50a12932 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6579 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.975154:0:6579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x50a12932 (ffff99d943f76d00) 00010000:00010000:2.0:1777051430.975159:0:6579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777051430.975163:0:6579:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99d94eccd000/0x85f51a6b96716517 lrc: 2/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x50a12932 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6579 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.975181:0:6579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d94eccd000/0x85f51a6b96716517 lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x50a12932 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6579 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.975225:0:6579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d94ecccc00/0x85f51a6b96716509 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b64b3 expref: 55 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.975294:0:6579:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99d950263c00/0x85f51a6b9671651e lrc: 3/0,0 mode: PR/PR res: [0x240000bd2:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b64b3 expref: 54 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.975308:0:6579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x2:0x0].0x0 (ffff99d943f76e00) 00010000:00010000:2.0:1777051430.975313:0:6579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1777051430.975318:0:6579:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d950263c00, rc 0) 00000100:00100000:2.0:1777051430.975372:0:6579:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da445dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+54:138045:x1863365425984768:12345-192.168.201.46@tcp:101:lfs.0 Request processed in 860us (1029us total) trans 8589934628 rc 0/0 00000100:00100000:2.0:1777051430.975383:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112083 00000100:00100000:1.0:1777051430.977784:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051430.977848:0:6582:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425985024 00000100:00100000:2.0:1777051430.977855:0:6582:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425985024 00000100:00100000:3.0:1777051430.977996:0:46501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3363 00000100:00100000:3.0:1777051430.978014:0:46501:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+54:138045:x1863365425985024:12345-192.168.201.46@tcp:35:lfs.0 00000100:00100000:3.0:1777051430.978271:0:46501:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+55:138045:x1863365425985024:12345-192.168.201.46@tcp:35:lfs.0 Request processed in 261us (487us total) trans 8589934629 rc 0/0 00000100:00100000:3.0:1777051430.978280:0:46501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3363 00000100:00100000:1.0:1777051430.994785:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051430.994884:0:27885:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425985280 00000100:00100000:2.0:1777051430.994896:0:27885:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425985280 00000100:00100000:2.0:1777051430.994990:0:27885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112084 00000100:00100000:2.0:1777051430.995005:0:27885:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+55:138046:x1863365425985280:12345-192.168.201.46@tcp:101:lfs.0 00010000:00010000:2.0:1777051430.995032:0:27885:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051430.995057:0:27885:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d950262400/0x85f51a6b9671652c lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b64ba expref: -99 pid: 27885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.995167:0:27885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d950262200/0x85f51a6b96716533 lrc: 3/1,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.995253:0:27885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d950262200/0x85f51a6b96716533 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 27885 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.995268:0:27885:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d950262200/0x85f51a6b96716533 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 27885 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.995286:0:27885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d950263e00/0x85f51a6b9671653a lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x999b0966 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.995298:0:27885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d950263e00/0x85f51a6b9671653a lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x999b0966 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 27885 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.995307:0:27885:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d950263e00/0x85f51a6b9671653a lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x999b0966 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 27885 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.995404:0:27885:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d950262200/0x85f51a6b96716533 lrc: 4/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 27885 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.995416:0:27885:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d950262200/0x85f51a6b96716533 lrc: 4/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 27885 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.995424:0:27885:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d950262200/0x85f51a6b96716533 lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 27885 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.995433:0:27885:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99d950262200/0x85f51a6b96716533 lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 27885 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.995441:0:27885:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d950262200 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:2.0:1777051430.995447:0:27885:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d950262200/0x85f51a6b96716533 lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 27885 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.995457:0:27885:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d950262200/0x85f51a6b96716533 lrc: 5/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 27885 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.995474:0:27885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff99d9413d0300) 00010000:00010000:2.0:1777051430.995477:0:27885:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777051430.995481:0:27885:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99d950262200/0x85f51a6b96716533 lrc: 3/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 27885 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.995488:0:27885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d950262200/0x85f51a6b96716533 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 27885 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.995500:0:27885:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d950263e00/0x85f51a6b9671653a lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x999b0966 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 27885 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.995506:0:27885:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d950263e00/0x85f51a6b9671653a lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x999b0966 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 27885 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.995512:0:27885:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99d950263e00/0x85f51a6b9671653a lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x999b0966 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 27885 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.995516:0:27885:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d950263e00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:2.0:1777051430.995519:0:27885:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d950263e00/0x85f51a6b9671653a lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x999b0966 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 27885 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.995524:0:27885:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d950263e00/0x85f51a6b9671653a lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x999b0966 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 27885 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.995529:0:27885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x999b0966 (ffff99d943f76600) 00010000:00010000:2.0:1777051430.995531:0:27885:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777051430.995534:0:27885:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99d950263e00/0x85f51a6b9671653a lrc: 2/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x999b0966 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 27885 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.995539:0:27885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d950263e00/0x85f51a6b9671653a lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x999b0966 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 27885 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.995579:0:27885:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99d950262400/0x85f51a6b9671652c lrc: 1/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b64ba expref: 56 pid: 27885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.995594:0:27885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff99d9413d0300) 00010000:00010000:2.0:1777051430.995597:0:27885:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1777051430.995603:0:27885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d950262400/0x85f51a6b9671652c lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b64ba expref: 56 pid: 27885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051430.995618:0:27885:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d950262400, rc 0) 00000100:00100000:2.0:1777051430.995700:0:27885:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+55:138046:x1863365425985280:12345-192.168.201.46@tcp:101:lfs.0 Request processed in 696us (925us total) trans 0 rc 301/301 00000100:00100000:2.0:1777051430.995713:0:27885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112084 00010000:00010000:1.0:1777051430.999014:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1777051430.999145:0:103189:0:(llog.c:801:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:2.0:1777051430.999152:0:103189:0:(llog_cat.c:158:llog_cat_process_common()) processing log [0x1:0x2b:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1777051430.999447:0:103189:0:(llog.c:858:llog_process_thread()) stop processing plain [0x1:0x2b:0x0] index 5 count 3 00000040:00080000:2.0:1777051430.999458:0:103189:0:(llog.c:858:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00000100:00100000:0.0:1777051431.000500:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051431.000587:0:8492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425985536 00000100:00100000:1.0:1777051431.000597:0:8492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425985536 00000100:00100000:1.0:1777051431.000658:0:8492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112085 00000100:00100000:1.0:1777051431.000689:0:8492:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d944d29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+55:138046:x1863365425985536:12345-192.168.201.46@tcp:101:lfs.0 00010000:00010000:1.0:1777051431.000709:0:8492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777051431.000730:0:8492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e48bc00/0x85f51a6b96716541 lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b64c1 expref: -99 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051431.001093:0:8492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e48b200/0x85f51a6b96716548 lrc: 3/1,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051431.001113:0:8492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e48b200/0x85f51a6b96716548 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8492 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051431.001128:0:8492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e48b200/0x85f51a6b96716548 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8492 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051431.001142:0:8492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e48b000/0x85f51a6b9671654f lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x999b0966 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051431.001161:0:8492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e48b000/0x85f51a6b9671654f lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x999b0966 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8492 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051431.001171:0:8492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e48b000/0x85f51a6b9671654f lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x999b0966 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8492 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051431.001328:0:8492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e48a800/0x85f51a6b96716556 lrc: 3/1,0 mode: --/PR res: [0x240000bd2:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051431.001343:0:8492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e48a800/0x85f51a6b96716556 lrc: 3/1,0 mode: PR/PR res: [0x240000bd2:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8492 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051431.001355:0:8492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e48a800/0x85f51a6b96716556 lrc: 3/1,0 mode: PR/PR res: [0x240000bd2:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8492 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1777051431.001369:0:8492:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000bd2:0x3:0x0]: returning size 1048576 00010000:00010000:1.0:1777051431.001461:0:8492:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e48b200/0x85f51a6b96716548 lrc: 4/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8492 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051431.001472:0:8492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e48b200/0x85f51a6b96716548 lrc: 4/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8492 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051431.001482:0:8492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e48b200/0x85f51a6b96716548 lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8492 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051431.001493:0:8492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e48b200/0x85f51a6b96716548 lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8492 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051431.001503:0:8492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94e48b200 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:1.0:1777051431.001508:0:8492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e48b200/0x85f51a6b96716548 lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8492 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051431.001526:0:8492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e48b200/0x85f51a6b96716548 lrc: 5/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8492 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051431.001541:0:8492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff99d9413d0300) 00010000:00010000:1.0:1777051431.001546:0:8492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777051431.001552:0:8492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e48b200/0x85f51a6b96716548 lrc: 3/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8492 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051431.001562:0:8492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e48b200/0x85f51a6b96716548 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8492 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051431.001578:0:8492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e48b000/0x85f51a6b9671654f lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x999b0966 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8492 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051431.001588:0:8492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e48b000/0x85f51a6b9671654f lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x999b0966 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8492 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051431.001598:0:8492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e48b000/0x85f51a6b9671654f lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x999b0966 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8492 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051431.001607:0:8492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94e48b000 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:1.0:1777051431.001611:0:8492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e48b000/0x85f51a6b9671654f lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x999b0966 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8492 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051431.001621:0:8492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e48b000/0x85f51a6b9671654f lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x999b0966 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8492 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051431.001631:0:8492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x999b0966 (ffff99d943f76600) 00010000:00010000:1.0:1777051431.001635:0:8492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777051431.001639:0:8492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e48b000/0x85f51a6b9671654f lrc: 2/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x999b0966 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8492 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051431.001655:0:8492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e48b000/0x85f51a6b9671654f lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x999b0966 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8492 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051431.001999:0:8492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e48bc00/0x85f51a6b96716541 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b64c1 expref: 58 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051431.002020:0:8492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e48a800/0x85f51a6b96716556 lrc: 3/0,0 mode: PR/PR res: [0x240000bd2:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b64c1 expref: 57 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051431.002032:0:8492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x3:0x0].0x0 (ffff99d943f76f00) 00010000:00010000:1.0:1777051431.002037:0:8492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1777051431.002041:0:8492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d94e48a800, rc 0) 00000100:00100000:1.0:1777051431.002379:0:8492:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d944d29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+57:138046:x1863365425985536:12345-192.168.201.46@tcp:101:lfs.0 Request processed in 1693us (1883us total) trans 8589934630 rc 0/0 00000100:00100000:1.0:1777051431.002391:0:8492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112085 00000100:00100000:1.0:1777051431.006389:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051431.006461:0:24269:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425985792 00000100:00100000:2.0:1777051431.006469:0:24269:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425985792 00000100:00100000:2.0:1777051431.006522:0:24269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3364 00000100:00100000:2.0:1777051431.006543:0:24269:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da6ff01050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+57:138046:x1863365425985792:12345-192.168.201.46@tcp:35:lfs.0 00000100:00100000:2.0:1777051431.006733:0:24269:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da6ff01050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+58:138046:x1863365425985792:12345-192.168.201.46@tcp:35:lfs.0 Request processed in 199us (349us total) trans 8589934631 rc 0/0 00000100:00100000:2.0:1777051431.006745:0:24269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3364 00000100:00100000:2.0:1777051431.025867:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051431.025994:0:6581:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425986048 00000100:00100000:0.0:1777051431.026007:0:6581:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425986048 00000100:00100000:0.0:1777051431.026101:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112086 00000100:00100000:0.0:1777051431.026118:0:6581:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+46:138047:x1863365425986048:12345-192.168.201.46@tcp:101:lfs.0 00000100:00080000:1.0:1777051431.026127:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1777051431.026149:0:6581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051431.026481:0:6581:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b600/0x85f51a6b96716564 lrc: 2/0,0 mode: --/CR res: [0x2000032e0:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b64c8 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051431.026573:0:6581:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b800/0x85f51a6b9671656b lrc: 3/1,0 mode: --/CR res: [0x2000032e0:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051431.026593:0:6581:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b800/0x85f51a6b9671656b lrc: 3/1,0 mode: CR/CR res: [0x2000032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051431.026611:0:6581:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b800/0x85f51a6b9671656b lrc: 3/1,0 mode: CR/CR res: [0x2000032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051431.026628:0:6581:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b200/0x85f51a6b96716572 lrc: 3/1,0 mode: --/PR res: [0x2000032e0:0x1:0x0].0xab04085a bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051431.026638:0:6581:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b200/0x85f51a6b96716572 lrc: 3/1,0 mode: PR/PR res: [0x2000032e0:0x1:0x0].0xab04085a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051431.026650:0:6581:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b200/0x85f51a6b96716572 lrc: 3/1,0 mode: PR/PR res: [0x2000032e0:0x1:0x0].0xab04085a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051431.026764:0:6581:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b800/0x85f51a6b9671656b lrc: 3/1,0 mode: CR/CR res: [0x2000032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051431.027075:0:6581:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b800/0x85f51a6b9671656b lrc: 2/0,0 mode: CR/CR res: [0x2000032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051431.027085:0:6581:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b800/0x85f51a6b9671656b lrc: 3/0,0 mode: CR/CR res: [0x2000032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051431.027101:0:6581:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94eb2b800 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:0.0:1777051431.027107:0:6581:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b800/0x85f51a6b9671656b lrc: 3/0,0 mode: CR/CR res: [0x2000032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051431.027118:0:6581:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b800/0x85f51a6b9671656b lrc: 4/0,0 mode: CR/CR res: [0x2000032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051431.027136:0:6581:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e0:0x1:0x0].0x0 (ffff99d943f76200) 00010000:00010000:0.0:1777051431.027140:0:6581:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777051431.027147:0:6581:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b800/0x85f51a6b9671656b lrc: 2/0,0 mode: --/CR res: [0x2000032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051431.027156:0:6581:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b800/0x85f51a6b9671656b lrc: 0/0,0 mode: --/CR res: [0x2000032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051431.027174:0:6581:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b200/0x85f51a6b96716572 lrc: 3/1,0 mode: PR/PR res: [0x2000032e0:0x1:0x0].0xab04085a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051431.027182:0:6581:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b200/0x85f51a6b96716572 lrc: 2/0,0 mode: PR/PR res: [0x2000032e0:0x1:0x0].0xab04085a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051431.027192:0:6581:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b200/0x85f51a6b96716572 lrc: 3/0,0 mode: PR/PR res: [0x2000032e0:0x1:0x0].0xab04085a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051431.027246:0:6581:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94eb2b200 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:0.0:1777051431.027251:0:6581:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b200/0x85f51a6b96716572 lrc: 3/0,0 mode: PR/PR res: [0x2000032e0:0x1:0x0].0xab04085a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051431.027261:0:6581:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b200/0x85f51a6b96716572 lrc: 4/0,0 mode: PR/PR res: [0x2000032e0:0x1:0x0].0xab04085a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051431.027281:0:6581:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e0:0x1:0x0].0xab04085a (ffff99d9413d0f00) 00010000:00010000:0.0:1777051431.027286:0:6581:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777051431.027291:0:6581:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b200/0x85f51a6b96716572 lrc: 2/0,0 mode: --/PR res: [0x2000032e0:0x1:0x0].0xab04085a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051431.027301:0:6581:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b200/0x85f51a6b96716572 lrc: 0/0,0 mode: --/PR res: [0x2000032e0:0x1:0x0].0xab04085a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051431.027345:0:6581:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b600/0x85f51a6b96716564 lrc: 1/0,0 mode: --/CR res: [0x2000032e0:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b64c8 expref: 47 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051431.027359:0:6581:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e0:0x1:0x0].0x0 (ffff99d943f76200) 00010000:00010000:0.0:1777051431.027363:0:6581:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1777051431.027368:0:6581:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b600/0x85f51a6b96716564 lrc: 0/0,0 mode: --/CR res: [0x2000032e0:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b64c8 expref: 47 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051431.027381:0:6581:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d94eb2b600, rc 0) 00000100:00100000:0.0:1777051431.027458:0:6581:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+46:138047:x1863365425986048:12345-192.168.201.46@tcp:101:lfs.0 Request processed in 1343us (1600us total) trans 0 rc 301/301 00000100:00100000:0.0:1777051431.027470:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112086 00000100:00100000:0.0:1777051431.032568:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051431.032668:0:21368:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425986304 00000100:00100000:2.0:1777051431.032697:0:21368:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425986304 00000100:00100000:2.0:1777051431.032766:0:21368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112087 00000100:00100000:2.0:1777051431.032781:0:21368:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d944d2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+46:138047:x1863365425986304:12345-192.168.201.46@tcp:101:lfs.0 00010000:00010000:2.0:1777051431.032803:0:21368:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051431.032827:0:21368:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eccd000/0x85f51a6b96716579 lrc: 2/0,0 mode: --/CR res: [0x2000032e0:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b64cf expref: -99 pid: 21368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051431.032943:0:21368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eccda00/0x85f51a6b96716580 lrc: 3/1,0 mode: --/CR res: [0x2000032e0:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051431.032962:0:21368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eccda00/0x85f51a6b96716580 lrc: 3/1,0 mode: CR/CR res: [0x2000032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051431.032978:0:21368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eccda00/0x85f51a6b96716580 lrc: 3/1,0 mode: CR/CR res: [0x2000032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051431.032993:0:21368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eccc200/0x85f51a6b96716587 lrc: 3/1,0 mode: --/PR res: [0x2000032e0:0x1:0x0].0xab04085a bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051431.033005:0:21368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eccc200/0x85f51a6b96716587 lrc: 3/1,0 mode: PR/PR res: [0x2000032e0:0x1:0x0].0xab04085a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051431.033015:0:21368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eccc200/0x85f51a6b96716587 lrc: 3/1,0 mode: PR/PR res: [0x2000032e0:0x1:0x0].0xab04085a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051431.033133:0:21368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94ecccc00/0x85f51a6b9671658e lrc: 3/1,0 mode: --/PR res: [0x2000032e3:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051431.033148:0:21368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94ecccc00/0x85f51a6b9671658e lrc: 3/1,0 mode: PR/PR res: [0x2000032e3:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051431.033160:0:21368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94ecccc00/0x85f51a6b9671658e lrc: 3/1,0 mode: PR/PR res: [0x2000032e3:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1777051431.033455:0:21368:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000032e3:0x6:0x0]: returning size 1048576 00010000:00010000:2.0:1777051431.033568:0:21368:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eccda00/0x85f51a6b96716580 lrc: 3/1,0 mode: CR/CR res: [0x2000032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051431.033580:0:21368:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eccda00/0x85f51a6b96716580 lrc: 2/0,0 mode: CR/CR res: [0x2000032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051431.033589:0:21368:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eccda00/0x85f51a6b96716580 lrc: 3/0,0 mode: CR/CR res: [0x2000032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051431.033597:0:21368:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94eccda00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:2.0:1777051431.033602:0:21368:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eccda00/0x85f51a6b96716580 lrc: 3/0,0 mode: CR/CR res: [0x2000032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051431.033613:0:21368:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eccda00/0x85f51a6b96716580 lrc: 4/0,0 mode: CR/CR res: [0x2000032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051431.033628:0:21368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e0:0x1:0x0].0x0 (ffff99d943f76200) 00010000:00010000:2.0:1777051431.033633:0:21368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777051431.033640:0:21368:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eccda00/0x85f51a6b96716580 lrc: 2/0,0 mode: --/CR res: [0x2000032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051431.033649:0:21368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eccda00/0x85f51a6b96716580 lrc: 0/0,0 mode: --/CR res: [0x2000032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051431.033667:0:21368:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eccc200/0x85f51a6b96716587 lrc: 3/1,0 mode: PR/PR res: [0x2000032e0:0x1:0x0].0xab04085a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051431.033677:0:21368:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eccc200/0x85f51a6b96716587 lrc: 2/0,0 mode: PR/PR res: [0x2000032e0:0x1:0x0].0xab04085a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051431.033693:0:21368:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eccc200/0x85f51a6b96716587 lrc: 3/0,0 mode: PR/PR res: [0x2000032e0:0x1:0x0].0xab04085a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051431.033701:0:21368:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94eccc200 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:2.0:1777051431.033705:0:21368:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eccc200/0x85f51a6b96716587 lrc: 3/0,0 mode: PR/PR res: [0x2000032e0:0x1:0x0].0xab04085a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051431.033715:0:21368:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eccc200/0x85f51a6b96716587 lrc: 4/0,0 mode: PR/PR res: [0x2000032e0:0x1:0x0].0xab04085a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051431.033727:0:21368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e0:0x1:0x0].0xab04085a (ffff99d9413d0f00) 00010000:00010000:2.0:1777051431.033731:0:21368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777051431.033736:0:21368:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eccc200/0x85f51a6b96716587 lrc: 2/0,0 mode: --/PR res: [0x2000032e0:0x1:0x0].0xab04085a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051431.033744:0:21368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eccc200/0x85f51a6b96716587 lrc: 0/0,0 mode: --/PR res: [0x2000032e0:0x1:0x0].0xab04085a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051431.033794:0:21368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eccd000/0x85f51a6b96716579 lrc: 0/0,0 mode: --/CR res: [0x2000032e0:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b64cf expref: 49 pid: 21368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051431.033815:0:21368:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94ecccc00/0x85f51a6b9671658e lrc: 3/0,0 mode: PR/PR res: [0x2000032e3:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b64cf expref: 48 pid: 21368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051431.033827:0:21368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e3:0x6:0x0].0x0 (ffff99d9413d0c00) 00010000:00010000:2.0:1777051431.033831:0:21368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1777051431.033835:0:21368:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d94ecccc00, rc 0) 00000100:00100000:2.0:1777051431.033893:0:21368:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d944d2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+48:138047:x1863365425986304:12345-192.168.201.46@tcp:101:lfs.0 Request processed in 1115us (1331us total) trans 30064771162 rc 0/0 00000100:00100000:2.0:1777051431.033937:0:21368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112087 00000100:00100000:1.0:1777051431.036872:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051431.036970:0:6582:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425986560 00000100:00100000:2.0:1777051431.036980:0:6582:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425986560 00000100:00100000:2.0:1777051431.037045:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3365 00000100:00100000:2.0:1777051431.037058:0:6582:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+48:138047:x1863365425986560:12345-192.168.201.46@tcp:35:lfs.0 00000100:00100000:2.0:1777051431.037237:0:6582:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+49:138047:x1863365425986560:12345-192.168.201.46@tcp:35:lfs.0 Request processed in 181us (369us total) trans 30064771163 rc 0/0 00000100:00100000:2.0:1777051431.037245:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3365 00000100:00100000:1.0:1777051431.052758:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051431.052866:0:27884:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425986688 00000100:00100000:2.0:1777051431.052879:0:27884:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425986688 00000100:00080000:1.0:1777051431.053021:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1777051431.053021:0:27884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 8009 00000100:00100000:2.0:1777051431.053040:0:27884:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+51:2439:x1863365425986688:12345-192.168.201.46@tcp:101:lfs.0 00010000:00010000:2.0:1777051431.053062:0:27884:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051431.053084:0:27884:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006da87666/0x85f51a6b9671659c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x103:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b64d6 expref: -99 pid: 27884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051431.053159:0:27884:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f9ffb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:27884:1863365452635136:192.168.201.46@tcp:106: 00000100:00100000:2.0:1777051431.053316:0:27884:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d95c67b900 going to sleep for 11 seconds 00002000:00010000:2.0:1777051431.055240:0:27884:0:(ofd_lvb.c:259:ofd_lvbo_update()) res: [0x280000400:0x103:0x0] updating lvb size: 0 -> 1048576 00002000:00010000:2.0:1777051431.055247:0:27884:0:(ofd_lvb.c:265:ofd_lvbo_update()) res: [0x280000400:0x103:0x0] updating lvb mtime: 0 -> 1777051430 00002000:00010000:2.0:1777051431.055251:0:27884:0:(ofd_lvb.c:271:ofd_lvbo_update()) res: [0x280000400:0x103:0x0] updating lvb atime: 0 -> 1777051430 00002000:00010000:2.0:1777051431.055254:0:27884:0:(ofd_lvb.c:277:ofd_lvbo_update()) res: [0x280000400:0x103:0x0] updating lvb ctime: 0 -> 1777051430 00002000:00010000:2.0:1777051431.055257:0:27884:0:(ofd_lvb.c:283:ofd_lvbo_update()) res: [0x280000400:0x103:0x0] updating lvb blocks: 0 -> 1 00000100:00100000:2.0:1777051431.055278:0:27884:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f9ffb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:27884:1863365452635136:192.168.201.46@tcp:106: 00010000:00010000:2.0:1777051431.055318:0:27884:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006da87666/0x85f51a6b9671659c lrc: 1/0,0 mode: --/PR res: [0x280000400:0x103:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b64d6 expref: 52 pid: 27884 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051431.055352:0:27884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006da87666/0x85f51a6b9671659c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x103:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b64d6 expref: 52 pid: 27884 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051431.055375:0:27884:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d94eccd000, rc 0) 00000100:00100000:2.0:1777051431.055434:0:27884:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+51:2439:x1863365425986688:12345-192.168.201.46@tcp:101:lfs.0 Request processed in 2399us (2687us total) trans 0 rc 301/301 00000100:00100000:2.0:1777051431.055450:0:27884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 8009 00000100:00100000:1.0:1777051431.058516:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051431.058629:0:8471:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425986816 00000100:00100000:0.0:1777051431.058640:0:8471:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425986816 00000100:00100000:0.0:1777051431.058732:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 8010 00000100:00080000:1.0:1777051431.058745:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1777051431.058750:0:8471:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+47:2437:x1863365425986816:12345-192.168.201.46@tcp:101:lfs.0 00010000:00010000:0.0:1777051431.058771:0:8471:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051431.058791:0:8471:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000999de92d/0x85f51a6b967165a3 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x103:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b64dd expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051431.058855:0:8471:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d944d2b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8471:1863365452635264:192.168.201.46@tcp:106: 00000100:00100000:0.0:1777051431.058987:0:8471:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d94eea9180 going to sleep for 11 seconds 00000040:00080000:3.0:1777051431.062406:0:104226:0:(llog.c:801:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1777051431.062415:0:104226:0:(llog_cat.c:158:llog_cat_process_common()) processing log [0x1:0x12:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1777051431.062533:0:104226:0:(llog.c:858:llog_process_thread()) stop processing plain [0x1:0x12:0x0] index 2 count 1 00000040:00080000:3.0:1777051431.062545:0:104226:0:(llog.c:858:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00002000:00010000:0.0:1777051431.064589:0:8471:0:(ofd_lvb.c:259:ofd_lvbo_update()) res: [0x2c0000400:0x103:0x0] updating lvb size: 0 -> 1048576 00002000:00010000:0.0:1777051431.064596:0:8471:0:(ofd_lvb.c:265:ofd_lvbo_update()) res: [0x2c0000400:0x103:0x0] updating lvb mtime: 0 -> 1777051430 00002000:00010000:0.0:1777051431.064600:0:8471:0:(ofd_lvb.c:271:ofd_lvbo_update()) res: [0x2c0000400:0x103:0x0] updating lvb atime: 0 -> 1777051430 00002000:00010000:0.0:1777051431.064603:0:8471:0:(ofd_lvb.c:277:ofd_lvbo_update()) res: [0x2c0000400:0x103:0x0] updating lvb ctime: 0 -> 1777051430 00002000:00010000:0.0:1777051431.064606:0:8471:0:(ofd_lvb.c:283:ofd_lvbo_update()) res: [0x2c0000400:0x103:0x0] updating lvb blocks: 0 -> 1 00000100:00100000:0.0:1777051431.064631:0:8471:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d944d2b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8471:1863365452635264:192.168.201.46@tcp:106: 00010000:00010000:0.0:1777051431.064670:0:8471:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000999de92d/0x85f51a6b967165a3 lrc: 1/0,0 mode: --/PR res: [0x2c0000400:0x103:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b64dd expref: 48 pid: 8471 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051431.064703:0:8471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000999de92d/0x85f51a6b967165a3 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x103:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b64dd expref: 48 pid: 8471 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051431.064723:0:8471:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d94eb2b200, rc 0) 00000100:00100000:0.0:1777051431.064797:0:8471:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+47:2437:x1863365425986816:12345-192.168.201.46@tcp:101:lfs.0 Request processed in 6051us (6284us total) trans 0 rc 301/301 00000100:00100000:0.0:1777051431.064810:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 8010 00000100:00100000:3.0:1777051431.069364:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051431.069490:0:27887:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425986944 00000100:00100000:2.0:1777051431.069500:0:27887:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425986944 00000100:00100000:2.0:1777051431.069557:0:27887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 8011 00000100:00100000:2.0:1777051431.069570:0:27887:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da445ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+51:2436:x1863365425986944:12345-192.168.201.46@tcp:101:lfs.0 00010000:00010000:2.0:1777051431.069591:0:27887:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051431.069615:0:27887:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006da87666/0x85f51a6b967165aa lrc: 2/0,0 mode: --/PR res: [0x280000400:0x104:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b64e4 expref: -99 pid: 27887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051431.069707:0:27887:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f9ffb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:27887:1863365452635392:192.168.201.46@tcp:106: 00000100:00100000:2.0:1777051431.069884:0:27887:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d95c67b900 going to sleep for 11 seconds 00002000:00010000:2.0:1777051431.072726:0:27887:0:(ofd_lvb.c:259:ofd_lvbo_update()) res: [0x280000400:0x104:0x0] updating lvb size: 0 -> 1048576 00002000:00010000:2.0:1777051431.072736:0:27887:0:(ofd_lvb.c:265:ofd_lvbo_update()) res: [0x280000400:0x104:0x0] updating lvb mtime: 0 -> 1777051430 00002000:00010000:2.0:1777051431.072741:0:27887:0:(ofd_lvb.c:271:ofd_lvbo_update()) res: [0x280000400:0x104:0x0] updating lvb atime: 0 -> 1777051430 00002000:00010000:2.0:1777051431.072746:0:27887:0:(ofd_lvb.c:277:ofd_lvbo_update()) res: [0x280000400:0x104:0x0] updating lvb ctime: 0 -> 1777051430 00002000:00010000:2.0:1777051431.073373:0:27887:0:(ofd_lvb.c:283:ofd_lvbo_update()) res: [0x280000400:0x104:0x0] updating lvb blocks: 0 -> 1 00000100:00100000:2.0:1777051431.073401:0:27887:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f9ffb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:27887:1863365452635392:192.168.201.46@tcp:106: 00010000:00010000:2.0:1777051431.073442:0:27887:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006da87666/0x85f51a6b967165aa lrc: 1/0,0 mode: --/PR res: [0x280000400:0x104:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b64e4 expref: 52 pid: 27887 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051431.073476:0:27887:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006da87666/0x85f51a6b967165aa lrc: 0/0,0 mode: --/PR res: [0x280000400:0x104:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b64e4 expref: 52 pid: 27887 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051431.073498:0:27887:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d94eccd000, rc 0) 00000100:00100000:2.0:1777051431.073578:0:27887:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da445ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+51:2436:x1863365425986944:12345-192.168.201.46@tcp:101:lfs.0 Request processed in 4007us (4221us total) trans 0 rc 301/301 00000100:00100000:2.0:1777051431.073591:0:27887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 8011 00000100:00100000:3.0:1777051431.077445:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051431.077550:0:8468:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425987072 00000100:00100000:1.0:1777051431.077561:0:8468:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425987072 00000100:00100000:1.0:1777051431.077623:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 8012 00000100:00100000:1.0:1777051431.077640:0:8468:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da445dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+51:2437:x1863365425987072:12345-192.168.201.46@tcp:101:lfs.0 00010000:00010000:1.0:1777051431.077655:0:8468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777051431.077673:0:8468:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000909766e2/0x85f51a6b967165b1 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x1e4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b64eb expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051431.077740:0:8468:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f9bf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8468:1863365452635520:192.168.201.46@tcp:106: 00000100:00100000:1.0:1777051431.077830:0:8468:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d95cf51240 going to sleep for 11 seconds 00002000:00010000:1.0:1777051431.082641:0:8468:0:(ofd_lvb.c:259:ofd_lvbo_update()) res: [0x280000401:0x1e4:0x0] updating lvb size: 0 -> 1048576 00002000:00010000:1.0:1777051431.082649:0:8468:0:(ofd_lvb.c:265:ofd_lvbo_update()) res: [0x280000401:0x1e4:0x0] updating lvb mtime: 0 -> 1777051430 00002000:00010000:1.0:1777051431.082653:0:8468:0:(ofd_lvb.c:271:ofd_lvbo_update()) res: [0x280000401:0x1e4:0x0] updating lvb atime: 0 -> 1777051430 00002000:00010000:1.0:1777051431.082658:0:8468:0:(ofd_lvb.c:277:ofd_lvbo_update()) res: [0x280000401:0x1e4:0x0] updating lvb ctime: 0 -> 1777051430 00002000:00010000:1.0:1777051431.082661:0:8468:0:(ofd_lvb.c:283:ofd_lvbo_update()) res: [0x280000401:0x1e4:0x0] updating lvb blocks: 0 -> 1 00000100:00100000:1.0:1777051431.082708:0:8468:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f9bf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8468:1863365452635520:192.168.201.46@tcp:106: 00010000:00010000:1.0:1777051431.082749:0:8468:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000909766e2/0x85f51a6b967165b1 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x1e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b64eb expref: 52 pid: 8468 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051431.082782:0:8468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000909766e2/0x85f51a6b967165b1 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x1e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b64eb expref: 52 pid: 8468 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051431.082801:0:8468:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d94e48aa00, rc 0) 00000100:00100000:1.0:1777051431.082875:0:8468:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da445dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+51:2437:x1863365425987072:12345-192.168.201.46@tcp:101:lfs.0 Request processed in 5234us (5434us total) trans 0 rc 301/301 00000100:00100000:1.0:1777051431.082890:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 8012 00000100:00100000:3.0:1777051431.086731:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051431.086862:0:10328:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425987200 00000100:00100000:0.0:1777051431.086871:0:10328:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425987200 00000100:00100000:0.0:1777051431.086980:0:10328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112088 00000100:00100000:0.0:1777051431.086996:0:10328:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da445ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+49:138048:x1863365425987200:12345-192.168.201.46@tcp:101:lfs.0 00010000:00010000:0.0:1777051431.087023:0:10328:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051431.087072:0:10328:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b200/0x85f51a6b967165b8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b64f2 expref: -99 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051431.087154:0:10328:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b800/0x85f51a6b967165bf lrc: 3/1,0 mode: --/PR res: [0x2000032e2:0x5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051431.087173:0:10328:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b800/0x85f51a6b967165bf lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0x5:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051431.087189:0:10328:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b800/0x85f51a6b967165bf lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0x5:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1777051431.087282:0:10328:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000032e2:0x5:0x0]: returning size 4096 00000004:00200000:0.0:1777051431.087289:0:10328:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1777051431.087316:0:10328:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b800/0x85f51a6b967165bf lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0x5:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051431.087354:0:10328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b200/0x85f51a6b967165b8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b64f2 expref: 51 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051431.087379:0:10328:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b800/0x85f51a6b967165bf lrc: 3/0,0 mode: PR/PR res: [0x2000032e2:0x5:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b64f2 expref: 50 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051431.087392:0:10328:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0x5:0x0].0x0 (ffff99d9413d0100) 00010000:00010000:0.0:1777051431.087396:0:10328:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1777051431.087402:0:10328:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d94eb2b800, rc 0) 00000100:00100000:0.0:1777051431.087479:0:10328:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da445ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+50:138048:x1863365425987200:12345-192.168.201.46@tcp:101:lfs.0 Request processed in 485us (750us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051431.087491:0:10328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112088 00000100:00100000:3.0:1777051431.090831:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051431.090975:0:46494:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425987328 00000100:00100000:0.0:1777051431.091006:0:46494:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425987328 00000100:00100000:0.0:1777051431.091074:0:46494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112089 00000100:00100000:0.0:1777051431.091088:0:46494:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da445df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+50:138048:x1863365425987328:12345-192.168.201.46@tcp:101:lfs.0 00010000:00010000:0.0:1777051431.091105:0:46494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051431.091123:0:46494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b600/0x85f51a6b967165c6 lrc: 2/0,0 mode: --/CR res: [0x2000032e2:0x5:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b64f9 expref: -99 pid: 46494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051431.091176:0:46494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2bc00/0x85f51a6b967165cd lrc: 3/1,0 mode: --/PR res: [0x2000032e2:0x6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051431.091189:0:46494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2bc00/0x85f51a6b967165cd lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0x6:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051431.091201:0:46494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2bc00/0x85f51a6b967165cd lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0x6:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1777051431.091298:0:46494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000032e2:0x6:0x0]: returning size 4096 00000004:00200000:0.0:1777051431.091306:0:46494:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:0.0:1777051431.091324:0:46494:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2bc00/0x85f51a6b967165cd lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0x6:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051431.091348:0:46494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b600/0x85f51a6b967165c6 lrc: 0/0,0 mode: --/CR res: [0x2000032e2:0x5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b64f9 expref: 52 pid: 46494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051431.091364:0:46494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2bc00/0x85f51a6b967165cd lrc: 3/0,0 mode: PR/PR res: [0x2000032e2:0x6:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b64f9 expref: 51 pid: 46494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051431.091372:0:46494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0x6:0x0].0x0 (ffff99d943f76700) 00010000:00010000:0.0:1777051431.091375:0:46494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1777051431.091378:0:46494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d94eb2bc00, rc 0) 00000100:00100000:0.0:1777051431.091428:0:46494:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da445df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+51:138048:x1863365425987328:12345-192.168.201.46@tcp:101:lfs.0 Request processed in 343us (598us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051431.091440:0:46494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112089 00000100:00100000:3.0:1777051431.095706:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051431.095819:0:24468:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425987456 00000100:00100000:1.0:1777051431.095829:0:24468:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425987456 00000100:00100000:1.0:1777051431.095890:0:24468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 8013 00000100:00100000:1.0:1777051431.095926:0:24468:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da445df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+51:2437:x1863365425987456:12345-192.168.201.46@tcp:101:lfs.0 00010000:00010000:1.0:1777051431.095945:0:24468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777051431.095965:0:24468:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000909766e2/0x85f51a6b967165d4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x103:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6500 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051431.096042:0:24468:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f9bf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:24468:1863365452635648:192.168.201.46@tcp:106: 00000100:00100000:1.0:1777051431.096155:0:24468:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d95cf51240 going to sleep for 11 seconds 00000100:00100000:1.0:1777051431.101321:0:24468:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f9bf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:24468:1863365452635648:192.168.201.46@tcp:106: 00010000:00010000:1.0:1777051431.101370:0:24468:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000909766e2/0x85f51a6b967165d4 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x103:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6500 expref: 52 pid: 24468 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051431.101407:0:24468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000909766e2/0x85f51a6b967165d4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x103:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6500 expref: 52 pid: 24468 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051431.101428:0:24468:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d94e48aa00, rc 0) 00000100:00100000:1.0:1777051431.101504:0:24468:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da445df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+51:2437:x1863365425987456:12345-192.168.201.46@tcp:101:lfs.0 Request processed in 5600us (5800us total) trans 0 rc 301/301 00000100:00100000:1.0:1777051431.101519:0:24468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 8013 00000100:00100000:3.0:1777051431.107511:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051431.107627:0:6580:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425987712 00000100:00100000:0.0:1777051431.107640:0:6580:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425987712 00000100:00100000:0.0:1777051431.107702:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112090 00000100:00100000:0.0:1777051431.107712:0:6580:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da445de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+51:138048:x1863365425987712:12345-192.168.201.46@tcp:58:lfs.0 00000040:00080000:0.0:1777051431.107946:0:6580:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2b:0x0].5, 136 off8872 00000100:00100000:0.0:1777051431.108077:0:6580:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da445de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+51:138048:x1863365425987712:12345-192.168.201.46@tcp:58:lfs.0 Request processed in 362us (573us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051431.108391:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112090 00000100:00100000:3.0:1777051431.110538:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051431.110639:0:46497:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425987968 00000100:00100000:2.0:1777051431.110649:0:46497:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425987968 00000100:00100000:2.0:1777051431.110720:0:46497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112091 00000100:00100000:2.0:1777051431.111057:0:46497:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f16a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+58:138048:x1863365425987968:12345-192.168.201.46@tcp:58:lfs.0 00000040:00080000:2.0:1777051431.111267:0:46497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].3, 136 off8600 00000040:00080000:2.0:1777051431.111346:0:46497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].4, 136 off8736 00000040:00080000:2.0:1777051431.111406:0:46497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].5, 136 off8872 00000100:00100000:2.0:1777051431.111487:0:46497:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f16a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+58:138048:x1863365425987968:12345-192.168.201.46@tcp:58:lfs.0 Request processed in 753us (951us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051431.111500:0:46497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112091 00000100:00100000:0.0:1777051431.703378:0:3678:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1777051431.703422:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f9bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452635776:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1777051431.703540:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051431.704750:0:47208:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452635776 00000100:00100000:1.0:1777051431.704766:0:47208:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452635776 00000100:00100000:1.0:1777051431.704928:0:47208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8179 00000100:00100000:1.0:1777051431.704953:0:47208:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d944d2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+6:3678:x1863365452635776:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1777051431.705014:0:47208:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4194304 pending 0 free 1441509376 avail 1295269888 00000100:00100000:1.0:1777051431.705128:0:47208:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d944d2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+6:3678:x1863365452635776:12345-0@lo:41:osp-pre-0-1.0 Request processed in 179us (1588us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051431.705148:0:47208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8179 00000100:00100000:0.0:1777051431.705308:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f9bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452635776:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1777051431.844521:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051431.844573:0:103163:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425988096 00000100:00100000:3.0:1777051431.844589:0:103163:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425988096 00000100:00100000:0.0:1777051431.844598:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051431.844661:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051431.844670:0:103163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 180 00000100:00100000:3.0:1777051431.844689:0:103163:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29c4352d-3260-4734-909d-9ea5de9e7fa4+12:2436:x1863365425988096:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:0.0:1777051431.844714:0:27882:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425988224 00000100:00100000:0.0:1777051431.844723:0:27882:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425988224 00000100:00100000:3.0:1777051431.844787:0:103163:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29c4352d-3260-4734-909d-9ea5de9e7fa4+12:2436:x1863365425988096:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 102us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051431.844801:0:103163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 180 00000100:00100000:0.0:1777051431.844808:0:27882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13395 00000100:00100000:0.0:1777051431.844829:0:27882:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d944d2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+29:2437:x1863365425988224:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:0.0:1777051431.844935:0:27882:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d944d2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+29:2437:x1863365425988224:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 109us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051431.844948:0:27882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13395 00000100:00100000:0.0:1777051431.844992:0:27884:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425988480 00000100:00100000:0.0:1777051431.844999:0:27884:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425988480 00000100:00100000:0.0:1777051431.845070:0:27884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10443 00000100:00100000:0.0:1777051431.845084:0:27884:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d944d28380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+54:2437:x1863365425988480:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:0.0:1777051431.845145:0:27884:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d944d28380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+54:2437:x1863365425988480:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 63us (484us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051431.845158:0:27884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10443 00000100:00080000:0.0:1777051431.845185:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1777051431.845626:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051431.845672:0:6579:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425988736 00000100:00100000:0.0:1777051431.845679:0:6579:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425988736 00000100:00100000:0.0:1777051431.845743:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13396 00000100:00100000:0.0:1777051431.845758:0:6579:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d944d28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+51:2437:x1863365425988736:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:0.0:1777051431.845834:0:6579:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d944d28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+51:2437:x1863365425988736:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 78us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051431.845846:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13396 00000100:00100000:3.0:1777051431.846122:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051431.846500:0:8471:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425988992 00000100:00100000:0.0:1777051431.846510:0:8471:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425988992 00000100:00100000:0.0:1777051431.846563:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10444 00000100:00100000:0.0:1777051431.846576:0:8471:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f169880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+51:2437:x1863365425988992:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:0.0:1777051431.846630:0:8471:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f169880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+51:2437:x1863365425988992:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 56us (868us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051431.846641:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10444 00000100:00100000:3.0:1777051431.847416:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051431.847490:0:46494:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425988352 00000100:00100000:0.0:1777051431.847500:0:46494:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425988352 00000100:00100000:3.0:1777051431.847508:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051431.847572:0:46494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13397 00000100:00100000:0.0:1777051431.847585:0:46494:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f16ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c11b6966-0775-44d2-bdc6-c74c26eb2226+21:2436:x1863365425988352:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:0.0:1777051431.847652:0:46494:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f16ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c11b6966-0775-44d2-bdc6-c74c26eb2226+21:2436:x1863365425988352:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 68us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051431.847663:0:46494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13397 00000100:00080000:0.0:1777051431.847701:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1777051431.848168:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051431.848611:0:8492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425988864 00000100:00100000:0.0:1777051431.848620:0:8492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425988864 00000100:00100000:0.0:1777051431.848669:0:8492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13398 00000100:00100000:0.0:1777051431.848681:0:8492:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f16a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+58:2436:x1863365425988864:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:0.0:1777051431.848733:0:8492:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f16a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+58:2436:x1863365425988864:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 55us (1175us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051431.848741:0:8492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13398 00000100:00100000:3.0:1777051431.849148:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051431.849515:0:27887:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425988608 00000100:00100000:3.0:1777051431.849523:0:27887:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425988608 00000100:00100000:3.0:1777051431.849565:0:27887:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425989120 00000100:00100000:3.0:1777051431.849572:0:27887:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425989120 00000100:00100000:3.0:1777051431.849604:0:27887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10445 00000100:00100000:3.0:1777051431.849616:0:27887:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f168000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c11b6966-0775-44d2-bdc6-c74c26eb2226+50:2436:x1863365425988608:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:3.0:1777051431.849673:0:27887:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f168000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c11b6966-0775-44d2-bdc6-c74c26eb2226+50:2436:x1863365425988608:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 59us (2171us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051431.849685:0:27887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10445 00000100:00100000:0.0:1777051431.849823:0:8628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10446 00000100:00100000:0.0:1777051431.849839:0:8628:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f16b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+47:2436:x1863365425989120:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:0.0:1777051431.849923:0:8628:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f16b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+47:2436:x1863365425989120:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 87us (775us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051431.849935:0:8628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10446 00000040:00080000:3.0:1777051431.956297:0:107446:0:(llog.c:801:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1777051431.956309:0:107446:0:(llog_cat.c:158:llog_cat_process_common()) processing log [0x1:0x12:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1777051431.956356:0:107446:0:(llog.c:858:llog_process_thread()) stop processing plain [0x1:0x12:0x0] index 6 count 4 00000040:00080000:3.0:1777051431.956367:0:107446:0:(llog.c:858:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000040:00080000:2.0:1777051432.023001:0:103189:0:(llog.c:801:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:2.0:1777051432.023012:0:103189:0:(llog_cat.c:158:llog_cat_process_common()) processing log [0x1:0x2b:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1777051432.023047:0:103189:0:(llog.c:858:llog_process_thread()) stop processing plain [0x1:0x2b:0x0] index 6 count 4 00000040:00080000:2.0:1777051432.023056:0:103189:0:(llog.c:858:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00010000:00010000:1.0:1777051432.023189:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1777051432.023404:0:103189:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f9ffb80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:103189:1863365452635904:192.168.201.46@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1777051432.023527:0:103189:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d956bda3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1777051432.028454:0:103189:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f9ffb80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:103189:1863365452635904:192.168.201.46@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1777051432.028516:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051432.028662:0:6581:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425989248 00000100:00100000:0.0:1777051432.028675:0:6581:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425989248 00000100:00100000:0.0:1777051432.029189:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112092 00000100:00100000:0.0:1777051432.029215:0:6581:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f169180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+29:138059:x1863365425989248:12345-192.168.201.46@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1777051432.029261:0:6581:0:(mdt_handler.c:7958:mdt_fid2path()) path get [0x2000032e3:0x6:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1777051432.029538:0:6581:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f169180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+29:138059:x1863365425989248:12345-192.168.201.46@tcp:53:lhsmtool_posix.0 Request processed in 330us (1026us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051432.029553:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112092 00000100:00100000:0.0:1777051432.033157:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051432.033398:0:27882:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425989504 00000100:00100000:1.0:1777051432.033408:0:27882:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425989504 00000100:00100000:1.0:1777051432.033474:0:27882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112093 00000100:00100000:1.0:1777051432.033491:0:27882:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d944d2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+29:138059:x1863365425989504:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1777051432.033512:0:27882:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777051432.033541:0:27882:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48a000/0x85f51a6b967165db lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6507 expref: -99 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051432.033654:0:27882:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48aa00/0x85f51a6b967165e2 lrc: 3/1,0 mode: --/PR res: [0x2000032e3:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051432.033675:0:27882:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48aa00/0x85f51a6b967165e2 lrc: 3/1,0 mode: PR/PR res: [0x2000032e3:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051432.033691:0:27882:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48aa00/0x85f51a6b967165e2 lrc: 3/1,0 mode: PR/PR res: [0x2000032e3:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1777051432.033708:0:27882:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000032e3:0x6:0x0]: returning size 1048576 00010000:00010000:1.0:1777051432.033864:0:27882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48a000/0x85f51a6b967165db lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6507 expref: 32 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051432.033881:0:27882:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48aa00/0x85f51a6b967165e2 lrc: 3/0,0 mode: PR/PR res: [0x2000032e3:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6507 expref: 31 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051432.034020:0:27882:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e3:0x6:0x0].0x0 (ffff99d9413d0c00) 00010000:00010000:1.0:1777051432.034025:0:27882:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1777051432.034030:0:27882:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d94e48aa00, rc 0) 00000100:00100000:1.0:1777051432.034090:0:27882:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d944d2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+31:138059:x1863365425989504:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 Request processed in 604us (937us total) trans 30064771164 rc 0/0 00000100:00100000:1.0:1777051432.034108:0:27882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112093 00000100:00100000:3.0:1777051432.037242:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051432.037321:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051432.037323:0:47597:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425989632 00000100:00100000:0.0:1777051432.037333:0:47597:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425989632 00000100:00100000:0.0:1777051432.037401:0:47597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13693 00000100:00100000:0.0:1777051432.037413:0:47597:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da6fd42850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+31:2439:x1863365425989632:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1777051432.037434:0:47597:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777051432.037453:0:47597:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48aa00/0x85f51a6b967165e2 lrc: 0/0,0 mode: --/PR res: [0x2000032e3:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6507 expref: 31 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051432.037473:0:47597:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e3:0x6:0x0].0x0 (ffff99d9413d0c00) 00010000:00010000:0.0:1777051432.037480:0:47597:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1777051432.037534:0:47597:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da6fd42850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+30:2439:x1863365425989632:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 122us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051432.037545:0:47597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13693 00000100:00100000:1.0:1777051432.037781:0:24468:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425989760 00000100:00100000:1.0:1777051432.037790:0:24468:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425989760 00000100:00080000:0.0:1777051432.037866:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1777051432.037869:0:24468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 8014 00000100:00100000:1.0:1777051432.037913:0:24468:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f169c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+54:2436:x1863365425989760:12345-192.168.201.46@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1777051432.037955:0:24468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a5833e0e/0x85f51a6b967165f0 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x1e4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051432.037981:0:24468:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c82c3fc4/0x85f51a6b9671645a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6474 expref: 54 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051432.037994:0:24468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1777051432.037997:0:24468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1777051432.038002:0:24468:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5833e0e/0x85f51a6b967165f0 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x1e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051432.038048:0:24468:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c82c3fc4/0x85f51a6b9671645a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6474 expref: 54 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051432.038072:0:24468:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c82c3fc4/0x85f51a6b9671645a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6474 expref: 54 pid: 24468 timeout: 8161 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051432.038094:0:24468:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f9bdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:24468:1863365452636032:192.168.201.46@tcp:104: 00000100:00100000:1.0:1777051432.038182:0:24468:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da6fdb6600 going to sleep for 11 seconds 00000100:00100000:1.0:1777051432.041786:0:24468:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f9bdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:24468:1863365452636032:192.168.201.46@tcp:104: 00010000:00010000:1.0:1777051432.041817:0:24468:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a5833e0e/0x85f51a6b967165f0 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x1e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051432.042714:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051432.042831:0:8476:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425989888 00000100:00100000:1.0:1777051432.042840:0:8476:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425989888 00002000:00100000:1.0:1777051432.042928:0:8476:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x1e4:0x0] (0->1048575) req@ffff99d94f16bb80 x1863365425989888/t0(0) o4->c11b6966-0775-44d2-bdc6-c74c26eb2226@192.168.201.46@tcp:393/0 lens 488/0 e 0 to 0 dl 1777051443 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1777051432.042947:0:8476:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99d94f16bb80 with x1863365425989888 ext(0->1048575) 00010000:00010000:1.0:1777051432.042960:0:8476:0:(ldlm_extent.c:759:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000c82c3fc4/0x85f51a6b9671645a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6474 expref: 55 pid: 24468 timeout: 8161 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051432.042985:0:8476:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000c82c3fc4/0x85f51a6b9671645a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6474 expref: 55 pid: 24468 timeout: 8161 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1777051432.043020:0:8476:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff99d94f16bb80 00000100:00100000:1.0:1777051432.043065:0:8476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 69 00000100:00100000:1.0:1777051432.043081:0:8476:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f16bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+55:2437:x1863365425989888:12345-192.168.201.46@tcp:4:dd.0 00000100:00100000:2.0:1777051432.063869:0:8476:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f16bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+57:2437:x1863365425989888:12345-192.168.201.46@tcp:4:dd.0 Request processed in 20781us (21147us total) trans 4294968355 rc 0/0 00000100:00100000:2.0:1777051432.063911:0:8476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 69 00002000:00100000:2.0:1777051432.063930:0:8476:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x1e4:0x0] (0->1048575) req@ffff99d94f16bb80 x1863365425989888/t4294968355(0) o4->c11b6966-0775-44d2-bdc6-c74c26eb2226@192.168.201.46@tcp:393/0 lens 488/448 e 0 to 0 dl 1777051443 ref 1 fl Complete:H/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1777051432.063948:0:8476:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99d94f16bb80 with x1863365425989888 ext(0->1048575) 00010000:00010000:2.0:1777051432.063963:0:8476:0:(ldlm_extent.c:759:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000c82c3fc4/0x85f51a6b9671645a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6474 expref: 57 pid: 24468 timeout: 8161 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051432.063993:0:8476:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000c82c3fc4/0x85f51a6b9671645a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6474 expref: 57 pid: 24468 timeout: 8161 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1777051432.064007:0:8476:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff99d94f16bb80 00000100:00100000:3.0:1777051432.068507:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051432.068715:0:24467:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425990016 00000100:00100000:2.0:1777051432.068729:0:24467:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425990016 00010000:00010000:2.0:1777051432.068783:0:24467:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c82c3fc4/0x85f51a6b9671645a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6474 expref: 57 pid: 24468 timeout: 8161 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051432.068853:0:24467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3878 00000100:00100000:2.0:1777051432.068875:0:24467:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f168700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+57:2438:x1863365425990016:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1777051432.068930:0:24467:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1777051432.068954:0:24467:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000401:0x1e4:0x0] updating lvb blocks from disk: 1 -> 2048 00010000:00010000:2.0:1777051432.068967:0:24467:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c82c3fc4/0x85f51a6b9671645a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6474 expref: 57 pid: 24468 timeout: 8161 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051432.068994:0:24467:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c82c3fc4/0x85f51a6b9671645a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6474 expref: 57 pid: 24468 timeout: 8161 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051432.069044:0:24467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c82c3fc4/0x85f51a6b9671645a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6474 expref: 57 pid: 24468 timeout: 8161 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051432.069069:0:24467:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777051432.069073:0:24467:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777051432.069437:0:24467:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a5833e0e/0x85f51a6b967165f0 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x1e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051432.069455:0:24467:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5833e0e/0x85f51a6b967165f0 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x1e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051432.069499:0:24467:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1777051432.069575:0:24467:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f168700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+56:2438:x1863365425990016:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 707us (1076us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051432.069588:0:24467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3878 00010000:00010000:3.0:1777051432.071063:0:24468:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a5833e0e/0x85f51a6b967165f0 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x1e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051432.071085:0:24468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5833e0e/0x85f51a6b967165f0 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x1e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051432.071118:0:24468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a5833e0e/0x85f51a6b967165f0 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x1e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051432.071135:0:24468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a5833e0e/0x85f51a6b967165f0 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x1e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051432.071149:0:24468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a5833e0e/0x85f51a6b967165f0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x1e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051432.071162:0:24468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94e48a600 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:3.0:1777051432.071169:0:24468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5833e0e/0x85f51a6b967165f0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x1e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051432.071193:0:24468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5833e0e/0x85f51a6b967165f0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x1e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051432.071248:0:24468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a5833e0e/0x85f51a6b967165f0 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x1e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051432.071265:0:24468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5833e0e/0x85f51a6b967165f0 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x1e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051432.071439:0:24468:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f169c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+55:2436:x1863365425989760:12345-192.168.201.46@tcp:1:lhsmtool_posix.0 Request processed in 33552us (34117us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051432.071455:0:24468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 8014 00000100:00100000:3.0:1777051432.075019:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051432.075122:0:6579:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425990272 00000100:00100000:0.0:1777051432.075134:0:6579:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425990272 00000100:00100000:0.0:1777051432.075220:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112094 00000100:00100000:0.0:1777051432.075256:0:6579:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f169500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+30:138059:x1863365425990272:12345-192.168.201.46@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1777051432.075402:0:6579:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f169500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+30:138059:x1863365425990272:12345-192.168.201.46@tcp:57:lhsmtool_posix.0 Request processed in 152us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051432.075416:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112094 00000100:00100000:0.0:1777051432.081543:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051432.081642:0:55805:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425990400 00000100:00100000:3.0:1777051432.081652:0:55805:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425990400 00000100:00100000:3.0:1777051432.082040:0:55805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 8015 00000100:00100000:3.0:1777051432.082056:0:55805:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d944d28700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c11b6966-0775-44d2-bdc6-c74c26eb2226+55:2436:x1863365425990400:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1777051432.082074:0:55805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777051432.082098:0:55805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000550ed123/0x85f51a6b967165f7 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x1e4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b650e expref: -99 pid: 55805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1777051432.082131:0:55805:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x1e4:0x0] initial LVB size: 1048576, mtime: 0x69eba726, atime: 0x0, ctime: 0x69eba726, blocks: 0x800 00010000:00010000:3.0:1777051432.082153:0:55805:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051432.082157:0:55805:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051432.082169:0:55805:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000550ed123/0x85f51a6b967165f7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x1e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b650e expref: 56 pid: 55805 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051432.082195:0:55805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000550ed123/0x85f51a6b967165f7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x1e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b650e expref: 56 pid: 55805 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051432.082286:0:55805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d9559a3a00, rc 0) 00000100:00100000:3.0:1777051432.082352:0:55805:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d944d28700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c11b6966-0775-44d2-bdc6-c74c26eb2226+56:2436:x1863365425990400:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 Request processed in 298us (813us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051432.082363:0:55805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 8015 00000100:00100000:3.0:1777051432.084609:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051432.084698:0:46494:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425990656 00000100:00100000:0.0:1777051432.084708:0:46494:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425990656 00000100:00100000:0.0:1777051432.085065:0:46494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112095 00000100:00100000:0.0:1777051432.085083:0:46494:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f168380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c11b6966-0775-44d2-bdc6-c74c26eb2226+30:138059:x1863365425990656:12345-192.168.201.46@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1777051432.085202:0:46494:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f168380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c11b6966-0775-44d2-bdc6-c74c26eb2226+30:138059:x1863365425990656:12345-192.168.201.46@tcp:57:lhsmtool_posix.0 Request processed in 123us (596us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051432.085215:0:46494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112095 00000040:00080000:3.0:1777051432.086426:0:104226:0:(llog.c:801:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1777051432.086434:0:104226:0:(llog_cat.c:158:llog_cat_process_common()) processing log [0x1:0x12:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1777051432.086480:0:104226:0:(llog.c:858:llog_process_thread()) stop processing plain [0x1:0x12:0x0] index 6 count 4 00000040:00080000:3.0:1777051432.086493:0:104226:0:(llog.c:858:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1777051432.090564:0:104226:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94f168a80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0001_UUID:104226:1863365452636160:192.168.201.46@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1777051432.091116:0:104226:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da43840900 going to sleep for 11 seconds 00000100:00100000:3.0:1777051432.096603:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051432.096661:0:43515:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425990784 00000100:00100000:1.0:1777051432.096675:0:43515:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425990784 00002000:00100000:1.0:1777051432.096731:0:43515:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x1e4:0x0] (0->1048575) req@ffff99d94f168e00 x1863365425990784/t0(0) o3->c11b6966-0775-44d2-bdc6-c74c26eb2226@192.168.201.46@tcp:393/0 lens 488/0 e 0 to 0 dl 1777051443 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1777051432.096750:0:43515:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99d94f168e00 with x1863365425990784 ext(0->1048575) 00002000:00010000:1.0:1777051432.096758:0:43515:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99d94f168e00 00000100:00100000:1.0:1777051432.096816:0:43515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 1768 00000100:00100000:1.0:1777051432.096834:0:43515:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f168e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+56:2436:x1863365425990784:12345-192.168.201.46@tcp:3:lhsmtool_posix.0 00000100:00100000:3.0:1777051432.100095:0:104226:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94f168a80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0001_UUID:104226:1863365452636160:192.168.201.46@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1777051432.104632:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051432.104978:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051432.105063:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051432.105124:0:8492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425990912 00000100:00100000:3.0:1777051432.105133:0:8492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425990912 00000100:00100000:3.0:1777051432.105443:0:8492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425991040 00000100:00100000:3.0:1777051432.105451:0:8492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425991040 00000100:00100000:3.0:1777051432.105504:0:8492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425991168 00000100:00100000:3.0:1777051432.105510:0:8492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425991168 00000100:00100000:1.0:1777051432.105519:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112096 00000100:00100000:1.0:1777051432.105545:0:6581:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f168a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+23:138062:x1863365425990912:12345-192.168.201.46@tcp:53:lhsmtool_posix.0 00000100:00100000:3.0:1777051432.105560:0:8492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112097 00000100:00100000:3.0:1777051432.105578:0:8492:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da444a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+23:138061:x1863365425991040:12345-192.168.201.46@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1777051432.105592:0:6581:0:(mdt_handler.c:7958:mdt_fid2path()) path get [0x240000bd2:0x3:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1777051432.105610:0:8492:0:(mdt_handler.c:7958:mdt_fid2path()) path get [0x240000bd2:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1777051432.105724:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112098 00000100:00100000:3.0:1777051432.106070:0:6580:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da444a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+23:138060:x1863365425991168:12345-192.168.201.46@tcp:53:lhsmtool_posix.0 00000100:00100000:1.0:1777051432.106093:0:6581:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f9bdc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6581:1863365452636288:0@lo:1000:mdt00_002.0 00000004:00000080:3.0:1777051432.106101:0:6580:0:(mdt_handler.c:7958:mdt_fid2path()) path get [0x240000bd2:0x1:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1777051432.106525:0:6581:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051432.106569:0:6581:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da6fdb6e40 going to sleep for 11 seconds 00000100:00100000:1.0:1777051432.106609:0:46498:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452636288 00000100:00100000:1.0:1777051432.106617:0:46498:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452636288 00000100:00100000:1.0:1777051432.106685:0:46498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8180 00000100:00100000:1.0:1777051432.106700:0:46498:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:6581:x1863365452636288:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1777051432.106817:0:46498:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:6581:x1863365452636288:12345-0@lo:1000:mdt00_002.0 Request processed in 120us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051432.106830:0:46498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8180 00000100:00100000:3.0:1777051432.106914:0:6581:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f9bdc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6581:1863365452636288:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1777051432.107033:0:6581:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f168a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+23:138062:x1863365425990912:12345-192.168.201.46@tcp:53:lhsmtool_posix.0 Request processed in 1496us (2402us total) trans 0 rc -66/-66 00000100:00100000:3.0:1777051432.107048:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112096 00000100:00100000:3.0:1777051432.107469:0:8492:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da444a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+22:138061:x1863365425991040:12345-192.168.201.46@tcp:53:lhsmtool_posix.0 Request processed in 1894us (2495us total) trans 0 rc -66/-66 00000100:00100000:3.0:1777051432.107483:0:8492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112097 00000100:00100000:3.0:1777051432.107549:0:6580:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da444a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+21:138060:x1863365425991168:12345-192.168.201.46@tcp:53:lhsmtool_posix.0 Request processed in 1812us (2488us total) trans 0 rc -66/-66 00000100:00100000:3.0:1777051432.107561:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112098 00000100:00100000:1.0:1777051432.126543:0:43515:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f168e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+56:2436:x1863365425990784:12345-192.168.201.46@tcp:3:lhsmtool_posix.0 Request processed in 29703us (29937us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1777051432.126563:0:43515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 1768 00002000:00100000:1.0:1777051432.126583:0:43515:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x1e4:0x0] (0->1048575) req@ffff99d94f168e00 x1863365425990784/t0(0) o3->c11b6966-0775-44d2-bdc6-c74c26eb2226@192.168.201.46@tcp:393/0 lens 488/440 e 0 to 0 dl 1777051443 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1777051432.126602:0:43515:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99d94f168e00 with x1863365425990784 ext(0->1048575) 00002000:00010000:1.0:1777051432.126613:0:43515:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99d94f168e00 00000100:00100000:3.0:1777051432.127316:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051432.127370:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051432.127411:0:10328:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425991424 00000100:00100000:1.0:1777051432.127425:0:10328:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425991424 00000100:00100000:2.0:1777051432.127759:0:6579:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425991296 00000100:00100000:1.0:1777051432.127769:0:10328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112099 00000100:00100000:2.0:1777051432.127771:0:6579:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425991296 00000100:00100000:1.0:1777051432.127797:0:10328:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da444a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+31:138061:x1863365425991424:12345-192.168.201.46@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1777051432.127842:0:10328:0:(mdt_handler.c:7958:mdt_fid2path()) path get [0x2000032e2:0x6:0x0] from 18446744073709551615 #-1 00000100:00100000:2.0:1777051432.127842:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112100 00000100:00100000:2.0:1777051432.127864:0:6579:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da444a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+31:138062:x1863365425991296:12345-192.168.201.46@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1777051432.127930:0:6579:0:(mdt_handler.c:7958:mdt_fid2path()) path get [0x2000032e2:0x6:0x0] from 18446744073709551615 #-1 00000100:00100000:0.0:1777051432.128083:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051432.128093:0:10328:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da444a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+31:138061:x1863365425991424:12345-192.168.201.46@tcp:53:lhsmtool_posix.0 Request processed in 298us (772us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051432.128111:0:10328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112099 00000100:00100000:2.0:1777051432.128122:0:6579:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da444a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+31:138062:x1863365425991296:12345-192.168.201.46@tcp:53:lhsmtool_posix.0 Request processed in 256us (743us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051432.128149:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112100 00000100:00100000:1.0:1777051432.128152:0:10328:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425991552 00000100:00100000:1.0:1777051432.128163:0:10328:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425991552 00000100:00100000:1.0:1777051432.128234:0:10328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112101 00000100:00100000:1.0:1777051432.128253:0:10328:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da445dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+30:138060:x1863365425991552:12345-192.168.201.46@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1777051432.128286:0:10328:0:(mdt_handler.c:7958:mdt_fid2path()) path get [0x2000032e2:0x6:0x0] from 18446744073709551615 #-1 00000100:00100000:1.0:1777051432.128558:0:10328:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da445dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+30:138060:x1863365425991552:12345-192.168.201.46@tcp:53:lhsmtool_posix.0 Request processed in 308us (477us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051432.128571:0:10328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112101 00000100:00100000:3.0:1777051432.132147:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051432.132290:0:27882:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425991808 00000100:00100000:1.0:1777051432.132301:0:27882:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425991808 00000100:00100000:1.0:1777051432.132380:0:27882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112102 00000100:00100000:1.0:1777051432.132395:0:27882:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da444a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+21:138061:x1863365425991808:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1777051432.132418:0:27882:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777051432.132452:0:27882:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e48b200/0x85f51a6b967165fe lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6515 expref: -99 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051432.132503:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00010000:00010000:1.0:1777051432.132578:0:27882:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e48b000/0x85f51a6b96716605 lrc: 3/1,0 mode: --/PR res: [0x240000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051432.132603:0:27882:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e48b000/0x85f51a6b96716605 lrc: 3/1,0 mode: PR/PR res: [0x240000bd2:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 27882 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051432.132622:0:27882:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e48b000/0x85f51a6b96716605 lrc: 3/1,0 mode: PR/PR res: [0x240000bd2:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 27882 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1777051432.132641:0:27882:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000bd2:0x2:0x0]: returning size 1048576 00010000:00010000:1.0:1777051432.132807:0:27882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e48b200/0x85f51a6b967165fe lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6515 expref: 24 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051432.132825:0:8492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425992064 00000100:00100000:3.0:1777051432.132837:0:8492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425992064 00010000:00010000:1.0:1777051432.132846:0:27882:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e48b000/0x85f51a6b96716605 lrc: 3/0,0 mode: PR/PR res: [0x240000bd2:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6515 expref: 24 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051432.132863:0:27882:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x2:0x0].0x0 (ffff99d943f76e00) 00010000:00010000:1.0:1777051432.132870:0:27882:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1777051432.132875:0:27882:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d94e48b000, rc 0) 00000100:00100000:3.0:1777051432.132937:0:8492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112103 00000100:00100000:3.0:1777051432.132956:0:8492:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da445df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+24:138062:x1863365425992064:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 00000100:00100000:1.0:1777051432.132998:0:27882:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da444a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+24:138061:x1863365425991808:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 Request processed in 602us (852us total) trans 8589934632 rc 0/0 00000100:00100000:1.0:1777051432.133012:0:27882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112102 00000100:00100000:0.0:1777051432.133382:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051432.133434:0:46494:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425992320 00000100:00100000:3.0:1777051432.133443:0:46494:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425992320 00000100:00100000:3.0:1777051432.133505:0:46494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112104 00000100:00100000:3.0:1777051432.133519:0:46494:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7e24c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c11b6966-0775-44d2-bdc6-c74c26eb2226+24:138060:x1863365425992320:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1777051432.133537:0:46494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777051432.133561:0:46494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a2200/0x85f51a6b96716613 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6523 expref: -99 pid: 46494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051432.133658:0:46494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a3400/0x85f51a6b9671661a lrc: 3/1,0 mode: --/PR res: [0x240000bd2:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051432.133678:0:46494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a3400/0x85f51a6b9671661a lrc: 3/1,0 mode: PR/PR res: [0x240000bd2:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 46494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051432.133695:0:46494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a3400/0x85f51a6b9671661a lrc: 3/1,0 mode: PR/PR res: [0x240000bd2:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 46494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051432.134399:0:8492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051432.134420:0:8492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d94eccd000/0x85f51a6b96716621 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b651c expref: -99 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051432.134512:0:8492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94eccda00/0x85f51a6b96716628 lrc: 3/1,0 mode: --/PR res: [0x240000bd2:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051432.134531:0:8492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d94eccda00/0x85f51a6b96716628 lrc: 3/1,0 mode: PR/PR res: [0x240000bd2:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8492 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051432.134547:0:8492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d94eccda00/0x85f51a6b96716628 lrc: 3/1,0 mode: PR/PR res: [0x240000bd2:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8492 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1777051432.134563:0:8492:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000bd2:0x3:0x0]: returning size 1048576 00010000:00010000:2.0:1777051432.134674:0:8492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d94eccd000/0x85f51a6b96716621 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b651c expref: 28 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051432.135035:0:8492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94eccda00/0x85f51a6b96716628 lrc: 3/0,0 mode: PR/PR res: [0x240000bd2:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b651c expref: 27 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051432.135053:0:8492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x3:0x0].0x0 (ffff99d943f76f00) 00010000:00010000:2.0:1777051432.135059:0:8492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1777051432.135065:0:8492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d94eccda00, rc 0) 00000100:00100000:2.0:1777051432.135140:0:8492:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da445df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+27:138062:x1863365425992064:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 Request processed in 2187us (2641us total) trans 8589934633 rc 0/0 00000100:00100000:2.0:1777051432.135154:0:8492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112103 00000004:00200000:3.0:1777051432.135351:0:46494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000bd2:0x1:0x0]: returning size 1048576 00010000:00010000:2.0:1777051432.136572:0:46494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a2200/0x85f51a6b96716613 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6523 expref: 28 pid: 46494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051432.136610:0:46494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a3400/0x85f51a6b9671661a lrc: 3/0,0 mode: PR/PR res: [0x240000bd2:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6523 expref: 27 pid: 46494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051432.136624:0:46494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x1:0x0].0x0 (ffff99d943f76b00) 00010000:00010000:2.0:1777051432.136628:0:46494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1777051432.136633:0:46494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d9559a3400, rc 0) 00000100:00100000:2.0:1777051432.136692:0:46494:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7e24c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c11b6966-0775-44d2-bdc6-c74c26eb2226+27:138060:x1863365425992320:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 Request processed in 3174us (3314us total) trans 8589934634 rc 0/0 00000100:00100000:2.0:1777051432.136705:0:46494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112104 00000100:00100000:0.0:1777051432.141412:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051432.142466:0:8470:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425992448 00000100:00100000:1.0:1777051432.142480:0:8470:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425992448 00000100:00100000:0.0:1777051432.142524:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00080000:2.0:1777051432.142544:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1777051432.142575:0:8470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 8016 00000100:00100000:1.0:1777051432.142594:0:8470:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7e24f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+50:2437:x1863365425992448:12345-192.168.201.46@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1777051432.142640:0:8470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000002fab269b/0x85f51a6b9671663d lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0x103:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051432.142670:0:8470:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005bb71356/0x85f51a6b967163c0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x103:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b643c expref: 50 pid: 27887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051432.142686:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1777051432.142689:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1777051432.142695:0:8470:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002fab269b/0x85f51a6b9671663d lrc: 4/1,0 mode: --/PR res: [0x2c0000400:0x103:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051432.142742:0:8470:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005bb71356/0x85f51a6b967163c0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x103:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b643c expref: 50 pid: 27887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051432.142766:0:8470:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005bb71356/0x85f51a6b967163c0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x103:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b643c expref: 50 pid: 27887 timeout: 8161 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051432.142790:0:8470:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f9bca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8470:1863365452636416:192.168.201.46@tcp:104: 00000100:00100000:3.0:1777051432.142914:0:6564:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425992576 00000100:00100000:1.0:1777051432.142921:0:8470:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da6fdb60c0 going to sleep for 11 seconds 00000100:00100000:3.0:1777051432.142922:0:6564:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425992576 00000100:00100000:3.0:1777051432.142983:0:6564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13694 00000100:00100000:3.0:1777051432.142998:0:6564:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7e24ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+27:2438:x1863365425992576:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1777051432.143014:0:6564:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777051432.143042:0:6564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e48b000/0x85f51a6b96716605 lrc: 0/0,0 mode: --/PR res: [0x240000bd2:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6515 expref: 27 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051432.143064:0:6564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x2:0x0].0x0 (ffff99d943f76e00) 00010000:00010000:3.0:1777051432.143070:0:6564:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1777051432.143114:0:6564:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7e24ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+26:2438:x1863365425992576:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 118us (594us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051432.143126:0:6564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13694 00000100:00100000:0.0:1777051432.146284:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051432.146345:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051432.146406:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051432.146422:0:27887:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425992704 00000100:00100000:3.0:1777051432.146434:0:27887:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425992704 00000100:00100000:1.0:1777051432.146450:0:47827:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425992832 00000100:00100000:1.0:1777051432.146461:0:47827:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425992832 00000100:00100000:2.0:1777051432.146493:0:6566:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425992960 00000100:00100000:2.0:1777051432.146507:0:6566:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425992960 00000100:00100000:3.0:1777051432.146515:0:27887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 8017 00000100:00100000:3.0:1777051432.146539:0:27887:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7e24fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c11b6966-0775-44d2-bdc6-c74c26eb2226+56:2437:x1863365425992704:12345-192.168.201.46@tcp:1:lhsmtool_posix.0 00000100:00100000:1.0:1777051432.146549:0:47827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13695 00000100:00100000:1.0:1777051432.146571:0:47827:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7e24f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+27:2437:x1863365425992832:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1777051432.146588:0:27887:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c9e5ad62/0x85f51a6b96716644 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x104:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 27887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051432.146592:0:47827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1777051432.146608:0:6566:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13696 00010000:00010000:1.0:1777051432.146620:0:47827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d94eccda00/0x85f51a6b96716628 lrc: 0/0,0 mode: --/PR res: [0x240000bd2:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b651c expref: 27 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051432.146634:0:27887:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009a997f2b/0x85f51a6b9671640d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x104:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6458 expref: 56 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051432.146642:0:6566:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7e24e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+26:2437:x1863365425992960:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1777051432.146646:0:47827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x3:0x0].0x0 (ffff99d943f76f00) 00010000:00010000:1.0:1777051432.146658:0:47827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1777051432.146989:0:27887:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1777051432.146995:0:27887:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1777051432.147001:0:6566:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777051432.147001:0:27887:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c9e5ad62/0x85f51a6b96716644 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x104:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 27887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051432.147048:0:6566:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a3400/0x85f51a6b9671661a lrc: 0/0,0 mode: --/PR res: [0x240000bd2:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6523 expref: 26 pid: 46494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051432.147050:0:27887:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009a997f2b/0x85f51a6b9671640d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x104:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6458 expref: 56 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051432.147087:0:47827:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7e24f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+26:2437:x1863365425992832:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 516us (734us total) trans 0 rc 0/0 00010000:00010000:2.0:1777051432.147101:0:6566:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x1:0x0].0x0 (ffff99d943f76b00) 00010000:00010000:3.0:1777051432.147104:0:27887:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009a997f2b/0x85f51a6b9671640d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x104:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6458 expref: 56 pid: 8468 timeout: 8161 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051432.147115:0:47827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13695 00010000:00010000:2.0:1777051432.147115:0:6566:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1777051432.147144:0:27887:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da444a3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:27887:1863365452636544:192.168.201.46@tcp:104: 00000100:00100000:2.0:1777051432.147172:0:6566:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7e24e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+24:2437:x1863365425992960:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 540us (761us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051432.147188:0:6566:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13696 00000100:00100000:2.0:1777051432.147349:0:27887:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da43840cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1777051432.149491:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051432.149651:0:8470:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f9bca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8470:1863365452636416:192.168.201.46@tcp:104: 00010000:00010000:2.0:1777051432.149682:0:8470:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000002fab269b/0x85f51a6b9671663d lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0x103:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051432.150133:0:13320:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425993088 00000100:00100000:3.0:1777051432.150143:0:13320:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425993088 00000100:00100000:3.0:1777051432.150246:0:13320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 8018 00000100:00100000:3.0:1777051432.150263:0:13320:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7e24df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+57:2436:x1863365425993088:12345-192.168.201.46@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1777051432.150302:0:13320:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000554aaf12/0x85f51a6b9671664b lrc: 3/1,0 mode: --/PR res: [0x280000400:0x103:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051432.150327:0:13320:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002b072fde/0x85f51a6b96716373 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x103:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6420 expref: 57 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051432.150341:0:13320:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1777051432.150345:0:13320:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1777051432.150350:0:13320:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000554aaf12/0x85f51a6b9671664b lrc: 4/1,0 mode: --/PR res: [0x280000400:0x103:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051432.150386:0:13320:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002b072fde/0x85f51a6b96716373 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x103:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6420 expref: 57 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051432.150405:0:13320:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002b072fde/0x85f51a6b96716373 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x103:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6420 expref: 57 pid: 8471 timeout: 8161 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051432.150426:0:13320:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da444a1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:13320:1863365452636672:192.168.201.46@tcp:104: 00000100:00100000:3.0:1777051432.151143:0:13320:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da43840900 going to sleep for 11 seconds 00000100:00100000:1.0:1777051432.151396:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051432.151522:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051432.152131:0:55658:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425993344 00000100:00100000:3.0:1777051432.152140:0:55658:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425993344 00002000:00100000:3.0:1777051432.152182:0:55658:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000400:0x103:0x0] (0->1048575) req@ffff99da5f9bea00 x1863365425993344/t0(0) o4->c11b6966-0775-44d2-bdc6-c74c26eb2226@192.168.201.46@tcp:393/0 lens 488/0 e 0 to 0 dl 1777051443 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1777051432.152226:0:55658:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99da5f9bea00 with x1863365425993344 ext(0->1048575) 00010000:00010000:3.0:1777051432.152237:0:55658:0:(ldlm_extent.c:759:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000005bb71356/0x85f51a6b967163c0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x103:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b643c expref: 51 pid: 27887 timeout: 8161 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051432.152258:0:55658:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000005bb71356/0x85f51a6b967163c0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x103:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b643c expref: 51 pid: 27887 timeout: 8161 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1777051432.152271:0:55658:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff99da5f9bea00 00000100:00100000:3.0:1777051432.152312:0:55658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 70 00000100:00100000:3.0:1777051432.152328:0:55658:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:c11b6966-0775-44d2-bdc6-c74c26eb2226+51:2436:x1863365425993344:12345-192.168.201.46@tcp:4:dd.0 00000100:00100000:2.0:1777051432.152380:0:6579:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425993216 00000100:00100000:2.0:1777051432.152389:0:6579:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425993216 00000100:00100000:2.0:1777051432.152461:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112105 00000100:00100000:2.0:1777051432.152474:0:6579:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+30:138059:x1863365425993216:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1777051432.152492:0:6579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051432.152514:0:6579:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eccd000/0x85f51a6b96716652 lrc: 2/0,0 mode: --/PR res: [0x2000032e3:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b652a expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051432.152556:0:6579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eccc200/0x85f51a6b96716659 lrc: 3/1,0 mode: --/PR res: [0x2000032e3:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051432.152575:0:6579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eccc200/0x85f51a6b96716659 lrc: 3/1,0 mode: PR/PR res: [0x2000032e3:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051432.152591:0:6579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eccc200/0x85f51a6b96716659 lrc: 3/1,0 mode: PR/PR res: [0x2000032e3:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051432.152733:0:6579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eccd000/0x85f51a6b96716652 lrc: 0/0,0 mode: --/PR res: [0x2000032e3:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b652a expref: 32 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051432.153811:0:6579:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eccc200/0x85f51a6b96716659 lrc: 3/0,0 mode: PR/PR res: [0x2000032e3:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b652a expref: 31 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051432.153828:0:6579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e3:0x6:0x0].0x0 (ffff99d9413d0c00) 00010000:00010000:2.0:1777051432.153834:0:6579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1777051432.153839:0:6579:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d94eccc200, rc 0) 00000100:00100000:2.0:1777051432.153929:0:6579:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+31:138059:x1863365425993216:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 Request processed in 1455us (2535us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051432.153942:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112105 00000100:00100000:0.0:1777051432.159662:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051432.159680:0:27887:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da444a3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:27887:1863365452636544:192.168.201.46@tcp:104: 00010000:00010000:2.0:1777051432.159721:0:27887:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c9e5ad62/0x85f51a6b96716644 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x104:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 27887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051432.159761:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051432.159846:0:46203:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425993472 00000100:00100000:1.0:1777051432.159859:0:46203:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425993472 00002000:00100000:1.0:1777051432.159943:0:46203:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000400:0x104:0x0] (0->1048575) req@ffff99da7e24ed80 x1863365425993472/t0(0) o4->c11b6966-0775-44d2-bdc6-c74c26eb2226@192.168.201.46@tcp:393/0 lens 488/0 e 0 to 0 dl 1777051443 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1777051432.159961:0:46203:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99da7e24ed80 with x1863365425993472 ext(0->1048575) 00010000:00010000:1.0:1777051432.159973:0:46203:0:(ldlm_extent.c:759:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000009a997f2b/0x85f51a6b9671640d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x104:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6458 expref: 58 pid: 8468 timeout: 8161 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051432.159996:0:46203:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000009a997f2b/0x85f51a6b9671640d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x104:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6458 expref: 58 pid: 8468 timeout: 8161 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1777051432.160012:0:46203:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff99da7e24ed80 00000100:00100000:1.0:1777051432.160059:0:46203:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425993600 00000100:00100000:1.0:1777051432.160066:0:46203:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425993600 00002000:00100000:1.0:1777051432.160096:0:46203:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000400:0x103:0x0] (0->1048575) req@ffff99da7e24f100 x1863365425993600/t0(0) o4->c11b6966-0775-44d2-bdc6-c74c26eb2226@192.168.201.46@tcp:393/0 lens 488/0 e 0 to 0 dl 1777051443 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1777051432.160112:0:46203:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99da7e24f100 with x1863365425993600 ext(0->1048575) 00010000:00010000:1.0:1777051432.160126:0:46203:0:(ldlm_extent.c:759:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000002b072fde/0x85f51a6b96716373 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x103:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6420 expref: 59 pid: 8471 timeout: 8161 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051432.160138:0:8475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 71 00010000:00010000:1.0:1777051432.160160:0:46203:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000002b072fde/0x85f51a6b96716373 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x103:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6420 expref: 59 pid: 8471 timeout: 8161 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051432.160170:0:8475:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7e24ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+59:2439:x1863365425993472:12345-192.168.201.46@tcp:4:dd.0 00002000:00010000:1.0:1777051432.160190:0:46203:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff99da7e24f100 00000100:00100000:1.0:1777051432.160277:0:46203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 72 00000100:00100000:1.0:1777051432.160293:0:46203:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7e24f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:c11b6966-0775-44d2-bdc6-c74c26eb2226+59:2437:x1863365425993600:12345-192.168.201.46@tcp:4:dd.0 00000100:00100000:3.0:1777051432.161568:0:13320:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da444a1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:13320:1863365452636672:192.168.201.46@tcp:104: 00000100:00100000:0.0:1777051432.161607:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00010000:00010000:3.0:1777051432.161608:0:13320:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000554aaf12/0x85f51a6b9671664b lrc: 3/1,0 mode: --/PR res: [0x280000400:0x103:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051432.161713:0:21368:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425993728 00000100:00100000:0.0:1777051432.161721:0:21368:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425993728 00000100:00100000:0.0:1777051432.161797:0:21368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112106 00000100:00100000:0.0:1777051432.161812:0:21368:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7e24d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+31:138059:x1863365425993728:12345-192.168.201.46@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1777051432.161839:0:21368:0:(mdt_handler.c:7958:mdt_fid2path()) path get [0x2000032e3:0x6:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1777051432.162089:0:21368:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7e24d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+31:138059:x1863365425993728:12345-192.168.201.46@tcp:53:lhsmtool_posix.0 Request processed in 279us (496us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051432.162103:0:21368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112106 00000100:00100000:1.0:1777051432.169753:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051432.170243:0:24468:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425993856 00000100:00100000:2.0:1777051432.170256:0:24468:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425993856 00000100:00100000:2.0:1777051432.170331:0:24468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 8019 00000100:00100000:2.0:1777051432.170348:0:24468:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+62:2437:x1863365425993856:12345-192.168.201.46@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1777051432.170409:0:24468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006da87666/0x85f51a6b96716660 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x1e4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051432.170435:0:24468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777051432.170439:0:24468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777051432.170448:0:24468:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006da87666/0x85f51a6b96716660 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x1e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051432.170471:0:24468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006da87666/0x85f51a6b96716660 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x1e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051432.170506:0:24468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006da87666/0x85f51a6b96716660 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x1e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051432.170522:0:24468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006da87666/0x85f51a6b96716660 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x1e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051432.170539:0:24468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006da87666/0x85f51a6b96716660 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x1e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051432.170553:0:24468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94eccd000 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:2.0:1777051432.170561:0:24468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006da87666/0x85f51a6b96716660 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x1e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051432.170578:0:24468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006da87666/0x85f51a6b96716660 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x1e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051432.170604:0:24468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006da87666/0x85f51a6b96716660 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x1e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051432.170620:0:24468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006da87666/0x85f51a6b96716660 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x1e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051432.170720:0:24468:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+62:2437:x1863365425993856:12345-192.168.201.46@tcp:1:lhsmtool_posix.0 Request processed in 374us (976us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051432.170734:0:24468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 8019 00000100:00100000:2.0:1777051432.175192:0:55658:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:c11b6966-0775-44d2-bdc6-c74c26eb2226+53:2436:x1863365425993344:12345-192.168.201.46@tcp:4:dd.0 Request processed in 22860us (23663us total) trans 4294968358 rc 0/0 00000100:00100000:2.0:1777051432.175216:0:55658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 70 00002000:00100000:2.0:1777051432.175232:0:55658:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000400:0x103:0x0] (0->1048575) req@ffff99da5f9bea00 x1863365425993344/t4294968358(0) o4->c11b6966-0775-44d2-bdc6-c74c26eb2226@192.168.201.46@tcp:393/0 lens 488/448 e 0 to 0 dl 1777051443 ref 1 fl Complete:H/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1777051432.175250:0:55658:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99da5f9bea00 with x1863365425993344 ext(0->1048575) 00010000:00010000:2.0:1777051432.175262:0:55658:0:(ldlm_extent.c:759:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000005bb71356/0x85f51a6b967163c0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x103:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b643c expref: 53 pid: 27887 timeout: 8161 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051432.175288:0:55658:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000005bb71356/0x85f51a6b967163c0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x103:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b643c expref: 53 pid: 27887 timeout: 8161 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1777051432.175303:0:55658:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff99da5f9bea00 00000100:00100000:0.0:1777051432.181453:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051432.181649:0:6581:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425994112 00000100:00100000:2.0:1777051432.181662:0:6581:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425994112 00000100:00100000:2.0:1777051432.181761:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112107 00000100:00100000:2.0:1777051432.182611:0:6581:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7e24d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+31:138059:x1863365425994112:12345-192.168.201.46@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1777051432.182710:0:6581:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eccd000/0x85f51a6b96716667 lrc: 3/0,1 mode: --/PW res: [0x2000032e3:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051432.182738:0:6581:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eccc200/0x85f51a6b96716659 lrc: 2/0,0 mode: PR/PR res: [0x2000032e3:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b652a expref: 31 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051432.183098:0:6581:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eccd000/0x85f51a6b96716667 lrc: 4/0,1 mode: --/PW res: [0x2000032e3:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051432.183153:0:6581:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eccc200/0x85f51a6b96716659 lrc: 3/0,0 mode: PR/PR res: [0x2000032e3:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b652a expref: 31 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051432.183180:0:6581:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eccc200/0x85f51a6b96716659 lrc: 4/0,0 mode: PR/PR res: [0x2000032e3:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b652a expref: 31 pid: 6579 timeout: 8161 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051432.183311:0:6581:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f9fea00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6581:1863365452636800:192.168.201.46@tcp:104: 00000100:00100000:2.0:1777051432.183422:0:6581:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d956bdad80 going to sleep for 11 seconds 00000100:00100000:1.0:1777051432.183955:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051432.184044:0:24467:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425994240 00000100:00100000:2.0:1777051432.184054:0:24467:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425994240 00010000:00010000:2.0:1777051432.184095:0:24467:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005bb71356/0x85f51a6b967163c0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x103:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b643c expref: 53 pid: 27887 timeout: 8161 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051432.184155:0:24467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3879 00000100:00100000:2.0:1777051432.184173:0:24467:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9bc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+53:2437:x1863365425994240:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1777051432.184193:0:24467:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1777051432.184518:0:24467:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x2c0000400:0x103:0x0] updating lvb blocks from disk: 1 -> 2048 00010000:00010000:2.0:1777051432.184531:0:24467:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005bb71356/0x85f51a6b967163c0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x103:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b643c expref: 53 pid: 27887 timeout: 8161 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051432.184550:0:24467:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005bb71356/0x85f51a6b967163c0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x103:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b643c expref: 53 pid: 27887 timeout: 8161 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051432.184580:0:24467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005bb71356/0x85f51a6b967163c0 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x103:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b643c expref: 53 pid: 27887 timeout: 8161 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051432.184604:0:24467:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777051432.184607:0:24467:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777051432.184614:0:24467:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002fab269b/0x85f51a6b9671663d lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0x103:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051432.184629:0:24467:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002fab269b/0x85f51a6b9671663d lrc: 4/1,0 mode: PR/PR res: [0x2c0000400:0x103:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051432.184680:0:24467:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1777051432.185061:0:24467:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9bc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+52:2437:x1863365425994240:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 891us (1109us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051432.185075:0:24467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3879 00000100:00100000:3.0:1777051432.185642:0:46203:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7e24f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:c11b6966-0775-44d2-bdc6-c74c26eb2226+62:2437:x1863365425993600:12345-192.168.201.46@tcp:4:dd.0 Request processed in 25351us (25884us total) trans 4294968356 rc 0/0 00000100:00100000:3.0:1777051432.185655:0:46203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 72 00002000:00100000:3.0:1777051432.185669:0:46203:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000400:0x103:0x0] (0->1048575) req@ffff99da7e24f100 x1863365425993600/t4294968356(0) o4->c11b6966-0775-44d2-bdc6-c74c26eb2226@192.168.201.46@tcp:393/0 lens 488/448 e 0 to 0 dl 1777051443 ref 1 fl Complete:H/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1777051432.185687:0:46203:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99da7e24f100 with x1863365425993600 ext(0->1048575) 00010000:00010000:3.0:1777051432.185702:0:46203:0:(ldlm_extent.c:759:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000002b072fde/0x85f51a6b96716373 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x103:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6420 expref: 62 pid: 8471 timeout: 8161 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051432.186036:0:46203:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000002b072fde/0x85f51a6b96716373 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x103:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6420 expref: 62 pid: 8471 timeout: 8161 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1777051432.186055:0:46203:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff99da7e24f100 00010000:00010000:1.0:1777051432.186062:0:8470:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000002fab269b/0x85f51a6b9671663d lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0x103:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051432.186086:0:8470:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002fab269b/0x85f51a6b9671663d lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0x103:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051432.186123:0:8470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000002fab269b/0x85f51a6b9671663d lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0x103:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051432.186140:0:8470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002fab269b/0x85f51a6b9671663d lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x103:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051432.186157:0:8470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002fab269b/0x85f51a6b9671663d lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x103:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051432.186172:0:8470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94e48bc00 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:1.0:1777051432.186180:0:8470:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002fab269b/0x85f51a6b9671663d lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x103:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051432.186252:0:8470:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002fab269b/0x85f51a6b9671663d lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x103:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051432.186282:0:8470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002fab269b/0x85f51a6b9671663d lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x103:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051432.186318:0:8470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002fab269b/0x85f51a6b9671663d lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x103:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051432.186420:0:8470:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7e24f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+51:2437:x1863365425992448:12345-192.168.201.46@tcp:1:lhsmtool_posix.0 Request processed in 43829us (45013us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051432.186435:0:8470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 8016 00000100:00100000:2.0:1777051432.188807:0:8475:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7e24ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+62:2439:x1863365425993472:12345-192.168.201.46@tcp:4:dd.0 Request processed in 28646us (29148us total) trans 4294968357 rc 0/0 00000100:00100000:2.0:1777051432.188825:0:8475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 71 00002000:00100000:2.0:1777051432.188839:0:8475:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000400:0x104:0x0] (0->1048575) req@ffff99da7e24ed80 x1863365425993472/t4294968357(0) o4->c11b6966-0775-44d2-bdc6-c74c26eb2226@192.168.201.46@tcp:393/0 lens 488/448 e 0 to 0 dl 1777051443 ref 1 fl Complete:H/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1777051432.188856:0:8475:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99da7e24ed80 with x1863365425993472 ext(0->1048575) 00010000:00010000:2.0:1777051432.188868:0:8475:0:(ldlm_extent.c:759:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000009a997f2b/0x85f51a6b9671640d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x104:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6458 expref: 62 pid: 8468 timeout: 8161 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051432.188925:0:8475:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000009a997f2b/0x85f51a6b9671640d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x104:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6458 expref: 62 pid: 8468 timeout: 8161 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1777051432.188940:0:8475:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff99da7e24ed80 00000100:00100000:3.0:1777051432.189060:0:6581:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f9fea00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6581:1863365452636800:192.168.201.46@tcp:104: 00010000:00010000:3.0:1777051432.189093:0:6581:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eccd000/0x85f51a6b96716667 lrc: 3/0,1 mode: --/PW res: [0x2000032e3:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051432.189319:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051432.189595:0:6564:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425994368 00000100:00100000:2.0:1777051432.189604:0:6564:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425994368 00010000:00010000:2.0:1777051432.189643:0:6564:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eccc200/0x85f51a6b96716659 lrc: 4/0,0 mode: PR/PR res: [0x2000032e3:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b652a expref: 32 pid: 6579 timeout: 8161 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051432.189697:0:6564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3880 00000100:00100000:2.0:1777051432.189710:0:6564:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9bf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+32:2437:x1863365425994368:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1777051432.189725:0:6564:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777051432.189737:0:6564:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eccc200/0x85f51a6b96716659 lrc: 4/0,0 mode: PR/PR res: [0x2000032e3:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b652a expref: 32 pid: 6579 timeout: 8161 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051432.190092:0:6564:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eccc200/0x85f51a6b96716659 lrc: 3/0,0 mode: PR/PR res: [0x2000032e3:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b652a expref: 32 pid: 6579 timeout: 8161 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051432.190123:0:6564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eccc200/0x85f51a6b96716659 lrc: 0/0,0 mode: --/PR res: [0x2000032e3:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b652a expref: 32 pid: 6579 timeout: 8161 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051432.190146:0:6564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e3:0x6:0x0].0x0 (ffff99d9413d0c00) 00010000:00010000:2.0:1777051432.190153:0:6564:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eccd000/0x85f51a6b96716667 lrc: 3/0,1 mode: --/PW res: [0x2000032e3:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051432.190175:0:6564:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eccd000/0x85f51a6b96716667 lrc: 3/0,1 mode: PW/PW res: [0x2000032e3:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051432.190188:0:6564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eccd000/0x85f51a6b96716667 lrc: 4/0,1 mode: PW/PW res: [0x2000032e3:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051432.190285:0:6564:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1777051432.190361:0:6581:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eccd000/0x85f51a6b96716667 lrc: 3/0,1 mode: PW/PW res: [0x2000032e3:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051432.190387:0:6581:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eccd000/0x85f51a6b96716667 lrc: 3/0,1 mode: PW/PW res: [0x2000032e3:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051432.190612:0:6581:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eccd000/0x85f51a6b96716667 lrc: 3/0,1 mode: PW/PW res: [0x2000032e3:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051432.190632:0:6581:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eccd000/0x85f51a6b96716667 lrc: 2/0,0 mode: PW/PW res: [0x2000032e3:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051432.190639:0:6581:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eccd000/0x85f51a6b96716667 lrc: 3/0,0 mode: PW/PW res: [0x2000032e3:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051432.190646:0:6581:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94eccd000 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:0.0:1777051432.190652:0:6581:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eccd000/0x85f51a6b96716667 lrc: 3/0,0 mode: PW/PW res: [0x2000032e3:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051432.190663:0:6581:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eccd000/0x85f51a6b96716667 lrc: 4/0,0 mode: PW/PW res: [0x2000032e3:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051432.190679:0:6581:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e3:0x6:0x0].0x0 (ffff99d9413d0c00) 00010000:00010000:0.0:1777051432.190996:0:6581:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1777051432.191006:0:6581:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eccd000/0x85f51a6b96716667 lrc: 2/0,0 mode: --/PW res: [0x2000032e3:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051432.191019:0:6581:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eccd000/0x85f51a6b96716667 lrc: 0/0,0 mode: --/PW res: [0x2000032e3:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1777051432.191343:0:103189:0:(llog.c:801:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:1.0:1777051432.191351:0:103189:0:(llog_cat.c:158:llog_cat_process_common()) processing log [0x1:0x2b:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1777051432.191379:0:103189:0:(llog.c:858:llog_process_thread()) stop processing plain [0x1:0x2b:0x0] index 6 count 4 00000040:00080000:1.0:1777051432.191388:0:103189:0:(llog.c:858:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00000100:00100000:2.0:1777051432.191484:0:6564:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9bf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+32:2437:x1863365425994368:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 1771us (2170us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051432.191486:0:6581:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7e24d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+32:138059:x1863365425994112:12345-192.168.201.46@tcp:57:lhsmtool_posix.0 Request processed in 9704us (10037us total) trans 30064771165 rc 0/0 00000100:00100000:2.0:1777051432.191524:0:6564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3880 00000100:00100000:0.0:1777051432.191527:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112107 00000100:00100000:3.0:1777051432.191911:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051432.192100:0:6580:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425994624 00000100:00100000:0.0:1777051432.192111:0:6580:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425994624 00000100:00100000:0.0:1777051432.192185:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112108 00000100:00100000:0.0:1777051432.192201:0:6580:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da444a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+24:138061:x1863365425994624:12345-192.168.201.46@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1777051432.192314:0:6580:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da444a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+24:138061:x1863365425994624:12345-192.168.201.46@tcp:57:lhsmtool_posix.0 Request processed in 114us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051432.192330:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112108 00000100:00100000:3.0:1777051432.193716:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051432.194340:0:9550:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425994752 00000100:00100000:1.0:1777051432.194349:0:9550:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425994752 00010000:00010000:1.0:1777051432.194385:0:9550:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002b072fde/0x85f51a6b96716373 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x103:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6420 expref: 62 pid: 8471 timeout: 8161 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051432.194442:0:9550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3881 00000100:00100000:1.0:1777051432.194456:0:9550:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da6fd43850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+62:2436:x1863365425994752:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1777051432.194472:0:9550:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1777051432.194492:0:9550:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x103:0x0] updating lvb blocks from disk: 1 -> 2048 00010000:00010000:1.0:1777051432.194504:0:9550:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002b072fde/0x85f51a6b96716373 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x103:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6420 expref: 62 pid: 8471 timeout: 8161 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051432.194525:0:9550:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002b072fde/0x85f51a6b96716373 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x103:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6420 expref: 62 pid: 8471 timeout: 8161 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051432.194553:0:9550:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002b072fde/0x85f51a6b96716373 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x103:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6420 expref: 62 pid: 8471 timeout: 8161 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051432.194585:0:9550:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051432.194588:0:9550:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051432.194594:0:9550:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000554aaf12/0x85f51a6b9671664b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x103:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051432.194611:0:9550:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000554aaf12/0x85f51a6b9671664b lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x103:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051432.194678:0:9550:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1777051432.194745:0:9550:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da6fd43850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+61:2436:x1863365425994752:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 289us (1027us total) trans 0 rc 0/0 00010000:00010000:3.0:1777051432.194754:0:13320:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000554aaf12/0x85f51a6b9671664b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x103:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051432.194764:0:9550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3881 00010000:00010000:3.0:1777051432.195394:0:13320:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000554aaf12/0x85f51a6b9671664b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x103:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051432.195431:0:13320:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000554aaf12/0x85f51a6b9671664b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x103:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051432.195447:0:13320:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000554aaf12/0x85f51a6b9671664b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x103:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051432.195463:0:13320:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000554aaf12/0x85f51a6b9671664b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x103:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051432.195476:0:13320:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d9559a3800 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:3.0:1777051432.195483:0:13320:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000554aaf12/0x85f51a6b9671664b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x103:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051432.195498:0:13320:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000554aaf12/0x85f51a6b9671664b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x103:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051432.195531:0:13320:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000554aaf12/0x85f51a6b9671664b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x103:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051432.195545:0:13320:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000554aaf12/0x85f51a6b9671664b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x103:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051432.195636:0:13320:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7e24df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+60:2436:x1863365425993088:12345-192.168.201.46@tcp:1:lhsmtool_posix.0 Request processed in 45374us (46392us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051432.195652:0:13320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 8018 00000100:00100000:3.0:1777051432.198734:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051432.198771:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051432.198875:0:6566:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425995136 00000100:00100000:2.0:1777051432.198918:0:6566:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425995136 00010000:00010000:2.0:1777051432.198956:0:6566:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009a997f2b/0x85f51a6b9671640d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x104:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6458 expref: 60 pid: 8468 timeout: 8161 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051432.199134:0:6566:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3882 00000100:00100000:2.0:1777051432.199150:0:6566:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da444a3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+60:2438:x1863365425995136:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1777051432.199167:0:6566:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1777051432.199181:0:6566:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x104:0x0] updating lvb blocks from disk: 1 -> 2048 00010000:00010000:2.0:1777051432.199191:0:6566:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009a997f2b/0x85f51a6b9671640d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x104:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6458 expref: 60 pid: 8468 timeout: 8161 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051432.199211:0:6566:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009a997f2b/0x85f51a6b9671640d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x104:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6458 expref: 60 pid: 8468 timeout: 8161 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051432.199235:0:6566:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a997f2b/0x85f51a6b9671640d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x104:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6458 expref: 60 pid: 8468 timeout: 8161 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051432.199255:0:6566:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777051432.199258:0:6566:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777051432.199264:0:6566:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c9e5ad62/0x85f51a6b96716644 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x104:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 27887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051432.199280:0:6566:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c9e5ad62/0x85f51a6b96716644 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x104:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 27887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051432.199567:0:6566:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1777051432.199586:0:6583:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425995008 00000100:00100000:0.0:1777051432.199597:0:6583:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425995008 00000100:00100000:2.0:1777051432.199621:0:6566:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da444a3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+59:2438:x1863365425995136:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 474us (847us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051432.199634:0:6566:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3882 00000100:00100000:0.0:1777051432.199675:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3366 00000100:00100000:0.0:1777051432.199695:0:6583:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da444a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+31:138059:x1863365425995008:12345-192.168.201.46@tcp:35:lhsmtool_posix.0 00010000:00010000:3.0:1777051432.199726:0:27887:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c9e5ad62/0x85f51a6b96716644 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x104:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 27887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051432.199749:0:27887:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c9e5ad62/0x85f51a6b96716644 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x104:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 27887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051432.199784:0:27887:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c9e5ad62/0x85f51a6b96716644 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x104:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 27887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051432.199800:0:27887:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c9e5ad62/0x85f51a6b96716644 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x104:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 27887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051432.199814:0:27887:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c9e5ad62/0x85f51a6b96716644 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x104:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 27887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051432.199837:0:27887:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d9559a2c00 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:3.0:1777051432.199844:0:27887:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c9e5ad62/0x85f51a6b96716644 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x104:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 27887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051432.200142:0:6583:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da444a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+32:138059:x1863365425995008:12345-192.168.201.46@tcp:35:lhsmtool_posix.0 Request processed in 451us (1408us total) trans 30064771166 rc 0/0 00000100:00100000:0.0:1777051432.200157:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3366 00010000:00010000:3.0:1777051432.200583:0:27887:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c9e5ad62/0x85f51a6b96716644 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x104:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 27887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051432.200608:0:27887:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c9e5ad62/0x85f51a6b96716644 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x104:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 27887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051432.200622:0:27887:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c9e5ad62/0x85f51a6b96716644 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x104:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 27887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051432.200634:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051432.200758:0:8471:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425995264 00000100:00100000:0.0:1777051432.200769:0:8471:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425995264 00000100:00100000:3.0:1777051432.200791:0:27887:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7e24fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c11b6966-0775-44d2-bdc6-c74c26eb2226+58:2437:x1863365425992704:12345-192.168.201.46@tcp:1:lhsmtool_posix.0 Request processed in 54259us (54511us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051432.200872:0:27887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 8017 00000100:00100000:0.0:1777051432.200949:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 8020 00000100:00100000:0.0:1777051432.200967:0:8471:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+51:2438:x1863365425995264:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1777051432.200984:0:8471:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051432.201008:0:8471:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000077750da1/0x85f51a6b9671666e lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x103:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6531 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1777051432.201038:0:8471:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x103:0x0] initial LVB size: 1048576, mtime: 0x69eba726, atime: 0x0, ctime: 0x69eba726, blocks: 0x800 00010000:00010000:0.0:1777051432.201386:0:8471:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777051432.201391:0:8471:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777051432.201402:0:8471:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000077750da1/0x85f51a6b9671666e lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x103:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6531 expref: 52 pid: 8471 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051432.201430:0:8471:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000077750da1/0x85f51a6b9671666e lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x103:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6531 expref: 52 pid: 8471 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051432.201458:0:8471:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d94eb2be00, rc 0) 00000100:00100000:0.0:1777051432.201617:0:8471:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+52:2438:x1863365425995264:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 Request processed in 651us (989us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051432.201631:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 8020 00000100:00100000:2.0:1777051432.203146:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051432.203240:0:8492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425995520 00000100:00100000:3.0:1777051432.203249:0:8492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425995520 00000100:00100000:3.0:1777051432.203390:0:8492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112109 00000100:00100000:3.0:1777051432.203405:0:8492:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+24:138060:x1863365425995520:12345-192.168.201.46@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1777051432.203522:0:8492:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+24:138060:x1863365425995520:12345-192.168.201.46@tcp:57:lhsmtool_posix.0 Request processed in 119us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051432.203535:0:8492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112109 00000100:00100000:1.0:1777051432.206020:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051432.206127:0:46497:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425995776 00000100:00100000:0.0:1777051432.206137:0:46497:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425995776 00000100:00100000:0.0:1777051432.206242:0:46497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112110 00000100:00100000:0.0:1777051432.206264:0:46497:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:c11b6966-0775-44d2-bdc6-c74c26eb2226+24:138062:x1863365425995776:12345-192.168.201.46@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1777051432.206365:0:46497:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:c11b6966-0775-44d2-bdc6-c74c26eb2226+24:138062:x1863365425995776:12345-192.168.201.46@tcp:57:lhsmtool_posix.0 Request processed in 109us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051432.206378:0:46497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112110 00000100:00100000:1.0:1777051432.209458:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051432.209562:0:10328:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425996032 00000100:00100000:3.0:1777051432.209572:0:10328:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425996032 00000100:00100000:3.0:1777051432.209627:0:10328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112111 00000100:00100000:3.0:1777051432.210001:0:10328:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+24:138061:x1863365425996032:12345-192.168.201.46@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1777051432.210105:0:10328:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+24:138061:x1863365425996032:12345-192.168.201.46@tcp:57:lhsmtool_posix.0 Request processed in 462us (643us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051432.210121:0:10328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112111 00000100:00100000:1.0:1777051432.210146:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051432.210616:0:8468:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425996160 00000100:00100000:0.0:1777051432.210627:0:8468:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425996160 00000100:00100000:0.0:1777051432.210691:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 8021 00000100:00100000:0.0:1777051432.210705:0:8468:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+58:2438:x1863365425996160:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1777051432.210729:0:8468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051432.210756:0:8468:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000067c7f5ed/0x85f51a6b96716675 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x103:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6538 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1777051432.210808:0:8468:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x103:0x0] initial LVB size: 1048576, mtime: 0x69eba726, atime: 0x0, ctime: 0x69eba726, blocks: 0x800 00010000:00010000:0.0:1777051432.210830:0:8468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777051432.210834:0:8468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777051432.210845:0:8468:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067c7f5ed/0x85f51a6b96716675 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x103:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6538 expref: 59 pid: 8468 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051432.210872:0:8468:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000067c7f5ed/0x85f51a6b96716675 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x103:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6538 expref: 59 pid: 8468 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051432.210922:0:8468:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d94eb2b600, rc 0) 00000100:00100000:0.0:1777051432.210982:0:8468:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+59:2438:x1863365425996160:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 Request processed in 279us (841us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051432.210994:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 8021 00000100:00100000:2.0:1777051432.211647:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051432.211725:0:24468:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425996288 00000100:00100000:1.0:1777051432.211735:0:24468:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425996288 00000100:00100000:1.0:1777051432.211802:0:24468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 8022 00000100:00100000:1.0:1777051432.211816:0:24468:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+59:2436:x1863365425996288:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1777051432.211832:0:24468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777051432.211852:0:24468:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000005fefa63/0x85f51a6b9671667c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x104:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b653f expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1777051432.211879:0:24468:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x104:0x0] initial LVB size: 1048576, mtime: 0x69eba726, atime: 0x0, ctime: 0x69eba726, blocks: 0x800 00010000:00010000:1.0:1777051432.211934:0:24468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051432.211938:0:24468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051432.211948:0:24468:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000005fefa63/0x85f51a6b9671667c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x104:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b653f expref: 60 pid: 24468 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051432.211971:0:24468:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000005fefa63/0x85f51a6b9671667c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x104:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b653f expref: 60 pid: 24468 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051432.211987:0:24468:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d94e48b200, rc 0) 00000100:00100000:1.0:1777051432.212048:0:24468:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+60:2436:x1863365425996288:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 Request processed in 233us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051432.212057:0:24468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 8022 00000100:00100000:2.0:1777051432.213550:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051432.213830:0:27882:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425996544 00000100:00100000:1.0:1777051432.213839:0:27882:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425996544 00000100:00100000:1.0:1777051432.213935:0:27882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112112 00000100:00100000:1.0:1777051432.213951:0:27882:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+24:138060:x1863365425996544:12345-192.168.201.46@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1777051432.214076:0:27882:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+24:138060:x1863365425996544:12345-192.168.201.46@tcp:57:lhsmtool_posix.0 Request processed in 127us (528us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051432.214089:0:27882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112112 00000100:00100000:0.0:1777051432.214719:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da444a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3678:1863365452636928:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1777051432.214786:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051432.214907:0:11727:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452636928 00000100:00100000:2.0:1777051432.214934:0:11727:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452636928 00000100:00100000:2.0:1777051432.215012:0:11727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8181 00000100:00100000:2.0:1777051432.215035:0:11727:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7e24dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3678:x1863365452636928:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1777051432.215078:0:11727:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4194304 pending 0 free 1446113280 avail 1299873792 00000100:00100000:3.0:1777051432.215127:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f9be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3679:1863365452637056:0@lo:400:kworker.0 00000100:00100000:2.0:1777051432.215171:0:11727:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7e24dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3678:x1863365452636928:12345-0@lo:41:osp-pre-1-0.0 Request processed in 142us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051432.215188:0:11727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8181 00000100:00100000:3.0:1777051432.215261:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051432.215297:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f9bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3680:1863365452637184:0@lo:400:kworker.0 00000100:00100000:1.0:1777051432.215363:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051432.215405:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f9bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3680:1863365452637696:0@lo:400:kworker.0 00000100:00100000:3.0:1777051432.215425:0:27885:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452637184 00000100:00100000:3.0:1777051432.215435:0:27885:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452637184 00000100:00100000:1.0:1777051432.215455:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051432.215510:0:27885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13399 00000100:00100000:1.0:1777051432.215512:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95fbaf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3680:1863365452638208:0@lo:400:kworker.0 00000100:00100000:3.0:1777051432.215532:0:27885:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95fbaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000-lwp-OST0000_UUID+5:3680:x1863365452637184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777051432.215564:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1777051432.215574:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1777051432.215623:0:27885:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95fbaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000-lwp-OST0000_UUID+5:3680:x1863365452637184:12345-0@lo:400:kworker.0 Request processed in 96us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051432.215639:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f9bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3679:1863365452637568:0@lo:400:kworker.0 00000100:00100000:3.0:1777051432.215642:0:27885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13399 00000100:00100000:1.0:1777051432.215667:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f9bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3680:1863365452637184:0@lo:400:kworker.0 00000100:00100000:2.0:1777051432.215711:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051432.215767:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95fbad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452638080:0@lo:400:kworker.0 00000100:00100000:1.0:1777051432.215782:0:103169:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452637056 00000100:00100000:1.0:1777051432.215791:0:103169:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452637056 00000100:00100000:2.0:1777051432.215820:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051432.215858:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f9bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3677:1863365452637312:0@lo:400:kworker.0 00000100:00100000:1.0:1777051432.215868:0:103169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1777051432.215924:0:103169:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942d2ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f9351a01-5b0e-4470-97fd-58b9b4b312a2+23:3679:x1863365452637056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777051432.215984:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051432.215994:0:8492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452637568 00000100:00100000:3.0:1777051432.216006:0:8492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452637568 00000100:00100000:2.0:1777051432.216040:0:27887:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452637696 00000100:00100000:0.0:1777051432.216047:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94f168700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3677:1863365452637824:0@lo:400:kworker.0 00000100:00100000:2.0:1777051432.216052:0:27887:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452637696 00000100:00100000:1.0:1777051432.216075:0:103169:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942d2ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f9351a01-5b0e-4470-97fd-58b9b4b312a2+23:3679:x1863365452637056:12345-0@lo:400:kworker.0 Request processed in 187us (816us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051432.216093:0:103169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1777051432.216104:0:8492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452637312 00000100:00100000:3.0:1777051432.216115:0:8492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452637312 00000100:00100000:0.0:1777051432.216125:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051432.216150:0:27887:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452638208 00000100:00100000:2.0:1777051432.216162:0:27887:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452638208 00000100:00100000:1.0:1777051432.216180:0:8628:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452638080 00000100:00100000:0.0:1777051432.216181:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95fbad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3677:1863365452638336:0@lo:400:kworker.0 00000100:00100000:3.0:1777051432.216195:0:8492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13400 00000100:00100000:3.0:1777051432.216218:0:8492:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3679:x1863365452637568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777051432.216231:0:27887:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452637824 00000100:00100000:1.0:1777051432.216240:0:8628:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452638080 00000100:00100000:2.0:1777051432.216240:0:27887:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452637824 00000100:00100000:1.0:1777051432.216335:0:8628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10447 00000100:00100000:1.0:1777051432.216356:0:8628:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95fbafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3680:x1863365452637696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051432.216372:0:8492:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3679:x1863365452637568:12345-0@lo:400:kworker.0 Request processed in 158us (658us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051432.216383:0:27887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10448 00000100:00100000:3.0:1777051432.216397:0:8492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13400 00000100:00100000:0.0:1777051432.216399:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051432.216413:0:27887:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95fbac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3680:x1863365452638208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051432.216448:0:8492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452638336 00000100:00100000:3.0:1777051432.216455:0:8492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452638336 00000100:00100000:1.0:1777051432.216471:0:8628:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95fbafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3680:x1863365452637696:12345-0@lo:400:kworker.0 Request processed in 118us (1012us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051432.216474:0:3677:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1777051432.216495:0:8628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10447 00000100:00100000:0.0:1777051432.216502:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f9bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3677:1863365452637440:0@lo:400:kworker.0 00000100:00100000:3.0:1777051432.216507:0:8492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13401 00000100:00100000:2.0:1777051432.216523:0:27887:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95fbac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3680:x1863365452638208:12345-0@lo:400:kworker.0 Request processed in 114us (953us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051432.216535:0:8492:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7e24c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3677:x1863365452637312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777051432.216549:0:8628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10449 00000100:00100000:2.0:1777051432.216565:0:27887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10448 00000100:00100000:0.0:1777051432.216580:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051432.216580:0:8628:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7e24ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3677:x1863365452637824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777051432.216621:0:27887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10450 00000100:00100000:0.0:1777051432.216628:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95fbaf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3677:1863365452637952:0@lo:400:kworker.0 00000100:00100000:3.0:1777051432.216646:0:8492:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7e24c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3677:x1863365452637312:12345-0@lo:400:kworker.0 Request processed in 117us (659us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051432.216651:0:27887:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3679:x1863365452638080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051432.216676:0:8492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13401 00000100:00100000:1.0:1777051432.216686:0:8628:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7e24ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3677:x1863365452637824:12345-0@lo:400:kworker.0 Request processed in 117us (561us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051432.216699:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051432.216717:0:8628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10449 00000100:00100000:3.0:1777051432.216724:0:8492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452637440 00000100:00100000:3.0:1777051432.216734:0:8492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452637440 00000100:00100000:2.0:1777051432.216772:0:27887:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3679:x1863365452638080:12345-0@lo:400:kworker.0 Request processed in 130us (951us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051432.216795:0:27887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10450 00000100:00100000:0.0:1777051432.216796:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f9bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3677:1863365452637312:0@lo:400:kworker.0 00000100:00100000:3.0:1777051432.216804:0:8492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452637952 00000100:00100000:3.0:1777051432.216813:0:8492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452637952 00000100:00100000:1.0:1777051432.216823:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f9bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3679:1863365452637568:0@lo:400:kworker.0 00000100:00100000:0.0:1777051432.216843:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94f168700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3677:1863365452637824:0@lo:400:kworker.0 00000100:00100000:3.0:1777051432.216863:0:8492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13402 00000100:00100000:1.0:1777051432.216870:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95fbad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452638080:0@lo:400:kworker.0 00000100:00100000:3.0:1777051432.216914:0:8492:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7e24e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3677:x1863365452638336:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1777051432.216917:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1777051432.216930:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f9be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3679:1863365452637056:0@lo:400:kworker.0 00000100:00080000:2.0:1777051432.216936:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1777051432.216953:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1777051432.216961:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1777051432.216980:0:3678:0:(client.c:3101:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 8589934619 gen 2 00000004:00080000:0.0:1777051432.216991:0:3678:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 8589934619 committed transno 8589934619 00000100:00100000:2.0:1777051432.217001:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13403 00000100:00100000:3.0:1777051432.217023:0:8492:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7e24e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3677:x1863365452638336:12345-0@lo:400:kworker.0 Request processed in 139us (628us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051432.217029:0:6579:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7e24d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3677:x1863365452637440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777051432.217043:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f9bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3680:1863365452637696:0@lo:400:kworker.0 00000100:00100000:3.0:1777051432.217053:0:8492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13402 00000100:00100000:1.0:1777051432.217088:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95fbaf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3680:1863365452638208:0@lo:400:kworker.0 00000100:00100000:0.0:1777051432.217103:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da444a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3678:1863365452636928:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1777051432.217116:0:8492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13404 00000100:00100000:2.0:1777051432.217138:0:6579:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7e24d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3677:x1863365452637440:12345-0@lo:400:kworker.0 Request processed in 117us (560us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051432.217145:0:8492:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7e24ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3677:x1863365452637952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777051432.217157:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13403 00000100:00100000:3.0:1777051432.217280:0:8492:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7e24ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3677:x1863365452637952:12345-0@lo:400:kworker.0 Request processed in 148us (591us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051432.217294:0:8492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13404 00000100:00100000:0.0:1777051432.217306:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f9bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3677:1863365452637440:0@lo:400:kworker.0 00000100:00100000:0.0:1777051432.217338:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95fbaf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3677:1863365452637952:0@lo:400:kworker.0 00000100:00100000:0.0:1777051432.217370:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95fbad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3677:1863365452638336:0@lo:400:kworker.0 00000100:00100000:1.0:1777051432.217392:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051432.217439:0:6581:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425996800 00000100:00100000:0.0:1777051432.217450:0:6581:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425996800 00000100:00100000:0.0:1777051432.217516:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112113 00000100:00100000:0.0:1777051432.217531:0:6581:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95fbaf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+24:138062:x1863365425996800:12345-192.168.201.46@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1777051432.217629:0:6581:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95fbaf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+24:138062:x1863365425996800:12345-192.168.201.46@tcp:57:lhsmtool_posix.0 Request processed in 99us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051432.217643:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112113 00000100:00100000:2.0:1777051432.218745:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051432.219523:0:46207:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425996928 00000100:00100000:0.0:1777051432.219535:0:46207:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425996928 00002000:00100000:0.0:1777051432.219586:0:46207:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000400:0x103:0x0] (0->1048575) req@ffff99da5f9fe680 x1863365425996928/t0(0) o3->c11b6966-0775-44d2-bdc6-c74c26eb2226@192.168.201.46@tcp:393/0 lens 488/0 e 0 to 0 dl 1777051443 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1777051432.219608:0:46207:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99da5f9fe680 with x1863365425996928 ext(0->1048575) 00002000:00010000:0.0:1777051432.219618:0:46207:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99da5f9fe680 00000100:00100000:0.0:1777051432.219664:0:46207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 1769 00000100:00100000:0.0:1777051432.219683:0:46207:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c11b6966-0775-44d2-bdc6-c74c26eb2226+52:2436:x1863365425996928:12345-192.168.201.46@tcp:3:lhsmtool_posix.0 00000100:00100000:2.0:1777051432.226144:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051432.226587:0:46199:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425997056 00000100:00100000:0.0:1777051432.226599:0:46199:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425997056 00002000:00100000:0.0:1777051432.226662:0:46199:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000400:0x103:0x0] (0->1048575) req@ffff99da5f9fd500 x1863365425997056/t0(0) o3->c11b6966-0775-44d2-bdc6-c74c26eb2226@192.168.201.46@tcp:393/0 lens 488/0 e 0 to 0 dl 1777051443 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1777051432.226684:0:46199:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99da5f9fd500 with x1863365425997056 ext(0->1048575) 00002000:00010000:0.0:1777051432.226693:0:46199:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99da5f9fd500 00000100:00100000:0.0:1777051432.226741:0:46199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 1770 00000100:00100000:0.0:1777051432.226756:0:46199:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:c11b6966-0775-44d2-bdc6-c74c26eb2226+60:2437:x1863365425997056:12345-192.168.201.46@tcp:3:lhsmtool_posix.0 00000100:00100000:1.0:1777051432.237291:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051432.237432:0:46205:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425997184 00000100:00100000:3.0:1777051432.237446:0:46205:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425997184 00002000:00100000:3.0:1777051432.237511:0:46205:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000400:0x104:0x0] (0->1048575) req@ffff99d95fbad880 x1863365425997184/t0(0) o3->c11b6966-0775-44d2-bdc6-c74c26eb2226@192.168.201.46@tcp:393/0 lens 488/0 e 0 to 0 dl 1777051443 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1777051432.237532:0:46205:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99d95fbad880 with x1863365425997184 ext(0->1048575) 00002000:00010000:3.0:1777051432.237541:0:46205:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99d95fbad880 00000100:00100000:3.0:1777051432.237591:0:46205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 1771 00000100:00100000:3.0:1777051432.237607:0:46205:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95fbad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:c11b6966-0775-44d2-bdc6-c74c26eb2226+62:2439:x1863365425997184:12345-192.168.201.46@tcp:3:lhsmtool_posix.0 00000100:00100000:1.0:1777051432.240460:0:46207:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c11b6966-0775-44d2-bdc6-c74c26eb2226+52:2436:x1863365425996928:12345-192.168.201.46@tcp:3:lhsmtool_posix.0 Request processed in 20776us (21711us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1777051432.240480:0:46207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 1769 00002000:00100000:1.0:1777051432.240498:0:46207:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000400:0x103:0x0] (0->1048575) req@ffff99da5f9fe680 x1863365425996928/t0(0) o3->c11b6966-0775-44d2-bdc6-c74c26eb2226@192.168.201.46@tcp:393/0 lens 488/440 e 0 to 0 dl 1777051443 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1777051432.240519:0:46207:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99da5f9fe680 with x1863365425996928 ext(0->1048575) 00002000:00010000:1.0:1777051432.240530:0:46207:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99da5f9fe680 00000100:00100000:2.0:1777051432.251130:0:46199:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:c11b6966-0775-44d2-bdc6-c74c26eb2226+62:2437:x1863365425997056:12345-192.168.201.46@tcp:3:lhsmtool_posix.0 Request processed in 24364us (24981us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1777051432.251153:0:46199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 1770 00002000:00100000:2.0:1777051432.251174:0:46199:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000400:0x103:0x0] (0->1048575) req@ffff99da5f9fd500 x1863365425997056/t0(0) o3->c11b6966-0775-44d2-bdc6-c74c26eb2226@192.168.201.46@tcp:393/0 lens 488/440 e 0 to 0 dl 1777051443 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1777051432.251265:0:46199:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99da5f9fd500 with x1863365425997056 ext(0->1048575) 00002000:00010000:2.0:1777051432.251278:0:46199:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99da5f9fd500 00000100:00100000:1.0:1777051432.253389:0:46205:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95fbad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:c11b6966-0775-44d2-bdc6-c74c26eb2226+60:2439:x1863365425997184:12345-192.168.201.46@tcp:3:lhsmtool_posix.0 Request processed in 15770us (16094us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1777051432.253407:0:46205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 1771 00002000:00100000:1.0:1777051432.253431:0:46205:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000400:0x104:0x0] (0->1048575) req@ffff99d95fbad880 x1863365425997184/t0(0) o3->c11b6966-0775-44d2-bdc6-c74c26eb2226@192.168.201.46@tcp:393/0 lens 488/440 e 0 to 0 dl 1777051443 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1777051432.253460:0:46205:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99d95fbad880 with x1863365425997184 ext(0->1048575) 00002000:00010000:1.0:1777051432.253470:0:46205:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99d95fbad880 00000100:00100000:3.0:1777051432.271923:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051432.272067:0:21368:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425997312 00000100:00100000:0.0:1777051432.272084:0:21368:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425997312 00000100:00100000:0.0:1777051432.272179:0:21368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112114 00000100:00100000:0.0:1777051432.272257:0:21368:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da444a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+24:138061:x1863365425997312:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1777051432.272290:0:21368:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051432.272328:0:21368:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d94eb2b200/0x85f51a6b96716683 lrc: 2/0,0 mode: --/PR res: [0x240000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6546 expref: -99 pid: 21368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051432.272389:0:21368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61ac00/0x85f51a6b9671668a lrc: 3/1,0 mode: --/PR res: [0x240000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051432.272413:0:21368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61ac00/0x85f51a6b9671668a lrc: 3/1,0 mode: PR/PR res: [0x240000bd2:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 21368 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051432.272434:0:21368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61ac00/0x85f51a6b9671668a lrc: 3/1,0 mode: PR/PR res: [0x240000bd2:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 21368 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051432.272625:0:21368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d94eb2b200/0x85f51a6b96716683 lrc: 0/0,0 mode: --/PR res: [0x240000bd2:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6546 expref: 26 pid: 21368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051432.272661:0:21368:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61ac00/0x85f51a6b9671668a lrc: 3/0,0 mode: PR/PR res: [0x240000bd2:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6546 expref: 25 pid: 21368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051432.272689:0:21368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x2:0x0].0x0 (ffff99d943f76e00) 00010000:00010000:0.0:1777051432.272695:0:21368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1777051432.272716:0:21368:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d94e61ac00, rc 0) 00000100:00100000:0.0:1777051432.272814:0:21368:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da444a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+25:138061:x1863365425997312:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 Request processed in 619us (928us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051432.272830:0:21368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112114 00000100:00100000:2.0:1777051432.279005:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051432.279249:0:6580:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425997440 00000100:00100000:1.0:1777051432.279263:0:6580:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425997440 00000100:00100000:1.0:1777051432.279442:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112115 00000100:00100000:1.0:1777051432.279461:0:6580:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+25:138061:x1863365425997440:12345-192.168.201.46@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1777051432.279505:0:6580:0:(mdt_handler.c:7958:mdt_fid2path()) path get [0x240000bd2:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1777051432.279522:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051432.279717:0:6580:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+25:138061:x1863365425997440:12345-192.168.201.46@tcp:53:lhsmtool_posix.0 Request processed in 258us (719us total) trans 0 rc -66/-66 00000100:00100000:1.0:1777051432.280001:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112115 00000100:00100000:3.0:1777051432.280523:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051432.280631:0:6580:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425997568 00000100:00100000:1.0:1777051432.280640:0:6580:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425997568 00000100:00100000:2.0:1777051432.280761:0:46494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112116 00000100:00100000:2.0:1777051432.280778:0:46494:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da444a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c11b6966-0775-44d2-bdc6-c74c26eb2226+25:138062:x1863365425997568:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1777051432.280797:0:46494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051432.280824:0:46494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d954ea5800/0x85f51a6b96716691 lrc: 2/0,0 mode: --/PR res: [0x240000bd2:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b654d expref: -99 pid: 46494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051432.280868:0:46494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d954ea5200/0x85f51a6b96716698 lrc: 3/1,0 mode: --/PR res: [0x240000bd2:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051432.280923:0:46494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d954ea5200/0x85f51a6b96716698 lrc: 3/1,0 mode: PR/PR res: [0x240000bd2:0x3:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 46494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051432.280945:0:46494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d954ea5200/0x85f51a6b96716698 lrc: 3/1,0 mode: PR/PR res: [0x240000bd2:0x3:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 46494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051432.281137:0:46494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d954ea5800/0x85f51a6b96716691 lrc: 0/0,0 mode: --/PR res: [0x240000bd2:0x3:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b654d expref: 27 pid: 46494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051432.281173:0:46494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99d954ea5200/0x85f51a6b96716698 lrc: 3/0,0 mode: PR/PR res: [0x240000bd2:0x3:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b654d expref: 26 pid: 46494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051432.281180:0:8492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425997696 00000100:00100000:3.0:1777051432.281194:0:8492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425997696 00010000:00010000:2.0:1777051432.281206:0:46494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x3:0x0].0x0 (ffff99d943f76f00) 00010000:00010000:2.0:1777051432.281215:0:46494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1777051432.281221:0:46494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d954ea5200, rc 0) 00000100:00100000:3.0:1777051432.281276:0:8492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112117 00000100:00100000:3.0:1777051432.281298:0:8492:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da444a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+27:138060:x1863365425997696:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1777051432.281321:0:8492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1777051432.281464:0:46494:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da444a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c11b6966-0775-44d2-bdc6-c74c26eb2226+27:138062:x1863365425997568:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 Request processed in 689us (1947us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051432.281474:0:46494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112116 00010000:00010000:2.0:1777051432.282530:0:8492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d954ea5600/0x85f51a6b9671669f lrc: 2/0,0 mode: --/PR res: [0x240000bd2:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6554 expref: -99 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051432.282577:0:8492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d954ea4200/0x85f51a6b967166a6 lrc: 3/1,0 mode: --/PR res: [0x240000bd2:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051432.282595:0:8492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d954ea4200/0x85f51a6b967166a6 lrc: 3/1,0 mode: PR/PR res: [0x240000bd2:0x1:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8492 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051432.282612:0:8492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d954ea4200/0x85f51a6b967166a6 lrc: 3/1,0 mode: PR/PR res: [0x240000bd2:0x1:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8492 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051432.282736:0:8492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d954ea5600/0x85f51a6b9671669f lrc: 0/0,0 mode: --/PR res: [0x240000bd2:0x1:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6554 expref: 28 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051432.282764:0:8492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99d954ea4200/0x85f51a6b967166a6 lrc: 3/0,0 mode: PR/PR res: [0x240000bd2:0x1:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6554 expref: 27 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051432.282779:0:8492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x1:0x0].0x0 (ffff99d943f76b00) 00010000:00010000:2.0:1777051432.282785:0:8492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1777051432.282789:0:8492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d954ea4200, rc 0) 00000100:00100000:2.0:1777051432.282857:0:8492:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da444a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+27:138060:x1863365425997696:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 Request processed in 1566us (2339us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051432.282907:0:8492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112117 00000100:00100000:3.0:1777051432.284857:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051432.285016:0:27882:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425997824 00000100:00100000:1.0:1777051432.285029:0:27882:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425997824 00000100:00100000:1.0:1777051432.285111:0:27882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112118 00000100:00100000:1.0:1777051432.285128:0:27882:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da444a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+32:138061:x1863365425997824:12345-192.168.201.46@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1777051432.285171:0:27882:0:(mdt_handler.c:7958:mdt_fid2path()) path get [0x2000032e2:0x6:0x0] from 18446744073709551615 #-1 00000100:00100000:1.0:1777051432.285486:0:27882:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da444a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+32:138061:x1863365425997824:12345-192.168.201.46@tcp:53:lhsmtool_posix.0 Request processed in 357us (629us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051432.285505:0:27882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112118 00000100:00100000:1.0:1777051432.287485:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051432.287616:0:6579:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425997952 00000100:00100000:2.0:1777051432.287627:0:6579:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425997952 00000100:00100000:2.0:1777051432.287703:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112119 00000100:00100000:2.0:1777051432.287791:0:6579:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95fbac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+27:138062:x1863365425997952:12345-192.168.201.46@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1777051432.287834:0:6579:0:(mdt_handler.c:7958:mdt_fid2path()) path get [0x240000bd2:0x3:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1777051432.288025:0:6579:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95fbac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+27:138062:x1863365425997952:12345-192.168.201.46@tcp:53:lhsmtool_posix.0 Request processed in 305us (539us total) trans 0 rc -66/-66 00000100:00100000:2.0:1777051432.288042:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112119 00000100:00100000:2.0:1777051432.290410:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051432.290680:0:27885:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425998080 00000100:00100000:0.0:1777051432.290690:0:27885:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425998080 00000100:00100000:0.0:1777051432.290753:0:27885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112120 00000100:00100000:0.0:1777051432.290766:0:27885:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c11b6966-0775-44d2-bdc6-c74c26eb2226+27:138060:x1863365425998080:12345-192.168.201.46@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1777051432.290791:0:27885:0:(mdt_handler.c:7958:mdt_fid2path()) path get [0x240000bd2:0x1:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1777051432.290948:0:27885:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c11b6966-0775-44d2-bdc6-c74c26eb2226+27:138060:x1863365425998080:12345-192.168.201.46@tcp:53:lhsmtool_posix.0 Request processed in 180us (538us total) trans 0 rc -66/-66 00000100:00100000:0.0:1777051432.290963:0:27885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112120 00000100:00100000:1.0:1777051432.291069:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051432.291175:0:46494:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425998208 00000100:00100000:2.0:1777051432.291186:0:46494:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425998208 00000100:00100000:1.0:1777051432.291235:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051432.291266:0:46494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112121 00000100:00100000:2.0:1777051432.291284:0:46494:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95fbac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c11b6966-0775-44d2-bdc6-c74c26eb2226+32:138062:x1863365425998208:12345-192.168.201.46@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1777051432.291334:0:46494:0:(mdt_handler.c:7958:mdt_fid2path()) path get [0x2000032e2:0x6:0x0] from 18446744073709551615 #-1 00000100:00100000:3.0:1777051432.291374:0:24468:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425998336 00000100:00100000:3.0:1777051432.291384:0:24468:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425998336 00000100:00100000:3.0:1777051432.291451:0:24468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 8023 00000100:00100000:3.0:1777051432.291465:0:24468:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95fbaca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+52:2436:x1863365425998336:12345-192.168.201.46@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1777051432.291512:0:24468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000554aaf12/0x85f51a6b967166ad lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0x103:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051432.291556:0:46494:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95fbac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c11b6966-0775-44d2-bdc6-c74c26eb2226+32:138062:x1863365425998208:12345-192.168.201.46@tcp:53:lhsmtool_posix.0 Request processed in 232us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051432.291573:0:46494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112121 00010000:00010000:3.0:1777051432.291703:0:24468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051432.291708:0:24468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051432.291717:0:24468:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000554aaf12/0x85f51a6b967166ad lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0x103:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051432.291742:0:24468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000554aaf12/0x85f51a6b967166ad lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0x103:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051432.291781:0:24468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000554aaf12/0x85f51a6b967166ad lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0x103:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051432.291811:0:24468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000554aaf12/0x85f51a6b967166ad lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x103:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051432.291829:0:24468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000554aaf12/0x85f51a6b967166ad lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x103:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051432.291856:0:24468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d9559a3800 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:3.0:1777051432.291864:0:24468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000554aaf12/0x85f51a6b967166ad lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x103:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051432.291917:0:24468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000554aaf12/0x85f51a6b967166ad lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x103:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051432.291942:0:24468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000554aaf12/0x85f51a6b967166ad lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x103:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051432.291958:0:24468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000554aaf12/0x85f51a6b967166ad lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x103:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051432.292054:0:24468:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95fbaca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+52:2436:x1863365425998336:12345-192.168.201.46@tcp:1:lhsmtool_posix.0 Request processed in 590us (862us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051432.292069:0:24468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 8023 00000100:00100000:1.0:1777051432.294610:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051432.294716:0:10328:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425998464 00000100:00100000:0.0:1777051432.294726:0:10328:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425998464 00000100:00100000:0.0:1777051432.294790:0:10328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112122 00000100:00100000:0.0:1777051432.294804:0:10328:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95fbadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+32:138060:x1863365425998464:12345-192.168.201.46@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1777051432.294834:0:10328:0:(mdt_handler.c:7958:mdt_fid2path()) path get [0x2000032e2:0x6:0x0] from 18446744073709551615 #-1 00000100:00100000:0.0:1777051432.295031:0:10328:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95fbadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+32:138060:x1863365425998464:12345-192.168.201.46@tcp:53:lhsmtool_posix.0 Request processed in 226us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051432.295045:0:10328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112122 00000100:00100000:1.0:1777051432.297598:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051432.297652:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051432.297720:0:27884:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425998592 00000100:00100000:2.0:1777051432.297732:0:27884:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425998592 00000100:00100000:0.0:1777051432.297767:0:6581:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425998848 00000100:00100000:0.0:1777051432.297779:0:6581:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425998848 00000100:00100000:2.0:1777051432.297812:0:27884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 8024 00000100:00100000:2.0:1777051432.297834:0:27884:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95fbace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+60:2437:x1863365425998592:12345-192.168.201.46@tcp:1:lhsmtool_posix.0 00000100:00100000:0.0:1777051432.297873:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112123 00010000:00010000:2.0:1777051432.297916:0:27884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002f2b81eb/0x85f51a6b967166b4 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x104:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 27884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051432.297930:0:6581:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95fbadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+27:138061:x1863365425998848:12345-192.168.201.46@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1777051432.297954:0:27884:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777051432.297959:0:27884:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777051432.297968:0:27884:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002f2b81eb/0x85f51a6b967166b4 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x104:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 27884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051432.297990:0:27884:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002f2b81eb/0x85f51a6b967166b4 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x104:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 27884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051432.298021:0:27884:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002f2b81eb/0x85f51a6b967166b4 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x104:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 27884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051432.298036:0:27884:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002f2b81eb/0x85f51a6b967166b4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x104:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 27884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051432.298051:0:27884:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002f2b81eb/0x85f51a6b967166b4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x104:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 27884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051432.298065:0:27884:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d954ea5800 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:2.0:1777051432.298072:0:27884:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002f2b81eb/0x85f51a6b967166b4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x104:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 27884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051432.298088:0:27884:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002f2b81eb/0x85f51a6b967166b4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x104:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 27884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051432.298112:0:27884:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002f2b81eb/0x85f51a6b967166b4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x104:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 27884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051432.298127:0:27884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002f2b81eb/0x85f51a6b967166b4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x104:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 27884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051432.298186:0:6581:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61a200/0x85f51a6b967166bb lrc: 3/0,1 mode: --/PW res: [0x240000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051432.298215:0:6581:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61ac00/0x85f51a6b9671668a lrc: 2/0,0 mode: PR/PR res: [0x240000bd2:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6546 expref: 27 pid: 21368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051432.298233:0:6581:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61a200/0x85f51a6b967166bb lrc: 4/0,1 mode: --/PW res: [0x240000bd2:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6581 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051432.298274:0:27884:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95fbace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+60:2437:x1863365425998592:12345-192.168.201.46@tcp:1:lhsmtool_posix.0 Request processed in 443us (674us total) trans 0 rc 0/0 00010000:00010000:0.0:1777051432.298289:0:6581:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61ac00/0x85f51a6b9671668a lrc: 3/0,0 mode: PR/PR res: [0x240000bd2:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6546 expref: 27 pid: 21368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051432.298296:0:27884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 8024 00010000:00010000:0.0:1777051432.298364:0:6581:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61ac00/0x85f51a6b9671668a lrc: 4/0,0 mode: PR/PR res: [0x240000bd2:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6546 expref: 27 pid: 21368 timeout: 8161 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051432.298390:0:6581:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7e24f800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:6581:1863365452638464:192.168.201.46@tcp:104: 00000100:00100000:0.0:1777051432.298479:0:6581:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da6fc65480 going to sleep for 11 seconds 00000100:00100000:2.0:1777051432.299679:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051432.299765:0:13320:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425998976 00000100:00100000:1.0:1777051432.299774:0:13320:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425998976 00000100:00100000:1.0:1777051432.299834:0:13320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 8025 00000100:00100000:1.0:1777051432.299850:0:13320:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+60:2437:x1863365425998976:12345-192.168.201.46@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1777051432.299925:0:13320:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a0dc4c16/0x85f51a6b967166c2 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x103:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051432.299948:0:13320:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051432.299952:0:13320:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051432.299958:0:13320:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a0dc4c16/0x85f51a6b967166c2 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x103:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051432.299990:0:13320:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a0dc4c16/0x85f51a6b967166c2 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x103:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051432.300048:0:13320:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a0dc4c16/0x85f51a6b967166c2 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x103:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051432.300064:0:13320:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a0dc4c16/0x85f51a6b967166c2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x103:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051432.300078:0:13320:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a0dc4c16/0x85f51a6b967166c2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x103:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051432.300091:0:13320:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94d72e400 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:1.0:1777051432.300097:0:13320:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a0dc4c16/0x85f51a6b967166c2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x103:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051432.300113:0:13320:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a0dc4c16/0x85f51a6b967166c2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x103:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051432.300135:0:13320:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a0dc4c16/0x85f51a6b967166c2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x103:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051432.300151:0:13320:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a0dc4c16/0x85f51a6b967166c2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x103:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051432.300325:0:13320:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+60:2437:x1863365425998976:12345-192.168.201.46@tcp:1:lhsmtool_posix.0 Request processed in 454us (624us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051432.300342:0:13320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 8025 00000100:00100000:1.0:1777051432.302215:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051432.302338:0:21368:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425999232 00000100:00100000:2.0:1777051432.302348:0:21368:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425999232 00000100:00100000:2.0:1777051432.302422:0:21368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112124 00000100:00100000:2.0:1777051432.302438:0:21368:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95fbad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+28:138062:x1863365425999232:12345-192.168.201.46@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1777051432.302481:0:6581:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7e24f800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:6581:1863365452638464:192.168.201.46@tcp:104: 00010000:00010000:2.0:1777051432.302508:0:21368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff99d954ea5e00/0x85f51a6b967166c9 lrc: 3/0,1 mode: --/PW res: [0x240000bd2:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051432.302516:0:6581:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61a200/0x85f51a6b967166bb lrc: 3/0,1 mode: --/PW res: [0x240000bd2:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6581 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051432.302545:0:21368:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff99d954ea5200/0x85f51a6b96716698 lrc: 2/0,0 mode: PR/PR res: [0x240000bd2:0x3:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b654d expref: 28 pid: 46494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051432.302565:0:21368:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d954ea5e00/0x85f51a6b967166c9 lrc: 4/0,1 mode: --/PW res: [0x240000bd2:0x3:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 21368 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051432.302603:0:21368:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff99d954ea5200/0x85f51a6b96716698 lrc: 3/0,0 mode: PR/PR res: [0x240000bd2:0x3:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b654d expref: 28 pid: 46494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051432.302622:0:21368:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff99d954ea5200/0x85f51a6b96716698 lrc: 4/0,0 mode: PR/PR res: [0x240000bd2:0x3:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b654d expref: 28 pid: 46494 timeout: 8161 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051432.302644:0:21368:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f9fce00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001_UUID:21368:1863365452638592:192.168.201.46@tcp:104: 00000100:00100000:2.0:1777051432.302746:0:21368:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d956bda480 going to sleep for 11 seconds 00000100:00100000:2.0:1777051432.303181:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051432.303349:0:24467:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425999360 00000100:00100000:3.0:1777051432.303360:0:24467:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425999360 00010000:00010000:3.0:1777051432.303402:0:24467:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61ac00/0x85f51a6b9671668a lrc: 4/0,0 mode: PR/PR res: [0x240000bd2:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6546 expref: 29 pid: 21368 timeout: 8161 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051432.303464:0:24467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3883 00000100:00100000:3.0:1777051432.303481:0:24467:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d944e11180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+29:2437:x1863365425999360:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1777051432.303500:0:24467:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777051432.303511:0:24467:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61ac00/0x85f51a6b9671668a lrc: 4/0,0 mode: PR/PR res: [0x240000bd2:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6546 expref: 29 pid: 21368 timeout: 8161 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051432.304407:0:24467:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61ac00/0x85f51a6b9671668a lrc: 3/0,0 mode: PR/PR res: [0x240000bd2:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6546 expref: 29 pid: 21368 timeout: 8161 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051432.304444:0:24467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61ac00/0x85f51a6b9671668a lrc: 0/0,0 mode: --/PR res: [0x240000bd2:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6546 expref: 29 pid: 21368 timeout: 8161 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051432.304468:0:24467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x2:0x0].0x0 (ffff99d943f76e00) 00010000:00010000:3.0:1777051432.304474:0:24467:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61a200/0x85f51a6b967166bb lrc: 3/0,1 mode: --/PW res: [0x240000bd2:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6581 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051432.304485:0:24467:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61a200/0x85f51a6b967166bb lrc: 3/0,1 mode: PW/PW res: [0x240000bd2:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6581 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051432.304495:0:24467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61a200/0x85f51a6b967166bb lrc: 4/0,1 mode: PW/PW res: [0x240000bd2:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6581 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051432.304545:0:24467:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1777051432.304618:0:6581:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61a200/0x85f51a6b967166bb lrc: 3/0,1 mode: PW/PW res: [0x240000bd2:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6581 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051432.304639:0:6581:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61a200/0x85f51a6b967166bb lrc: 3/0,1 mode: PW/PW res: [0x240000bd2:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6581 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051432.304687:0:24467:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d944e11180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+28:2437:x1863365425999360:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 1206us (1507us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051432.304703:0:24467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3883 00010000:00010000:0.0:1777051432.305503:0:6581:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61a200/0x85f51a6b967166bb lrc: 3/0,1 mode: PW/PW res: [0x240000bd2:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6581 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051432.305521:0:6581:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61a200/0x85f51a6b967166bb lrc: 2/0,0 mode: PW/PW res: [0x240000bd2:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6581 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051432.305533:0:6581:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61a200/0x85f51a6b967166bb lrc: 3/0,0 mode: PW/PW res: [0x240000bd2:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6581 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051432.305546:0:6581:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94e61a200 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:0.0:1777051432.305553:0:6581:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61a200/0x85f51a6b967166bb lrc: 3/0,0 mode: PW/PW res: [0x240000bd2:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6581 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051432.305567:0:6581:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61a200/0x85f51a6b967166bb lrc: 4/0,0 mode: PW/PW res: [0x240000bd2:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6581 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051432.305584:0:6581:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x2:0x0].0x0 (ffff99d943f76e00) 00010000:00010000:0.0:1777051432.305590:0:6581:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1777051432.305596:0:6581:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61a200/0x85f51a6b967166bb lrc: 2/0,0 mode: --/PW res: [0x240000bd2:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6581 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051432.305606:0:6581:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61a200/0x85f51a6b967166bb lrc: 0/0,0 mode: --/PW res: [0x240000bd2:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6581 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051432.306362:0:6581:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95fbadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+28:138061:x1863365425998848:12345-192.168.201.46@tcp:57:lhsmtool_posix.0 Request processed in 8438us (8704us total) trans 8589934635 rc 0/0 00000100:00100000:0.0:1777051432.306381:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112123 00000100:00100000:2.0:1777051432.307191:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051432.307319:0:46497:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425999616 00000100:00100000:0.0:1777051432.307331:0:46497:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425999616 00000100:00100000:0.0:1777051432.307399:0:46497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112125 00000100:00100000:0.0:1777051432.307416:0:46497:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d944e11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:c11b6966-0775-44d2-bdc6-c74c26eb2226+28:138060:x1863365425999616:12345-192.168.201.46@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1777051432.307483:0:46497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61be00/0x85f51a6b967166d0 lrc: 3/0,1 mode: --/PW res: [0x240000bd2:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051432.307509:0:46497:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff99d954ea4200/0x85f51a6b967166a6 lrc: 2/0,0 mode: PR/PR res: [0x240000bd2:0x1:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6554 expref: 28 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051432.307525:0:46497:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61be00/0x85f51a6b967166d0 lrc: 4/0,1 mode: --/PW res: [0x240000bd2:0x1:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051432.307567:0:46497:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff99d954ea4200/0x85f51a6b967166a6 lrc: 3/0,0 mode: PR/PR res: [0x240000bd2:0x1:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6554 expref: 28 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051432.307586:0:46497:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff99d954ea4200/0x85f51a6b967166a6 lrc: 4/0,0 mode: PR/PR res: [0x240000bd2:0x1:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6554 expref: 28 pid: 8492 timeout: 8161 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051432.307606:0:46497:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7e24f800 pname:cluuid:pid:xid:nid:opc:job mdt00_009:lustre-MDT0001_UUID:46497:1863365452638720:192.168.201.46@tcp:104: 00000100:00100000:0.0:1777051432.308046:0:46497:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d944ac0240 going to sleep for 11 seconds 00000100:00100000:2.0:1777051432.308979:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051432.309056:0:21368:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f9fce00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001_UUID:21368:1863365452638592:192.168.201.46@tcp:104: 00010000:00010000:0.0:1777051432.309087:0:21368:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff99d954ea5e00/0x85f51a6b967166c9 lrc: 3/0,1 mode: --/PW res: [0x240000bd2:0x3:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 21368 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051432.309097:0:6564:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425999744 00000100:00100000:3.0:1777051432.309109:0:6564:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425999744 00010000:00010000:3.0:1777051432.309148:0:6564:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d954ea5200/0x85f51a6b96716698 lrc: 4/0,0 mode: PR/PR res: [0x240000bd2:0x3:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b654d expref: 29 pid: 46494 timeout: 8161 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051432.309768:0:6564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3884 00000100:00100000:3.0:1777051432.309790:0:6564:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d944e10e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+29:2437:x1863365425999744:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1777051432.310045:0:6564:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777051432.310059:0:6564:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff99d954ea5200/0x85f51a6b96716698 lrc: 4/0,0 mode: PR/PR res: [0x240000bd2:0x3:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b654d expref: 29 pid: 46494 timeout: 8161 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051432.310080:0:6564:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff99d954ea5200/0x85f51a6b96716698 lrc: 3/0,0 mode: PR/PR res: [0x240000bd2:0x3:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b654d expref: 29 pid: 46494 timeout: 8161 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051432.310107:0:6564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d954ea5200/0x85f51a6b96716698 lrc: 0/0,0 mode: --/PR res: [0x240000bd2:0x3:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b654d expref: 29 pid: 46494 timeout: 8161 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051432.310127:0:6564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x3:0x0].0x0 (ffff99d943f76f00) 00010000:00010000:3.0:1777051432.310134:0:6564:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0001_UUID lock: ffff99d954ea5e00/0x85f51a6b967166c9 lrc: 3/0,1 mode: --/PW res: [0x240000bd2:0x3:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 21368 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051432.310148:0:6564:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff99d954ea5e00/0x85f51a6b967166c9 lrc: 3/0,1 mode: PW/PW res: [0x240000bd2:0x3:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 21368 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051432.310160:0:6564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d954ea5e00/0x85f51a6b967166c9 lrc: 4/0,1 mode: PW/PW res: [0x240000bd2:0x3:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 21368 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051432.310397:0:6564:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1777051432.310483:0:21368:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff99d954ea5e00/0x85f51a6b967166c9 lrc: 3/0,1 mode: PW/PW res: [0x240000bd2:0x3:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21368 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051432.310509:0:21368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d954ea5e00/0x85f51a6b967166c9 lrc: 3/0,1 mode: PW/PW res: [0x240000bd2:0x3:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21368 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051432.310517:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051432.310564:0:46497:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7e24f800 pname:cluuid:pid:xid:nid:opc:job mdt00_009:lustre-MDT0001_UUID:46497:1863365452638720:192.168.201.46@tcp:104: 00000100:00100000:2.0:1777051432.310580:0:46501:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426000000 00000100:00100000:2.0:1777051432.310587:0:46501:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426000000 00010000:00010000:1.0:1777051432.310592:0:46497:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61be00/0x85f51a6b967166d0 lrc: 3/0,1 mode: --/PW res: [0x240000bd2:0x1:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051432.310649:0:46501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3367 00000100:00100000:2.0:1777051432.310670:0:46501:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94ed2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+30:138061:x1863365426000000:12345-192.168.201.46@tcp:35:lhsmtool_posix.0 00010000:00010000:0.0:1777051432.310980:0:21368:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff99d954ea5e00/0x85f51a6b967166c9 lrc: 3/0,1 mode: PW/PW res: [0x240000bd2:0x3:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 21368 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051432.310998:0:21368:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d954ea5e00/0x85f51a6b967166c9 lrc: 2/0,0 mode: PW/PW res: [0x240000bd2:0x3:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 21368 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051432.311011:0:21368:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99d954ea5e00/0x85f51a6b967166c9 lrc: 3/0,0 mode: PW/PW res: [0x240000bd2:0x3:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 21368 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051432.311024:0:21368:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d954ea5e00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:0.0:1777051432.311030:0:21368:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d954ea5e00/0x85f51a6b967166c9 lrc: 3/0,0 mode: PW/PW res: [0x240000bd2:0x3:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 21368 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051432.311042:0:21368:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d954ea5e00/0x85f51a6b967166c9 lrc: 4/0,0 mode: PW/PW res: [0x240000bd2:0x3:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 21368 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051432.311061:0:21368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x3:0x0].0x0 (ffff99d943f76f00) 00010000:00010000:0.0:1777051432.311066:0:21368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1777051432.311072:0:21368:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99d954ea5e00/0x85f51a6b967166c9 lrc: 2/0,0 mode: --/PW res: [0x240000bd2:0x3:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 21368 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051432.311082:0:21368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d954ea5e00/0x85f51a6b967166c9 lrc: 0/0,0 mode: --/PW res: [0x240000bd2:0x3:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 21368 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051432.311247:0:21368:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95fbad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+31:138062:x1863365425999232:12345-192.168.201.46@tcp:57:lhsmtool_posix.0 Request processed in 8809us (9038us total) trans 8589934636 rc 0/0 00000100:00100000:0.0:1777051432.311265:0:21368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112124 00000100:00100000:2.0:1777051432.311316:0:46501:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94ed2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+30:138061:x1863365426000000:12345-192.168.201.46@tcp:35:lhsmtool_posix.0 Request processed in 647us (799us total) trans 8589934637 rc 0/0 00000100:00100000:2.0:1777051432.311335:0:46501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3367 00000100:00100000:1.0:1777051432.311369:0:6564:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d944e10e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+29:2437:x1863365425999744:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 1582us (2388us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051432.311388:0:6564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3884 00000100:00100000:3.0:1777051432.311438:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051432.311521:0:9550:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426000128 00000100:00100000:0.0:1777051432.311531:0:9550:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426000128 00010000:00010000:0.0:1777051432.311568:0:9550:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d954ea4200/0x85f51a6b967166a6 lrc: 4/0,0 mode: PR/PR res: [0x240000bd2:0x1:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6554 expref: 29 pid: 8492 timeout: 8161 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051432.311623:0:9550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3885 00000100:00100000:0.0:1777051432.312034:0:9550:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da444a3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+29:2437:x1863365426000128:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1777051432.312054:0:9550:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777051432.312065:0:9550:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff99d954ea4200/0x85f51a6b967166a6 lrc: 4/0,0 mode: PR/PR res: [0x240000bd2:0x1:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6554 expref: 29 pid: 8492 timeout: 8161 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051432.312086:0:9550:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff99d954ea4200/0x85f51a6b967166a6 lrc: 3/0,0 mode: PR/PR res: [0x240000bd2:0x1:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6554 expref: 29 pid: 8492 timeout: 8161 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051432.312106:0:9550:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d954ea4200/0x85f51a6b967166a6 lrc: 0/0,0 mode: --/PR res: [0x240000bd2:0x1:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6554 expref: 29 pid: 8492 timeout: 8161 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051432.312125:0:9550:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x1:0x0].0x0 (ffff99d943f76b00) 00010000:00010000:0.0:1777051432.312132:0:9550:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61be00/0x85f51a6b967166d0 lrc: 3/0,1 mode: --/PW res: [0x240000bd2:0x1:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051432.312146:0:9550:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61be00/0x85f51a6b967166d0 lrc: 3/0,1 mode: PW/PW res: [0x240000bd2:0x1:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051432.312159:0:9550:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61be00/0x85f51a6b967166d0 lrc: 4/0,1 mode: PW/PW res: [0x240000bd2:0x1:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051432.312201:0:9550:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1777051432.312261:0:9550:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da444a3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+28:2437:x1863365426000128:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 235us (828us total) trans 0 rc 0/0 00010000:00010000:1.0:1777051432.312274:0:46497:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61be00/0x85f51a6b967166d0 lrc: 3/0,1 mode: PW/PW res: [0x240000bd2:0x1:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051432.312277:0:9550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3885 00010000:00010000:1.0:1777051432.312296:0:46497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61be00/0x85f51a6b967166d0 lrc: 3/0,1 mode: PW/PW res: [0x240000bd2:0x1:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051432.312424:0:46497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61be00/0x85f51a6b967166d0 lrc: 3/0,1 mode: PW/PW res: [0x240000bd2:0x1:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051432.312440:0:46497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61be00/0x85f51a6b967166d0 lrc: 2/0,0 mode: PW/PW res: [0x240000bd2:0x1:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051432.312452:0:46497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61be00/0x85f51a6b967166d0 lrc: 3/0,0 mode: PW/PW res: [0x240000bd2:0x1:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051432.312462:0:46497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94e61be00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:1.0:1777051432.312468:0:46497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61be00/0x85f51a6b967166d0 lrc: 3/0,0 mode: PW/PW res: [0x240000bd2:0x1:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051432.312481:0:46497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61be00/0x85f51a6b967166d0 lrc: 4/0,0 mode: PW/PW res: [0x240000bd2:0x1:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051432.312498:0:46497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x1:0x0].0x0 (ffff99d943f76b00) 00010000:00010000:1.0:1777051432.312503:0:46497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1777051432.312509:0:46497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61be00/0x85f51a6b967166d0 lrc: 2/0,0 mode: --/PW res: [0x240000bd2:0x1:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051432.312519:0:46497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61be00/0x85f51a6b967166d0 lrc: 0/0,0 mode: --/PW res: [0x240000bd2:0x1:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051432.312658:0:46497:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d944e11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:c11b6966-0775-44d2-bdc6-c74c26eb2226+28:138060:x1863365425999616:12345-192.168.201.46@tcp:57:lhsmtool_posix.0 Request processed in 5241us (5466us total) trans 8589934638 rc 0/0 00000100:00100000:1.0:1777051432.312675:0:46497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112125 00000040:00080000:0.0:1777051432.313118:0:104226:0:(llog.c:801:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1777051432.313126:0:104226:0:(llog_cat.c:158:llog_cat_process_common()) processing log [0x1:0x12:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1777051432.314575:0:104226:0:(llog.c:858:llog_process_thread()) stop processing plain [0x1:0x12:0x0] index 64768 count 4 00000040:00080000:0.0:1777051432.314591:0:104226:0:(llog.c:858:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1777051432.314911:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051432.315044:0:24269:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426000384 00000100:00100000:2.0:1777051432.315052:0:24269:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426000384 00000100:00100000:2.0:1777051432.315101:0:24269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3368 00000100:00100000:2.0:1777051432.315111:0:24269:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95fbaf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+28:138062:x1863365426000384:12345-192.168.201.46@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1777051432.315460:0:24269:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95fbaf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+29:138062:x1863365426000384:12345-192.168.201.46@tcp:35:lhsmtool_posix.0 Request processed in 341us (575us total) trans 8589934639 rc 0/0 00000100:00100000:2.0:1777051432.315479:0:24269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3368 00000100:00100000:3.0:1777051432.316973:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051432.317078:0:6582:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426000640 00000100:00100000:1.0:1777051432.317088:0:6582:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426000640 00000100:00100000:2.0:1777051432.317553:0:46501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3369 00000100:00100000:2.0:1777051432.317579:0:46501:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da444a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+29:138060:x1863365426000640:12345-192.168.201.46@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1777051432.318241:0:46501:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da444a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+30:138060:x1863365426000640:12345-192.168.201.46@tcp:35:lhsmtool_posix.0 Request processed in 625us (1223us total) trans 8589934640 rc 0/0 00000100:00100000:2.0:1777051432.318260:0:46501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3369 00000100:00100000:2.0:1777051432.726482:0:3677:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1777051432.726506:0:3680:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1777051432.726513:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94ed2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452638848:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1777051432.726522:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f9bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3680:1863365452638976:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1777051432.726616:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051432.726666:0:8473:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452638976 00000100:00100000:2.0:1777051432.726679:0:8473:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452638976 00000100:00100000:3.0:1777051432.726734:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051432.726753:0:8473:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452638848 00000100:00100000:2.0:1777051432.726760:0:8473:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452638848 00000100:00100000:2.0:1777051432.726818:0:8473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5662 00000100:00100000:2.0:1777051432.726836:0:8473:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3680:x1863365452638976:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1777051432.726844:0:10113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5663 00000100:00100000:3.0:1777051432.726868:0:10113:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5fbef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3677:x1863365452638848:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1777051432.726905:0:8473:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 460824128 pending 1073152 free 3644805120 avail 3413282816 00002000:00000024:3.0:1777051432.726924:0:10113:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 480394816 pending 3219456 free 3862671360 avail 3631149056 00000100:00100000:2.0:1777051432.727005:0:8473:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3680:x1863365452638976:12345-0@lo:13:osp-pre-1-1.0 Request processed in 168us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051432.727024:0:8473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5662 00000100:00100000:3.0:1777051432.727032:0:10113:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5fbef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3677:x1863365452638848:12345-0@lo:13:osp-pre-0-1.0 Request processed in 166us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051432.727048:0:10113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5663 00000100:00100000:1.0:1777051432.727066:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f9bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3680:1863365452638976:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1777051432.727127:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94ed2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452638848:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1777051433.048264:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1777051433.570935:0:107497:0:(llog.c:801:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1777051433.570946:0:107497:0:(llog_cat.c:158:llog_cat_process_common()) processing log [0x1:0x12:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1777051433.570999:0:107497:0:(llog.c:858:llog_process_thread()) stop processing plain [0x1:0x12:0x0] index 6 count 4 00000040:00080000:1.0:1777051433.571009:0:107497:0:(llog.c:858:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000001:00080000:2.0:1777051433.760654:0:103159:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771166 is committed 00000001:00080000:2.0:1777051433.760701:0:103159:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771163 is committed 00000020:00080000:2.0:1777051433.760735:0:103159:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff99d95cf51180 refcount 2 committed 0 result 0 batchid 25769803777 00000020:00080000:2.0:1777051433.760744:0:103159:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff99da7b2f5200 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff99d95cf51f00 00000020:00080000:2.0:1777051433.760751:0:103159:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x240000bd1:0x2:0x0].1 00000020:00080000:2.0:1777051433.760756:0:103159:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff99da7b2f5400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff99d941e5f800 00000020:00080000:2.0:1777051433.760761:0:103159:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x2000032e0:0x2:0x0].1 00000004:00080000:2.0:1777051433.761286:0:103159:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000004:00080000:2.0:1777051433.761310:0:103159:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00010000:00010000:1.0:1777051433.761375:0:3664:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b400/0x85f51a6b9671619e lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e2:0x4:0x0].0x4b5e7af5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051433.761403:0:3664:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b400/0x85f51a6b9671619e lrc: 2/0,0 mode: TXN/TXN res: [0x2000032e2:0x4:0x0].0x4b5e7af5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051433.761418:0:3664:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b400/0x85f51a6b9671619e lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e2:0x4:0x0].0x4b5e7af5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051433.761430:0:3664:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94eb2b400 already unused, calling callback (ffffffffc17724f0) 00000100:00100000:2.0:1777051433.761435:0:3679:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:1.0:1777051433.761439:0:3664:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b400/0x85f51a6b9671619e lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e2:0x4:0x0].0x4b5e7af5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051433.761454:0:3664:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b400/0x85f51a6b9671619e lrc: 4/0,0 mode: TXN/TXN res: [0x2000032e2:0x4:0x0].0x4b5e7af5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051433.761479:0:3664:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0x4:0x0].0x4b5e7af5 (ffff99d943f76500) 00010000:00010000:1.0:1777051433.761486:0:3664:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777051433.761493:0:3664:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b400/0x85f51a6b9671619e lrc: 2/0,0 mode: --/TXN res: [0x2000032e2:0x4:0x0].0x4b5e7af5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051433.761493:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94ed2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452639104:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1777051433.761513:0:3664:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b400/0x85f51a6b9671619e lrc: 0/0,0 mode: --/TXN res: [0x2000032e2:0x4:0x0].0x4b5e7af5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051433.761550:0:3664:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2a800/0x85f51a6b967161ba lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e2:0x3:0x0].0xac1bda01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051433.761558:0:3664:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2a800/0x85f51a6b967161ba lrc: 2/0,0 mode: TXN/TXN res: [0x2000032e2:0x3:0x0].0xac1bda01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051433.761565:0:3664:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2a800/0x85f51a6b967161ba lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e2:0x3:0x0].0xac1bda01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051433.761571:0:3664:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94eb2a800 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:1.0:1777051433.761576:0:3664:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2a800/0x85f51a6b967161ba lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e2:0x3:0x0].0xac1bda01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051433.761583:0:3664:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2a800/0x85f51a6b967161ba lrc: 4/0,0 mode: TXN/TXN res: [0x2000032e2:0x3:0x0].0xac1bda01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051433.761592:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1777051433.761605:0:3664:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0x3:0x0].0xac1bda01 (ffff99d943f76a00) 00010000:00010000:1.0:1777051433.761609:0:3664:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777051433.761612:0:3664:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2a800/0x85f51a6b967161ba lrc: 2/0,0 mode: --/TXN res: [0x2000032e2:0x3:0x0].0xac1bda01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051433.761618:0:3664:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2a800/0x85f51a6b967161ba lrc: 0/0,0 mode: --/TXN res: [0x2000032e2:0x3:0x0].0xac1bda01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051433.761637:0:3664:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950262600/0x85f51a6b96716207 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc9adb04b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051433.761643:0:3664:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d950262600/0x85f51a6b96716207 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc9adb04b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051433.761650:0:3664:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d950262600/0x85f51a6b96716207 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc9adb04b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051433.761656:0:3664:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d950262600 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:1.0:1777051433.761660:0:3664:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d950262600/0x85f51a6b96716207 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc9adb04b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051433.761667:0:3664:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d950262600/0x85f51a6b96716207 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc9adb04b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051433.761676:0:3664:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc9adb04b (ffff99d9413d0700) 00010000:00010000:1.0:1777051433.761679:0:3664:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777051433.761683:0:3664:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d950262600/0x85f51a6b96716207 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xc9adb04b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051433.761689:0:3664:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d950262600/0x85f51a6b96716207 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xc9adb04b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1777051433.762217:0:103195:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 25769803777 committed batchid 8590017025 00000020:00080000:2.0:1777051433.762298:0:103195:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8590017025 00010000:00010000:1.0:1777051433.762313:0:3664:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263600/0x85f51a6b9671620e lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e2:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051433.762326:0:3664:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263600/0x85f51a6b9671620e lrc: 2/0,0 mode: TXN/TXN res: [0x2000032e2:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051433.762335:0:3664:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263600/0x85f51a6b9671620e lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e2:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051433.762343:0:3664:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d950263600 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:1.0:1777051433.762347:0:3664:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263600/0x85f51a6b9671620e lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e2:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051433.762356:0:3664:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263600/0x85f51a6b9671620e lrc: 4/0,0 mode: TXN/TXN res: [0x2000032e2:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051433.762369:0:3664:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0x5:0x0].0x0 (ffff99d9413d0100) 00010000:00010000:1.0:1777051433.762373:0:3664:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777051433.762378:0:3664:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263600/0x85f51a6b9671620e lrc: 2/0,0 mode: --/TXN res: [0x2000032e2:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051433.762388:0:3664:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263600/0x85f51a6b9671620e lrc: 0/0,0 mode: --/TXN res: [0x2000032e2:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051433.762430:0:3664:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950262e00/0x85f51a6b9671629a lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e2:0x5:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051433.762432:0:8468:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452639104 00010000:00010000:1.0:1777051433.762452:0:3664:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d950262e00/0x85f51a6b9671629a lrc: 2/0,0 mode: TXN/TXN res: [0x2000032e2:0x5:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051433.762463:0:3664:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d950262e00/0x85f51a6b9671629a lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e2:0x5:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051433.762473:0:3664:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d950262e00 already unused, calling callback (ffffffffc17724f0) 00000100:00100000:2.0:1777051433.762476:0:8468:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452639104 00010000:00010000:1.0:1777051433.762480:0:3664:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d950262e00/0x85f51a6b9671629a lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e2:0x5:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051433.762493:0:3664:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d950262e00/0x85f51a6b9671629a lrc: 4/0,0 mode: TXN/TXN res: [0x2000032e2:0x5:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051433.762512:0:3664:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0x5:0x0].0xd1d4b922 (ffff99d9413d0500) 00010000:00010000:1.0:1777051433.762516:0:3664:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1777051433.762543:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8026 00000100:00100000:2.0:1777051433.762557:0:8468:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94ed2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3679:x1863365452639104:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1777051433.762575:0:3664:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d950262e00/0x85f51a6b9671629a lrc: 2/0,0 mode: --/TXN res: [0x2000032e2:0x5:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051433.762588:0:3664:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d950262e00/0x85f51a6b9671629a lrc: 0/0,0 mode: --/TXN res: [0x2000032e2:0x5:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1777051433.762591:0:8468:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:483 count 1 00010000:00010000:1.0:1777051433.762621:0:3664:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2a600/0x85f51a6b967162a1 lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e2:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051433.762626:0:8468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007917b08a/0x85f51a6b967166d7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1e3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051433.762636:0:3664:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2a600/0x85f51a6b967162a1 lrc: 2/0,0 mode: TXN/TXN res: [0x2000032e2:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051433.762668:0:3664:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2a600/0x85f51a6b967162a1 lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e2:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051433.762680:0:3664:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94eb2a600 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:2.0:1777051433.762688:0:8468:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000036b4d075/0x85f51a6b96716151 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x1e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b638d expref: 51 pid: 24468 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051433.762689:0:3664:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2a600/0x85f51a6b967162a1 lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e2:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051433.762721:0:3664:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2a600/0x85f51a6b967162a1 lrc: 4/0,0 mode: TXN/TXN res: [0x2000032e2:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051433.762723:0:8468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777051433.762729:0:8468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777051433.762737:0:8468:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007917b08a/0x85f51a6b967166d7 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x1e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051433.762743:0:3664:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0x6:0x0].0x0 (ffff99d943f76700) 00010000:00010000:1.0:1777051433.762754:0:3664:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777051433.762759:0:3664:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2a600/0x85f51a6b967162a1 lrc: 2/0,0 mode: --/TXN res: [0x2000032e2:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051433.763505:0:3664:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2a600/0x85f51a6b967162a1 lrc: 0/0,0 mode: --/TXN res: [0x2000032e2:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051433.763523:0:8468:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000036b4d075/0x85f51a6b96716151 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b638d expref: 51 pid: 24468 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051433.763524:0:3664:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2ae00/0x85f51a6b967162a8 lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051433.763558:0:3664:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2ae00/0x85f51a6b967162a8 lrc: 2/0,0 mode: TXN/TXN res: [0x2000032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051433.763569:0:8468:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000036b4d075/0x85f51a6b96716151 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b638d expref: 51 pid: 24468 timeout: 8162 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051433.763575:0:3664:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2ae00/0x85f51a6b967162a8 lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051433.763605:0:3664:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94eb2ae00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:1.0:1777051433.763612:0:3664:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2ae00/0x85f51a6b967162a8 lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051433.763613:0:8468:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94ed2dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8468:1863365452639232:192.168.201.46@tcp:104: 00010000:00010000:1.0:1777051433.763633:0:3664:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2ae00/0x85f51a6b967162a8 lrc: 4/0,0 mode: TXN/TXN res: [0x2000032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051433.763650:0:3664:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e0:0x1:0x0].0x0 (ffff99d943f76200) 00010000:00010000:1.0:1777051433.763656:0:3664:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777051433.763661:0:3664:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2ae00/0x85f51a6b967162a8 lrc: 2/0,0 mode: --/TXN res: [0x2000032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051433.763671:0:3664:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2ae00/0x85f51a6b967162a8 lrc: 0/0,0 mode: --/TXN res: [0x2000032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051433.763747:0:8468:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d956bdad80 going to sleep for 11 seconds 00010000:00010000:0.0:1777051433.764401:0:3663:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eccc000/0x85f51a6b96716445 lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e0:0x1:0x0].0xab04085a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051433.764417:0:3663:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eccc000/0x85f51a6b96716445 lrc: 2/0,0 mode: TXN/TXN res: [0x2000032e0:0x1:0x0].0xab04085a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051433.764428:0:3663:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eccc000/0x85f51a6b96716445 lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e0:0x1:0x0].0xab04085a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051433.764437:0:3663:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94eccc000 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:0.0:1777051433.764444:0:3663:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eccc000/0x85f51a6b96716445 lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e0:0x1:0x0].0xab04085a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051433.764456:0:3663:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eccc000/0x85f51a6b96716445 lrc: 4/0,0 mode: TXN/TXN res: [0x2000032e0:0x1:0x0].0xab04085a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051433.764472:0:3663:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e0:0x1:0x0].0xab04085a (ffff99d9413d0f00) 00010000:00010000:0.0:1777051433.764477:0:3663:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777051433.764483:0:3663:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eccc000/0x85f51a6b96716445 lrc: 2/0,0 mode: --/TXN res: [0x2000032e0:0x1:0x0].0xab04085a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051433.764492:0:3663:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eccc000/0x85f51a6b96716445 lrc: 0/0,0 mode: --/TXN res: [0x2000032e0:0x1:0x0].0xab04085a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051433.769598:0:8468:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94ed2dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8468:1863365452639232:192.168.201.46@tcp:104: 00010000:00010000:0.0:1777051433.769632:0:8468:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000007917b08a/0x85f51a6b967166d7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051433.773731:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051433.774143:0:6566:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426000768 00000100:00100000:2.0:1777051433.774154:0:6566:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426000768 00010000:00010000:2.0:1777051433.774355:0:6566:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000036b4d075/0x85f51a6b96716151 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b638d expref: 52 pid: 24468 timeout: 8162 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051433.774418:0:6566:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3886 00000100:00100000:2.0:1777051433.774434:0:6566:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+52:2436:x1863365426000768:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1777051433.774454:0:6566:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777051433.774465:0:6566:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000036b4d075/0x85f51a6b96716151 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b638d expref: 52 pid: 24468 timeout: 8162 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051433.774485:0:6566:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000036b4d075/0x85f51a6b96716151 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b638d expref: 52 pid: 24468 timeout: 8162 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051433.774514:0:6566:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000036b4d075/0x85f51a6b96716151 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x1e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b638d expref: 52 pid: 24468 timeout: 8162 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051433.774534:0:6566:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777051433.774537:0:6566:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777051433.774544:0:6566:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007917b08a/0x85f51a6b967166d7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051433.774559:0:6566:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007917b08a/0x85f51a6b967166d7 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051433.774603:0:6566:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1777051433.774659:0:6566:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+51:2436:x1863365426000768:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 228us (932us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051433.774671:0:6566:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3886 00010000:00010000:1.0:1777051433.774905:0:8468:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000007917b08a/0x85f51a6b967166d7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051433.774920:0:8468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007917b08a/0x85f51a6b967166d7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051433.774933:0:8468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007917b08a/0x85f51a6b967166d7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051433.774942:0:8468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007917b08a/0x85f51a6b967166d7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051433.774965:0:8468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1777051433.775477:0:8468:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94ed2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3679:x1863365452639104:12345-0@lo:6:osp-syn-1-0.0 Request processed in 12919us (13889us total) trans 4294968359 rc 0/0 00000100:00100000:1.0:1777051433.775494:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8026 00010000:00010000:3.0:1777051433.775496:0:6568:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777051433.775509:0:6568:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007917b08a/0x85f51a6b967166d7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051433.775523:0:6568:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d954ea4c00 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:3.0:1777051433.775530:0:6568:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007917b08a/0x85f51a6b967166d7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051433.775544:0:6568:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007917b08a/0x85f51a6b967166d7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051433.775565:0:6568:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007917b08a/0x85f51a6b967166d7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051433.775576:0:6568:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007917b08a/0x85f51a6b967166d7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051433.775601:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051433.775605:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051433.775608:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1777051433.775736:0:3679:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99d94ed2ce00/2, rc 0, transno 4294968359 00000100:00100000:2.0:1777051433.775747:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94ed2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452639104:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1777051434.070655:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1777051434.265608:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f9be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3677:1863365452639360:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1777051434.265708:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051434.265792:0:8472:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452639360 00000100:00100000:1.0:1777051434.265803:0:8472:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452639360 00000100:00100000:1.0:1777051434.265920:0:8472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5664 00000100:00100000:1.0:1777051434.265938:0:8472:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3677:x1863365452639360:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1777051434.265983:0:8472:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 460824128 pending 1073152 free 3643756544 avail 3412234240 00000100:00100000:1.0:1777051434.266062:0:8472:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3677:x1863365452639360:12345-0@lo:13:osp-pre-1-0.0 Request processed in 128us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051434.266077:0:8472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5664 00000100:00080000:1.0:1777051434.266121:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1777051434.266524:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f9be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3677:1863365452639360:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1777051434.266991:0:3677:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1777051434.267013:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f9be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3677:1863365452639488:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1777051434.267071:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051434.267435:0:8473:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452639488 00000100:00100000:0.0:1777051434.267445:0:8473:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452639488 00000100:00100000:0.0:1777051434.267534:0:8473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5665 00000100:00100000:0.0:1777051434.267550:0:8473:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3677:x1863365452639488:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1777051434.267578:0:8473:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 480394816 pending 3219456 free 3859525632 avail 3628003328 00000100:00080000:1.0:1777051434.267635:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1777051434.267651:0:8473:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3677:x1863365452639488:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (579us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051434.267664:0:8473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5665 00000100:00100000:1.0:1777051434.268051:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f9be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3677:1863365452639488:0@lo:13:osp-pre-0-0.0 00000040:00080000:0.0:1777051434.399300:0:107548:0:(llog.c:801:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1777051434.399311:0:107548:0:(llog_cat.c:158:llog_cat_process_common()) processing log [0x1:0x12:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1777051434.399353:0:107548:0:(llog.c:858:llog_process_thread()) stop processing plain [0x1:0x12:0x0] index 6 count 4 00000040:00080000:0.0:1777051434.399363:0:107548:0:(llog.c:858:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:3.0:1777051435.095416:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1777051435.333003:0:107599:0:(llog.c:801:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1777051435.333015:0:107599:0:(llog_cat.c:158:llog_cat_process_common()) processing log [0x1:0x12:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1777051435.333070:0:107599:0:(llog.c:858:llog_process_thread()) stop processing plain [0x1:0x12:0x0] index 6 count 4 00000040:00080000:3.0:1777051435.333082:0:107599:0:(llog.c:858:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000001:00080000:1.0:1777051435.802578:0:104205:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934640 is committed 00000001:00080000:1.0:1777051435.802638:0:104205:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934631 is committed 00010000:00010000:0.0:1777051435.802685:0:3663:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61a400/0x85f51a6b9671635e lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0xa30099d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8492 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051435.802709:0:3663:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61a400/0x85f51a6b9671635e lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0xa30099d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8492 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051435.802722:0:3663:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61a400/0x85f51a6b9671635e lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0xa30099d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8492 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051435.802733:0:3663:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94e61a400 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:0.0:1777051435.802740:0:3663:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61a400/0x85f51a6b9671635e lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0xa30099d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8492 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051435.802752:0:3663:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61a400/0x85f51a6b9671635e lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0xa30099d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8492 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051435.802775:0:3663:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0xa30099d5 (ffff99d943f76800) 00010000:00010000:0.0:1777051435.802780:0:3663:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777051435.802808:0:3663:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61a400/0x85f51a6b9671635e lrc: 2/0,0 mode: --/TXN res: [0x240000bd1:0x1:0x0].0xa30099d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8492 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051435.802858:0:3663:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61a400/0x85f51a6b9671635e lrc: 0/0,0 mode: --/TXN res: [0x240000bd1:0x1:0x0].0xa30099d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8492 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051435.802896:0:3663:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61bc00/0x85f51a6b967163ab lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x50a12932 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10328 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051435.802907:0:3663:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61bc00/0x85f51a6b967163ab lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x50a12932 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10328 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051435.802918:0:3663:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61bc00/0x85f51a6b967163ab lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x50a12932 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10328 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051435.802928:0:3663:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94e61bc00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:0.0:1777051435.802933:0:3663:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61bc00/0x85f51a6b967163ab lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x50a12932 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10328 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051435.802944:0:3663:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61bc00/0x85f51a6b967163ab lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x50a12932 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10328 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051435.802958:0:3663:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x50a12932 (ffff99d943f76d00) 00010000:00010000:0.0:1777051435.802963:0:3663:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777051435.802968:0:3663:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61bc00/0x85f51a6b967163ab lrc: 2/0,0 mode: --/TXN res: [0x240000bd1:0x1:0x0].0x50a12932 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10328 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051435.802978:0:3663:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61bc00/0x85f51a6b967163ab lrc: 0/0,0 mode: --/TXN res: [0x240000bd1:0x1:0x0].0x50a12932 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10328 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051435.803004:0:3663:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61ba00/0x85f51a6b967163f8 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x999b0966 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6581 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051435.803016:0:3663:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61ba00/0x85f51a6b967163f8 lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x999b0966 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6581 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051435.803027:0:3663:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61ba00/0x85f51a6b967163f8 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x999b0966 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6581 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051435.803037:0:3663:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94e61ba00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:0.0:1777051435.803042:0:3663:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61ba00/0x85f51a6b967163f8 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x999b0966 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6581 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051435.803723:0:3663:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61ba00/0x85f51a6b967163f8 lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd1:0x1:0x0].0x999b0966 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6581 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051435.803746:0:3663:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x999b0966 (ffff99d943f76600) 00010000:00010000:0.0:1777051435.803751:0:3663:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777051435.803759:0:3663:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61ba00/0x85f51a6b967163f8 lrc: 2/0,0 mode: --/TXN res: [0x240000bd1:0x1:0x0].0x999b0966 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6581 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051435.803771:0:3663:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61ba00/0x85f51a6b967163f8 lrc: 0/0,0 mode: --/TXN res: [0x240000bd1:0x1:0x0].0x999b0966 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6581 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051436.118564:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1777051436.250023:0:107650:0:(llog.c:801:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:1.0:1777051436.250035:0:107650:0:(llog_cat.c:158:llog_cat_process_common()) processing log [0x1:0x2b:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1777051436.250085:0:107650:0:(llog.c:858:llog_process_thread()) stop processing plain [0x1:0x2b:0x0] index 6 count 4 00000040:00080000:1.0:1777051436.250095:0:107650:0:(llog.c:858:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00000100:00100000:2.0:1777051436.304509:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051436.304661:0:8471:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426000896 00000100:00100000:3.0:1777051436.304672:0:8471:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426000896 00000100:00100000:3.0:1777051436.304856:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 8027 00000100:00100000:3.0:1777051436.304872:0:8471:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94ed2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+51:2436:x1863365426000896:12345-192.168.201.46@tcp:101:lfs.0 00010000:00010000:3.0:1777051436.304895:0:8471:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:1.0:1777051436.304896:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1777051436.304918:0:8471:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000554aaf12/0x85f51a6b967166de lrc: 2/0,0 mode: --/PR res: [0x280000400:0x103:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b655b expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051436.304965:0:8471:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051436.304970:0:8471:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051436.304983:0:8471:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000554aaf12/0x85f51a6b967166de lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x103:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b655b expref: 52 pid: 8471 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051436.305007:0:8471:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000554aaf12/0x85f51a6b967166de lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x103:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b655b expref: 52 pid: 8471 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051436.305026:0:8471:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d9559a3800, rc 0) 00000100:00100000:3.0:1777051436.305108:0:8471:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94ed2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+52:2436:x1863365426000896:12345-192.168.201.46@tcp:101:lfs.0 Request processed in 240us (615us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051436.305119:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 8027 00000100:00100000:1.0:1777051436.318033:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051436.318109:0:6580:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426001152 00000100:00100000:3.0:1777051436.318122:0:6580:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426001152 00000100:00100000:3.0:1777051436.318489:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112126 00000100:00100000:3.0:1777051436.318509:0:6580:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+52:138098:x1863365426001152:12345-192.168.201.46@tcp:101:lfs.0 00010000:00010000:3.0:1777051436.318535:0:6580:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777051436.318562:0:6580:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a2c00/0x85f51a6b967166e5 lrc: 2/0,0 mode: --/CR res: [0x240000bd2:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6562 expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051436.318985:0:6580:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a2a00/0x85f51a6b967166ec lrc: 3/0,1 mode: --/PW res: [0x240000bd2:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051436.319010:0:6580:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a2a00/0x85f51a6b967166ec lrc: 3/0,1 mode: PW/PW res: [0x240000bd2:0x1:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6580 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051436.319029:0:6580:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a2a00/0x85f51a6b967166ec lrc: 3/0,1 mode: PW/PW res: [0x240000bd2:0x1:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6580 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1777051436.319048:0:6580:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000bd2:0x1:0x0]: returning size 1048576 00010000:00010000:3.0:1777051436.319240:0:6580:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a2c00/0x85f51a6b967166e5 lrc: 0/0,0 mode: --/CR res: [0x240000bd2:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6562 expref: 55 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051436.319265:0:6580:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a2a00/0x85f51a6b967166ec lrc: 3/0,0 mode: PW/PW res: [0x240000bd2:0x1:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6562 expref: 54 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051436.319278:0:6580:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x1:0x0].0x0 (ffff99d943f76b00) 00010000:00010000:3.0:1777051436.319282:0:6580:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1777051436.319287:0:6580:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d9559a2a00, rc 0) 00000100:00100000:3.0:1777051436.319353:0:6580:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+54:138098:x1863365426001152:12345-192.168.201.46@tcp:101:lfs.0 Request processed in 850us (1325us total) trans 8589934641 rc 0/0 00000100:00100000:3.0:1777051436.319364:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112126 00000100:00080000:3.0:1777051436.319395:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1777051436.328960:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051436.329046:0:24468:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426001280 00000100:00100000:2.0:1777051436.329058:0:24468:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426001280 00000100:00100000:2.0:1777051436.329135:0:24468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 8028 00000100:00100000:2.0:1777051436.329151:0:24468:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5fbef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+52:2436:x1863365426001280:12345-192.168.201.46@tcp:1:lfs.0 00010000:00010000:2.0:1777051436.329226:0:24468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c93414fd/0x85f51a6b967166fa lrc: 3/0,1 mode: --/PW res: [0x280000400:0x103:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051436.329254:0:24468:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000067c7f5ed/0x85f51a6b96716675 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x103:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6538 expref: 59 pid: 8468 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051436.329268:0:24468:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000554aaf12/0x85f51a6b967166de lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x103:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b655b expref: 52 pid: 8471 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051436.329279:0:24468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777051436.329282:0:24468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777051436.329287:0:24468:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c93414fd/0x85f51a6b967166fa lrc: 5/0,1 mode: --/PW res: [0x280000400:0x103:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051436.329334:0:24468:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000554aaf12/0x85f51a6b967166de lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x103:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b655b expref: 52 pid: 8471 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051436.329356:0:24468:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000554aaf12/0x85f51a6b967166de lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x103:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b655b expref: 52 pid: 8471 timeout: 8165 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051436.329376:0:24468:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94ed2fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:24468:1863365452639616:192.168.201.46@tcp:104: 00010000:00010000:2.0:1777051436.329500:0:24468:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000067c7f5ed/0x85f51a6b96716675 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x103:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6538 expref: 59 pid: 8468 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051436.329524:0:24468:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000067c7f5ed/0x85f51a6b96716675 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x103:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6538 expref: 59 pid: 8468 timeout: 8165 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051436.329540:0:24468:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94ed2c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:24468:1863365452639744:192.168.201.46@tcp:104: 00000100:00100000:2.0:1777051436.329581:0:24468:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d956bdacc0 going to sleep for 11 seconds 00000100:00100000:3.0:1777051436.335496:0:24468:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94ed2fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:24468:1863365452639616:192.168.201.46@tcp:104: 00000100:00100000:3.0:1777051436.335519:0:24468:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94ed2c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:24468:1863365452639744:192.168.201.46@tcp:104: 00010000:00010000:3.0:1777051436.335559:0:24468:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c93414fd/0x85f51a6b967166fa lrc: 3/0,1 mode: --/PW res: [0x280000400:0x103:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051436.337170:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051436.337282:0:24467:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426001408 00000100:00100000:0.0:1777051436.337292:0:24467:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426001408 00010000:00010000:0.0:1777051436.337342:0:24467:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000554aaf12/0x85f51a6b967166de lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x103:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b655b expref: 53 pid: 8471 timeout: 8165 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051436.337415:0:24467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3887 00000100:00100000:0.0:1777051436.337427:0:24467:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5fbece00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+53:2437:x1863365426001408:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1777051436.337443:0:24467:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777051436.337465:0:24467:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000554aaf12/0x85f51a6b967166de lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x103:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b655b expref: 53 pid: 8471 timeout: 8165 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051436.337486:0:24467:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000554aaf12/0x85f51a6b967166de lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x103:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b655b expref: 53 pid: 8471 timeout: 8165 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051436.337518:0:24467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000554aaf12/0x85f51a6b967166de lrc: 0/0,0 mode: --/PR res: [0x280000400:0x103:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b655b expref: 53 pid: 8471 timeout: 8165 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051436.337539:0:24467:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1777051436.337680:0:24467:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5fbece00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+52:2437:x1863365426001408:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 253us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051436.337695:0:24467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3887 00000100:00100000:2.0:1777051436.338646:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051436.339032:0:6564:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426001536 00000100:00100000:0.0:1777051436.339038:0:6564:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426001536 00010000:00010000:0.0:1777051436.339087:0:6564:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000067c7f5ed/0x85f51a6b96716675 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x103:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6538 expref: 60 pid: 8468 timeout: 8165 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051436.339120:0:6564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3888 00000100:00100000:0.0:1777051436.339130:0:6564:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da6fd41450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+60:2437:x1863365426001536:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1777051436.339142:0:6564:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777051436.339156:0:6564:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000067c7f5ed/0x85f51a6b96716675 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x103:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6538 expref: 60 pid: 8468 timeout: 8165 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051436.339172:0:6564:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000067c7f5ed/0x85f51a6b96716675 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x103:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6538 expref: 60 pid: 8468 timeout: 8165 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051436.339199:0:6564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000067c7f5ed/0x85f51a6b96716675 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x103:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6538 expref: 60 pid: 8468 timeout: 8165 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051436.339217:0:6564:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777051436.339220:0:6564:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777051436.339226:0:6564:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c93414fd/0x85f51a6b967166fa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x103:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051436.339239:0:6564:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c93414fd/0x85f51a6b967166fa lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x103:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051436.339277:0:6564:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1777051436.339313:0:6564:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da6fd41450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+59:2437:x1863365426001536:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 182us (670us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051436.339323:0:6564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3888 00010000:00010000:0.0:1777051436.339396:0:24468:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c93414fd/0x85f51a6b967166fa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x103:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051436.339411:0:24468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c93414fd/0x85f51a6b967166fa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x103:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1777051436.339431:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1777051436.339439:0:24468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c93414fd/0x85f51a6b967166fa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x103:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051436.339454:0:24468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c93414fd/0x85f51a6b967166fa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x103:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051436.339467:0:24468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c93414fd/0x85f51a6b967166fa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x103:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051436.339477:0:24468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d954ea5a00 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:0.0:1777051436.339482:0:24468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c93414fd/0x85f51a6b967166fa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x103:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051436.339495:0:24468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c93414fd/0x85f51a6b967166fa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x103:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051436.339510:0:24468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c93414fd/0x85f51a6b967166fa lrc: 2/0,0 mode: --/PW res: [0x280000400:0x103:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051436.339519:0:24468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c93414fd/0x85f51a6b967166fa lrc: 0/0,0 mode: --/PW res: [0x280000400:0x103:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051436.339577:0:24468:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5fbef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+51:2436:x1863365426001280:12345-192.168.201.46@tcp:1:lfs.0 Request processed in 10429us (10623us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051436.339587:0:24468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 8028 00000100:00100000:3.0:1777051436.344404:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051436.344634:0:6588:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426001664 00000100:00100000:0.0:1777051436.344645:0:6588:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426001664 00000100:00100000:0.0:1777051436.344718:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 21 00000100:00100000:0.0:1777051436.344733:0:6588:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5fbedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+54:138098:x1863365426001664:12345-192.168.201.46@tcp:700:lfs.0 00000100:00100000:0.0:1777051436.344872:0:6588:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5fbedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+54:138098:x1863365426001664:12345-192.168.201.46@tcp:700:lfs.0 Request processed in 142us (799us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051436.344885:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 21 00000100:00100000:2.0:1777051436.350498:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051436.350642:0:6583:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426001920 00000100:00100000:1.0:1777051436.350652:0:6583:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426001920 00000100:00100000:1.0:1777051436.350766:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3370 00000100:00100000:1.0:1777051436.350785:0:6583:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da6ff01450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+54:138098:x1863365426001920:12345-192.168.201.46@tcp:35:lfs.0 00000004:00010000:1.0:1777051436.350879:0:6583:0:(mdt_open.c:1994:mdt_hsm_release()) ### [0x240000bd2:0x1:0x0] lease broken? 0 ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a2a00/0x85f51a6b967166ec lrc: 3/0,0 mode: PW/PW res: [0x240000bd2:0x1:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6562 expref: 54 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1777051436.351143:0:6583:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 8589934642 00000001:00080000:1.0:1777051436.354285:0:6583:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 8589934643 00010000:00010000:1.0:1777051436.354353:0:6583:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72e400/0x85f51a6b96716701 lrc: 3/0,1 mode: --/EX res: [0x240000bd2:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6583 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051436.354377:0:6583:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61b200/0x85f51a6b96716365 lrc: 2/0,0 mode: PR/PR res: [0x240000bd2:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6419 expref: 11 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051436.354390:0:6583:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff99d94eb2ac00/0x85f51a6b967164d1 lrc: 2/0,0 mode: PR/PR res: [0x240000bd2:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b649e expref: 57 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051436.354402:0:6583:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72e400/0x85f51a6b96716701 lrc: 5/0,1 mode: --/EX res: [0x240000bd2:0x1:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6583 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051436.354447:0:6583:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff99d94eb2ac00/0x85f51a6b967164d1 lrc: 3/0,0 mode: PR/PR res: [0x240000bd2:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b649e expref: 57 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051436.354468:0:6583:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94eb2ac00/0x85f51a6b967164d1 lrc: 4/0,0 mode: PR/PR res: [0x240000bd2:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b649e expref: 57 pid: 6580 timeout: 8165 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051436.354489:0:6583:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f9bfb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0001_UUID:6583:1863365452639872:192.168.201.46@tcp:104: 00010000:00010000:1.0:1777051436.354603:0:6583:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61b200/0x85f51a6b96716365 lrc: 3/0,0 mode: PR/PR res: [0x240000bd2:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6419 expref: 11 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051436.354619:0:6583:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61b200/0x85f51a6b96716365 lrc: 4/0,0 mode: PR/PR res: [0x240000bd2:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6419 expref: 11 pid: 8492 timeout: 8165 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051436.354645:0:6583:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f9bdc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0001_UUID:6583:1863365452640000:192.168.201.46@tcp:104: 00000100:00100000:1.0:1777051436.354692:0:6583:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d959767600 going to sleep for 11 seconds 00000100:00100000:1.0:1777051436.357571:0:6583:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f9bfb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0001_UUID:6583:1863365452639872:192.168.201.46@tcp:104: 00000100:00100000:0.0:1777051436.359141:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051436.359198:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051436.359310:0:9550:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426002048 00000100:00100000:1.0:1777051436.359320:0:9550:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426002048 00010000:00010000:1.0:1777051436.359362:0:9550:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d94eb2ac00/0x85f51a6b967164d1 lrc: 4/0,0 mode: PR/PR res: [0x240000bd2:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b649e expref: 58 pid: 6580 timeout: 8165 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051436.359385:0:6583:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f9bdc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0001_UUID:6583:1863365452640000:192.168.201.46@tcp:104: 00000100:00100000:1.0:1777051436.359406:0:9550:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426002176 00000100:00100000:1.0:1777051436.359413:0:9550:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426002176 00010000:00010000:3.0:1777051436.359425:0:6583:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72e400/0x85f51a6b96716701 lrc: 3/0,1 mode: --/EX res: [0x240000bd2:0x1:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6583 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051436.359457:0:9550:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61b200/0x85f51a6b96716365 lrc: 4/0,0 mode: PR/PR res: [0x240000bd2:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6419 expref: 12 pid: 8492 timeout: 8165 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051436.359486:0:47597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3889 00000100:00100000:1.0:1777051436.359506:0:9550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3890 00000100:00100000:3.0:1777051436.359509:0:47597:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7e24e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+58:2436:x1863365426002048:12345-192.168.201.46@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1777051436.359527:0:9550:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7e24f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+12:2436:x1863365426002176:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1777051436.359532:0:47597:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1777051436.359546:0:9550:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777051436.359546:0:47597:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff99d94eb2ac00/0x85f51a6b967164d1 lrc: 4/0,0 mode: PR/PR res: [0x240000bd2:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b649e expref: 58 pid: 6580 timeout: 8165 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051436.359560:0:9550:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61b200/0x85f51a6b96716365 lrc: 4/0,0 mode: PR/PR res: [0x240000bd2:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6419 expref: 12 pid: 8492 timeout: 8165 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051436.359572:0:47597:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff99d94eb2ac00/0x85f51a6b967164d1 lrc: 3/0,0 mode: PR/PR res: [0x240000bd2:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b649e expref: 58 pid: 6580 timeout: 8165 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1777051436.359696:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1777051436.360561:0:9550:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61b200/0x85f51a6b96716365 lrc: 3/0,0 mode: PR/PR res: [0x240000bd2:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6419 expref: 12 pid: 8492 timeout: 8165 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051436.360593:0:47597:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d94eb2ac00/0x85f51a6b967164d1 lrc: 0/0,0 mode: --/PR res: [0x240000bd2:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b649e expref: 58 pid: 6580 timeout: 8165 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051436.360619:0:47597:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x1:0x0].0x0 (ffff99d943f76b00) 00010000:00010000:1.0:1777051436.360626:0:9550:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61b200/0x85f51a6b96716365 lrc: 0/0,0 mode: --/PR res: [0x240000bd2:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6419 expref: 12 pid: 8492 timeout: 8165 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051436.360629:0:47597:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72e400/0x85f51a6b96716701 lrc: 3/0,1 mode: --/EX res: [0x240000bd2:0x1:0x0].0x0 bits 0x28/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6583 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051436.360710:0:47597:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72e400/0x85f51a6b96716701 lrc: 3/0,1 mode: EX/EX res: [0x240000bd2:0x1:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6583 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051436.360722:0:47597:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72e400/0x85f51a6b96716701 lrc: 4/0,1 mode: EX/EX res: [0x240000bd2:0x1:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6583 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051436.360737:0:9550:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x1:0x0].0x0 (ffff99d943f76b00) 00010000:00010000:1.0:1777051436.361007:0:9550:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1777051436.361435:0:9550:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7e24f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+11:2436:x1863365426002176:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 1912us (2233us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051436.361449:0:9550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3890 00010000:00010000:3.0:1777051436.361465:0:47597:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1777051436.361508:0:47597:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7e24e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+57:2436:x1863365426002048:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 2006us (2366us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051436.361522:0:47597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3889 00010000:00010000:3.0:1777051436.361565:0:6583:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72e400/0x85f51a6b96716701 lrc: 3/0,1 mode: EX/EX res: [0x240000bd2:0x1:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6583 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051436.362127:0:6583:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72e400/0x85f51a6b96716701 lrc: 3/0,1 mode: EX/EX res: [0x240000bd2:0x1:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6583 initiator: MDT1 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1777051436.362242:0:6583:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 8589934644 00000001:00080000:3.0:1777051436.362439:0:6583:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 8589934645 00000100:00100000:3.0:1777051436.362567:0:6583:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5fbed500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0001-mdtlov_UUID:6583:1863365452640128:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1777051436.362876:0:6583:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051436.362924:0:6583:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d94eea9780 going to sleep for 11 seconds 00000100:00100000:1.0:1777051436.362982:0:6584:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452640128 00000100:00100000:1.0:1777051436.362991:0:6584:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452640128 00000100:00100000:1.0:1777051436.363067:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8182 00000100:00080000:2.0:1777051436.363079:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1777051436.363081:0:6584:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5fbedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:6583:x1863365452640128:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1777051436.363209:0:6584:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5fbedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:6583:x1863365452640128:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 117us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051436.363221:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8182 00000100:00100000:3.0:1777051436.363299:0:6583:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5fbed500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0001-mdtlov_UUID:6583:1863365452640128:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1777051436.363438:0:6583:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 8589934646 00000100:00100000:3.0:1777051436.363514:0:6583:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5fbed500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0001-mdtlov_UUID:6583:1863365452640256:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1777051436.363576:0:6583:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051436.363909:0:6583:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d95cf51780 going to sleep for 11 seconds 00000100:00100000:1.0:1777051436.363959:0:46498:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452640256 00000100:00100000:1.0:1777051436.363968:0:46498:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452640256 00000100:00100000:1.0:1777051436.364016:0:46498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8183 00000100:00100000:1.0:1777051436.364029:0:46498:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5fbee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+5:6583:x1863365452640256:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1777051436.364189:0:46498:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5fbee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:6583:x1863365452640256:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 161us (613us total) trans 4294968358 rc 0/0 00000100:00100000:1.0:1777051436.364200:0:46498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8183 00000100:00100000:3.0:1777051436.364299:0:6583:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5fbed500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0001-mdtlov_UUID:6583:1863365452640256:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1777051436.364351:0:6583:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 8589934647 00010000:00010000:3.0:1777051436.364385:0:6583:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72e400/0x85f51a6b96716701 lrc: 3/0,1 mode: EX/EX res: [0x240000bd2:0x1:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6583 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051436.364398:0:6583:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72e400/0x85f51a6b96716701 lrc: 2/0,0 mode: EX/EX res: [0x240000bd2:0x1:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6583 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051436.364410:0:6583:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72e400/0x85f51a6b96716701 lrc: 3/0,0 mode: EX/EX res: [0x240000bd2:0x1:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6583 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051436.364420:0:6583:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94d72e400 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:3.0:1777051436.364426:0:6583:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72e400/0x85f51a6b96716701 lrc: 3/0,0 mode: EX/EX res: [0x240000bd2:0x1:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6583 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051436.364435:0:6583:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72e400/0x85f51a6b96716701 lrc: 4/0,0 mode: EX/EX res: [0x240000bd2:0x1:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6583 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051436.364452:0:6583:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x1:0x0].0x0 (ffff99d943f76b00) 00010000:00010000:3.0:1777051436.364456:0:6583:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1777051436.364462:0:6583:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72e400/0x85f51a6b96716701 lrc: 2/0,0 mode: --/EX res: [0x240000bd2:0x1:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6583 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051436.364471:0:6583:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72e400/0x85f51a6b96716701 lrc: 0/0,0 mode: --/EX res: [0x240000bd2:0x1:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6583 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1777051436.364612:0:6583:0:(mdd_object.c:4010:mdd_close()) Object [0x240000bd3:0x1:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1777051436.365016:0:6583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].3, 64 off8384 00000004:00080000:3.0:1777051436.365038:0:6583:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 8065557839747ns, next at 8066557835692ns, rc = 0 00000001:00080000:3.0:1777051436.365050:0:6583:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 8589934648 00010000:00010000:3.0:1777051436.365086:0:6583:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x1:0x0].0x0 (ffff99d943f76b00) 00010000:00010000:3.0:1777051436.365091:0:6583:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1777051436.365101:0:6583:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a2a00/0x85f51a6b967166ec lrc: 0/0,0 mode: --/PW res: [0x240000bd2:0x1:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6562 expref: 61 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051436.365252:0:6583:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da6ff01450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+60:138098:x1863365426001920:12345-192.168.201.46@tcp:35:lfs.0 Request processed in 14473us (14758us total) trans 8589934649 rc 0/0 00000100:00100000:3.0:1777051436.365266:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3370 00000020:00080000:3.0:1777051436.365272:0:6583:0:(tgt_main.c:783:tgt_ses_key_exit()) total 8 transactions per RPC 00000100:00100000:1.0:1777051436.387975:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051436.388048:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051436.388107:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051436.388107:0:46500:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426002432 00000100:00100000:3.0:1777051436.388120:0:46500:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426002432 00000100:00100000:1.0:1777051436.388189:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051436.388193:0:46500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 8184 00000100:00100000:3.0:1777051436.388212:0:46500:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da6ff7f450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+60:2439:x1863365426002432:12345-192.168.201.46@tcp:63:ll_sa.0 00000100:00100000:1.0:1777051436.388241:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00010000:00010000:3.0:1777051436.388261:0:46500:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1777051436.388281:0:13320:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426002304 00010000:00010000:3.0:1777051436.388286:0:46500:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a2a00/0x85f51a6b96716708 lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6577 expref: -99 pid: 46500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051436.388290:0:13320:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426002304 00000100:00100000:2.0:1777051436.388319:0:27884:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426002688 00000100:00100000:2.0:1777051436.388328:0:27884:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426002688 00000100:00100000:1.0:1777051436.388360:0:13320:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426002816 00000100:00100000:1.0:1777051436.388367:0:13320:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426002816 00000100:00100000:2.0:1777051436.388388:0:27884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 8029 00010000:00010000:3.0:1777051436.388396:0:46500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a2c00/0x85f51a6b9671670f lrc: 3/1,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 46500 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051436.388407:0:27884:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+47:2437:x1863365426002304:12345-192.168.201.46@tcp:101:lfs.0 00000100:00100000:1.0:1777051436.388419:0:13320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 8030 00010000:00010000:3.0:1777051436.388424:0:46500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a2c00/0x85f51a6b9671670f lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 46500 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051436.388426:0:27884:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1777051436.388438:0:13320:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+52:2439:x1863365426002688:12345-192.168.201.46@tcp:101:ll_sa.0 00010000:00010000:2.0:1777051436.388443:0:27884:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a93e98b2/0x85f51a6b96716716 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x103:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6570 expref: -99 pid: 27884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051436.388448:0:46500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a2c00/0x85f51a6b9671670f lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 46500 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051436.388458:0:13320:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051436.388482:0:27884:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777051436.388487:0:27884:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051436.388490:0:13320:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c420a9d5/0x85f51a6b9671671d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x104:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b659a expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051436.388493:0:46500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a2600/0x85f51a6b96716724 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x4992a133 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 46500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051436.388498:0:27884:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a93e98b2/0x85f51a6b96716716 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x103:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6570 expref: 48 pid: 27884 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051436.388530:0:46500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a2600/0x85f51a6b96716724 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x4992a133 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46500 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051436.388539:0:27884:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a93e98b2/0x85f51a6b96716716 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x103:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6570 expref: 48 pid: 27884 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051436.388541:0:13320:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051436.388547:0:46500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a2600/0x85f51a6b96716724 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x4992a133 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 46500 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051436.388548:0:13320:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051436.388562:0:13320:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c420a9d5/0x85f51a6b9671671d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x104:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b659a expref: 53 pid: 13320 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051436.388599:0:27884:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d954ea4000, rc 0) 00010000:00010000:1.0:1777051436.388606:0:13320:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c420a9d5/0x85f51a6b9671671d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x104:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b659a expref: 53 pid: 13320 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051436.388620:0:46500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a2c00/0x85f51a6b9671670f lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 46500 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051436.388624:0:13320:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d94d72e600, rc 0) 00010000:00010000:3.0:1777051436.388638:0:46500:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a2c00/0x85f51a6b9671670f lrc: 2/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 46500 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051436.388649:0:46500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a2c00/0x85f51a6b9671670f lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 46500 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051436.388930:0:46500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d9559a2c00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:3.0:1777051436.388936:0:46500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a2c00/0x85f51a6b9671670f lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 46500 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051436.388949:0:27884:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+48:2437:x1863365426002304:12345-192.168.201.46@tcp:101:lfs.0 Request processed in 548us (981us total) trans 0 rc 0/0 00010000:00010000:3.0:1777051436.388949:0:46500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a2c00/0x85f51a6b9671670f lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 46500 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051436.388968:0:46500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff99d9413d0300) 00010000:00010000:3.0:1777051436.388978:0:46500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1777051436.388984:0:27884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 8029 00010000:00010000:3.0:1777051436.388987:0:46500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a2c00/0x85f51a6b9671670f lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 46500 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051436.388998:0:13320:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+53:2439:x1863365426002688:12345-192.168.201.46@tcp:101:ll_sa.0 Request processed in 563us (887us total) trans 0 rc 0/0 00010000:00010000:3.0:1777051436.389004:0:46500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a2c00/0x85f51a6b9671670f lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 46500 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051436.389020:0:27884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 8031 00000100:00100000:2.0:1777051436.389033:0:27884:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942a0f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+53:2438:x1863365426002816:12345-192.168.201.46@tcp:101:ll_sa.0 00010000:00010000:2.0:1777051436.389043:0:27884:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051436.389054:0:27884:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000054859c6/0x85f51a6b9671672b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x1e4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b65a1 expref: -99 pid: 27884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051436.389076:0:27884:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777051436.389079:0:27884:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777051436.389085:0:27884:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000054859c6/0x85f51a6b9671672b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x1e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b65a1 expref: 54 pid: 27884 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051436.389099:0:27884:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000054859c6/0x85f51a6b9671672b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x1e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b65a1 expref: 54 pid: 27884 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051436.389109:0:27884:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d954ea4400, rc 0) 00000100:00100000:1.0:1777051436.389129:0:13320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 8030 00000100:00100000:2.0:1777051436.389140:0:27884:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942a0f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+54:2438:x1863365426002816:12345-192.168.201.46@tcp:101:ll_sa.0 Request processed in 108us (899us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051436.389149:0:27884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 8031 00000100:00100000:2.0:1777051436.389233:0:11727:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426002560 00000100:00100000:2.0:1777051436.389241:0:11727:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426002560 00000100:00080000:1.0:1777051436.389279:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1777051436.389286:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1777051436.389296:0:11727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 8185 00000100:00100000:2.0:1777051436.389306:0:11727:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+33:2438:x1863365426002560:12345-192.168.201.46@tcp:63:ll_sa.0 00010000:00010000:2.0:1777051436.389326:0:11727:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051436.389340:0:11727:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d954ea5a00/0x85f51a6b96716732 lrc: 2/0,0 mode: --/CR res: [0x2000032e0:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6569 expref: -99 pid: 11727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051436.389371:0:11727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d954ea5800/0x85f51a6b96716739 lrc: 3/1,0 mode: --/CR res: [0x2000032e0:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051436.389380:0:11727:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d954ea5800/0x85f51a6b96716739 lrc: 3/1,0 mode: CR/CR res: [0x2000032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051436.389389:0:11727:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d954ea5800/0x85f51a6b96716739 lrc: 3/1,0 mode: CR/CR res: [0x2000032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051436.389401:0:11727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d954ea5400/0x85f51a6b96716740 lrc: 3/1,0 mode: --/PR res: [0x2000032e0:0x1:0x0].0x5a47bb0b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051436.389407:0:11727:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d954ea5400/0x85f51a6b96716740 lrc: 3/1,0 mode: PR/PR res: [0x2000032e0:0x1:0x0].0x5a47bb0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051436.389414:0:11727:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d954ea5400/0x85f51a6b96716740 lrc: 3/1,0 mode: PR/PR res: [0x2000032e0:0x1:0x0].0x5a47bb0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051436.389438:0:11727:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d954ea5800/0x85f51a6b96716739 lrc: 3/1,0 mode: CR/CR res: [0x2000032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051436.389444:0:11727:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d954ea5800/0x85f51a6b96716739 lrc: 2/0,0 mode: CR/CR res: [0x2000032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051436.389449:0:11727:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d954ea5800/0x85f51a6b96716739 lrc: 3/0,0 mode: CR/CR res: [0x2000032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051436.389459:0:11727:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d954ea5800 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:2.0:1777051436.389462:0:11727:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d954ea5800/0x85f51a6b96716739 lrc: 3/0,0 mode: CR/CR res: [0x2000032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051436.389467:0:11727:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d954ea5800/0x85f51a6b96716739 lrc: 4/0,0 mode: CR/CR res: [0x2000032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051436.389475:0:11727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e0:0x1:0x0].0x0 (ffff99d943f76200) 00010000:00010000:2.0:1777051436.389477:0:11727:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777051436.389481:0:11727:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d954ea5800/0x85f51a6b96716739 lrc: 2/0,0 mode: --/CR res: [0x2000032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051436.389486:0:11727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d954ea5800/0x85f51a6b96716739 lrc: 0/0,0 mode: --/CR res: [0x2000032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051436.389495:0:11727:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d954ea5400/0x85f51a6b96716740 lrc: 3/1,0 mode: PR/PR res: [0x2000032e0:0x1:0x0].0x5a47bb0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051436.389501:0:11727:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d954ea5400/0x85f51a6b96716740 lrc: 2/0,0 mode: PR/PR res: [0x2000032e0:0x1:0x0].0x5a47bb0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051436.389507:0:11727:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d954ea5400/0x85f51a6b96716740 lrc: 3/0,0 mode: PR/PR res: [0x2000032e0:0x1:0x0].0x5a47bb0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051436.389511:0:11727:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d954ea5400 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:2.0:1777051436.389514:0:11727:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d954ea5400/0x85f51a6b96716740 lrc: 3/0,0 mode: PR/PR res: [0x2000032e0:0x1:0x0].0x5a47bb0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051436.389519:0:11727:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d954ea5400/0x85f51a6b96716740 lrc: 4/0,0 mode: PR/PR res: [0x2000032e0:0x1:0x0].0x5a47bb0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051436.389530:0:11727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e0:0x1:0x0].0x5a47bb0b (ffff99da59dd4800) 00010000:00010000:2.0:1777051436.389532:0:11727:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777051436.389535:0:11727:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d954ea5400/0x85f51a6b96716740 lrc: 2/0,0 mode: --/PR res: [0x2000032e0:0x1:0x0].0x5a47bb0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051436.389540:0:11727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d954ea5400/0x85f51a6b96716740 lrc: 0/0,0 mode: --/PR res: [0x2000032e0:0x1:0x0].0x5a47bb0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051436.389568:0:11727:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff99d954ea5a00/0x85f51a6b96716732 lrc: 1/0,0 mode: --/CR res: [0x2000032e0:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6569 expref: 34 pid: 11727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051436.389579:0:11727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e0:0x1:0x0].0x0 (ffff99d943f76200) 00010000:00010000:2.0:1777051436.389582:0:11727:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1777051436.389587:0:11727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d954ea5a00/0x85f51a6b96716732 lrc: 0/0,0 mode: --/CR res: [0x2000032e0:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6569 expref: 34 pid: 11727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051436.389599:0:11727:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d954ea5a00, rc -2) 00000100:00100000:2.0:1777051436.389671:0:11727:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+33:2438:x1863365426002560:12345-192.168.201.46@tcp:63:ll_sa.0 Request processed in 353us (1477us total) trans 0 rc -2/-2 00000100:00100000:2.0:1777051436.389688:0:11727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 8185 00010000:00010000:3.0:1777051436.390794:0:46500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a2600/0x85f51a6b96716724 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x4992a133 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46500 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051436.390807:0:46500:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a2600/0x85f51a6b96716724 lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x4992a133 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 46500 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051436.390848:0:46500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a2600/0x85f51a6b96716724 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x4992a133 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 46500 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051436.390859:0:46500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d9559a2600 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:3.0:1777051436.390866:0:46500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a2600/0x85f51a6b96716724 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x4992a133 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 46500 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051436.390880:0:46500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a2600/0x85f51a6b96716724 lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x4992a133 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 46500 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051436.390898:0:46500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x4992a133 (ffff99d9533ab400) 00010000:00010000:3.0:1777051436.390903:0:46500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777051436.390908:0:46500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a2600/0x85f51a6b96716724 lrc: 2/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x4992a133 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 46500 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051436.390918:0:46500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a2600/0x85f51a6b96716724 lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x4992a133 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 46500 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051436.390966:0:46500:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a2a00/0x85f51a6b96716708 lrc: 1/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6577 expref: 61 pid: 46500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051436.390980:0:46500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff99d9413d0300) 00010000:00010000:3.0:1777051436.390984:0:46500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1777051436.390990:0:46500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a2a00/0x85f51a6b96716708 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6577 expref: 61 pid: 46500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051436.391006:0:46500:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d9559a2a00, rc -2) 00000100:00100000:3.0:1777051436.391145:0:46500:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da6ff7f450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+60:2439:x1863365426002432:12345-192.168.201.46@tcp:63:ll_sa.0 Request processed in 2930us (3088us total) trans 0 rc -2/-2 00000100:00100000:3.0:1777051436.391161:0:46500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 8184 00000100:00100000:1.0:1777051436.401937:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051436.402032:0:8492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426003072 00000100:00100000:3.0:1777051436.402045:0:8492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426003072 00000100:00100000:3.0:1777051436.402117:0:8492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112127 00000100:00100000:3.0:1777051436.402423:0:8492:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942a0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+60:138099:x1863365426003072:12345-192.168.201.46@tcp:101:lfs.0 00010000:00010000:3.0:1777051436.402449:0:8492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777051436.402475:0:8492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a2a00/0x85f51a6b96716747 lrc: 2/0,0 mode: --/CR res: [0x240000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b65a8 expref: -99 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051436.402627:0:8492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a2600/0x85f51a6b9671674e lrc: 3/0,1 mode: --/PW res: [0x240000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051436.402648:0:8492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a2600/0x85f51a6b9671674e lrc: 3/0,1 mode: PW/PW res: [0x240000bd2:0x2:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8492 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051436.402664:0:8492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a2600/0x85f51a6b9671674e lrc: 3/0,1 mode: PW/PW res: [0x240000bd2:0x2:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8492 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1777051436.402679:0:8492:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000bd2:0x2:0x0]: returning size 1048576 00010000:00010000:3.0:1777051436.403116:0:8492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a2a00/0x85f51a6b96716747 lrc: 0/0,0 mode: --/CR res: [0x240000bd2:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b65a8 expref: 63 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051436.403143:0:8492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a2600/0x85f51a6b9671674e lrc: 3/0,0 mode: PW/PW res: [0x240000bd2:0x2:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b65a8 expref: 62 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051436.403155:0:8492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x2:0x0].0x0 (ffff99d943f76e00) 00010000:00010000:3.0:1777051436.403158:0:8492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1777051436.403162:0:8492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d9559a2600, rc 0) 00000100:00100000:3.0:1777051436.403284:0:8492:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942a0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+62:138099:x1863365426003072:12345-192.168.201.46@tcp:101:lfs.0 Request processed in 865us (1358us total) trans 8589934650 rc 0/0 00000100:00100000:3.0:1777051436.403298:0:8492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112127 00000100:00100000:0.0:1777051436.407501:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051436.407577:0:8471:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426003200 00000100:00100000:3.0:1777051436.407588:0:8471:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426003200 00000100:00100000:3.0:1777051436.407949:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 8032 00000100:00100000:3.0:1777051436.407966:0:8471:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7e24ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+48:2438:x1863365426003200:12345-192.168.201.46@tcp:1:lfs.0 00010000:00010000:3.0:1777051436.408011:0:8471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c9e5ad62/0x85f51a6b9671675c lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x103:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051436.408037:0:8471:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000077750da1/0x85f51a6b9671666e lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x103:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6531 expref: 50 pid: 8471 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051436.408051:0:8471:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a93e98b2/0x85f51a6b96716716 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x103:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6570 expref: 48 pid: 27884 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051436.408061:0:8471:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051436.408064:0:8471:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051436.408070:0:8471:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c9e5ad62/0x85f51a6b9671675c lrc: 5/0,1 mode: --/PW res: [0x2c0000400:0x103:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051436.408114:0:8471:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a93e98b2/0x85f51a6b96716716 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x103:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6570 expref: 48 pid: 27884 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051436.408134:0:8471:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a93e98b2/0x85f51a6b96716716 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x103:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6570 expref: 48 pid: 27884 timeout: 8165 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051436.408154:0:8471:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5fbec380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8471:1863365452640384:192.168.201.46@tcp:104: 00010000:00010000:3.0:1777051436.408271:0:8471:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000077750da1/0x85f51a6b9671666e lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x103:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6531 expref: 50 pid: 8471 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051436.408290:0:8471:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000077750da1/0x85f51a6b9671666e lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x103:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6531 expref: 50 pid: 8471 timeout: 8165 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051436.408305:0:8471:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5fbed180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8471:1863365452640512:192.168.201.46@tcp:104: 00000100:00100000:3.0:1777051436.408407:0:8471:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d95cf51540 going to sleep for 11 seconds 00000100:00100000:0.0:1777051436.412668:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051436.412680:0:8471:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5fbec380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8471:1863365452640384:192.168.201.46@tcp:104: 00000100:00100000:3.0:1777051436.413125:0:8471:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5fbed180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8471:1863365452640512:192.168.201.46@tcp:104: 00010000:00010000:3.0:1777051436.413163:0:8471:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c9e5ad62/0x85f51a6b9671675c lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x103:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051436.413504:0:24467:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426003328 00000100:00100000:2.0:1777051436.413512:0:24467:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426003328 00010000:00010000:2.0:1777051436.413551:0:24467:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a93e98b2/0x85f51a6b96716716 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x103:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6570 expref: 49 pid: 27884 timeout: 8165 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051436.413600:0:24467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3891 00000100:00100000:2.0:1777051436.413616:0:24467:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7e24c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+49:2436:x1863365426003328:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1777051436.413634:0:24467:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777051436.413660:0:24467:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a93e98b2/0x85f51a6b96716716 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x103:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6570 expref: 49 pid: 27884 timeout: 8165 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051436.413681:0:24467:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a93e98b2/0x85f51a6b96716716 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x103:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6570 expref: 49 pid: 27884 timeout: 8165 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051436.413723:0:24467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a93e98b2/0x85f51a6b96716716 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x103:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6570 expref: 49 pid: 27884 timeout: 8165 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051436.413745:0:24467:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1777051436.413840:0:24467:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7e24c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+48:2436:x1863365426003328:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 201us (1152us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051436.413854:0:24467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3891 00000100:00100000:2.0:1777051436.418142:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051436.418187:0:6565:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426003456 00000100:00100000:2.0:1777051436.418195:0:6565:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426003456 00010000:00010000:2.0:1777051436.418246:0:6565:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000077750da1/0x85f51a6b9671666e lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x103:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6531 expref: 51 pid: 8471 timeout: 8165 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051436.418287:0:6565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3892 00000100:00100000:2.0:1777051436.418299:0:6565:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94ed2d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+51:2436:x1863365426003456:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1777051436.418319:0:6565:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777051436.418489:0:6565:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000077750da1/0x85f51a6b9671666e lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x103:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6531 expref: 51 pid: 8471 timeout: 8165 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051436.418521:0:6565:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000077750da1/0x85f51a6b9671666e lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x103:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6531 expref: 51 pid: 8471 timeout: 8165 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051436.418550:0:6565:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000077750da1/0x85f51a6b9671666e lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x103:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6531 expref: 51 pid: 8471 timeout: 8165 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051436.418571:0:6565:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777051436.418574:0:6565:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777051436.418581:0:6565:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c9e5ad62/0x85f51a6b9671675c lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x103:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051436.418598:0:6565:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c9e5ad62/0x85f51a6b9671675c lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x103:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051436.418644:0:6565:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1777051436.418702:0:8471:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c9e5ad62/0x85f51a6b9671675c lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x103:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051436.418732:0:8471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c9e5ad62/0x85f51a6b9671675c lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x103:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051436.418740:0:6565:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94ed2d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+50:2436:x1863365426003456:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 437us (599us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051436.419039:0:6565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3892 00010000:00010000:3.0:1777051436.419056:0:8471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c9e5ad62/0x85f51a6b9671675c lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x103:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051436.419072:0:8471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c9e5ad62/0x85f51a6b9671675c lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x103:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051436.419095:0:8471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c9e5ad62/0x85f51a6b9671675c lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x103:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051436.419108:0:8471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d9559a2c00 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:3.0:1777051436.419114:0:8471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c9e5ad62/0x85f51a6b9671675c lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x103:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051436.419127:0:8471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c9e5ad62/0x85f51a6b9671675c lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x103:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051436.419147:0:8471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c9e5ad62/0x85f51a6b9671675c lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x103:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051436.419159:0:8471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c9e5ad62/0x85f51a6b9671675c lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x103:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1777051436.419512:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1777051436.419595:0:8471:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7e24ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+47:2438:x1863365426003200:12345-192.168.201.46@tcp:1:lfs.0 Request processed in 11631us (12097us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051436.419609:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 8032 00000100:00100000:2.0:1777051436.430089:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051436.430138:0:6582:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426003712 00000100:00100000:1.0:1777051436.430152:0:6582:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426003712 00000100:00100000:3.0:1777051436.430362:0:46501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3371 00000100:00100000:3.0:1777051436.430384:0:46501:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94ed2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+62:138099:x1863365426003712:12345-192.168.201.46@tcp:35:lfs.0 00000004:00010000:3.0:1777051436.430471:0:46501:0:(mdt_open.c:1994:mdt_hsm_release()) ### [0x240000bd2:0x2:0x0] lease broken? 0 ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a2600/0x85f51a6b9671674e lrc: 3/0,0 mode: PW/PW res: [0x240000bd2:0x2:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b65a8 expref: 62 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1777051436.430919:0:46501:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 8589934651 00000001:00080000:3.0:1777051436.431413:0:46501:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 8589934652 00010000:00010000:3.0:1777051436.431490:0:46501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a2c00/0x85f51a6b96716763 lrc: 3/0,1 mode: --/EX res: [0x240000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 46501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051436.431515:0:46501:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61b000/0x85f51a6b967163b2 lrc: 2/0,0 mode: PR/PR res: [0x240000bd2:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6435 expref: 10 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051436.431540:0:46501:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff99d950263c00/0x85f51a6b9671651e lrc: 2/0,0 mode: PR/PR res: [0x240000bd2:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b64b3 expref: 65 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051436.431554:0:46501:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a2c00/0x85f51a6b96716763 lrc: 5/0,1 mode: --/EX res: [0x240000bd2:0x2:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 46501 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051436.431605:0:46501:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff99d950263c00/0x85f51a6b9671651e lrc: 3/0,0 mode: PR/PR res: [0x240000bd2:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b64b3 expref: 65 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051436.431625:0:46501:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff99d950263c00/0x85f51a6b9671651e lrc: 4/0,0 mode: PR/PR res: [0x240000bd2:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b64b3 expref: 65 pid: 6579 timeout: 8165 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051436.431649:0:46501:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5fbed180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001_UUID:46501:1863365452640640:192.168.201.46@tcp:104: 00010000:00010000:3.0:1777051436.431841:0:46501:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61b000/0x85f51a6b967163b2 lrc: 3/0,0 mode: PR/PR res: [0x240000bd2:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6435 expref: 10 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051436.431861:0:46501:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61b000/0x85f51a6b967163b2 lrc: 4/0,0 mode: PR/PR res: [0x240000bd2:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6435 expref: 10 pid: 10328 timeout: 8165 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051436.431885:0:46501:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5fbec380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001_UUID:46501:1863365452640768:192.168.201.46@tcp:104: 00000100:00100000:3.0:1777051436.431934:0:46501:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d95cf51540 going to sleep for 11 seconds 00000100:00100000:2.0:1777051436.437518:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051436.437616:0:46501:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5fbed180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001_UUID:46501:1863365452640640:192.168.201.46@tcp:104: 00000100:00100000:3.0:1777051436.438364:0:46501:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5fbec380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001_UUID:46501:1863365452640768:192.168.201.46@tcp:104: 00000100:00100000:2.0:1777051436.438367:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051436.438421:0:47597:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426003840 00010000:00010000:3.0:1777051436.438424:0:46501:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a2c00/0x85f51a6b96716763 lrc: 3/0,1 mode: --/EX res: [0x240000bd2:0x2:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 46501 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051436.438431:0:47597:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426003840 00010000:00010000:2.0:1777051436.438480:0:47597:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d950263c00/0x85f51a6b9671651e lrc: 4/0,0 mode: PR/PR res: [0x240000bd2:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b64b3 expref: 66 pid: 6579 timeout: 8165 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051436.438536:0:47597:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426003968 00000100:00100000:2.0:1777051436.438541:0:47597:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426003968 00010000:00010000:2.0:1777051436.438559:0:47597:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61b000/0x85f51a6b967163b2 lrc: 4/0,0 mode: PR/PR res: [0x240000bd2:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6435 expref: 11 pid: 10328 timeout: 8165 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051436.438599:0:47597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3893 00000100:00100000:2.0:1777051436.438613:0:47597:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94ed2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+66:2437:x1863365426003840:12345-192.168.201.46@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1777051436.438622:0:47827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3894 00010000:00010000:2.0:1777051436.438638:0:47597:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1777051436.438658:0:47827:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94ed2f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+11:2437:x1863365426003968:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1777051436.438666:0:47597:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff99d950263c00/0x85f51a6b9671651e lrc: 4/0,0 mode: PR/PR res: [0x240000bd2:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b64b3 expref: 66 pid: 6579 timeout: 8165 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051436.438688:0:47597:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff99d950263c00/0x85f51a6b9671651e lrc: 3/0,0 mode: PR/PR res: [0x240000bd2:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b64b3 expref: 66 pid: 6579 timeout: 8165 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051436.438718:0:47597:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d950263c00/0x85f51a6b9671651e lrc: 0/0,0 mode: --/PR res: [0x240000bd2:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b64b3 expref: 66 pid: 6579 timeout: 8165 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051436.438739:0:47597:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x2:0x0].0x0 (ffff99d943f76e00) 00010000:00010000:2.0:1777051436.438746:0:47597:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a2c00/0x85f51a6b96716763 lrc: 3/0,1 mode: --/EX res: [0x240000bd2:0x2:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 46501 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051436.438758:0:47597:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a2c00/0x85f51a6b96716763 lrc: 3/0,1 mode: --/EX res: [0x240000bd2:0x2:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 46501 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051436.438768:0:47597:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1777051436.438841:0:47827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777051436.438855:0:47827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61b000/0x85f51a6b967163b2 lrc: 4/0,0 mode: PR/PR res: [0x240000bd2:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6435 expref: 11 pid: 10328 timeout: 8165 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051436.438867:0:47597:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94ed2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+65:2437:x1863365426003840:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 251us (1353us total) trans 0 rc 0/0 00010000:00010000:3.0:1777051436.438888:0:47827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61b000/0x85f51a6b967163b2 lrc: 3/0,0 mode: PR/PR res: [0x240000bd2:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6435 expref: 11 pid: 10328 timeout: 8165 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051436.438889:0:47597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3893 00010000:00010000:3.0:1777051436.438921:0:47827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61b000/0x85f51a6b967163b2 lrc: 0/0,0 mode: --/PR res: [0x240000bd2:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6435 expref: 11 pid: 10328 timeout: 8165 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051436.438946:0:47827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x2:0x0].0x0 (ffff99d943f76e00) 00010000:00010000:3.0:1777051436.438953:0:47827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a2c00/0x85f51a6b96716763 lrc: 3/0,1 mode: --/EX res: [0x240000bd2:0x2:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 46501 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051436.438967:0:47827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a2c00/0x85f51a6b96716763 lrc: 3/0,1 mode: EX/EX res: [0x240000bd2:0x2:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 46501 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051436.438979:0:47827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a2c00/0x85f51a6b96716763 lrc: 4/0,1 mode: EX/EX res: [0x240000bd2:0x2:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 46501 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051436.439181:0:47827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1777051436.439221:0:47827:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94ed2f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+10:2437:x1863365426003968:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 582us (858us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051436.439234:0:47827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3894 00010000:00010000:3.0:1777051436.439953:0:46501:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a2c00/0x85f51a6b96716763 lrc: 3/0,1 mode: EX/EX res: [0x240000bd2:0x2:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 46501 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051436.439966:0:46501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a2c00/0x85f51a6b96716763 lrc: 3/0,1 mode: EX/EX res: [0x240000bd2:0x2:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 46501 initiator: MDT1 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1777051436.440342:0:46501:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 8589934653 00000001:00080000:2.0:1777051436.440505:0:46501:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 8589934654 00000100:00100000:2.0:1777051436.440620:0:46501:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94ed2ea00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:46501:1863365452640896:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:2.0:1777051436.440703:0:46501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051436.440811:0:46501:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d956bda0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1777051436.444003:0:6585:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452640896 00000100:00100000:3.0:1777051436.444015:0:6585:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452640896 00000100:00100000:2.0:1777051436.444799:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8186 00000100:00100000:2.0:1777051436.444848:0:6585:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94ed2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:46501:x1863365452640896:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:2.0:1777051436.445016:0:6585:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94ed2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:46501:x1863365452640896:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 171us (4309us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051436.445030:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8186 00000100:00080000:2.0:1777051436.445064:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1777051436.445140:0:46501:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94ed2ea00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:46501:1863365452640896:0@lo:1000:mdt_rdpg00_003.0 00000001:00080000:1.0:1777051436.445607:0:46501:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 8589934655 00000100:00100000:1.0:1777051436.445708:0:46501:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d942a0d180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:46501:1863365452641024:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:1.0:1777051436.445763:0:46501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051436.445843:0:47208:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452641024 00000100:00100000:1.0:1777051436.445852:0:47208:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452641024 00000100:00100000:1.0:1777051436.445901:0:47208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8187 00000100:00100000:1.0:1777051436.445913:0:47208:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942a0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+5:46501:x1863365452641024:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:1.0:1777051436.446191:0:47208:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942a0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+6:46501:x1863365452641024:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 277us (425us total) trans 4294968360 rc 0/0 00000100:00100000:1.0:1777051436.446205:0:47208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8187 00000100:00100000:1.0:1777051436.446252:0:46501:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d959767480 going to sleep for 11 seconds 00000100:00100000:1.0:1777051436.446318:0:46501:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d942a0d180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:46501:1863365452641024:0@lo:1000:mdt_rdpg00_003.0 00000001:00080000:1.0:1777051436.446392:0:46501:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 8589934656 00010000:00010000:1.0:1777051436.446432:0:46501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a2c00/0x85f51a6b96716763 lrc: 3/0,1 mode: EX/EX res: [0x240000bd2:0x2:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 46501 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051436.446449:0:46501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a2c00/0x85f51a6b96716763 lrc: 2/0,0 mode: EX/EX res: [0x240000bd2:0x2:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 46501 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051436.446462:0:46501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a2c00/0x85f51a6b96716763 lrc: 3/0,0 mode: EX/EX res: [0x240000bd2:0x2:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 46501 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051436.446474:0:46501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d9559a2c00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:1.0:1777051436.446482:0:46501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a2c00/0x85f51a6b96716763 lrc: 3/0,0 mode: EX/EX res: [0x240000bd2:0x2:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 46501 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051436.446496:0:46501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a2c00/0x85f51a6b96716763 lrc: 4/0,0 mode: EX/EX res: [0x240000bd2:0x2:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 46501 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051436.446519:0:46501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x2:0x0].0x0 (ffff99d943f76e00) 00010000:00010000:1.0:1777051436.446526:0:46501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1777051436.446534:0:46501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a2c00/0x85f51a6b96716763 lrc: 2/0,0 mode: --/EX res: [0x240000bd2:0x2:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 46501 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051436.446545:0:46501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a2c00/0x85f51a6b96716763 lrc: 0/0,0 mode: --/EX res: [0x240000bd2:0x2:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 46501 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1777051436.446667:0:46501:0:(mdd_object.c:4010:mdd_close()) Object [0x240000bd3:0x2:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1777051436.446764:0:46501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].3, 64 off8384 00000004:00080000:1.0:1777051436.446783:0:46501:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 8065639584656ns, next at 8066639581071ns, rc = 0 00000001:00080000:1.0:1777051436.446795:0:46501:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 8589934657 00010000:00010000:1.0:1777051436.446872:0:46501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x2:0x0].0x0 (ffff99d943f76e00) 00010000:00010000:1.0:1777051436.446878:0:46501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1777051436.446890:0:46501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a2600/0x85f51a6b9671674e lrc: 0/0,0 mode: --/PW res: [0x240000bd2:0x2:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b65a8 expref: 69 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051436.447034:0:46501:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94ed2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+68:138099:x1863365426003712:12345-192.168.201.46@tcp:35:lfs.0 Request processed in 16656us (17874us total) trans 8589934658 rc 0/0 00000100:00100000:1.0:1777051436.447050:0:46501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3371 00000020:00080000:1.0:1777051436.447057:0:46501:0:(tgt_main.c:783:tgt_ses_key_exit()) total 8 transactions per RPC 00000100:00100000:2.0:1777051436.472695:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051436.472793:0:6584:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426004096 00000100:00100000:1.0:1777051436.472806:0:6584:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426004096 00000100:00100000:1.0:1777051436.472919:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 8188 00000100:00100000:1.0:1777051436.472932:0:6584:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94ed2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+68:2439:x1863365426004096:12345-192.168.201.46@tcp:63:ll_sa.0 00010000:00010000:1.0:1777051436.472981:0:6584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777051436.473005:0:6584:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72fe00/0x85f51a6b9671676a lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b65af expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051436.473070:0:6584:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72f200/0x85f51a6b96716771 lrc: 3/1,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051436.473089:0:6584:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72f200/0x85f51a6b96716771 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051436.473104:0:6584:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72f200/0x85f51a6b96716771 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051436.473124:0:6584:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72f400/0x85f51a6b96716778 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x74ddbf9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051436.473135:0:6584:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72f400/0x85f51a6b96716778 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x74ddbf9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051436.473146:0:6584:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72f400/0x85f51a6b96716778 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x74ddbf9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051436.473199:0:6584:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72f200/0x85f51a6b96716771 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051436.473211:0:6584:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72f200/0x85f51a6b96716771 lrc: 2/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051436.473223:0:6584:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72f200/0x85f51a6b96716771 lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051436.473232:0:6584:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94d72f200 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:1.0:1777051436.473239:0:6584:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72f200/0x85f51a6b96716771 lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051436.473249:0:6584:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72f200/0x85f51a6b96716771 lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051436.473265:0:6584:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff99d9413d0300) 00010000:00010000:1.0:1777051436.473270:0:6584:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777051436.473277:0:6584:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72f200/0x85f51a6b96716771 lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051436.473287:0:6584:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72f200/0x85f51a6b96716771 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051436.473303:0:6584:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72f400/0x85f51a6b96716778 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x74ddbf9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051436.473313:0:6584:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72f400/0x85f51a6b96716778 lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x74ddbf9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051436.473322:0:6584:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72f400/0x85f51a6b96716778 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x74ddbf9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051436.473332:0:6584:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94d72f400 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:1.0:1777051436.473338:0:6584:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72f400/0x85f51a6b96716778 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x74ddbf9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051436.473350:0:6584:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72f400/0x85f51a6b96716778 lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x74ddbf9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051436.473365:0:6584:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x74ddbf9 (ffff99d94e5e2400) 00010000:00010000:1.0:1777051436.473370:0:6584:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777051436.473374:0:6584:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72f400/0x85f51a6b96716778 lrc: 2/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x74ddbf9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051436.473385:0:6584:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72f400/0x85f51a6b96716778 lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x74ddbf9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6584 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051436.473427:0:6584:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72fe00/0x85f51a6b9671676a lrc: 1/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b65af expref: 69 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051436.473452:0:6584:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff99d9413d0300) 00010000:00010000:1.0:1777051436.473457:0:6584:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1777051436.473463:0:6584:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72fe00/0x85f51a6b9671676a lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b65af expref: 69 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051436.473477:0:6584:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d94d72fe00, rc -2) 00000100:00100000:1.0:1777051436.473739:0:6584:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94ed2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+68:2439:x1863365426004096:12345-192.168.201.46@tcp:63:ll_sa.0 Request processed in 805us (1055us total) trans 0 rc -2/-2 00000100:00100000:1.0:1777051436.474025:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 8188 00000100:00100000:3.0:1777051436.479056:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051436.479154:0:27882:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426004352 00000100:00100000:1.0:1777051436.479165:0:27882:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426004352 00000100:00100000:1.0:1777051436.479270:0:27882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112128 00000100:00100000:1.0:1777051436.479288:0:27882:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5fbec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+68:138102:x1863365426004352:12345-192.168.201.46@tcp:101:lfs.0 00010000:00010000:1.0:1777051436.479311:0:27882:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777051436.479336:0:27882:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72fc00/0x85f51a6b9671677f lrc: 2/0,0 mode: --/CR res: [0x240000bd2:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b65b6 expref: -99 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051436.479470:0:27882:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72f600/0x85f51a6b96716786 lrc: 3/0,1 mode: --/PW res: [0x240000bd2:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051436.479493:0:27882:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72f600/0x85f51a6b96716786 lrc: 3/0,1 mode: PW/PW res: [0x240000bd2:0x3:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 27882 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051436.479510:0:27882:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72f600/0x85f51a6b96716786 lrc: 3/0,1 mode: PW/PW res: [0x240000bd2:0x3:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 27882 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1777051436.479525:0:27882:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000bd2:0x3:0x0]: returning size 1048576 00010000:00010000:1.0:1777051436.479695:0:27882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72fc00/0x85f51a6b9671677f lrc: 0/0,0 mode: --/CR res: [0x240000bd2:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b65b6 expref: 71 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051436.479721:0:27882:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72f600/0x85f51a6b96716786 lrc: 3/0,0 mode: PW/PW res: [0x240000bd2:0x3:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b65b6 expref: 70 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051436.480133:0:27882:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x3:0x0].0x0 (ffff99d943f76f00) 00010000:00010000:1.0:1777051436.480141:0:27882:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1777051436.480148:0:27882:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d94d72f600, rc 0) 00000100:00100000:1.0:1777051436.480303:0:27882:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5fbec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+70:138102:x1863365426004352:12345-192.168.201.46@tcp:101:lfs.0 Request processed in 1016us (1253us total) trans 8589934659 rc 0/0 00000100:00100000:1.0:1777051436.480318:0:27882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112128 00000100:00100000:2.0:1777051436.485120:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051436.485334:0:24468:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426004480 00000100:00100000:0.0:1777051436.485345:0:24468:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426004480 00000100:00100000:0.0:1777051436.485446:0:24468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 8033 00000100:00100000:0.0:1777051436.485463:0:24468:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94ed2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+53:2437:x1863365426004480:12345-192.168.201.46@tcp:1:lfs.0 00010000:00010000:0.0:1777051436.485514:0:24468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059b7ad31/0x85f51a6b96716794 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x104:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051436.485545:0:24468:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000005fefa63/0x85f51a6b9671667c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x104:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b653f expref: 58 pid: 24468 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051436.485561:0:24468:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c420a9d5/0x85f51a6b9671671d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x104:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b659a expref: 53 pid: 13320 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051436.485573:0:24468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777051436.485576:0:24468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777051436.485581:0:24468:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000059b7ad31/0x85f51a6b96716794 lrc: 5/0,1 mode: --/PW res: [0x280000400:0x104:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051436.485627:0:24468:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c420a9d5/0x85f51a6b9671671d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x104:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b659a expref: 53 pid: 13320 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051436.485662:0:24468:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c420a9d5/0x85f51a6b9671671d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x104:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b659a expref: 53 pid: 13320 timeout: 8165 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051436.485688:0:24468:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7e24dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:24468:1863365452641152:192.168.201.46@tcp:104: 00010000:00010000:0.0:1777051436.485844:0:24468:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000005fefa63/0x85f51a6b9671667c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x104:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b653f expref: 58 pid: 24468 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051436.485862:0:24468:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000005fefa63/0x85f51a6b9671667c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x104:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b653f expref: 58 pid: 24468 timeout: 8165 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051436.485879:0:24468:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d944e11180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:24468:1863365452641280:192.168.201.46@tcp:104: 00000100:00100000:0.0:1777051436.485919:0:24468:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d959b89b40 going to sleep for 11 seconds 00000100:00100000:0.0:1777051436.488746:0:24468:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7e24dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:24468:1863365452641152:192.168.201.46@tcp:104: 00000100:00100000:0.0:1777051436.489609:0:24468:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d944e11180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:24468:1863365452641280:192.168.201.46@tcp:104: 00000100:00100000:2.0:1777051436.489620:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00010000:00010000:0.0:1777051436.489644:0:24468:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000059b7ad31/0x85f51a6b96716794 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x104:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051436.489771:0:24467:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426004608 00000100:00100000:1.0:1777051436.489780:0:24467:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426004608 00010000:00010000:1.0:1777051436.489872:0:24467:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c420a9d5/0x85f51a6b9671671d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x104:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b659a expref: 54 pid: 13320 timeout: 8165 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051436.489951:0:24467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3895 00000100:00100000:1.0:1777051436.489968:0:24467:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da6fd41050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+54:2436:x1863365426004608:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1777051436.489989:0:24467:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1777051436.490021:0:24467:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c420a9d5/0x85f51a6b9671671d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x104:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b659a expref: 54 pid: 13320 timeout: 8165 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051436.490045:0:24467:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c420a9d5/0x85f51a6b9671671d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x104:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b659a expref: 54 pid: 13320 timeout: 8165 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051436.490077:0:24467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c420a9d5/0x85f51a6b9671671d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x104:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b659a expref: 54 pid: 13320 timeout: 8165 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051436.490103:0:24467:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1777051436.490556:0:24467:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da6fd41050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+53:2436:x1863365426004608:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 588us (932us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051436.490572:0:24467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3895 00000100:00100000:3.0:1777051436.494108:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051436.494240:0:6565:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426004736 00000100:00100000:2.0:1777051436.494251:0:6565:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426004736 00010000:00010000:2.0:1777051436.494289:0:6565:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000005fefa63/0x85f51a6b9671667c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x104:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b653f expref: 59 pid: 24468 timeout: 8165 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051436.494356:0:6565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3896 00000100:00100000:2.0:1777051436.494370:0:6565:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5fbed180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+59:2436:x1863365426004736:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1777051436.494386:0:6565:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777051436.494407:0:6565:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000005fefa63/0x85f51a6b9671667c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x104:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b653f expref: 59 pid: 24468 timeout: 8165 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051436.494430:0:6565:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000005fefa63/0x85f51a6b9671667c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x104:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b653f expref: 59 pid: 24468 timeout: 8165 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051436.494460:0:6565:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000005fefa63/0x85f51a6b9671667c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x104:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b653f expref: 59 pid: 24468 timeout: 8165 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051436.494480:0:6565:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777051436.494484:0:6565:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777051436.494491:0:6565:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000059b7ad31/0x85f51a6b96716794 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x104:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051436.494506:0:6565:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000059b7ad31/0x85f51a6b96716794 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x104:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051436.494549:0:6565:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1777051436.494600:0:6565:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5fbed180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+58:2436:x1863365426004736:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 230us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051436.494614:0:6565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3896 00010000:00010000:0.0:1777051436.494621:0:24468:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000059b7ad31/0x85f51a6b96716794 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x104:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051436.494643:0:24468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000059b7ad31/0x85f51a6b96716794 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x104:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051436.494688:0:24468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059b7ad31/0x85f51a6b96716794 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x104:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051436.494705:0:24468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000059b7ad31/0x85f51a6b96716794 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x104:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051436.494720:0:24468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000059b7ad31/0x85f51a6b96716794 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x104:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051436.494734:0:24468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94e61ba00 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:0.0:1777051436.494742:0:24468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000059b7ad31/0x85f51a6b96716794 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x104:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051436.494759:0:24468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000059b7ad31/0x85f51a6b96716794 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x104:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051436.494781:0:24468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000059b7ad31/0x85f51a6b96716794 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x104:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051436.494795:0:24468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000059b7ad31/0x85f51a6b96716794 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x104:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051436.494951:0:24468:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94ed2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+52:2437:x1863365426004480:12345-192.168.201.46@tcp:1:lfs.0 Request processed in 9489us (9838us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051436.494974:0:24468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 8033 00000100:00100000:3.0:1777051436.502578:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051436.502678:0:24269:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426004992 00000100:00100000:2.0:1777051436.502691:0:24269:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426004992 00000100:00100000:2.0:1777051436.502800:0:24269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3372 00000100:00100000:2.0:1777051436.502848:0:24269:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5fbedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+70:138102:x1863365426004992:12345-192.168.201.46@tcp:35:lfs.0 00000004:00010000:2.0:1777051436.502925:0:24269:0:(mdt_open.c:1994:mdt_hsm_release()) ### [0x240000bd2:0x3:0x0] lease broken? 0 ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72f600/0x85f51a6b96716786 lrc: 3/0,0 mode: PW/PW res: [0x240000bd2:0x3:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b65b6 expref: 70 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1777051436.503188:0:24269:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 8589934660 00000001:00080000:2.0:1777051436.503627:0:24269:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 8589934661 00010000:00010000:2.0:1777051436.503990:0:24269:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff99d954ea5400/0x85f51a6b9671679b lrc: 3/0,1 mode: --/EX res: [0x240000bd2:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051436.504015:0:24269:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61b400/0x85f51a6b967163ff lrc: 2/0,0 mode: PR/PR res: [0x240000bd2:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6451 expref: 9 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051436.504031:0:24269:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e48a800/0x85f51a6b96716556 lrc: 2/0,0 mode: PR/PR res: [0x240000bd2:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b64c1 expref: 73 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051436.504045:0:24269:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d954ea5400/0x85f51a6b9671679b lrc: 5/0,1 mode: --/EX res: [0x240000bd2:0x3:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24269 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051436.504092:0:24269:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e48a800/0x85f51a6b96716556 lrc: 3/0,0 mode: PR/PR res: [0x240000bd2:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b64c1 expref: 73 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051436.504115:0:24269:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e48a800/0x85f51a6b96716556 lrc: 4/0,0 mode: PR/PR res: [0x240000bd2:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b64c1 expref: 73 pid: 8492 timeout: 8165 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051436.504138:0:24269:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94ed2fb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0001_UUID:24269:1863365452641408:192.168.201.46@tcp:104: 00010000:00010000:2.0:1777051436.504298:0:24269:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61b400/0x85f51a6b967163ff lrc: 3/0,0 mode: PR/PR res: [0x240000bd2:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6451 expref: 9 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051436.504319:0:24269:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61b400/0x85f51a6b967163ff lrc: 4/0,0 mode: PR/PR res: [0x240000bd2:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6451 expref: 9 pid: 6581 timeout: 8165 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051436.504338:0:24269:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94ed2dc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0001_UUID:24269:1863365452641536:192.168.201.46@tcp:104: 00000100:00100000:2.0:1777051436.504396:0:24269:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d956bda780 going to sleep for 11 seconds 00000100:00100000:3.0:1777051436.509410:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051436.509487:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051436.509537:0:6564:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426005120 00000100:00100000:0.0:1777051436.509550:0:6564:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426005120 00010000:00010000:0.0:1777051436.509599:0:6564:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e48a800/0x85f51a6b96716556 lrc: 5/0,0 mode: PR/PR res: [0x240000bd2:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b64c1 expref: 74 pid: 8492 timeout: 8165 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051436.509667:0:6564:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426005248 00000100:00100000:0.0:1777051436.509675:0:6564:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426005248 00000100:00100000:2.0:1777051436.509699:0:24269:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94ed2fb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0001_UUID:24269:1863365452641408:192.168.201.46@tcp:104: 00010000:00010000:0.0:1777051436.509704:0:6564:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61b400/0x85f51a6b967163ff lrc: 5/0,0 mode: PR/PR res: [0x240000bd2:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6451 expref: 10 pid: 6581 timeout: 8165 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051436.509737:0:47827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3897 00000100:00100000:2.0:1777051436.509754:0:24269:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94ed2dc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0001_UUID:24269:1863365452641536:192.168.201.46@tcp:104: 00000100:00100000:1.0:1777051436.510110:0:47827:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5fbee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+74:2437:x1863365426005120:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1777051436.510122:0:24269:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff99d954ea5400/0x85f51a6b9671679b lrc: 3/0,1 mode: --/EX res: [0x240000bd2:0x3:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24269 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051436.510127:0:6564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3898 00010000:00010000:1.0:1777051436.510142:0:47827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1777051436.510163:0:6564:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5fbee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+10:2436:x1863365426005248:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1777051436.510163:0:47827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e48a800/0x85f51a6b96716556 lrc: 4/0,0 mode: PR/PR res: [0x240000bd2:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b64c1 expref: 74 pid: 8492 timeout: 8165 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051436.510192:0:6564:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777051436.510258:0:6564:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61b400/0x85f51a6b967163ff lrc: 4/0,0 mode: PR/PR res: [0x240000bd2:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6451 expref: 10 pid: 6581 timeout: 8165 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051436.510268:0:47827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e48a800/0x85f51a6b96716556 lrc: 3/0,0 mode: PR/PR res: [0x240000bd2:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b64c1 expref: 74 pid: 8492 timeout: 8165 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051436.510310:0:6564:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61b400/0x85f51a6b967163ff lrc: 3/0,0 mode: PR/PR res: [0x240000bd2:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6451 expref: 10 pid: 6581 timeout: 8165 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051436.511260:0:47827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e48a800/0x85f51a6b96716556 lrc: 0/0,0 mode: --/PR res: [0x240000bd2:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b64c1 expref: 74 pid: 8492 timeout: 8165 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051436.511274:0:6564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61b400/0x85f51a6b967163ff lrc: 0/0,0 mode: --/PR res: [0x240000bd2:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6451 expref: 10 pid: 6581 timeout: 8165 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051436.511291:0:47827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x3:0x0].0x0 (ffff99d943f76f00) 00010000:00010000:1.0:1777051436.511303:0:47827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff99d954ea5400/0x85f51a6b9671679b lrc: 3/0,1 mode: --/EX res: [0x240000bd2:0x3:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24269 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051436.511320:0:47827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff99d954ea5400/0x85f51a6b9671679b lrc: 3/0,1 mode: EX/EX res: [0x240000bd2:0x3:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 24269 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051436.511334:0:47827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d954ea5400/0x85f51a6b9671679b lrc: 4/0,1 mode: EX/EX res: [0x240000bd2:0x3:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 24269 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051436.511355:0:6564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x3:0x0].0x0 (ffff99d943f76f00) 00010000:00010000:0.0:1777051436.511365:0:6564:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1777051436.511388:0:47827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1777051436.511447:0:24269:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff99d954ea5400/0x85f51a6b9671679b lrc: 3/0,1 mode: EX/EX res: [0x240000bd2:0x3:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24269 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051436.511473:0:24269:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d954ea5400/0x85f51a6b9671679b lrc: 3/0,1 mode: EX/EX res: [0x240000bd2:0x3:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24269 initiator: MDT1 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1777051436.511624:0:24269:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 8589934662 00000001:00080000:2.0:1777051436.511792:0:24269:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 8589934663 00000100:00100000:2.0:1777051436.511955:0:24269:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94ed2dc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0001-mdtlov_UUID:24269:1863365452641664:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:2.0:1777051436.512021:0:24269:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051436.512063:0:24269:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d956bdaf00 going to sleep for 11 seconds 00000100:00100000:0.0:1777051436.512142:0:6564:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5fbee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+9:2436:x1863365426005248:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 1989us (2649us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051436.512163:0:47827:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5fbee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+75:2437:x1863365426005120:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 2403us (2755us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051436.512174:0:6564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3898 00000100:00100000:2.0:1777051436.512183:0:46498:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452641664 00000100:00100000:1.0:1777051436.512190:0:47827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3897 00000100:00100000:2.0:1777051436.512195:0:46498:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452641664 00000100:00100000:2.0:1777051436.512319:0:46498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8189 00000100:00100000:2.0:1777051436.512335:0:46498:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94ed2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:24269:x1863365452641664:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:2.0:1777051436.512483:0:46498:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94ed2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:24269:x1863365452641664:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 150us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051436.512498:0:46498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8189 00000100:00100000:1.0:1777051436.513057:0:24269:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94ed2dc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0001-mdtlov_UUID:24269:1863365452641664:0@lo:1000:mdt_rdpg00_002.0 00000001:00080000:1.0:1777051436.513211:0:24269:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 8589934664 00000100:00100000:1.0:1777051436.513289:0:24269:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d942a0c700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0001-mdtlov_UUID:24269:1863365452641792:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:1.0:1777051436.513337:0:24269:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051436.513373:0:24269:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d941082600 going to sleep for 11 seconds 00000100:00100000:0.0:1777051436.513528:0:47208:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452641792 00000100:00100000:0.0:1777051436.513538:0:47208:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452641792 00000100:00100000:0.0:1777051436.513595:0:47208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8190 00000100:00100000:0.0:1777051436.513608:0:47208:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942a0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+6:24269:x1863365452641792:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:0.0:1777051436.513781:0:47208:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942a0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+7:24269:x1863365452641792:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 175us (442us total) trans 4294968359 rc 0/0 00000100:00100000:1.0:1777051436.514126:0:24269:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d942a0c700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0001-mdtlov_UUID:24269:1863365452641792:0@lo:1000:mdt_rdpg00_002.0 00000001:00080000:1.0:1777051436.514185:0:24269:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 8589934665 00010000:00010000:1.0:1777051436.514224:0:24269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff99d954ea5400/0x85f51a6b9671679b lrc: 3/0,1 mode: EX/EX res: [0x240000bd2:0x3:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24269 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051436.514269:0:24269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d954ea5400/0x85f51a6b9671679b lrc: 2/0,0 mode: EX/EX res: [0x240000bd2:0x3:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24269 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051436.514281:0:24269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99d954ea5400/0x85f51a6b9671679b lrc: 3/0,0 mode: EX/EX res: [0x240000bd2:0x3:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24269 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051436.514326:0:24269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d954ea5400 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:1.0:1777051436.514333:0:24269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d954ea5400/0x85f51a6b9671679b lrc: 3/0,0 mode: EX/EX res: [0x240000bd2:0x3:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24269 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051436.514342:0:24269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d954ea5400/0x85f51a6b9671679b lrc: 4/0,0 mode: EX/EX res: [0x240000bd2:0x3:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24269 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051436.514357:0:24269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x3:0x0].0x0 (ffff99d943f76f00) 00010000:00010000:1.0:1777051436.514362:0:24269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1777051436.514366:0:24269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99d954ea5400/0x85f51a6b9671679b lrc: 2/0,0 mode: --/EX res: [0x240000bd2:0x3:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24269 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051436.514373:0:24269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d954ea5400/0x85f51a6b9671679b lrc: 0/0,0 mode: --/EX res: [0x240000bd2:0x3:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24269 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051436.514396:0:47208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8190 00000004:00080000:1.0:1777051436.514494:0:24269:0:(mdd_object.c:4010:mdd_close()) Object [0x240000bd3:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1777051436.514564:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].4, 64 off8448 00000001:00080000:1.0:1777051436.514601:0:24269:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 8589934666 00010000:00010000:1.0:1777051436.514650:0:24269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x3:0x0].0x0 (ffff99d943f76f00) 00010000:00010000:1.0:1777051436.514655:0:24269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1777051436.514664:0:24269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72f600/0x85f51a6b96716786 lrc: 0/0,0 mode: --/PW res: [0x240000bd2:0x3:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b65b6 expref: 77 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051436.515120:0:24269:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5fbedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+76:138102:x1863365426004992:12345-192.168.201.46@tcp:35:lfs.0 Request processed in 12304us (12549us total) trans 8589934667 rc 0/0 00000100:00100000:1.0:1777051436.515135:0:24269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3372 00000020:00080000:1.0:1777051436.515143:0:24269:0:(tgt_main.c:783:tgt_ses_key_exit()) total 8 transactions per RPC 00000100:00100000:3.0:1777051436.543929:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051436.544044:0:6581:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426005504 00000100:00100000:0.0:1777051436.544059:0:6581:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426005504 00000100:00100000:0.0:1777051436.544496:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112129 00000100:00100000:0.0:1777051436.544515:0:6581:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5fbec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+33:138103:x1863365426005504:12345-192.168.201.46@tcp:101:lfs.0 00010000:00010000:0.0:1777051436.544588:0:6581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051436.544619:0:6581:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e61b400/0x85f51a6b967167a2 lrc: 2/0,0 mode: --/CR res: [0x2000032e3:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b65bd expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051436.545260:0:6581:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e61ba00/0x85f51a6b967167a9 lrc: 3/0,1 mode: --/PW res: [0x2000032e3:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051436.545283:0:6581:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e61ba00/0x85f51a6b967167a9 lrc: 3/0,1 mode: PW/PW res: [0x2000032e3:0x6:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051436.545302:0:6581:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e61ba00/0x85f51a6b967167a9 lrc: 3/0,1 mode: PW/PW res: [0x2000032e3:0x6:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1777051436.545322:0:6581:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000032e3:0x6:0x0]: returning size 1048576 00010000:00010000:0.0:1777051436.545520:0:6581:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e61b400/0x85f51a6b967167a2 lrc: 0/0,0 mode: --/CR res: [0x2000032e3:0x6:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b65bd expref: 36 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051436.545559:0:6581:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e61ba00/0x85f51a6b967167a9 lrc: 3/0,0 mode: PW/PW res: [0x2000032e3:0x6:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b65bd expref: 35 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051436.545573:0:6581:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e3:0x6:0x0].0x0 (ffff99d9413d0c00) 00010000:00010000:0.0:1777051436.545578:0:6581:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1777051436.545583:0:6581:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d94e61ba00, rc 0) 00000100:00100000:0.0:1777051436.545669:0:6581:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5fbec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+35:138103:x1863365426005504:12345-192.168.201.46@tcp:101:lfs.0 Request processed in 1158us (1751us total) trans 30064771167 rc 0/0 00000100:00100000:0.0:1777051436.545683:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112129 00000100:00100000:2.0:1777051436.551516:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051436.551632:0:55805:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426005632 00000100:00100000:1.0:1777051436.551645:0:55805:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426005632 00000100:00100000:1.0:1777051436.551727:0:55805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 8034 00000100:00100000:1.0:1777051436.551742:0:55805:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94ed2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+52:2437:x1863365426005632:12345-192.168.201.46@tcp:1:lfs.0 00010000:00010000:1.0:1777051436.551797:0:55805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000076e82d3b/0x85f51a6b967167b7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1e4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051436.551863:0:55805:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000550ed123/0x85f51a6b967165f7 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x1e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b650e expref: 57 pid: 55805 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051436.551892:0:55805:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000054859c6/0x85f51a6b9671672b lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x1e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b65a1 expref: 52 pid: 27884 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051436.551905:0:55805:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051436.551908:0:55805:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051436.551913:0:55805:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000076e82d3b/0x85f51a6b967167b7 lrc: 5/0,1 mode: --/PW res: [0x280000401:0x1e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 55805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051436.551980:0:55805:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000054859c6/0x85f51a6b9671672b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x1e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b65a1 expref: 52 pid: 27884 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051436.552003:0:55805:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000054859c6/0x85f51a6b9671672b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x1e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b65a1 expref: 52 pid: 27884 timeout: 8165 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051436.552025:0:55805:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d942a0c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:55805:1863365452641920:192.168.201.46@tcp:104: 00010000:00010000:1.0:1777051436.552150:0:55805:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000550ed123/0x85f51a6b967165f7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x1e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b650e expref: 57 pid: 55805 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051436.552169:0:55805:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000550ed123/0x85f51a6b967165f7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x1e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b650e expref: 57 pid: 55805 timeout: 8165 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051436.552187:0:55805:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d942a0d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:55805:1863365452642048:192.168.201.46@tcp:104: 00000100:00100000:1.0:1777051436.552308:0:55805:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d9410826c0 going to sleep for 11 seconds 00000100:00100000:1.0:1777051436.557112:0:55805:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d942a0c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:55805:1863365452641920:192.168.201.46@tcp:104: 00000100:00100000:1.0:1777051436.557132:0:55805:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d942a0d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:55805:1863365452642048:192.168.201.46@tcp:104: 00010000:00010000:1.0:1777051436.557165:0:55805:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000076e82d3b/0x85f51a6b967167b7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 55805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051436.561277:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051436.561393:0:24467:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426005760 00000100:00100000:1.0:1777051436.561405:0:24467:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426005760 00010000:00010000:1.0:1777051436.561459:0:24467:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000054859c6/0x85f51a6b9671672b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x1e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b65a1 expref: 53 pid: 27884 timeout: 8165 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051436.561522:0:24467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3899 00000100:00100000:1.0:1777051436.561540:0:24467:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94ed2d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+53:2437:x1863365426005760:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1777051436.561561:0:24467:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1777051436.561616:0:24467:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000054859c6/0x85f51a6b9671672b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x1e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b65a1 expref: 53 pid: 27884 timeout: 8165 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051436.561642:0:24467:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000054859c6/0x85f51a6b9671672b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x1e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b65a1 expref: 53 pid: 27884 timeout: 8165 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051436.561676:0:24467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000054859c6/0x85f51a6b9671672b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x1e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b65a1 expref: 53 pid: 27884 timeout: 8165 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051436.561704:0:24467:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1777051436.562451:0:24467:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94ed2d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+52:2437:x1863365426005760:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 912us (1179us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051436.562472:0:24467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3899 00000100:00100000:2.0:1777051436.564625:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051436.565007:0:6565:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426005888 00000100:00100000:0.0:1777051436.565019:0:6565:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426005888 00010000:00010000:0.0:1777051436.565061:0:6565:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000550ed123/0x85f51a6b967165f7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x1e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b650e expref: 58 pid: 55805 timeout: 8165 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051436.565156:0:6565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3900 00000100:00100000:0.0:1777051436.565172:0:6565:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94ed2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+58:2438:x1863365426005888:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1777051436.565496:0:6565:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777051436.565525:0:6565:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000550ed123/0x85f51a6b967165f7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x1e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b650e expref: 58 pid: 55805 timeout: 8165 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051436.565551:0:6565:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000550ed123/0x85f51a6b967165f7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x1e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b650e expref: 58 pid: 55805 timeout: 8165 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051436.565580:0:6565:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000550ed123/0x85f51a6b967165f7 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x1e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b650e expref: 58 pid: 55805 timeout: 8165 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051436.565601:0:6565:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777051436.565605:0:6565:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777051436.565611:0:6565:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000076e82d3b/0x85f51a6b967167b7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 55805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051436.565628:0:6565:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000076e82d3b/0x85f51a6b967167b7 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 55805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051436.565682:0:6565:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1777051436.565749:0:6565:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94ed2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+57:2438:x1863365426005888:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 578us (1125us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051436.565763:0:6565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3900 00010000:00010000:1.0:1777051436.565890:0:55805:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000076e82d3b/0x85f51a6b967167b7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 55805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051436.565910:0:55805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000076e82d3b/0x85f51a6b967167b7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 55805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051436.565947:0:55805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000076e82d3b/0x85f51a6b967167b7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 55805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051436.565963:0:55805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000076e82d3b/0x85f51a6b967167b7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 55805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051436.565979:0:55805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000076e82d3b/0x85f51a6b967167b7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 55805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051436.565991:0:55805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94d72f600 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:1.0:1777051436.565998:0:55805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000076e82d3b/0x85f51a6b967167b7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 55805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051436.566013:0:55805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000076e82d3b/0x85f51a6b967167b7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 55805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051436.566034:0:55805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000076e82d3b/0x85f51a6b967167b7 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 55805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051436.566058:0:55805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000076e82d3b/0x85f51a6b967167b7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 55805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051436.566447:0:55805:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94ed2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+51:2437:x1863365426005632:12345-192.168.201.46@tcp:1:lfs.0 Request processed in 14706us (14937us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051436.566462:0:55805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 8034 00000100:00100000:2.0:1777051436.572301:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051436.572379:0:6582:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426006144 00000100:00100000:1.0:1777051436.572391:0:6582:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426006144 00000100:00100000:1.0:1777051436.572465:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3373 00000100:00100000:1.0:1777051436.572482:0:6582:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94ed2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+35:138103:x1863365426006144:12345-192.168.201.46@tcp:35:lfs.0 00000004:00010000:1.0:1777051436.572550:0:6582:0:(mdt_open.c:1994:mdt_hsm_release()) ### [0x2000032e3:0x6:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e61ba00/0x85f51a6b967167a9 lrc: 3/0,0 mode: PW/PW res: [0x2000032e3:0x6:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b65bd expref: 35 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1777051436.572791:0:6582:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 30064771168 00000001:00080000:1.0:1777051436.573408:0:6582:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 30064771169 00010000:00010000:1.0:1777051436.573475:0:6582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94d72f400/0x85f51a6b967167be lrc: 3/0,1 mode: --/EX res: [0x2000032e3:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051436.573500:0:6582:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eccc400/0x85f51a6b9671644c lrc: 2/0,0 mode: PR/PR res: [0x2000032e3:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b646d expref: 23 pid: 27885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051436.573516:0:6582:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94ecccc00/0x85f51a6b9671658e lrc: 2/0,0 mode: PR/PR res: [0x2000032e3:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b64cf expref: 38 pid: 21368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051436.573531:0:6582:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d94d72f400/0x85f51a6b967167be lrc: 5/0,1 mode: --/EX res: [0x2000032e3:0x6:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051436.573586:0:6582:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99d94ecccc00/0x85f51a6b9671658e lrc: 3/0,0 mode: PR/PR res: [0x2000032e3:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b64cf expref: 38 pid: 21368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051436.573609:0:6582:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94ecccc00/0x85f51a6b9671658e lrc: 4/0,0 mode: PR/PR res: [0x2000032e3:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b64cf expref: 38 pid: 21368 timeout: 8165 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051436.573632:0:6582:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d942a0d500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6582:1863365452642176:192.168.201.46@tcp:104: 00010000:00010000:1.0:1777051436.573869:0:6582:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eccc400/0x85f51a6b9671644c lrc: 3/0,0 mode: PR/PR res: [0x2000032e3:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b646d expref: 23 pid: 27885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051436.573888:0:6582:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eccc400/0x85f51a6b9671644c lrc: 4/0,0 mode: PR/PR res: [0x2000032e3:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b646d expref: 23 pid: 27885 timeout: 8165 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051436.573907:0:6582:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d942a0c380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6582:1863365452642304:192.168.201.46@tcp:104: 00000100:00100000:1.0:1777051436.573949:0:6582:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d941082900 going to sleep for 11 seconds 00000100:00100000:1.0:1777051436.577929:0:6582:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d942a0d500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6582:1863365452642176:192.168.201.46@tcp:104: 00000100:00100000:1.0:1777051436.577950:0:6582:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d942a0c380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6582:1863365452642304:192.168.201.46@tcp:104: 00010000:00010000:1.0:1777051436.577981:0:6582:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99d94d72f400/0x85f51a6b967167be lrc: 3/0,1 mode: --/EX res: [0x2000032e3:0x6:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6582 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051436.579113:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051436.579281:0:6566:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426006400 00000100:00100000:3.0:1777051436.579292:0:6566:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426006400 00010000:00010000:3.0:1777051436.579370:0:6566:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eccc400/0x85f51a6b9671644c lrc: 4/0,0 mode: PR/PR res: [0x2000032e3:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b646d expref: 24 pid: 27885 timeout: 8165 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1777051436.579389:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1777051436.579433:0:6566:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3901 00000100:00100000:3.0:1777051436.579452:0:6566:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94ed2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+24:2436:x1863365426006400:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1777051436.579471:0:6566:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777051436.579483:0:6566:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eccc400/0x85f51a6b9671644c lrc: 4/0,0 mode: PR/PR res: [0x2000032e3:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b646d expref: 24 pid: 27885 timeout: 8165 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051436.579502:0:6566:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eccc400/0x85f51a6b9671644c lrc: 3/0,0 mode: PR/PR res: [0x2000032e3:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b646d expref: 24 pid: 27885 timeout: 8165 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051436.579701:0:6566:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eccc400/0x85f51a6b9671644c lrc: 0/0,0 mode: --/PR res: [0x2000032e3:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b646d expref: 24 pid: 27885 timeout: 8165 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051436.579725:0:6566:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e3:0x6:0x0].0x0 (ffff99d9413d0c00) 00010000:00010000:3.0:1777051436.579734:0:6566:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99d94d72f400/0x85f51a6b967167be lrc: 3/0,1 mode: --/EX res: [0x2000032e3:0x6:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051436.579746:0:6566:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff99d94d72f400/0x85f51a6b967167be lrc: 3/0,1 mode: --/EX res: [0x2000032e3:0x6:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051436.579756:0:6566:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1777051436.579849:0:6566:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94ed2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+23:2436:x1863365426006400:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 402us (739us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051436.579862:0:6566:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3901 00000100:00100000:2.0:1777051436.580402:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051436.580482:0:47827:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426006272 00000100:00100000:0.0:1777051436.580497:0:47827:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426006272 00010000:00010000:0.0:1777051436.580535:0:47827:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d94ecccc00/0x85f51a6b9671658e lrc: 4/0,0 mode: PR/PR res: [0x2000032e3:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b64cf expref: 39 pid: 21368 timeout: 8165 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051436.580626:0:47827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3902 00000100:00100000:0.0:1777051436.580649:0:47827:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da6fd43050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+39:2438:x1863365426006272:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1777051436.580667:0:47827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777051436.580677:0:47827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99d94ecccc00/0x85f51a6b9671658e lrc: 4/0,0 mode: PR/PR res: [0x2000032e3:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b64cf expref: 39 pid: 21368 timeout: 8165 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051436.580697:0:47827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99d94ecccc00/0x85f51a6b9671658e lrc: 3/0,0 mode: PR/PR res: [0x2000032e3:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b64cf expref: 39 pid: 21368 timeout: 8165 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051436.580728:0:47827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94ecccc00/0x85f51a6b9671658e lrc: 0/0,0 mode: --/PR res: [0x2000032e3:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b64cf expref: 39 pid: 21368 timeout: 8165 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051436.580747:0:47827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e3:0x6:0x0].0x0 (ffff99d9413d0c00) 00010000:00010000:0.0:1777051436.580755:0:47827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99d94d72f400/0x85f51a6b967167be lrc: 3/0,1 mode: --/EX res: [0x2000032e3:0x6:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051436.580769:0:47827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94d72f400/0x85f51a6b967167be lrc: 3/0,1 mode: EX/EX res: [0x2000032e3:0x6:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051436.580780:0:47827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94d72f400/0x85f51a6b967167be lrc: 4/0,1 mode: EX/EX res: [0x2000032e3:0x6:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051436.580846:0:47827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1777051436.580890:0:6582:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99d94d72f400/0x85f51a6b967167be lrc: 3/0,1 mode: EX/EX res: [0x2000032e3:0x6:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6582 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051436.580907:0:47827:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da6fd43050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+38:2438:x1863365426006272:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 264us (502us total) trans 0 rc 0/0 00010000:00010000:1.0:1777051436.580912:0:6582:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94d72f400/0x85f51a6b967167be lrc: 3/0,1 mode: EX/EX res: [0x2000032e3:0x6:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6582 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051436.580930:0:47827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3902 00000001:00080000:1.0:1777051436.581101:0:6582:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 30064771170 00000001:00080000:1.0:1777051436.581290:0:6582:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 30064771171 00000001:00080000:1.0:1777051436.581346:0:6582:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 30064771172 00000100:00100000:1.0:1777051436.581445:0:6582:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d942a0c380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6582:1863365452642432:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1777051436.581505:0:6582:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051436.581555:0:6582:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d941082000 going to sleep for 11 seconds 00000100:00100000:2.0:1777051436.581624:0:6584:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452642432 00000100:00100000:2.0:1777051436.581635:0:6584:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452642432 00000100:00100000:2.0:1777051436.581761:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8191 00000100:00100000:2.0:1777051436.581778:0:6584:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942a0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6582:x1863365452642432:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00080000:0.0:1777051436.581904:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1777051436.582082:0:6584:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942a0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6582:x1863365452642432:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 304us (572us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051436.582096:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8191 00000100:00100000:3.0:1777051436.582268:0:6582:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d942a0c380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6582:1863365452642432:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1777051436.582425:0:6582:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 30064771173 00000100:00100000:3.0:1777051436.582501:0:6582:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5fbeea00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6582:1863365452642560:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1777051436.582546:0:6582:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051436.582582:0:6582:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d95cf519c0 going to sleep for 11 seconds 00000100:00100000:1.0:1777051436.582750:0:6585:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452642560 00000100:00100000:1.0:1777051436.582760:0:6585:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452642560 00000100:00100000:1.0:1777051436.582934:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8192 00000100:00100000:1.0:1777051436.582951:0:6585:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5fbeca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6582:x1863365452642560:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1777051436.583108:0:6585:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5fbeca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6582:x1863365452642560:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 161us (559us total) trans 4294968360 rc 0/0 00000100:00100000:1.0:1777051436.583120:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8192 00000100:00100000:3.0:1777051436.583366:0:6582:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5fbeea00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6582:1863365452642560:0@lo:1000:mdt_rdpg00_000.0 00010000:00010000:3.0:1777051436.583396:0:6582:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94d72f400/0x85f51a6b967167be lrc: 3/0,1 mode: EX/EX res: [0x2000032e3:0x6:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051436.583432:0:6582:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d94d72f400/0x85f51a6b967167be lrc: 2/0,0 mode: EX/EX res: [0x2000032e3:0x6:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051436.583445:0:6582:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d94d72f400/0x85f51a6b967167be lrc: 3/0,0 mode: EX/EX res: [0x2000032e3:0x6:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051436.583456:0:6582:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94d72f400 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:3.0:1777051436.583462:0:6582:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94d72f400/0x85f51a6b967167be lrc: 3/0,0 mode: EX/EX res: [0x2000032e3:0x6:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051436.583482:0:6582:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94d72f400/0x85f51a6b967167be lrc: 4/0,0 mode: EX/EX res: [0x2000032e3:0x6:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051436.583501:0:6582:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e3:0x6:0x0].0x0 (ffff99d9413d0c00) 00010000:00010000:3.0:1777051436.583506:0:6582:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1777051436.583513:0:6582:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d94d72f400/0x85f51a6b967167be lrc: 2/0,0 mode: --/EX res: [0x2000032e3:0x6:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051436.583523:0:6582:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94d72f400/0x85f51a6b967167be lrc: 0/0,0 mode: --/EX res: [0x2000032e3:0x6:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6582 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1777051436.583688:0:6582:0:(mdd_object.c:4010:mdd_close()) Object [0x2000032e2:0x7:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1777051436.583801:0:6582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x27:0x0].3, 64 off8384 00000004:00080000:3.0:1777051436.583853:0:6582:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 8065776654947ns, next at 8066776651742ns, rc = 0 00000001:00080000:3.0:1777051436.583866:0:6582:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 30064771174 00010000:00010000:3.0:1777051436.583909:0:6582:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e3:0x6:0x0].0x0 (ffff99d9413d0c00) 00010000:00010000:3.0:1777051436.583914:0:6582:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1777051436.583924:0:6582:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e61ba00/0x85f51a6b967167a9 lrc: 0/0,0 mode: --/PW res: [0x2000032e3:0x6:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b65bd expref: 42 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051436.584062:0:6582:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94ed2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+41:138103:x1863365426006144:12345-192.168.201.46@tcp:35:lfs.0 Request processed in 11582us (11770us total) trans 30064771175 rc 0/0 00000100:00100000:3.0:1777051436.584077:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3373 00000020:00080000:3.0:1777051436.584084:0:6582:0:(tgt_main.c:783:tgt_ses_key_exit()) total 8 transactions per RPC 00000100:00100000:2.0:1777051436.603076:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051436.603396:0:21368:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426006656 00000100:00100000:0.0:1777051436.603412:0:21368:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426006656 00000100:00100000:0.0:1777051436.603503:0:21368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112130 00000100:00100000:0.0:1777051436.603521:0:21368:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94ed2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+76:138104:x1863365426006656:12345-192.168.201.46@tcp:101:cat.0 00010000:00010000:0.0:1777051436.603555:0:21368:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051436.603583:0:21368:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61b400/0x85f51a6b967167c5 lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b65c4 expref: -99 pid: 21368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051436.603687:0:21368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61ac00/0x85f51a6b967167cc lrc: 3/1,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051436.603709:0:21368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61ac00/0x85f51a6b967167cc lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 21368 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051436.603727:0:21368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61ac00/0x85f51a6b967167cc lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 21368 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051436.603749:0:21368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61b600/0x85f51a6b967167d3 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0xa30099d5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051436.603761:0:21368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61b600/0x85f51a6b967167d3 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xa30099d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21368 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051436.603771:0:21368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61b600/0x85f51a6b967167d3 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xa30099d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21368 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051436.603958:0:21368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61be00/0x85f51a6b967167da lrc: 3/1,0 mode: --/PR res: [0x240000bd2:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051436.603973:0:21368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61be00/0x85f51a6b967167da lrc: 3/1,0 mode: PR/PR res: [0x240000bd2:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21368 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051436.603986:0:21368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61be00/0x85f51a6b967167da lrc: 3/1,0 mode: PR/PR res: [0x240000bd2:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21368 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1777051436.604010:0:21368:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000bd2:0x1:0x0]: returning size 1048576 00010000:00010000:0.0:1777051436.604376:0:21368:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61ac00/0x85f51a6b967167cc lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 21368 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051436.604391:0:21368:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61ac00/0x85f51a6b967167cc lrc: 2/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 21368 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051436.604402:0:21368:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61ac00/0x85f51a6b967167cc lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 21368 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051436.604413:0:21368:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94e61ac00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:0.0:1777051436.604420:0:21368:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61ac00/0x85f51a6b967167cc lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 21368 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051436.604485:0:21368:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61ac00/0x85f51a6b967167cc lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 21368 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051436.604505:0:21368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff99d9413d0300) 00010000:00010000:0.0:1777051436.604511:0:21368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777051436.604518:0:21368:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61ac00/0x85f51a6b967167cc lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 21368 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051436.604530:0:21368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61ac00/0x85f51a6b967167cc lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 21368 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051436.604581:0:21368:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61b600/0x85f51a6b967167d3 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xa30099d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21368 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051436.604592:0:21368:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61b600/0x85f51a6b967167d3 lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xa30099d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 21368 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051436.604601:0:21368:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61b600/0x85f51a6b967167d3 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xa30099d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21368 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051436.604611:0:21368:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94e61b600 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:0.0:1777051436.604617:0:21368:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61b600/0x85f51a6b967167d3 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xa30099d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21368 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051436.604628:0:21368:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61b600/0x85f51a6b967167d3 lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0xa30099d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 21368 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051436.604649:0:21368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0xa30099d5 (ffff99da5fb45200) 00010000:00010000:0.0:1777051436.604654:0:21368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777051436.604658:0:21368:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61b600/0x85f51a6b967167d3 lrc: 2/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0xa30099d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21368 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051436.604668:0:21368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61b600/0x85f51a6b967167d3 lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0xa30099d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21368 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051436.605067:0:21368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61b400/0x85f51a6b967167c5 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b65c4 expref: 79 pid: 21368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051436.605330:0:21368:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61be00/0x85f51a6b967167da lrc: 3/0,0 mode: PR/PR res: [0x240000bd2:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b65c4 expref: 78 pid: 21368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051436.605345:0:21368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x1:0x0].0x0 (ffff99da5fb45c00) 00010000:00010000:0.0:1777051436.605349:0:21368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1777051436.605354:0:21368:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d94e61be00, rc 0) 00000100:00100000:0.0:1777051436.605478:0:21368:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94ed2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+78:138104:x1863365426006656:12345-192.168.201.46@tcp:101:cat.0 Request processed in 1960us (2410us total) trans 8589934668 rc 0/0 00000100:00100000:0.0:1777051436.605493:0:21368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112130 00000100:00100000:2.0:1777051436.610375:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051436.610530:0:47597:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426006912 00000100:00100000:3.0:1777051436.610538:0:47597:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426006912 00000100:00100000:3.0:1777051436.610594:0:47597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13697 00000100:00100000:3.0:1777051436.610604:0:47597:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94ed2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+78:138104:x1863365426006912:12345-192.168.201.46@tcp:103:cat.0 00010000:00010000:3.0:1777051436.610622:0:47597:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777051436.610645:0:47597:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61be00/0x85f51a6b967167da lrc: 0/0,0 mode: --/PR res: [0x240000bd2:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b65c4 expref: 78 pid: 21368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051436.610682:0:47597:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x1:0x0].0x0 (ffff99da5fb45c00) 00010000:00010000:3.0:1777051436.610694:0:47597:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1777051436.610752:0:47597:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94ed2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+77:138104:x1863365426006912:12345-192.168.201.46@tcp:103:cat.0 Request processed in 147us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051436.610771:0:47597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13697 00000100:00100000:2.0:1777051436.613593:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051436.613995:0:46494:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426007040 00000100:00100000:0.0:1777051436.614006:0:46494:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426007040 00000100:00100000:0.0:1777051436.614940:0:46494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112131 00000100:00100000:0.0:1777051436.614962:0:46494:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94ed2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+77:138104:x1863365426007040:12345-192.168.201.46@tcp:58:cat.0 00010000:00010000:0.0:1777051436.615094:0:46494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61b400/0x85f51a6b967167e8 lrc: 3/0,1 mode: --/EX res: [0x240000bd2:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051436.615124:0:46494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61b400/0x85f51a6b967167e8 lrc: 3/0,1 mode: EX/EX res: [0x240000bd2:0x1:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051436.615140:0:46494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61b400/0x85f51a6b967167e8 lrc: 3/0,1 mode: EX/EX res: [0x240000bd2:0x1:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 46494 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1777051436.615603:0:46494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].6, 136 off9008 00000100:00100000:0.0:1777051436.616005:0:46494:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94ed2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+77:138104:x1863365426007040:12345-192.168.201.46@tcp:58:cat.0 Request processed in 758us (2123us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051436.616019:0:46494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112131 00000100:00100000:2.0:1777051436.621302:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051436.621565:0:10328:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426007168 00000100:00100000:1.0:1777051436.621578:0:10328:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426007168 00000100:00100000:1.0:1777051436.621991:0:10328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112132 00000100:00100000:1.0:1777051436.622010:0:10328:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95a581500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+77:138104:x1863365426007168:12345-192.168.201.46@tcp:101:cat.0 00010000:00010000:1.0:1777051436.622036:0:10328:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777051436.622397:0:10328:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72f600/0x85f51a6b967167ef lrc: 2/0,0 mode: --/CR res: [0x240000bd2:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b65cb expref: -99 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051436.622475:0:10328:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61b400/0x85f51a6b967167e8 lrc: 2/0,1 mode: EX/EX res: [0x240000bd2:0x1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 46494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051436.622495:0:10328:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72f600/0x85f51a6b967167ef lrc: 4/0,0 mode: --/CR res: [0x240000bd2:0x1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b65cb expref: 78 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051436.622535:0:10328:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61b400/0x85f51a6b967167e8 lrc: 3/0,1 mode: EX/EX res: [0x240000bd2:0x1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 46494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051436.622558:0:10328:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72f600/0x85f51a6b967167ef lrc: 3/0,0 mode: --/CR res: [0x240000bd2:0x1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b65cb expref: 78 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051436.622579:0:10328:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x1:0x0].0x0 (ffff99da5fb45200) 00010000:00010000:1.0:1777051436.622584:0:10328:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1777051436.622591:0:10328:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72f600/0x85f51a6b967167ef lrc: 3/0,0 mode: --/CR res: [0x240000bd2:0x1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b65cb expref: 78 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051436.622606:0:10328:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d94d72f600, rc 0) 00000100:00100000:1.0:1777051436.622696:0:10328:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95a581500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+78:138104:x1863365426007168:12345-192.168.201.46@tcp:101:cat.0 Request processed in 690us (1401us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051436.622710:0:10328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112132 00000100:00100000:3.0:1777051436.823723:0:3680:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1777051436.824669:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d942a0c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3680:1863365452642688:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1777051436.825525:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051436.825694:0:11727:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452642688 00000100:00100000:2.0:1777051436.825706:0:11727:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452642688 00000100:00100000:2.0:1777051436.825769:0:11727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8193 00000100:00100000:2.0:1777051436.825791:0:11727:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5fbef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3680:x1863365452642688:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1777051436.825865:0:11727:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4194304 pending 0 free 1441509376 avail 1295269888 00000100:00100000:2.0:1777051436.826029:0:11727:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5fbef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3680:x1863365452642688:12345-0@lo:41:osp-pre-0-1.0 Request processed in 240us (504us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051436.826042:0:11727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8193 00000100:00100000:3.0:1777051436.826155:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d942a0c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3680:1863365452642688:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1777051436.963425:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051436.963535:0:103168:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426007296 00000100:00100000:3.0:1777051436.963549:0:103168:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426007296 00000100:00100000:3.0:1777051436.963634:0:103168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 182 00000100:00100000:3.0:1777051436.963649:0:103168:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942d2b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:29c4352d-3260-4734-909d-9ea5de9e7fa4+12:2439:x1863365426007296:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:3.0:1777051436.963754:0:103168:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942d2b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:29c4352d-3260-4734-909d-9ea5de9e7fa4+12:2439:x1863365426007296:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 106us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051436.963768:0:103168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 182 00010000:00010000:3.0:1777051437.143334:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1777051437.334589:0:3679:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1777051437.334622:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5fbec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452642816:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1777051437.334718:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051437.334852:0:46500:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452642816 00000100:00100000:3.0:1777051437.334886:0:46500:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452642816 00000100:00100000:3.0:1777051437.334999:0:46500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8194 00000100:00100000:3.0:1777051437.335020:0:46500:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95a582300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+6:3679:x1863365452642816:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1777051437.335077:0:46500:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4194304 pending 0 free 1446113280 avail 1299873792 00000100:00100000:3.0:1777051437.335470:0:46500:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95a582300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+6:3679:x1863365452642816:12345-0@lo:41:osp-pre-1-0.0 Request processed in 151us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051437.335488:0:46500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8194 00000100:00100000:2.0:1777051437.335556:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5fbec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452642816:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1777051437.336133:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d942a0f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3677:1863365452642944:0@lo:400:kworker.0 00000100:00100000:2.0:1777051437.336247:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051437.336301:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d942a0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3678:1863365452643072:0@lo:400:kworker.0 00000100:00100000:2.0:1777051437.336324:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d942a0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3677:1863365452643456:0@lo:400:kworker.0 00000100:00100000:1.0:1777051437.336369:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d942a0c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3680:1863365452643328:0@lo:400:kworker.0 00000100:00100000:0.0:1777051437.336386:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051437.336404:0:103165:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452642944 00000100:00100000:2.0:1777051437.336413:0:103165:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452642944 00000100:00100000:2.0:1777051437.336471:0:103165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1777051437.336485:0:103165:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942d2a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9351a01-5b0e-4470-97fd-58b9b4b312a2+23:3677:x1863365452642944:12345-0@lo:400:kworker.0 00000040:00080000:3.0:1777051437.336635:0:103189:0:(llog.c:801:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:3.0:1777051437.336643:0:103189:0:(llog_cat.c:158:llog_cat_process_common()) processing log [0x1:0x2b:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1777051437.336678:0:103189:0:(llog.c:858:llog_process_thread()) stop processing plain [0x1:0x2b:0x0] index 6 count 4 00000040:00080000:3.0:1777051437.336689:0:103189:0:(llog.c:858:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00000100:00100000:3.0:1777051437.337688:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d942a0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3679:1863365452643200:0@lo:400:kworker.0 00000100:00100000:0.0:1777051437.338181:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da45f76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3678:1863365452643584:0@lo:400:kworker.0 00000100:00100000:1.0:1777051437.338266:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051437.338268:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051437.338282:0:103165:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942d2a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9351a01-5b0e-4470-97fd-58b9b4b312a2+23:3677:x1863365452642944:12345-0@lo:400:kworker.0 Request processed in 1793us (2033us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051437.338299:0:103165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1777051437.338352:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da45f75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3680:1863365452643840:0@lo:400:kworker.0 00000100:00100000:3.0:1777051437.338367:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051437.338401:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da45f75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452644096:0@lo:400:kworker.0 00000100:00100000:2.0:1777051437.338407:0:8470:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452643584 00000100:00100000:2.0:1777051437.338417:0:8470:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452643584 00000100:00100000:3.0:1777051437.338428:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da45f76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452643712:0@lo:400:kworker.0 00000100:00100000:1.0:1777051437.338444:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051437.338474:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051437.338499:0:8470:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452644096 00000100:00100000:2.0:1777051437.338508:0:8470:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452644096 00000100:00100000:1.0:1777051437.338551:0:8628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10451 00000100:00100000:3.0:1777051437.338554:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051437.338571:0:6579:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452643072 00000100:00100000:1.0:1777051437.338574:0:8628:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d944e10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3678:x1863365452643584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777051437.338578:0:8470:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452643712 00000100:00100000:0.0:1777051437.338582:0:6579:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452643072 00000100:00100000:2.0:1777051437.338588:0:8470:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452643712 00000100:00100000:3.0:1777051437.338605:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da45f75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3679:1863365452644224:0@lo:400:kworker.0 00000100:00100000:2.0:1777051437.338682:0:8470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10452 00000100:00100000:3.0:1777051437.338682:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051437.338691:0:6579:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452643328 00000100:00100000:1.0:1777051437.338693:0:8628:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d944e10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3678:x1863365452643584:12345-0@lo:400:kworker.0 Request processed in 124us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051437.338705:0:6579:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452643328 00000100:00100000:1.0:1777051437.338723:0:8628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10451 00000100:00100000:2.0:1777051437.338724:0:8470:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7e24f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3678:x1863365452644096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777051437.338776:0:8628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10453 00000100:00100000:3.0:1777051437.338779:0:27885:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452643200 00000100:00100000:3.0:1777051437.338789:0:27885:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452643200 00000100:00100000:0.0:1777051437.338793:0:6579:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452643840 00000100:00100000:0.0:1777051437.338831:0:6579:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452643840 00000100:00100000:1.0:1777051437.338831:0:8628:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5fbed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3679:x1863365452643712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777051437.338843:0:8470:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7e24f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3678:x1863365452644096:12345-0@lo:400:kworker.0 Request processed in 127us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051437.338858:0:8470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10452 00000100:00100000:3.0:1777051437.338878:0:27885:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452644224 00000100:00100000:3.0:1777051437.338887:0:27885:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452644224 00000100:00100000:0.0:1777051437.338906:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13405 00000100:00100000:0.0:1777051437.338925:0:6579:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d944e11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3678:x1863365452643072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777051437.338970:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13406 00000100:00100000:1.0:1777051437.338978:0:8628:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5fbed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3679:x1863365452643712:12345-0@lo:400:kworker.0 Request processed in 182us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051437.338990:0:27885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13407 00000100:00100000:2.0:1777051437.339002:0:6580:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da45f77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3680:x1863365452643328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777051437.339004:0:6579:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d944e11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3678:x1863365452643072:12345-0@lo:400:kworker.0 Request processed in 78us (2618us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051437.339005:0:8628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10453 00000100:00100000:3.0:1777051437.339020:0:27885:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5fbeed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:lustre-MDT0001-lwp-OST0000_UUID+5:3679:x1863365452643200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777051437.339034:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13405 00000100:00100000:0.0:1777051437.339077:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13408 00000100:00100000:1.0:1777051437.339092:0:46497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13409 00000100:00100000:0.0:1777051437.339098:0:6579:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da45f76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3680:x1863365452643840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777051437.339119:0:46497:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5fbefb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:lustre-MDT0000-lwp-MDT0001_UUID+5:3679:x1863365452644224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777051437.339124:0:6580:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da45f77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3680:x1863365452643328:12345-0@lo:400:kworker.0 Request processed in 133us (863us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051437.339130:0:27885:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5fbeed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:lustre-MDT0001-lwp-OST0000_UUID+5:3679:x1863365452643200:12345-0@lo:400:kworker.0 Request processed in 115us (762us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051437.339155:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13406 00000100:00100000:3.0:1777051437.339167:0:27885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13407 00000100:00100000:0.0:1777051437.339181:0:6579:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da45f76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3680:x1863365452643840:12345-0@lo:400:kworker.0 Request processed in 88us (742us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051437.339238:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13408 00000100:00100000:2.0:1777051437.339255:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051437.339274:0:6579:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452643456 00000100:00100000:1.0:1777051437.339284:0:46497:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5fbefb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:lustre-MDT0000-lwp-MDT0001_UUID+5:3679:x1863365452644224:12345-0@lo:400:kworker.0 Request processed in 171us (606us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051437.339285:0:6579:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452643456 00000100:00100000:1.0:1777051437.339323:0:46497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13409 00000100:00100000:2.0:1777051437.339323:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da45f77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452643968:0@lo:400:kworker.0 00000100:00100000:3.0:1777051437.339357:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d942a0c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3680:1863365452643328:0@lo:400:kworker.0 00000100:00100000:1.0:1777051437.339371:0:46497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13410 00000100:00100000:2.0:1777051437.339382:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051437.339386:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da45f75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3680:1863365452643840:0@lo:400:kworker.0 00000100:00100000:1.0:1777051437.339399:0:46497:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95a580700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:lustre-MDT0001-lwp-OST0001_UUID+5:3677:x1863365452643456:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1777051437.339401:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1777051437.339413:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1777051437.339421:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1777051437.339456:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d942a0f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3677:1863365452642944:0@lo:400:kworker.0 00000100:00100000:0.0:1777051437.339482:0:24468:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452643968 00000100:00100000:0.0:1777051437.339492:0:24468:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452643968 00000100:00100000:1.0:1777051437.339492:0:46497:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95a580700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:lustre-MDT0001-lwp-OST0001_UUID+5:3677:x1863365452643456:12345-0@lo:400:kworker.0 Request processed in 99us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051437.339506:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d942a0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3677:1863365452643456:0@lo:400:kworker.0 00000100:00100000:3.0:1777051437.339542:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d942a0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3679:1863365452643200:0@lo:400:kworker.0 00000100:00100000:1.0:1777051437.339544:0:46497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13410 00000100:00100000:0.0:1777051437.339554:0:24468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10454 00000100:00100000:0.0:1777051437.339571:0:24468:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95a581880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+7:3677:x1863365452643968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051437.339603:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da45f76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452643712:0@lo:400:kworker.0 00000100:00100000:2.0:1777051437.339614:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da45f75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452644096:0@lo:400:kworker.0 00000100:00100000:3.0:1777051437.339636:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da45f75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3679:1863365452644224:0@lo:400:kworker.0 00000100:00100000:2.0:1777051437.339651:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d942a0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3678:1863365452643072:0@lo:400:kworker.0 00000100:00100000:0.0:1777051437.339663:0:24468:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95a581880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+7:3677:x1863365452643968:12345-0@lo:400:kworker.0 Request processed in 95us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051437.339677:0:24468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10454 00000100:00100000:2.0:1777051437.339684:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da45f76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3678:1863365452643584:0@lo:400:kworker.0 00000100:00100000:2.0:1777051437.339749:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da45f77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452643968:0@lo:400:kworker.0 00000040:00080000:0.0:1777051437.463299:0:104226:0:(llog.c:801:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1777051437.463310:0:104226:0:(llog_cat.c:158:llog_cat_process_common()) processing log [0x1:0x12:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1777051437.463347:0:104226:0:(llog.c:858:llog_process_thread()) stop processing plain [0x1:0x12:0x0] index 7 count 5 00000040:00080000:0.0:1777051437.463356:0:104226:0:(llog.c:858:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1777051437.463515:0:104226:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7e24e300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0001_UUID:104226:1863365452644352:192.168.201.46@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1777051437.463636:0:104226:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d95c67b840 going to sleep for 11 seconds 00000100:00100000:0.0:1777051437.469721:0:104226:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7e24e300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0001_UUID:104226:1863365452644352:192.168.201.46@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1777051437.473351:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051437.473472:0:8492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426007424 00000100:00100000:3.0:1777051437.473485:0:8492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426007424 00000100:00100000:3.0:1777051437.473572:0:8492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112133 00000100:00100000:3.0:1777051437.473589:0:8492:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95a580e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+9:138105:x1863365426007424:12345-192.168.201.46@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1777051437.473641:0:8492:0:(mdt_handler.c:7958:mdt_fid2path()) path get [0x240000bd2:0x1:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1777051437.474116:0:8492:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95a580e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+9:138105:x1863365426007424:12345-192.168.201.46@tcp:53:lhsmtool_posix.0 Request processed in 528us (767us total) trans 0 rc -66/-66 00000100:00100000:3.0:1777051437.474129:0:8492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112133 00000100:00100000:2.0:1777051437.481783:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051437.481930:0:27885:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426007552 00000100:00100000:3.0:1777051437.481941:0:27885:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426007552 00000100:00100000:3.0:1777051437.482021:0:27885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112134 00000100:00100000:3.0:1777051437.482035:0:27885:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95a582680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c11b6966-0775-44d2-bdc6-c74c26eb2226+23:138105:x1863365426007552:12345-192.168.201.46@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1777051437.482070:0:27885:0:(mdt_handler.c:7958:mdt_fid2path()) path get [0x2000032e2:0x6:0x0] from 18446744073709551615 #-1 00000100:00100000:3.0:1777051437.482350:0:27885:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95a582680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c11b6966-0775-44d2-bdc6-c74c26eb2226+23:138105:x1863365426007552:12345-192.168.201.46@tcp:53:lhsmtool_posix.0 Request processed in 316us (574us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051437.482363:0:27885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112134 00000100:00100000:2.0:1777051437.493521:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051437.493697:0:6580:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426007680 00000100:00100000:3.0:1777051437.493712:0:6580:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426007680 00000100:00100000:1.0:1777051437.493918:0:46497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112135 00000100:00100000:1.0:1777051437.493939:0:46497:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95a580380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:c11b6966-0775-44d2-bdc6-c74c26eb2226+23:138105:x1863365426007680:12345-192.168.201.46@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1777051437.494053:0:46497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94d72f200/0x85f51a6b967167f6 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051437.494080:0:46497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94d72f200/0x85f51a6b967167f6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051437.494434:0:46497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94d72f200/0x85f51a6b967167f6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051437.494463:0:46497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94d72ec00/0x85f51a6b967167fd lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x83974591 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051437.494488:0:46497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94d72ec00/0x85f51a6b967167fd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x83974591 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051437.494501:0:46497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94d72ec00/0x85f51a6b967167fd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x83974591 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051437.494619:0:46497:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da45f74000 pname:cluuid:pid:xid:nid:opc:job mdt00_009:lustre-MDT0000-mdtlov_UUID:46497:1863365452644480:0@lo:1000:mdt00_009.0 00000100:00100000:1.0:1777051437.494688:0:46497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051437.494747:0:46497:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d941082480 going to sleep for 11 seconds 00000100:00100000:2.0:1777051437.494845:0:46498:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452644480 00000100:00100000:2.0:1777051437.494856:0:46498:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452644480 00000100:00100000:2.0:1777051437.494930:0:46498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8195 00000100:00100000:2.0:1777051437.494947:0:46498:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da45f76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+6:46497:x1863365452644480:12345-0@lo:1000:mdt00_009.0 00000100:00100000:2.0:1777051437.495412:0:46498:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da45f76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+6:46497:x1863365452644480:12345-0@lo:1000:mdt00_009.0 Request processed in 465us (720us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051437.495428:0:46498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8195 00000100:00100000:1.0:1777051437.495445:0:46497:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da45f74000 pname:cluuid:pid:xid:nid:opc:job mdt00_009:lustre-MDT0000-mdtlov_UUID:46497:1863365452644480:0@lo:1000:mdt00_009.0 00010000:00010000:1.0:1777051437.495529:0:46497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94d72ee00/0x85f51a6b96716804 lrc: 3/1,0 mode: --/PR res: [0x240000bd2:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051437.495546:0:46497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94d72ee00/0x85f51a6b96716804 lrc: 3/1,0 mode: PR/PR res: [0x240000bd2:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051437.495561:0:46497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94d72ee00/0x85f51a6b96716804 lrc: 3/1,0 mode: PR/PR res: [0x240000bd2:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1777051437.495609:0:46497:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99d94d72ee00/0x85f51a6b96716804 lrc: 3/1,0 mode: PR/PR res: [0x240000bd2:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051437.495628:0:46497:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94d72f200/0x85f51a6b967167f6 lrc: 4/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051437.495639:0:46497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94d72f200/0x85f51a6b967167f6 lrc: 4/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051437.495649:0:46497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d94d72f200/0x85f51a6b967167f6 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051437.495669:0:46497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d94d72f200/0x85f51a6b967167f6 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051437.495679:0:46497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94d72f200 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:1.0:1777051437.495685:0:46497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94d72f200/0x85f51a6b967167f6 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051437.495697:0:46497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94d72f200/0x85f51a6b967167f6 lrc: 5/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051437.495713:0:46497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99d941e2ea00) 00010000:00010000:1.0:1777051437.495719:0:46497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777051437.495725:0:46497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d94d72f200/0x85f51a6b967167f6 lrc: 3/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051437.495736:0:46497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94d72f200/0x85f51a6b967167f6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051437.495757:0:46497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94d72ec00/0x85f51a6b967167fd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x83974591 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051437.495768:0:46497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d94d72ec00/0x85f51a6b967167fd lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x83974591 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051437.495778:0:46497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d94d72ec00/0x85f51a6b967167fd lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x83974591 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051437.495786:0:46497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94d72ec00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:1.0:1777051437.495790:0:46497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94d72ec00/0x85f51a6b967167fd lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x83974591 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051437.495838:0:46497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94d72ec00/0x85f51a6b967167fd lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x83974591 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051437.495852:0:46497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x83974591 (ffff99d94e5e2400) 00010000:00010000:1.0:1777051437.495857:0:46497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777051437.495863:0:46497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d94d72ec00/0x85f51a6b967167fd lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x83974591 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051437.495873:0:46497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94d72ec00/0x85f51a6b967167fd lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x83974591 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051437.495898:0:46497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94d72ee00/0x85f51a6b96716804 lrc: 3/1,0 mode: PR/PR res: [0x240000bd2:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051437.495909:0:46497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d94d72ee00/0x85f51a6b96716804 lrc: 2/0,0 mode: PR/PR res: [0x240000bd2:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051437.495920:0:46497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d94d72ee00/0x85f51a6b96716804 lrc: 3/0,0 mode: PR/PR res: [0x240000bd2:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051437.495929:0:46497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94d72ee00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:1.0:1777051437.495934:0:46497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94d72ee00/0x85f51a6b96716804 lrc: 3/0,0 mode: PR/PR res: [0x240000bd2:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051437.495945:0:46497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94d72ee00/0x85f51a6b96716804 lrc: 4/0,0 mode: PR/PR res: [0x240000bd2:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051437.495958:0:46497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x1:0x0].0x0 (ffff99d94e5e2d00) 00010000:00010000:1.0:1777051437.495963:0:46497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1777051437.495967:0:46497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d94d72ee00/0x85f51a6b96716804 lrc: 2/0,0 mode: --/PR res: [0x240000bd2:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051437.495985:0:46497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94d72ee00/0x85f51a6b96716804 lrc: 0/0,0 mode: --/PR res: [0x240000bd2:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051437.496087:0:46497:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95a580380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:c11b6966-0775-44d2-bdc6-c74c26eb2226+23:138105:x1863365426007680:12345-192.168.201.46@tcp:34:lhsmtool_posix.0 Request processed in 2151us (2569us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051437.496102:0:46497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112135 00000100:00100000:2.0:1777051437.503160:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051437.503279:0:10328:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426007808 00000100:00100000:1.0:1777051437.503292:0:10328:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426007808 00000100:00100000:1.0:1777051437.503376:0:10328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112136 00000100:00100000:1.0:1777051437.503393:0:10328:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95a581180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+9:138105:x1863365426007808:12345-192.168.201.46@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1777051437.503478:0:10328:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72ee00/0x85f51a6b9671680b lrc: 3/1,0 mode: --/PR res: [0x240000bd2:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051437.503505:0:10328:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72ee00/0x85f51a6b9671680b lrc: 3/1,0 mode: PR/PR res: [0x240000bd2:0x1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10328 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051437.503525:0:10328:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72ee00/0x85f51a6b9671680b lrc: 3/1,0 mode: PR/PR res: [0x240000bd2:0x1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10328 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1777051437.503596:0:10328:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000bd2:0x1:0x0]: returning size 1048576 00000004:00200000:1.0:1777051437.503618:0:10328:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:1.0:1777051437.503639:0:10328:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72ee00/0x85f51a6b9671680b lrc: 3/1,0 mode: PR/PR res: [0x240000bd2:0x1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10328 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051437.503652:0:10328:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72ee00/0x85f51a6b9671680b lrc: 2/0,0 mode: PR/PR res: [0x240000bd2:0x1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10328 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051437.503663:0:10328:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72ee00/0x85f51a6b9671680b lrc: 3/0,0 mode: PR/PR res: [0x240000bd2:0x1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10328 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051437.503682:0:10328:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94d72ee00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:1.0:1777051437.503688:0:10328:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72ee00/0x85f51a6b9671680b lrc: 3/0,0 mode: PR/PR res: [0x240000bd2:0x1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10328 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051437.503700:0:10328:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72ee00/0x85f51a6b9671680b lrc: 4/0,0 mode: PR/PR res: [0x240000bd2:0x1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10328 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051437.503717:0:10328:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x1:0x0].0x0 (ffff99da5fb45200) 00010000:00010000:1.0:1777051437.503722:0:10328:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1777051437.503729:0:10328:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72ee00/0x85f51a6b9671680b lrc: 2/0,0 mode: --/PR res: [0x240000bd2:0x1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10328 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051437.503739:0:10328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72ee00/0x85f51a6b9671680b lrc: 0/0,0 mode: --/PR res: [0x240000bd2:0x1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10328 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051437.503888:0:10328:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95a581180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+9:138105:x1863365426007808:12345-192.168.201.46@tcp:34:lhsmtool_posix.0 Request processed in 495us (735us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051437.503902:0:10328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112136 00000100:00100000:2.0:1777051437.508666:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051437.509066:0:46494:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426008064 00000100:00100000:1.0:1777051437.509076:0:46494:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426008064 00000100:00100000:1.0:1777051437.509152:0:46494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112137 00000100:00100000:1.0:1777051437.509168:0:46494:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95a583800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c11b6966-0775-44d2-bdc6-c74c26eb2226+9:138105:x1863365426008064:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1777051437.509189:0:46494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777051437.509248:0:46494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72ec00/0x85f51a6b96716812 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b65d2 expref: -99 pid: 46494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051437.509372:0:46494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72f200/0x85f51a6b96716819 lrc: 3/1,0 mode: --/PR res: [0x240000bd2:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051437.509393:0:46494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72f200/0x85f51a6b96716819 lrc: 3/1,0 mode: PR/PR res: [0x240000bd2:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 46494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051437.509405:0:46494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72f200/0x85f51a6b96716819 lrc: 3/1,0 mode: PR/PR res: [0x240000bd2:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 46494 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1777051437.509421:0:46494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000bd2:0x1:0x0]: returning size 1048576 00010000:00010000:1.0:1777051437.509535:0:46494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72f200/0x85f51a6b96716819 lrc: 3/1,0 mode: PR/PR res: [0x240000bd2:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 46494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051437.509549:0:46494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72f200/0x85f51a6b96716819 lrc: 2/0,0 mode: PR/PR res: [0x240000bd2:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 46494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051437.509560:0:46494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72f200/0x85f51a6b96716819 lrc: 3/0,0 mode: PR/PR res: [0x240000bd2:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 46494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051437.509569:0:46494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94d72f200 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:1.0:1777051437.509575:0:46494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72f200/0x85f51a6b96716819 lrc: 3/0,0 mode: PR/PR res: [0x240000bd2:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 46494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051437.509588:0:46494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72f200/0x85f51a6b96716819 lrc: 4/0,0 mode: PR/PR res: [0x240000bd2:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 46494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051437.509604:0:46494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x1:0x0].0x0 (ffff99da5fb45200) 00010000:00010000:1.0:1777051437.509608:0:46494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1777051437.509615:0:46494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72f200/0x85f51a6b96716819 lrc: 2/0,0 mode: --/PR res: [0x240000bd2:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 46494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051437.509627:0:46494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72f200/0x85f51a6b96716819 lrc: 0/0,0 mode: --/PR res: [0x240000bd2:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 46494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051437.509687:0:46494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72ec00/0x85f51a6b96716812 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b65d2 expref: 11 pid: 46494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051437.509706:0:46494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99d94e5e2d00) 00010000:00010000:1.0:1777051437.509711:0:46494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1777051437.509717:0:46494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72ec00/0x85f51a6b96716812 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b65d2 expref: 11 pid: 46494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051437.509741:0:46494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d94d72ec00, rc 0) 00000100:00100000:1.0:1777051437.509841:0:46494:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95a583800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c11b6966-0775-44d2-bdc6-c74c26eb2226+10:138105:x1863365426008064:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 Request processed in 674us (1182us total) trans 8589934669 rc 301/301 00000100:00100000:1.0:1777051437.509855:0:46494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112137 00000100:00100000:2.0:1777051437.516443:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051437.517059:0:6579:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426008192 00000100:00100000:0.0:1777051437.517070:0:6579:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426008192 00000100:00100000:0.0:1777051437.517154:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112138 00000100:00100000:0.0:1777051437.517170:0:6579:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95a580000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+10:138105:x1863365426008192:12345-192.168.201.46@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1777051437.517273:0:6579:0:(mdt_handler.c:7958:mdt_fid2path()) path get [0x240000bd2:0x1:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1777051437.517666:0:6579:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95a580000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+10:138105:x1863365426008192:12345-192.168.201.46@tcp:53:lhsmtool_posix.0 Request processed in 269us (998us total) trans 0 rc -66/-66 00000100:00100000:0.0:1777051437.517686:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112138 00000100:00100000:2.0:1777051437.527569:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051437.528150:0:27885:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426008320 00000100:00100000:3.0:1777051437.528547:0:27885:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426008320 00000100:00100000:3.0:1777051437.528624:0:27885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112139 00000100:00100000:3.0:1777051437.528642:0:27885:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95a581c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c11b6966-0775-44d2-bdc6-c74c26eb2226+23:138105:x1863365426008320:12345-192.168.201.46@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1777051437.528691:0:27885:0:(mdt_handler.c:7958:mdt_fid2path()) path get [0x2000032e2:0x6:0x0] from 18446744073709551615 #-1 00000100:00100000:3.0:1777051437.528959:0:27885:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95a581c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c11b6966-0775-44d2-bdc6-c74c26eb2226+23:138105:x1863365426008320:12345-192.168.201.46@tcp:53:lhsmtool_posix.0 Request processed in 319us (1398us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051437.528975:0:27885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112139 00000100:00100000:2.0:1777051437.542079:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051437.542611:0:6580:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426008576 00000100:00100000:3.0:1777051437.542627:0:6580:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426008576 00000100:00100000:3.0:1777051437.542721:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112140 00000100:00100000:3.0:1777051437.542739:0:6580:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95a583100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+10:138105:x1863365426008576:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1777051437.542771:0:6580:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777051437.542778:0:6580:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1777051437.542853:0:6580:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d94eccc800/0x85f51a6b9671641b lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b645f expref: 10 pid: 21368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051437.542887:0:6580:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff99d9413d0300) 00010000:00010000:3.0:1777051437.542896:0:6580:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1777051437.542918:0:6580:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a2a00/0x85f51a6b96716827 lrc: 2/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b65d9 expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051437.543614:0:6580:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a3000/0x85f51a6b9671682e lrc: 3/1,0 mode: --/PR res: [0x240000bd2:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051437.543638:0:6580:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a3000/0x85f51a6b9671682e lrc: 3/1,0 mode: PR/PR res: [0x240000bd2:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6580 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051437.543655:0:6580:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a3000/0x85f51a6b9671682e lrc: 3/1,0 mode: PR/PR res: [0x240000bd2:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6580 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1777051437.543672:0:6580:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000bd2:0x4:0x0]: returning size 0 00010000:00010000:3.0:1777051437.543742:0:6580:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a2a00/0x85f51a6b96716827 lrc: 0/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b65d9 expref: 12 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051437.543771:0:6580:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a3000/0x85f51a6b9671682e lrc: 3/0,0 mode: PR/PR res: [0x240000bd2:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b65d9 expref: 11 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051437.543786:0:6580:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x4:0x0].0x0 (ffff99d9533ab400) 00010000:00010000:3.0:1777051437.543792:0:6580:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1777051437.543822:0:6580:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d9559a3000, rc 0) 00000100:00100000:3.0:1777051437.543923:0:6580:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95a583100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+11:138105:x1863365426008576:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 Request processed in 1186us (2238us total) trans 8589934670 rc 0/0 00000100:00100000:3.0:1777051437.543938:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112140 00000100:00100000:2.0:1777051437.552711:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051437.552875:0:27882:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426008832 00000100:00100000:3.0:1777051437.552891:0:27882:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426008832 00000100:00100000:3.0:1777051437.552976:0:27882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112141 00000100:00100000:3.0:1777051437.552996:0:27882:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95a581f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+11:138105:x1863365426008832:12345-192.168.201.46@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1777051437.553085:0:27882:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777051437.553122:0:27882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a3000/0x85f51a6b9671682e lrc: 0/0,0 mode: --/PR res: [0x240000bd2:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b65d9 expref: 11 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051437.553153:0:27882:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x4:0x0].0x0 (ffff99d9533ab400) 00010000:00010000:3.0:1777051437.553171:0:27882:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1777051437.553732:0:27882:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f299880 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-mdtlov_UUID:27882:1863365452644608:0@lo:1000:mdt00_006.0 00000100:00100000:2.0:1777051437.553842:0:27882:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051437.553897:0:27882:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d956bda9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1777051437.554026:0:47208:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452644608 00000100:00100000:0.0:1777051437.554036:0:47208:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452644608 00000100:00100000:0.0:1777051437.554104:0:47208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8196 00000100:00100000:0.0:1777051437.554120:0:47208:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f299500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+6:27882:x1863365452644608:12345-0@lo:1000:mdt00_006.0 00000100:00100000:0.0:1777051437.554321:0:47208:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f299500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+6:27882:x1863365452644608:12345-0@lo:1000:mdt00_006.0 Request processed in 203us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051437.554337:0:47208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8196 00000100:00100000:1.0:1777051437.554666:0:27882:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f299880 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-mdtlov_UUID:27882:1863365452644608:0@lo:1000:mdt00_006.0 00010000:00010000:1.0:1777051437.555062:0:27882:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d94d72ec00/0x85f51a6b9671683c lrc: 3/0,1 mode: --/CW res: [0x2000032e0:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051437.555081:0:27882:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d94d72ec00/0x85f51a6b9671683c lrc: 3/0,1 mode: --/CW res: [0x2000032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 27882 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051437.555101:0:27882:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d94d72ec00/0x85f51a6b9671683c lrc: 3/0,1 mode: --/CW res: [0x2000032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 27882 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051437.555128:0:27882:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da45f74000 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-mdtlov_UUID:27882:1863365452644736:0@lo:101:mdt00_006.0 00000100:00100000:1.0:1777051437.555180:0:27882:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051437.555289:0:27882:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d941082480 going to sleep for 11 seconds 00000100:00100000:2.0:1777051437.555398:0:6584:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452644736 00000100:00100000:2.0:1777051437.555405:0:6584:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452644736 00000100:00100000:2.0:1777051437.555466:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8197 00000100:00100000:2.0:1777051437.555481:0:6584:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da45f75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:27882:x1863365452644736:12345-0@lo:101:mdt00_006.0 00010000:00010000:2.0:1777051437.555499:0:6584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051437.555523:0:6584:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d954ea5e00/0x85f51a6b96716843 lrc: 2/0,0 mode: --/CW res: [0x2000032e0:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x85f51a6b9671683c expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051437.555559:0:6584:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eccca00/0x85f51a6b96716484 lrc: 2/0,0 mode: PR/PR res: [0x2000032e0:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6482 expref: 40 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051437.555576:0:6584:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d954ea5e00/0x85f51a6b96716843 lrc: 4/0,0 mode: --/CW res: [0x2000032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x85f51a6b9671683c expref: 7 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051437.555614:0:6584:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eccca00/0x85f51a6b96716484 lrc: 3/0,0 mode: PR/PR res: [0x2000032e0:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6482 expref: 40 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051437.555636:0:6584:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eccca00/0x85f51a6b96716484 lrc: 4/0,0 mode: PR/PR res: [0x2000032e0:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6482 expref: 40 pid: 46497 timeout: 8166 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051437.556003:0:6584:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f299c00 pname:cluuid:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000_UUID:6584:1863365452644864:192.168.201.46@tcp:104: 00000100:00100000:2.0:1777051437.556113:0:6584:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d956bdae40 going to sleep for 11 seconds 00000100:00100000:2.0:1777051437.563388:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051437.563493:0:6584:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f299c00 pname:cluuid:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000_UUID:6584:1863365452644864:192.168.201.46@tcp:104: 00010000:00010000:1.0:1777051437.563536:0:6584:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d954ea5e00/0x85f51a6b96716843 lrc: 3/0,0 mode: --/CW res: [0x2000032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b9671683c expref: 7 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051437.563557:0:6584:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e0:0x1:0x0].0x0 (ffff99d943f76200) 00010000:00010000:1.0:1777051437.563563:0:6584:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777051437.563571:0:6584:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff99d954ea5e00/0x85f51a6b96716843 lrc: 3/0,0 mode: --/CW res: [0x2000032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b9671683c expref: 7 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051437.563589:0:6584:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d954ea5e00, rc 0) 00000100:00100000:1.0:1777051437.563675:0:6584:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da45f75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:27882:x1863365452644736:12345-0@lo:101:mdt00_006.0 Request processed in 8195us (8492us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051437.563690:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8197 00000100:00100000:2.0:1777051437.563792:0:27882:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da45f74000 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-mdtlov_UUID:27882:1863365452644736:0@lo:101:mdt00_006.0 00010000:00010000:2.0:1777051437.563855:0:27882:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d94d72ec00/0x85f51a6b9671683c lrc: 4/0,1 mode: --/CW res: [0x2000032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x85f51a6b96716843 expref: -99 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051437.563876:0:27882:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d94d72ec00/0x85f51a6b9671683c lrc: 4/0,1 mode: --/CW res: [0x2000032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x85f51a6b96716843 expref: -99 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051437.563931:0:6565:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426008960 00000100:00100000:0.0:1777051437.563945:0:6565:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426008960 00010000:00010000:0.0:1777051437.563992:0:6565:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eccca00/0x85f51a6b96716484 lrc: 4/0,0 mode: PR/PR res: [0x2000032e0:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6482 expref: 41 pid: 46497 timeout: 8166 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051437.564062:0:6565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3903 00000100:00100000:0.0:1777051437.564079:0:6565:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f29a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+41:2437:x1863365426008960:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1777051437.564100:0:6565:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777051437.564111:0:6565:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eccca00/0x85f51a6b96716484 lrc: 4/0,0 mode: PR/PR res: [0x2000032e0:0x1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6482 expref: 41 pid: 46497 timeout: 8166 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051437.564135:0:6565:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eccca00/0x85f51a6b96716484 lrc: 3/0,0 mode: PR/PR res: [0x2000032e0:0x1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6482 expref: 41 pid: 46497 timeout: 8166 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051437.564167:0:6565:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eccca00/0x85f51a6b96716484 lrc: 0/0,0 mode: --/PR res: [0x2000032e0:0x1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6482 expref: 41 pid: 46497 timeout: 8166 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051437.564257:0:6565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e0:0x1:0x0].0x0 (ffff99d943f76200) 00010000:00010000:0.0:1777051437.564267:0:6565:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff99d954ea5e00/0x85f51a6b96716843 lrc: 2/0,0 mode: --/CW res: [0x2000032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b9671683c expref: 6 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051437.564286:0:6565:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99d954ea5e00/0x85f51a6b96716843 lrc: 2/0,0 mode: CW/CW res: [0x2000032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x85f51a6b9671683c expref: 6 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051437.564302:0:6565:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d954ea5e00/0x85f51a6b96716843 lrc: 3/0,0 mode: CW/CW res: [0x2000032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x85f51a6b9671683c expref: 6 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051437.564350:0:6565:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff99d954ea5e00/0x85f51a6b96716843 lrc: 3/0,0 mode: CW/CW res: [0x2000032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b9671683c expref: 6 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051437.564370:0:6565:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7e24e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000_UUID:6565:1863365452644992:0@lo:105: 00000100:00100000:0.0:1777051437.564424:0:6565:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051437.564486:0:6565:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d95c67b240 going to sleep for 11 seconds 00000100:00100000:3.0:1777051437.565143:0:99220:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452644992 00000100:00100000:3.0:1777051437.565152:0:99220:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452644992 00000100:00100000:3.0:1777051437.565290:0:99220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1777051437.565307:0:99220:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7e24c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:6565:x1863365452644992:12345-0@lo:105: 00010000:00010000:3.0:1777051437.565325:0:99220:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d94d72ec00/0x85f51a6b9671683c lrc: 5/0,1 mode: --/CW res: [0x2000032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x85f51a6b96716843 expref: -99 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051437.565345:0:99220:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d94d72ec00/0x85f51a6b9671683c lrc: 5/0,1 mode: --/CW res: [0x2000032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x85f51a6b96716843 expref: -99 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051437.565361:0:99220:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d94d72ec00/0x85f51a6b9671683c lrc: 5/0,1 mode: --/CW res: [0x2000032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x85f51a6b96716843 expref: -99 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051437.565376:0:99220:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d94d72ec00/0x85f51a6b9671683c lrc: 5/0,1 mode: CW/CW res: [0x2000032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x85f51a6b96716843 expref: -99 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051437.565390:0:99220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d94d72ec00/0x85f51a6b9671683c lrc: 6/0,1 mode: CW/CW res: [0x2000032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x85f51a6b96716843 expref: -99 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051437.565404:0:99220:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d94d72ec00/0x85f51a6b9671683c lrc: 6/0,1 mode: CW/CW res: [0x2000032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x85f51a6b96716843 expref: -99 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051437.565448:0:99220:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff99d94d72ec00) 00000100:00100000:3.0:1777051437.565520:0:99220:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7e24c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:6565:x1863365452644992:12345-0@lo:105: Request processed in 218us (1094us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051437.565533:0:99220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1777051437.565837:0:6565:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7e24e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000_UUID:6565:1863365452644992:0@lo:105: 00010000:00010000:2.0:1777051437.565840:0:27882:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d94d72ec00/0x85f51a6b9671683c lrc: 4/0,1 mode: CW/CW res: [0x2000032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x85f51a6b96716843 expref: -99 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051437.565866:0:27882:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d94d72ec00/0x85f51a6b9671683c lrc: 4/0,1 mode: CW/CW res: [0x2000032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x85f51a6b96716843 expref: -99 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051437.565867:0:6565:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000004:00080000:2.0:1777051437.565912:0:27882:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x2000032e0:0x1:0x0] 00000100:00100000:1.0:1777051437.565956:0:6565:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f29a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+40:2437:x1863365426008960:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 1877us (2571us total) trans 0 rc 0/0 00010000:00010000:2.0:1777051437.565968:0:27882:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d954ea4400/0x85f51a6b9671684a lrc: 3/0,1 mode: --/PW res: [0x2000032e0:0x1:0x0].0xa677fe89 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051437.565978:0:6565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3903 00010000:00010000:2.0:1777051437.565997:0:27882:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d954ea4400/0x85f51a6b9671684a lrc: 3/0,1 mode: --/PW res: [0x2000032e0:0x1:0x0].0xa677fe89 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 27882 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051437.566040:0:27882:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d954ea4400/0x85f51a6b9671684a lrc: 3/0,1 mode: --/PW res: [0x2000032e0:0x1:0x0].0xa677fe89 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 27882 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051437.566070:0:27882:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f29ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-mdtlov_UUID:27882:1863365452645120:0@lo:101:mdt00_006.0 00000100:00100000:2.0:1777051437.566123:0:27882:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051437.566169:0:27882:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d956bda600 going to sleep for 11 seconds 00000100:00100000:1.0:1777051437.566724:0:6585:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452645120 00000100:00100000:1.0:1777051437.566733:0:6585:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452645120 00000100:00100000:1.0:1777051437.566822:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8198 00000100:00100000:1.0:1777051437.566839:0:6585:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f298380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:27882:x1863365452645120:12345-0@lo:101:mdt00_006.0 00010000:00010000:1.0:1777051437.566861:0:6585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777051437.566887:0:6585:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94d72f200/0x85f51a6b96716851 lrc: 2/0,0 mode: --/PW res: [0x2000032e0:0x1:0x0].0xa677fe89 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x85f51a6b9671684a expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051437.566922:0:6585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94d72f200/0x85f51a6b96716851 lrc: 3/0,0 mode: PW/PW res: [0x2000032e0:0x1:0x0].0xa677fe89 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x85f51a6b9671684a expref: 8 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051437.566943:0:6585:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94d72f200/0x85f51a6b96716851 lrc: 3/0,0 mode: PW/PW res: [0x2000032e0:0x1:0x0].0xa677fe89 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b9671684a expref: 8 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051437.566958:0:6585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e0:0x1:0x0].0xa677fe89 (ffff99d94e5e2400) 00010000:00010000:1.0:1777051437.566963:0:6585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777051437.566968:0:6585:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d94d72f200, rc 0) 00000100:00100000:1.0:1777051437.567039:0:6585:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f298380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:27882:x1863365452645120:12345-0@lo:101:mdt00_006.0 Request processed in 202us (914us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051437.567051:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8198 00000100:00100000:2.0:1777051437.567331:0:27882:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f29ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-mdtlov_UUID:27882:1863365452645120:0@lo:101:mdt00_006.0 00010000:00010000:2.0:1777051437.567355:0:27882:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d954ea4400/0x85f51a6b9671684a lrc: 4/0,1 mode: PW/PW res: [0x2000032e0:0x1:0x0].0xa677fe89 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x85f51a6b96716851 expref: -99 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051437.567374:0:27882:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d954ea4400/0x85f51a6b9671684a lrc: 4/0,1 mode: PW/PW res: [0x2000032e0:0x1:0x0].0xa677fe89 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x85f51a6b96716851 expref: -99 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1777051437.567399:0:27882:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x2000032e0:0x1:0x0] 00000100:00100000:2.0:1777051437.567485:0:27882:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f29ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-mdtlov_UUID:27882:1863365452645248:0@lo:1000:mdt00_006.0 00000100:00100000:2.0:1777051437.567539:0:27882:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051437.567580:0:27882:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d956bdab40 going to sleep for 11 seconds 00000100:00100000:0.0:1777051437.567589:0:47208:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452645248 00000100:00100000:0.0:1777051437.567600:0:47208:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452645248 00000100:00100000:0.0:1777051437.567674:0:47208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8199 00000100:00100000:0.0:1777051437.567688:0:47208:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f29a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+8:27882:x1863365452645248:12345-0@lo:1000:mdt00_006.0 00000100:00100000:0.0:1777051437.567839:0:47208:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f29a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+8:27882:x1863365452645248:12345-0@lo:1000:mdt00_006.0 Request processed in 152us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051437.567852:0:47208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8199 00000100:00100000:2.0:1777051437.568430:0:27882:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f29ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-mdtlov_UUID:27882:1863365452645248:0@lo:1000:mdt00_006.0 00000100:00100000:2.0:1777051437.568506:0:27882:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f29ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-mdtlov_UUID:27882:1863365452645376:0@lo:1000:mdt00_006.0 00000100:00100000:2.0:1777051437.568551:0:27882:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051437.569247:0:46500:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452645376 00000100:00100000:3.0:1777051437.569259:0:46500:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452645376 00000100:00100000:2.0:1777051437.569260:0:27882:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d956bdab40 going to sleep for 11 seconds 00000100:00100000:3.0:1777051437.569370:0:46500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8200 00000100:00100000:3.0:1777051437.569388:0:46500:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f29bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+8:27882:x1863365452645376:12345-0@lo:1000:mdt00_006.0 00000100:00100000:3.0:1777051437.569514:0:46500:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f29bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+8:27882:x1863365452645376:12345-0@lo:1000:mdt00_006.0 Request processed in 130us (960us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051437.569528:0:46500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8200 00000100:00100000:2.0:1777051437.569599:0:27882:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f29ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-mdtlov_UUID:27882:1863365452645376:0@lo:1000:mdt00_006.0 00000100:00100000:2.0:1777051437.569669:0:27882:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f29ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-mdtlov_UUID:27882:1863365452645504:0@lo:1000:mdt00_006.0 00000100:00100000:2.0:1777051437.569713:0:27882:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051437.569757:0:27882:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d956bdab40 going to sleep for 11 seconds 00000100:00100000:1.0:1777051437.569849:0:46498:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452645504 00000100:00100000:1.0:1777051437.569858:0:46498:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452645504 00000100:00100000:1.0:1777051437.569911:0:46498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8201 00000100:00100000:1.0:1777051437.569925:0:46498:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f298700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+8:27882:x1863365452645504:12345-0@lo:1000:mdt00_006.0 00000100:00100000:1.0:1777051437.570058:0:46498:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f298700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+8:27882:x1863365452645504:12345-0@lo:1000:mdt00_006.0 Request processed in 126us (335us total) trans 0 rc -2/-2 00000100:00100000:1.0:1777051437.570070:0:46498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8201 00000100:00100000:3.0:1777051437.570128:0:27882:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f29ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-mdtlov_UUID:27882:1863365452645504:0@lo:1000:mdt00_006.0 00000004:00080000:3.0:1777051437.570159:0:27882:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x2000032e0:0x1:0x0] 00010000:00010000:3.0:1777051437.570170:0:27882:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d94d72ec00/0x85f51a6b9671683c lrc: 4/0,1 mode: CW/CW res: [0x2000032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x85f51a6b96716843 expref: -99 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051437.570211:0:27882:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d94d72ec00/0x85f51a6b9671683c lrc: 4/0,1 mode: CW/CW res: [0x2000032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x85f51a6b96716843 expref: -99 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051437.570227:0:27882:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d94d72ec00/0x85f51a6b9671683c lrc: 3/0,0 mode: CW/CW res: [0x2000032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x85f51a6b96716843 expref: -99 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051437.570270:0:27882:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:3.0:1777051437.570280:0:27882:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x2000032e0:0x1:0x0] 00010000:00010000:3.0:1777051437.570287:0:27882:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d954ea4400/0x85f51a6b9671684a lrc: 4/0,1 mode: PW/PW res: [0x2000032e0:0x1:0x0].0xa677fe89 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x85f51a6b96716851 expref: -99 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051437.570303:0:27882:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d954ea4400/0x85f51a6b9671684a lrc: 4/0,1 mode: PW/PW res: [0x2000032e0:0x1:0x0].0xa677fe89 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x85f51a6b96716851 expref: -99 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051437.570317:0:27882:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d954ea4400/0x85f51a6b9671684a lrc: 3/0,0 mode: PW/PW res: [0x2000032e0:0x1:0x0].0xa677fe89 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x85f51a6b96716851 expref: -99 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051437.570338:0:6567:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1777051437.570358:0:27882:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1777051437.570368:0:6567:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d94d72ec00/0x85f51a6b9671683c lrc: 2/0,0 mode: CW/CW res: [0x2000032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x85f51a6b96716843 expref: -99 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051437.570389:0:6567:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94d72ec00 already unused, calling callback (ffffffffc177eed0) 00010000:00010000:1.0:1777051437.570400:0:6567:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d94d72ec00/0x85f51a6b9671683c lrc: 3/0,0 mode: CW/CW res: [0x2000032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x85f51a6b96716843 expref: -99 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1777051437.570417:0:6567:0:(mdt_handler.c:3963:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d94d72ec00/0x85f51a6b9671683c lrc: 3/0,0 mode: CW/CW res: [0x2000032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x85f51a6b96716843 expref: -99 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051437.570465:0:6567:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d94d72ec00/0x85f51a6b9671683c lrc: 2/0,0 mode: --/CW res: [0x2000032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x85f51a6b96716843 expref: -99 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051437.570477:0:27882:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95a581f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+10:138105:x1863365426008832:12345-192.168.201.46@tcp:36:lhsmtool_posix.0 Request processed in 17481us (17772us total) trans 0 rc -2/-2 00000100:00100000:3.0:1777051437.570509:0:27882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112141 00010000:00010000:1.0:1777051437.570516:0:6567:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1777051437.570564:0:6567:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d94d72ec00/0x85f51a6b9671683c lrc: 1/0,0 mode: --/CW res: [0x2000032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x85f51a6b96716843 expref: -99 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051437.570581:0:6567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d94d72ec00/0x85f51a6b9671683c lrc: 0/0,0 mode: --/CW res: [0x2000032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x85f51a6b96716843 expref: -99 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051437.570591:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da45f77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3680:1863365452645632:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1777051437.570619:0:6567:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777051437.570627:0:6567:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d954ea4400/0x85f51a6b9671684a lrc: 2/0,0 mode: PW/PW res: [0x2000032e0:0x1:0x0].0xa677fe89 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x85f51a6b96716851 expref: -99 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051437.570641:0:6567:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d954ea4400 already unused, calling callback (ffffffffc177eed0) 00010000:00010000:1.0:1777051437.570650:0:6567:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d954ea4400/0x85f51a6b9671684a lrc: 3/0,0 mode: PW/PW res: [0x2000032e0:0x1:0x0].0xa677fe89 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x85f51a6b96716851 expref: -99 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051437.570657:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00010000:1.0:1777051437.570675:0:6567:0:(mdt_handler.c:3963:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d954ea4400/0x85f51a6b9671684a lrc: 3/0,0 mode: PW/PW res: [0x2000032e0:0x1:0x0].0xa677fe89 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x85f51a6b96716851 expref: -99 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051437.570687:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051437.570714:0:6567:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d954ea4400/0x85f51a6b9671684a lrc: 2/0,0 mode: --/PW res: [0x2000032e0:0x1:0x0].0xa677fe89 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x85f51a6b96716851 expref: -99 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051437.570724:0:6567:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1777051437.571067:0:6567:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d954ea4400/0x85f51a6b9671684a lrc: 1/0,0 mode: --/PW res: [0x2000032e0:0x1:0x0].0xa677fe89 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x85f51a6b96716851 expref: -99 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051437.571083:0:6567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d954ea4400/0x85f51a6b9671684a lrc: 0/0,0 mode: --/PW res: [0x2000032e0:0x1:0x0].0xa677fe89 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x85f51a6b96716851 expref: -99 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051437.571112:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da45f75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452645760:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1777051437.571156:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051437.571170:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051437.571177:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777051437.571181:0:6566:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452645632 00000100:00100000:2.0:1777051437.571191:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051437.571195:0:6566:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452645632 00000100:00100000:1.0:1777051437.571301:0:24467:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452645760 00000100:00100000:1.0:1777051437.571313:0:24467:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452645760 00000100:00100000:0.0:1777051437.571368:0:6566:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13698 00000100:00100000:1.0:1777051437.571390:0:24467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13699 00000100:00100000:0.0:1777051437.571395:0:6566:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5fbec000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+9:3680:x1863365452645632:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1777051437.571417:0:24467:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f298000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+9:3677:x1863365452645760:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1777051437.571424:0:6566:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1777051437.571439:0:24467:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777051437.571457:0:6566:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d954ea5e00/0x85f51a6b96716843 lrc: 0/0,0 mode: --/CW res: [0x2000032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x85f51a6b9671683c expref: 9 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051437.571470:0:24467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94d72f200/0x85f51a6b96716851 lrc: 0/0,0 mode: --/PW res: [0x2000032e0:0x1:0x0].0xa677fe89 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x85f51a6b9671684a expref: 9 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051437.571490:0:6566:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e0:0x1:0x0].0x0 (ffff99d943f76200) 00010000:00010000:1.0:1777051437.571501:0:24467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e0:0x1:0x0].0xa677fe89 (ffff99d94e5e2400) 00010000:00010000:0.0:1777051437.571511:0:6566:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1777051437.571524:0:24467:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1777051437.571595:0:6566:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5fbec000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+7:3680:x1863365452645632:12345-0@lo:103:ldlm_bl.0 Request processed in 209us (939us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051437.571611:0:24467:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f298000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+7:3677:x1863365452645760:12345-0@lo:103:ldlm_bl.0 Request processed in 203us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051437.571612:0:6566:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13698 00000100:00100000:1.0:1777051437.571634:0:24467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13699 00000100:00100000:2.0:1777051437.571695:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da45f75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452645760:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1777051437.573442:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da45f77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3680:1863365452645632:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1777051437.577264:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051437.577373:0:46494:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426009088 00000100:00100000:1.0:1777051437.577383:0:46494:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426009088 00000100:00100000:0.0:1777051437.577886:0:21368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112142 00000100:00100000:0.0:1777051437.577910:0:21368:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f299f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+10:138105:x1863365426009088:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1777051437.577936:0:21368:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051437.577996:0:21368:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61a200/0x85f51a6b96716858 lrc: 2/0,0 mode: --/PR res: [0x240000bd2:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b65e0 expref: -99 pid: 21368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051437.578054:0:21368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61ac00/0x85f51a6b9671685f lrc: 3/1,0 mode: --/PR res: [0x240000bd2:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051437.578076:0:21368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61ac00/0x85f51a6b9671685f lrc: 3/1,0 mode: PR/PR res: [0x240000bd2:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21368 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051437.578449:0:21368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61ac00/0x85f51a6b9671685f lrc: 3/1,0 mode: PR/PR res: [0x240000bd2:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21368 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051437.578633:0:21368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61a200/0x85f51a6b96716858 lrc: 0/0,0 mode: --/PR res: [0x240000bd2:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b65e0 expref: 12 pid: 21368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051437.578674:0:21368:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61ac00/0x85f51a6b9671685f lrc: 3/0,0 mode: PR/PR res: [0x240000bd2:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b65e0 expref: 11 pid: 21368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051437.578691:0:21368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x4:0x0].0x0 (ffff99da5fb45500) 00010000:00010000:0.0:1777051437.578696:0:21368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1777051437.578703:0:21368:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d94e61ac00, rc 0) 00000100:00100000:0.0:1777051437.578834:0:21368:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f299f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+11:138105:x1863365426009088:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 Request processed in 931us (1576us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051437.578849:0:21368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112142 00000100:00100000:2.0:1777051437.585592:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051437.586142:0:6579:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426009344 00000100:00100000:0.0:1777051437.586156:0:6579:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426009344 00000100:00100000:0.0:1777051437.586300:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112143 00000100:00100000:0.0:1777051437.586318:0:6579:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f298e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+11:138105:x1863365426009344:12345-192.168.201.46@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1777051437.586416:0:6579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61a200/0x85f51a6b96716866 lrc: 3/0,1 mode: --/PW res: [0x240000bd2:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051437.586454:0:6579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61a200/0x85f51a6b96716866 lrc: 3/0,1 mode: PW/PW res: [0x240000bd2:0x4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051437.586473:0:6579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61a200/0x85f51a6b96716866 lrc: 3/0,1 mode: PW/PW res: [0x240000bd2:0x4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1777051437.586689:0:6579:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000067dd5916 reply state 00000000c0b0234c transno 8589934671 ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61a200/0x85f51a6b96716866 lrc: 3/0,1 mode: PW/PW res: [0x240000bd2:0x4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051437.586711:0:6579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61a200/0x85f51a6b96716866 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd2:0x4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051437.586725:0:6579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x4:0x0].0x0 (ffff99da5fb45500) 00010000:00010000:0.0:1777051437.586732:0:6579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1777051437.586738:0:6579:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1777051437.586918:0:6579:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f298e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+13:138105:x1863365426009344:12345-192.168.201.46@tcp:36:lhsmtool_posix.0 Request processed in 602us (1332us total) trans 8589934671 rc 0/0 00000100:00100000:0.0:1777051437.586939:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112143 00000100:00100000:2.0:1777051437.594334:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051437.594426:0:6581:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426009472 00000100:00100000:0.0:1777051437.594438:0:6581:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426009472 00000100:00100000:0.0:1777051437.594522:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112144 00000100:00100000:0.0:1777051437.594540:0:6581:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f29b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+13:138105:x1863365426009472:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1777051437.594574:0:6581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051437.594604:0:6581:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61b600/0x85f51a6b9671686d lrc: 2/0,0 mode: --/CR res: [0x240000bd2:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b65e7 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051437.594676:0:6581:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61b600/0x85f51a6b9671686d lrc: 3/0,0 mode: CR/CR res: [0x240000bd2:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b65e7 expref: 14 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051437.594699:0:6581:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61b600/0x85f51a6b9671686d lrc: 3/0,0 mode: CR/CR res: [0x240000bd2:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b65e7 expref: 14 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051437.594716:0:6581:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x4:0x0].0x0 (ffff99da5fb45500) 00010000:00010000:0.0:1777051437.594722:0:6581:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1777051437.594728:0:6581:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d94e61b600, rc 0) 00000100:00100000:0.0:1777051437.595271:0:6581:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f29b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+14:138105:x1863365426009472:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 Request processed in 732us (945us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051437.595285:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112144 00000100:00100000:2.0:1777051437.601693:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051437.601871:0:6583:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426009600 00000100:00100000:3.0:1777051437.601883:0:6583:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426009600 00000100:00100000:3.0:1777051437.601959:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3374 00000100:00100000:3.0:1777051437.601977:0:6583:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f299180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+14:138105:x1863365426009600:12345-192.168.201.46@tcp:49:lhsmtool_posix.0 00000100:00100000:3.0:1777051437.602149:0:6583:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f299180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+14:138105:x1863365426009600:12345-192.168.201.46@tcp:49:lhsmtool_posix.0 Request processed in 176us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051437.602158:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3374 00000100:00100000:2.0:1777051437.608096:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051437.608275:0:46501:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426009856 00000100:00100000:1.0:1777051437.608288:0:46501:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426009856 00000100:00100000:1.0:1777051437.608457:0:46501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3375 00000100:00100000:1.0:1777051437.608475:0:46501:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da6ff03850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+14:138105:x1863365426009856:12345-192.168.201.46@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1777051437.609087:0:46501:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da6ff03850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+15:138105:x1863365426009856:12345-192.168.201.46@tcp:35:lhsmtool_posix.0 Request processed in 613us (994us total) trans 8589934672 rc 0/0 00000100:00100000:1.0:1777051437.609102:0:46501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3375 00000100:00100000:2.0:1777051437.617345:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051437.617847:0:46497:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426010112 00000100:00100000:1.0:1777051437.617861:0:46497:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426010112 00000100:00100000:1.0:1777051437.617946:0:46497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112145 00000100:00100000:1.0:1777051437.617962:0:46497:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f298a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:c11b6966-0775-44d2-bdc6-c74c26eb2226+15:138105:x1863365426010112:12345-192.168.201.46@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1777051437.618111:0:46497:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f298a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:c11b6966-0775-44d2-bdc6-c74c26eb2226+15:138105:x1863365426010112:12345-192.168.201.46@tcp:57:lhsmtool_posix.0 Request processed in 150us (776us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051437.618125:0:46497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112145 00000100:00100000:2.0:1777051437.622079:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051437.622271:0:10328:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426010368 00000100:00100000:1.0:1777051437.622280:0:10328:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426010368 00000100:00100000:1.0:1777051437.622343:0:10328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112146 00000100:00100000:1.0:1777051437.622357:0:10328:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f299180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+15:138105:x1863365426010368:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1777051437.622380:0:10328:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777051437.622423:0:10328:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72f200/0x85f51a6b96716874 lrc: 2/0,0 mode: --/CR res: [0x240000bd2:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b65ee expref: -99 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051437.623061:0:10328:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72ec00/0x85f51a6b9671687b lrc: 3/0,1 mode: --/EX res: [0x240000bd2:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051437.623088:0:10328:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61b600/0x85f51a6b9671686d lrc: 2/0,0 mode: CR/CR res: [0x240000bd2:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b65e7 expref: 16 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051437.623103:0:10328:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72ec00/0x85f51a6b9671687b lrc: 4/0,1 mode: --/EX res: [0x240000bd2:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10328 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051437.623150:0:10328:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61b600/0x85f51a6b9671686d lrc: 3/0,0 mode: CR/CR res: [0x240000bd2:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b65e7 expref: 16 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051437.623574:0:10328:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61b600/0x85f51a6b9671686d lrc: 4/0,0 mode: CR/CR res: [0x240000bd2:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b65e7 expref: 16 pid: 6581 timeout: 8166 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051437.623663:0:10328:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da45f77480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:10328:1863365452645888:192.168.201.46@tcp:104: 00000100:00100000:1.0:1777051437.623767:0:10328:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d941082480 going to sleep for 11 seconds 00000100:00100000:2.0:1777051437.631099:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051437.631304:0:47597:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426010496 00000100:00100000:3.0:1777051437.631315:0:47597:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426010496 00010000:00010000:3.0:1777051437.631359:0:47597:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61b600/0x85f51a6b9671686d lrc: 5/0,0 mode: CR/CR res: [0x240000bd2:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b65e7 expref: 17 pid: 6581 timeout: 8166 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051437.631411:0:47597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3904 00000100:00100000:3.0:1777051437.631424:0:47597:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f29ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+17:2437:x1863365426010496:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1777051437.631444:0:47597:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777051437.631455:0:47597:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61b600/0x85f51a6b9671686d lrc: 5/0,0 mode: CR/CR res: [0x240000bd2:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b65e7 expref: 17 pid: 6581 timeout: 8166 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051437.631476:0:47597:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61b600/0x85f51a6b9671686d lrc: 4/0,0 mode: CR/CR res: [0x240000bd2:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b65e7 expref: 17 pid: 6581 timeout: 8166 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051437.631507:0:47597:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x4:0x0].0x0 (ffff99da5fb45500) 00010000:00010000:3.0:1777051437.631516:0:47597:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72ec00/0x85f51a6b9671687b lrc: 3/0,1 mode: --/EX res: [0x240000bd2:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10328 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051437.631537:0:47597:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72ec00/0x85f51a6b9671687b lrc: 3/0,1 mode: EX/EX res: [0x240000bd2:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 10328 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051437.631549:0:47597:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72ec00/0x85f51a6b9671687b lrc: 4/0,1 mode: EX/EX res: [0x240000bd2:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 10328 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051437.631573:0:47597:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1777051437.631634:0:47597:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f29ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+17:2437:x1863365426010496:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 212us (545us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051437.631646:0:47597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3904 00010000:00010000:1.0:1777051437.633441:0:10328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61b600/0x85f51a6b9671686d lrc: 0/0,0 mode: --/CR res: [0x240000bd2:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b65e7 expref: 16 pid: 6581 timeout: 8166 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051437.633469:0:10328:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da45f77480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:10328:1863365452645888:192.168.201.46@tcp:104: 00010000:00010000:1.0:1777051437.633500:0:10328:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72ec00/0x85f51a6b9671687b lrc: 3/0,1 mode: EX/EX res: [0x240000bd2:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10328 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051437.633515:0:10328:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72ec00/0x85f51a6b9671687b lrc: 3/0,1 mode: EX/EX res: [0x240000bd2:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10328 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051437.633524:0:10328:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72ec00/0x85f51a6b9671687b lrc: 3/0,1 mode: EX/EX res: [0x240000bd2:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10328 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1777051437.633550:0:10328:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000bd2:0x4:0x0]: returning size 0 00000004:00080000:1.0:1777051437.633775:0:10328:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x104:0x0], index 1: 0 00010000:00010000:0.0:1777051437.634602:0:10328:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72ec00/0x85f51a6b9671687b lrc: 3/0,1 mode: EX/EX res: [0x240000bd2:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10328 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051437.634616:0:10328:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72ec00/0x85f51a6b9671687b lrc: 2/0,0 mode: EX/EX res: [0x240000bd2:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10328 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051437.634626:0:10328:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72ec00/0x85f51a6b9671687b lrc: 3/0,0 mode: EX/EX res: [0x240000bd2:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10328 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051437.634636:0:10328:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94d72ec00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:0.0:1777051437.634642:0:10328:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72ec00/0x85f51a6b9671687b lrc: 3/0,0 mode: EX/EX res: [0x240000bd2:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10328 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051437.635160:0:10328:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72ec00/0x85f51a6b9671687b lrc: 4/0,0 mode: EX/EX res: [0x240000bd2:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10328 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051437.635180:0:10328:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x4:0x0].0x0 (ffff99da5fb45500) 00010000:00010000:0.0:1777051437.635185:0:10328:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1777051437.635192:0:10328:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72ec00/0x85f51a6b9671687b lrc: 2/0,0 mode: --/EX res: [0x240000bd2:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10328 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051437.635202:0:10328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72ec00/0x85f51a6b9671687b lrc: 0/0,0 mode: --/EX res: [0x240000bd2:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10328 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051437.635267:0:10328:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72f200/0x85f51a6b96716874 lrc: 1/0,0 mode: --/CR res: [0x240000bd2:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b65ee expref: 16 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051437.635283:0:10328:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x4:0x0].0x0 (ffff99da5fb45500) 00010000:00010000:0.0:1777051437.635287:0:10328:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1777051437.635293:0:10328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72f200/0x85f51a6b96716874 lrc: 0/0,0 mode: --/CR res: [0x240000bd2:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b65ee expref: 16 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051437.635307:0:10328:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d94d72f200, rc 0) 00000100:00100000:0.0:1777051437.635381:0:10328:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f299180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+15:138105:x1863365426010368:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 Request processed in 13025us (13309us total) trans 8589934673 rc 301/301 00000100:00100000:0.0:1777051437.635398:0:10328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112146 00000100:00100000:2.0:1777051437.640360:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051437.640686:0:24269:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426010752 00000100:00100000:1.0:1777051437.640698:0:24269:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426010752 00000100:00100000:1.0:1777051437.640786:0:24269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3376 00000100:00100000:1.0:1777051437.640837:0:24269:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f299c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+15:138105:x1863365426010752:12345-192.168.201.46@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1777051437.641985:0:24269:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f299c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+16:138105:x1863365426010752:12345-192.168.201.46@tcp:35:lhsmtool_posix.0 Request processed in 1185us (1631us total) trans 8589934674 rc 0/0 00000100:00100000:1.0:1777051437.641999:0:24269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3376 00000100:00100000:2.0:1777051437.646682:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051437.647095:0:46494:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426010880 00000100:00100000:1.0:1777051437.647105:0:46494:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426010880 00000100:00100000:1.0:1777051437.647285:0:46494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112147 00000100:00100000:1.0:1777051437.647303:0:46494:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f299880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c11b6966-0775-44d2-bdc6-c74c26eb2226+16:138105:x1863365426010880:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1777051437.647489:0:46494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051437.647519:0:46494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d954ea5400/0x85f51a6b96716889 lrc: 2/0,0 mode: --/CR res: [0x240000bd2:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b65f5 expref: -99 pid: 46494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051437.647598:0:46494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d954ea4000/0x85f51a6b96716890 lrc: 3/1,0 mode: --/PR res: [0x240000bd2:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051437.647620:0:46494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d954ea4000/0x85f51a6b96716890 lrc: 3/1,0 mode: PR/PR res: [0x240000bd2:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 46494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051437.647638:0:46494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d954ea4000/0x85f51a6b96716890 lrc: 3/1,0 mode: PR/PR res: [0x240000bd2:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 46494 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1777051437.647690:0:46494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000bd2:0x4:0x0]: returning size 0 00000004:00200000:2.0:1777051437.647697:0:46494:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1777051437.647719:0:46494:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff99d954ea4000/0x85f51a6b96716890 lrc: 3/1,0 mode: PR/PR res: [0x240000bd2:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 46494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051437.647754:0:46494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d954ea5400/0x85f51a6b96716889 lrc: 0/0,0 mode: --/CR res: [0x240000bd2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b65f5 expref: 18 pid: 46494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051437.647778:0:46494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99d954ea4000/0x85f51a6b96716890 lrc: 3/0,0 mode: PR/PR res: [0x240000bd2:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b65f5 expref: 17 pid: 46494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051437.647821:0:46494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x4:0x0].0x0 (ffff99da5fb45500) 00010000:00010000:2.0:1777051437.647827:0:46494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1777051437.647832:0:46494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d954ea4000, rc 0) 00000100:00100000:2.0:1777051437.647899:0:46494:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f299880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c11b6966-0775-44d2-bdc6-c74c26eb2226+17:138105:x1863365426010880:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 Request processed in 600us (1219us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051437.647912:0:46494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112147 00000100:00100000:2.0:1777051437.650678:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051437.651535:0:55805:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426011008 00000100:00100000:1.0:1777051437.651546:0:55805:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426011008 00000100:00100000:1.0:1777051437.651616:0:55805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 8035 00000100:00100000:1.0:1777051437.651635:0:55805:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95fae9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c11b6966-0775-44d2-bdc6-c74c26eb2226+50:2436:x1863365426011008:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1777051437.651655:0:55805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777051437.651701:0:55805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000050ec90a4/0x85f51a6b96716897 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x104:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b65fc expref: -99 pid: 55805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1777051437.651738:0:55805:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x104:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777051437.651762:0:55805:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051437.652083:0:55805:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051437.652095:0:55805:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000050ec90a4/0x85f51a6b96716897 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x104:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b65fc expref: 51 pid: 55805 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051437.652125:0:55805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000050ec90a4/0x85f51a6b96716897 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x104:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b65fc expref: 51 pid: 55805 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051437.652147:0:55805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d94d72ee00, rc 0) 00000100:00100000:1.0:1777051437.652263:0:55805:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95fae9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c11b6966-0775-44d2-bdc6-c74c26eb2226+51:2436:x1863365426011008:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 Request processed in 633us (1590us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051437.652276:0:55805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 8035 00000100:00100000:0.0:1777051437.655771:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051437.655881:0:8492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426011264 00000100:00100000:3.0:1777051437.655893:0:8492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426011264 00000100:00100000:3.0:1777051437.655966:0:8492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112148 00000100:00100000:3.0:1777051437.655981:0:8492:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7e24dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+17:138105:x1863365426011264:12345-192.168.201.46@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1777051437.656130:0:8492:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7e24dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+17:138105:x1863365426011264:12345-192.168.201.46@tcp:57:lhsmtool_posix.0 Request processed in 150us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051437.656149:0:8492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112148 00000100:00100000:2.0:1777051437.665581:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051437.666077:0:27887:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426011392 00000100:00100000:0.0:1777051437.666091:0:27887:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426011392 00000100:00100000:0.0:1777051437.666437:0:27887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 8036 00000100:00100000:0.0:1777051437.666456:0:27887:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95fae9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c11b6966-0775-44d2-bdc6-c74c26eb2226+51:138105:x1863365426011392:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1777051437.666504:0:27887:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051437.666533:0:27887:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000059b7ad31/0x85f51a6b9671689e lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x104:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6603 expref: -99 pid: 27887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051437.666582:0:27887:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000050ec90a4/0x85f51a6b96716897 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x104:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b65fc expref: 52 pid: 55805 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051437.666597:0:27887:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777051437.666600:0:27887:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777051437.666607:0:27887:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000059b7ad31/0x85f51a6b9671689e lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0x104:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6603 expref: 52 pid: 27887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051437.666653:0:27887:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000050ec90a4/0x85f51a6b96716897 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x104:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b65fc expref: 52 pid: 55805 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051437.666676:0:27887:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000050ec90a4/0x85f51a6b96716897 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x104:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b65fc expref: 52 pid: 55805 timeout: 8166 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051437.667076:0:27887:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7e24e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:27887:1863365452646016:192.168.201.46@tcp:104: 00000100:00100000:0.0:1777051437.667486:0:27887:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d95c67b180 going to sleep for 11 seconds 00000100:00100000:2.0:1777051437.672046:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051437.672264:0:27887:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7e24e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:27887:1863365452646016:192.168.201.46@tcp:104: 00010000:00010000:0.0:1777051437.672303:0:27887:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000059b7ad31/0x85f51a6b9671689e lrc: 3/0,0 mode: --/PW res: [0x2c0000400:0x104:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6603 expref: 52 pid: 27887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051437.672334:0:27887:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d94e61ba00, rc 0) 00000100:00100000:0.0:1777051437.672407:0:27887:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95fae9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c11b6966-0775-44d2-bdc6-c74c26eb2226+52:138105:x1863365426011392:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 Request processed in 5956us (7386us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051437.672432:0:27887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 8036 00000100:00100000:1.0:1777051437.672478:0:6565:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426011520 00000100:00100000:1.0:1777051437.672487:0:6565:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426011520 00010000:00010000:1.0:1777051437.672604:0:6565:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000050ec90a4/0x85f51a6b96716897 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x104:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b65fc expref: 52 pid: 55805 timeout: 8166 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051437.672649:0:6565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3905 00000100:00100000:1.0:1777051437.672660:0:6565:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95fae8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+52:2437:x1863365426011520:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1777051437.672677:0:6565:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1777051437.672700:0:6565:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000050ec90a4/0x85f51a6b96716897 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x104:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b65fc expref: 52 pid: 55805 timeout: 8166 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051437.672723:0:6565:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000050ec90a4/0x85f51a6b96716897 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x104:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b65fc expref: 52 pid: 55805 timeout: 8166 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051437.672756:0:6565:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000050ec90a4/0x85f51a6b96716897 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x104:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b65fc expref: 52 pid: 55805 timeout: 8166 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051437.672776:0:6565:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051437.672779:0:6565:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051437.672789:0:6565:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000059b7ad31/0x85f51a6b9671689e lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x104:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6603 expref: 51 pid: 27887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051437.672831:0:6565:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000059b7ad31/0x85f51a6b9671689e lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x104:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6603 expref: 51 pid: 27887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051437.672875:0:6565:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000059b7ad31/0x85f51a6b9671689e lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x104:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6603 expref: 51 pid: 27887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051437.672904:0:6565:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da45f77480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6565:1863365452646144:192.168.201.46@tcp:105: 00000100:00100000:1.0:1777051437.672990:0:6565:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d9410826c0 going to sleep for 11 seconds 00000100:00100000:1.0:1777051437.677186:0:6565:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da45f77480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6565:1863365452646144:192.168.201.46@tcp:105: 00010000:00010000:1.0:1777051437.677214:0:6565:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1777051437.677280:0:6565:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95fae8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+51:2437:x1863365426011520:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 4619us (5530us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051437.677297:0:6565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3905 00000100:00100000:2.0:1777051437.721087:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051437.721243:0:20161:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426011648 00000100:00100000:1.0:1777051437.721258:0:20161:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426011648 00002000:00100000:2.0:1777051437.721410:0:20161:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000400:0x104:0x0] (0->1048575) req@ffff99d95fae8000 x1863365426011648/t0(0) o4->c11b6966-0775-44d2-bdc6-c74c26eb2226@192.168.201.46@tcp:398/0 lens 488/0 e 0 to 0 dl 1777051448 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1777051437.721428:0:20161:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99d95fae8000 with x1863365426011648 ext(0->1048575) 00002000:00010000:2.0:1777051437.721436:0:20161:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99d95fae8000 00000100:00100000:2.0:1777051437.721486:0:20161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 1772 00000100:00100000:2.0:1777051437.721501:0:20161:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95fae8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+51:2436:x1863365426011648:12345-192.168.201.46@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1777051437.747916:0:20161:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95fae8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+53:2436:x1863365426011648:12345-192.168.201.46@tcp:4:lhsmtool_posix.0 Request processed in 26407us (27124us total) trans 4294968361 rc 0/0 00000100:00100000:3.0:1777051437.747940:0:20161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 1772 00002000:00100000:3.0:1777051437.747957:0:20161:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000400:0x104:0x0] (0->1048575) req@ffff99d95fae8000 x1863365426011648/t4294968361(0) o4->c11b6966-0775-44d2-bdc6-c74c26eb2226@192.168.201.46@tcp:398/0 lens 488/448 e 0 to 0 dl 1777051448 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1777051437.747973:0:20161:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99d95fae8000 with x1863365426011648 ext(0->1048575) 00002000:00010000:3.0:1777051437.747981:0:20161:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99d95fae8000 00000001:00080000:1.0:1777051437.749520:0:9540:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0001: transno 4294968361 is committed 00000001:00080000:1.0:1777051437.749539:0:9540:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0001: transno 4294968360 is committed 00000001:00080000:1.0:1777051437.749549:0:9540:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0001: transno 4294968359 is committed 00000100:00100000:2.0:1777051437.750651:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051437.750746:0:27885:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426011776 00000100:00100000:3.0:1777051437.750756:0:27885:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426011776 00000100:00100000:3.0:1777051437.750852:0:27885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112149 00000100:00100000:3.0:1777051437.750867:0:27885:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95faead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c11b6966-0775-44d2-bdc6-c74c26eb2226+17:138105:x1863365426011776:12345-192.168.201.46@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1777051437.753304:0:104205:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934674 is committed 00000001:00080000:1.0:1777051437.753331:0:104205:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934668 is committed 00000020:00080000:1.0:1777051437.753345:0:104205:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff99d9597676c0 refcount 2 committed 0 result 0 batchid 4294970580 00000020:00080000:1.0:1777051437.753352:0:104205:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff99da5fa92000 obd lustre-OST0000-osc-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff99d9597673c0 00000020:00080000:1.0:1777051437.753358:0:104205:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff99da5fa92500 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff99da71c4c400 00010000:00010000:2.0:1777051437.753381:0:3664:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61a200/0x85f51a6b96716866 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd2:0x4:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051437.753398:0:3664:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61a200/0x85f51a6b96716866 lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd2:0x4:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6579 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1777051437.753405:0:104205:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 4 committed 00010000:00010000:2.0:1777051437.753409:0:3664:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61a200/0x85f51a6b96716866 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd2:0x4:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6579 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051437.753426:0:3664:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94e61a200 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:2.0:1777051437.753432:0:3664:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61a200/0x85f51a6b96716866 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd2:0x4:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6579 initiator: MDT1 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1777051437.753443:0:104205:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff99d9597679c0 refcount 2 committed 0 result 0 batchid 4294970579 00010000:00010000:2.0:1777051437.753444:0:3664:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61a200/0x85f51a6b96716866 lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd2:0x4:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6579 initiator: MDT1 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1777051437.753448:0:104230:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 4294970577 00000020:00080000:1.0:1777051437.753457:0:104205:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff99da5fa92200 obd lustre-OST0001-osc-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff99d959767f00 00000020:00080000:1.0:1777051437.753472:0:104205:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff99da5fa92600 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff99da5fac7200 00010000:00010000:2.0:1777051437.753483:0:3664:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x4:0x0].0x0 (ffff99da5fb45500) 00010000:00010000:2.0:1777051437.753490:0:3664:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1777051437.753498:0:3664:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61a200/0x85f51a6b96716866 lrc: 2/0,0 mode: --/TXN res: [0x240000bd2:0x4:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6579 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051437.753509:0:3664:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61a200/0x85f51a6b96716866 lrc: 0/0,0 mode: --/TXN res: [0x240000bd2:0x4:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6579 initiator: MDT1 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1777051437.753516:0:104230:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 4294970577 00000004:00080000:1.0:1777051437.753517:0:104205:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3 committed 00000020:00080000:1.0:1777051437.753549:0:104205:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff99d95cf51e40 refcount 2 committed 0 result 0 batchid 4294970578 00000020:00080000:1.0:1777051437.753576:0:104205:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff99da43971c00 obd lustre-OST0000-osc-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff99d95cf51240 00000020:00080000:1.0:1777051437.753583:0:104205:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff99da452c5100 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff99d942d88c00 00000100:00100000:2.0:1777051437.753647:0:3677:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000020:00080000:3.0:1777051437.753662:0:104230:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 4294970580 committed batchid 4294970577 00000100:00100000:0.0:1777051437.753665:0:3680:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1777051437.753673:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7e24e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452646272:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1777051437.754041:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:3.0:1777051437.754378:0:104230:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 4294970577 00000100:00100000:2.0:1777051437.754381:0:8628:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452646272 00000100:00100000:2.0:1777051437.754391:0:8628:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452646272 00000100:00100000:0.0:1777051437.754421:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5fbed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3680:1863365452646400:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1777051437.754445:0:8628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8037 00000100:00100000:2.0:1777051437.754462:0:8628:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95fae9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3677:x1863365452646272:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1777051437.754487:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00080000:2.0:1777051437.754491:0:8628:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:259 count 1 00000100:00100000:3.0:1777051437.754519:0:27885:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95faead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c11b6966-0775-44d2-bdc6-c74c26eb2226+10:138105:x1863365426011776:12345-192.168.201.46@tcp:44:lhsmtool_posix.0 Request processed in 3652us (3868us total) trans 0 rc 0/0 00002000:00010000:2.0:1777051437.754530:0:8628:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x103:0x0] initial LVB size: 1048576, mtime: 0x69eba726, atime: 0x0, ctime: 0x69eba726, blocks: 0x800 00000100:00100000:3.0:1777051437.754539:0:27885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112149 00010000:00010000:2.0:1777051437.754545:0:8628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f7f0d990/0x85f51a6b967168a5 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x103:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051437.754561:0:13320:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452646400 00010000:00010000:2.0:1777051437.754566:0:8628:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1777051437.754572:0:13320:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452646400 00010000:00010000:2.0:1777051437.754572:0:8628:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777051437.754582:0:8628:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f7f0d990/0x85f51a6b967168a5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x103:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051437.754604:0:8628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f7f0d990/0x85f51a6b967168a5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x103:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051437.754618:0:8628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f7f0d990/0x85f51a6b967168a5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x103:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051437.754630:0:8628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f7f0d990/0x85f51a6b967168a5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x103:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051437.754644:0:13320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8038 00000100:00100000:1.0:1777051437.754659:0:13320:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da57c87c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+7:3680:x1863365452646400:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1777051437.754666:0:8628:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:1.0:1777051437.754685:0:13320:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:259 count 1 00010000:00010000:0.0:1777051437.754713:0:38719:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00002000:00010000:1.0:1777051437.754720:0:13320:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x103:0x0] initial LVB size: 1048576, mtime: 0x69eba726, atime: 0x0, ctime: 0x69eba726, blocks: 0x800 00010000:00010000:0.0:1777051437.754724:0:38719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f7f0d990/0x85f51a6b967168a5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x103:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051437.754733:0:13320:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050ec90a4/0x85f51a6b967168ac lrc: 3/0,1 mode: --/PW res: [0x280000400:0x103:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051437.754748:0:38719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d954ea4200 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:0.0:1777051437.754755:0:38719:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f7f0d990/0x85f51a6b967168a5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x103:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051437.754773:0:38719:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f7f0d990/0x85f51a6b967168a5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x103:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051437.754785:0:13320:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051437.754790:0:13320:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051437.754825:0:13320:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000050ec90a4/0x85f51a6b967168ac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x103:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051437.754826:0:38719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f7f0d990/0x85f51a6b967168a5 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x103:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051437.754865:0:13320:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000050ec90a4/0x85f51a6b967168ac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x103:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051437.754871:0:8628:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95fae9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3677:x1863365452646272:12345-0@lo:6:osp-syn-1-1.0 Request processed in 409us (824us total) trans 4294968362 rc 0/0 00010000:00010000:0.0:1777051437.754877:0:38719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f7f0d990/0x85f51a6b967168a5 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x103:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051437.754901:0:8628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8037 00010000:00010000:1.0:1777051437.754910:0:13320:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050ec90a4/0x85f51a6b967168ac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x103:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051437.754924:0:13320:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000050ec90a4/0x85f51a6b967168ac lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x103:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051437.754933:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777051437.754938:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051437.754956:0:13320:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1777051437.755415:0:3677:0:(client.c:3101:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294968360 gen 2 00000100:00100000:1.0:1777051437.755421:0:13320:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da57c87c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+8:3680:x1863365452646400:12345-0@lo:6:osp-syn-0-1.0 Request processed in 763us (934us total) trans 4294968361 rc 0/0 00000004:00080000:3.0:1777051437.755424:0:3677:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 4294968360 committed transno 4294968360 00000100:00100000:1.0:1777051437.755442:0:13320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8038 00000100:00100000:3.0:1777051437.755463:0:3677:0:(client.c:3145:ptlrpc_free_committed()) @@@ stopping search req@ffff99da7e24e300 x1863365452646272/t4294968362(4294968362) o6->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 544/432 e 0 to 0 dl 1777051453 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-1.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1777051437.755480:0:3677:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99da7e24e300/2, rc 0, transno 4294968362 00000100:00100000:3.0:1777051437.755488:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7e24e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452646272:0@lo:6:osp-syn-1-1.0 00010000:00010000:0.0:1777051437.756177:0:38719:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1777051437.756188:0:38719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000050ec90a4/0x85f51a6b967168ac lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x103:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051437.756202:0:38719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94d72ee00 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:0.0:1777051437.756207:0:38719:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000050ec90a4/0x85f51a6b967168ac lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x103:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051437.756230:0:38719:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000050ec90a4/0x85f51a6b967168ac lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x103:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051437.756249:0:38719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000050ec90a4/0x85f51a6b967168ac lrc: 1/0,0 mode: --/PW res: [0x280000400:0x103:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051437.756261:0:38719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000050ec90a4/0x85f51a6b967168ac lrc: 0/0,0 mode: --/PW res: [0x280000400:0x103:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051437.756282:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777051437.756285:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777051437.756288:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1777051437.756319:0:3680:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99da5fbed180/2, rc 0, transno 4294968361 00000100:00100000:0.0:1777051437.756344:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5fbed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3680:1863365452646400:0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1777051437.756503:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1777051437.760006:0:8464:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0000: transno 4294968361 is committed 00000001:00080000:3.0:1777051437.760019:0:8464:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0000: transno 4294968360 is committed 00000001:00080000:3.0:1777051437.760031:0:8464:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0000: transno 4294968357 is committed 00000100:00100000:0.0:1777051437.760669:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051437.761716:0:27884:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426011904 00000100:00100000:2.0:1777051437.761726:0:27884:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426011904 00000100:00100000:2.0:1777051437.761817:0:27884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 8039 00000100:00100000:2.0:1777051437.761832:0:27884:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7e24f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+49:2437:x1863365426011904:12345-192.168.201.46@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1777051437.761972:0:27884:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7e24f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+49:2437:x1863365426011904:12345-192.168.201.46@tcp:16:lhsmtool_posix.0 Request processed in 142us (1307us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051437.761984:0:27884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 8039 00000100:00100000:0.0:1777051437.767363:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051437.767458:0:46497:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426012160 00000100:00100000:1.0:1777051437.767467:0:46497:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426012160 00000100:00100000:1.0:1777051437.767535:0:46497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112150 00000100:00100000:1.0:1777051437.767547:0:46497:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7e24df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:c11b6966-0775-44d2-bdc6-c74c26eb2226+10:138105:x1863365426012160:12345-192.168.201.46@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1777051437.767600:0:46497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1777051437.767631:0:46497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d954ea4000/0x85f51a6b96716890 lrc: 0/0,0 mode: --/PR res: [0x240000bd2:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b65f5 expref: 10 pid: 46494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051437.767652:0:46497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x4:0x0].0x0 (ffff99da5fb45500) 00010000:00010000:1.0:1777051437.767657:0:46497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1777051437.767685:0:46497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72e000/0x85f51a6b967168b3 lrc: 3/0,1 mode: --/PW res: [0x240000bd2:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051437.767699:0:46497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72e000/0x85f51a6b967168b3 lrc: 3/0,1 mode: PW/PW res: [0x240000bd2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051437.767708:0:46497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72e000/0x85f51a6b967168b3 lrc: 3/0,1 mode: PW/PW res: [0x240000bd2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1777051437.768148:0:46497:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000c76014dd reply state 0000000000ac73d1 transno 8589934675 ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72e000/0x85f51a6b967168b3 lrc: 3/0,1 mode: PW/PW res: [0x240000bd2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051437.768166:0:46497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72e000/0x85f51a6b967168b3 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051437.768175:0:46497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x4:0x0].0x0 (ffff99da5fb45500) 00010000:00010000:1.0:1777051437.768179:0:46497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1777051437.768182:0:46497:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1777051437.768350:0:46497:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7e24df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:c11b6966-0775-44d2-bdc6-c74c26eb2226+11:138105:x1863365426012160:12345-192.168.201.46@tcp:36:lhsmtool_posix.0 Request processed in 803us (991us total) trans 8589934675 rc 0/0 00000100:00100000:1.0:1777051437.768361:0:46497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112150 00000100:00100000:0.0:1777051437.771315:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051437.771404:0:27882:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426012288 00000100:00100000:3.0:1777051437.771413:0:27882:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426012288 00000100:00100000:3.0:1777051437.771491:0:27882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112151 00000100:00100000:3.0:1777051437.771505:0:27882:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7e24fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+11:138105:x1863365426012288:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1777051437.771527:0:27882:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777051437.771546:0:27882:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a3000/0x85f51a6b967168ba lrc: 2/0,0 mode: --/CR res: [0x240000bd2:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b660a expref: -99 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051437.771608:0:27882:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a3000/0x85f51a6b967168ba lrc: 3/0,0 mode: CR/CR res: [0x240000bd2:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b660a expref: 12 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051437.771626:0:27882:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a3000/0x85f51a6b967168ba lrc: 3/0,0 mode: CR/CR res: [0x240000bd2:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b660a expref: 12 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051437.771647:0:27882:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x4:0x0].0x0 (ffff99da5fb45500) 00010000:00010000:3.0:1777051437.771652:0:27882:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1777051437.771656:0:27882:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d9559a3000, rc 0) 00000100:00100000:3.0:1777051437.771726:0:27882:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7e24fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+12:138105:x1863365426012288:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 Request processed in 223us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051437.771737:0:27882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112151 00000100:00100000:0.0:1777051437.773723:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051437.773857:0:55805:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426012416 00000100:00100000:1.0:1777051437.773867:0:55805:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426012416 00000100:00100000:1.0:1777051437.773948:0:55805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 8040 00000100:00100000:1.0:1777051437.773962:0:55805:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7e24ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c11b6966-0775-44d2-bdc6-c74c26eb2226+49:2436:x1863365426012416:12345-192.168.201.46@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1777051437.774137:0:55805:0:(ofd_lvb.c:305:ofd_lvbo_update()) res: [0x2c0000400:0x104:0x0] updating lvb size from disk: 0 -> 1048576 00002000:00010000:1.0:1777051437.774143:0:55805:0:(ofd_lvb.c:312:ofd_lvbo_update()) res: [0x2c0000400:0x104:0x0] updating lvb mtime from disk: 0 -> 1777051430 00002000:00010000:1.0:1777051437.774147:0:55805:0:(ofd_lvb.c:318:ofd_lvbo_update()) res: [0x2c0000400:0x104:0x0] updating lvb atime from disk: 0 -> 1777051430 00002000:00010000:1.0:1777051437.774151:0:55805:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x2c0000400:0x104:0x0] updating lvb ctime from disk: 0 -> 1777051430 00002000:00010000:1.0:1777051437.774154:0:55805:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x2c0000400:0x104:0x0] updating lvb blocks from disk: 0 -> 2048 00000100:00100000:1.0:1777051437.774494:0:55805:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7e24ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c11b6966-0775-44d2-bdc6-c74c26eb2226+50:2436:x1863365426012416:12345-192.168.201.46@tcp:2:lhsmtool_posix.0 Request processed in 533us (777us total) trans 4294968363 rc 0/0 00000100:00100000:1.0:1777051437.774506:0:55805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 8040 00000100:00100000:0.0:1777051437.777976:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051437.778561:0:21368:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426012672 00000100:00100000:1.0:1777051437.778570:0:21368:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426012672 00000100:00100000:1.0:1777051437.778634:0:21368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112152 00000100:00100000:1.0:1777051437.778647:0:21368:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7e24ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+12:138105:x1863365426012672:12345-192.168.201.46@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1777051437.778724:0:21368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72e400/0x85f51a6b967168c1 lrc: 3/0,1 mode: --/PW res: [0x240000bd2:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051437.778746:0:21368:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61ac00/0x85f51a6b9671685f lrc: 2/0,0 mode: PR/PR res: [0x240000bd2:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b65e0 expref: 12 pid: 21368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051437.778760:0:21368:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72e400/0x85f51a6b967168c1 lrc: 4/0,1 mode: --/PW res: [0x240000bd2:0x4:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 21368 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051437.778839:0:21368:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61ac00/0x85f51a6b9671685f lrc: 3/0,0 mode: PR/PR res: [0x240000bd2:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b65e0 expref: 12 pid: 21368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051437.778860:0:21368:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61ac00/0x85f51a6b9671685f lrc: 4/0,0 mode: PR/PR res: [0x240000bd2:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b65e0 expref: 12 pid: 21368 timeout: 8166 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051437.778880:0:21368:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da45f77480 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001_UUID:21368:1863365452646528:192.168.201.46@tcp:104: 00000100:00100000:1.0:1777051437.778987:0:21368:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d9410820c0 going to sleep for 11 seconds 00000100:00100000:1.0:1777051437.781743:0:21368:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da45f77480 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001_UUID:21368:1863365452646528:192.168.201.46@tcp:104: 00010000:00010000:1.0:1777051437.781774:0:21368:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72e400/0x85f51a6b967168c1 lrc: 3/0,1 mode: --/PW res: [0x240000bd2:0x4:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 21368 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051437.783062:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051437.783422:0:47827:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426012800 00000100:00100000:3.0:1777051437.783429:0:47827:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426012800 00010000:00010000:3.0:1777051437.783462:0:47827:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61ac00/0x85f51a6b9671685f lrc: 4/0,0 mode: PR/PR res: [0x240000bd2:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b65e0 expref: 13 pid: 21368 timeout: 8166 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051437.783505:0:47827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3906 00000100:00100000:3.0:1777051437.783526:0:47827:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da6fd43450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+13:2436:x1863365426012800:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1777051437.783545:0:47827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777051437.783555:0:47827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61ac00/0x85f51a6b9671685f lrc: 4/0,0 mode: PR/PR res: [0x240000bd2:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b65e0 expref: 13 pid: 21368 timeout: 8166 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051437.783575:0:47827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61ac00/0x85f51a6b9671685f lrc: 3/0,0 mode: PR/PR res: [0x240000bd2:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b65e0 expref: 13 pid: 21368 timeout: 8166 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051437.783611:0:47827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61ac00/0x85f51a6b9671685f lrc: 0/0,0 mode: --/PR res: [0x240000bd2:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b65e0 expref: 13 pid: 21368 timeout: 8166 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051437.783631:0:47827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x4:0x0].0x0 (ffff99da5fb45500) 00010000:00010000:3.0:1777051437.783638:0:47827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72e400/0x85f51a6b967168c1 lrc: 3/0,1 mode: --/PW res: [0x240000bd2:0x4:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 21368 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051437.783652:0:47827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72e400/0x85f51a6b967168c1 lrc: 3/0,1 mode: PW/PW res: [0x240000bd2:0x4:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 21368 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051437.783662:0:47827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72e400/0x85f51a6b967168c1 lrc: 4/0,1 mode: PW/PW res: [0x240000bd2:0x4:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 21368 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051437.783702:0:47827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1777051437.783753:0:21368:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72e400/0x85f51a6b967168c1 lrc: 3/0,1 mode: PW/PW res: [0x240000bd2:0x4:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21368 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051437.783768:0:47827:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da6fd43450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+12:2436:x1863365426012800:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 242us (705us total) trans 0 rc 0/0 00010000:00010000:1.0:1777051437.783773:0:21368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72e400/0x85f51a6b967168c1 lrc: 3/0,1 mode: PW/PW res: [0x240000bd2:0x4:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21368 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051437.783789:0:47827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3906 00010000:00010000:1.0:1777051437.783851:0:21368:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72e400/0x85f51a6b967168c1 lrc: 3/0,1 mode: PW/PW res: [0x240000bd2:0x4:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 21368 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051437.783866:0:21368:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72e400/0x85f51a6b967168c1 lrc: 2/0,0 mode: PW/PW res: [0x240000bd2:0x4:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 21368 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051437.783877:0:21368:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72e400/0x85f51a6b967168c1 lrc: 3/0,0 mode: PW/PW res: [0x240000bd2:0x4:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 21368 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051437.783887:0:21368:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94d72e400 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:1.0:1777051437.783893:0:21368:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72e400/0x85f51a6b967168c1 lrc: 3/0,0 mode: PW/PW res: [0x240000bd2:0x4:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 21368 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051437.783905:0:21368:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72e400/0x85f51a6b967168c1 lrc: 4/0,0 mode: PW/PW res: [0x240000bd2:0x4:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 21368 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051437.783924:0:21368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x4:0x0].0x0 (ffff99da5fb45500) 00010000:00010000:1.0:1777051437.783929:0:21368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1777051437.783935:0:21368:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72e400/0x85f51a6b967168c1 lrc: 2/0,0 mode: --/PW res: [0x240000bd2:0x4:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 21368 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051437.783946:0:21368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72e400/0x85f51a6b967168c1 lrc: 0/0,0 mode: --/PW res: [0x240000bd2:0x4:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 21368 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051437.784015:0:21368:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7e24ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+11:138105:x1863365426012672:12345-192.168.201.46@tcp:55:lhsmtool_posix.0 Request processed in 5369us (6042us total) trans 0 rc -22/-22 00000100:00100000:1.0:1777051437.784029:0:21368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112152 00000100:00100000:0.0:1777051437.791058:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051437.791692:0:27887:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426012928 00000100:00100000:2.0:1777051437.791712:0:27887:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426012928 00000100:00100000:2.0:1777051437.791816:0:27887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 8041 00000100:00100000:2.0:1777051437.791832:0:27887:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7e24f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c11b6966-0775-44d2-bdc6-c74c26eb2226+50:2438:x1863365426012928:12345-192.168.201.46@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1777051437.791883:0:27887:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000ac5690ba/0x85f51a6b967168c8 lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0x104:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 27887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051437.791910:0:27887:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000059b7ad31/0x85f51a6b9671689e lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x104:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6603 expref: 50 pid: 27887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051437.791922:0:27887:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1777051437.791925:0:27887:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1777051437.791929:0:27887:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ac5690ba/0x85f51a6b967168c8 lrc: 4/1,0 mode: --/PR res: [0x2c0000400:0x104:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 27887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051437.791969:0:27887:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000059b7ad31/0x85f51a6b9671689e lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x104:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6603 expref: 50 pid: 27887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051437.791990:0:27887:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000059b7ad31/0x85f51a6b9671689e lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x104:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6603 expref: 50 pid: 27887 timeout: 8166 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051437.792011:0:27887:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95fae9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:27887:1863365452646656:192.168.201.46@tcp:104: 00000100:00100000:2.0:1777051437.792101:0:27887:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d956bda180 going to sleep for 11 seconds 00000100:00100000:2.0:1777051437.794909:0:27887:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95fae9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:27887:1863365452646656:192.168.201.46@tcp:104: 00010000:00010000:2.0:1777051437.794937:0:27887:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ac5690ba/0x85f51a6b967168c8 lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0x104:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 27887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051437.797308:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051437.797414:0:24467:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426013056 00000100:00100000:1.0:1777051437.797424:0:24467:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426013056 00010000:00010000:1.0:1777051437.797467:0:24467:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000059b7ad31/0x85f51a6b9671689e lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x104:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6603 expref: 51 pid: 27887 timeout: 8166 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051437.797531:0:24467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3907 00000100:00100000:1.0:1777051437.797545:0:24467:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da444a3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+51:2437:x1863365426013056:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1777051437.797564:0:24467:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1777051437.797591:0:24467:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000059b7ad31/0x85f51a6b9671689e lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x104:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6603 expref: 51 pid: 27887 timeout: 8166 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051437.797617:0:24467:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000059b7ad31/0x85f51a6b9671689e lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x104:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6603 expref: 51 pid: 27887 timeout: 8166 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051437.797651:0:24467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000059b7ad31/0x85f51a6b9671689e lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x104:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6603 expref: 51 pid: 27887 timeout: 8166 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051437.797675:0:24467:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051437.797679:0:24467:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051437.797686:0:24467:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ac5690ba/0x85f51a6b967168c8 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0x104:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 27887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051437.797701:0:24467:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ac5690ba/0x85f51a6b967168c8 lrc: 4/1,0 mode: PR/PR res: [0x2c0000400:0x104:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 27887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051437.797760:0:24467:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1777051437.797828:0:27887:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ac5690ba/0x85f51a6b967168c8 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0x104:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 27887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051437.797844:0:27887:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ac5690ba/0x85f51a6b967168c8 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0x104:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 27887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051437.797857:0:24467:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da444a3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+50:2437:x1863365426013056:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 312us (550us total) trans 0 rc 0/0 00010000:00010000:2.0:1777051437.797870:0:27887:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000ac5690ba/0x85f51a6b967168c8 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0x104:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 27887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051437.797872:0:24467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3907 00010000:00010000:2.0:1777051437.797886:0:27887:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ac5690ba/0x85f51a6b967168c8 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x104:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 27887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051437.797895:0:27887:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ac5690ba/0x85f51a6b967168c8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x104:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 27887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051437.797902:0:27887:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d954ea5e00 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:2.0:1777051437.797907:0:27887:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac5690ba/0x85f51a6b967168c8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x104:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 27887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051437.797914:0:27887:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac5690ba/0x85f51a6b967168c8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x104:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 27887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051437.797927:0:27887:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ac5690ba/0x85f51a6b967168c8 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x104:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 27887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051437.797935:0:27887:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ac5690ba/0x85f51a6b967168c8 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x104:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 27887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051437.798024:0:27887:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7e24f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c11b6966-0775-44d2-bdc6-c74c26eb2226+49:2438:x1863365426012928:12345-192.168.201.46@tcp:1:lhsmtool_posix.0 Request processed in 6195us (6971us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051437.798036:0:27887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 8041 00000100:00100000:0.0:1777051437.799643:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051437.800041:0:6579:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426013312 00000100:00100000:3.0:1777051437.800050:0:6579:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426013312 00000100:00100000:3.0:1777051437.800113:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112153 00000100:00100000:3.0:1777051437.800125:0:6579:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da444a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+11:138105:x1863365426013312:12345-192.168.201.46@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1777051437.800241:0:6579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a2a00/0x85f51a6b967168cf lrc: 3/0,1 mode: --/PW res: [0x240000bd2:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051437.800262:0:6579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a2a00/0x85f51a6b967168cf lrc: 3/0,1 mode: PW/PW res: [0x240000bd2:0x1:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051437.800277:0:6579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a2a00/0x85f51a6b967168cf lrc: 3/0,1 mode: PW/PW res: [0x240000bd2:0x1:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051437.800463:0:6579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a2800/0x85f51a6b967168d6 lrc: 3/0,1 mode: --/EX res: [0x240000bd2:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051437.800481:0:6579:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a3000/0x85f51a6b967168ba lrc: 2/0,0 mode: CR/CR res: [0x240000bd2:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b660a expref: 12 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051437.800492:0:6579:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a2800/0x85f51a6b967168d6 lrc: 4/0,1 mode: --/EX res: [0x240000bd2:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051437.800531:0:6579:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a3000/0x85f51a6b967168ba lrc: 3/0,0 mode: CR/CR res: [0x240000bd2:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b660a expref: 12 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051437.800551:0:6579:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a3000/0x85f51a6b967168ba lrc: 4/0,0 mode: CR/CR res: [0x240000bd2:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b660a expref: 12 pid: 27882 timeout: 8166 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051437.800571:0:6579:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5fbec000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6579:1863365452646784:192.168.201.46@tcp:104: 00000100:00100000:3.0:1777051437.800664:0:6579:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d95cb329c0 going to sleep for 11 seconds 00000100:00100000:3.0:1777051437.803466:0:6579:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5fbec000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6579:1863365452646784:192.168.201.46@tcp:104: 00010000:00010000:3.0:1777051437.803502:0:6579:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a2800/0x85f51a6b967168d6 lrc: 3/0,1 mode: --/EX res: [0x240000bd2:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051437.804515:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051437.804620:0:47597:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426013440 00000100:00100000:3.0:1777051437.804630:0:47597:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426013440 00010000:00010000:3.0:1777051437.804661:0:47597:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a3000/0x85f51a6b967168ba lrc: 4/0,0 mode: CR/CR res: [0x240000bd2:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b660a expref: 13 pid: 27882 timeout: 8166 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051437.804980:0:47597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3908 00000100:00100000:3.0:1777051437.804991:0:47597:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da444a3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+13:2436:x1863365426013440:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1777051437.805005:0:47597:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777051437.805013:0:47597:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a3000/0x85f51a6b967168ba lrc: 4/0,0 mode: CR/CR res: [0x240000bd2:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b660a expref: 13 pid: 27882 timeout: 8166 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051437.805028:0:47597:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a3000/0x85f51a6b967168ba lrc: 3/0,0 mode: CR/CR res: [0x240000bd2:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b660a expref: 13 pid: 27882 timeout: 8166 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051437.805056:0:47597:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a3000/0x85f51a6b967168ba lrc: 0/0,0 mode: --/CR res: [0x240000bd2:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b660a expref: 13 pid: 27882 timeout: 8166 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051437.805076:0:47597:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x4:0x0].0x0 (ffff99da5fb45500) 00010000:00010000:3.0:1777051437.805083:0:47597:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a2800/0x85f51a6b967168d6 lrc: 3/0,1 mode: --/EX res: [0x240000bd2:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051437.805094:0:47597:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a2800/0x85f51a6b967168d6 lrc: 3/0,1 mode: EX/EX res: [0x240000bd2:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6579 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051437.805104:0:47597:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a2800/0x85f51a6b967168d6 lrc: 4/0,1 mode: EX/EX res: [0x240000bd2:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6579 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051437.805141:0:47597:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1777051437.805201:0:47597:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da444a3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+12:2436:x1863365426013440:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 209us (687us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051437.805214:0:47597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3908 00010000:00010000:0.0:1777051437.805240:0:6579:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a2800/0x85f51a6b967168d6 lrc: 3/0,1 mode: EX/EX res: [0x240000bd2:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051437.805256:0:6579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a2800/0x85f51a6b967168d6 lrc: 3/0,1 mode: EX/EX res: [0x240000bd2:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT1 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1777051437.805383:0:6579:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 8589934676 00000001:00080000:0.0:1777051437.805518:0:6579:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 8589934677 00000001:00080000:0.0:1777051437.805553:0:6579:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 8589934678 00000100:00100000:0.0:1777051437.805638:0:6579:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da444a3100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6579:1863365452646912:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1777051437.805700:0:6579:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051437.805750:0:6579:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d95cf51cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1777051437.805952:0:11727:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452646912 00000100:00100000:2.0:1777051437.805961:0:11727:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452646912 00000100:00100000:2.0:1777051437.806021:0:11727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8202 00000100:00100000:2.0:1777051437.806033:0:11727:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:6579:x1863365452646912:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1777051437.806144:0:11727:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:6579:x1863365452646912:12345-0@lo:1000:mdt00_000.0 Request processed in 112us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051437.806157:0:11727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8202 00000100:00100000:0.0:1777051437.806204:0:6579:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da444a3100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6579:1863365452646912:0@lo:1000:mdt00_000.0 00000001:00080000:0.0:1777051437.806406:0:6579:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 8589934679 00000100:00100000:0.0:1777051437.806463:0:6579:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f9fd180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6579:1863365452647040:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1777051437.806494:0:6579:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051437.806522:0:6579:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d95c67b840 going to sleep for 11 seconds 00000100:00100000:1.0:1777051437.806561:0:6584:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452647040 00000100:00100000:1.0:1777051437.806568:0:6584:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452647040 00000100:00100000:1.0:1777051437.806620:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8203 00000100:00100000:1.0:1777051437.806629:0:6584:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:6579:x1863365452647040:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1777051437.806749:0:6584:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:6579:x1863365452647040:12345-0@lo:1000:mdt00_000.0 Request processed in 121us (253us total) trans 4294968364 rc 0/0 00000100:00100000:1.0:1777051437.806757:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8203 00000100:00100000:0.0:1777051437.806839:0:6579:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f9fd180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6579:1863365452647040:0@lo:1000:mdt00_000.0 00000001:00080000:0.0:1777051437.806898:0:6579:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 8589934680 00010000:00010000:0.0:1777051437.806926:0:6579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a2800/0x85f51a6b967168d6 lrc: 3/0,1 mode: EX/EX res: [0x240000bd2:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051437.806940:0:6579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a2800/0x85f51a6b967168d6 lrc: 2/0,0 mode: EX/EX res: [0x240000bd2:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6579 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051437.806950:0:6579:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a2800/0x85f51a6b967168d6 lrc: 3/0,0 mode: EX/EX res: [0x240000bd2:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6579 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051437.806959:0:6579:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d9559a2800 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:0.0:1777051437.806965:0:6579:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a2800/0x85f51a6b967168d6 lrc: 3/0,0 mode: EX/EX res: [0x240000bd2:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6579 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051437.806975:0:6579:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a2800/0x85f51a6b967168d6 lrc: 4/0,0 mode: EX/EX res: [0x240000bd2:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6579 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051437.806989:0:6579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x4:0x0].0x0 (ffff99da5fb45500) 00010000:00010000:0.0:1777051437.806993:0:6579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1777051437.806999:0:6579:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a2800/0x85f51a6b967168d6 lrc: 2/0,0 mode: --/EX res: [0x240000bd2:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6579 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051437.807007:0:6579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a2800/0x85f51a6b967168d6 lrc: 0/0,0 mode: --/EX res: [0x240000bd2:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6579 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051437.807045:0:6579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61b400/0x85f51a6b967167e8 lrc: 3/0,1 mode: EX/EX res: [0x240000bd2:0x1:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 46494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051437.807055:0:6579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61b400/0x85f51a6b967167e8 lrc: 2/0,0 mode: EX/EX res: [0x240000bd2:0x1:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 46494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051437.807070:0:6579:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61b400/0x85f51a6b967167e8 lrc: 3/0,0 mode: EX/EX res: [0x240000bd2:0x1:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 46494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051437.807077:0:6579:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94e61b400 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:0.0:1777051437.807081:0:6579:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61b400/0x85f51a6b967167e8 lrc: 3/0,0 mode: EX/EX res: [0x240000bd2:0x1:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 46494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051437.807090:0:6579:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61b400/0x85f51a6b967167e8 lrc: 4/0,0 mode: EX/EX res: [0x240000bd2:0x1:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 46494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051437.807101:0:6579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x1:0x0].0x0 (ffff99da5fb45200) 00010000:00010000:0.0:1777051437.807105:0:6579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1777051437.807113:0:6579:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72f600/0x85f51a6b967167ef lrc: 2/0,0 mode: --/CR res: [0x240000bd2:0x1:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b65cb expref: 49 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051437.807124:0:6579:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72f600/0x85f51a6b967167ef lrc: 2/0,0 mode: CR/CR res: [0x240000bd2:0x1:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b65cb expref: 49 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051437.807132:0:6579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72f600/0x85f51a6b967167ef lrc: 3/0,0 mode: CR/CR res: [0x240000bd2:0x1:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b65cb expref: 49 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051437.807219:0:6579:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72f600/0x85f51a6b967167ef lrc: 3/0,0 mode: CR/CR res: [0x240000bd2:0x1:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b65cb expref: 49 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051437.807237:0:6579:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f9fed80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6579:1863365452647168:192.168.201.46@tcp:105: 00000100:00100000:0.0:1777051437.807312:0:6579:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d944ac00c0 going to sleep for 11 seconds 00000100:00100000:3.0:1777051437.812594:0:6579:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f9fed80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6579:1863365452647168:192.168.201.46@tcp:105: 00010000:00010000:3.0:1777051437.812635:0:6579:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61b400/0x85f51a6b967167e8 lrc: 2/0,0 mode: --/EX res: [0x240000bd2:0x1:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 46494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051437.812660:0:6579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61b400/0x85f51a6b967167e8 lrc: 0/0,0 mode: --/EX res: [0x240000bd2:0x1:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 46494 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051437.812687:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00010000:00010000:3.0:1777051437.812703:0:6579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a3000/0x85f51a6b967168dd lrc: 3/0,1 mode: --/EX res: [0x240000bd2:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051437.812724:0:6579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a3000/0x85f51a6b967168dd lrc: 3/0,1 mode: EX/EX res: [0x240000bd2:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051437.812745:0:6579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a3000/0x85f51a6b967168dd lrc: 3/0,1 mode: EX/EX res: [0x240000bd2:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051437.812762:0:6579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a3000/0x85f51a6b967168dd lrc: 3/0,1 mode: EX/EX res: [0x240000bd2:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051437.812774:0:6579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a3000/0x85f51a6b967168dd lrc: 2/0,0 mode: EX/EX res: [0x240000bd2:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6579 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051437.812786:0:6579:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a3000/0x85f51a6b967168dd lrc: 3/0,0 mode: EX/EX res: [0x240000bd2:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6579 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051437.812823:0:6582:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426013568 00010000:00010000:3.0:1777051437.812824:0:6579:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d9559a3000 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:3.0:1777051437.812833:0:6579:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a3000/0x85f51a6b967168dd lrc: 3/0,0 mode: EX/EX res: [0x240000bd2:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6579 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051437.812836:0:6582:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426013568 00000100:00100000:1.0:1777051437.812921:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3377 00000100:00100000:1.0:1777051437.812935:0:6582:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95fae9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+50:138104:x1863365426013568:12345-192.168.201.46@tcp:49:cat.0 00000100:00100000:1.0:1777051437.813165:0:6582:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95fae9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+50:138104:x1863365426013568:12345-192.168.201.46@tcp:49:cat.0 Request processed in 232us (482us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051437.813175:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3377 00010000:00010000:3.0:1777051437.813318:0:6579:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a3000/0x85f51a6b967168dd lrc: 4/0,0 mode: EX/EX res: [0x240000bd2:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6579 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051437.813339:0:6579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x1:0x0].0x0 (ffff99da5fb45200) 00010000:00010000:3.0:1777051437.813345:0:6579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777051437.813351:0:6579:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a3000/0x85f51a6b967168dd lrc: 2/0,0 mode: --/EX res: [0x240000bd2:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6579 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051437.813361:0:6579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a3000/0x85f51a6b967168dd lrc: 0/0,0 mode: --/EX res: [0x240000bd2:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6579 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051437.813378:0:6579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a2a00/0x85f51a6b967168cf lrc: 3/0,1 mode: PW/PW res: [0x240000bd2:0x1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051437.813387:0:6579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a2a00/0x85f51a6b967168cf lrc: 2/0,0 mode: PW/PW res: [0x240000bd2:0x1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6579 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051437.813396:0:6579:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a2a00/0x85f51a6b967168cf lrc: 3/0,0 mode: PW/PW res: [0x240000bd2:0x1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6579 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051437.813405:0:6579:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d9559a2a00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:3.0:1777051437.813410:0:6579:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a2a00/0x85f51a6b967168cf lrc: 3/0,0 mode: PW/PW res: [0x240000bd2:0x1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6579 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051437.813420:0:6579:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a2a00/0x85f51a6b967168cf lrc: 4/0,0 mode: PW/PW res: [0x240000bd2:0x1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6579 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051437.813432:0:6579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x1:0x0].0x0 (ffff99da5fb45200) 00010000:00010000:3.0:1777051437.813437:0:6579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1777051437.813442:0:6579:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a2a00/0x85f51a6b967168cf lrc: 2/0,0 mode: --/PW res: [0x240000bd2:0x1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6579 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051437.813451:0:6579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a2a00/0x85f51a6b967168cf lrc: 0/0,0 mode: --/PW res: [0x240000bd2:0x1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6579 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1777051437.813720:0:104226:0:(llog.c:801:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000100:00100000:3.0:1777051437.814039:0:6579:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da444a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+16:138105:x1863365426013312:12345-192.168.201.46@tcp:57:lhsmtool_posix.0 Request processed in 13601us (14086us total) trans 8589934681 rc 0/0 00000040:00080000:0.0:1777051437.814049:0:104226:0:(llog_cat.c:158:llog_cat_process_common()) processing log [0x1:0x12:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000100:00100000:3.0:1777051437.814060:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112153 00000020:00080000:3.0:1777051437.814069:0:6579:0:(tgt_main.c:783:tgt_ses_key_exit()) total 6 transactions per RPC 00000040:00080000:0.0:1777051437.815138:0:104226:0:(llog.c:858:llog_process_thread()) stop processing plain [0x1:0x12:0x0] index 64768 count 5 00000040:00080000:0.0:1777051437.815153:0:104226:0:(llog.c:858:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1777051437.821406:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051437.821486:0:6583:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426013824 00000100:00100000:3.0:1777051437.821499:0:6583:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426013824 00000100:00100000:2.0:1777051437.821509:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051437.821607:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3378 00000100:00100000:0.0:1777051437.821610:0:24468:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426013952 00000100:00100000:0.0:1777051437.821620:0:24468:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426013952 00000100:00100000:3.0:1777051437.821626:0:6583:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95fae8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+16:138105:x1863365426013824:12345-192.168.201.46@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1777051437.821691:0:24468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 8042 00000100:00100000:0.0:1777051437.821708:0:24468:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95fae8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+47:138104:x1863365426013952:12345-192.168.201.46@tcp:101:cat.0 00010000:00010000:0.0:1777051437.821727:0:24468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051437.821755:0:24468:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000086329984/0x85f51a6b967168e4 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x104:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6611 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1777051437.821827:0:24468:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x104:0x0] initial LVB size: 1048576, mtime: 0x69eba726, atime: 0x69eba726, ctime: 0x69eba726, blocks: 0x800 00010000:00010000:0.0:1777051437.821853:0:24468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777051437.821856:0:24468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777051437.821869:0:24468:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000086329984/0x85f51a6b967168e4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x104:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6611 expref: 48 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051437.821895:0:24468:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000086329984/0x85f51a6b967168e4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x104:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6611 expref: 48 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051437.821915:0:24468:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d94e61b600, rc 0) 00000100:00100000:0.0:1777051437.821985:0:24468:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95fae8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+48:138104:x1863365426013952:12345-192.168.201.46@tcp:101:cat.0 Request processed in 282us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051437.821998:0:24468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 8042 00000004:00080000:3.0:1777051437.822252:0:6583:0:(mdd_object.c:4010:mdd_close()) Object [0x240000bd2:0x4:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1777051437.822296:0:6583:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 8589934682 00010000:00010000:3.0:1777051437.822501:0:6583:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a3c00/0x85f51a6b967168eb lrc: 3/0,1 mode: --/PW res: [0x240000bd2:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6583 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051437.822526:0:6583:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a3c00/0x85f51a6b967168eb lrc: 3/0,1 mode: PW/PW res: [0x240000bd2:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6583 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051437.822542:0:6583:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a3c00/0x85f51a6b967168eb lrc: 3/0,1 mode: PW/PW res: [0x240000bd2:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6583 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051437.822577:0:6583:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a3c00/0x85f51a6b967168eb lrc: 4/0,1 mode: PW/PW res: [0x240000bd2:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6583 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051437.822591:0:6583:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a3c00/0x85f51a6b967168eb lrc: 4/0,1 mode: PW/PW res: [0x240000bd2:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6583 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051437.822601:0:6583:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a3c00/0x85f51a6b967168eb lrc: 3/0,0 mode: PW/PW res: [0x240000bd2:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6583 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051437.823071:0:6583:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1777051437.823166:0:6583:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95fae8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+18:138105:x1863365426013824:12345-192.168.201.46@tcp:35:lhsmtool_posix.0 Request processed in 1544us (1769us total) trans 8589934683 rc 0/0 00000100:00100000:2.0:1777051437.823177:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3378 00000020:00080000:2.0:1777051437.823183:0:6583:0:(tgt_main.c:783:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1777051437.823318:0:13753:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1777051437.823327:0:13753:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a3c00/0x85f51a6b967168eb lrc: 2/0,0 mode: PW/PW res: [0x240000bd2:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6583 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051437.823341:0:13753:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d9559a3c00 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:0.0:1777051437.823348:0:13753:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a3c00/0x85f51a6b967168eb lrc: 2/0,0 mode: PW/PW res: [0x240000bd2:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6583 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051437.823362:0:13753:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a3c00/0x85f51a6b967168eb lrc: 3/0,0 mode: PW/PW res: [0x240000bd2:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6583 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051437.823381:0:13753:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x4:0x0].0x0 (ffff99da5fb45500) 00010000:00010000:0.0:1777051437.823386:0:13753:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1777051437.823392:0:13753:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a3c00/0x85f51a6b967168eb lrc: 1/0,0 mode: --/PW res: [0x240000bd2:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6583 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051437.823402:0:13753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a3c00/0x85f51a6b967168eb lrc: 0/0,0 mode: --/PW res: [0x240000bd2:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6583 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051437.823422:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777051437.823425:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777051437.823428:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1777051437.833336:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051437.833452:0:8474:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426014080 00000100:00100000:0.0:1777051437.833463:0:8474:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426014080 00002000:00100000:0.0:1777051437.833517:0:8474:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000400:0x104:0x0] (0->1048575) req@ffff99d95faea680 x1863365426014080/t0(0) o3->2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp:398/0 lens 488/0 e 0 to 0 dl 1777051448 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1777051437.833534:0:8474:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99d95faea680 with x1863365426014080 ext(0->1048575) 00002000:00010000:0.0:1777051437.833541:0:8474:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99d95faea680 00000100:00100000:0.0:1777051437.833603:0:8474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 1773 00000100:00100000:0.0:1777051437.833617:0:8474:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95faea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+48:2436:x1863365426014080:12345-192.168.201.46@tcp:3:cat.0 00000004:00080000:2.0:1777051437.846415:0:104214:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 8067039215138ns, next at 8068039210801ns, rc = 0 00000100:00100000:1.0:1777051437.846418:0:3679:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1777051437.846456:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95faebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452647296:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1777051437.846552:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051437.846677:0:8472:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452647296 00000100:00100000:0.0:1777051437.846690:0:8472:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452647296 00000100:00100000:0.0:1777051437.846750:0:8472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5666 00000100:00100000:0.0:1777051437.846763:0:8472:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da45f77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3679:x1863365452647296:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1777051437.846841:0:8472:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 477175360 pending 0 free 3859525632 avail 3628003328 00000100:00100000:3.0:1777051437.846946:0:3678:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1777051437.846948:0:8472:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da45f77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3679:x1863365452647296:12345-0@lo:13:osp-pre-0-1.0 Request processed in 178us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051437.846965:0:8472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5666 00000100:00100000:3.0:1777051437.846968:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5fbec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452647424:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1777051437.847026:0:3679:0:(client.c:3101:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294968361 gen 2 00000004:00080000:0.0:1777051437.847035:0:3679:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 4294968358 committed transno 4294968361 00000004:00080000:0.0:1777051437.847063:0:3679:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 4294968359 committed transno 4294968361 00000004:00080000:0.0:1777051437.847083:0:3679:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff99da5fbed180, transno 4294968361 00000100:00100000:0.0:1777051437.847118:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95faebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452647296:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1777051437.847308:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051437.847400:0:10113:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452647424 00000100:00100000:1.0:1777051437.847407:0:10113:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452647424 00000100:00100000:1.0:1777051437.847456:0:10113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5667 00000100:00100000:1.0:1777051437.847467:0:10113:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95faeaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3678:x1863365452647424:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1777051437.847488:0:10113:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 467115584 pending 0 free 3644805120 avail 3411136512 00000100:00100000:1.0:1777051437.847575:0:10113:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95faeaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3678:x1863365452647424:12345-0@lo:13:osp-pre-1-1.0 Request processed in 107us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051437.847587:0:10113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5667 00000100:00100000:2.0:1777051437.847727:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5fbec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452647424:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1777051437.851932:0:8474:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95faea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+48:2436:x1863365426014080:12345-192.168.201.46@tcp:3:cat.0 Request processed in 18312us (18598us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1777051437.851945:0:8474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 1773 00002000:00100000:0.0:1777051437.851959:0:8474:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000400:0x104:0x0] (0->1048575) req@ffff99d95faea680 x1863365426014080/t0(0) o3->2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp:398/0 lens 488/440 e 0 to 0 dl 1777051448 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1777051437.851975:0:8474:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99d95faea680 with x1863365426014080 ext(0->1048575) 00002000:00010000:0.0:1777051437.851984:0:8474:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99d95faea680 00000100:00100000:1.0:1777051437.865637:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051437.865736:0:46203:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426014208 00000100:00100000:3.0:1777051437.865751:0:46203:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426014208 00002000:00100000:3.0:1777051437.865846:0:46203:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000400:0x104:0x0] (1048576->1052671) req@ffff99da45f75180 x1863365426014208/t0(0) o3->2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp:398/0 lens 488/0 e 0 to 0 dl 1777051448 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1777051437.865898:0:46203:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99da45f75180 with x1863365426014208 ext(1048576->1052671) 00002000:00010000:3.0:1777051437.865918:0:46203:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99da45f75180 00000100:00100000:3.0:1777051437.865960:0:46203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 1774 00000100:00100000:3.0:1777051437.865975:0:46203:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da45f75180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+48:2436:x1863365426014208:12345-192.168.201.46@tcp:3:cat.0 00000100:00100000:3.0:1777051437.866560:0:46203:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da45f75180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+48:2436:x1863365426014208:12345-192.168.201.46@tcp:3:cat.0 Request processed in 586us (931us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051437.866573:0:46203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 1774 00002000:00100000:3.0:1777051437.866585:0:46203:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000400:0x104:0x0] (1048576->1052671) req@ffff99da45f75180 x1863365426014208/t0(0) o3->2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp:398/0 lens 488/440 e 0 to 0 dl 1777051448 ref 1 fl Complete:/600/0 rc 0/0 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1777051437.866599:0:46203:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99da45f75180 with x1863365426014208 ext(1048576->1052671) 00002000:00010000:3.0:1777051437.866606:0:46203:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99da45f75180 00000100:00100000:2.0:1777051437.880990:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051437.881104:0:6582:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426014464 00000100:00100000:1.0:1777051437.881118:0:6582:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426014464 00000100:00100000:1.0:1777051437.881189:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3379 00000100:00100000:1.0:1777051437.881271:0:6582:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95faeb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+50:138104:x1863365426014464:12345-192.168.201.46@tcp:35:cat.0 00000100:00100000:1.0:1777051437.881545:0:6582:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95faeb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+51:138104:x1863365426014464:12345-192.168.201.46@tcp:35:cat.0 Request processed in 342us (565us total) trans 8589934684 rc 0/0 00000100:00100000:1.0:1777051437.881573:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3379 00000100:00100000:0.0:1777051437.891259:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051437.891366:0:6581:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426014720 00000100:00100000:2.0:1777051437.891379:0:6581:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426014720 00000100:00100000:2.0:1777051437.891472:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112154 00000100:00100000:2.0:1777051437.891488:0:6581:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+51:138106:x1863365426014720:12345-192.168.201.46@tcp:101:cat.0 00010000:00010000:2.0:1777051437.891516:0:6581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051437.891544:0:6581:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d944a3ea00/0x85f51a6b967168f2 lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6618 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051437.891629:0:6581:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d944a3fe00/0x85f51a6b967168f9 lrc: 3/1,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051437.891645:0:6581:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d944a3fe00/0x85f51a6b967168f9 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6581 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051437.891656:0:6581:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d944a3fe00/0x85f51a6b967168f9 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6581 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051437.891672:0:6581:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d944a3fc00/0x85f51a6b96716900 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x50a12932 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051437.891682:0:6581:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d944a3fc00/0x85f51a6b96716900 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x50a12932 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6581 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051437.891692:0:6581:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d944a3fc00/0x85f51a6b96716900 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x50a12932 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6581 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051437.891872:0:6581:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d944a3f400/0x85f51a6b96716907 lrc: 3/1,0 mode: --/PR res: [0x240000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051437.891886:0:6581:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d944a3f400/0x85f51a6b96716907 lrc: 3/1,0 mode: PR/PR res: [0x240000bd2:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6581 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051437.891897:0:6581:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d944a3f400/0x85f51a6b96716907 lrc: 3/1,0 mode: PR/PR res: [0x240000bd2:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6581 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1777051437.891919:0:6581:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000bd2:0x2:0x0]: returning size 1048576 00010000:00010000:2.0:1777051437.892020:0:6581:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d944a3fe00/0x85f51a6b967168f9 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6581 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051437.892033:0:6581:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d944a3fe00/0x85f51a6b967168f9 lrc: 2/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6581 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051437.892042:0:6581:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99d944a3fe00/0x85f51a6b967168f9 lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6581 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051437.892072:0:6581:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d944a3fe00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:2.0:1777051437.892078:0:6581:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d944a3fe00/0x85f51a6b967168f9 lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6581 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051437.892088:0:6581:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d944a3fe00/0x85f51a6b967168f9 lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6581 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051437.892103:0:6581:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff99d9413d0300) 00010000:00010000:2.0:1777051437.892107:0:6581:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777051437.892113:0:6581:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99d944a3fe00/0x85f51a6b967168f9 lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6581 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051437.892122:0:6581:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d944a3fe00/0x85f51a6b967168f9 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6581 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051437.892139:0:6581:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d944a3fc00/0x85f51a6b96716900 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x50a12932 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6581 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051437.892148:0:6581:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d944a3fc00/0x85f51a6b96716900 lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x50a12932 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6581 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051437.892163:0:6581:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99d944a3fc00/0x85f51a6b96716900 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x50a12932 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6581 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051437.892170:0:6581:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d944a3fc00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:2.0:1777051437.892173:0:6581:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d944a3fc00/0x85f51a6b96716900 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x50a12932 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6581 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051437.892181:0:6581:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d944a3fc00/0x85f51a6b96716900 lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x50a12932 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6581 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051437.892191:0:6581:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x50a12932 (ffff99da59dd4200) 00010000:00010000:2.0:1777051437.892194:0:6581:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777051437.892268:0:6581:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99d944a3fc00/0x85f51a6b96716900 lrc: 2/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x50a12932 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6581 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051437.892279:0:6581:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d944a3fc00/0x85f51a6b96716900 lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x50a12932 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6581 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051437.892344:0:6581:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d944a3ea00/0x85f51a6b967168f2 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6618 expref: 54 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051437.892362:0:6581:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99d944a3f400/0x85f51a6b96716907 lrc: 3/0,0 mode: PR/PR res: [0x240000bd2:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6618 expref: 53 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051437.892370:0:6581:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x2:0x0].0x0 (ffff99da59dd4d00) 00010000:00010000:2.0:1777051437.892373:0:6581:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1777051437.892376:0:6581:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d944a3f400, rc 0) 00000100:00100000:2.0:1777051437.892434:0:6581:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+53:138106:x1863365426014720:12345-192.168.201.46@tcp:101:cat.0 Request processed in 952us (1185us total) trans 8589934685 rc 0/0 00000100:00100000:2.0:1777051437.892449:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112154 00000100:00100000:0.0:1777051437.897080:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051437.897253:0:6565:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426014976 00000100:00100000:1.0:1777051437.897263:0:6565:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426014976 00000100:00100000:1.0:1777051437.897333:0:6565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13700 00000100:00100000:1.0:1777051437.897347:0:6565:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9fce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+53:138106:x1863365426014976:12345-192.168.201.46@tcp:103:cat.0 00010000:00010000:1.0:1777051437.897366:0:6565:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1777051437.897391:0:6565:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d944a3f400/0x85f51a6b96716907 lrc: 0/0,0 mode: --/PR res: [0x240000bd2:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6618 expref: 53 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051437.897416:0:6565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x2:0x0].0x0 (ffff99da59dd4d00) 00010000:00010000:1.0:1777051437.897428:0:6565:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1777051437.897486:0:6565:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9fce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+52:138106:x1863365426014976:12345-192.168.201.46@tcp:103:cat.0 Request processed in 142us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051437.897498:0:6565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13700 00000100:00100000:0.0:1777051437.901164:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051437.901275:0:46497:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426015104 00000100:00100000:1.0:1777051437.901285:0:46497:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426015104 00000100:00100000:1.0:1777051437.901351:0:46497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112155 00000100:00100000:1.0:1777051437.901361:0:46497:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+52:138106:x1863365426015104:12345-192.168.201.46@tcp:58:cat.0 00010000:00010000:1.0:1777051437.901459:0:46497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72ee00/0x85f51a6b96716915 lrc: 3/0,1 mode: --/EX res: [0x240000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051437.901479:0:46497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72ee00/0x85f51a6b96716915 lrc: 3/0,1 mode: EX/EX res: [0x240000bd2:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051437.901493:0:46497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72ee00/0x85f51a6b96716915 lrc: 3/0,1 mode: EX/EX res: [0x240000bd2:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1777051437.901610:0:46497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].7, 136 off9144 00000100:00100000:1.0:1777051437.901705:0:46497:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+52:138106:x1863365426015104:12345-192.168.201.46@tcp:58:cat.0 Request processed in 342us (543us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051437.901716:0:46497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112155 00000100:00100000:2.0:1777051437.904447:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051437.904615:0:10328:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426015232 00000100:00100000:0.0:1777051437.904622:0:10328:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426015232 00000100:00100000:0.0:1777051437.904675:0:10328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112156 00000100:00100000:0.0:1777051437.904687:0:10328:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95faeb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+52:138106:x1863365426015232:12345-192.168.201.46@tcp:101:cat.0 00010000:00010000:0.0:1777051437.904705:0:10328:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051437.904993:0:10328:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61a200/0x85f51a6b9671691c lrc: 2/0,0 mode: --/CR res: [0x240000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b661f expref: -99 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051437.905046:0:10328:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72ee00/0x85f51a6b96716915 lrc: 2/0,1 mode: EX/EX res: [0x240000bd2:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051437.905062:0:10328:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61a200/0x85f51a6b9671691c lrc: 4/0,0 mode: --/CR res: [0x240000bd2:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b661f expref: 53 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051437.905373:0:10328:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72ee00/0x85f51a6b96716915 lrc: 3/0,1 mode: EX/EX res: [0x240000bd2:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051437.905395:0:10328:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61a200/0x85f51a6b9671691c lrc: 3/0,0 mode: --/CR res: [0x240000bd2:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b661f expref: 53 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051437.905414:0:10328:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x2:0x0].0x0 (ffff99d94e6b6f00) 00010000:00010000:0.0:1777051437.905419:0:10328:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1777051437.905425:0:10328:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61a200/0x85f51a6b9671691c lrc: 3/0,0 mode: --/CR res: [0x240000bd2:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b661f expref: 53 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051437.905438:0:10328:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d94e61a200, rc 0) 00000100:00100000:0.0:1777051437.906403:0:10328:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95faeb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+53:138106:x1863365426015232:12345-192.168.201.46@tcp:101:cat.0 Request processed in 1484us (1726us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051437.906416:0:10328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112156 00010000:00010000:1.0:1777051438.167600:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1777051438.871105:0:104226:0:(llog.c:801:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1777051438.871116:0:104226:0:(llog_cat.c:158:llog_cat_process_common()) processing log [0x1:0x12:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1777051438.871155:0:104226:0:(llog.c:858:llog_process_thread()) stop processing plain [0x1:0x12:0x0] index 8 count 6 00000040:00080000:0.0:1777051438.871168:0:104226:0:(llog.c:858:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1777051438.871374:0:104226:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da444a3100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0001_UUID:104226:1863365452647552:192.168.201.46@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1777051438.871509:0:104226:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d944ac00c0 going to sleep for 11 seconds 00000100:00100000:0.0:1777051438.875508:0:104226:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da444a3100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0001_UUID:104226:1863365452647552:192.168.201.46@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1777051438.876940:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051438.877065:0:46494:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426015360 00000100:00100000:0.0:1777051438.877076:0:46494:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426015360 00000100:00080000:2.0:1777051438.877182:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1777051438.877184:0:46494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112157 00000100:00100000:0.0:1777051438.877249:0:46494:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95fae9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c11b6966-0775-44d2-bdc6-c74c26eb2226+18:138107:x1863365426015360:12345-192.168.201.46@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1777051438.877293:0:46494:0:(mdt_handler.c:7958:mdt_fid2path()) path get [0x240000bd2:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1777051438.877421:0:46494:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95fae9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c11b6966-0775-44d2-bdc6-c74c26eb2226+18:138107:x1863365426015360:12345-192.168.201.46@tcp:53:lhsmtool_posix.0 Request processed in 219us (482us total) trans 0 rc -66/-66 00000100:00100000:0.0:1777051438.877435:0:46494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112157 00000100:00100000:2.0:1777051438.879840:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051438.879937:0:8492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426015488 00000100:00100000:0.0:1777051438.879946:0:8492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426015488 00000100:00080000:2.0:1777051438.880023:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1777051438.880031:0:8492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112158 00000100:00100000:0.0:1777051438.880048:0:8492:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95faebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+23:138107:x1863365426015488:12345-192.168.201.46@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1777051438.880076:0:8492:0:(mdt_handler.c:7958:mdt_fid2path()) path get [0x2000032e2:0x6:0x0] from 18446744073709551615 #-1 00000100:00100000:0.0:1777051438.880324:0:8492:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95faebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+23:138107:x1863365426015488:12345-192.168.201.46@tcp:53:lhsmtool_posix.0 Request processed in 278us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051438.880336:0:8492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112158 00000100:00100000:2.0:1777051438.883917:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051438.884841:0:27885:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426015616 00000100:00100000:3.0:1777051438.884851:0:27885:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426015616 00000100:00100000:3.0:1777051438.884918:0:27885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112159 00000100:00100000:3.0:1777051438.884931:0:27885:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95fae8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c11b6966-0775-44d2-bdc6-c74c26eb2226+23:138107:x1863365426015616:12345-192.168.201.46@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1777051438.885565:0:27885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3000/0x85f51a6b96716923 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051438.885591:0:27885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3000/0x85f51a6b96716923 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051438.885611:0:27885:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3000/0x85f51a6b96716923 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051438.885632:0:27885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3200/0x85f51a6b9671692a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x247420d5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051438.885645:0:27885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3200/0x85f51a6b9671692a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x247420d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051438.885655:0:27885:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3200/0x85f51a6b9671692a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x247420d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051438.885820:0:27885:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5fbed180 pname:cluuid:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000-mdtlov_UUID:27885:1863365452647680:0@lo:1000:mdt00_007.0 00000100:00100000:3.0:1777051438.885882:0:27885:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051438.885926:0:27885:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d95cb32600 going to sleep for 11 seconds 00000100:00100000:1.0:1777051438.886009:0:46498:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452647680 00000100:00100000:1.0:1777051438.886018:0:46498:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452647680 00000100:00100000:1.0:1777051438.886096:0:46498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8204 00000100:00100000:1.0:1777051438.886112:0:46498:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5fbee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+6:27885:x1863365452647680:12345-0@lo:1000:mdt00_007.0 00000100:00100000:1.0:1777051438.886567:0:46498:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5fbee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+6:27885:x1863365452647680:12345-0@lo:1000:mdt00_007.0 Request processed in 458us (682us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051438.886583:0:46498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8204 00000100:00100000:3.0:1777051438.886635:0:27885:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5fbed180 pname:cluuid:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000-mdtlov_UUID:27885:1863365452647680:0@lo:1000:mdt00_007.0 00010000:00010000:3.0:1777051438.886697:0:27885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2e00/0x85f51a6b96716931 lrc: 3/1,0 mode: --/PR res: [0x240000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051438.886711:0:27885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2e00/0x85f51a6b96716931 lrc: 3/1,0 mode: PR/PR res: [0x240000bd2:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051438.886724:0:27885:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2e00/0x85f51a6b96716931 lrc: 3/1,0 mode: PR/PR res: [0x240000bd2:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777051438.886748:0:27885:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2e00/0x85f51a6b96716931 lrc: 3/1,0 mode: PR/PR res: [0x240000bd2:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051438.886764:0:27885:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3000/0x85f51a6b96716923 lrc: 4/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051438.886804:0:27885:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3000/0x85f51a6b96716923 lrc: 4/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051438.886816:0:27885:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3000/0x85f51a6b96716923 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051438.886835:0:27885:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3000/0x85f51a6b96716923 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051438.886845:0:27885:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d9559a3000 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:3.0:1777051438.886853:0:27885:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3000/0x85f51a6b96716923 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051438.886864:0:27885:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3000/0x85f51a6b96716923 lrc: 5/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051438.886881:0:27885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99d941e2ea00) 00010000:00010000:3.0:1777051438.886887:0:27885:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777051438.886893:0:27885:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3000/0x85f51a6b96716923 lrc: 3/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051438.886904:0:27885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3000/0x85f51a6b96716923 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051438.886923:0:27885:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3200/0x85f51a6b9671692a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x247420d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051438.886933:0:27885:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3200/0x85f51a6b9671692a lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x247420d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051438.886943:0:27885:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3200/0x85f51a6b9671692a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x247420d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051438.886951:0:27885:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d9559a3200 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:3.0:1777051438.886955:0:27885:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3200/0x85f51a6b9671692a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x247420d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051438.886992:0:27885:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3200/0x85f51a6b9671692a lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x247420d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051438.887004:0:27885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x247420d5 (ffff99d9413d0500) 00010000:00010000:3.0:1777051438.887008:0:27885:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777051438.887012:0:27885:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3200/0x85f51a6b9671692a lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x247420d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051438.887022:0:27885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3200/0x85f51a6b9671692a lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x247420d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051438.887042:0:27885:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2e00/0x85f51a6b96716931 lrc: 3/1,0 mode: PR/PR res: [0x240000bd2:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051438.887051:0:27885:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2e00/0x85f51a6b96716931 lrc: 2/0,0 mode: PR/PR res: [0x240000bd2:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051438.887060:0:27885:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2e00/0x85f51a6b96716931 lrc: 3/0,0 mode: PR/PR res: [0x240000bd2:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051438.887069:0:27885:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d9559a2e00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:3.0:1777051438.887073:0:27885:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2e00/0x85f51a6b96716931 lrc: 3/0,0 mode: PR/PR res: [0x240000bd2:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051438.887082:0:27885:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2e00/0x85f51a6b96716931 lrc: 4/0,0 mode: PR/PR res: [0x240000bd2:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051438.887092:0:27885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x2:0x0].0x0 (ffff99d9413d0c00) 00010000:00010000:3.0:1777051438.887095:0:27885:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1777051438.887099:0:27885:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2e00/0x85f51a6b96716931 lrc: 2/0,0 mode: --/PR res: [0x240000bd2:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051438.887115:0:27885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2e00/0x85f51a6b96716931 lrc: 0/0,0 mode: --/PR res: [0x240000bd2:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051438.887316:0:27885:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95fae8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c11b6966-0775-44d2-bdc6-c74c26eb2226+23:138107:x1863365426015616:12345-192.168.201.46@tcp:34:lhsmtool_posix.0 Request processed in 2385us (3402us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051438.887328:0:27885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112159 00000100:00100000:2.0:1777051438.889952:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051438.890047:0:46497:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426015744 00000100:00100000:1.0:1777051438.890057:0:46497:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426015744 00000100:00100000:1.0:1777051438.890416:0:46497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112160 00000100:00100000:1.0:1777051438.890437:0:46497:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95fae9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:c11b6966-0775-44d2-bdc6-c74c26eb2226+18:138107:x1863365426015744:12345-192.168.201.46@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1777051438.890493:0:46497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72ec00/0x85f51a6b96716938 lrc: 3/1,0 mode: --/PR res: [0x240000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051438.890514:0:46497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72ec00/0x85f51a6b96716938 lrc: 3/1,0 mode: PR/PR res: [0x240000bd2:0x2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051438.890531:0:46497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72ec00/0x85f51a6b96716938 lrc: 3/1,0 mode: PR/PR res: [0x240000bd2:0x2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1777051438.890582:0:46497:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000bd2:0x2:0x0]: returning size 1048576 00000004:00200000:1.0:1777051438.890589:0:46497:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:1.0:1777051438.890605:0:46497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72ec00/0x85f51a6b96716938 lrc: 3/1,0 mode: PR/PR res: [0x240000bd2:0x2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051438.890616:0:46497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72ec00/0x85f51a6b96716938 lrc: 2/0,0 mode: PR/PR res: [0x240000bd2:0x2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051438.890627:0:46497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72ec00/0x85f51a6b96716938 lrc: 3/0,0 mode: PR/PR res: [0x240000bd2:0x2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051438.890636:0:46497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94d72ec00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:1.0:1777051438.890643:0:46497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72ec00/0x85f51a6b96716938 lrc: 3/0,0 mode: PR/PR res: [0x240000bd2:0x2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051438.890654:0:46497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72ec00/0x85f51a6b96716938 lrc: 4/0,0 mode: PR/PR res: [0x240000bd2:0x2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051438.890668:0:46497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x2:0x0].0x0 (ffff99d94e6b6f00) 00010000:00010000:1.0:1777051438.890672:0:46497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1777051438.890677:0:46497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72ec00/0x85f51a6b96716938 lrc: 2/0,0 mode: --/PR res: [0x240000bd2:0x2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051438.890981:0:46497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72ec00/0x85f51a6b96716938 lrc: 0/0,0 mode: --/PR res: [0x240000bd2:0x2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051438.891063:0:46497:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95fae9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:c11b6966-0775-44d2-bdc6-c74c26eb2226+18:138107:x1863365426015744:12345-192.168.201.46@tcp:34:lhsmtool_posix.0 Request processed in 632us (1110us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051438.891076:0:46497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112160 00000100:00100000:2.0:1777051438.894178:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051438.894398:0:27882:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426016000 00000100:00100000:3.0:1777051438.894407:0:27882:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426016000 00000100:00100000:3.0:1777051438.894464:0:27882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112161 00000100:00100000:3.0:1777051438.894478:0:27882:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95fae9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+18:138107:x1863365426016000:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1777051438.894496:0:27882:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777051438.894518:0:27882:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a2e00/0x85f51a6b9671693f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6626 expref: -99 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051438.894615:0:27882:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a3200/0x85f51a6b96716946 lrc: 3/1,0 mode: --/PR res: [0x240000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051438.894634:0:27882:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a3200/0x85f51a6b96716946 lrc: 3/1,0 mode: PR/PR res: [0x240000bd2:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 27882 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051438.894671:0:27882:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a3200/0x85f51a6b96716946 lrc: 3/1,0 mode: PR/PR res: [0x240000bd2:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 27882 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1777051438.894694:0:27882:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000bd2:0x2:0x0]: returning size 1048576 00010000:00010000:3.0:1777051438.894830:0:27882:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a3200/0x85f51a6b96716946 lrc: 3/1,0 mode: PR/PR res: [0x240000bd2:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 27882 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051438.894844:0:27882:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a3200/0x85f51a6b96716946 lrc: 2/0,0 mode: PR/PR res: [0x240000bd2:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 27882 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051438.894863:0:27882:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a3200/0x85f51a6b96716946 lrc: 3/0,0 mode: PR/PR res: [0x240000bd2:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 27882 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051438.894872:0:27882:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d9559a3200 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:3.0:1777051438.894877:0:27882:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a3200/0x85f51a6b96716946 lrc: 3/0,0 mode: PR/PR res: [0x240000bd2:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 27882 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051438.894887:0:27882:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a3200/0x85f51a6b96716946 lrc: 4/0,0 mode: PR/PR res: [0x240000bd2:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 27882 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051438.894901:0:27882:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x2:0x0].0x0 (ffff99d94e6b6f00) 00010000:00010000:3.0:1777051438.894906:0:27882:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1777051438.894912:0:27882:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a3200/0x85f51a6b96716946 lrc: 2/0,0 mode: --/PR res: [0x240000bd2:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 27882 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051438.894923:0:27882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a3200/0x85f51a6b96716946 lrc: 0/0,0 mode: --/PR res: [0x240000bd2:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 27882 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051438.894971:0:27882:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a2e00/0x85f51a6b9671693f lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6626 expref: 20 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051438.894989:0:27882:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99d9413d0c00) 00010000:00010000:3.0:1777051438.894993:0:27882:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1777051438.894999:0:27882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a2e00/0x85f51a6b9671693f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6626 expref: 20 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051438.895019:0:27882:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d9559a2e00, rc 0) 00000100:00100000:3.0:1777051438.895075:0:27882:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95fae9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+19:138107:x1863365426016000:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 Request processed in 600us (901us total) trans 8589934686 rc 301/301 00000100:00100000:3.0:1777051438.895088:0:27882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112161 00000100:00100000:2.0:1777051438.897917:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051438.898126:0:21368:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426016128 00000100:00100000:1.0:1777051438.898134:0:21368:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426016128 00000100:00100000:1.0:1777051438.898246:0:21368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112162 00000100:00100000:1.0:1777051438.898258:0:21368:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95fae9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+19:138107:x1863365426016128:12345-192.168.201.46@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1777051438.898290:0:21368:0:(mdt_handler.c:7958:mdt_fid2path()) path get [0x240000bd2:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1777051438.898392:0:21368:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95fae9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+19:138107:x1863365426016128:12345-192.168.201.46@tcp:53:lhsmtool_posix.0 Request processed in 134us (500us total) trans 0 rc -66/-66 00000100:00100000:1.0:1777051438.898404:0:21368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112162 00000100:00100000:2.0:1777051438.901166:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051438.901604:0:8492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426016256 00000100:00100000:0.0:1777051438.901613:0:8492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426016256 00000100:00100000:0.0:1777051438.901674:0:8492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112163 00000100:00100000:0.0:1777051438.901687:0:8492:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7c9a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+23:138107:x1863365426016256:12345-192.168.201.46@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1777051438.902000:0:8492:0:(mdt_handler.c:7958:mdt_fid2path()) path get [0x2000032e2:0x6:0x0] from 18446744073709551615 #-1 00000100:00100000:0.0:1777051438.902182:0:8492:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7c9a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+23:138107:x1863365426016256:12345-192.168.201.46@tcp:53:lhsmtool_posix.0 Request processed in 495us (1018us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051438.902228:0:8492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112163 00000100:00100000:2.0:1777051438.905962:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051438.906529:0:6581:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426016512 00000100:00100000:0.0:1777051438.906538:0:6581:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426016512 00000100:00100000:0.0:1777051438.906614:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112164 00000100:00100000:0.0:1777051438.906628:0:6581:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7c9a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+19:138107:x1863365426016512:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1777051438.906649:0:6581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051438.906675:0:6581:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61a400/0x85f51a6b96716954 lrc: 2/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b662d expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051438.907288:0:6581:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61a000/0x85f51a6b9671695b lrc: 3/1,0 mode: --/PR res: [0x240000bd2:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051438.907308:0:6581:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61a000/0x85f51a6b9671695b lrc: 3/1,0 mode: PR/PR res: [0x240000bd2:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6581 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051438.907323:0:6581:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61a000/0x85f51a6b9671695b lrc: 3/1,0 mode: PR/PR res: [0x240000bd2:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6581 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1777051438.907337:0:6581:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000bd2:0x5:0x0]: returning size 0 00010000:00010000:0.0:1777051438.907393:0:6581:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61a400/0x85f51a6b96716954 lrc: 0/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b662d expref: 22 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051438.907417:0:6581:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61a000/0x85f51a6b9671695b lrc: 3/0,0 mode: PR/PR res: [0x240000bd2:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b662d expref: 21 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051438.907429:0:6581:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x5:0x0].0x0 (ffff99da5fb45600) 00010000:00010000:0.0:1777051438.907433:0:6581:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1777051438.907438:0:6581:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d94e61a000, rc 0) 00000100:00100000:0.0:1777051438.907507:0:6581:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7c9a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+21:138107:x1863365426016512:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 Request processed in 881us (1551us total) trans 8589934687 rc 0/0 00000100:00100000:0.0:1777051438.907518:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112164 00000100:00100000:2.0:1777051438.913039:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051438.913134:0:6580:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426016768 00000100:00100000:3.0:1777051438.913145:0:6580:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426016768 00000100:00100000:3.0:1777051438.913495:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112165 00000100:00100000:3.0:1777051438.913511:0:6580:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7c9a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+21:138107:x1863365426016768:12345-192.168.201.46@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1777051438.913796:0:6580:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777051438.913831:0:6580:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61a000/0x85f51a6b9671695b lrc: 0/0,0 mode: --/PR res: [0x240000bd2:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b662d expref: 21 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051438.913855:0:6580:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x5:0x0].0x0 (ffff99da5fb45600) 00010000:00010000:3.0:1777051438.913872:0:6580:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1777051438.914084:0:6580:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d944a3e400/0x85f51a6b96716969 lrc: 3/0,1 mode: --/CW res: [0x2000032e0:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051438.914098:0:6580:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d944a3e400/0x85f51a6b96716969 lrc: 3/0,1 mode: --/CW res: [0x2000032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6580 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051438.914113:0:6580:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d944a3e400/0x85f51a6b96716969 lrc: 3/0,1 mode: --/CW res: [0x2000032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6580 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051438.914143:0:6580:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7c9a0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6580:1863365452647808:0@lo:101:mdt00_001.0 00000100:00100000:2.0:1777051438.914330:0:6580:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051438.914368:0:6580:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d956bda240 going to sleep for 11 seconds 00000100:00100000:0.0:1777051438.914413:0:47208:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452647808 00000100:00100000:0.0:1777051438.914423:0:47208:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452647808 00000100:00100000:0.0:1777051438.914474:0:47208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8205 00000100:00100000:0.0:1777051438.914485:0:47208:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7c9a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+6:6580:x1863365452647808:12345-0@lo:101:mdt00_001.0 00010000:00010000:0.0:1777051438.914499:0:47208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051438.914521:0:47208:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e61a400/0x85f51a6b96716970 lrc: 2/0,0 mode: --/CW res: [0x2000032e0:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x85f51a6b96716969 expref: -99 pid: 47208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051438.914574:0:47208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e61a400/0x85f51a6b96716970 lrc: 3/0,0 mode: CW/CW res: [0x2000032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x85f51a6b96716969 expref: 7 pid: 47208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051438.914592:0:47208:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e61a400/0x85f51a6b96716970 lrc: 3/0,0 mode: CW/CW res: [0x2000032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b96716969 expref: 7 pid: 47208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051438.914604:0:47208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e0:0x1:0x0].0x0 (ffff99da5fb45f00) 00010000:00010000:0.0:1777051438.914609:0:47208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777051438.914613:0:47208:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d94e61a400, rc 0) 00000100:00100000:0.0:1777051438.914687:0:47208:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7c9a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+7:6580:x1863365452647808:12345-0@lo:101:mdt00_001.0 Request processed in 203us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051438.914697:0:47208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8205 00000100:00100000:3.0:1777051438.914818:0:6580:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7c9a0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6580:1863365452647808:0@lo:101:mdt00_001.0 00010000:00010000:3.0:1777051438.914843:0:6580:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d944a3e400/0x85f51a6b96716969 lrc: 4/0,1 mode: CW/CW res: [0x2000032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x85f51a6b96716970 expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051438.914858:0:6580:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d944a3e400/0x85f51a6b96716969 lrc: 4/0,1 mode: CW/CW res: [0x2000032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x85f51a6b96716970 expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1777051438.914883:0:6580:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x2000032e0:0x1:0x0] 00010000:00010000:3.0:1777051438.914912:0:6580:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d9559a2e00/0x85f51a6b96716977 lrc: 3/0,1 mode: --/PW res: [0x2000032e0:0x1:0x0].0xf8000862 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051438.914923:0:6580:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d9559a2e00/0x85f51a6b96716977 lrc: 3/0,1 mode: --/PW res: [0x2000032e0:0x1:0x0].0xf8000862 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6580 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051438.914934:0:6580:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d9559a2e00/0x85f51a6b96716977 lrc: 3/0,1 mode: --/PW res: [0x2000032e0:0x1:0x0].0xf8000862 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6580 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051438.914958:0:6580:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5fbed180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6580:1863365452647936:0@lo:101:mdt00_001.0 00000100:00100000:3.0:1777051438.914995:0:6580:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051438.915033:0:6580:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d95cb32c00 going to sleep for 11 seconds 00000100:00100000:0.0:1777051438.915119:0:46500:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452647936 00000100:00100000:0.0:1777051438.915128:0:46500:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452647936 00000100:00100000:0.0:1777051438.915185:0:46500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8206 00000100:00100000:0.0:1777051438.915226:0:46500:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5fbee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+7:6580:x1863365452647936:12345-0@lo:101:mdt00_001.0 00010000:00010000:0.0:1777051438.915241:0:46500:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051438.915261:0:46500:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e61b200/0x85f51a6b9671697e lrc: 2/0,0 mode: --/PW res: [0x2000032e0:0x1:0x0].0xf8000862 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x85f51a6b96716977 expref: -99 pid: 46500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051438.915287:0:46500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e61b200/0x85f51a6b9671697e lrc: 3/0,0 mode: PW/PW res: [0x2000032e0:0x1:0x0].0xf8000862 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x85f51a6b96716977 expref: 8 pid: 46500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051438.915304:0:46500:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e61b200/0x85f51a6b9671697e lrc: 3/0,0 mode: PW/PW res: [0x2000032e0:0x1:0x0].0xf8000862 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b96716977 expref: 8 pid: 46500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051438.915316:0:46500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e0:0x1:0x0].0xf8000862 (ffff99da5fb45700) 00010000:00010000:0.0:1777051438.915320:0:46500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777051438.915324:0:46500:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d94e61b200, rc 0) 00000100:00100000:0.0:1777051438.915380:0:46500:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5fbee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+8:6580:x1863365452647936:12345-0@lo:101:mdt00_001.0 Request processed in 184us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051438.915391:0:46500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8206 00000100:00100000:3.0:1777051438.915455:0:6580:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5fbed180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6580:1863365452647936:0@lo:101:mdt00_001.0 00010000:00010000:3.0:1777051438.915472:0:6580:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d9559a2e00/0x85f51a6b96716977 lrc: 4/0,1 mode: PW/PW res: [0x2000032e0:0x1:0x0].0xf8000862 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x85f51a6b9671697e expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051438.915485:0:6580:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d9559a2e00/0x85f51a6b96716977 lrc: 4/0,1 mode: PW/PW res: [0x2000032e0:0x1:0x0].0xf8000862 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x85f51a6b9671697e expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1777051438.915505:0:6580:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x2000032e0:0x1:0x0] 00000100:00100000:3.0:1777051438.915547:0:6580:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5fbed180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6580:1863365452648064:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1777051438.915584:0:6580:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051438.915616:0:6580:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d95cb32600 going to sleep for 11 seconds 00000100:00100000:0.0:1777051438.915689:0:6585:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452648064 00000100:00100000:0.0:1777051438.915698:0:6585:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452648064 00000100:00100000:0.0:1777051438.915742:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8207 00000100:00100000:0.0:1777051438.915752:0:6585:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5fbece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:6580:x1863365452648064:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1777051438.915877:0:6585:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5fbece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:6580:x1863365452648064:12345-0@lo:1000:mdt00_001.0 Request processed in 124us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051438.915887:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8207 00000100:00100000:3.0:1777051438.915941:0:6580:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5fbed180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6580:1863365452648064:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1777051438.916023:0:6580:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5fbed180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6580:1863365452648192:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1777051438.916713:0:6580:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051438.916744:0:6580:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d95cb32600 going to sleep for 11 seconds 00000100:00100000:0.0:1777051438.916820:0:47208:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452648192 00000100:00100000:0.0:1777051438.916828:0:47208:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452648192 00000100:00100000:0.0:1777051438.916873:0:47208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8208 00000100:00100000:0.0:1777051438.916883:0:47208:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da45f74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+8:6580:x1863365452648192:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1777051438.917024:0:47208:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da45f74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+8:6580:x1863365452648192:12345-0@lo:1000:mdt00_001.0 Request processed in 140us (311us total) trans 0 rc -2/-2 00000100:00100000:0.0:1777051438.917040:0:47208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8208 00000100:00100000:1.0:1777051438.917310:0:6580:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5fbed180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6580:1863365452648192:0@lo:1000:mdt00_001.0 00000004:00080000:1.0:1777051438.917338:0:6580:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x2000032e0:0x1:0x0] 00010000:00010000:1.0:1777051438.917346:0:6580:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d944a3e400/0x85f51a6b96716969 lrc: 4/0,1 mode: CW/CW res: [0x2000032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x85f51a6b96716970 expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051438.917360:0:6580:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d944a3e400/0x85f51a6b96716969 lrc: 4/0,1 mode: CW/CW res: [0x2000032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x85f51a6b96716970 expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051438.917370:0:6580:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d944a3e400/0x85f51a6b96716969 lrc: 3/0,0 mode: CW/CW res: [0x2000032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x85f51a6b96716970 expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051438.917407:0:6580:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1777051438.917415:0:6580:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x2000032e0:0x1:0x0] 00010000:00010000:1.0:1777051438.917421:0:6580:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d9559a2e00/0x85f51a6b96716977 lrc: 4/0,1 mode: PW/PW res: [0x2000032e0:0x1:0x0].0xf8000862 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x85f51a6b9671697e expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051438.917431:0:6580:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d9559a2e00/0x85f51a6b96716977 lrc: 4/0,1 mode: PW/PW res: [0x2000032e0:0x1:0x0].0xf8000862 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x85f51a6b9671697e expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051438.917442:0:6580:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d9559a2e00/0x85f51a6b96716977 lrc: 3/0,0 mode: PW/PW res: [0x2000032e0:0x1:0x0].0xf8000862 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x85f51a6b9671697e expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051438.917469:0:6580:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:1.0:1777051438.917559:0:6580:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7c9a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+20:138107:x1863365426016768:12345-192.168.201.46@tcp:36:lhsmtool_posix.0 Request processed in 4050us (4527us total) trans 0 rc -2/-2 00000100:00100000:1.0:1777051438.917571:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112165 00010000:00010000:0.0:1777051438.917643:0:38719:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1777051438.917654:0:38719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d944a3e400/0x85f51a6b96716969 lrc: 2/0,0 mode: CW/CW res: [0x2000032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x85f51a6b96716970 expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051438.917668:0:38719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d944a3e400 already unused, calling callback (ffffffffc177eed0) 00010000:00010000:0.0:1777051438.917676:0:38719:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d944a3e400/0x85f51a6b96716969 lrc: 3/0,0 mode: CW/CW res: [0x2000032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x85f51a6b96716970 expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1777051438.917690:0:38719:0:(mdt_handler.c:3963:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d944a3e400/0x85f51a6b96716969 lrc: 3/0,0 mode: CW/CW res: [0x2000032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x85f51a6b96716970 expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051438.917725:0:38719:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d944a3e400/0x85f51a6b96716969 lrc: 2/0,0 mode: --/CW res: [0x2000032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x85f51a6b96716970 expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051438.917736:0:38719:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1777051438.917763:0:6568:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777051438.917800:0:6568:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d9559a2e00/0x85f51a6b96716977 lrc: 2/0,0 mode: PW/PW res: [0x2000032e0:0x1:0x0].0xf8000862 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x85f51a6b9671697e expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051438.917810:0:38719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d944a3e400/0x85f51a6b96716969 lrc: 1/0,0 mode: --/CW res: [0x2000032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x85f51a6b96716970 expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051438.917852:0:6568:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d9559a2e00 already unused, calling callback (ffffffffc177eed0) 00010000:00010000:0.0:1777051438.917854:0:38719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d944a3e400/0x85f51a6b96716969 lrc: 0/0,0 mode: --/CW res: [0x2000032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x85f51a6b96716970 expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051438.917863:0:6568:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d9559a2e00/0x85f51a6b96716977 lrc: 3/0,0 mode: PW/PW res: [0x2000032e0:0x1:0x0].0xf8000862 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x85f51a6b9671697e expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1777051438.917880:0:6568:0:(mdt_handler.c:3963:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d9559a2e00/0x85f51a6b96716977 lrc: 3/0,0 mode: PW/PW res: [0x2000032e0:0x1:0x0].0xf8000862 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x85f51a6b9671697e expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051438.917886:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777051438.917900:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777051438.917904:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777051438.917914:0:6568:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d9559a2e00/0x85f51a6b96716977 lrc: 2/0,0 mode: --/PW res: [0x2000032e0:0x1:0x0].0xf8000862 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x85f51a6b9671697e expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051438.917926:0:6568:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1777051438.917960:0:6568:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d9559a2e00/0x85f51a6b96716977 lrc: 1/0,0 mode: --/PW res: [0x2000032e0:0x1:0x0].0xf8000862 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x85f51a6b9671697e expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051438.917971:0:6568:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d9559a2e00/0x85f51a6b96716977 lrc: 0/0,0 mode: --/PW res: [0x2000032e0:0x1:0x0].0xf8000862 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x85f51a6b9671697e expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051438.917997:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7c9a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452648448:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1777051438.917998:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777051438.918003:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777051438.918010:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1777051438.918029:0:3677:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1777051438.918047:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da444a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452648320:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1777051438.918060:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051438.918104:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051438.918156:0:6564:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452648448 00000100:00100000:2.0:1777051438.918163:0:6564:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452648448 00000100:00100000:0.0:1777051438.918695:0:24467:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452648320 00000100:00100000:0.0:1777051438.918704:0:24467:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452648320 00000100:00100000:2.0:1777051438.919096:0:6564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13701 00000100:00100000:2.0:1777051438.919112:0:6564:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fd64000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+9:3679:x1863365452648448:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1777051438.919141:0:6564:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777051438.919163:0:6564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e61b200/0x85f51a6b9671697e lrc: 0/0,0 mode: --/PW res: [0x2000032e0:0x1:0x0].0xf8000862 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x85f51a6b96716977 expref: 9 pid: 46500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051438.919188:0:24467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13702 00000100:00100000:0.0:1777051438.919206:0:24467:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7c9a0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+8:3677:x1863365452648320:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1777051438.919222:0:24467:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777051438.919225:0:6564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e0:0x1:0x0].0xf8000862 (ffff99da5fb45700) 00010000:00010000:2.0:1777051438.919243:0:6564:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1777051438.919246:0:24467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e61a400/0x85f51a6b96716970 lrc: 0/0,0 mode: --/CW res: [0x2000032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x85f51a6b96716969 expref: 8 pid: 47208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051438.919301:0:6564:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fd64000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+7:3679:x1863365452648448:12345-0@lo:103:ldlm_bl.0 Request processed in 190us (1241us total) trans 0 rc 0/0 00010000:00010000:0.0:1777051438.919304:0:24467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e0:0x1:0x0].0x0 (ffff99da5fb45f00) 00000100:00100000:2.0:1777051438.919320:0:6564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13701 00010000:00010000:0.0:1777051438.919327:0:24467:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1777051438.919372:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7c9a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452648448:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1777051438.919418:0:24467:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7c9a0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+6:3677:x1863365452648320:12345-0@lo:103:ldlm_bl.0 Request processed in 214us (1312us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051438.919423:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da444a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452648320:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1777051438.919438:0:24467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13702 00000100:00100000:2.0:1777051438.924484:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051438.924586:0:10328:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426016896 00000100:00100000:0.0:1777051438.924595:0:10328:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426016896 00000100:00100000:0.0:1777051438.924654:0:10328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112166 00000100:00100000:0.0:1777051438.924668:0:10328:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7c9a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+20:138107:x1863365426016896:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1777051438.924702:0:10328:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051438.924983:0:10328:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61a000/0x85f51a6b96716985 lrc: 2/0,0 mode: --/PR res: [0x240000bd2:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6634 expref: -99 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051438.925032:0:10328:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61bc00/0x85f51a6b9671698c lrc: 3/1,0 mode: --/PR res: [0x240000bd2:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051438.925049:0:10328:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61bc00/0x85f51a6b9671698c lrc: 3/1,0 mode: PR/PR res: [0x240000bd2:0x5:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10328 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051438.925064:0:10328:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61bc00/0x85f51a6b9671698c lrc: 3/1,0 mode: PR/PR res: [0x240000bd2:0x5:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10328 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051438.925200:0:10328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61a000/0x85f51a6b96716985 lrc: 0/0,0 mode: --/PR res: [0x240000bd2:0x5:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6634 expref: 22 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051438.925224:0:10328:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61bc00/0x85f51a6b9671698c lrc: 3/0,0 mode: PR/PR res: [0x240000bd2:0x5:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6634 expref: 21 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051438.925236:0:10328:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x5:0x0].0x0 (ffff99da5fb45600) 00010000:00010000:0.0:1777051438.925240:0:10328:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1777051438.925244:0:10328:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d94e61bc00, rc 0) 00000100:00100000:0.0:1777051438.925659:0:10328:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7c9a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+21:138107:x1863365426016896:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 Request processed in 991us (1178us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051438.925671:0:10328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112166 00000100:00100000:1.0:1777051438.928966:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051438.929041:0:46494:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426017152 00000100:00100000:0.0:1777051438.929050:0:46494:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426017152 00000100:00100000:0.0:1777051438.929104:0:46494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112167 00000100:00100000:0.0:1777051438.929113:0:46494:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da45f77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c11b6966-0775-44d2-bdc6-c74c26eb2226+21:138107:x1863365426017152:12345-192.168.201.46@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1777051438.929186:0:46494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61ac00/0x85f51a6b96716993 lrc: 3/0,1 mode: --/PW res: [0x240000bd2:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051438.929207:0:46494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61ac00/0x85f51a6b96716993 lrc: 3/0,1 mode: PW/PW res: [0x240000bd2:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 46494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051438.929223:0:46494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61ac00/0x85f51a6b96716993 lrc: 3/0,1 mode: PW/PW res: [0x240000bd2:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 46494 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1777051438.929396:0:46494:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000007944c681 reply state 00000000f6b97b2d transno 8589934688 ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61ac00/0x85f51a6b96716993 lrc: 3/0,1 mode: PW/PW res: [0x240000bd2:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 46494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051438.929447:0:46494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61ac00/0x85f51a6b96716993 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd2:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 46494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051438.929458:0:46494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x5:0x0].0x0 (ffff99da5fb45600) 00010000:00010000:0.0:1777051438.929462:0:46494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1777051438.929467:0:46494:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1777051438.929683:0:46494:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da45f77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c11b6966-0775-44d2-bdc6-c74c26eb2226+23:138107:x1863365426017152:12345-192.168.201.46@tcp:36:lhsmtool_posix.0 Request processed in 567us (719us total) trans 8589934688 rc 0/0 00000100:00100000:0.0:1777051438.929695:0:46494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112167 00000100:00100000:2.0:1777051438.935849:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051438.936191:0:8492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426017280 00000100:00100000:0.0:1777051438.936203:0:8492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426017280 00000100:00100000:0.0:1777051438.936270:0:8492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112168 00000100:00100000:0.0:1777051438.936283:0:8492:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7c9a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+23:138107:x1863365426017280:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1777051438.936311:0:8492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051438.936334:0:8492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61a400/0x85f51a6b9671699a lrc: 2/0,0 mode: --/CR res: [0x240000bd2:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b663b expref: -99 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051438.936399:0:8492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61a400/0x85f51a6b9671699a lrc: 3/0,0 mode: CR/CR res: [0x240000bd2:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b663b expref: 24 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051438.936421:0:8492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61a400/0x85f51a6b9671699a lrc: 3/0,0 mode: CR/CR res: [0x240000bd2:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b663b expref: 24 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051438.936435:0:8492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x5:0x0].0x0 (ffff99da5fb45600) 00010000:00010000:0.0:1777051438.936440:0:8492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1777051438.936445:0:8492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d94e61a400, rc 0) 00000100:00100000:0.0:1777051438.936509:0:8492:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7c9a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+24:138107:x1863365426017280:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 Request processed in 227us (665us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051438.936521:0:8492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112168 00000100:00100000:2.0:1777051438.939424:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051438.939516:0:24269:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426017408 00000100:00100000:1.0:1777051438.939525:0:24269:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426017408 00000100:00100000:1.0:1777051438.939586:0:24269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3380 00000100:00100000:1.0:1777051438.939599:0:24269:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da6ff03450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+24:138107:x1863365426017408:12345-192.168.201.46@tcp:49:lhsmtool_posix.0 00000100:00100000:1.0:1777051438.939718:0:24269:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da6ff03450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+24:138107:x1863365426017408:12345-192.168.201.46@tcp:49:lhsmtool_posix.0 Request processed in 120us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051438.939731:0:24269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3380 00000100:00100000:1.0:1777051438.942349:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051438.942539:0:46501:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426017664 00000100:00100000:2.0:1777051438.942547:0:46501:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426017664 00000100:00100000:2.0:1777051438.942679:0:46501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3381 00000100:00100000:2.0:1777051438.942694:0:46501:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da45f76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+24:138107:x1863365426017664:12345-192.168.201.46@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1777051438.942945:0:46501:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da45f76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+25:138107:x1863365426017664:12345-192.168.201.46@tcp:35:lhsmtool_posix.0 Request processed in 253us (597us total) trans 8589934689 rc 0/0 00000100:00100000:2.0:1777051438.942982:0:46501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3381 00000100:00100000:3.0:1777051438.946275:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051438.946324:0:6581:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426017920 00000100:00100000:0.0:1777051438.946331:0:6581:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426017920 00000100:00100000:0.0:1777051438.946395:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112169 00000100:00100000:0.0:1777051438.946405:0:6581:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5fbed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+25:138107:x1863365426017920:12345-192.168.201.46@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1777051438.946633:0:6581:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5fbed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+25:138107:x1863365426017920:12345-192.168.201.46@tcp:57:lhsmtool_posix.0 Request processed in 225us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051438.946645:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112169 00000100:00100000:0.0:1777051438.949985:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051438.950093:0:46497:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426018176 00000100:00100000:1.0:1777051438.950103:0:46497:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426018176 00000100:00100000:1.0:1777051438.950167:0:46497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112170 00000100:00100000:1.0:1777051438.950180:0:46497:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fd65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:c11b6966-0775-44d2-bdc6-c74c26eb2226+25:138107:x1863365426018176:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1777051438.950592:0:46497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777051438.950619:0:46497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72fe00/0x85f51a6b967169a1 lrc: 2/0,0 mode: --/CR res: [0x240000bd2:0x5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6642 expref: -99 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051438.950756:0:46497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72e600/0x85f51a6b967169a8 lrc: 3/0,1 mode: --/EX res: [0x240000bd2:0x5:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051438.950808:0:46497:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61a400/0x85f51a6b9671699a lrc: 2/0,0 mode: CR/CR res: [0x240000bd2:0x5:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b663b expref: 26 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051438.950822:0:46497:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72e600/0x85f51a6b967169a8 lrc: 4/0,1 mode: --/EX res: [0x240000bd2:0x5:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051438.950875:0:46497:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61a400/0x85f51a6b9671699a lrc: 3/0,0 mode: CR/CR res: [0x240000bd2:0x5:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b663b expref: 26 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051438.950897:0:46497:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61a400/0x85f51a6b9671699a lrc: 4/0,0 mode: CR/CR res: [0x240000bd2:0x5:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b663b expref: 26 pid: 8492 timeout: 8168 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051438.950918:0:46497:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da45f75880 pname:cluuid:pid:xid:nid:opc:job mdt00_009:lustre-MDT0001_UUID:46497:1863365452648576:192.168.201.46@tcp:104: 00000100:00100000:1.0:1777051438.951015:0:46497:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d941082000 going to sleep for 11 seconds 00000100:00100000:1.0:1777051438.955412:0:46497:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da45f75880 pname:cluuid:pid:xid:nid:opc:job mdt00_009:lustre-MDT0001_UUID:46497:1863365452648576:192.168.201.46@tcp:104: 00000100:00100000:2.0:1777051438.955425:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00010000:00010000:1.0:1777051438.955449:0:46497:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72e600/0x85f51a6b967169a8 lrc: 3/0,1 mode: --/EX res: [0x240000bd2:0x5:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051438.955522:0:47597:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426018304 00000100:00100000:3.0:1777051438.955683:0:47597:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426018304 00010000:00010000:3.0:1777051438.955730:0:47597:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61a400/0x85f51a6b9671699a lrc: 4/0,0 mode: CR/CR res: [0x240000bd2:0x5:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b663b expref: 27 pid: 8492 timeout: 8168 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051438.955814:0:47597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3909 00000100:00100000:3.0:1777051438.955831:0:47597:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7c9a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+27:2437:x1863365426018304:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1777051438.955848:0:47597:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777051438.955860:0:47597:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61a400/0x85f51a6b9671699a lrc: 4/0,0 mode: CR/CR res: [0x240000bd2:0x5:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b663b expref: 27 pid: 8492 timeout: 8168 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051438.955880:0:47597:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61a400/0x85f51a6b9671699a lrc: 3/0,0 mode: CR/CR res: [0x240000bd2:0x5:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b663b expref: 27 pid: 8492 timeout: 8168 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051438.955911:0:47597:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61a400/0x85f51a6b9671699a lrc: 0/0,0 mode: --/CR res: [0x240000bd2:0x5:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b663b expref: 27 pid: 8492 timeout: 8168 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051438.955939:0:47597:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x5:0x0].0x0 (ffff99da5fb45600) 00010000:00010000:3.0:1777051438.955947:0:47597:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72e600/0x85f51a6b967169a8 lrc: 3/0,1 mode: --/EX res: [0x240000bd2:0x5:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051438.955961:0:47597:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72e600/0x85f51a6b967169a8 lrc: 3/0,1 mode: EX/EX res: [0x240000bd2:0x5:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051438.955973:0:47597:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72e600/0x85f51a6b967169a8 lrc: 4/0,1 mode: EX/EX res: [0x240000bd2:0x5:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051438.956112:0:47597:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1777051438.956162:0:46497:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72e600/0x85f51a6b967169a8 lrc: 3/0,1 mode: EX/EX res: [0x240000bd2:0x5:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051438.956178:0:46497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72e600/0x85f51a6b967169a8 lrc: 3/0,1 mode: EX/EX res: [0x240000bd2:0x5:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1777051438.956225:0:46497:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000bd2:0x5:0x0]: returning size 0 00000100:00100000:2.0:1777051438.956282:0:47597:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7c9a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+26:2437:x1863365426018304:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 450us (862us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051438.956351:0:47597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3909 00000004:00080000:1.0:1777051438.956432:0:46497:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x105:0x0], index 0: 0 00010000:00010000:1.0:1777051438.956560:0:46497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72e600/0x85f51a6b967169a8 lrc: 3/0,1 mode: EX/EX res: [0x240000bd2:0x5:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051438.956574:0:46497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72e600/0x85f51a6b967169a8 lrc: 2/0,0 mode: EX/EX res: [0x240000bd2:0x5:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051438.956585:0:46497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72e600/0x85f51a6b967169a8 lrc: 3/0,0 mode: EX/EX res: [0x240000bd2:0x5:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051438.956595:0:46497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94d72e600 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:1.0:1777051438.956602:0:46497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72e600/0x85f51a6b967169a8 lrc: 3/0,0 mode: EX/EX res: [0x240000bd2:0x5:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051438.956614:0:46497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72e600/0x85f51a6b967169a8 lrc: 4/0,0 mode: EX/EX res: [0x240000bd2:0x5:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051438.956630:0:46497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x5:0x0].0x0 (ffff99da5fb45600) 00010000:00010000:1.0:1777051438.956634:0:46497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1777051438.956641:0:46497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72e600/0x85f51a6b967169a8 lrc: 2/0,0 mode: --/EX res: [0x240000bd2:0x5:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051438.956651:0:46497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72e600/0x85f51a6b967169a8 lrc: 0/0,0 mode: --/EX res: [0x240000bd2:0x5:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051438.956705:0:46497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72fe00/0x85f51a6b967169a1 lrc: 1/0,0 mode: --/CR res: [0x240000bd2:0x5:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6642 expref: 26 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051438.956720:0:46497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x5:0x0].0x0 (ffff99da5fb45600) 00010000:00010000:1.0:1777051438.956726:0:46497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1777051438.956732:0:46497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72fe00/0x85f51a6b967169a1 lrc: 0/0,0 mode: --/CR res: [0x240000bd2:0x5:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6642 expref: 26 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051438.956746:0:46497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d94d72fe00, rc 0) 00000100:00100000:1.0:1777051438.956833:0:46497:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fd65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:c11b6966-0775-44d2-bdc6-c74c26eb2226+25:138107:x1863365426018176:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 Request processed in 6652us (6849us total) trans 8589934690 rc 301/301 00000100:00100000:1.0:1777051438.956847:0:46497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112170 00000100:00100000:2.0:1777051438.959626:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051438.959702:0:24269:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426018560 00000100:00100000:1.0:1777051438.959712:0:24269:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426018560 00000100:00100000:1.0:1777051438.960070:0:24269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3382 00000100:00100000:1.0:1777051438.960081:0:24269:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7c9a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+25:138107:x1863365426018560:12345-192.168.201.46@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1777051438.960350:0:24269:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7c9a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+26:138107:x1863365426018560:12345-192.168.201.46@tcp:35:lhsmtool_posix.0 Request processed in 267us (725us total) trans 8589934691 rc 0/0 00000100:00100000:1.0:1777051438.960363:0:24269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3382 00000100:00100000:3.0:1777051438.965028:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051438.965518:0:27882:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426018688 00000100:00100000:2.0:1777051438.965529:0:27882:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426018688 00000100:00100000:2.0:1777051438.965592:0:27882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112171 00000100:00100000:2.0:1777051438.965606:0:27882:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5fbec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+26:138107:x1863365426018688:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1777051438.965631:0:27882:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051438.965655:0:27882:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d944a3f800/0x85f51a6b967169b6 lrc: 2/0,0 mode: --/CR res: [0x240000bd2:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6649 expref: -99 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051438.965737:0:27882:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d944a3f600/0x85f51a6b967169bd lrc: 3/1,0 mode: --/PR res: [0x240000bd2:0x5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051438.966041:0:27882:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d944a3f600/0x85f51a6b967169bd lrc: 3/1,0 mode: PR/PR res: [0x240000bd2:0x5:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 27882 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051438.966059:0:27882:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d944a3f600/0x85f51a6b967169bd lrc: 3/1,0 mode: PR/PR res: [0x240000bd2:0x5:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 27882 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1777051438.966105:0:27882:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000bd2:0x5:0x0]: returning size 0 00000004:00200000:2.0:1777051438.966111:0:27882:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1777051438.966134:0:27882:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff99d944a3f600/0x85f51a6b967169bd lrc: 3/1,0 mode: PR/PR res: [0x240000bd2:0x5:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 27882 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051438.966168:0:27882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d944a3f800/0x85f51a6b967169b6 lrc: 0/0,0 mode: --/CR res: [0x240000bd2:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6649 expref: 28 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051438.966190:0:27882:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99d944a3f600/0x85f51a6b967169bd lrc: 3/0,0 mode: PR/PR res: [0x240000bd2:0x5:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6649 expref: 27 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051438.966246:0:27882:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x5:0x0].0x0 (ffff99da5fb45600) 00010000:00010000:2.0:1777051438.966251:0:27882:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1777051438.966256:0:27882:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d944a3f600, rc 0) 00000100:00100000:2.0:1777051438.966360:0:27882:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5fbec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+27:138107:x1863365426018688:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 Request processed in 755us (1337us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051438.966372:0:27882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112171 00000100:00100000:0.0:1777051438.972756:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051438.972881:0:13320:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426018816 00000100:00100000:1.0:1777051438.972892:0:13320:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426018816 00000100:00080000:2.0:1777051438.972983:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1777051438.972993:0:13320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 8043 00000100:00100000:1.0:1777051438.973011:0:13320:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fd67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+51:2436:x1863365426018816:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1777051438.973032:0:13320:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777051438.973057:0:13320:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000089826651/0x85f51a6b967169c4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x105:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6650 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1777051438.973093:0:13320:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x105:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777051438.973113:0:13320:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051438.973116:0:13320:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051438.973126:0:13320:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000089826651/0x85f51a6b967169c4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x105:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6650 expref: 52 pid: 13320 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051438.973147:0:13320:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000089826651/0x85f51a6b967169c4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x105:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6650 expref: 52 pid: 13320 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051438.973162:0:13320:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d94d72fe00, rc 0) 00000100:00100000:1.0:1777051438.973289:0:13320:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fd67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+52:2436:x1863365426018816:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 Request processed in 280us (537us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051438.973304:0:13320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 8043 00000100:00100000:0.0:1777051438.986875:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051438.987516:0:21368:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426019072 00000100:00100000:1.0:1777051438.987532:0:21368:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426019072 00000100:00100000:1.0:1777051438.987625:0:21368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112172 00000100:00100000:1.0:1777051438.987643:0:21368:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fd65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+27:138107:x1863365426019072:12345-192.168.201.46@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1777051438.987827:0:21368:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fd65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+27:138107:x1863365426019072:12345-192.168.201.46@tcp:57:lhsmtool_posix.0 Request processed in 186us (981us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051438.987842:0:21368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112172 00000100:00100000:3.0:1777051438.999664:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051438.999823:0:27884:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426019200 00000100:00100000:2.0:1777051438.999838:0:27884:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426019200 00000100:00100000:2.0:1777051438.999937:0:27884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 8044 00000100:00100000:2.0:1777051438.999954:0:27884:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5fbed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+52:138107:x1863365426019200:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1777051438.999980:0:27884:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051439.000008:0:27884:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010d8627e/0x85f51a6b967169cb lrc: 2/0,0 mode: --/PW res: [0x280000400:0x105:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6657 expref: -99 pid: 27884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051439.000205:0:27884:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000089826651/0x85f51a6b967169c4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x105:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6650 expref: 53 pid: 13320 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051439.000223:0:27884:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777051439.000740:0:27884:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777051439.000750:0:27884:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010d8627e/0x85f51a6b967169cb lrc: 4/0,0 mode: --/PW res: [0x280000400:0x105:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6657 expref: 53 pid: 27884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051439.000851:0:27884:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000089826651/0x85f51a6b967169c4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x105:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6650 expref: 53 pid: 13320 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051439.000888:0:27884:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000089826651/0x85f51a6b967169c4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x105:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6650 expref: 53 pid: 13320 timeout: 8168 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051439.000912:0:27884:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7c9a3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:27884:1863365452648704:192.168.201.46@tcp:104: 00000100:00100000:2.0:1777051439.001023:0:27884:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d956bda300 going to sleep for 11 seconds 00000100:00100000:0.0:1777051439.008913:0:27884:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7c9a3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:27884:1863365452648704:192.168.201.46@tcp:104: 00010000:00010000:0.0:1777051439.008961:0:27884:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000010d8627e/0x85f51a6b967169cb lrc: 3/0,0 mode: --/PW res: [0x280000400:0x105:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6657 expref: 53 pid: 27884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051439.008991:0:27884:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d944a3e800, rc 0) 00000100:00100000:0.0:1777051439.009079:0:27884:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5fbed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+53:138107:x1863365426019200:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 Request processed in 9128us (9423us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051439.009095:0:27884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 8044 00000100:00100000:3.0:1777051439.011001:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051439.011683:0:6566:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426019328 00000100:00100000:1.0:1777051439.011695:0:6566:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426019328 00010000:00010000:1.0:1777051439.011742:0:6566:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000089826651/0x85f51a6b967169c4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x105:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6650 expref: 53 pid: 13320 timeout: 8168 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051439.011828:0:6566:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3910 00000100:00100000:1.0:1777051439.011844:0:6566:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da6fd40450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+53:2437:x1863365426019328:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1777051439.011865:0:6566:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1777051439.011894:0:6566:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000089826651/0x85f51a6b967169c4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x105:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6650 expref: 53 pid: 13320 timeout: 8168 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051439.011919:0:6566:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000089826651/0x85f51a6b967169c4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x105:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6650 expref: 53 pid: 13320 timeout: 8168 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051439.011952:0:6566:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000089826651/0x85f51a6b967169c4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x105:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6650 expref: 53 pid: 13320 timeout: 8168 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051439.011974:0:6566:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051439.011978:0:6566:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051439.011988:0:6566:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000010d8627e/0x85f51a6b967169cb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x105:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6657 expref: 52 pid: 27884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051439.012005:0:6566:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010d8627e/0x85f51a6b967169cb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x105:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6657 expref: 52 pid: 27884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051439.012052:0:6566:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000010d8627e/0x85f51a6b967169cb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x105:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6657 expref: 52 pid: 27884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051439.012086:0:6566:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da45f75880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6566:1863365452648832:192.168.201.46@tcp:105: 00000100:00100000:1.0:1777051439.014797:0:6566:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d941082840 going to sleep for 11 seconds 00000100:00100000:1.0:1777051439.017080:0:6566:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da45f75880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6566:1863365452648832:192.168.201.46@tcp:105: 00010000:00010000:1.0:1777051439.017111:0:6566:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1777051439.017181:0:6566:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da6fd40450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+52:2437:x1863365426019328:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 5338us (6180us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051439.017197:0:6566:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3910 00000100:00100000:3.0:1777051439.053741:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051439.053891:0:43492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426019456 00000100:00100000:1.0:1777051439.053906:0:43492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426019456 00002000:00100000:1.0:1777051439.053973:0:43492:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000400:0x105:0x0] (0->1048575) req@ffff99da5fbef800 x1863365426019456/t0(0) o4->c11b6966-0775-44d2-bdc6-c74c26eb2226@192.168.201.46@tcp:400/0 lens 488/0 e 0 to 0 dl 1777051450 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1777051439.053993:0:43492:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99da5fbef800 with x1863365426019456 ext(0->1048575) 00002000:00010000:1.0:1777051439.054003:0:43492:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99da5fbef800 00000100:00100000:1.0:1777051439.054173:0:43492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 1775 00000100:00100000:1.0:1777051439.054194:0:43492:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5fbef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+52:2436:x1863365426019456:12345-192.168.201.46@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1777051439.097600:0:43492:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5fbef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+54:2436:x1863365426019456:12345-192.168.201.46@tcp:4:lhsmtool_posix.0 Request processed in 43398us (43857us total) trans 4294968362 rc 0/0 00000100:00100000:1.0:1777051439.097624:0:43492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 1775 00002000:00100000:1.0:1777051439.097646:0:43492:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000400:0x105:0x0] (0->1048575) req@ffff99da5fbef800 x1863365426019456/t4294968362(0) o4->c11b6966-0775-44d2-bdc6-c74c26eb2226@192.168.201.46@tcp:400/0 lens 488/448 e 0 to 0 dl 1777051450 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1777051439.097667:0:43492:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99da5fbef800 with x1863365426019456 ext(0->1048575) 00002000:00010000:1.0:1777051439.097974:0:43492:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99da5fbef800 00000100:00100000:3.0:1777051439.103071:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051439.103323:0:8492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426019584 00000100:00100000:0.0:1777051439.103337:0:8492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426019584 00000100:00100000:0.0:1777051439.103504:0:8492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112173 00000100:00100000:0.0:1777051439.103522:0:8492:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5fbed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+27:138107:x1863365426019584:12345-192.168.201.46@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1777051439.107681:0:104205:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934691 is committed 00000001:00080000:1.0:1777051439.107716:0:104205:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934685 is committed 00000004:00080000:1.0:1777051439.107727:0:104205:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 4 committed 00010000:00010000:0.0:1777051439.108065:0:3663:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72e000/0x85f51a6b967168b3 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1777051439.108069:0:104205:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff99d95cf51cc0 refcount 2 committed 0 result 0 batchid 4294970581 00000020:00080000:1.0:1777051439.108083:0:104205:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff99da7cc02400 obd lustre-OST0001-osc-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff99d95cf51780 00000020:00080000:1.0:1777051439.108099:0:104205:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff99da7cc02b00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff99d9537d0e00 00010000:00010000:0.0:1777051439.108101:0:3663:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72e000/0x85f51a6b967168b3 lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051439.108119:0:3663:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72e000/0x85f51a6b967168b3 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051439.108425:0:3663:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94d72e000 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:0.0:1777051439.108436:0:3663:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72e000/0x85f51a6b967168b3 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1777051439.108441:0:104205:0:(update_trans.c:1333:distribute_txn_batchid_cb()) lustre-MDT0001: 4294970580 batchid updated 00010000:00010000:0.0:1777051439.108458:0:3663:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72e000/0x85f51a6b967168b3 lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051439.108487:0:3663:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x4:0x0].0x0 (ffff99da5fb45500) 00000020:00080000:2.0:1777051439.108487:0:104230:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 4294970581 committed batchid 4294970580 00010000:00010000:0.0:1777051439.108499:0:3663:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777051439.108508:0:3663:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72e000/0x85f51a6b967168b3 lrc: 2/0,0 mode: --/TXN res: [0x240000bd2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051439.108522:0:3663:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72e000/0x85f51a6b967168b3 lrc: 0/0,0 mode: --/TXN res: [0x240000bd2:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051439.108566:0:3663:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61ac00/0x85f51a6b96716993 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd2:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 46494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051439.108580:0:3663:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61ac00/0x85f51a6b96716993 lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd2:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 46494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051439.108593:0:3663:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61ac00/0x85f51a6b96716993 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd2:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 46494 initiator: MDT1 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1777051439.108601:0:104230:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 4294970580 00010000:00010000:0.0:1777051439.108604:0:3663:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94e61ac00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:0.0:1777051439.108614:0:3663:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61ac00/0x85f51a6b96716993 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd2:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 46494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051439.108628:0:3663:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61ac00/0x85f51a6b96716993 lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd2:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 46494 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051439.108646:0:8492:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5fbed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+11:138107:x1863365426019584:12345-192.168.201.46@tcp:44:lhsmtool_posix.0 Request processed in 5121us (5577us total) trans 0 rc 0/0 00010000:00010000:0.0:1777051439.108647:0:3663:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x5:0x0].0x0 (ffff99da5fb45600) 00010000:00010000:0.0:1777051439.108658:0:3663:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1777051439.108665:0:3663:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61ac00/0x85f51a6b96716993 lrc: 2/0,0 mode: --/TXN res: [0x240000bd2:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 46494 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051439.108675:0:8492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112173 00010000:00010000:0.0:1777051439.108688:0:3663:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61ac00/0x85f51a6b96716993 lrc: 0/0,0 mode: --/TXN res: [0x240000bd2:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 46494 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051439.110352:0:3679:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1777051439.110377:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5fbedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452648960:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1777051439.110451:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051439.112425:0:55805:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452648960 00000100:00100000:1.0:1777051439.112437:0:55805:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452648960 00000100:00100000:1.0:1777051439.112539:0:55805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8045 00000100:00100000:1.0:1777051439.112557:0:55805:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fd64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3679:x1863365452648960:12345-0@lo:6:osp-syn-0-1.0 00000100:00080000:2.0:1777051439.112561:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00080000:1.0:1777051439.112593:0:55805:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:260 count 1 00002000:00010000:1.0:1777051439.112634:0:55805:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x104:0x0] initial LVB size: 1048576, mtime: 0x69eba726, atime: 0x0, ctime: 0x69eba726, blocks: 0x800 00010000:00010000:1.0:1777051439.112646:0:55805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c6d4c615/0x85f51a6b967169d2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x104:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051439.112670:0:55805:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051439.112674:0:55805:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051439.112682:0:55805:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c6d4c615/0x85f51a6b967169d2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x104:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 55805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051439.112705:0:55805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c6d4c615/0x85f51a6b967169d2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x104:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 55805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051439.112731:0:55805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c6d4c615/0x85f51a6b967169d2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x104:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 55805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051439.112745:0:55805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c6d4c615/0x85f51a6b967169d2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x104:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 55805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051439.112868:0:13753:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1777051439.112880:0:13753:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c6d4c615/0x85f51a6b967169d2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x104:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 55805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051439.112899:0:13753:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94d72fc00 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:0.0:1777051439.112909:0:13753:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c6d4c615/0x85f51a6b967169d2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x104:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 55805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051439.112925:0:13753:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c6d4c615/0x85f51a6b967169d2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x104:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 55805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051439.112952:0:13753:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c6d4c615/0x85f51a6b967169d2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x104:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 55805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051439.112952:0:55805:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1777051439.112995:0:13753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c6d4c615/0x85f51a6b967169d2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x104:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 55805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051439.113029:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777051439.113032:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777051439.113035:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1777051439.113184:0:55805:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fd64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+6:3679:x1863365452648960:12345-0@lo:6:osp-syn-0-1.0 Request processed in 630us (2731us total) trans 4294968363 rc 0/0 00000100:00100000:1.0:1777051439.113198:0:55805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8045 00000004:00080000:0.0:1777051439.113347:0:3679:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99da5fbedc00/2, rc 0, transno 4294968363 00000100:00100000:0.0:1777051439.113361:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5fbedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452648960:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1777051439.113959:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051439.114370:0:27887:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426019712 00000100:00100000:2.0:1777051439.114379:0:27887:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426019712 00000100:00100000:2.0:1777051439.114445:0:27887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 8046 00000100:00100000:2.0:1777051439.114461:0:27887:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f299c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c11b6966-0775-44d2-bdc6-c74c26eb2226+54:2438:x1863365426019712:12345-192.168.201.46@tcp:16:lhsmtool_posix.0 00000001:00080000:3.0:1777051439.120802:0:8464:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0000: transno 4294968363 is committed 00000001:00080000:3.0:1777051439.120817:0:8464:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0000: transno 4294968362 is committed 00000100:00100000:2.0:1777051439.121230:0:27887:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f299c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c11b6966-0775-44d2-bdc6-c74c26eb2226+52:2438:x1863365426019712:12345-192.168.201.46@tcp:16:lhsmtool_posix.0 Request processed in 6765us (7267us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051439.121250:0:27887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 8046 00000100:00100000:1.0:1777051439.130598:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051439.130717:0:27885:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426019968 00000100:00100000:3.0:1777051439.130729:0:27885:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426019968 00000100:00100000:3.0:1777051439.130841:0:27885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112174 00000100:00100000:3.0:1777051439.130860:0:27885:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da45f75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c11b6966-0775-44d2-bdc6-c74c26eb2226+10:138107:x1863365426019968:12345-192.168.201.46@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1777051439.130931:0:27885:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777051439.130969:0:27885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d944a3f600/0x85f51a6b967169bd lrc: 0/0,0 mode: --/PR res: [0x240000bd2:0x5:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6649 expref: 10 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051439.130999:0:27885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x5:0x0].0x0 (ffff99da5fb45600) 00010000:00010000:3.0:1777051439.131007:0:27885:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1777051439.131045:0:27885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a3000/0x85f51a6b967169d9 lrc: 3/0,1 mode: --/PW res: [0x240000bd2:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051439.131066:0:27885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a3000/0x85f51a6b967169d9 lrc: 3/0,1 mode: PW/PW res: [0x240000bd2:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 27885 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051439.131082:0:27885:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a3000/0x85f51a6b967169d9 lrc: 3/0,1 mode: PW/PW res: [0x240000bd2:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 27885 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777051439.132805:0:27885:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000070ae2ecb reply state 00000000f4aade96 transno 8589934692 ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a3000/0x85f51a6b967169d9 lrc: 3/0,1 mode: PW/PW res: [0x240000bd2:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 27885 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051439.132829:0:27885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a3000/0x85f51a6b967169d9 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd2:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 27885 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051439.132842:0:27885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x5:0x0].0x0 (ffff99da5fb45600) 00010000:00010000:3.0:1777051439.132848:0:27885:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1777051439.132852:0:27885:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1777051439.133002:0:27885:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da45f75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c11b6966-0775-44d2-bdc6-c74c26eb2226+11:138107:x1863365426019968:12345-192.168.201.46@tcp:36:lhsmtool_posix.0 Request processed in 2143us (2409us total) trans 8589934692 rc 0/0 00000100:00100000:3.0:1777051439.133016:0:27885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112174 00000100:00100000:3.0:1777051439.139088:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051439.140870:0:6580:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426020096 00000100:00100000:2.0:1777051439.140882:0:6580:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426020096 00000100:00100000:2.0:1777051439.140971:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112175 00000100:00100000:2.0:1777051439.140987:0:6580:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f29a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+11:138107:x1863365426020096:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1777051439.141014:0:6580:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051439.141038:0:6580:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d944a3f000/0x85f51a6b967169e0 lrc: 2/0,0 mode: --/CR res: [0x240000bd2:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b665e expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051439.141102:0:6580:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d944a3f000/0x85f51a6b967169e0 lrc: 3/0,0 mode: CR/CR res: [0x240000bd2:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b665e expref: 12 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051439.141124:0:6580:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99d944a3f000/0x85f51a6b967169e0 lrc: 3/0,0 mode: CR/CR res: [0x240000bd2:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b665e expref: 12 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051439.141148:0:6580:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x5:0x0].0x0 (ffff99da5fb45600) 00010000:00010000:2.0:1777051439.141153:0:6580:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1777051439.141158:0:6580:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d944a3f000, rc 0) 00000100:00100000:2.0:1777051439.141293:0:6580:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f29a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+12:138107:x1863365426020096:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 Request processed in 309us (2558us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051439.141305:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112175 00000100:00100000:2.0:1777051439.146526:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051439.147690:0:24468:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426020224 00000100:00100000:0.0:1777051439.147702:0:24468:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426020224 00000100:00100000:0.0:1777051439.147811:0:24468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 8047 00000100:00100000:0.0:1777051439.147830:0:24468:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7c9a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+52:2437:x1863365426020224:12345-192.168.201.46@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1777051439.148055:0:24468:0:(ofd_lvb.c:305:ofd_lvbo_update()) res: [0x280000400:0x105:0x0] updating lvb size from disk: 0 -> 1048576 00002000:00010000:0.0:1777051439.148062:0:24468:0:(ofd_lvb.c:312:ofd_lvbo_update()) res: [0x280000400:0x105:0x0] updating lvb mtime from disk: 0 -> 1777051430 00002000:00010000:0.0:1777051439.148067:0:24468:0:(ofd_lvb.c:318:ofd_lvbo_update()) res: [0x280000400:0x105:0x0] updating lvb atime from disk: 0 -> 1777051430 00002000:00010000:0.0:1777051439.148071:0:24468:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x280000400:0x105:0x0] updating lvb ctime from disk: 0 -> 1777051430 00002000:00010000:0.0:1777051439.148075:0:24468:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x105:0x0] updating lvb blocks from disk: 0 -> 2048 00000100:00100000:0.0:1777051439.149054:0:24468:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7c9a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+53:2437:x1863365426020224:12345-192.168.201.46@tcp:2:lhsmtool_posix.0 Request processed in 1227us (2529us total) trans 4294968364 rc 0/0 00000100:00100000:0.0:1777051439.149068:0:24468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 8047 00000100:00100000:3.0:1777051439.157315:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051439.157433:0:10328:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426020480 00000100:00100000:0.0:1777051439.157446:0:10328:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426020480 00000100:00100000:0.0:1777051439.157598:0:10328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112176 00000100:00100000:0.0:1777051439.157617:0:10328:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f298000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+12:138107:x1863365426020480:12345-192.168.201.46@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1777051439.157702:0:10328:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61ac00/0x85f51a6b967169e7 lrc: 3/0,1 mode: --/PW res: [0x240000bd2:0x5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051439.157729:0:10328:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61bc00/0x85f51a6b9671698c lrc: 2/0,0 mode: PR/PR res: [0x240000bd2:0x5:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6634 expref: 12 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051439.157745:0:10328:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61ac00/0x85f51a6b967169e7 lrc: 4/0,1 mode: --/PW res: [0x240000bd2:0x5:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10328 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051439.158121:0:10328:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61bc00/0x85f51a6b9671698c lrc: 3/0,0 mode: PR/PR res: [0x240000bd2:0x5:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6634 expref: 12 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051439.158148:0:10328:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61bc00/0x85f51a6b9671698c lrc: 4/0,0 mode: PR/PR res: [0x240000bd2:0x5:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6634 expref: 12 pid: 10328 timeout: 8168 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051439.158181:0:10328:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94f169880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:10328:1863365452649088:192.168.201.46@tcp:104: 00000100:00100000:0.0:1777051439.158404:0:10328:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d95cf51240 going to sleep for 11 seconds 00000100:00100000:0.0:1777051439.163052:0:10328:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94f169880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:10328:1863365452649088:192.168.201.46@tcp:104: 00010000:00010000:0.0:1777051439.163090:0:10328:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61ac00/0x85f51a6b967169e7 lrc: 3/0,1 mode: --/PW res: [0x240000bd2:0x5:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10328 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051439.164917:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051439.165258:0:24467:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426020608 00000100:00100000:0.0:1777051439.165268:0:24467:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426020608 00010000:00010000:0.0:1777051439.165316:0:24467:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61bc00/0x85f51a6b9671698c lrc: 4/0,0 mode: PR/PR res: [0x240000bd2:0x5:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6634 expref: 13 pid: 10328 timeout: 8168 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051439.165370:0:24467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3911 00000100:00100000:0.0:1777051439.165384:0:24467:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f29ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+13:2437:x1863365426020608:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1777051439.165406:0:24467:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777051439.165416:0:24467:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61bc00/0x85f51a6b9671698c lrc: 4/0,0 mode: PR/PR res: [0x240000bd2:0x5:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6634 expref: 13 pid: 10328 timeout: 8168 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051439.165439:0:24467:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61bc00/0x85f51a6b9671698c lrc: 3/0,0 mode: PR/PR res: [0x240000bd2:0x5:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6634 expref: 13 pid: 10328 timeout: 8168 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051439.165474:0:24467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61bc00/0x85f51a6b9671698c lrc: 0/0,0 mode: --/PR res: [0x240000bd2:0x5:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6634 expref: 13 pid: 10328 timeout: 8168 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051439.165502:0:24467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x5:0x0].0x0 (ffff99da5fb45600) 00010000:00010000:0.0:1777051439.165509:0:24467:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61ac00/0x85f51a6b967169e7 lrc: 3/0,1 mode: --/PW res: [0x240000bd2:0x5:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10328 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051439.165526:0:24467:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61ac00/0x85f51a6b967169e7 lrc: 3/0,1 mode: PW/PW res: [0x240000bd2:0x5:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 10328 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051439.165539:0:24467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61ac00/0x85f51a6b967169e7 lrc: 4/0,1 mode: PW/PW res: [0x240000bd2:0x5:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 10328 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051439.165586:0:24467:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1777051439.165660:0:10328:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61ac00/0x85f51a6b967169e7 lrc: 3/0,1 mode: PW/PW res: [0x240000bd2:0x5:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10328 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051439.165674:0:24467:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f29ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+12:2437:x1863365426020608:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 287us (776us total) trans 0 rc 0/0 00010000:00010000:2.0:1777051439.165693:0:10328:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61ac00/0x85f51a6b967169e7 lrc: 3/0,1 mode: PW/PW res: [0x240000bd2:0x5:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10328 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051439.165702:0:24467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3911 00010000:00010000:2.0:1777051439.165759:0:10328:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61ac00/0x85f51a6b967169e7 lrc: 3/0,1 mode: PW/PW res: [0x240000bd2:0x5:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10328 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051439.166304:0:10328:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61ac00/0x85f51a6b967169e7 lrc: 2/0,0 mode: PW/PW res: [0x240000bd2:0x5:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10328 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051439.166316:0:10328:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61ac00/0x85f51a6b967169e7 lrc: 3/0,0 mode: PW/PW res: [0x240000bd2:0x5:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10328 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051439.166328:0:10328:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94e61ac00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:2.0:1777051439.166335:0:10328:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61ac00/0x85f51a6b967169e7 lrc: 3/0,0 mode: PW/PW res: [0x240000bd2:0x5:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10328 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051439.166357:0:10328:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61ac00/0x85f51a6b967169e7 lrc: 4/0,0 mode: PW/PW res: [0x240000bd2:0x5:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10328 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051439.166375:0:10328:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x5:0x0].0x0 (ffff99da5fb45600) 00010000:00010000:2.0:1777051439.166381:0:10328:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1777051439.166387:0:10328:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61ac00/0x85f51a6b967169e7 lrc: 2/0,0 mode: --/PW res: [0x240000bd2:0x5:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10328 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051439.166398:0:10328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61ac00/0x85f51a6b967169e7 lrc: 0/0,0 mode: --/PW res: [0x240000bd2:0x5:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10328 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051439.166468:0:10328:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f298000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+11:138107:x1863365426020480:12345-192.168.201.46@tcp:55:lhsmtool_posix.0 Request processed in 8855us (9161us total) trans 0 rc -22/-22 00000100:00100000:2.0:1777051439.166484:0:10328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112176 00000100:00100000:2.0:1777051439.177022:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051439.177273:0:13320:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426020736 00000100:00100000:1.0:1777051439.177286:0:13320:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426020736 00000100:00100000:1.0:1777051439.177360:0:13320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 8048 00000100:00100000:1.0:1777051439.177375:0:13320:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7c9a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+53:2436:x1863365426020736:12345-192.168.201.46@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1777051439.177435:0:13320:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c6d4c615/0x85f51a6b967169ee lrc: 3/1,0 mode: --/PR res: [0x280000400:0x105:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051439.177467:0:13320:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000010d8627e/0x85f51a6b967169cb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x105:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6657 expref: 53 pid: 27884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051439.177483:0:13320:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1777051439.177487:0:13320:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1777051439.177493:0:13320:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c6d4c615/0x85f51a6b967169ee lrc: 4/1,0 mode: --/PR res: [0x280000400:0x105:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051439.177552:0:13320:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000010d8627e/0x85f51a6b967169cb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x105:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6657 expref: 53 pid: 27884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051439.177577:0:13320:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000010d8627e/0x85f51a6b967169cb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x105:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6657 expref: 53 pid: 27884 timeout: 8168 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051439.177601:0:13320:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da45f75c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:13320:1863365452649216:192.168.201.46@tcp:104: 00000100:00100000:1.0:1777051439.178036:0:13320:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d941082d80 going to sleep for 11 seconds 00000100:00100000:1.0:1777051439.183656:0:13320:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da45f75c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:13320:1863365452649216:192.168.201.46@tcp:104: 00010000:00010000:1.0:1777051439.183696:0:13320:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c6d4c615/0x85f51a6b967169ee lrc: 3/1,0 mode: --/PR res: [0x280000400:0x105:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051439.187030:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051439.188361:0:47827:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426020864 00000100:00100000:3.0:1777051439.188374:0:47827:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426020864 00010000:00010000:3.0:1777051439.188427:0:47827:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000010d8627e/0x85f51a6b967169cb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x105:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6657 expref: 54 pid: 27884 timeout: 8168 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051439.188503:0:47827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3912 00000100:00100000:3.0:1777051439.188521:0:47827:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7c9a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+54:2436:x1863365426020864:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1777051439.188545:0:47827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777051439.188577:0:47827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000010d8627e/0x85f51a6b967169cb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x105:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6657 expref: 54 pid: 27884 timeout: 8168 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051439.188603:0:47827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000010d8627e/0x85f51a6b967169cb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x105:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6657 expref: 54 pid: 27884 timeout: 8168 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051439.188639:0:47827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010d8627e/0x85f51a6b967169cb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x105:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6657 expref: 54 pid: 27884 timeout: 8168 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051439.188665:0:47827:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051439.188669:0:47827:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051439.188677:0:47827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c6d4c615/0x85f51a6b967169ee lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x105:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051439.188694:0:47827:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c6d4c615/0x85f51a6b967169ee lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x105:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051439.188749:0:47827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1777051439.188880:0:47827:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7c9a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+53:2436:x1863365426020864:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 360us (1853us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051439.188895:0:47827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3912 00010000:00010000:1.0:1777051439.188988:0:13320:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c6d4c615/0x85f51a6b967169ee lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x105:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051439.189011:0:13320:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c6d4c615/0x85f51a6b967169ee lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x105:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051439.189045:0:13320:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c6d4c615/0x85f51a6b967169ee lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x105:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051439.189060:0:13320:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c6d4c615/0x85f51a6b967169ee lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x105:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051439.189085:0:13320:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c6d4c615/0x85f51a6b967169ee lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x105:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051439.189098:0:13320:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94d72fc00 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:1.0:1777051439.189104:0:13320:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c6d4c615/0x85f51a6b967169ee lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x105:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051439.189120:0:13320:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c6d4c615/0x85f51a6b967169ee lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x105:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051439.189143:0:13320:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c6d4c615/0x85f51a6b967169ee lrc: 2/0,0 mode: --/PR res: [0x280000400:0x105:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051439.189157:0:13320:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c6d4c615/0x85f51a6b967169ee lrc: 0/0,0 mode: --/PR res: [0x280000400:0x105:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051439.189348:0:13320:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7c9a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+52:2436:x1863365426020736:12345-192.168.201.46@tcp:1:lhsmtool_posix.0 Request processed in 11973us (12332us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051439.189362:0:13320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 8048 00010000:00010000:1.0:1777051439.191511:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1777051439.192887:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051439.192980:0:21368:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426021120 00000100:00100000:1.0:1777051439.192990:0:21368:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426021120 00000100:00100000:1.0:1777051439.193059:0:21368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112177 00000100:00100000:1.0:1777051439.193074:0:21368:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7c9a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+11:138107:x1863365426021120:12345-192.168.201.46@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1777051439.193168:0:21368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72e000/0x85f51a6b967169f5 lrc: 3/0,1 mode: --/PW res: [0x240000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051439.193192:0:21368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72e000/0x85f51a6b967169f5 lrc: 3/0,1 mode: PW/PW res: [0x240000bd2:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 21368 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051439.193209:0:21368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72e000/0x85f51a6b967169f5 lrc: 3/0,1 mode: PW/PW res: [0x240000bd2:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21368 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051439.193432:0:21368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72e600/0x85f51a6b967169fc lrc: 3/0,1 mode: --/EX res: [0x240000bd2:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051439.193453:0:21368:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff99d944a3f000/0x85f51a6b967169e0 lrc: 2/0,0 mode: CR/CR res: [0x240000bd2:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b665e expref: 12 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051439.193466:0:21368:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72e600/0x85f51a6b967169fc lrc: 4/0,1 mode: --/EX res: [0x240000bd2:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 21368 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051439.193511:0:21368:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff99d944a3f000/0x85f51a6b967169e0 lrc: 3/0,0 mode: CR/CR res: [0x240000bd2:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b665e expref: 12 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051439.193535:0:21368:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff99d944a3f000/0x85f51a6b967169e0 lrc: 4/0,0 mode: CR/CR res: [0x240000bd2:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b665e expref: 12 pid: 6580 timeout: 8168 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051439.193559:0:21368:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da45f75c00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001_UUID:21368:1863365452649344:192.168.201.46@tcp:104: 00000100:00100000:1.0:1777051439.193664:0:21368:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d9410826c0 going to sleep for 11 seconds 00000100:00100000:0.0:1777051439.200596:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051439.200809:0:21368:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da45f75c00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001_UUID:21368:1863365452649344:192.168.201.46@tcp:104: 00010000:00010000:1.0:1777051439.200855:0:21368:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72e600/0x85f51a6b967169fc lrc: 3/0,1 mode: --/EX res: [0x240000bd2:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21368 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051439.200992:0:47597:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426021248 00000100:00100000:2.0:1777051439.201003:0:47597:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426021248 00010000:00010000:2.0:1777051439.201398:0:47597:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d944a3f000/0x85f51a6b967169e0 lrc: 4/0,0 mode: CR/CR res: [0x240000bd2:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b665e expref: 13 pid: 6580 timeout: 8168 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051439.201450:0:47597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3913 00000100:00100000:2.0:1777051439.201467:0:47597:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f169880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+13:2437:x1863365426021248:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1777051439.201489:0:47597:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777051439.201500:0:47597:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff99d944a3f000/0x85f51a6b967169e0 lrc: 4/0,0 mode: CR/CR res: [0x240000bd2:0x5:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b665e expref: 13 pid: 6580 timeout: 8168 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051439.201531:0:47597:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff99d944a3f000/0x85f51a6b967169e0 lrc: 3/0,0 mode: CR/CR res: [0x240000bd2:0x5:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b665e expref: 13 pid: 6580 timeout: 8168 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051439.201560:0:47597:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d944a3f000/0x85f51a6b967169e0 lrc: 0/0,0 mode: --/CR res: [0x240000bd2:0x5:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b665e expref: 13 pid: 6580 timeout: 8168 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051439.201581:0:47597:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x5:0x0].0x0 (ffff99da5fb45600) 00010000:00010000:2.0:1777051439.201588:0:47597:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72e600/0x85f51a6b967169fc lrc: 3/0,1 mode: --/EX res: [0x240000bd2:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21368 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051439.201600:0:47597:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72e600/0x85f51a6b967169fc lrc: 3/0,1 mode: EX/EX res: [0x240000bd2:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 21368 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051439.201612:0:47597:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72e600/0x85f51a6b967169fc lrc: 4/0,1 mode: EX/EX res: [0x240000bd2:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 21368 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051439.201871:0:21368:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72e600/0x85f51a6b967169fc lrc: 3/0,1 mode: EX/EX res: [0x240000bd2:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21368 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051439.201875:0:47597:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1777051439.201884:0:21368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72e600/0x85f51a6b967169fc lrc: 3/0,1 mode: EX/EX res: [0x240000bd2:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21368 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051439.201983:0:47597:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f169880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+12:2437:x1863365426021248:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 520us (1395us total) trans 0 rc 0/0 00000001:00080000:1.0:1777051439.202004:0:21368:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 8589934693 00000100:00100000:2.0:1777051439.202004:0:47597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3913 00000001:00080000:1.0:1777051439.202161:0:21368:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 8589934694 00000001:00080000:1.0:1777051439.202217:0:21368:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 8589934695 00000100:00100000:1.0:1777051439.202398:0:21368:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da45f75c00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:21368:1863365452649472:0@lo:1000:mdt00_005.0 00000100:00100000:1.0:1777051439.202458:0:21368:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051439.202503:0:21368:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d9410820c0 going to sleep for 11 seconds 00000100:00100000:0.0:1777051439.202583:0:46500:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452649472 00000100:00100000:0.0:1777051439.202590:0:46500:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452649472 00000100:00100000:0.0:1777051439.202687:0:46500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8209 00000100:00100000:0.0:1777051439.202699:0:46500:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da45f76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+5:21368:x1863365452649472:12345-0@lo:1000:mdt00_005.0 00000100:00100000:0.0:1777051439.202821:0:46500:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da45f76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+5:21368:x1863365452649472:12345-0@lo:1000:mdt00_005.0 Request processed in 124us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051439.202833:0:46500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8209 00000100:00100000:2.0:1777051439.202876:0:21368:0:(client.c:3101:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294968363 gen 2 00000004:00080000:2.0:1777051439.202885:0:21368:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff99da5fbedc00, transno 4294968363 00000100:00100000:2.0:1777051439.202924:0:21368:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da45f75c00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:21368:1863365452649472:0@lo:1000:mdt00_005.0 00000001:00080000:2.0:1777051439.203062:0:21368:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 8589934696 00000100:00100000:2.0:1777051439.203113:0:21368:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7c9a3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:21368:1863365452649600:0@lo:1000:mdt00_005.0 00000100:00100000:2.0:1777051439.203147:0:21368:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051439.203179:0:21368:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d956bda240 going to sleep for 11 seconds 00000100:00100000:1.0:1777051439.203219:0:46498:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452649600 00000100:00100000:1.0:1777051439.203227:0:46498:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452649600 00000100:00100000:1.0:1777051439.203286:0:46498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8210 00000100:00100000:1.0:1777051439.203298:0:46498:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7c9a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+5:21368:x1863365452649600:12345-0@lo:1000:mdt00_005.0 00000100:00100000:1.0:1777051439.203418:0:46498:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7c9a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:21368:x1863365452649600:12345-0@lo:1000:mdt00_005.0 Request processed in 122us (268us total) trans 4294968365 rc 0/0 00000100:00100000:1.0:1777051439.203430:0:46498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8210 00000100:00100000:2.0:1777051439.203480:0:21368:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7c9a3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:21368:1863365452649600:0@lo:1000:mdt00_005.0 00000001:00080000:2.0:1777051439.203553:0:21368:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 8589934697 00010000:00010000:2.0:1777051439.203580:0:21368:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72e600/0x85f51a6b967169fc lrc: 3/0,1 mode: EX/EX res: [0x240000bd2:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21368 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051439.203590:0:21368:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72e600/0x85f51a6b967169fc lrc: 2/0,0 mode: EX/EX res: [0x240000bd2:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 21368 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051439.203597:0:21368:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72e600/0x85f51a6b967169fc lrc: 3/0,0 mode: EX/EX res: [0x240000bd2:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21368 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051439.203603:0:21368:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94d72e600 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:2.0:1777051439.203608:0:21368:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72e600/0x85f51a6b967169fc lrc: 3/0,0 mode: EX/EX res: [0x240000bd2:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21368 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051439.203616:0:21368:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72e600/0x85f51a6b967169fc lrc: 4/0,0 mode: EX/EX res: [0x240000bd2:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 21368 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051439.203627:0:21368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x5:0x0].0x0 (ffff99da5fb45600) 00010000:00010000:2.0:1777051439.203630:0:21368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1777051439.203634:0:21368:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72e600/0x85f51a6b967169fc lrc: 2/0,0 mode: --/EX res: [0x240000bd2:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21368 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051439.203640:0:21368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72e600/0x85f51a6b967169fc lrc: 0/0,0 mode: --/EX res: [0x240000bd2:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21368 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051439.203661:0:21368:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72ee00/0x85f51a6b96716915 lrc: 3/0,1 mode: EX/EX res: [0x240000bd2:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051439.203669:0:21368:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72ee00/0x85f51a6b96716915 lrc: 2/0,0 mode: EX/EX res: [0x240000bd2:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051439.203678:0:21368:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72ee00/0x85f51a6b96716915 lrc: 3/0,0 mode: EX/EX res: [0x240000bd2:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051439.203687:0:21368:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94d72ee00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:2.0:1777051439.203691:0:21368:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72ee00/0x85f51a6b96716915 lrc: 3/0,0 mode: EX/EX res: [0x240000bd2:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051439.204028:0:21368:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72ee00/0x85f51a6b96716915 lrc: 4/0,0 mode: EX/EX res: [0x240000bd2:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051439.204043:0:21368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x2:0x0].0x0 (ffff99d94e6b6f00) 00010000:00010000:2.0:1777051439.204046:0:21368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1777051439.204054:0:21368:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61a200/0x85f51a6b9671691c lrc: 2/0,0 mode: --/CR res: [0x240000bd2:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b661f expref: 50 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051439.204067:0:21368:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61a200/0x85f51a6b9671691c lrc: 2/0,0 mode: CR/CR res: [0x240000bd2:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b661f expref: 50 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051439.204081:0:21368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61a200/0x85f51a6b9671691c lrc: 3/0,0 mode: CR/CR res: [0x240000bd2:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b661f expref: 50 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051439.204118:0:21368:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e61a200/0x85f51a6b9671691c lrc: 3/0,0 mode: CR/CR res: [0x240000bd2:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b661f expref: 50 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051439.204134:0:21368:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7c9a2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001_UUID:21368:1863365452649728:192.168.201.46@tcp:105: 00000100:00100000:2.0:1777051439.204507:0:21368:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d956bdaa80 going to sleep for 11 seconds 00000100:00100000:0.0:1777051439.212495:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051439.212606:0:6582:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426021376 00000100:00100000:1.0:1777051439.212617:0:6582:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426021376 00000100:00100000:1.0:1777051439.212716:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3383 00000100:00100000:2.0:1777051439.212717:0:21368:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7c9a2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001_UUID:21368:1863365452649728:192.168.201.46@tcp:105: 00000100:00100000:1.0:1777051439.212732:0:6582:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f168000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+51:138106:x1863365426021376:12345-192.168.201.46@tcp:49:cat.0 00000100:00080000:0.0:1777051439.212742:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1777051439.212752:0:21368:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72ee00/0x85f51a6b96716915 lrc: 2/0,0 mode: --/EX res: [0x240000bd2:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051439.212808:0:21368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72ee00/0x85f51a6b96716915 lrc: 0/0,0 mode: --/EX res: [0x240000bd2:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051439.212848:0:21368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff99d944a3f000/0x85f51a6b96716a03 lrc: 3/0,1 mode: --/EX res: [0x240000bd2:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051439.212866:0:21368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d944a3f000/0x85f51a6b96716a03 lrc: 3/0,1 mode: EX/EX res: [0x240000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 21368 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051439.212880:0:21368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d944a3f000/0x85f51a6b96716a03 lrc: 3/0,1 mode: EX/EX res: [0x240000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21368 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051439.212895:0:21368:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff99d944a3f000/0x85f51a6b96716a03 lrc: 3/0,1 mode: EX/EX res: [0x240000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 21368 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051439.212906:0:21368:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d944a3f000/0x85f51a6b96716a03 lrc: 2/0,0 mode: EX/EX res: [0x240000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 21368 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051439.212917:0:21368:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99d944a3f000/0x85f51a6b96716a03 lrc: 3/0,0 mode: EX/EX res: [0x240000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 21368 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051439.212918:0:6582:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f168000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+51:138106:x1863365426021376:12345-192.168.201.46@tcp:49:cat.0 Request processed in 189us (430us total) trans 0 rc 0/0 00010000:00010000:2.0:1777051439.212928:0:21368:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d944a3f000 already unused, calling callback (ffffffffc17724f0) 00000100:00100000:1.0:1777051439.212931:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3383 00010000:00010000:2.0:1777051439.212935:0:21368:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d944a3f000/0x85f51a6b96716a03 lrc: 3/0,0 mode: EX/EX res: [0x240000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 21368 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051439.212947:0:21368:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d944a3f000/0x85f51a6b96716a03 lrc: 4/0,0 mode: EX/EX res: [0x240000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 21368 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051439.212963:0:21368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x2:0x0].0x0 (ffff99d94e6b6f00) 00010000:00010000:2.0:1777051439.212969:0:21368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777051439.212975:0:21368:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99d944a3f000/0x85f51a6b96716a03 lrc: 2/0,0 mode: --/EX res: [0x240000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 21368 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051439.213001:0:21368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d944a3f000/0x85f51a6b96716a03 lrc: 0/0,0 mode: --/EX res: [0x240000bd2:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 21368 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051439.213021:0:21368:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72e000/0x85f51a6b967169f5 lrc: 3/0,1 mode: PW/PW res: [0x240000bd2:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21368 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051439.213033:0:21368:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72e000/0x85f51a6b967169f5 lrc: 2/0,0 mode: PW/PW res: [0x240000bd2:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 21368 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051439.213043:0:21368:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72e000/0x85f51a6b967169f5 lrc: 3/0,0 mode: PW/PW res: [0x240000bd2:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21368 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051439.213053:0:21368:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94d72e000 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:2.0:1777051439.213059:0:21368:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72e000/0x85f51a6b967169f5 lrc: 3/0,0 mode: PW/PW res: [0x240000bd2:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21368 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051439.213070:0:21368:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72e000/0x85f51a6b967169f5 lrc: 4/0,0 mode: PW/PW res: [0x240000bd2:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 21368 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051439.213087:0:21368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x2:0x0].0x0 (ffff99d94e6b6f00) 00010000:00010000:2.0:1777051439.213091:0:21368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1777051439.213097:0:21368:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72e000/0x85f51a6b967169f5 lrc: 2/0,0 mode: --/PW res: [0x240000bd2:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21368 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051439.213106:0:21368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72e000/0x85f51a6b967169f5 lrc: 0/0,0 mode: --/PW res: [0x240000bd2:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21368 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051439.213360:0:21368:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7c9a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+16:138107:x1863365426021120:12345-192.168.201.46@tcp:57:lhsmtool_posix.0 Request processed in 20286us (20473us total) trans 8589934698 rc 0/0 00000100:00100000:2.0:1777051439.213375:0:21368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112177 00000020:00080000:2.0:1777051439.213384:0:21368:0:(tgt_main.c:783:tgt_ses_key_exit()) total 6 transactions per RPC 00000040:00080000:0.0:1777051439.213437:0:104226:0:(llog.c:801:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1777051439.213446:0:104226:0:(llog_cat.c:158:llog_cat_process_common()) processing log [0x1:0x12:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1777051439.214298:0:104226:0:(llog.c:858:llog_process_thread()) stop processing plain [0x1:0x12:0x0] index 64768 count 6 00000040:00080000:0.0:1777051439.214313:0:104226:0:(llog.c:858:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1777051439.218614:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051439.219078:0:6583:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426021632 00000100:00100000:2.0:1777051439.219089:0:6583:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426021632 00000100:00100000:2.0:1777051439.219431:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3384 00000100:00100000:2.0:1777051439.219449:0:6583:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f16b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+16:138107:x1863365426021632:12345-192.168.201.46@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1777051439.219720:0:6583:0:(mdd_object.c:4010:mdd_close()) Object [0x240000bd2:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1777051439.219764:0:6583:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 8589934699 00010000:00010000:2.0:1777051439.219839:0:6583:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff99d944a3f000/0x85f51a6b96716a0a lrc: 3/0,1 mode: --/PW res: [0x240000bd2:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6583 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051439.219863:0:6583:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d944a3f000/0x85f51a6b96716a0a lrc: 3/0,1 mode: PW/PW res: [0x240000bd2:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6583 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051439.219880:0:6583:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d944a3f000/0x85f51a6b96716a0a lrc: 3/0,1 mode: PW/PW res: [0x240000bd2:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6583 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051439.219893:0:6583:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff99d944a3f000/0x85f51a6b96716a0a lrc: 4/0,1 mode: PW/PW res: [0x240000bd2:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6583 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051439.219903:0:6583:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff99d944a3f000/0x85f51a6b96716a0a lrc: 4/0,1 mode: PW/PW res: [0x240000bd2:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6583 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051439.219912:0:6583:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d944a3f000/0x85f51a6b96716a0a lrc: 3/0,0 mode: PW/PW res: [0x240000bd2:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6583 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051439.219952:0:6583:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1777051439.220070:0:6583:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f16b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+18:138107:x1863365426021632:12345-192.168.201.46@tcp:35:lhsmtool_posix.0 Request processed in 624us (1459us total) trans 8589934700 rc 0/0 00000100:00100000:2.0:1777051439.220084:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3384 00000020:00080000:2.0:1777051439.220091:0:6583:0:(tgt_main.c:783:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1777051439.220993:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00010000:00010000:0.0:1777051439.221381:0:38719:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1777051439.221393:0:38719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99d944a3f000/0x85f51a6b96716a0a lrc: 2/0,0 mode: PW/PW res: [0x240000bd2:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6583 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051439.221407:0:38719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d944a3f000 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:0.0:1777051439.221414:0:38719:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d944a3f000/0x85f51a6b96716a0a lrc: 2/0,0 mode: PW/PW res: [0x240000bd2:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6583 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051439.221427:0:38719:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d944a3f000/0x85f51a6b96716a0a lrc: 3/0,0 mode: PW/PW res: [0x240000bd2:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6583 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051439.221446:0:38719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x5:0x0].0x0 (ffff99da5fb45600) 00010000:00010000:0.0:1777051439.221451:0:38719:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1777051439.221458:0:38719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99d944a3f000/0x85f51a6b96716a0a lrc: 1/0,0 mode: --/PW res: [0x240000bd2:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6583 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051439.221467:0:38719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d944a3f000/0x85f51a6b96716a0a lrc: 0/0,0 mode: --/PW res: [0x240000bd2:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6583 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051439.221487:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777051439.221490:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777051439.221493:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1777051439.222734:0:27884:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426021760 00000100:00100000:2.0:1777051439.223029:0:27884:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426021760 00000100:00080000:0.0:1777051439.223414:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1777051439.223439:0:27884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 8049 00000100:00100000:2.0:1777051439.223456:0:27884:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5fbedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+51:138106:x1863365426021760:12345-192.168.201.46@tcp:101:cat.0 00010000:00010000:2.0:1777051439.223473:0:27884:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051439.223497:0:27884:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004d4ff20b/0x85f51a6b96716a11 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x105:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6665 expref: -99 pid: 27884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1777051439.223528:0:27884:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x105:0x0] initial LVB size: 1048576, mtime: 0x69eba726, atime: 0x69eba726, ctime: 0x69eba726, blocks: 0x800 00010000:00010000:2.0:1777051439.223550:0:27884:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777051439.223554:0:27884:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777051439.223565:0:27884:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004d4ff20b/0x85f51a6b96716a11 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x105:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6665 expref: 52 pid: 27884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051439.223586:0:27884:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004d4ff20b/0x85f51a6b96716a11 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x105:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6665 expref: 52 pid: 27884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051439.223602:0:27884:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d944a3e600, rc 0) 00000100:00100000:2.0:1777051439.223658:0:27884:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5fbedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+52:138106:x1863365426021760:12345-192.168.201.46@tcp:101:cat.0 Request processed in 204us (2666us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051439.223995:0:27884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 8049 00000100:00100000:3.0:1777051439.238710:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051439.238857:0:43515:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426021888 00000100:00100000:1.0:1777051439.238872:0:43515:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426021888 00002000:00100000:1.0:1777051439.239141:0:43515:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000400:0x105:0x0] (0->1048575) req@ffff99d942a0c700 x1863365426021888/t0(0) o3->2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp:400/0 lens 488/0 e 0 to 0 dl 1777051450 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1777051439.239160:0:43515:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99d942a0c700 with x1863365426021888 ext(0->1048575) 00002000:00010000:1.0:1777051439.239170:0:43515:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99d942a0c700 00000100:00100000:1.0:1777051439.239369:0:43515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 1776 00000100:00100000:1.0:1777051439.239386:0:43515:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942a0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+52:2436:x1863365426021888:12345-192.168.201.46@tcp:3:cat.0 00000100:00100000:1.0:1777051439.258012:0:43515:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942a0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+52:2436:x1863365426021888:12345-192.168.201.46@tcp:3:cat.0 Request processed in 18618us (19299us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1777051439.258034:0:43515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 1776 00002000:00100000:1.0:1777051439.258054:0:43515:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000400:0x105:0x0] (0->1048575) req@ffff99d942a0c700 x1863365426021888/t0(0) o3->2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp:400/0 lens 488/440 e 0 to 0 dl 1777051450 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1777051439.258073:0:43515:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99d942a0c700 with x1863365426021888 ext(0->1048575) 00002000:00010000:1.0:1777051439.258082:0:43515:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99d942a0c700 00000100:00100000:0.0:1777051439.271729:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051439.271864:0:46199:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426022016 00000100:00100000:2.0:1777051439.271879:0:46199:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426022016 00002000:00100000:2.0:1777051439.271981:0:46199:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000400:0x105:0x0] (1048576->1052671) req@ffff99d94f169c00 x1863365426022016/t0(0) o3->2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp:400/0 lens 488/0 e 0 to 0 dl 1777051450 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1777051439.272007:0:46199:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99d94f169c00 with x1863365426022016 ext(1048576->1052671) 00002000:00010000:2.0:1777051439.272016:0:46199:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99d94f169c00 00000100:00100000:2.0:1777051439.272076:0:46199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 1777 00000100:00100000:2.0:1777051439.272092:0:46199:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f169c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+52:2439:x1863365426022016:12345-192.168.201.46@tcp:3:cat.0 00000100:00100000:2.0:1777051439.272403:0:46199:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f169c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+52:2439:x1863365426022016:12345-192.168.201.46@tcp:3:cat.0 Request processed in 312us (682us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051439.272416:0:46199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 1777 00002000:00100000:2.0:1777051439.272427:0:46199:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000400:0x105:0x0] (1048576->1052671) req@ffff99d94f169c00 x1863365426022016/t0(0) o3->2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp:400/0 lens 488/440 e 0 to 0 dl 1777051450 ref 1 fl Complete:/600/0 rc 0/0 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1777051439.272442:0:46199:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99d94f169c00 with x1863365426022016 ext(1048576->1052671) 00002000:00010000:2.0:1777051439.272449:0:46199:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99d94f169c00 00000100:00100000:0.0:1777051439.279480:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051439.279593:0:6582:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426022272 00000100:00100000:1.0:1777051439.279604:0:6582:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426022272 00000100:00100000:1.0:1777051439.279678:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3385 00000100:00100000:1.0:1777051439.279695:0:6582:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f168700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+51:138106:x1863365426022272:12345-192.168.201.46@tcp:35:cat.0 00000100:00100000:1.0:1777051439.280024:0:6582:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f168700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+52:138106:x1863365426022272:12345-192.168.201.46@tcp:35:cat.0 Request processed in 331us (550us total) trans 8589934701 rc 0/0 00000100:00100000:1.0:1777051439.280039:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3385 00000100:00100000:3.0:1777051439.299268:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051439.299357:0:6579:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426022528 00000100:00100000:0.0:1777051439.299380:0:6579:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426022528 00000100:00100000:0.0:1777051439.299575:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112178 00000100:00100000:0.0:1777051439.299595:0:6579:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942a0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+52:138108:x1863365426022528:12345-192.168.201.46@tcp:101:cat.0 00010000:00010000:0.0:1777051439.299629:0:6579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051439.299659:0:6579:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d950705e00/0x85f51a6b96716a18 lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b666c expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051439.299797:0:6579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d950705600/0x85f51a6b96716a1f lrc: 3/1,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051439.299827:0:6579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d950705600/0x85f51a6b96716a1f lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051439.299845:0:6579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d950705600/0x85f51a6b96716a1f lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051439.299869:0:6579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d950705400/0x85f51a6b96716a26 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x999b0966 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051439.299881:0:6579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d950705400/0x85f51a6b96716a26 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x999b0966 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051439.299892:0:6579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d950705400/0x85f51a6b96716a26 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x999b0966 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051439.300040:0:6579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d950705c00/0x85f51a6b96716a2d lrc: 3/1,0 mode: --/PR res: [0x240000bd2:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051439.300056:0:6579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d950705c00/0x85f51a6b96716a2d lrc: 3/1,0 mode: PR/PR res: [0x240000bd2:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051439.300069:0:6579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d950705c00/0x85f51a6b96716a2d lrc: 3/1,0 mode: PR/PR res: [0x240000bd2:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1777051439.300085:0:6579:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000bd2:0x3:0x0]: returning size 1048576 00010000:00010000:0.0:1777051439.300195:0:6579:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d950705600/0x85f51a6b96716a1f lrc: 4/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051439.300209:0:6579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d950705600/0x85f51a6b96716a1f lrc: 4/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6579 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051439.300220:0:6579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d950705600/0x85f51a6b96716a1f lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6579 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051439.300231:0:6579:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99d950705600/0x85f51a6b96716a1f lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6579 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051439.300241:0:6579:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d950705600 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:0.0:1777051439.300247:0:6579:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d950705600/0x85f51a6b96716a1f lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6579 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051439.300260:0:6579:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d950705600/0x85f51a6b96716a1f lrc: 5/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6579 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051439.300340:0:6579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff99d9413d0300) 00010000:00010000:0.0:1777051439.300347:0:6579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777051439.300356:0:6579:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99d950705600/0x85f51a6b96716a1f lrc: 3/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6579 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051439.300367:0:6579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d950705600/0x85f51a6b96716a1f lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6579 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051439.300390:0:6579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d950705400/0x85f51a6b96716a26 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x999b0966 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051439.300401:0:6579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d950705400/0x85f51a6b96716a26 lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x999b0966 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6579 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051439.300411:0:6579:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99d950705400/0x85f51a6b96716a26 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x999b0966 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6579 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051439.300421:0:6579:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d950705400 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:0.0:1777051439.300426:0:6579:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d950705400/0x85f51a6b96716a26 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x999b0966 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6579 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051439.300436:0:6579:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d950705400/0x85f51a6b96716a26 lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x999b0966 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6579 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051439.300449:0:6579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x999b0966 (ffff99da5fb45500) 00010000:00010000:0.0:1777051439.300454:0:6579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777051439.300458:0:6579:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99d950705400/0x85f51a6b96716a26 lrc: 2/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x999b0966 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6579 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051439.300469:0:6579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d950705400/0x85f51a6b96716a26 lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x999b0966 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6579 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051439.300532:0:6579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d950705e00/0x85f51a6b96716a18 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b666c expref: 55 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051439.300556:0:6579:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99d950705c00/0x85f51a6b96716a2d lrc: 3/0,0 mode: PR/PR res: [0x240000bd2:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b666c expref: 54 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051439.300576:0:6579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x3:0x0].0x0 (ffff99da5fb45f00) 00010000:00010000:0.0:1777051439.300581:0:6579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1777051439.300584:0:6579:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d950705c00, rc 0) 00000100:00100000:0.0:1777051439.300660:0:6579:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942a0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+54:138108:x1863365426022528:12345-192.168.201.46@tcp:101:cat.0 Request processed in 1069us (1405us total) trans 8589934702 rc 0/0 00000100:00100000:0.0:1777051439.300673:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112178 00000100:00100000:0.0:1777051439.312089:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051439.312261:0:6566:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426022784 00000100:00100000:1.0:1777051439.312275:0:6566:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426022784 00000100:00100000:1.0:1777051439.312352:0:6566:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13703 00000100:00100000:1.0:1777051439.312363:0:6566:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95aecdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+54:138108:x1863365426022784:12345-192.168.201.46@tcp:103:cat.0 00010000:00010000:1.0:1777051439.312383:0:6566:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1777051439.312410:0:6566:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d950705c00/0x85f51a6b96716a2d lrc: 0/0,0 mode: --/PR res: [0x240000bd2:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b666c expref: 54 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051439.312430:0:6566:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x3:0x0].0x0 (ffff99da5fb45f00) 00010000:00010000:1.0:1777051439.312441:0:6566:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1777051439.312501:0:6566:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95aecdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+53:138108:x1863365426022784:12345-192.168.201.46@tcp:103:cat.0 Request processed in 140us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051439.312510:0:6566:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13703 00000100:00100000:2.0:1777051439.317559:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051439.317690:0:6581:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426022912 00000100:00100000:0.0:1777051439.317704:0:6581:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426022912 00000100:00100000:0.0:1777051439.317822:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112179 00000100:00100000:0.0:1777051439.317840:0:6581:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7c9a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+53:138108:x1863365426022912:12345-192.168.201.46@tcp:58:cat.0 00010000:00010000:0.0:1777051439.318012:0:6581:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff99d950705e00/0x85f51a6b96716a3b lrc: 3/0,1 mode: --/EX res: [0x240000bd2:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051439.318038:0:6581:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d950705e00/0x85f51a6b96716a3b lrc: 3/0,1 mode: EX/EX res: [0x240000bd2:0x3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6581 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051439.318058:0:6581:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d950705e00/0x85f51a6b96716a3b lrc: 3/0,1 mode: EX/EX res: [0x240000bd2:0x3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6581 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1777051439.318290:0:6581:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].8, 136 off9280 00000100:00100000:0.0:1777051439.318399:0:6581:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7c9a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+53:138108:x1863365426022912:12345-192.168.201.46@tcp:58:cat.0 Request processed in 562us (843us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051439.318413:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112179 00000100:00100000:3.0:1777051439.323903:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051439.324059:0:6580:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426023040 00000100:00100000:2.0:1777051439.324075:0:6580:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426023040 00000100:00100000:2.0:1777051439.324192:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112180 00000100:00100000:2.0:1777051439.324281:0:6580:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942a0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+53:138108:x1863365426023040:12345-192.168.201.46@tcp:101:cat.0 00010000:00010000:2.0:1777051439.324314:0:6580:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051439.324349:0:6580:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d944a3e400/0x85f51a6b96716a42 lrc: 2/0,0 mode: --/CR res: [0x240000bd2:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6673 expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051439.324434:0:6580:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff99d950705e00/0x85f51a6b96716a3b lrc: 2/0,1 mode: EX/EX res: [0x240000bd2:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6581 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051439.324451:0:6580:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d944a3e400/0x85f51a6b96716a42 lrc: 4/0,0 mode: --/CR res: [0x240000bd2:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6673 expref: 54 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051439.324483:0:6580:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0001_UUID lock: ffff99d950705e00/0x85f51a6b96716a3b lrc: 3/0,1 mode: EX/EX res: [0x240000bd2:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 6581 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051439.324504:0:6580:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99d944a3e400/0x85f51a6b96716a42 lrc: 3/0,0 mode: --/CR res: [0x240000bd2:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6673 expref: 54 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051439.324527:0:6580:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x3:0x0].0x0 (ffff99da5fb45500) 00010000:00010000:2.0:1777051439.324532:0:6580:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1777051439.324538:0:6580:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff99d944a3e400/0x85f51a6b96716a42 lrc: 3/0,0 mode: --/CR res: [0x240000bd2:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6673 expref: 54 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051439.324546:0:6580:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d944a3e400, rc 0) 00000100:00100000:2.0:1777051439.324623:0:6580:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942a0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+54:138108:x1863365426023040:12345-192.168.201.46@tcp:101:cat.0 Request processed in 372us (738us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051439.324632:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112180 00000004:00080000:1.0:1777051439.382550:0:103178:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 8068575348954ns, next at 8069575342652ns, rc = 0 00000100:00100000:2.0:1777051439.382581:0:3678:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1777051439.382622:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7c9a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3678:1863365452649984:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1777051439.382747:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051439.382863:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da45f75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3678:1863365452649856:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1777051439.382905:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051439.382977:0:47388:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452649984 00000100:00100000:2.0:1777051439.382992:0:47388:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452649984 00000100:00100000:3.0:1777051439.383010:0:8472:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452649856 00000100:00100000:3.0:1777051439.383030:0:8472:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452649856 00000100:00100000:2.0:1777051439.383123:0:47388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5668 00000100:00100000:2.0:1777051439.383149:0:47388:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7c9a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3678:x1863365452649984:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1777051439.383162:0:8472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5669 00000100:00100000:3.0:1777051439.383192:0:8472:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da444a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3678:x1863365452649856:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1777051439.383242:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1777051439.383252:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:2.0:1777051439.383277:0:47388:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 467115584 pending 0 free 3644805120 avail 3413282816 00002000:00000024:3.0:1777051439.383294:0:8472:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 484539968 pending 0 free 3859525632 avail 3626930176 00000100:00100000:2.0:1777051439.383396:0:47388:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7c9a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3678:x1863365452649984:12345-0@lo:13:osp-pre-1-0.0 Request processed in 254us (652us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051439.383412:0:47388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5668 00000100:00100000:3.0:1777051439.383433:0:8472:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da444a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3678:x1863365452649856:12345-0@lo:13:osp-pre-0-0.0 Request processed in 248us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051439.383450:0:8472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5669 00000100:00100000:2.0:1777051439.383501:0:3678:0:(client.c:3101:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968359 gen 2 00000004:00080000:2.0:1777051439.383513:0:3678:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff99d94ed2ce00, transno 4294968359 00000100:00100000:2.0:1777051439.383553:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7c9a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3678:1863365452649984:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1777051439.383578:0:3678:0:(client.c:3101:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968360 gen 2 00000004:00080000:2.0:1777051439.383585:0:3678:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 4294968360 committed transno 4294968360 00000100:00100000:2.0:1777051439.383631:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da45f75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3678:1863365452649856:0@lo:13:osp-pre-0-0.0 00000004:00080000:1.0:1777051439.386802:0:103159:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000001:00080000:1.0:1777051439.386836:0:103159:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771175 is committed 00000004:00080000:1.0:1777051439.386843:0:103159:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000020:00080000:1.0:1777051439.386858:0:103159:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff99d95cf51d80 refcount 2 committed 0 result 0 batchid 25769803778 00000020:00080000:1.0:1777051439.386864:0:103159:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff99da7da06c00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff99d95cf51540 00000020:00080000:1.0:1777051439.386870:0:103159:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff99da7da06a00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff99d94e46f000 00000020:00080000:1.0:1777051439.386925:0:103159:0:(update_trans.c:1333:distribute_txn_batchid_cb()) lustre-MDT0000: 25769803777 batchid updated 00000020:00080000:2.0:1777051439.386965:0:103195:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 25769803778 committed batchid 25769803777 00000100:00100000:1.0:1777051439.387086:0:3677:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1777051439.387119:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95aecce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3677:1863365452650112:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1777051439.387168:0:103195:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da444a3800 pname:cluuid:pid:xid:nid:opc:job dist_txn-0:lustre-MDT0000-mdtlov_UUID:103195:1863365452650240:0@lo:1000:dist_txn-0.0 00000100:00100000:1.0:1777051439.387201:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051439.387323:0:103195:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051439.387341:0:55805:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452650112 00000100:00100000:3.0:1777051439.387354:0:55805:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452650112 00000100:00100000:2.0:1777051439.387382:0:103195:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d956bda780 going to sleep for 11 seconds 00000100:00100000:0.0:1777051439.387423:0:11727:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452650240 00000100:00100000:0.0:1777051439.387435:0:11727:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452650240 00000100:00100000:3.0:1777051439.387439:0:55805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8050 00000100:00100000:3.0:1777051439.387462:0:55805:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da45f75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3677:x1863365452650112:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1777051439.387502:0:55805:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:484 count 1 00000100:00100000:0.0:1777051439.387503:0:11727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8211 00000100:00100000:0.0:1777051439.387527:0:11727:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da444a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:103195:x1863365452650240:12345-0@lo:1000:dist_txn-0.0 00002000:00010000:3.0:1777051439.387555:0:55805:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x1e4:0x0] initial LVB size: 1048576, mtime: 0x69eba726, atime: 0x0, ctime: 0x69eba726, blocks: 0x800 00010000:00010000:3.0:1777051439.387571:0:55805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000de55c88/0x85f51a6b96716a49 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1e4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051439.387597:0:55805:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051439.387602:0:55805:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051439.387611:0:55805:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000de55c88/0x85f51a6b96716a49 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 55805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051439.387648:0:55805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000de55c88/0x85f51a6b96716a49 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 55805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051439.387665:0:55805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000de55c88/0x85f51a6b96716a49 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 55805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051439.387673:0:11727:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da444a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:103195:x1863365452650240:12345-0@lo:1000:dist_txn-0.0 Request processed in 148us (354us total) trans 0 rc 0/0 00010000:00010000:3.0:1777051439.387700:0:55805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000de55c88/0x85f51a6b96716a49 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 55805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051439.387703:0:11727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8211 00010000:00010000:3.0:1777051439.387757:0:55805:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1777051439.387804:0:103195:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da444a3800 pname:cluuid:pid:xid:nid:opc:job dist_txn-0:lustre-MDT0000-mdtlov_UUID:103195:1863365452650240:0@lo:1000:dist_txn-0.0 00000004:00080000:2.0:1777051439.387870:0:103195:0:(osp_trans.c:1582:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff99d956bda840 with version 4 00010000:00010000:1.0:1777051439.387886:0:6568:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000020:00080000:2.0:1777051439.387915:0:103195:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 25769803777 cancel update log [0x240000bd1:0x2:0x0].1: rc = 0 00010000:00010000:1.0:1777051439.387917:0:6568:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000de55c88/0x85f51a6b96716a49 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 55805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051439.387949:0:6568:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d9559a3200 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:1.0:1777051439.387959:0:6568:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000de55c88/0x85f51a6b96716a49 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 55805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051439.387981:0:6568:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000de55c88/0x85f51a6b96716a49 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 55805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051439.388013:0:6568:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000de55c88/0x85f51a6b96716a49 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 55805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051439.388018:0:55805:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da45f75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:3677:x1863365452650112:12345-0@lo:6:osp-syn-0-0.0 Request processed in 559us (813us total) trans 4294968366 rc 0/0 00000020:00080000:2.0:1777051439.388025:0:103195:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 25769803777 cancel update log [0x2000032e0:0x2:0x0].1: rc = 0 00010000:00010000:1.0:1777051439.388051:0:6568:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000de55c88/0x85f51a6b96716a49 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 55805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1777051439.388051:0:103195:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 25769803777 00000100:00100000:3.0:1777051439.388059:0:55805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8050 00010000:00010000:1.0:1777051439.388105:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051439.388111:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051439.388117:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1777051439.388143:0:3677:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99d95aecce00/2, rc 0, transno 4294968366 00000100:00100000:2.0:1777051439.388155:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95aecce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3677:1863365452650112:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1777051439.388280:0:103175:0:(osp_trans.c:1330:osp_get_next_request()) ou ffff99d9594cf180 version 4 rpc_version 4 00000020:00100000:0.0:1777051439.388310:0:103175:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1777051439.388320:0:103175:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff99d95aecf800 x1863365452650496/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1777051439.388341:0:103175:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95aecf800 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:103175:1863365452650496:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1777051439.388380:0:103175:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051439.388411:0:103175:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d95cf51f00 going to sleep for 11 seconds 00000100:00100000:1.0:1777051439.388553:0:6584:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452650496 00000100:00100000:1.0:1777051439.388562:0:6584:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452650496 00000100:00100000:1.0:1777051439.388619:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8212 00000100:00100000:1.0:1777051439.388632:0:6584:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95aecc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:103175:x1863365452650496:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1777051439.388816:0:6584:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95aecc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:103175:x1863365452650496:12345-0@lo:1000:osp_up1-0.0 Request processed in 185us (431us total) trans 8589934703 rc 0/0 00000100:00100000:1.0:1777051439.388828:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8212 00000100:00100000:0.0:1777051439.388991:0:103175:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95aecf800 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:103175:1863365452650496:0@lo:1000:osp_up1-0.0 00000040:00080000:0.0:1777051440.215382:0:104226:0:(llog.c:801:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1777051440.215393:0:104226:0:(llog_cat.c:158:llog_cat_process_common()) processing log [0x1:0x12:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1777051440.215431:0:104226:0:(llog.c:858:llog_process_thread()) stop processing plain [0x1:0x12:0x0] index 9 count 7 00000040:00080000:0.0:1777051440.215446:0:104226:0:(llog.c:858:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1777051440.215626:0:104226:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95aecd180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0001_UUID:104226:1863365452650624:192.168.201.46@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1777051440.215778:0:104226:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d95cf51e40 going to sleep for 11 seconds 00010000:00010000:0.0:1777051440.215874:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777051440.220102:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051440.220528:0:27882:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426023168 00000100:00100000:2.0:1777051440.220541:0:27882:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426023168 00000100:00100000:2.0:1777051440.220678:0:27882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112181 00000100:00100000:2.0:1777051440.220695:0:27882:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942a0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+19:138110:x1863365426023168:12345-192.168.201.46@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1777051440.220744:0:27882:0:(mdt_handler.c:7958:mdt_fid2path()) path get [0x240000bd2:0x3:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1777051440.220925:0:27882:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942a0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+19:138110:x1863365426023168:12345-192.168.201.46@tcp:53:lhsmtool_posix.0 Request processed in 232us (827us total) trans 0 rc -66/-66 00000100:00100000:2.0:1777051440.220941:0:27882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112181 00000100:00100000:0.0:1777051440.221543:0:104226:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95aecd180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0001_UUID:104226:1863365452650624:192.168.201.46@tcp:107:hsm_cdtr.0 00000100:00080000:1.0:1777051440.221694:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1777051440.224577:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051440.224703:0:46494:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426023296 00000100:00100000:0.0:1777051440.224713:0:46494:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426023296 00000100:00100000:0.0:1777051440.224930:0:46494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112182 00000100:00100000:0.0:1777051440.224946:0:46494:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942a0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c11b6966-0775-44d2-bdc6-c74c26eb2226+23:138110:x1863365426023296:12345-192.168.201.46@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1777051440.224975:0:46494:0:(mdt_handler.c:7958:mdt_fid2path()) path get [0x2000032e2:0x6:0x0] from 18446744073709551615 #-1 00000100:00100000:0.0:1777051440.225210:0:46494:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942a0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c11b6966-0775-44d2-bdc6-c74c26eb2226+23:138110:x1863365426023296:12345-192.168.201.46@tcp:53:lhsmtool_posix.0 Request processed in 266us (636us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051440.225224:0:46494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112182 00000100:00080000:1.0:1777051440.225687:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1777051440.229187:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051440.229291:0:8492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426023424 00000100:00100000:0.0:1777051440.229301:0:8492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426023424 00000100:00100000:0.0:1777051440.229367:0:8492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112183 00000100:00100000:0.0:1777051440.229381:0:8492:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da45f75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+23:138110:x1863365426023424:12345-192.168.201.46@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1777051440.229479:0:8492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950705600/0x85f51a6b96716a50 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051440.229504:0:8492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d950705600/0x85f51a6b96716a50 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051440.229522:0:8492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d950705600/0x85f51a6b96716a50 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051440.229545:0:8492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950705a00/0x85f51a6b96716a57 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x915cfc18 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051440.229558:0:8492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d950705a00/0x85f51a6b96716a57 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x915cfc18 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051440.229571:0:8492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d950705a00/0x85f51a6b96716a57 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x915cfc18 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051440.229684:0:8492:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95aecd180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8492:1863365452650752:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1777051440.229748:0:8492:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051440.229929:0:8492:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d95cf51180 going to sleep for 11 seconds 00000100:00100000:2.0:1777051440.230004:0:6585:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452650752 00000100:00100000:2.0:1777051440.230013:0:6585:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452650752 00000100:00100000:2.0:1777051440.230076:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8213 00000100:00100000:2.0:1777051440.230088:0:6585:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95aecd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:8492:x1863365452650752:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1777051440.230312:0:6585:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95aecd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:8492:x1863365452650752:12345-0@lo:1000:mdt00_003.0 Request processed in 224us (561us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051440.230326:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8213 00000100:00100000:0.0:1777051440.230440:0:8492:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95aecd180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8492:1863365452650752:0@lo:1000:mdt00_003.0 00010000:00010000:0.0:1777051440.230505:0:8492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950704a00/0x85f51a6b96716a5e lrc: 3/1,0 mode: --/PR res: [0x240000bd2:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051440.230531:0:8492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d950704a00/0x85f51a6b96716a5e lrc: 3/1,0 mode: PR/PR res: [0x240000bd2:0x3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051440.230543:0:8492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d950704a00/0x85f51a6b96716a5e lrc: 3/1,0 mode: PR/PR res: [0x240000bd2:0x3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1777051440.230570:0:8492:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99d950704a00/0x85f51a6b96716a5e lrc: 3/1,0 mode: PR/PR res: [0x240000bd2:0x3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051440.230587:0:8492:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950705600/0x85f51a6b96716a50 lrc: 4/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051440.230598:0:8492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950705600/0x85f51a6b96716a50 lrc: 4/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051440.230608:0:8492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d950705600/0x85f51a6b96716a50 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051440.230619:0:8492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d950705600/0x85f51a6b96716a50 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051440.230628:0:8492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d950705600 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:0.0:1777051440.230635:0:8492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d950705600/0x85f51a6b96716a50 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051440.230646:0:8492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d950705600/0x85f51a6b96716a50 lrc: 5/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051440.230663:0:8492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99d941e2ea00) 00010000:00010000:0.0:1777051440.230668:0:8492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777051440.230675:0:8492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d950705600/0x85f51a6b96716a50 lrc: 3/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051440.230686:0:8492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d950705600/0x85f51a6b96716a50 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051440.230706:0:8492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950705a00/0x85f51a6b96716a57 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x915cfc18 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051440.230716:0:8492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d950705a00/0x85f51a6b96716a57 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x915cfc18 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051440.230726:0:8492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d950705a00/0x85f51a6b96716a57 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x915cfc18 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051440.230735:0:8492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d950705a00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:0.0:1777051440.230739:0:8492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d950705a00/0x85f51a6b96716a57 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x915cfc18 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051440.230749:0:8492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d950705a00/0x85f51a6b96716a57 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x915cfc18 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051440.230795:0:8492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x915cfc18 (ffff99da5fb45c00) 00010000:00010000:0.0:1777051440.230799:0:8492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777051440.230804:0:8492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d950705a00/0x85f51a6b96716a57 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x915cfc18 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051440.230813:0:8492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d950705a00/0x85f51a6b96716a57 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x915cfc18 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051440.230834:0:8492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950704a00/0x85f51a6b96716a5e lrc: 3/1,0 mode: PR/PR res: [0x240000bd2:0x3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051440.230845:0:8492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d950704a00/0x85f51a6b96716a5e lrc: 2/0,0 mode: PR/PR res: [0x240000bd2:0x3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051440.230855:0:8492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d950704a00/0x85f51a6b96716a5e lrc: 3/0,0 mode: PR/PR res: [0x240000bd2:0x3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051440.230863:0:8492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d950704a00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:0.0:1777051440.230867:0:8492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d950704a00/0x85f51a6b96716a5e lrc: 3/0,0 mode: PR/PR res: [0x240000bd2:0x3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051440.230876:0:8492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d950704a00/0x85f51a6b96716a5e lrc: 4/0,0 mode: PR/PR res: [0x240000bd2:0x3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051440.230888:0:8492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x3:0x0].0x0 (ffff99da5fb45f00) 00010000:00010000:0.0:1777051440.230892:0:8492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1777051440.230897:0:8492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d950704a00/0x85f51a6b96716a5e lrc: 2/0,0 mode: --/PR res: [0x240000bd2:0x3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051440.230906:0:8492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d950704a00/0x85f51a6b96716a5e lrc: 0/0,0 mode: --/PR res: [0x240000bd2:0x3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051440.231004:0:8492:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da45f75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+23:138110:x1863365426023424:12345-192.168.201.46@tcp:34:lhsmtool_posix.0 Request processed in 1623us (1820us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051440.231017:0:8492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112183 00000100:00100000:3.0:1777051440.232657:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051440.233041:0:6581:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426023552 00000100:00100000:0.0:1777051440.233060:0:6581:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426023552 00000100:00100000:0.0:1777051440.233237:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112184 00000100:00100000:0.0:1777051440.233253:0:6581:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942a0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+18:138110:x1863365426023552:12345-192.168.201.46@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1777051440.233335:0:6581:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d950704800/0x85f51a6b96716a65 lrc: 3/1,0 mode: --/PR res: [0x240000bd2:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051440.233355:0:6581:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d950704800/0x85f51a6b96716a65 lrc: 3/1,0 mode: PR/PR res: [0x240000bd2:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6581 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051440.233371:0:6581:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d950704800/0x85f51a6b96716a65 lrc: 3/1,0 mode: PR/PR res: [0x240000bd2:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6581 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1777051440.233422:0:6581:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000bd2:0x3:0x0]: returning size 1048576 00000004:00200000:0.0:1777051440.233428:0:6581:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:0.0:1777051440.233444:0:6581:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d950704800/0x85f51a6b96716a65 lrc: 3/1,0 mode: PR/PR res: [0x240000bd2:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6581 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051440.233456:0:6581:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d950704800/0x85f51a6b96716a65 lrc: 2/0,0 mode: PR/PR res: [0x240000bd2:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6581 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051440.233467:0:6581:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99d950704800/0x85f51a6b96716a65 lrc: 3/0,0 mode: PR/PR res: [0x240000bd2:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6581 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051440.233476:0:6581:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d950704800 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:0.0:1777051440.233481:0:6581:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d950704800/0x85f51a6b96716a65 lrc: 3/0,0 mode: PR/PR res: [0x240000bd2:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6581 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051440.233492:0:6581:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d950704800/0x85f51a6b96716a65 lrc: 4/0,0 mode: PR/PR res: [0x240000bd2:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6581 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051440.233507:0:6581:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x3:0x0].0x0 (ffff99da5fb45500) 00010000:00010000:0.0:1777051440.233512:0:6581:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1777051440.233517:0:6581:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99d950704800/0x85f51a6b96716a65 lrc: 2/0,0 mode: --/PR res: [0x240000bd2:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6581 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051440.233528:0:6581:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d950704800/0x85f51a6b96716a65 lrc: 0/0,0 mode: --/PR res: [0x240000bd2:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6581 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051440.233602:0:6581:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942a0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+18:138110:x1863365426023552:12345-192.168.201.46@tcp:34:lhsmtool_posix.0 Request processed in 351us (947us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051440.233621:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112184 00000100:00100000:3.0:1777051440.236571:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051440.236685:0:46497:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426023808 00000100:00100000:1.0:1777051440.236695:0:46497:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426023808 00000100:00100000:1.0:1777051440.236789:0:46497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112185 00000100:00100000:1.0:1777051440.236804:0:46497:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942a0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:c11b6966-0775-44d2-bdc6-c74c26eb2226+18:138110:x1863365426023808:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1777051440.236824:0:46497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777051440.236848:0:46497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72e400/0x85f51a6b96716a6c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b667a expref: -99 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051440.236952:0:46497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72f200/0x85f51a6b96716a73 lrc: 3/1,0 mode: --/PR res: [0x240000bd2:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051440.236972:0:46497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72f200/0x85f51a6b96716a73 lrc: 3/1,0 mode: PR/PR res: [0x240000bd2:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051440.236989:0:46497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72f200/0x85f51a6b96716a73 lrc: 3/1,0 mode: PR/PR res: [0x240000bd2:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1777051440.237004:0:46497:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000bd2:0x3:0x0]: returning size 1048576 00010000:00010000:1.0:1777051440.237111:0:46497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72f200/0x85f51a6b96716a73 lrc: 3/1,0 mode: PR/PR res: [0x240000bd2:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051440.237136:0:46497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72f200/0x85f51a6b96716a73 lrc: 2/0,0 mode: PR/PR res: [0x240000bd2:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051440.237148:0:46497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72f200/0x85f51a6b96716a73 lrc: 3/0,0 mode: PR/PR res: [0x240000bd2:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051440.237494:0:46497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94d72f200 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:1.0:1777051440.237501:0:46497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72f200/0x85f51a6b96716a73 lrc: 3/0,0 mode: PR/PR res: [0x240000bd2:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051440.237523:0:46497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72f200/0x85f51a6b96716a73 lrc: 4/0,0 mode: PR/PR res: [0x240000bd2:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051440.237539:0:46497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x3:0x0].0x0 (ffff99da5fb45500) 00010000:00010000:1.0:1777051440.237545:0:46497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1777051440.237551:0:46497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72f200/0x85f51a6b96716a73 lrc: 2/0,0 mode: --/PR res: [0x240000bd2:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051440.237561:0:46497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72f200/0x85f51a6b96716a73 lrc: 0/0,0 mode: --/PR res: [0x240000bd2:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051440.237615:0:46497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72e400/0x85f51a6b96716a6c lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b667a expref: 20 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051440.237633:0:46497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99d94e6b6000) 00010000:00010000:1.0:1777051440.237637:0:46497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1777051440.237644:0:46497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72e400/0x85f51a6b96716a6c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b667a expref: 20 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051440.237665:0:46497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d94d72e400, rc 0) 00000100:00100000:1.0:1777051440.237736:0:46497:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942a0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:c11b6966-0775-44d2-bdc6-c74c26eb2226+19:138110:x1863365426023808:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 Request processed in 934us (1167us total) trans 8589934704 rc 301/301 00000100:00100000:1.0:1777051440.237749:0:46497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112185 00000100:00100000:1.0:1777051440.242524:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051440.242645:0:27882:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426023936 00000100:00100000:2.0:1777051440.242656:0:27882:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426023936 00000100:00100000:2.0:1777051440.242725:0:27882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112186 00000100:00100000:2.0:1777051440.242740:0:27882:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+19:138110:x1863365426023936:12345-192.168.201.46@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1777051440.242809:0:27882:0:(mdt_handler.c:7958:mdt_fid2path()) path get [0x240000bd2:0x3:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1777051440.242951:0:27882:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+19:138110:x1863365426023936:12345-192.168.201.46@tcp:53:lhsmtool_posix.0 Request processed in 212us (431us total) trans 0 rc -66/-66 00000100:00100000:2.0:1777051440.242966:0:27882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112186 00000100:00100000:3.0:1777051440.246703:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051440.246837:0:46494:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426024064 00000100:00100000:0.0:1777051440.246847:0:46494:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426024064 00000100:00100000:0.0:1777051440.246931:0:46494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112187 00000100:00100000:0.0:1777051440.246948:0:46494:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942a0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c11b6966-0775-44d2-bdc6-c74c26eb2226+23:138110:x1863365426024064:12345-192.168.201.46@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1777051440.246977:0:46494:0:(mdt_handler.c:7958:mdt_fid2path()) path get [0x2000032e2:0x6:0x0] from 18446744073709551615 #-1 00000100:00100000:0.0:1777051440.247447:0:46494:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942a0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c11b6966-0775-44d2-bdc6-c74c26eb2226+23:138110:x1863365426024064:12345-192.168.201.46@tcp:53:lhsmtool_posix.0 Request processed in 502us (747us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051440.247461:0:46494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112187 00000100:00100000:3.0:1777051440.253471:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051440.253848:0:6579:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426024320 00000100:00100000:0.0:1777051440.253861:0:6579:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426024320 00000100:00100000:0.0:1777051440.253931:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112188 00000100:00100000:0.0:1777051440.253949:0:6579:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d944d28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+19:138110:x1863365426024320:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1777051440.253968:0:6579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051440.253997:0:6579:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d950704800/0x85f51a6b96716a81 lrc: 2/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6681 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051440.255441:0:6579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d950704a00/0x85f51a6b96716a88 lrc: 3/1,0 mode: --/PR res: [0x240000bd2:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051440.255460:0:6579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d950704a00/0x85f51a6b96716a88 lrc: 3/1,0 mode: PR/PR res: [0x240000bd2:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051440.255475:0:6579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d950704a00/0x85f51a6b96716a88 lrc: 3/1,0 mode: PR/PR res: [0x240000bd2:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1777051440.255492:0:6579:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000bd2:0x6:0x0]: returning size 0 00010000:00010000:0.0:1777051440.255834:0:6579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d950704800/0x85f51a6b96716a81 lrc: 0/0,0 mode: --/CW res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6681 expref: 22 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051440.255863:0:6579:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99d950704a00/0x85f51a6b96716a88 lrc: 3/0,0 mode: PR/PR res: [0x240000bd2:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6681 expref: 21 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051440.255879:0:6579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x6:0x0].0x0 (ffff99da5fb45f00) 00010000:00010000:0.0:1777051440.255884:0:6579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1777051440.255889:0:6579:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d950704a00, rc 0) 00000100:00100000:0.0:1777051440.255968:0:6579:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d944d28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+21:138110:x1863365426024320:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 Request processed in 2017us (2503us total) trans 8589934705 rc 0/0 00000100:00100000:0.0:1777051440.255981:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112188 00000100:00100000:1.0:1777051440.262047:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051440.262450:0:27885:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426024576 00000100:00100000:3.0:1777051440.262461:0:27885:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426024576 00000100:00100000:3.0:1777051440.262527:0:27885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112189 00000100:00100000:3.0:1777051440.262548:0:27885:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95fae9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c11b6966-0775-44d2-bdc6-c74c26eb2226+21:138110:x1863365426024576:12345-192.168.201.46@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1777051440.262606:0:27885:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777051440.262634:0:27885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d950704a00/0x85f51a6b96716a88 lrc: 0/0,0 mode: --/PR res: [0x240000bd2:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6681 expref: 21 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051440.262660:0:27885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x6:0x0].0x0 (ffff99da5fb45f00) 00010000:00010000:3.0:1777051440.262672:0:27885:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1777051440.262729:0:27885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d9559a3a00/0x85f51a6b96716a96 lrc: 3/0,1 mode: --/CW res: [0x2000032e0:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051440.262744:0:27885:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d9559a3a00/0x85f51a6b96716a96 lrc: 3/0,1 mode: --/CW res: [0x2000032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 27885 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051440.263080:0:27885:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d9559a3a00/0x85f51a6b96716a96 lrc: 3/0,1 mode: --/CW res: [0x2000032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 27885 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051440.263114:0:27885:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d944d28700 pname:cluuid:pid:xid:nid:opc:job mdt00_007:lustre-MDT0001-mdtlov_UUID:27885:1863365452650880:0@lo:101:mdt00_007.0 00000100:00100000:3.0:1777051440.263173:0:27885:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051440.263348:0:27885:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d95cb32c00 going to sleep for 11 seconds 00000100:00100000:1.0:1777051440.263425:0:47208:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452650880 00000100:00100000:1.0:1777051440.263434:0:47208:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452650880 00000100:00100000:1.0:1777051440.263493:0:47208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8214 00000100:00100000:1.0:1777051440.263507:0:47208:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d944d28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+6:27885:x1863365452650880:12345-0@lo:101:mdt00_007.0 00010000:00010000:1.0:1777051440.263524:0:47208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777051440.263551:0:47208:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94d72f200/0x85f51a6b96716a9d lrc: 2/0,0 mode: --/CW res: [0x2000032e0:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x85f51a6b96716a96 expref: -99 pid: 47208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051440.263584:0:47208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94d72f200/0x85f51a6b96716a9d lrc: 3/0,0 mode: CW/CW res: [0x2000032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x85f51a6b96716a96 expref: 7 pid: 47208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051440.263604:0:47208:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94d72f200/0x85f51a6b96716a9d lrc: 3/0,0 mode: CW/CW res: [0x2000032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b96716a96 expref: 7 pid: 47208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051440.263617:0:47208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e0:0x1:0x0].0x0 (ffff99d94e6b6000) 00010000:00010000:1.0:1777051440.263622:0:47208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777051440.263626:0:47208:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d94d72f200, rc 0) 00000100:00100000:1.0:1777051440.263987:0:47208:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d944d28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+7:27885:x1863365452650880:12345-0@lo:101:mdt00_007.0 Request processed in 474us (805us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051440.264000:0:47208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8214 00000100:00100000:3.0:1777051440.264065:0:27885:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d944d28700 pname:cluuid:pid:xid:nid:opc:job mdt00_007:lustre-MDT0001-mdtlov_UUID:27885:1863365452650880:0@lo:101:mdt00_007.0 00010000:00010000:3.0:1777051440.264092:0:27885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d9559a3a00/0x85f51a6b96716a96 lrc: 4/0,1 mode: CW/CW res: [0x2000032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x85f51a6b96716a9d expref: -99 pid: 27885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051440.264112:0:27885:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d9559a3a00/0x85f51a6b96716a96 lrc: 4/0,1 mode: CW/CW res: [0x2000032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x85f51a6b96716a9d expref: -99 pid: 27885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1777051440.264142:0:27885:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x2000032e0:0x1:0x0] 00010000:00010000:3.0:1777051440.264198:0:27885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d9559a2800/0x85f51a6b96716aa4 lrc: 3/0,1 mode: --/PW res: [0x2000032e0:0x1:0x0].0xec12eaff bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051440.264212:0:27885:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d9559a2800/0x85f51a6b96716aa4 lrc: 3/0,1 mode: --/PW res: [0x2000032e0:0x1:0x0].0xec12eaff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 27885 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051440.264225:0:27885:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d9559a2800/0x85f51a6b96716aa4 lrc: 3/0,1 mode: --/PW res: [0x2000032e0:0x1:0x0].0xec12eaff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 27885 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051440.264248:0:27885:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d944d28700 pname:cluuid:pid:xid:nid:opc:job mdt00_007:lustre-MDT0001-mdtlov_UUID:27885:1863365452651008:0@lo:101:mdt00_007.0 00000100:00100000:3.0:1777051440.264289:0:27885:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051440.264325:0:27885:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d95cb32c00 going to sleep for 11 seconds 00000100:00100000:0.0:1777051440.264385:0:46500:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452651008 00000100:00100000:0.0:1777051440.264395:0:46500:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452651008 00000100:00100000:0.0:1777051440.264450:0:46500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8215 00000100:00100000:0.0:1777051440.264459:0:46500:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d944d29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+7:27885:x1863365452651008:12345-0@lo:101:mdt00_007.0 00010000:00010000:0.0:1777051440.264472:0:46500:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051440.264489:0:46500:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d950704800/0x85f51a6b96716aab lrc: 2/0,0 mode: --/PW res: [0x2000032e0:0x1:0x0].0xec12eaff bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x85f51a6b96716aa4 expref: -99 pid: 46500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051440.264515:0:46500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d950704800/0x85f51a6b96716aab lrc: 3/0,0 mode: PW/PW res: [0x2000032e0:0x1:0x0].0xec12eaff bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x85f51a6b96716aa4 expref: 8 pid: 46500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051440.264530:0:46500:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950704800/0x85f51a6b96716aab lrc: 3/0,0 mode: PW/PW res: [0x2000032e0:0x1:0x0].0xec12eaff bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b96716aa4 expref: 8 pid: 46500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051440.264538:0:46500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e0:0x1:0x0].0xec12eaff (ffff99da5fb45c00) 00010000:00010000:0.0:1777051440.264542:0:46500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777051440.264546:0:46500:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d950704800, rc 0) 00000100:00100000:0.0:1777051440.264598:0:46500:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d944d29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+8:27885:x1863365452651008:12345-0@lo:101:mdt00_007.0 Request processed in 140us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051440.264606:0:46500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8215 00000100:00100000:3.0:1777051440.264701:0:27885:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d944d28700 pname:cluuid:pid:xid:nid:opc:job mdt00_007:lustre-MDT0001-mdtlov_UUID:27885:1863365452651008:0@lo:101:mdt00_007.0 00010000:00010000:3.0:1777051440.264721:0:27885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d9559a2800/0x85f51a6b96716aa4 lrc: 4/0,1 mode: PW/PW res: [0x2000032e0:0x1:0x0].0xec12eaff bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x85f51a6b96716aab expref: -99 pid: 27885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051440.264737:0:27885:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d9559a2800/0x85f51a6b96716aa4 lrc: 4/0,1 mode: PW/PW res: [0x2000032e0:0x1:0x0].0xec12eaff bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x85f51a6b96716aab expref: -99 pid: 27885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1777051440.265085:0:27885:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x2000032e0:0x1:0x0] 00000100:00100000:3.0:1777051440.266026:0:27885:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d944d28700 pname:cluuid:pid:xid:nid:opc:job mdt00_007:lustre-MDT0001-mdtlov_UUID:27885:1863365452651136:0@lo:1000:mdt00_007.0 00000100:00100000:3.0:1777051440.266081:0:27885:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051440.266241:0:27885:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d95cb32e40 going to sleep for 11 seconds 00000100:00100000:1.0:1777051440.266544:0:46498:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452651136 00000100:00100000:1.0:1777051440.266553:0:46498:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452651136 00000100:00100000:1.0:1777051440.266623:0:46498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8216 00000100:00100000:1.0:1777051440.266638:0:46498:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d944d29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+8:27885:x1863365452651136:12345-0@lo:1000:mdt00_007.0 00000100:00100000:1.0:1777051440.266784:0:46498:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d944d29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+8:27885:x1863365452651136:12345-0@lo:1000:mdt00_007.0 Request processed in 118us (672us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051440.266798:0:46498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8216 00000100:00100000:2.0:1777051440.266857:0:27885:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d944d28700 pname:cluuid:pid:xid:nid:opc:job mdt00_007:lustre-MDT0001-mdtlov_UUID:27885:1863365452651136:0@lo:1000:mdt00_007.0 00000100:00100000:2.0:1777051440.266931:0:27885:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da444a3800 pname:cluuid:pid:xid:nid:opc:job mdt00_007:lustre-MDT0001-mdtlov_UUID:27885:1863365452651264:0@lo:1000:mdt00_007.0 00000100:00100000:2.0:1777051440.266985:0:27885:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051440.267027:0:27885:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d956bda780 going to sleep for 11 seconds 00000100:00100000:0.0:1777051440.267096:0:11727:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452651264 00000100:00100000:0.0:1777051440.267105:0:11727:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452651264 00000100:00100000:1.0:1777051440.267502:0:47208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8217 00000100:00100000:1.0:1777051440.267516:0:47208:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7c9a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+8:27885:x1863365452651264:12345-0@lo:1000:mdt00_007.0 00000100:00100000:1.0:1777051440.267651:0:47208:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7c9a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+8:27885:x1863365452651264:12345-0@lo:1000:mdt00_007.0 Request processed in 136us (663us total) trans 0 rc -2/-2 00000100:00100000:1.0:1777051440.267665:0:47208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8217 00000100:00100000:2.0:1777051440.268452:0:27885:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da444a3800 pname:cluuid:pid:xid:nid:opc:job mdt00_007:lustre-MDT0001-mdtlov_UUID:27885:1863365452651264:0@lo:1000:mdt00_007.0 00000004:00080000:2.0:1777051440.268483:0:27885:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x2000032e0:0x1:0x0] 00010000:00010000:2.0:1777051440.268493:0:27885:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d9559a3a00/0x85f51a6b96716a96 lrc: 4/0,1 mode: CW/CW res: [0x2000032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x85f51a6b96716a9d expref: -99 pid: 27885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051440.268510:0:27885:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d9559a3a00/0x85f51a6b96716a96 lrc: 4/0,1 mode: CW/CW res: [0x2000032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x85f51a6b96716a9d expref: -99 pid: 27885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051440.268534:0:27885:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d9559a3a00/0x85f51a6b96716a96 lrc: 3/0,0 mode: CW/CW res: [0x2000032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x85f51a6b96716a9d expref: -99 pid: 27885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051440.268577:0:27885:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:2.0:1777051440.268587:0:27885:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x2000032e0:0x1:0x0] 00010000:00010000:2.0:1777051440.268594:0:27885:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d9559a2800/0x85f51a6b96716aa4 lrc: 4/0,1 mode: PW/PW res: [0x2000032e0:0x1:0x0].0xec12eaff bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x85f51a6b96716aab expref: -99 pid: 27885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051440.268609:0:27885:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d9559a2800/0x85f51a6b96716aa4 lrc: 4/0,1 mode: PW/PW res: [0x2000032e0:0x1:0x0].0xec12eaff bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x85f51a6b96716aab expref: -99 pid: 27885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051440.268623:0:27885:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d9559a2800/0x85f51a6b96716aa4 lrc: 3/0,0 mode: PW/PW res: [0x2000032e0:0x1:0x0].0xec12eaff bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x85f51a6b96716aab expref: -99 pid: 27885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051440.268646:0:27885:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1777051440.268675:0:38719:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1777051440.268688:0:38719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d9559a3a00/0x85f51a6b96716a96 lrc: 2/0,0 mode: CW/CW res: [0x2000032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x85f51a6b96716a9d expref: -99 pid: 27885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051440.268705:0:38719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d9559a3a00 already unused, calling callback (ffffffffc177eed0) 00010000:00010000:0.0:1777051440.268714:0:38719:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d9559a3a00/0x85f51a6b96716a96 lrc: 3/0,0 mode: CW/CW res: [0x2000032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x85f51a6b96716a9d expref: -99 pid: 27885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1777051440.268733:0:38719:0:(mdt_handler.c:3963:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d9559a3a00/0x85f51a6b96716a96 lrc: 3/0,0 mode: CW/CW res: [0x2000032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x85f51a6b96716a9d expref: -99 pid: 27885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051440.268733:0:27885:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95fae9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c11b6966-0775-44d2-bdc6-c74c26eb2226+20:138110:x1863365426024576:12345-192.168.201.46@tcp:36:lhsmtool_posix.0 Request processed in 6188us (6688us total) trans 0 rc -2/-2 00000100:00100000:2.0:1777051440.269056:0:27885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112189 00010000:00010000:0.0:1777051440.269081:0:38719:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d9559a3a00/0x85f51a6b96716a96 lrc: 2/0,0 mode: --/CW res: [0x2000032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x85f51a6b96716a9d expref: -99 pid: 27885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051440.269095:0:38719:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1777051440.269129:0:38719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d9559a3a00/0x85f51a6b96716a96 lrc: 1/0,0 mode: --/CW res: [0x2000032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x85f51a6b96716a9d expref: -99 pid: 27885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051440.269142:0:38719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d9559a3a00/0x85f51a6b96716a96 lrc: 0/0,0 mode: --/CW res: [0x2000032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x85f51a6b96716a9d expref: -99 pid: 27885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051440.269153:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95aecd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452651392:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1777051440.269486:0:38719:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1777051440.269495:0:38719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d9559a2800/0x85f51a6b96716aa4 lrc: 2/0,0 mode: PW/PW res: [0x2000032e0:0x1:0x0].0xec12eaff bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x85f51a6b96716aab expref: -99 pid: 27885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051440.269527:0:38719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d9559a2800 already unused, calling callback (ffffffffc177eed0) 00000100:00100000:2.0:1777051440.269527:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1777051440.269539:0:38719:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d9559a2800/0x85f51a6b96716aa4 lrc: 3/0,0 mode: PW/PW res: [0x2000032e0:0x1:0x0].0xec12eaff bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x85f51a6b96716aab expref: -99 pid: 27885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1777051440.269554:0:38719:0:(mdt_handler.c:3963:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d9559a2800/0x85f51a6b96716aa4 lrc: 3/0,0 mode: PW/PW res: [0x2000032e0:0x1:0x0].0xec12eaff bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x85f51a6b96716aab expref: -99 pid: 27885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051440.269590:0:9550:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452651392 00010000:00010000:0.0:1777051440.269597:0:38719:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d9559a2800/0x85f51a6b96716aa4 lrc: 2/0,0 mode: --/PW res: [0x2000032e0:0x1:0x0].0xec12eaff bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x85f51a6b96716aab expref: -99 pid: 27885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051440.269602:0:9550:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452651392 00010000:00010000:0.0:1777051440.269617:0:38719:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1777051440.269663:0:38719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d9559a2800/0x85f51a6b96716aa4 lrc: 1/0,0 mode: --/PW res: [0x2000032e0:0x1:0x0].0xec12eaff bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x85f51a6b96716aab expref: -99 pid: 27885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051440.269676:0:38719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d9559a2800/0x85f51a6b96716aa4 lrc: 0/0,0 mode: --/PW res: [0x2000032e0:0x1:0x0].0xec12eaff bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x85f51a6b96716aab expref: -99 pid: 27885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051440.269702:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777051440.269706:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777051440.269709:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051440.269876:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1777051440.270034:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95aece680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3680:1863365452651520:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1777051440.270084:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051440.270308:0:6565:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452651520 00000100:00100000:0.0:1777051440.270318:0:6565:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452651520 00000100:00100000:3.0:1777051440.270362:0:47827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13704 00000100:00100000:3.0:1777051440.270382:0:47827:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da444a3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:lustre-MDT0001-mdtlov_UUID+9:3679:x1863365452651392:12345-0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1777051440.270398:0:6565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13705 00010000:00010000:3.0:1777051440.270400:0:47827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1777051440.270422:0:6565:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5fbeea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+9:3680:x1863365452651520:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1777051440.270441:0:6565:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777051440.270470:0:6565:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d950704800/0x85f51a6b96716aab lrc: 0/0,0 mode: --/PW res: [0x2000032e0:0x1:0x0].0xec12eaff bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x85f51a6b96716aa4 expref: 9 pid: 46500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051440.270486:0:47827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94d72f200/0x85f51a6b96716a9d lrc: 0/0,0 mode: --/CW res: [0x2000032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x85f51a6b96716a96 expref: 9 pid: 47208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051440.270521:0:47827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e0:0x1:0x0].0x0 (ffff99d94e6b6000) 00010000:00010000:3.0:1777051440.270532:0:47827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1777051440.270668:0:47827:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da444a3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:lustre-MDT0001-mdtlov_UUID+8:3679:x1863365452651392:12345-0@lo:103:ldlm_bl.0 Request processed in 290us (1146us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051440.270681:0:47827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13704 00000100:00100000:3.0:1777051440.270744:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95aecd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452651392:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1777051440.270802:0:6565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e0:0x1:0x0].0xec12eaff (ffff99da5fb45c00) 00010000:00010000:0.0:1777051440.270819:0:6565:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1777051440.270897:0:6565:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5fbeea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+6:3680:x1863365452651520:12345-0@lo:103:ldlm_bl.0 Request processed in 483us (811us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051440.270910:0:6565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13705 00000100:00100000:2.0:1777051440.271039:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95aece680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3680:1863365452651520:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1777051440.274669:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051440.275295:0:6580:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426024704 00000100:00100000:2.0:1777051440.275304:0:6580:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426024704 00000100:00100000:2.0:1777051440.275365:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112190 00000100:00100000:2.0:1777051440.275377:0:6580:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d944d29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+20:138110:x1863365426024704:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1777051440.275396:0:6580:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051440.275422:0:6580:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d944a3ee00/0x85f51a6b96716ab2 lrc: 2/0,0 mode: --/PR res: [0x240000bd2:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6688 expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051440.275465:0:6580:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d944a3fe00/0x85f51a6b96716ab9 lrc: 3/1,0 mode: --/PR res: [0x240000bd2:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051440.275484:0:6580:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d944a3fe00/0x85f51a6b96716ab9 lrc: 3/1,0 mode: PR/PR res: [0x240000bd2:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6580 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051440.275499:0:6580:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d944a3fe00/0x85f51a6b96716ab9 lrc: 3/1,0 mode: PR/PR res: [0x240000bd2:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6580 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051440.275642:0:6580:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d944a3ee00/0x85f51a6b96716ab2 lrc: 0/0,0 mode: --/PR res: [0x240000bd2:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6688 expref: 22 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051440.275666:0:6580:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99d944a3fe00/0x85f51a6b96716ab9 lrc: 3/0,0 mode: PR/PR res: [0x240000bd2:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6688 expref: 21 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051440.275680:0:6580:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x6:0x0].0x0 (ffff99da59dd4c00) 00010000:00010000:2.0:1777051440.275684:0:6580:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1777051440.275689:0:6580:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d944a3fe00, rc 0) 00000100:00100000:2.0:1777051440.275773:0:6580:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d944d29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+21:138110:x1863365426024704:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 Request processed in 374us (1086us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051440.275793:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112190 00000100:00100000:3.0:1777051440.277605:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051440.277677:0:10328:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426024960 00000100:00100000:2.0:1777051440.277686:0:10328:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426024960 00000100:00100000:2.0:1777051440.277739:0:10328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112191 00000100:00100000:2.0:1777051440.278084:0:10328:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d944d28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+21:138110:x1863365426024960:12345-192.168.201.46@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1777051440.278152:0:10328:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff99d944a3f400/0x85f51a6b96716ac0 lrc: 3/0,1 mode: --/PW res: [0x240000bd2:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051440.278170:0:10328:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d944a3f400/0x85f51a6b96716ac0 lrc: 3/0,1 mode: PW/PW res: [0x240000bd2:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10328 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051440.278183:0:10328:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d944a3f400/0x85f51a6b96716ac0 lrc: 3/0,1 mode: PW/PW res: [0x240000bd2:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10328 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1777051440.278367:0:10328:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000d6555351 reply state 000000007ea5d003 transno 8589934706 ns: mdt-lustre-MDT0001_UUID lock: ffff99d944a3f400/0x85f51a6b96716ac0 lrc: 3/0,1 mode: PW/PW res: [0x240000bd2:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10328 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051440.278393:0:10328:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d944a3f400/0x85f51a6b96716ac0 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd2:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10328 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051440.278403:0:10328:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x6:0x0].0x0 (ffff99da59dd4c00) 00010000:00010000:2.0:1777051440.278408:0:10328:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1777051440.278411:0:10328:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1777051440.278496:0:10328:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d944d28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+23:138110:x1863365426024960:12345-192.168.201.46@tcp:36:lhsmtool_posix.0 Request processed in 744us (892us total) trans 8589934706 rc 0/0 00000100:00100000:2.0:1777051440.278509:0:10328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112191 00000100:00100000:1.0:1777051440.280379:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051440.280497:0:46494:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426025088 00000100:00100000:0.0:1777051440.280507:0:46494:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426025088 00000100:00100000:0.0:1777051440.280565:0:46494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112192 00000100:00100000:0.0:1777051440.280577:0:46494:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95fae8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c11b6966-0775-44d2-bdc6-c74c26eb2226+23:138110:x1863365426025088:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1777051440.280597:0:46494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051440.280614:0:46494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d950704800/0x85f51a6b96716ac7 lrc: 2/0,0 mode: --/CR res: [0x240000bd2:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b668f expref: -99 pid: 46494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051440.280674:0:46494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d950704800/0x85f51a6b96716ac7 lrc: 3/0,0 mode: CR/CR res: [0x240000bd2:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b668f expref: 24 pid: 46494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051440.280693:0:46494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99d950704800/0x85f51a6b96716ac7 lrc: 3/0,0 mode: CR/CR res: [0x240000bd2:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b668f expref: 24 pid: 46494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051440.280706:0:46494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x6:0x0].0x0 (ffff99da59dd4c00) 00010000:00010000:0.0:1777051440.280711:0:46494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1777051440.280715:0:46494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d950704800, rc 0) 00000100:00100000:0.0:1777051440.280790:0:46494:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95fae8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c11b6966-0775-44d2-bdc6-c74c26eb2226+24:138110:x1863365426025088:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 Request processed in 214us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051440.280801:0:46494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112192 00000100:00100000:2.0:1777051440.283605:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051440.283693:0:24269:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426025216 00000100:00100000:1.0:1777051440.283700:0:24269:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426025216 00000100:00100000:1.0:1777051440.283748:0:24269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3386 00000100:00100000:1.0:1777051440.283789:0:24269:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da6ff00450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+24:138110:x1863365426025216:12345-192.168.201.46@tcp:49:lhsmtool_posix.0 00000100:00100000:1.0:1777051440.283909:0:24269:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da6ff00450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+24:138110:x1863365426025216:12345-192.168.201.46@tcp:49:lhsmtool_posix.0 Request processed in 122us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051440.283922:0:24269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3386 00000100:00100000:3.0:1777051440.286551:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051440.286662:0:46501:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426025472 00000100:00100000:2.0:1777051440.286670:0:46501:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426025472 00000100:00100000:2.0:1777051440.287072:0:46501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3387 00000100:00100000:2.0:1777051440.287085:0:46501:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d944d2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+24:138110:x1863365426025472:12345-192.168.201.46@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1777051440.287351:0:46501:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d944d2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+25:138110:x1863365426025472:12345-192.168.201.46@tcp:35:lhsmtool_posix.0 Request processed in 266us (802us total) trans 8589934707 rc 0/0 00000100:00100000:2.0:1777051440.287365:0:46501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3387 00000100:00100000:2.0:1777051440.290549:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051440.291314:0:8492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426025728 00000100:00100000:1.0:1777051440.291322:0:8492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426025728 00000100:00100000:1.0:1777051440.291368:0:8492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112193 00000100:00100000:1.0:1777051440.291381:0:8492:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fdf3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+25:138110:x1863365426025728:12345-192.168.201.46@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1777051440.291484:0:8492:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fdf3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+25:138110:x1863365426025728:12345-192.168.201.46@tcp:57:lhsmtool_posix.0 Request processed in 105us (939us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051440.291493:0:8492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112193 00000100:00100000:3.0:1777051440.299509:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051440.299634:0:6581:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426025984 00000100:00100000:0.0:1777051440.299644:0:6581:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426025984 00000100:00100000:0.0:1777051440.300364:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112194 00000100:00100000:0.0:1777051440.300381:0:6581:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d944d28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+25:138110:x1863365426025984:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1777051440.300401:0:6581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051440.300426:0:6581:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d950705a00/0x85f51a6b96716ace lrc: 2/0,0 mode: --/CR res: [0x240000bd2:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6696 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051440.300549:0:6581:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff99d950705600/0x85f51a6b96716ad5 lrc: 3/0,1 mode: --/EX res: [0x240000bd2:0x6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051440.300572:0:6581:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff99d950704800/0x85f51a6b96716ac7 lrc: 2/0,0 mode: CR/CR res: [0x240000bd2:0x6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b668f expref: 26 pid: 46494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051440.300585:0:6581:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d950705600/0x85f51a6b96716ad5 lrc: 4/0,1 mode: --/EX res: [0x240000bd2:0x6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6581 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051440.300631:0:6581:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff99d950704800/0x85f51a6b96716ac7 lrc: 3/0,0 mode: CR/CR res: [0x240000bd2:0x6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b668f expref: 26 pid: 46494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051440.300651:0:6581:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff99d950704800/0x85f51a6b96716ac7 lrc: 4/0,0 mode: CR/CR res: [0x240000bd2:0x6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b668f expref: 26 pid: 46494 timeout: 8169 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051440.300671:0:6581:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95aece300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:6581:1863365452651648:192.168.201.46@tcp:104: 00000100:00100000:0.0:1777051440.301122:0:6581:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d95cf51540 going to sleep for 11 seconds 00000100:00100000:0.0:1777051440.304925:0:6581:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95aece300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:6581:1863365452651648:192.168.201.46@tcp:104: 00010000:00010000:0.0:1777051440.304956:0:6581:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff99d950705600/0x85f51a6b96716ad5 lrc: 3/0,1 mode: --/EX res: [0x240000bd2:0x6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6581 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051440.304980:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051440.305113:0:47597:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426026112 00000100:00100000:2.0:1777051440.305122:0:47597:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426026112 00010000:00010000:2.0:1777051440.305160:0:47597:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d950704800/0x85f51a6b96716ac7 lrc: 4/0,0 mode: CR/CR res: [0x240000bd2:0x6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b668f expref: 27 pid: 46494 timeout: 8169 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051440.305257:0:47597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3914 00000100:00100000:2.0:1777051440.305274:0:47597:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da53b94850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+27:2436:x1863365426026112:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1777051440.305292:0:47597:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777051440.305302:0:47597:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff99d950704800/0x85f51a6b96716ac7 lrc: 4/0,0 mode: CR/CR res: [0x240000bd2:0x6:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b668f expref: 27 pid: 46494 timeout: 8169 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051440.305322:0:47597:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff99d950704800/0x85f51a6b96716ac7 lrc: 3/0,0 mode: CR/CR res: [0x240000bd2:0x6:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b668f expref: 27 pid: 46494 timeout: 8169 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051440.305348:0:47597:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d950704800/0x85f51a6b96716ac7 lrc: 0/0,0 mode: --/CR res: [0x240000bd2:0x6:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b668f expref: 27 pid: 46494 timeout: 8169 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051440.305375:0:47597:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x6:0x0].0x0 (ffff99da59dd4c00) 00010000:00010000:2.0:1777051440.305384:0:47597:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff99d950705600/0x85f51a6b96716ad5 lrc: 3/0,1 mode: --/EX res: [0x240000bd2:0x6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6581 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051440.305404:0:47597:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff99d950705600/0x85f51a6b96716ad5 lrc: 3/0,1 mode: EX/EX res: [0x240000bd2:0x6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6581 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051440.305415:0:47597:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d950705600/0x85f51a6b96716ad5 lrc: 4/0,1 mode: EX/EX res: [0x240000bd2:0x6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6581 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051440.305524:0:47597:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1777051440.305588:0:47597:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da53b94850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+26:2436:x1863365426026112:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 310us (606us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051440.305603:0:47597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3914 00010000:00010000:0.0:1777051440.306005:0:6581:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff99d950705600/0x85f51a6b96716ad5 lrc: 3/0,1 mode: EX/EX res: [0x240000bd2:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6581 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051440.306019:0:6581:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d950705600/0x85f51a6b96716ad5 lrc: 3/0,1 mode: EX/EX res: [0x240000bd2:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6581 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1777051440.306039:0:6581:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000bd2:0x6:0x0]: returning size 0 00000004:00080000:0.0:1777051440.306430:0:6581:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x105:0x0], index 1: 0 00010000:00010000:0.0:1777051440.306548:0:6581:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff99d950705600/0x85f51a6b96716ad5 lrc: 3/0,1 mode: EX/EX res: [0x240000bd2:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6581 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051440.306562:0:6581:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d950705600/0x85f51a6b96716ad5 lrc: 2/0,0 mode: EX/EX res: [0x240000bd2:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6581 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051440.306574:0:6581:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99d950705600/0x85f51a6b96716ad5 lrc: 3/0,0 mode: EX/EX res: [0x240000bd2:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6581 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051440.306583:0:6581:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d950705600 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:0.0:1777051440.306589:0:6581:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d950705600/0x85f51a6b96716ad5 lrc: 3/0,0 mode: EX/EX res: [0x240000bd2:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6581 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051440.306600:0:6581:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d950705600/0x85f51a6b96716ad5 lrc: 4/0,0 mode: EX/EX res: [0x240000bd2:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6581 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051440.306615:0:6581:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x6:0x0].0x0 (ffff99da59dd4c00) 00010000:00010000:0.0:1777051440.306619:0:6581:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1777051440.306625:0:6581:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99d950705600/0x85f51a6b96716ad5 lrc: 2/0,0 mode: --/EX res: [0x240000bd2:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6581 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051440.306635:0:6581:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d950705600/0x85f51a6b96716ad5 lrc: 0/0,0 mode: --/EX res: [0x240000bd2:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6581 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051440.307019:0:6581:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99d950705a00/0x85f51a6b96716ace lrc: 1/0,0 mode: --/CR res: [0x240000bd2:0x6:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6696 expref: 26 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051440.307036:0:6581:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x6:0x0].0x0 (ffff99da59dd4c00) 00010000:00010000:0.0:1777051440.307039:0:6581:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1777051440.307045:0:6581:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d950705a00/0x85f51a6b96716ace lrc: 0/0,0 mode: --/CR res: [0x240000bd2:0x6:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6696 expref: 26 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051440.307062:0:6581:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d950705a00, rc 0) 00000100:00100000:0.0:1777051440.307618:0:6581:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d944d28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+25:138110:x1863365426025984:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 Request processed in 7239us (8113us total) trans 8589934708 rc 301/301 00000100:00100000:0.0:1777051440.307630:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112194 00000100:00100000:3.0:1777051440.311059:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051440.311148:0:6583:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426026368 00000100:00100000:2.0:1777051440.311157:0:6583:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426026368 00000100:00100000:2.0:1777051440.311225:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3388 00000100:00100000:2.0:1777051440.311240:0:6583:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+25:138110:x1863365426026368:12345-192.168.201.46@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1777051440.311486:0:6583:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+26:138110:x1863365426026368:12345-192.168.201.46@tcp:35:lhsmtool_posix.0 Request processed in 247us (428us total) trans 8589934709 rc 0/0 00000100:00100000:2.0:1777051440.311500:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3388 00000100:00100000:1.0:1777051440.314706:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051440.314824:0:46497:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426026496 00000100:00100000:2.0:1777051440.314834:0:46497:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426026496 00000100:00100000:2.0:1777051440.314891:0:46497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112195 00000100:00100000:2.0:1777051440.314905:0:46497:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95faeb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:c11b6966-0775-44d2-bdc6-c74c26eb2226+26:138110:x1863365426026496:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1777051440.314927:0:46497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051440.314950:0:46497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d944a3ea00/0x85f51a6b96716ae3 lrc: 2/0,0 mode: --/CR res: [0x240000bd2:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b669d expref: -99 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051440.315022:0:46497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d944a3fc00/0x85f51a6b96716aea lrc: 3/1,0 mode: --/PR res: [0x240000bd2:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051440.315042:0:46497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d944a3fc00/0x85f51a6b96716aea lrc: 3/1,0 mode: PR/PR res: [0x240000bd2:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051440.315057:0:46497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d944a3fc00/0x85f51a6b96716aea lrc: 3/1,0 mode: PR/PR res: [0x240000bd2:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1777051440.315441:0:46497:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000bd2:0x6:0x0]: returning size 0 00000004:00200000:2.0:1777051440.315448:0:46497:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1777051440.315474:0:46497:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff99d944a3fc00/0x85f51a6b96716aea lrc: 3/1,0 mode: PR/PR res: [0x240000bd2:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051440.315511:0:46497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d944a3ea00/0x85f51a6b96716ae3 lrc: 0/0,0 mode: --/CR res: [0x240000bd2:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b669d expref: 28 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051440.315534:0:46497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99d944a3fc00/0x85f51a6b96716aea lrc: 3/0,0 mode: PR/PR res: [0x240000bd2:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b669d expref: 27 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051440.315547:0:46497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x6:0x0].0x0 (ffff99da59dd4c00) 00010000:00010000:2.0:1777051440.315551:0:46497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1777051440.315556:0:46497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d944a3fc00, rc 0) 00000100:00100000:2.0:1777051440.315618:0:46497:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95faeb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:c11b6966-0775-44d2-bdc6-c74c26eb2226+27:138110:x1863365426026496:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 Request processed in 715us (923us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051440.315631:0:46497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112195 00000100:00100000:3.0:1777051440.319787:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051440.319900:0:27887:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426026624 00000100:00100000:2.0:1777051440.319912:0:27887:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426026624 00000100:00100000:2.0:1777051440.320007:0:27887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 8051 00000100:00080000:1.0:1777051440.320017:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1777051440.320027:0:27887:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c11b6966-0775-44d2-bdc6-c74c26eb2226+49:2437:x1863365426026624:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1777051440.320048:0:27887:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051440.320095:0:27887:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b4ed81c0/0x85f51a6b96716af1 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x105:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b66a4 expref: -99 pid: 27887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1777051440.320132:0:27887:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x105:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1777051440.320157:0:27887:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777051440.320427:0:27887:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777051440.320440:0:27887:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b4ed81c0/0x85f51a6b96716af1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x105:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b66a4 expref: 50 pid: 27887 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051440.320468:0:27887:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b4ed81c0/0x85f51a6b96716af1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x105:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b66a4 expref: 50 pid: 27887 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051440.320489:0:27887:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d944a3e200, rc 0) 00000100:00100000:2.0:1777051440.320554:0:27887:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c11b6966-0775-44d2-bdc6-c74c26eb2226+50:2437:x1863365426026624:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 Request processed in 534us (801us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051440.320567:0:27887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 8051 00000100:00100000:3.0:1777051440.325008:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051440.325351:0:27882:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426026880 00000100:00100000:2.0:1777051440.325361:0:27882:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426026880 00000100:00100000:2.0:1777051440.325421:0:27882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112196 00000100:00100000:2.0:1777051440.325432:0:27882:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+27:138110:x1863365426026880:12345-192.168.201.46@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1777051440.325553:0:27882:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+27:138110:x1863365426026880:12345-192.168.201.46@tcp:57:lhsmtool_posix.0 Request processed in 120us (548us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051440.325566:0:27882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112196 00000100:00100000:1.0:1777051440.329485:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051440.329590:0:24468:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426027008 00000100:00100000:0.0:1777051440.329601:0:24468:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426027008 00000100:00100000:0.0:1777051440.330534:0:24468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 8052 00000100:00100000:0.0:1777051440.330558:0:24468:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da45f76d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+50:138110:x1863365426027008:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1777051440.330579:0:24468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051440.330602:0:24468:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000555c159d/0x85f51a6b96716af8 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x105:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b66ab expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051440.330645:0:24468:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b4ed81c0/0x85f51a6b96716af1 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x105:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b66a4 expref: 51 pid: 27887 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051440.330660:0:24468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777051440.330664:0:24468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777051440.330672:0:24468:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000555c159d/0x85f51a6b96716af8 lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0x105:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b66ab expref: 51 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051440.331607:0:24468:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b4ed81c0/0x85f51a6b96716af1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x105:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b66a4 expref: 51 pid: 27887 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051440.331634:0:24468:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b4ed81c0/0x85f51a6b96716af1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x105:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b66a4 expref: 51 pid: 27887 timeout: 8169 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051440.331656:0:24468:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95aece300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:24468:1863365452651776:192.168.201.46@tcp:104: 00000100:00100000:0.0:1777051440.332551:0:24468:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d95cf51900 going to sleep for 11 seconds 00000100:00100000:0.0:1777051440.335801:0:24468:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95aece300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:24468:1863365452651776:192.168.201.46@tcp:104: 00010000:00010000:0.0:1777051440.335848:0:24468:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000555c159d/0x85f51a6b96716af8 lrc: 3/0,0 mode: --/PW res: [0x2c0000400:0x105:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b66ab expref: 51 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051440.335875:0:24468:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d950705a00, rc 0) 00000100:00100000:0.0:1777051440.335937:0:24468:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da45f76d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+51:138110:x1863365426027008:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 Request processed in 5385us (6457us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051440.335952:0:24468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 8052 00000100:00100000:2.0:1777051440.337894:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051440.338012:0:24467:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426027136 00000100:00100000:0.0:1777051440.338022:0:24467:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426027136 00010000:00010000:0.0:1777051440.338080:0:24467:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b4ed81c0/0x85f51a6b96716af1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x105:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b66a4 expref: 51 pid: 27887 timeout: 8169 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051440.338135:0:24467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3915 00000100:00100000:0.0:1777051440.338149:0:24467:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fdf3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+51:2436:x1863365426027136:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1777051440.338174:0:24467:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777051440.338239:0:24467:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b4ed81c0/0x85f51a6b96716af1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x105:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b66a4 expref: 51 pid: 27887 timeout: 8169 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051440.338263:0:24467:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b4ed81c0/0x85f51a6b96716af1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x105:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b66a4 expref: 51 pid: 27887 timeout: 8169 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051440.338304:0:24467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b4ed81c0/0x85f51a6b96716af1 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x105:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b66a4 expref: 51 pid: 27887 timeout: 8169 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051440.338324:0:24467:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777051440.338327:0:24467:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777051440.338337:0:24467:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000555c159d/0x85f51a6b96716af8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x105:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b66ab expref: 50 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051440.338353:0:24467:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000555c159d/0x85f51a6b96716af8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x105:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b66ab expref: 50 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051440.338408:0:24467:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000555c159d/0x85f51a6b96716af8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x105:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b66ab expref: 50 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051440.338427:0:24467:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95aece300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:24467:1863365452651904:192.168.201.46@tcp:105: 00000100:00100000:0.0:1777051440.338506:0:24467:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d95cf51900 going to sleep for 11 seconds 00000100:00100000:0.0:1777051440.347496:0:24467:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95aece300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:24467:1863365452651904:192.168.201.46@tcp:105: 00010000:00010000:0.0:1777051440.347522:0:24467:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1777051440.347595:0:24467:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fdf3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+50:2436:x1863365426027136:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 9445us (9701us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051440.347612:0:24467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3915 00000100:00100000:3.0:1777051440.371702:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051440.371879:0:27888:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426027264 00000100:00100000:0.0:1777051440.371895:0:27888:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426027264 00002000:00100000:0.0:1777051440.371969:0:27888:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000400:0x105:0x0] (0->1048575) req@ffff99da5f9bce00 x1863365426027264/t0(0) o4->c11b6966-0775-44d2-bdc6-c74c26eb2226@192.168.201.46@tcp:401/0 lens 488/0 e 0 to 0 dl 1777051451 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1777051440.371989:0:27888:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99da5f9bce00 with x1863365426027264 ext(0->1048575) 00002000:00010000:0.0:1777051440.371999:0:27888:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99da5f9bce00 00000100:00100000:0.0:1777051440.372054:0:27888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 1778 00000100:00100000:0.0:1777051440.372071:0:27888:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+50:2437:x1863365426027264:12345-192.168.201.46@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1777051440.397431:0:27888:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+52:2437:x1863365426027264:12345-192.168.201.46@tcp:4:lhsmtool_posix.0 Request processed in 25354us (25732us total) trans 4294968365 rc 0/0 00000100:00100000:1.0:1777051440.397447:0:27888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 1778 00002000:00100000:1.0:1777051440.397463:0:27888:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000400:0x105:0x0] (0->1048575) req@ffff99da5f9bce00 x1863365426027264/t4294968365(0) o4->c11b6966-0775-44d2-bdc6-c74c26eb2226@192.168.201.46@tcp:401/0 lens 488/448 e 0 to 0 dl 1777051451 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1777051440.397485:0:27888:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99da5f9bce00 with x1863365426027264 ext(0->1048575) 00002000:00010000:1.0:1777051440.397492:0:27888:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99da5f9bce00 00000100:00100000:2.0:1777051440.402450:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051440.402591:0:21368:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426027392 00000100:00100000:1.0:1777051440.402604:0:21368:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426027392 00000100:00100000:1.0:1777051440.402690:0:21368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112197 00000100:00100000:1.0:1777051440.402706:0:21368:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fdf0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+27:138110:x1863365426027392:12345-192.168.201.46@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1777051440.408395:0:104205:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934709 is committed 00000001:00080000:3.0:1777051440.408453:0:104205:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934703 is committed 00010000:00010000:2.0:1777051440.408464:0:3664:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a3000/0x85f51a6b967169d9 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd2:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27885 initiator: MDT1 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1777051440.408466:0:104205:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934702 is committed 00010000:00010000:2.0:1777051440.408491:0:3664:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a3000/0x85f51a6b967169d9 lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd2:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 27885 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051440.408508:0:3664:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a3000/0x85f51a6b967169d9 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd2:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27885 initiator: MDT1 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1777051440.408514:0:104205:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff99d956bdacc0 refcount 2 committed 0 result 0 batchid 4294970582 00010000:00010000:2.0:1777051440.408524:0:3664:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d9559a3000 already unused, calling callback (ffffffffc17724f0) 00000020:00080000:3.0:1777051440.408527:0:104205:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff99da7b3b0d00 obd lustre-OST0000-osc-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff99d956bda0c0 00010000:00010000:2.0:1777051440.408536:0:3664:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a3000/0x85f51a6b967169d9 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd2:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27885 initiator: MDT1 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1777051440.408538:0:104205:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff99da7b3b0400 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff99d942d89000 00010000:00010000:2.0:1777051440.408562:0:3664:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a3000/0x85f51a6b967169d9 lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd2:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 27885 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051440.408591:0:3664:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x5:0x0].0x0 (ffff99da5fb45600) 00010000:00010000:2.0:1777051440.408598:0:3664:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000020:00080000:3.0:1777051440.408605:0:104205:0:(update_trans.c:1333:distribute_txn_batchid_cb()) lustre-MDT0001: 4294970581 batchid updated 00010000:00010000:2.0:1777051440.408608:0:3664:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a3000/0x85f51a6b967169d9 lrc: 2/0,0 mode: --/TXN res: [0x240000bd2:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27885 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051440.408626:0:3664:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a3000/0x85f51a6b967169d9 lrc: 0/0,0 mode: --/TXN res: [0x240000bd2:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27885 initiator: MDT1 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1777051440.408673:0:104230:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 4294970582 committed batchid 4294970581 00010000:00010000:2.0:1777051440.408679:0:3664:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff99d944a3f400/0x85f51a6b96716ac0 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd2:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10328 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051440.408695:0:3664:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d944a3f400/0x85f51a6b96716ac0 lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd2:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10328 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051440.408705:0:3664:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99d944a3f400/0x85f51a6b96716ac0 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd2:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10328 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051440.408716:0:3664:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d944a3f400 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:2.0:1777051440.408724:0:3664:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d944a3f400/0x85f51a6b96716ac0 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd2:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10328 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051440.408736:0:3664:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d944a3f400/0x85f51a6b96716ac0 lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd2:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10328 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051440.408791:0:3664:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x6:0x0].0x0 (ffff99da59dd4c00) 00010000:00010000:2.0:1777051440.408798:0:3664:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1777051440.408806:0:3664:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99d944a3f400/0x85f51a6b96716ac0 lrc: 2/0,0 mode: --/TXN res: [0x240000bd2:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10328 initiator: MDT1 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1777051440.408820:0:104230:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 4294970581 00010000:00010000:2.0:1777051440.408820:0:3664:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d944a3f400/0x85f51a6b96716ac0 lrc: 0/0,0 mode: --/TXN res: [0x240000bd2:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10328 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051440.408860:0:21368:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fdf0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+10:138110:x1863365426027392:12345-192.168.201.46@tcp:44:lhsmtool_posix.0 Request processed in 6150us (6411us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051440.408881:0:21368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112197 00000100:00100000:2.0:1777051440.415507:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051440.415616:0:13320:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426027520 00000100:00100000:1.0:1777051440.415647:0:13320:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426027520 00000100:00100000:1.0:1777051440.415741:0:13320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 8053 00000100:00100000:1.0:1777051440.415794:0:13320:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fdf0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+52:2436:x1863365426027520:12345-192.168.201.46@tcp:16:lhsmtool_posix.0 00000001:00080000:0.0:1777051440.423937:0:9540:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0001: transno 4294968365 is committed 00000001:00080000:0.0:1777051440.423959:0:9540:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0001: transno 4294968364 is committed 00000100:00100000:1.0:1777051440.424533:0:13320:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fdf0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+49:2436:x1863365426027520:12345-192.168.201.46@tcp:16:lhsmtool_posix.0 Request processed in 8772us (9028us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051440.424551:0:13320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 8053 00000100:00100000:1.0:1777051440.431153:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051440.431349:0:6579:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426027776 00000100:00100000:0.0:1777051440.431363:0:6579:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426027776 00000100:00100000:0.0:1777051440.431522:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112198 00000100:00100000:0.0:1777051440.431541:0:6579:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7c9a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+10:138110:x1863365426027776:12345-192.168.201.46@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1777051440.431611:0:6579:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777051440.431649:0:6579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d944a3fc00/0x85f51a6b96716aea lrc: 0/0,0 mode: --/PR res: [0x240000bd2:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b669d expref: 10 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051440.431681:0:6579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x6:0x0].0x0 (ffff99da59dd4c00) 00010000:00010000:0.0:1777051440.431689:0:6579:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1777051440.431731:0:6579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff99d950705600/0x85f51a6b96716aff lrc: 3/0,1 mode: --/PW res: [0x240000bd2:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051440.431800:0:6579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d950705600/0x85f51a6b96716aff lrc: 3/0,1 mode: PW/PW res: [0x240000bd2:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051440.431818:0:6579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d950705600/0x85f51a6b96716aff lrc: 3/0,1 mode: PW/PW res: [0x240000bd2:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1777051440.431983:0:6579:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000ec73fdbc reply state 00000000238aa0c4 transno 8589934710 ns: mdt-lustre-MDT0001_UUID lock: ffff99d950705600/0x85f51a6b96716aff lrc: 3/0,1 mode: PW/PW res: [0x240000bd2:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051440.432004:0:6579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d950705600/0x85f51a6b96716aff lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd2:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051440.432016:0:6579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x6:0x0].0x0 (ffff99da59dd4c00) 00010000:00010000:0.0:1777051440.432021:0:6579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1777051440.432026:0:6579:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1777051440.432176:0:6579:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7c9a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+11:138110:x1863365426027776:12345-192.168.201.46@tcp:36:lhsmtool_posix.0 Request processed in 638us (1029us total) trans 8589934710 rc 0/0 00000100:00100000:0.0:1777051440.432190:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112198 00000100:00100000:2.0:1777051440.434682:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051440.434939:0:27885:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426027904 00000100:00100000:1.0:1777051440.434949:0:27885:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426027904 00000100:00100000:1.0:1777051440.435043:0:27885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112199 00000100:00100000:1.0:1777051440.435058:0:27885:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fdf1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c11b6966-0775-44d2-bdc6-c74c26eb2226+11:138110:x1863365426027904:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1777051440.435082:0:27885:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777051440.435102:0:27885:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72e600/0x85f51a6b96716b06 lrc: 2/0,0 mode: --/CR res: [0x240000bd2:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b66b2 expref: -99 pid: 27885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051440.435169:0:27885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72e600/0x85f51a6b96716b06 lrc: 3/0,0 mode: CR/CR res: [0x240000bd2:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b66b2 expref: 12 pid: 27885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051440.435190:0:27885:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72e600/0x85f51a6b96716b06 lrc: 3/0,0 mode: CR/CR res: [0x240000bd2:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b66b2 expref: 12 pid: 27885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051440.435271:0:27885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x6:0x0].0x0 (ffff99da59dd4c00) 00010000:00010000:1.0:1777051440.435276:0:27885:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1777051440.435281:0:27885:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d94d72e600, rc 0) 00000100:00100000:1.0:1777051440.435338:0:27885:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fdf1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c11b6966-0775-44d2-bdc6-c74c26eb2226+12:138110:x1863365426027904:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 Request processed in 283us (661us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051440.435350:0:27885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112199 00000100:00100000:2.0:1777051440.442023:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051440.442427:0:27884:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426028032 00000100:00100000:0.0:1777051440.442439:0:27884:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426028032 00000100:00100000:0.0:1777051440.442520:0:27884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 8054 00000100:00100000:0.0:1777051440.442560:0:27884:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fdf1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+49:2437:x1863365426028032:12345-192.168.201.46@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1777051440.442795:0:27884:0:(ofd_lvb.c:305:ofd_lvbo_update()) res: [0x2c0000400:0x105:0x0] updating lvb size from disk: 0 -> 1048576 00002000:00010000:0.0:1777051440.442803:0:27884:0:(ofd_lvb.c:312:ofd_lvbo_update()) res: [0x2c0000400:0x105:0x0] updating lvb mtime from disk: 0 -> 1777051430 00002000:00010000:0.0:1777051440.442807:0:27884:0:(ofd_lvb.c:318:ofd_lvbo_update()) res: [0x2c0000400:0x105:0x0] updating lvb atime from disk: 0 -> 1777051430 00002000:00010000:0.0:1777051440.442812:0:27884:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x2c0000400:0x105:0x0] updating lvb ctime from disk: 0 -> 1777051430 00002000:00010000:0.0:1777051440.442816:0:27884:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x2c0000400:0x105:0x0] updating lvb blocks from disk: 0 -> 2048 00000100:00100000:0.0:1777051440.442903:0:27884:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fdf1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+50:2437:x1863365426028032:12345-192.168.201.46@tcp:2:lhsmtool_posix.0 Request processed in 367us (885us total) trans 4294968366 rc 0/0 00000100:00100000:0.0:1777051440.442918:0:27884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 8054 00000100:00100000:0.0:1777051440.449269:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051440.452871:0:6580:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426028288 00000100:00100000:1.0:1777051440.452884:0:6580:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426028288 00000100:00100000:1.0:1777051440.452958:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112200 00000100:00100000:1.0:1777051440.452969:0:6580:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95aece300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+12:138110:x1863365426028288:12345-192.168.201.46@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1777051440.453052:0:6580:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72fc00/0x85f51a6b96716b0d lrc: 3/0,1 mode: --/PW res: [0x240000bd2:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051440.453080:0:6580:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff99d944a3fe00/0x85f51a6b96716ab9 lrc: 2/0,0 mode: PR/PR res: [0x240000bd2:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6688 expref: 12 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051440.453098:0:6580:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72fc00/0x85f51a6b96716b0d lrc: 4/0,1 mode: --/PW res: [0x240000bd2:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6580 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051440.453145:0:6580:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff99d944a3fe00/0x85f51a6b96716ab9 lrc: 3/0,0 mode: PR/PR res: [0x240000bd2:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6688 expref: 12 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051440.453170:0:6580:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff99d944a3fe00/0x85f51a6b96716ab9 lrc: 4/0,0 mode: PR/PR res: [0x240000bd2:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6688 expref: 12 pid: 6580 timeout: 8169 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051440.453193:0:6580:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7c9a3800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6580:1863365452652032:192.168.201.46@tcp:104: 00000100:00100000:1.0:1777051440.453362:0:6580:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d941082180 going to sleep for 11 seconds 00000100:00100000:1.0:1777051440.457230:0:6580:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7c9a3800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6580:1863365452652032:192.168.201.46@tcp:104: 00010000:00010000:1.0:1777051440.457263:0:6580:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72fc00/0x85f51a6b96716b0d lrc: 3/0,1 mode: --/PW res: [0x240000bd2:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6580 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051440.458610:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051440.458739:0:47827:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426028416 00000100:00100000:2.0:1777051440.459525:0:47827:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426028416 00010000:00010000:2.0:1777051440.459575:0:47827:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d944a3fe00/0x85f51a6b96716ab9 lrc: 4/0,0 mode: PR/PR res: [0x240000bd2:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6688 expref: 13 pid: 6580 timeout: 8169 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051440.459636:0:47827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3916 00000100:00100000:2.0:1777051440.459652:0:47827:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95aecc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+13:2437:x1863365426028416:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1777051440.459672:0:47827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777051440.459685:0:47827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff99d944a3fe00/0x85f51a6b96716ab9 lrc: 4/0,0 mode: PR/PR res: [0x240000bd2:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6688 expref: 13 pid: 6580 timeout: 8169 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051440.459719:0:47827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff99d944a3fe00/0x85f51a6b96716ab9 lrc: 3/0,0 mode: PR/PR res: [0x240000bd2:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6688 expref: 13 pid: 6580 timeout: 8169 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051440.459795:0:47827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d944a3fe00/0x85f51a6b96716ab9 lrc: 0/0,0 mode: --/PR res: [0x240000bd2:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6688 expref: 13 pid: 6580 timeout: 8169 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051440.459822:0:47827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x6:0x0].0x0 (ffff99da59dd4c00) 00010000:00010000:2.0:1777051440.459831:0:47827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72fc00/0x85f51a6b96716b0d lrc: 3/0,1 mode: --/PW res: [0x240000bd2:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6580 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051440.459937:0:47827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72fc00/0x85f51a6b96716b0d lrc: 3/0,1 mode: PW/PW res: [0x240000bd2:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6580 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051440.459955:0:47827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72fc00/0x85f51a6b96716b0d lrc: 4/0,1 mode: PW/PW res: [0x240000bd2:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6580 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051440.460000:0:47827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1777051440.460072:0:47827:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95aecc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+12:2437:x1863365426028416:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 421us (1463us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051440.460089:0:47827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3916 00010000:00010000:1.0:1777051440.460496:0:6580:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72fc00/0x85f51a6b96716b0d lrc: 3/0,1 mode: PW/PW res: [0x240000bd2:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6580 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051440.460532:0:6580:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72fc00/0x85f51a6b96716b0d lrc: 3/0,1 mode: PW/PW res: [0x240000bd2:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6580 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051440.460586:0:6580:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72fc00/0x85f51a6b96716b0d lrc: 3/0,1 mode: PW/PW res: [0x240000bd2:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6580 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051440.460600:0:6580:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72fc00/0x85f51a6b96716b0d lrc: 2/0,0 mode: PW/PW res: [0x240000bd2:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6580 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051440.460613:0:6580:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72fc00/0x85f51a6b96716b0d lrc: 3/0,0 mode: PW/PW res: [0x240000bd2:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6580 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051440.460626:0:6580:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94d72fc00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:1.0:1777051440.460633:0:6580:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72fc00/0x85f51a6b96716b0d lrc: 3/0,0 mode: PW/PW res: [0x240000bd2:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6580 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051440.460647:0:6580:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72fc00/0x85f51a6b96716b0d lrc: 4/0,0 mode: PW/PW res: [0x240000bd2:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6580 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051440.460667:0:6580:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x6:0x0].0x0 (ffff99da59dd4c00) 00010000:00010000:1.0:1777051440.460673:0:6580:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1777051440.460679:0:6580:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72fc00/0x85f51a6b96716b0d lrc: 2/0,0 mode: --/PW res: [0x240000bd2:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6580 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051440.460689:0:6580:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72fc00/0x85f51a6b96716b0d lrc: 0/0,0 mode: --/PW res: [0x240000bd2:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6580 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051440.460803:0:6580:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95aece300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+11:138110:x1863365426028288:12345-192.168.201.46@tcp:55:lhsmtool_posix.0 Request processed in 7831us (11540us total) trans 0 rc -22/-22 00000100:00100000:1.0:1777051440.460817:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112200 00000100:00100000:0.0:1777051440.467048:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051440.471556:0:55805:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426028544 00000100:00100000:3.0:1777051440.471570:0:55805:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426028544 00000100:00100000:3.0:1777051440.471648:0:55805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 8055 00000100:00100000:3.0:1777051440.471663:0:55805:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95aecf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c11b6966-0775-44d2-bdc6-c74c26eb2226+50:2436:x1863365426028544:12345-192.168.201.46@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1777051440.471719:0:55805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000a908e83d/0x85f51a6b96716b14 lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0x105:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051440.471777:0:55805:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000555c159d/0x85f51a6b96716af8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x105:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b66ab expref: 50 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051440.471803:0:55805:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1777051440.471812:0:55805:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1777051440.471819:0:55805:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a908e83d/0x85f51a6b96716b14 lrc: 4/1,0 mode: --/PR res: [0x2c0000400:0x105:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 55805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051440.471871:0:55805:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000555c159d/0x85f51a6b96716af8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x105:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b66ab expref: 50 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051440.471895:0:55805:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000555c159d/0x85f51a6b96716af8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x105:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b66ab expref: 50 pid: 24468 timeout: 8169 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051440.471917:0:55805:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f9bd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:55805:1863365452652160:192.168.201.46@tcp:104: 00000100:00100000:3.0:1777051440.472021:0:55805:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d95cb329c0 going to sleep for 11 seconds 00000100:00100000:3.0:1777051440.477955:0:55805:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f9bd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:55805:1863365452652160:192.168.201.46@tcp:104: 00010000:00010000:3.0:1777051440.477995:0:55805:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a908e83d/0x85f51a6b96716b14 lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0x105:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 55805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051440.480342:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051440.480436:0:6564:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426028672 00000100:00100000:1.0:1777051440.480446:0:6564:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426028672 00010000:00010000:1.0:1777051440.480491:0:6564:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000555c159d/0x85f51a6b96716af8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x105:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b66ab expref: 51 pid: 24468 timeout: 8169 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051440.480545:0:6564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3917 00000100:00100000:1.0:1777051440.480559:0:6564:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95aecca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+51:2437:x1863365426028672:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1777051440.480578:0:6564:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1777051440.480607:0:6564:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000555c159d/0x85f51a6b96716af8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x105:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b66ab expref: 51 pid: 24468 timeout: 8169 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051440.480628:0:6564:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000555c159d/0x85f51a6b96716af8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x105:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b66ab expref: 51 pid: 24468 timeout: 8169 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051440.480662:0:6564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000555c159d/0x85f51a6b96716af8 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x105:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b66ab expref: 51 pid: 24468 timeout: 8169 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051440.480687:0:6564:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051440.480691:0:6564:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051440.480698:0:6564:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a908e83d/0x85f51a6b96716b14 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0x105:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 55805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051440.480713:0:6564:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a908e83d/0x85f51a6b96716b14 lrc: 4/1,0 mode: PR/PR res: [0x2c0000400:0x105:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 55805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051440.480780:0:6564:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1777051440.480803:0:55805:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a908e83d/0x85f51a6b96716b14 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0x105:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 55805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051440.480823:0:55805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a908e83d/0x85f51a6b96716b14 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0x105:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 55805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051440.480853:0:55805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000a908e83d/0x85f51a6b96716b14 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0x105:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 55805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051440.480869:0:55805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a908e83d/0x85f51a6b96716b14 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x105:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 55805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051440.480880:0:6564:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95aecca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+50:2437:x1863365426028672:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 313us (536us total) trans 0 rc 0/0 00010000:00010000:3.0:1777051440.480897:0:55805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a908e83d/0x85f51a6b96716b14 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x105:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 55805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051440.480906:0:6564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3917 00010000:00010000:3.0:1777051440.480920:0:55805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d9559a3c00 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:3.0:1777051440.480928:0:55805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a908e83d/0x85f51a6b96716b14 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x105:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 55805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051440.480942:0:55805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a908e83d/0x85f51a6b96716b14 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x105:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 55805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051440.480964:0:55805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a908e83d/0x85f51a6b96716b14 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x105:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 55805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051440.480974:0:55805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a908e83d/0x85f51a6b96716b14 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x105:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 55805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051440.481067:0:55805:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95aecf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c11b6966-0775-44d2-bdc6-c74c26eb2226+49:2436:x1863365426028544:12345-192.168.201.46@tcp:1:lhsmtool_posix.0 Request processed in 9405us (14023us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051440.481083:0:55805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 8055 00000100:00100000:0.0:1777051440.485812:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051440.486122:0:10328:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426028928 00000100:00100000:3.0:1777051440.486131:0:10328:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426028928 00000100:00100000:3.0:1777051440.486195:0:10328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112201 00000100:00100000:3.0:1777051440.486210:0:10328:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95aecea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+11:138110:x1863365426028928:12345-192.168.201.46@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1777051440.486306:0:10328:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a2600/0x85f51a6b96716b1b lrc: 3/0,1 mode: --/PW res: [0x240000bd2:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051440.486332:0:10328:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a2600/0x85f51a6b96716b1b lrc: 3/0,1 mode: PW/PW res: [0x240000bd2:0x3:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10328 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051440.486351:0:10328:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a2600/0x85f51a6b96716b1b lrc: 3/0,1 mode: PW/PW res: [0x240000bd2:0x3:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10328 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051440.486587:0:10328:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a2a00/0x85f51a6b96716b22 lrc: 3/0,1 mode: --/EX res: [0x240000bd2:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051440.486651:0:10328:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72e600/0x85f51a6b96716b06 lrc: 2/0,0 mode: CR/CR res: [0x240000bd2:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b66b2 expref: 12 pid: 27885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051440.486666:0:10328:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a2a00/0x85f51a6b96716b22 lrc: 4/0,1 mode: --/EX res: [0x240000bd2:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10328 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051440.486717:0:10328:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72e600/0x85f51a6b96716b06 lrc: 3/0,0 mode: CR/CR res: [0x240000bd2:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b66b2 expref: 12 pid: 27885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051440.486741:0:10328:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72e600/0x85f51a6b96716b06 lrc: 4/0,0 mode: CR/CR res: [0x240000bd2:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b66b2 expref: 12 pid: 27885 timeout: 8169 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051440.486795:0:10328:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f9bd880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:10328:1863365452652288:192.168.201.46@tcp:104: 00000100:00100000:0.0:1777051440.487232:0:10328:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d95cb32c00 going to sleep for 11 seconds 00000100:00100000:0.0:1777051440.492002:0:10328:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f9bd880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:10328:1863365452652288:192.168.201.46@tcp:104: 00010000:00010000:0.0:1777051440.492060:0:10328:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a2a00/0x85f51a6b96716b22 lrc: 3/0,1 mode: --/EX res: [0x240000bd2:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10328 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051440.493272:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051440.493611:0:47597:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426029056 00000100:00100000:2.0:1777051440.493622:0:47597:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426029056 00010000:00010000:2.0:1777051440.493668:0:47597:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72e600/0x85f51a6b96716b06 lrc: 4/0,0 mode: CR/CR res: [0x240000bd2:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b66b2 expref: 13 pid: 27885 timeout: 8169 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051440.493737:0:47597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3918 00000100:00100000:2.0:1777051440.493779:0:47597:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95aeced80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+13:2437:x1863365426029056:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1777051440.493800:0:47597:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777051440.493811:0:47597:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72e600/0x85f51a6b96716b06 lrc: 4/0,0 mode: CR/CR res: [0x240000bd2:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b66b2 expref: 13 pid: 27885 timeout: 8169 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051440.493842:0:47597:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72e600/0x85f51a6b96716b06 lrc: 3/0,0 mode: CR/CR res: [0x240000bd2:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b66b2 expref: 13 pid: 27885 timeout: 8169 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051440.493873:0:47597:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d94d72e600/0x85f51a6b96716b06 lrc: 0/0,0 mode: --/CR res: [0x240000bd2:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b66b2 expref: 13 pid: 27885 timeout: 8169 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051440.493895:0:47597:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x6:0x0].0x0 (ffff99da59dd4c00) 00010000:00010000:2.0:1777051440.493902:0:47597:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a2a00/0x85f51a6b96716b22 lrc: 3/0,1 mode: --/EX res: [0x240000bd2:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10328 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051440.493935:0:47597:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a2a00/0x85f51a6b96716b22 lrc: 3/0,1 mode: EX/EX res: [0x240000bd2:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10328 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051440.493954:0:47597:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a2a00/0x85f51a6b96716b22 lrc: 4/0,1 mode: EX/EX res: [0x240000bd2:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10328 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051440.493989:0:47597:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1777051440.494049:0:10328:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a2a00/0x85f51a6b96716b22 lrc: 3/0,1 mode: EX/EX res: [0x240000bd2:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10328 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051440.494061:0:47597:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95aeced80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+12:2437:x1863365426029056:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 307us (788us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051440.494084:0:47597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3918 00010000:00010000:0.0:1777051440.494087:0:10328:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a2a00/0x85f51a6b96716b22 lrc: 3/0,1 mode: EX/EX res: [0x240000bd2:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10328 initiator: MDT1 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1777051440.494614:0:10328:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 8589934711 00000001:00080000:0.0:1777051440.494810:0:10328:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 8589934712 00000001:00080000:0.0:1777051440.494860:0:10328:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 8589934713 00000100:00100000:0.0:1777051440.494957:0:10328:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95aecc380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:10328:1863365452652416:0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1777051440.495015:0:10328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051440.495056:0:10328:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d944ac0840 going to sleep for 11 seconds 00000100:00100000:1.0:1777051440.495102:0:6584:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452652416 00000100:00100000:1.0:1777051440.495120:0:6584:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452652416 00000100:00100000:1.0:1777051440.495215:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8218 00000100:00100000:1.0:1777051440.495228:0:6584:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95aecdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:10328:x1863365452652416:12345-0@lo:1000:mdt00_004.0 00000100:00080000:0.0:1777051440.495374:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1777051440.495379:0:6584:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95aecdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:10328:x1863365452652416:12345-0@lo:1000:mdt00_004.0 Request processed in 150us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051440.495394:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8218 00000100:00100000:2.0:1777051440.495442:0:10328:0:(client.c:3101:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294968364 gen 2 00000004:00080000:2.0:1777051440.495464:0:10328:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff99da7e24e300, transno 4294968362 00000004:00080000:2.0:1777051440.495493:0:10328:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 4294968364 committed transno 4294968364 00000100:00100000:2.0:1777051440.495521:0:10328:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95aecc380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:10328:1863365452652416:0@lo:1000:mdt00_004.0 00000001:00080000:2.0:1777051440.495688:0:10328:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 8589934714 00000100:00100000:2.0:1777051440.495746:0:10328:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7fdf2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:10328:1863365452652544:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1777051440.495825:0:10328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051440.495864:0:10328:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d956bdab40 going to sleep for 11 seconds 00000100:00100000:0.0:1777051440.495899:0:6585:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452652544 00000100:00100000:0.0:1777051440.495908:0:6585:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452652544 00000100:00100000:0.0:1777051440.495975:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8219 00000100:00100000:0.0:1777051440.495988:0:6585:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fdf2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:10328:x1863365452652544:12345-0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1777051440.496150:0:6585:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fdf2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:10328:x1863365452652544:12345-0@lo:1000:mdt00_004.0 Request processed in 163us (323us total) trans 4294968367 rc 0/0 00000100:00100000:0.0:1777051440.496165:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8219 00000100:00100000:2.0:1777051440.496216:0:10328:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7fdf2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:10328:1863365452652544:0@lo:1000:mdt00_004.0 00000001:00080000:2.0:1777051440.496299:0:10328:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 8589934715 00010000:00010000:2.0:1777051440.496339:0:10328:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a2a00/0x85f51a6b96716b22 lrc: 3/0,1 mode: EX/EX res: [0x240000bd2:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10328 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051440.496356:0:10328:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a2a00/0x85f51a6b96716b22 lrc: 2/0,0 mode: EX/EX res: [0x240000bd2:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10328 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051440.496369:0:10328:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a2a00/0x85f51a6b96716b22 lrc: 3/0,0 mode: EX/EX res: [0x240000bd2:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10328 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051440.496379:0:10328:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d9559a2a00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:2.0:1777051440.496385:0:10328:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a2a00/0x85f51a6b96716b22 lrc: 3/0,0 mode: EX/EX res: [0x240000bd2:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10328 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051440.496397:0:10328:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a2a00/0x85f51a6b96716b22 lrc: 4/0,0 mode: EX/EX res: [0x240000bd2:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10328 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051440.496413:0:10328:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x6:0x0].0x0 (ffff99da59dd4c00) 00010000:00010000:2.0:1777051440.496418:0:10328:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1777051440.496424:0:10328:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a2a00/0x85f51a6b96716b22 lrc: 2/0,0 mode: --/EX res: [0x240000bd2:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10328 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051440.496435:0:10328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a2a00/0x85f51a6b96716b22 lrc: 0/0,0 mode: --/EX res: [0x240000bd2:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10328 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051440.496523:0:10328:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff99d950705e00/0x85f51a6b96716a3b lrc: 3/0,1 mode: EX/EX res: [0x240000bd2:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 6581 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051440.496535:0:10328:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d950705e00/0x85f51a6b96716a3b lrc: 2/0,0 mode: EX/EX res: [0x240000bd2:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 6581 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051440.496553:0:10328:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99d950705e00/0x85f51a6b96716a3b lrc: 3/0,0 mode: EX/EX res: [0x240000bd2:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 6581 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051440.496563:0:10328:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d950705e00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:2.0:1777051440.496568:0:10328:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d950705e00/0x85f51a6b96716a3b lrc: 3/0,0 mode: EX/EX res: [0x240000bd2:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 6581 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051440.496579:0:10328:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d950705e00/0x85f51a6b96716a3b lrc: 4/0,0 mode: EX/EX res: [0x240000bd2:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 6581 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051440.496594:0:10328:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x3:0x0].0x0 (ffff99da5fb45500) 00010000:00010000:2.0:1777051440.496599:0:10328:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1777051440.496608:0:10328:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff99d944a3e400/0x85f51a6b96716a42 lrc: 2/0,0 mode: --/CR res: [0x240000bd2:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6673 expref: 51 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051440.496625:0:10328:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff99d944a3e400/0x85f51a6b96716a42 lrc: 2/0,0 mode: CR/CR res: [0x240000bd2:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6673 expref: 51 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051440.496640:0:10328:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d944a3e400/0x85f51a6b96716a42 lrc: 3/0,0 mode: CR/CR res: [0x240000bd2:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6673 expref: 51 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051440.496683:0:10328:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0001_UUID lock: ffff99d944a3e400/0x85f51a6b96716a42 lrc: 3/0,0 mode: CR/CR res: [0x240000bd2:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6673 expref: 51 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051440.496703:0:10328:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7fdf1180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:10328:1863365452652672:192.168.201.46@tcp:105: 00000100:00100000:2.0:1777051440.497098:0:10328:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d956bda780 going to sleep for 11 seconds 00000100:00100000:2.0:1777051440.501212:0:10328:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7fdf1180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:10328:1863365452652672:192.168.201.46@tcp:105: 00010000:00010000:2.0:1777051440.501246:0:10328:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99d950705e00/0x85f51a6b96716a3b lrc: 2/0,0 mode: --/EX res: [0x240000bd2:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 6581 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051440.501262:0:10328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d950705e00/0x85f51a6b96716a3b lrc: 0/0,0 mode: --/EX res: [0x240000bd2:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 6581 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051440.501299:0:10328:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff99d944a3f600/0x85f51a6b96716b29 lrc: 3/0,1 mode: --/EX res: [0x240000bd2:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051440.501316:0:10328:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d944a3f600/0x85f51a6b96716b29 lrc: 3/0,1 mode: EX/EX res: [0x240000bd2:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10328 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051440.501334:0:10328:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d944a3f600/0x85f51a6b96716b29 lrc: 3/0,1 mode: EX/EX res: [0x240000bd2:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10328 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051440.501348:0:10328:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff99d944a3f600/0x85f51a6b96716b29 lrc: 3/0,1 mode: EX/EX res: [0x240000bd2:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10328 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051440.501360:0:10328:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d944a3f600/0x85f51a6b96716b29 lrc: 2/0,0 mode: EX/EX res: [0x240000bd2:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10328 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051440.501370:0:10328:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99d944a3f600/0x85f51a6b96716b29 lrc: 3/0,0 mode: EX/EX res: [0x240000bd2:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10328 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051440.501380:0:10328:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d944a3f600 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:2.0:1777051440.501386:0:10328:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d944a3f600/0x85f51a6b96716b29 lrc: 3/0,0 mode: EX/EX res: [0x240000bd2:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10328 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051440.501397:0:10328:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d944a3f600/0x85f51a6b96716b29 lrc: 4/0,0 mode: EX/EX res: [0x240000bd2:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10328 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051440.501411:0:10328:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x3:0x0].0x0 (ffff99da5fb45500) 00010000:00010000:2.0:1777051440.501416:0:10328:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777051440.501422:0:10328:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99d944a3f600/0x85f51a6b96716b29 lrc: 2/0,0 mode: --/EX res: [0x240000bd2:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10328 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051440.501433:0:10328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d944a3f600/0x85f51a6b96716b29 lrc: 0/0,0 mode: --/EX res: [0x240000bd2:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10328 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051440.501450:0:10328:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a2600/0x85f51a6b96716b1b lrc: 3/0,1 mode: PW/PW res: [0x240000bd2:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10328 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051440.501462:0:10328:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a2600/0x85f51a6b96716b1b lrc: 2/0,0 mode: PW/PW res: [0x240000bd2:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10328 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051440.501473:0:10328:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a2600/0x85f51a6b96716b1b lrc: 3/0,0 mode: PW/PW res: [0x240000bd2:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10328 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051440.501482:0:10328:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d9559a2600 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:2.0:1777051440.501487:0:10328:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a2600/0x85f51a6b96716b1b lrc: 3/0,0 mode: PW/PW res: [0x240000bd2:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10328 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051440.501497:0:10328:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a2600/0x85f51a6b96716b1b lrc: 4/0,0 mode: PW/PW res: [0x240000bd2:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10328 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051440.501513:0:10328:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x3:0x0].0x0 (ffff99da5fb45500) 00010000:00010000:2.0:1777051440.501518:0:10328:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1777051440.501523:0:10328:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a2600/0x85f51a6b96716b1b lrc: 2/0,0 mode: --/PW res: [0x240000bd2:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10328 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051440.501532:0:10328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a2600/0x85f51a6b96716b1b lrc: 0/0,0 mode: --/PW res: [0x240000bd2:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10328 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051440.501701:0:10328:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95aecea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+16:138110:x1863365426028928:12345-192.168.201.46@tcp:57:lhsmtool_posix.0 Request processed in 15491us (15893us total) trans 8589934716 rc 0/0 00000100:00100000:2.0:1777051440.501718:0:10328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112201 00000020:00080000:2.0:1777051440.501726:0:10328:0:(tgt_main.c:783:tgt_ses_key_exit()) total 6 transactions per RPC 00000040:00080000:0.0:1777051440.501836:0:104226:0:(llog.c:801:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000100:00100000:3.0:1777051440.501856:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000040:00080000:0.0:1777051440.501865:0:104226:0:(llog_cat.c:158:llog_cat_process_common()) processing log [0x1:0x12:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000100:00100000:3.0:1777051440.502422:0:46501:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426029184 00000100:00100000:3.0:1777051440.502431:0:46501:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426029184 00000100:00100000:3.0:1777051440.502486:0:46501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3389 00000100:00100000:3.0:1777051440.502498:0:46501:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+52:138108:x1863365426029184:12345-192.168.201.46@tcp:49:cat.0 00000100:00100000:3.0:1777051440.502661:0:46501:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+52:138108:x1863365426029184:12345-192.168.201.46@tcp:49:cat.0 Request processed in 162us (807us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051440.502675:0:46501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3389 00000040:00080000:0.0:1777051440.502839:0:104226:0:(llog.c:858:llog_process_thread()) stop processing plain [0x1:0x12:0x0] index 64768 count 7 00000040:00080000:0.0:1777051440.502856:0:104226:0:(llog.c:858:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1777051440.504178:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051440.504580:0:6583:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426029440 00000100:00100000:2.0:1777051440.504590:0:6583:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426029440 00000100:00100000:2.0:1777051440.504646:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3390 00000100:00100000:2.0:1777051440.504661:0:6583:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+16:138110:x1863365426029440:12345-192.168.201.46@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1777051440.504942:0:6583:0:(mdd_object.c:4010:mdd_close()) Object [0x240000bd2:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1777051440.504988:0:6583:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 8589934717 00010000:00010000:2.0:1777051440.505033:0:6583:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff99d944a3fe00/0x85f51a6b96716b30 lrc: 3/0,1 mode: --/PW res: [0x240000bd2:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6583 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051440.505054:0:6583:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d944a3fe00/0x85f51a6b96716b30 lrc: 3/0,1 mode: PW/PW res: [0x240000bd2:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6583 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051440.505069:0:6583:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d944a3fe00/0x85f51a6b96716b30 lrc: 3/0,1 mode: PW/PW res: [0x240000bd2:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6583 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051440.505083:0:6583:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff99d944a3fe00/0x85f51a6b96716b30 lrc: 4/0,1 mode: PW/PW res: [0x240000bd2:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6583 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051440.505093:0:6583:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff99d944a3fe00/0x85f51a6b96716b30 lrc: 4/0,1 mode: PW/PW res: [0x240000bd2:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6583 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051440.505104:0:6583:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d944a3fe00/0x85f51a6b96716b30 lrc: 3/0,0 mode: PW/PW res: [0x240000bd2:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6583 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051440.505162:0:6583:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1777051440.505298:0:6583:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+18:138110:x1863365426029440:12345-192.168.201.46@tcp:35:lhsmtool_posix.0 Request processed in 639us (1120us total) trans 8589934718 rc 0/0 00000100:00100000:2.0:1777051440.505311:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3390 00000020:00080000:2.0:1777051440.505319:0:6583:0:(tgt_main.c:783:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1777051440.506327:0:6568:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777051440.506337:0:6568:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99d944a3fe00/0x85f51a6b96716b30 lrc: 2/0,0 mode: PW/PW res: [0x240000bd2:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6583 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051440.506350:0:6568:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d944a3fe00 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:3.0:1777051440.506357:0:6568:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d944a3fe00/0x85f51a6b96716b30 lrc: 2/0,0 mode: PW/PW res: [0x240000bd2:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6583 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051440.506370:0:6568:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d944a3fe00/0x85f51a6b96716b30 lrc: 3/0,0 mode: PW/PW res: [0x240000bd2:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6583 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051440.506387:0:6568:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x6:0x0].0x0 (ffff99da59dd4c00) 00010000:00010000:3.0:1777051440.506392:0:6568:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1777051440.506399:0:6568:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99d944a3fe00/0x85f51a6b96716b30 lrc: 1/0,0 mode: --/PW res: [0x240000bd2:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6583 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051440.506411:0:6568:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d944a3fe00/0x85f51a6b96716b30 lrc: 0/0,0 mode: --/PW res: [0x240000bd2:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6583 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051440.506430:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051440.506433:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051440.506436:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1777051440.506824:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051440.506914:0:27887:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426029568 00000100:00100000:2.0:1777051440.506924:0:27887:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426029568 00000100:00100000:2.0:1777051440.507022:0:27887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 8056 00000100:00100000:2.0:1777051440.507038:0:27887:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7c9a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+48:138108:x1863365426029568:12345-192.168.201.46@tcp:101:cat.0 00010000:00010000:2.0:1777051440.507056:0:27887:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051440.507082:0:27887:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eaed06a7/0x85f51a6b96716b37 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x105:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b66b9 expref: -99 pid: 27887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1777051440.507115:0:27887:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x105:0x0] initial LVB size: 1048576, mtime: 0x69eba726, atime: 0x69eba726, ctime: 0x69eba726, blocks: 0x800 00010000:00010000:2.0:1777051440.507154:0:27887:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777051440.507157:0:27887:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777051440.507174:0:27887:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eaed06a7/0x85f51a6b96716b37 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x105:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b66b9 expref: 49 pid: 27887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1777051440.507188:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1777051440.507204:0:27887:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000eaed06a7/0x85f51a6b96716b37 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x105:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b66b9 expref: 49 pid: 27887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051440.507225:0:27887:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d944a3f800, rc 0) 00000100:00100000:2.0:1777051440.507294:0:27887:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7c9a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+49:138108:x1863365426029568:12345-192.168.201.46@tcp:101:cat.0 Request processed in 258us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051440.507308:0:27887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 8056 00000100:00100000:0.0:1777051440.519318:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051440.519442:0:55658:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426029696 00000100:00100000:2.0:1777051440.519455:0:55658:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426029696 00002000:00100000:2.0:1777051440.519515:0:55658:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000400:0x105:0x0] (0->1048575) req@ffff99d95aece680 x1863365426029696/t0(0) o3->2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp:401/0 lens 488/0 e 0 to 0 dl 1777051451 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1777051440.519536:0:55658:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99d95aece680 with x1863365426029696 ext(0->1048575) 00002000:00010000:2.0:1777051440.519545:0:55658:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99d95aece680 00000100:00100000:2.0:1777051440.519583:0:55658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 1779 00000100:00100000:2.0:1777051440.519596:0:55658:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95aece680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+49:2437:x1863365426029696:12345-192.168.201.46@tcp:3:cat.0 00000100:00100000:2.0:1777051440.535639:0:55658:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95aece680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+49:2437:x1863365426029696:12345-192.168.201.46@tcp:3:cat.0 Request processed in 16028us (16316us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1777051440.535656:0:55658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 1779 00002000:00100000:2.0:1777051440.535677:0:55658:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000400:0x105:0x0] (0->1048575) req@ffff99d95aece680 x1863365426029696/t0(0) o3->2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp:401/0 lens 488/440 e 0 to 0 dl 1777051451 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1777051440.535697:0:55658:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99d95aece680 with x1863365426029696 ext(0->1048575) 00002000:00010000:2.0:1777051440.535707:0:55658:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99d95aece680 00000100:00100000:0.0:1777051440.555458:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051440.555571:0:46203:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426029824 00000100:00100000:3.0:1777051440.555584:0:46203:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426029824 00002000:00100000:3.0:1777051440.555651:0:46203:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000400:0x105:0x0] (1048576->1052671) req@ffff99d95aecd180 x1863365426029824/t0(0) o3->2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp:401/0 lens 488/0 e 0 to 0 dl 1777051451 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1777051440.555670:0:46203:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99d95aecd180 with x1863365426029824 ext(1048576->1052671) 00002000:00010000:3.0:1777051440.555679:0:46203:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99d95aecd180 00000100:00100000:3.0:1777051440.555725:0:46203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 1780 00000100:00100000:3.0:1777051440.555740:0:46203:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95aecd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+49:2436:x1863365426029824:12345-192.168.201.46@tcp:3:cat.0 00000100:00100000:3.0:1777051440.556499:0:46203:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95aecd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+49:2436:x1863365426029824:12345-192.168.201.46@tcp:3:cat.0 Request processed in 759us (1050us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051440.556513:0:46203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 1780 00002000:00100000:3.0:1777051440.556525:0:46203:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000400:0x105:0x0] (1048576->1052671) req@ffff99d95aecd180 x1863365426029824/t0(0) o3->2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp:401/0 lens 488/440 e 0 to 0 dl 1777051451 ref 1 fl Complete:/600/0 rc 0/0 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1777051440.556542:0:46203:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99d95aecd180 with x1863365426029824 ext(1048576->1052671) 00002000:00010000:3.0:1777051440.556549:0:46203:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99d95aecd180 00000100:00100000:1.0:1777051440.566414:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051440.566510:0:6582:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426030080 00000100:00100000:2.0:1777051440.566519:0:6582:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426030080 00000100:00100000:2.0:1777051440.566583:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3391 00000100:00100000:2.0:1777051440.566607:0:6582:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f169880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+52:138108:x1863365426030080:12345-192.168.201.46@tcp:35:cat.0 00000100:00100000:2.0:1777051440.566916:0:6582:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f169880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+53:138108:x1863365426030080:12345-192.168.201.46@tcp:35:cat.0 Request processed in 310us (507us total) trans 8589934719 rc 0/0 00000100:00100000:2.0:1777051440.566930:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3391 00000100:00100000:2.0:1777051440.585098:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051440.585259:0:46494:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426030336 00000100:00100000:0.0:1777051440.585274:0:46494:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426030336 00000100:00100000:0.0:1777051440.585389:0:46494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112202 00000100:00100000:0.0:1777051440.585408:0:46494:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fdf1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+31:138111:x1863365426030336:12345-192.168.201.46@tcp:101:cat.0 00000100:00080000:1.0:1777051440.585410:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1777051440.585450:0:46494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051440.585502:0:46494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d950705c00/0x85f51a6b96716b3e lrc: 2/0,0 mode: --/CR res: [0x2000032e0:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b66c0 expref: -99 pid: 46494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051440.585623:0:46494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950705000/0x85f51a6b96716b45 lrc: 3/1,0 mode: --/CR res: [0x2000032e0:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051440.585647:0:46494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d950705000/0x85f51a6b96716b45 lrc: 3/1,0 mode: CR/CR res: [0x2000032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051440.585667:0:46494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d950705000/0x85f51a6b96716b45 lrc: 3/1,0 mode: CR/CR res: [0x2000032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051440.585690:0:46494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950704c00/0x85f51a6b96716b4c lrc: 3/1,0 mode: --/PR res: [0x2000032e0:0x1:0x0].0xab04085a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051440.585705:0:46494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d950704c00/0x85f51a6b96716b4c lrc: 3/1,0 mode: PR/PR res: [0x2000032e0:0x1:0x0].0xab04085a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051440.585719:0:46494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d950704c00/0x85f51a6b96716b4c lrc: 3/1,0 mode: PR/PR res: [0x2000032e0:0x1:0x0].0xab04085a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051440.586229:0:46494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950704600/0x85f51a6b96716b53 lrc: 3/1,0 mode: --/PR res: [0x2000032e3:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051440.586247:0:46494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d950704600/0x85f51a6b96716b53 lrc: 3/1,0 mode: PR/PR res: [0x2000032e3:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051440.586261:0:46494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d950704600/0x85f51a6b96716b53 lrc: 3/1,0 mode: PR/PR res: [0x2000032e3:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1777051440.586277:0:46494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000032e3:0x6:0x0]: returning size 1048576 00010000:00010000:0.0:1777051440.586400:0:46494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950705000/0x85f51a6b96716b45 lrc: 3/1,0 mode: CR/CR res: [0x2000032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051440.586415:0:46494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d950705000/0x85f51a6b96716b45 lrc: 2/0,0 mode: CR/CR res: [0x2000032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051440.586426:0:46494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d950705000/0x85f51a6b96716b45 lrc: 3/0,0 mode: CR/CR res: [0x2000032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051440.586437:0:46494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d950705000 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:0.0:1777051440.586444:0:46494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d950705000/0x85f51a6b96716b45 lrc: 3/0,0 mode: CR/CR res: [0x2000032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051440.586457:0:46494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d950705000/0x85f51a6b96716b45 lrc: 4/0,0 mode: CR/CR res: [0x2000032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051440.586476:0:46494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e0:0x1:0x0].0x0 (ffff99da42881a00) 00010000:00010000:0.0:1777051440.586481:0:46494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777051440.586489:0:46494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d950705000/0x85f51a6b96716b45 lrc: 2/0,0 mode: --/CR res: [0x2000032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051440.586501:0:46494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d950705000/0x85f51a6b96716b45 lrc: 0/0,0 mode: --/CR res: [0x2000032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051440.586521:0:46494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950704c00/0x85f51a6b96716b4c lrc: 3/1,0 mode: PR/PR res: [0x2000032e0:0x1:0x0].0xab04085a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051440.586532:0:46494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d950704c00/0x85f51a6b96716b4c lrc: 2/0,0 mode: PR/PR res: [0x2000032e0:0x1:0x0].0xab04085a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051440.586544:0:46494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d950704c00/0x85f51a6b96716b4c lrc: 3/0,0 mode: PR/PR res: [0x2000032e0:0x1:0x0].0xab04085a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051440.586553:0:46494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d950704c00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:0.0:1777051440.586558:0:46494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d950704c00/0x85f51a6b96716b4c lrc: 3/0,0 mode: PR/PR res: [0x2000032e0:0x1:0x0].0xab04085a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051440.586569:0:46494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d950704c00/0x85f51a6b96716b4c lrc: 4/0,0 mode: PR/PR res: [0x2000032e0:0x1:0x0].0xab04085a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051440.586581:0:46494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e0:0x1:0x0].0xab04085a (ffff99da42881f00) 00010000:00010000:0.0:1777051440.586586:0:46494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777051440.586590:0:46494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d950704c00/0x85f51a6b96716b4c lrc: 2/0,0 mode: --/PR res: [0x2000032e0:0x1:0x0].0xab04085a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051440.586600:0:46494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d950704c00/0x85f51a6b96716b4c lrc: 0/0,0 mode: --/PR res: [0x2000032e0:0x1:0x0].0xab04085a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051440.586689:0:46494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d950705c00/0x85f51a6b96716b3e lrc: 0/0,0 mode: --/CR res: [0x2000032e0:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b66c0 expref: 34 pid: 46494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051440.586729:0:46494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950704600/0x85f51a6b96716b53 lrc: 3/0,0 mode: PR/PR res: [0x2000032e3:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b66c0 expref: 33 pid: 46494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051440.586744:0:46494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e3:0x6:0x0].0x0 (ffff99da42881100) 00010000:00010000:0.0:1777051440.586777:0:46494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1777051440.586782:0:46494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d950704600, rc 0) 00000100:00100000:0.0:1777051440.586870:0:46494:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fdf1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+33:138111:x1863365426030336:12345-192.168.201.46@tcp:101:cat.0 Request processed in 1466us (1784us total) trans 30064771176 rc 0/0 00000100:00100000:0.0:1777051440.586884:0:46494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112202 00000100:00100000:0.0:1777051440.598629:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051440.598675:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051440.598811:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051440.598932:0:24467:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426030592 00000100:00100000:1.0:1777051440.598948:0:24467:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426030592 00000100:00100000:1.0:1777051440.599065:0:24467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13706 00000100:00100000:3.0:1777051440.599067:0:47208:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426030720 00000100:00100000:3.0:1777051440.599082:0:47208:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426030720 00000100:00100000:1.0:1777051440.599093:0:24467:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95aecc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+33:138111:x1863365426030592:12345-192.168.201.46@tcp:103:cat.0 00010000:00010000:1.0:1777051440.599122:0:24467:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1777051440.599534:0:24467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d950704600/0x85f51a6b96716b53 lrc: 0/0,0 mode: --/PR res: [0x2000032e3:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b66c0 expref: 33 pid: 46494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051440.599540:0:47208:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426030848 00000100:00100000:3.0:1777051440.599554:0:47208:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426030848 00000100:00100000:0.0:1777051440.599557:0:11727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 8220 00010000:00010000:1.0:1777051440.599594:0:24467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e3:0x6:0x0].0x0 (ffff99da42881100) 00000100:00100000:0.0:1777051440.599597:0:11727:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fdf2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+53:2436:x1863365426030720:12345-192.168.201.46@tcp:63:ll_sa.0 00010000:00010000:1.0:1777051440.599616:0:24467:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1777051440.599632:0:47208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 8221 00000100:00100000:3.0:1777051440.599658:0:47208:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fdf0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+33:2437:x1863365426030848:12345-192.168.201.46@tcp:63:ll_sa.0 00010000:00010000:0.0:1777051440.599659:0:11727:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051440.599692:0:11727:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d950705c00/0x85f51a6b96716b61 lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b66ce expref: -99 pid: 11727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051440.599708:0:47208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1777051440.600036:0:24467:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95aecc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+33:138111:x1863365426030592:12345-192.168.201.46@tcp:103:cat.0 Request processed in 628us (1092us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051440.600065:0:24467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13706 00010000:00010000:3.0:1777051440.600086:0:47208:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2c00/0x85f51a6b96716b68 lrc: 2/0,0 mode: --/CR res: [0x2000032e0:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b66c7 expref: -99 pid: 47208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051440.600134:0:11727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d950704c00/0x85f51a6b96716b6f lrc: 3/1,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051440.600161:0:11727:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d950704c00/0x85f51a6b96716b6f lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11727 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051440.600166:0:47208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3800/0x85f51a6b96716b76 lrc: 3/1,0 mode: --/CR res: [0x2000032e0:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 47208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051440.600251:0:11727:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d950704c00/0x85f51a6b96716b6f lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11727 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051440.600262:0:47208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3800/0x85f51a6b96716b76 lrc: 3/1,0 mode: CR/CR res: [0x2000032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 47208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051440.600285:0:11727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d950705000/0x85f51a6b96716b7d lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x4992a133 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051440.600287:0:47208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3800/0x85f51a6b96716b76 lrc: 3/1,0 mode: CR/CR res: [0x2000032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 47208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051440.600324:0:11727:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d950705000/0x85f51a6b96716b7d lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x4992a133 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11727 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051440.600344:0:47208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2200/0x85f51a6b96716b84 lrc: 3/1,0 mode: --/PR res: [0x2000032e0:0x1:0x0].0x5a47bb0b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 47208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051440.600347:0:11727:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d950705000/0x85f51a6b96716b7d lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x4992a133 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11727 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051440.600414:0:11727:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d950704c00/0x85f51a6b96716b6f lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11727 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051440.600430:0:11727:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d950704c00/0x85f51a6b96716b6f lrc: 2/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11727 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051440.600446:0:11727:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99d950704c00/0x85f51a6b96716b6f lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11727 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051440.600461:0:11727:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d950704c00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:0.0:1777051440.600471:0:11727:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d950704c00/0x85f51a6b96716b6f lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11727 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051440.600487:0:11727:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d950704c00/0x85f51a6b96716b6f lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11727 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051440.600509:0:11727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff99d9413d0300) 00010000:00010000:0.0:1777051440.600516:0:11727:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777051440.600523:0:11727:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99d950704c00/0x85f51a6b96716b6f lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11727 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051440.600538:0:11727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d950704c00/0x85f51a6b96716b6f lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11727 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051440.600561:0:11727:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d950705000/0x85f51a6b96716b7d lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x4992a133 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11727 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051440.600581:0:47208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2200/0x85f51a6b96716b84 lrc: 3/1,0 mode: PR/PR res: [0x2000032e0:0x1:0x0].0x5a47bb0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 47208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051440.600584:0:11727:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d950705000/0x85f51a6b96716b7d lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x4992a133 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11727 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051440.600611:0:11727:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99d950705000/0x85f51a6b96716b7d lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x4992a133 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11727 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051440.600630:0:11727:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d950705000 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:3.0:1777051440.600632:0:47208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2200/0x85f51a6b96716b84 lrc: 3/1,0 mode: PR/PR res: [0x2000032e0:0x1:0x0].0x5a47bb0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 47208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051440.600638:0:11727:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d950705000/0x85f51a6b96716b7d lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x4992a133 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11727 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051440.600674:0:11727:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d950705000/0x85f51a6b96716b7d lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x4992a133 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11727 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051440.600694:0:11727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x4992a133 (ffff99da42881a00) 00010000:00010000:0.0:1777051440.600700:0:11727:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777051440.600708:0:11727:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99d950705000/0x85f51a6b96716b7d lrc: 2/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x4992a133 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11727 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051440.600721:0:11727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d950705000/0x85f51a6b96716b7d lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x4992a133 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11727 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051440.600806:0:11727:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff99d950705c00/0x85f51a6b96716b61 lrc: 1/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b66ce expref: 54 pid: 11727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051440.600827:0:11727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff99d9413d0300) 00010000:00010000:0.0:1777051440.600832:0:11727:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1777051440.600841:0:11727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d950705c00/0x85f51a6b96716b61 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b66ce expref: 54 pid: 11727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051440.600874:0:11727:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d950705c00, rc -2) 00010000:00010000:1.0:1777051440.600895:0:47208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3800/0x85f51a6b96716b76 lrc: 3/1,0 mode: CR/CR res: [0x2000032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 47208 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051440.600976:0:11727:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fdf2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+53:2436:x1863365426030720:12345-192.168.201.46@tcp:63:ll_sa.0 Request processed in 1393us (2303us total) trans 0 rc -2/-2 00000100:00100000:0.0:1777051440.600995:0:11727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 8220 00010000:00010000:1.0:1777051440.601038:0:47208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3800/0x85f51a6b96716b76 lrc: 2/0,0 mode: CR/CR res: [0x2000032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 47208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051440.601054:0:47208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3800/0x85f51a6b96716b76 lrc: 3/0,0 mode: CR/CR res: [0x2000032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 47208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051440.601065:0:47208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d9559a3800 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:1.0:1777051440.601072:0:47208:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3800/0x85f51a6b96716b76 lrc: 3/0,0 mode: CR/CR res: [0x2000032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 47208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051440.601086:0:47208:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3800/0x85f51a6b96716b76 lrc: 4/0,0 mode: CR/CR res: [0x2000032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 47208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051440.601107:0:47208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e0:0x1:0x0].0x0 (ffff99d9413d0900) 00010000:00010000:1.0:1777051440.601115:0:47208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777051440.601124:0:47208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3800/0x85f51a6b96716b76 lrc: 2/0,0 mode: --/CR res: [0x2000032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 47208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051440.601627:0:47208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3800/0x85f51a6b96716b76 lrc: 0/0,0 mode: --/CR res: [0x2000032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 47208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051440.601717:0:47208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2200/0x85f51a6b96716b84 lrc: 3/1,0 mode: PR/PR res: [0x2000032e0:0x1:0x0].0x5a47bb0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 47208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051440.601732:0:47208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2200/0x85f51a6b96716b84 lrc: 2/0,0 mode: PR/PR res: [0x2000032e0:0x1:0x0].0x5a47bb0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 47208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051440.601775:0:47208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2200/0x85f51a6b96716b84 lrc: 3/0,0 mode: PR/PR res: [0x2000032e0:0x1:0x0].0x5a47bb0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 47208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051440.601790:0:47208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d9559a2200 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:1.0:1777051440.601797:0:47208:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2200/0x85f51a6b96716b84 lrc: 3/0,0 mode: PR/PR res: [0x2000032e0:0x1:0x0].0x5a47bb0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 47208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051440.601809:0:47208:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2200/0x85f51a6b96716b84 lrc: 4/0,0 mode: PR/PR res: [0x2000032e0:0x1:0x0].0x5a47bb0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 47208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051440.601827:0:47208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e0:0x1:0x0].0x5a47bb0b (ffff99d9413d0600) 00010000:00010000:1.0:1777051440.601832:0:47208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777051440.601838:0:47208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2200/0x85f51a6b96716b84 lrc: 2/0,0 mode: --/PR res: [0x2000032e0:0x1:0x0].0x5a47bb0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 47208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051440.601854:0:47208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2200/0x85f51a6b96716b84 lrc: 0/0,0 mode: --/PR res: [0x2000032e0:0x1:0x0].0x5a47bb0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 47208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051440.602057:0:47208:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2c00/0x85f51a6b96716b68 lrc: 1/0,0 mode: --/CR res: [0x2000032e0:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b66c7 expref: 33 pid: 47208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051440.602094:0:47208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e0:0x1:0x0].0x0 (ffff99d9413d0900) 00010000:00010000:1.0:1777051440.602100:0:47208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1777051440.602109:0:47208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2c00/0x85f51a6b96716b68 lrc: 0/0,0 mode: --/CR res: [0x2000032e0:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b66c7 expref: 33 pid: 47208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051440.602137:0:47208:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d9559a2c00, rc -2) 00000100:00100000:1.0:1777051440.603139:0:47208:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fdf0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+32:2437:x1863365426030848:12345-192.168.201.46@tcp:63:ll_sa.0 Request processed in 3486us (4324us total) trans 0 rc -2/-2 00000100:00100000:1.0:1777051440.603157:0:47208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 8221 00000100:00100000:2.0:1777051440.604168:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051440.604358:0:8492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426030976 00000100:00100000:1.0:1777051440.604368:0:8492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426030976 00000100:00100000:1.0:1777051440.604434:0:8492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112203 00000100:00100000:1.0:1777051440.604451:0:8492:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fdf2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+32:138111:x1863365426030976:12345-192.168.201.46@tcp:58:cat.0 00010000:00010000:1.0:1777051440.604563:0:8492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cfc00/0x85f51a6b96716b8b lrc: 3/0,1 mode: --/EX res: [0x2000032e3:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051440.604584:0:8492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cfc00/0x85f51a6b96716b8b lrc: 3/0,1 mode: EX/EX res: [0x2000032e3:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051440.604601:0:8492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cfc00/0x85f51a6b96716b8b lrc: 3/0,1 mode: EX/EX res: [0x2000032e3:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1777051440.604734:0:8492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2b:0x0].6, 136 off9008 00000100:00100000:1.0:1777051440.604872:0:8492:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fdf2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+32:138111:x1863365426030976:12345-192.168.201.46@tcp:58:cat.0 Request processed in 423us (705us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051440.604886:0:8492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112203 00000100:00100000:2.0:1777051440.612819:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051440.612928:0:6581:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426031104 00000100:00100000:1.0:1777051440.612942:0:6581:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426031104 00000100:00100000:1.0:1777051440.613025:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112204 00000100:00100000:1.0:1777051440.613041:0:6581:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+32:138111:x1863365426031104:12345-192.168.201.46@tcp:101:cat.0 00010000:00010000:1.0:1777051440.613067:0:6581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777051440.613094:0:6581:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cea00/0x85f51a6b96716b92 lrc: 2/0,0 mode: --/CR res: [0x2000032e3:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b66ff expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051440.613160:0:6581:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cfc00/0x85f51a6b96716b8b lrc: 2/0,1 mode: EX/EX res: [0x2000032e3:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051440.613180:0:6581:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cea00/0x85f51a6b96716b92 lrc: 4/0,0 mode: --/CR res: [0x2000032e3:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b66ff expref: 33 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051440.613248:0:6581:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cfc00/0x85f51a6b96716b8b lrc: 3/0,1 mode: EX/EX res: [0x2000032e3:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051440.613275:0:6581:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cea00/0x85f51a6b96716b92 lrc: 3/0,0 mode: --/CR res: [0x2000032e3:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b66ff expref: 33 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051440.613296:0:6581:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e3:0x6:0x0].0x0 (ffff99d94e6b6800) 00010000:00010000:1.0:1777051440.613303:0:6581:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1777051440.613311:0:6581:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cea00/0x85f51a6b96716b92 lrc: 3/0,0 mode: --/CR res: [0x2000032e3:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b66ff expref: 33 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051440.613326:0:6581:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99da7d5cea00, rc 0) 00000100:00100000:1.0:1777051440.613420:0:6581:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+33:138111:x1863365426031104:12345-192.168.201.46@tcp:101:cat.0 Request processed in 368us (592us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051440.613434:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112204 00010000:00010000:0.0:1777051441.238610:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1777051441.432084:0:103189:0:(llog.c:801:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:3.0:1777051441.432095:0:103189:0:(llog_cat.c:158:llog_cat_process_common()) processing log [0x1:0x2b:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1777051441.432188:0:103189:0:(llog.c:858:llog_process_thread()) stop processing plain [0x1:0x2b:0x0] index 7 count 5 00000040:00080000:3.0:1777051441.432230:0:103189:0:(llog.c:858:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00000100:00100000:3.0:1777051441.432416:0:103189:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f9bd880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:103189:1863365452652800:192.168.201.46@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1777051441.432524:0:103189:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d95cb32e40 going to sleep for 11 seconds 00000100:00100000:3.0:1777051441.436288:0:103189:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f9bd880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:103189:1863365452652800:192.168.201.46@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1777051441.436876:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051441.437451:0:46497:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426031232 00000100:00100000:1.0:1777051441.437462:0:46497:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426031232 00000100:00100000:1.0:1777051441.437635:0:46497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112205 00000100:00100000:1.0:1777051441.437653:0:46497:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f29ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:c11b6966-0775-44d2-bdc6-c74c26eb2226+23:138114:x1863365426031232:12345-192.168.201.46@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1777051441.437713:0:46497:0:(mdt_handler.c:7958:mdt_fid2path()) path get [0x2000032e3:0x6:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1777051441.438537:0:46497:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f29ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:c11b6966-0775-44d2-bdc6-c74c26eb2226+23:138114:x1863365426031232:12345-192.168.201.46@tcp:53:lhsmtool_posix.0 Request processed in 886us (1661us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051441.438551:0:46497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112205 00000100:00100000:2.0:1777051441.442678:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051441.442905:0:27882:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426031360 00000100:00100000:3.0:1777051441.442931:0:27882:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426031360 00000100:00100000:3.0:1777051441.442998:0:27882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112206 00000100:00100000:3.0:1777051441.443027:0:27882:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da444a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+23:138114:x1863365426031360:12345-192.168.201.46@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1777051441.443106:0:27882:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3400/0x85f51a6b96716b99 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051441.443150:0:27882:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3400/0x85f51a6b96716b99 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051441.443169:0:27882:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3400/0x85f51a6b96716b99 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051441.443193:0:27882:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2000/0x85f51a6b96716ba0 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xad442353 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051441.443205:0:27882:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2000/0x85f51a6b96716ba0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xad442353 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051441.443216:0:27882:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2000/0x85f51a6b96716ba0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xad442353 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051441.443246:0:27882:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3c00/0x85f51a6b96716ba7 lrc: 3/1,0 mode: --/PR res: [0x2000032e3:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051441.443258:0:27882:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3c00/0x85f51a6b96716ba7 lrc: 3/1,0 mode: PR/PR res: [0x2000032e3:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051441.443269:0:27882:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3c00/0x85f51a6b96716ba7 lrc: 3/1,0 mode: PR/PR res: [0x2000032e3:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1777051441.443354:0:27882:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000032e3:0x6:0x0]: returning size 1048576 00000004:00200000:3.0:1777051441.443361:0:27882:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1777051441.443378:0:27882:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3c00/0x85f51a6b96716ba7 lrc: 3/1,0 mode: PR/PR res: [0x2000032e3:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051441.443397:0:27882:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3400/0x85f51a6b96716b99 lrc: 4/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051441.443415:0:27882:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3400/0x85f51a6b96716b99 lrc: 4/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051441.443424:0:27882:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3400/0x85f51a6b96716b99 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051441.443435:0:27882:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3400/0x85f51a6b96716b99 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051441.443444:0:27882:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d9559a3400 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:3.0:1777051441.443450:0:27882:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3400/0x85f51a6b96716b99 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051441.443462:0:27882:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3400/0x85f51a6b96716b99 lrc: 5/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051441.443478:0:27882:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99d941e2ea00) 00010000:00010000:3.0:1777051441.443483:0:27882:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777051441.443489:0:27882:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3400/0x85f51a6b96716b99 lrc: 3/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051441.443499:0:27882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3400/0x85f51a6b96716b99 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051441.443518:0:27882:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2000/0x85f51a6b96716ba0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xad442353 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051441.443529:0:27882:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2000/0x85f51a6b96716ba0 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xad442353 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051441.443538:0:27882:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2000/0x85f51a6b96716ba0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xad442353 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051441.443547:0:27882:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d9559a2000 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:3.0:1777051441.443551:0:27882:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2000/0x85f51a6b96716ba0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xad442353 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051441.443561:0:27882:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2000/0x85f51a6b96716ba0 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xad442353 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051441.443575:0:27882:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xad442353 (ffff99d9413d0800) 00010000:00010000:3.0:1777051441.443578:0:27882:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777051441.443583:0:27882:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2000/0x85f51a6b96716ba0 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xad442353 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051441.443592:0:27882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2000/0x85f51a6b96716ba0 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xad442353 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051441.443617:0:27882:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3c00/0x85f51a6b96716ba7 lrc: 3/1,0 mode: PR/PR res: [0x2000032e3:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051441.443627:0:27882:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3c00/0x85f51a6b96716ba7 lrc: 2/0,0 mode: PR/PR res: [0x2000032e3:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051441.443637:0:27882:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3c00/0x85f51a6b96716ba7 lrc: 3/0,0 mode: PR/PR res: [0x2000032e3:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051441.443645:0:27882:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d9559a3c00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:3.0:1777051441.443650:0:27882:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3c00/0x85f51a6b96716ba7 lrc: 3/0,0 mode: PR/PR res: [0x2000032e3:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051441.443660:0:27882:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3c00/0x85f51a6b96716ba7 lrc: 4/0,0 mode: PR/PR res: [0x2000032e3:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051441.443678:0:27882:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e3:0x6:0x0].0x0 (ffff99d94e6b6800) 00010000:00010000:3.0:1777051441.443682:0:27882:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777051441.443686:0:27882:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3c00/0x85f51a6b96716ba7 lrc: 2/0,0 mode: --/PR res: [0x2000032e3:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051441.443696:0:27882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3c00/0x85f51a6b96716ba7 lrc: 0/0,0 mode: --/PR res: [0x2000032e3:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051441.443820:0:27882:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da444a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+23:138114:x1863365426031360:12345-192.168.201.46@tcp:34:lhsmtool_posix.0 Request processed in 809us (1146us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051441.443834:0:27882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112206 00000100:00100000:0.0:1777051441.446632:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051441.446769:0:21368:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426031616 00000100:00100000:2.0:1777051441.446778:0:21368:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426031616 00000100:00100000:2.0:1777051441.446852:0:21368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112207 00000100:00100000:2.0:1777051441.446867:0:21368:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7e24e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+23:138114:x1863365426031616:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1777051441.446886:0:21368:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051441.446906:0:21368:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d944a3ee00/0x85f51a6b96716bae lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6706 expref: -99 pid: 21368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051441.447026:0:21368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d944a3ea00/0x85f51a6b96716bb5 lrc: 3/1,0 mode: --/PR res: [0x2000032e3:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051441.447044:0:21368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d944a3ea00/0x85f51a6b96716bb5 lrc: 3/1,0 mode: PR/PR res: [0x2000032e3:0x6:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051441.447059:0:21368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d944a3ea00/0x85f51a6b96716bb5 lrc: 3/1,0 mode: PR/PR res: [0x2000032e3:0x6:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1777051441.447072:0:21368:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000032e3:0x6:0x0]: returning size 1048576 00010000:00010000:2.0:1777051441.447165:0:21368:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d944a3ea00/0x85f51a6b96716bb5 lrc: 3/1,0 mode: PR/PR res: [0x2000032e3:0x6:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051441.447178:0:21368:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d944a3ea00/0x85f51a6b96716bb5 lrc: 2/0,0 mode: PR/PR res: [0x2000032e3:0x6:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051441.447189:0:21368:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d944a3ea00/0x85f51a6b96716bb5 lrc: 3/0,0 mode: PR/PR res: [0x2000032e3:0x6:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051441.447259:0:21368:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d944a3ea00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:2.0:1777051441.447266:0:21368:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d944a3ea00/0x85f51a6b96716bb5 lrc: 3/0,0 mode: PR/PR res: [0x2000032e3:0x6:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051441.447278:0:21368:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d944a3ea00/0x85f51a6b96716bb5 lrc: 4/0,0 mode: PR/PR res: [0x2000032e3:0x6:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051441.447293:0:21368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e3:0x6:0x0].0x0 (ffff99d94e6b6800) 00010000:00010000:2.0:1777051441.447299:0:21368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1777051441.447305:0:21368:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d944a3ea00/0x85f51a6b96716bb5 lrc: 2/0,0 mode: --/PR res: [0x2000032e3:0x6:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051441.447314:0:21368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d944a3ea00/0x85f51a6b96716bb5 lrc: 0/0,0 mode: --/PR res: [0x2000032e3:0x6:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051441.447380:0:21368:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d944a3ee00/0x85f51a6b96716bae lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6706 expref: 25 pid: 21368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051441.447396:0:21368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99d941e2ea00) 00010000:00010000:2.0:1777051441.447400:0:21368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1777051441.447406:0:21368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d944a3ee00/0x85f51a6b96716bae lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6706 expref: 25 pid: 21368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051441.447421:0:21368:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d944a3ee00, rc 0) 00000100:00100000:2.0:1777051441.447477:0:21368:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7e24e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+24:138114:x1863365426031616:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 Request processed in 612us (848us total) trans 30064771177 rc 301/301 00000100:00100000:2.0:1777051441.447489:0:21368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112207 00000100:00100000:1.0:1777051441.451278:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051441.451332:0:6579:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426031744 00000100:00100000:0.0:1777051441.451341:0:6579:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426031744 00000100:00100000:0.0:1777051441.451408:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112208 00000100:00100000:0.0:1777051441.451419:0:6579:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f168000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+24:138114:x1863365426031744:12345-192.168.201.46@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1777051441.451450:0:6579:0:(mdt_handler.c:7958:mdt_fid2path()) path get [0x2000032e3:0x6:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1777051441.451652:0:6579:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f168000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+24:138114:x1863365426031744:12345-192.168.201.46@tcp:53:lhsmtool_posix.0 Request processed in 231us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051441.451666:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112208 00000100:00100000:3.0:1777051441.456992:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051441.457558:0:27885:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426032000 00000100:00100000:2.0:1777051441.457577:0:27885:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426032000 00000100:00100000:2.0:1777051441.457691:0:27885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112209 00000100:00100000:2.0:1777051441.457707:0:27885:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c11b6966-0775-44d2-bdc6-c74c26eb2226+24:138114:x1863365426032000:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1777051441.457730:0:27885:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051441.457792:0:27885:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d944a3ee00/0x85f51a6b96716bc3 lrc: 2/0,0 mode: --/CW res: [0x2000032e0:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b670d expref: -99 pid: 27885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051441.458491:0:27885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d944a3ea00/0x85f51a6b96716bca lrc: 3/1,0 mode: --/PR res: [0x2000032e3:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051441.458515:0:27885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d944a3ea00/0x85f51a6b96716bca lrc: 3/1,0 mode: PR/PR res: [0x2000032e3:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051441.458533:0:27885:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d944a3ea00/0x85f51a6b96716bca lrc: 3/1,0 mode: PR/PR res: [0x2000032e3:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1777051441.458552:0:27885:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000032e3:0x7:0x0]: returning size 0 00010000:00010000:2.0:1777051441.458617:0:27885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d944a3ee00/0x85f51a6b96716bc3 lrc: 0/0,0 mode: --/CW res: [0x2000032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b670d expref: 27 pid: 27885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051441.458652:0:27885:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d944a3ea00/0x85f51a6b96716bca lrc: 3/0,0 mode: PR/PR res: [0x2000032e3:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b670d expref: 26 pid: 27885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051441.458667:0:27885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e3:0x7:0x0].0x0 (ffff99da617f5500) 00010000:00010000:2.0:1777051441.458672:0:27885:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1777051441.458677:0:27885:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d944a3ea00, rc 0) 00000100:00100000:2.0:1777051441.458785:0:27885:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c11b6966-0775-44d2-bdc6-c74c26eb2226+26:138114:x1863365426032000:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 Request processed in 1080us (1808us total) trans 30064771178 rc 0/0 00000100:00100000:2.0:1777051441.459066:0:27885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112209 00000100:00100000:2.0:1777051441.468667:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051441.470184:0:6580:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426032256 00000100:00100000:1.0:1777051441.470233:0:6580:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426032256 00000100:00100000:1.0:1777051441.470343:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112210 00000100:00100000:1.0:1777051441.470361:0:6580:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5fbeea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+26:138114:x1863365426032256:12345-192.168.201.46@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1777051441.470458:0:6580:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1777051441.470496:0:6580:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d944a3ea00/0x85f51a6b96716bca lrc: 0/0,0 mode: --/PR res: [0x2000032e3:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b670d expref: 26 pid: 27885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051441.470520:0:6580:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e3:0x7:0x0].0x0 (ffff99da617f5500) 00010000:00010000:1.0:1777051441.470536:0:6580:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1777051441.470573:0:6580:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cfe00/0x85f51a6b96716bd8 lrc: 3/0,1 mode: --/CW res: [0x2000032e0:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051441.470594:0:6580:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cfe00/0x85f51a6b96716bd8 lrc: 3/0,1 mode: CW/CW res: [0x2000032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051441.470612:0:6580:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cfe00/0x85f51a6b96716bd8 lrc: 3/0,1 mode: CW/CW res: [0x2000032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051441.470639:0:6580:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cf000/0x85f51a6b96716bdf lrc: 3/0,1 mode: --/PW res: [0x2000032e0:0x1:0x0].0xcfd1db06 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051441.470649:0:6580:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cf000/0x85f51a6b96716bdf lrc: 3/0,1 mode: PW/PW res: [0x2000032e0:0x1:0x0].0xcfd1db06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051441.470657:0:6580:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cf000/0x85f51a6b96716bdf lrc: 3/0,1 mode: PW/PW res: [0x2000032e0:0x1:0x0].0xcfd1db06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051441.470726:0:6580:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cfe00/0x85f51a6b96716bd8 lrc: 4/0,1 mode: CW/CW res: [0x2000032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051441.470765:0:6580:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cfe00/0x85f51a6b96716bd8 lrc: 4/0,1 mode: CW/CW res: [0x2000032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051441.470775:0:6580:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cfe00/0x85f51a6b96716bd8 lrc: 3/0,0 mode: CW/CW res: [0x2000032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051441.470784:0:6580:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cfe00/0x85f51a6b96716bd8 lrc: 4/0,0 mode: CW/CW res: [0x2000032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051441.470794:0:6580:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da7d5cfe00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:1.0:1777051441.470800:0:6580:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cfe00/0x85f51a6b96716bd8 lrc: 4/0,0 mode: CW/CW res: [0x2000032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051441.470811:0:6580:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cfe00/0x85f51a6b96716bd8 lrc: 5/0,0 mode: CW/CW res: [0x2000032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051441.470823:0:6580:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e0:0x1:0x0].0x0 (ffff99d94e6b6300) 00010000:00010000:1.0:1777051441.470827:0:6580:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777051441.470845:0:6580:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cfe00/0x85f51a6b96716bd8 lrc: 3/0,0 mode: --/CW res: [0x2000032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051441.470856:0:6580:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cfe00/0x85f51a6b96716bd8 lrc: 0/0,0 mode: --/CW res: [0x2000032e0:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051441.470877:0:6580:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cf000/0x85f51a6b96716bdf lrc: 3/0,1 mode: PW/PW res: [0x2000032e0:0x1:0x0].0xcfd1db06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051441.470887:0:6580:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cf000/0x85f51a6b96716bdf lrc: 2/0,0 mode: PW/PW res: [0x2000032e0:0x1:0x0].0xcfd1db06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051441.470894:0:6580:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cf000/0x85f51a6b96716bdf lrc: 3/0,0 mode: PW/PW res: [0x2000032e0:0x1:0x0].0xcfd1db06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051441.470899:0:6580:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da7d5cf000 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:1.0:1777051441.470901:0:6580:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cf000/0x85f51a6b96716bdf lrc: 3/0,0 mode: PW/PW res: [0x2000032e0:0x1:0x0].0xcfd1db06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051441.470907:0:6580:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cf000/0x85f51a6b96716bdf lrc: 4/0,0 mode: PW/PW res: [0x2000032e0:0x1:0x0].0xcfd1db06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051441.470914:0:6580:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e0:0x1:0x0].0xcfd1db06 (ffff99d94e6b6100) 00010000:00010000:1.0:1777051441.470916:0:6580:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777051441.470918:0:6580:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cf000/0x85f51a6b96716bdf lrc: 2/0,0 mode: --/PW res: [0x2000032e0:0x1:0x0].0xcfd1db06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051441.470923:0:6580:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cf000/0x85f51a6b96716bdf lrc: 0/0,0 mode: --/PW res: [0x2000032e0:0x1:0x0].0xcfd1db06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051441.471023:0:6580:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5fbeea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+25:138114:x1863365426032256:12345-192.168.201.46@tcp:36:lhsmtool_posix.0 Request processed in 667us (2371us total) trans 0 rc -2/-2 00000100:00100000:1.0:1777051441.471032:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112210 00000100:00100000:1.0:1777051441.474477:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051441.474805:0:27882:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426032384 00000100:00100000:3.0:1777051441.474817:0:27882:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426032384 00000100:00100000:3.0:1777051441.474885:0:27882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112211 00000100:00100000:3.0:1777051441.474897:0:27882:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f16b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+25:138114:x1863365426032384:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1777051441.474920:0:27882:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777051441.474948:0:27882:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2c00/0x85f51a6b96716be6 lrc: 2/0,0 mode: --/PR res: [0x2000032e3:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6714 expref: -99 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051441.474988:0:27882:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3c00/0x85f51a6b96716bed lrc: 3/1,0 mode: --/PR res: [0x2000032e3:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051441.475001:0:27882:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3c00/0x85f51a6b96716bed lrc: 3/1,0 mode: PR/PR res: [0x2000032e3:0x7:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051441.475011:0:27882:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3c00/0x85f51a6b96716bed lrc: 3/1,0 mode: PR/PR res: [0x2000032e3:0x7:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051441.475510:0:27882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2c00/0x85f51a6b96716be6 lrc: 0/0,0 mode: --/PR res: [0x2000032e3:0x7:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6714 expref: 27 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051441.475538:0:27882:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3c00/0x85f51a6b96716bed lrc: 3/0,0 mode: PR/PR res: [0x2000032e3:0x7:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6714 expref: 26 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051441.475552:0:27882:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e3:0x7:0x0].0x0 (ffff99d9413d0800) 00010000:00010000:3.0:1777051441.475556:0:27882:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1777051441.475561:0:27882:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d9559a3c00, rc 0) 00000100:00100000:3.0:1777051441.475633:0:27882:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f16b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+26:138114:x1863365426032384:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 Request processed in 737us (1160us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051441.475645:0:27882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112211 00000100:00100000:3.0:1777051441.480892:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051441.481017:0:21368:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426032640 00000100:00100000:2.0:1777051441.481033:0:21368:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426032640 00000100:00100000:2.0:1777051441.481141:0:21368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112212 00000100:00100000:2.0:1777051441.481158:0:21368:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95fbafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+26:138114:x1863365426032640:12345-192.168.201.46@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1777051441.481354:0:21368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d944a3ea00/0x85f51a6b96716bf4 lrc: 3/0,1 mode: --/PW res: [0x2000032e3:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051441.481400:0:21368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d944a3ea00/0x85f51a6b96716bf4 lrc: 3/0,1 mode: PW/PW res: [0x2000032e3:0x7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051441.481419:0:21368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d944a3ea00/0x85f51a6b96716bf4 lrc: 3/0,1 mode: PW/PW res: [0x2000032e3:0x7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1777051441.481667:0:21368:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000004f3ea8e7 reply state 000000008c79fee0 transno 30064771179 ns: mdt-lustre-MDT0000_UUID lock: ffff99d944a3ea00/0x85f51a6b96716bf4 lrc: 3/0,1 mode: PW/PW res: [0x2000032e3:0x7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051441.481689:0:21368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d944a3ea00/0x85f51a6b96716bf4 lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e3:0x7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051441.481701:0:21368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e3:0x7:0x0].0x0 (ffff99d9413d0800) 00010000:00010000:2.0:1777051441.481706:0:21368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1777051441.481712:0:21368:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1777051441.481884:0:21368:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95fbafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+28:138114:x1863365426032640:12345-192.168.201.46@tcp:36:lhsmtool_posix.0 Request processed in 731us (1009us total) trans 30064771179 rc 0/0 00000100:00100000:2.0:1777051441.481894:0:21368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112212 00000100:00100000:2.0:1777051441.485840:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051441.485987:0:8492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426032768 00000100:00100000:1.0:1777051441.486007:0:8492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426032768 00000100:00100000:1.0:1777051441.486126:0:8492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112213 00000100:00100000:1.0:1777051441.486144:0:8492:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94e626680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+28:138114:x1863365426032768:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1777051441.486182:0:8492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777051441.486288:0:8492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cfe00/0x85f51a6b96716bfb lrc: 2/0,0 mode: --/CR res: [0x2000032e3:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b671b expref: -99 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051441.486374:0:8492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cfe00/0x85f51a6b96716bfb lrc: 3/0,0 mode: CR/CR res: [0x2000032e3:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b671b expref: 29 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051441.486397:0:8492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cfe00/0x85f51a6b96716bfb lrc: 3/0,0 mode: CR/CR res: [0x2000032e3:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b671b expref: 29 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051441.486413:0:8492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e3:0x7:0x0].0x0 (ffff99d9413d0800) 00010000:00010000:1.0:1777051441.486418:0:8492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1777051441.486423:0:8492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99da7d5cfe00, rc 0) 00000100:00100000:1.0:1777051441.486511:0:8492:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94e626680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+29:138114:x1863365426032768:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 Request processed in 372us (685us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051441.486524:0:8492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112213 00000100:00100000:1.0:1777051441.491719:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051441.492436:0:6583:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426032896 00000100:00100000:2.0:1777051441.492452:0:6583:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426032896 00000100:00100000:2.0:1777051441.492560:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3392 00000100:00100000:2.0:1777051441.492576:0:6583:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da6ff00850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+29:138114:x1863365426032896:12345-192.168.201.46@tcp:49:lhsmtool_posix.0 00000100:00100000:2.0:1777051441.493157:0:6583:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da6ff00850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+29:138114:x1863365426032896:12345-192.168.201.46@tcp:49:lhsmtool_posix.0 Request processed in 567us (1431us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051441.493173:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3392 00000100:00100000:3.0:1777051441.498588:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051441.499128:0:46501:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426033152 00000100:00100000:2.0:1777051441.499143:0:46501:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426033152 00000100:00100000:2.0:1777051441.499263:0:46501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3393 00000100:00100000:2.0:1777051441.499283:0:46501:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95fbac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+29:138114:x1863365426033152:12345-192.168.201.46@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1777051441.499589:0:46501:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95fbac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+30:138114:x1863365426033152:12345-192.168.201.46@tcp:35:lhsmtool_posix.0 Request processed in 310us (1011us total) trans 30064771180 rc 0/0 00000100:00100000:2.0:1777051441.499606:0:46501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3393 00000100:00100000:0.0:1777051441.502846:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051441.503000:0:6581:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426033408 00000100:00100000:1.0:1777051441.503019:0:6581:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426033408 00000100:00100000:1.0:1777051441.503141:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112214 00000100:00100000:1.0:1777051441.503157:0:6581:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f42e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+30:138114:x1863365426033408:12345-192.168.201.46@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1777051441.503355:0:6581:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f42e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+30:138114:x1863365426033408:12345-192.168.201.46@tcp:57:lhsmtool_posix.0 Request processed in 201us (515us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051441.503368:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112214 00000100:00100000:1.0:1777051441.507533:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051441.507694:0:6580:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426033664 00000100:00100000:2.0:1777051441.507705:0:6580:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426033664 00000100:00100000:2.0:1777051441.508117:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112215 00000100:00100000:2.0:1777051441.508135:0:6580:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f168700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+30:138114:x1863365426033664:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1777051441.508160:0:6580:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051441.508276:0:6580:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d944a3e200/0x85f51a6b96716c02 lrc: 2/0,0 mode: --/CR res: [0x2000032e3:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6722 expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051441.508470:0:6580:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99d944a3f400/0x85f51a6b96716c09 lrc: 3/0,1 mode: --/EX res: [0x2000032e3:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051441.508499:0:6580:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cfe00/0x85f51a6b96716bfb lrc: 2/0,0 mode: CR/CR res: [0x2000032e3:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b671b expref: 31 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051441.508515:0:6580:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d944a3f400/0x85f51a6b96716c09 lrc: 4/0,1 mode: --/EX res: [0x2000032e3:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051441.508575:0:6580:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cfe00/0x85f51a6b96716bfb lrc: 3/0,0 mode: CR/CR res: [0x2000032e3:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b671b expref: 31 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051441.508600:0:6580:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cfe00/0x85f51a6b96716bfb lrc: 4/0,0 mode: CR/CR res: [0x2000032e3:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b671b expref: 31 pid: 8492 timeout: 8170 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051441.508633:0:6580:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94e627b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6580:1863365452652928:192.168.201.46@tcp:104: 00000100:00100000:2.0:1777051441.509050:0:6580:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d95cf519c0 going to sleep for 11 seconds 00000100:00100000:3.0:1777051441.514773:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051441.514877:0:47827:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426033792 00000100:00100000:2.0:1777051441.514880:0:6580:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94e627b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6580:1863365452652928:192.168.201.46@tcp:104: 00000100:00100000:0.0:1777051441.514887:0:47827:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426033792 00010000:00010000:2.0:1777051441.514936:0:6580:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99d944a3f400/0x85f51a6b96716c09 lrc: 3/0,1 mode: --/EX res: [0x2000032e3:0x7:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051441.514940:0:47827:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cfe00/0x85f51a6b96716bfb lrc: 4/0,0 mode: CR/CR res: [0x2000032e3:0x7:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b671b expref: 32 pid: 8492 timeout: 8170 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051441.515206:0:47827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3919 00000100:00100000:0.0:1777051441.515226:0:47827:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95fbaca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+32:2436:x1863365426033792:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1777051441.515250:0:47827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777051441.515262:0:47827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cfe00/0x85f51a6b96716bfb lrc: 4/0,0 mode: CR/CR res: [0x2000032e3:0x7:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b671b expref: 32 pid: 8492 timeout: 8170 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051441.515295:0:47827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cfe00/0x85f51a6b96716bfb lrc: 3/0,0 mode: CR/CR res: [0x2000032e3:0x7:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b671b expref: 32 pid: 8492 timeout: 8170 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051441.515327:0:47827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cfe00/0x85f51a6b96716bfb lrc: 0/0,0 mode: --/CR res: [0x2000032e3:0x7:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b671b expref: 32 pid: 8492 timeout: 8170 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051441.515348:0:47827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e3:0x7:0x0].0x0 (ffff99d9413d0800) 00010000:00010000:0.0:1777051441.515354:0:47827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99d944a3f400/0x85f51a6b96716c09 lrc: 3/0,1 mode: --/EX res: [0x2000032e3:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051441.515437:0:47827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99d944a3f400/0x85f51a6b96716c09 lrc: 3/0,1 mode: EX/EX res: [0x2000032e3:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051441.515452:0:47827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d944a3f400/0x85f51a6b96716c09 lrc: 4/0,1 mode: EX/EX res: [0x2000032e3:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051441.515508:0:47827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1777051441.515573:0:6580:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99d944a3f400/0x85f51a6b96716c09 lrc: 3/0,1 mode: EX/EX res: [0x2000032e3:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051441.515592:0:47827:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95fbaca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+31:2436:x1863365426033792:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 367us (895us total) trans 0 rc 0/0 00010000:00010000:3.0:1777051441.515594:0:6580:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d944a3f400/0x85f51a6b96716c09 lrc: 3/0,1 mode: EX/EX res: [0x2000032e3:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051441.515618:0:47827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3919 00000004:00200000:3.0:1777051441.515636:0:6580:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000032e3:0x7:0x0]: returning size 0 00000004:00080000:3.0:1777051441.516104:0:6580:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x1e4:0x0], index 1: 0 00010000:00010000:3.0:1777051441.516260:0:6580:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99d944a3f400/0x85f51a6b96716c09 lrc: 3/0,1 mode: EX/EX res: [0x2000032e3:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051441.516275:0:6580:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d944a3f400/0x85f51a6b96716c09 lrc: 2/0,0 mode: EX/EX res: [0x2000032e3:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051441.516293:0:6580:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d944a3f400/0x85f51a6b96716c09 lrc: 3/0,0 mode: EX/EX res: [0x2000032e3:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051441.516349:0:6580:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d944a3f400 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:3.0:1777051441.516357:0:6580:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d944a3f400/0x85f51a6b96716c09 lrc: 3/0,0 mode: EX/EX res: [0x2000032e3:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051441.516369:0:6580:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d944a3f400/0x85f51a6b96716c09 lrc: 4/0,0 mode: EX/EX res: [0x2000032e3:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051441.516386:0:6580:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e3:0x7:0x0].0x0 (ffff99d9413d0800) 00010000:00010000:3.0:1777051441.516394:0:6580:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1777051441.516401:0:6580:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d944a3f400/0x85f51a6b96716c09 lrc: 2/0,0 mode: --/EX res: [0x2000032e3:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051441.516411:0:6580:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d944a3f400/0x85f51a6b96716c09 lrc: 0/0,0 mode: --/EX res: [0x2000032e3:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051441.516562:0:6580:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d944a3e200/0x85f51a6b96716c02 lrc: 1/0,0 mode: --/CR res: [0x2000032e3:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6722 expref: 31 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051441.516581:0:6580:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e3:0x7:0x0].0x0 (ffff99d9413d0800) 00010000:00010000:2.0:1777051441.516586:0:6580:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1777051441.516593:0:6580:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d944a3e200/0x85f51a6b96716c02 lrc: 0/0,0 mode: --/CR res: [0x2000032e3:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6722 expref: 31 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051441.516611:0:6580:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d944a3e200, rc 0) 00000100:00100000:2.0:1777051441.516667:0:6580:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f168700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+30:138114:x1863365426033664:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 Request processed in 8537us (9142us total) trans 30064771181 rc 301/301 00000100:00100000:2.0:1777051441.516678:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112215 00000100:00100000:3.0:1777051441.526061:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051441.526179:0:24269:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426034048 00000100:00100000:1.0:1777051441.526563:0:24269:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426034048 00000100:00100000:1.0:1777051441.526668:0:24269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3394 00000100:00100000:1.0:1777051441.526686:0:24269:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95fbace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+30:138114:x1863365426034048:12345-192.168.201.46@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1777051441.527141:0:24269:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95fbace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+31:138114:x1863365426034048:12345-192.168.201.46@tcp:35:lhsmtool_posix.0 Request processed in 457us (1093us total) trans 30064771182 rc 0/0 00000100:00100000:1.0:1777051441.527155:0:24269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3394 00000100:00100000:0.0:1777051441.529969:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051441.530074:0:10328:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426034176 00000100:00100000:2.0:1777051441.530085:0:10328:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426034176 00000100:00100000:2.0:1777051441.530236:0:10328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112216 00000100:00100000:2.0:1777051441.530255:0:10328:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f42c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+31:138114:x1863365426034176:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1777051441.530281:0:10328:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051441.530316:0:10328:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d944a3fc00/0x85f51a6b96716c17 lrc: 2/0,0 mode: --/CR res: [0x2000032e3:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6729 expref: -99 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051441.530430:0:10328:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d944a3f000/0x85f51a6b96716c1e lrc: 3/1,0 mode: --/PR res: [0x2000032e3:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051441.530458:0:10328:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d944a3f000/0x85f51a6b96716c1e lrc: 3/1,0 mode: PR/PR res: [0x2000032e3:0x7:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051441.530478:0:10328:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d944a3f000/0x85f51a6b96716c1e lrc: 3/1,0 mode: PR/PR res: [0x2000032e3:0x7:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1777051441.530522:0:10328:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000032e3:0x7:0x0]: returning size 0 00000004:00200000:2.0:1777051441.530530:0:10328:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1777051441.530557:0:10328:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99d944a3f000/0x85f51a6b96716c1e lrc: 3/1,0 mode: PR/PR res: [0x2000032e3:0x7:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051441.530598:0:10328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d944a3fc00/0x85f51a6b96716c17 lrc: 0/0,0 mode: --/CR res: [0x2000032e3:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6729 expref: 33 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051441.530624:0:10328:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d944a3f000/0x85f51a6b96716c1e lrc: 3/0,0 mode: PR/PR res: [0x2000032e3:0x7:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6729 expref: 32 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051441.530638:0:10328:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e3:0x7:0x0].0x0 (ffff99d9413d0800) 00010000:00010000:2.0:1777051441.530642:0:10328:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1777051441.530648:0:10328:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d944a3f000, rc 0) 00000100:00100000:2.0:1777051441.530719:0:10328:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f42c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+32:138114:x1863365426034176:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 Request processed in 468us (754us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051441.530760:0:10328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112216 00000100:00100000:2.0:1777051441.534621:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051441.534722:0:24468:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426034304 00000100:00100000:0.0:1777051441.534757:0:24468:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426034304 00000100:00100000:0.0:1777051441.534829:0:24468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 8057 00000100:00100000:0.0:1777051441.534843:0:24468:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94e627b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+49:2437:x1863365426034304:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1777051441.534860:0:24468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051441.534882:0:24468:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000963efdd1/0x85f51a6b96716c25 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x1e4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6730 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1777051441.534913:0:24468:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x1e4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1777051441.534932:0:24468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777051441.534934:0:24468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777051441.534945:0:24468:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000963efdd1/0x85f51a6b96716c25 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6730 expref: 50 pid: 24468 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051441.534962:0:24468:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000963efdd1/0x85f51a6b96716c25 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6730 expref: 50 pid: 24468 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051441.534976:0:24468:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d950704400, rc 0) 00000100:00100000:0.0:1777051441.535027:0:24468:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94e627b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+50:2437:x1863365426034304:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 Request processed in 189us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051441.535034:0:24468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 8057 00000100:00100000:3.0:1777051441.538680:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051441.538793:0:46494:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426034560 00000100:00100000:0.0:1777051441.538801:0:46494:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426034560 00000100:00100000:0.0:1777051441.538848:0:46494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112217 00000100:00100000:0.0:1777051441.538856:0:46494:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95fbad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c11b6966-0775-44d2-bdc6-c74c26eb2226+32:138114:x1863365426034560:12345-192.168.201.46@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1777051441.538949:0:46494:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95fbad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c11b6966-0775-44d2-bdc6-c74c26eb2226+32:138114:x1863365426034560:12345-192.168.201.46@tcp:57:lhsmtool_posix.0 Request processed in 93us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051441.538956:0:46494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112217 00000100:00100000:2.0:1777051441.542655:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051441.543087:0:13320:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426034688 00000100:00100000:1.0:1777051441.543095:0:13320:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426034688 00000100:00100000:1.0:1777051441.543185:0:13320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 8058 00000100:00100000:1.0:1777051441.543252:0:13320:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94e625180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+50:138114:x1863365426034688:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1777051441.543274:0:13320:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777051441.543299:0:13320:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f6fa49c7/0x85f51a6b96716c2c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x1e4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6737 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051441.543342:0:13320:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000963efdd1/0x85f51a6b96716c25 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x1e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6730 expref: 51 pid: 24468 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051441.543357:0:13320:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051441.543360:0:13320:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051441.543366:0:13320:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f6fa49c7/0x85f51a6b96716c2c lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x1e4:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6737 expref: 51 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051441.543418:0:13320:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000963efdd1/0x85f51a6b96716c25 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6730 expref: 51 pid: 24468 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051441.543442:0:13320:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000963efdd1/0x85f51a6b96716c25 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6730 expref: 51 pid: 24468 timeout: 8170 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051441.543461:0:13320:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94f169880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:13320:1863365452653056:192.168.201.46@tcp:104: 00000100:00100000:1.0:1777051441.543586:0:13320:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d9410826c0 going to sleep for 11 seconds 00000100:00100000:1.0:1777051441.550085:0:13320:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94f169880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:13320:1863365452653056:192.168.201.46@tcp:104: 00010000:00010000:1.0:1777051441.550589:0:13320:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f6fa49c7/0x85f51a6b96716c2c lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x1e4:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6737 expref: 51 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051441.550625:0:13320:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99da7d5cf200, rc 0) 00000100:00100000:1.0:1777051441.550755:0:13320:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94e625180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+51:138114:x1863365426034688:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 Request processed in 7532us (8078us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051441.551448:0:13320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 8058 00000100:00100000:2.0:1777051441.551475:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051441.551553:0:6564:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426034816 00000100:00100000:0.0:1777051441.551565:0:6564:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426034816 00010000:00010000:0.0:1777051441.551610:0:6564:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000963efdd1/0x85f51a6b96716c25 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6730 expref: 51 pid: 24468 timeout: 8170 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051441.551669:0:6564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3920 00000100:00100000:0.0:1777051441.551690:0:6564:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da53b94450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+51:2437:x1863365426034816:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1777051441.551708:0:6564:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777051441.551766:0:6564:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000963efdd1/0x85f51a6b96716c25 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6730 expref: 51 pid: 24468 timeout: 8170 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051441.551799:0:6564:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000963efdd1/0x85f51a6b96716c25 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6730 expref: 51 pid: 24468 timeout: 8170 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051441.551833:0:6564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000963efdd1/0x85f51a6b96716c25 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x1e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6730 expref: 51 pid: 24468 timeout: 8170 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051441.551857:0:6564:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777051441.551861:0:6564:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777051441.551872:0:6564:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f6fa49c7/0x85f51a6b96716c2c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6737 expref: 50 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051441.551888:0:6564:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f6fa49c7/0x85f51a6b96716c2c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6737 expref: 50 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051441.551935:0:6564:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000f6fa49c7/0x85f51a6b96716c2c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6737 expref: 50 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051441.551954:0:6564:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94f42c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6564:1863365452653184:192.168.201.46@tcp:105: 00000100:00100000:0.0:1777051441.552034:0:6564:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d944ac0240 going to sleep for 11 seconds 00000100:00100000:3.0:1777051441.558531:0:6564:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94f42c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6564:1863365452653184:192.168.201.46@tcp:105: 00010000:00010000:3.0:1777051441.558574:0:6564:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1777051441.558679:0:6564:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da53b94450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+50:2437:x1863365426034816:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 6988us (7942us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051441.558701:0:6564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3920 00000040:00080000:2.0:1777051441.558918:0:104226:0:(llog.c:801:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1777051441.558929:0:104226:0:(llog_cat.c:158:llog_cat_process_common()) processing log [0x1:0x12:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1777051441.558967:0:104226:0:(llog.c:858:llog_process_thread()) stop processing plain [0x1:0x12:0x0] index 9 count 7 00000040:00080000:2.0:1777051441.558980:0:104226:0:(llog.c:858:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1777051441.589431:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051441.589548:0:8476:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426034944 00000100:00100000:2.0:1777051441.589564:0:8476:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426034944 00002000:00100000:2.0:1777051441.589656:0:8476:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x1e4:0x0] (0->1048575) req@ffff99d95fbaca80 x1863365426034944/t0(0) o4->c11b6966-0775-44d2-bdc6-c74c26eb2226@192.168.201.46@tcp:402/0 lens 488/0 e 0 to 0 dl 1777051452 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1777051441.589676:0:8476:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99d95fbaca80 with x1863365426034944 ext(0->1048575) 00002000:00010000:2.0:1777051441.589685:0:8476:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99d95fbaca80 00000100:00100000:2.0:1777051441.589774:0:8476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 1781 00000100:00100000:2.0:1777051441.589793:0:8476:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95fbaca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+50:2436:x1863365426034944:12345-192.168.201.46@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1777051441.617924:0:8476:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95fbaca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+52:2436:x1863365426034944:12345-192.168.201.46@tcp:4:lhsmtool_posix.0 Request processed in 28120us (28487us total) trans 4294968368 rc 0/0 00000100:00100000:2.0:1777051441.617948:0:8476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 1781 00002000:00100000:2.0:1777051441.617985:0:8476:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x1e4:0x0] (0->1048575) req@ffff99d95fbaca80 x1863365426034944/t4294968368(0) o4->c11b6966-0775-44d2-bdc6-c74c26eb2226@192.168.201.46@tcp:402/0 lens 488/448 e 0 to 0 dl 1777051452 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1777051441.618008:0:8476:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99d95fbaca80 with x1863365426034944 ext(0->1048575) 00002000:00010000:2.0:1777051441.618020:0:8476:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99d95fbaca80 00000100:00100000:1.0:1777051441.621130:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051441.621239:0:8492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426035072 00000100:00100000:0.0:1777051441.621254:0:8492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426035072 00000100:00100000:0.0:1777051441.621364:0:8492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112218 00000100:00100000:0.0:1777051441.621383:0:8492:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f169880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+32:138114:x1863365426035072:12345-192.168.201.46@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1777051441.625319:0:103159:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771182 is committed 00000001:00080000:1.0:1777051441.625347:0:103159:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771176 is committed 00000020:00080000:1.0:1777051441.625355:0:103159:0:(update_trans.c:1333:distribute_txn_batchid_cb()) lustre-MDT0000: 25769803778 batchid updated 00010000:00010000:0.0:1777051441.625401:0:3663:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99d944a3ea00/0x85f51a6b96716bf4 lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e3:0x7:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051441.625423:0:3663:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d944a3ea00/0x85f51a6b96716bf4 lrc: 2/0,0 mode: TXN/TXN res: [0x2000032e3:0x7:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051441.625438:0:3663:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d944a3ea00/0x85f51a6b96716bf4 lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e3:0x7:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1777051441.625448:0:103195:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 25769803778 00010000:00010000:0.0:1777051441.625450:0:3663:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d944a3ea00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:0.0:1777051441.625458:0:3663:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d944a3ea00/0x85f51a6b96716bf4 lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e3:0x7:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051441.625470:0:3663:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d944a3ea00/0x85f51a6b96716bf4 lrc: 4/0,0 mode: TXN/TXN res: [0x2000032e3:0x7:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1777051441.625471:0:103195:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 25769803778 00010000:00010000:0.0:1777051441.625497:0:3663:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e3:0x7:0x0].0x0 (ffff99d9413d0800) 00010000:00010000:0.0:1777051441.625501:0:3663:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1777051441.625507:0:3663:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d944a3ea00/0x85f51a6b96716bf4 lrc: 2/0,0 mode: --/TXN res: [0x2000032e3:0x7:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051441.625515:0:3663:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d944a3ea00/0x85f51a6b96716bf4 lrc: 0/0,0 mode: --/TXN res: [0x2000032e3:0x7:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051441.625675:0:8492:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f169880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+25:138114:x1863365426035072:12345-192.168.201.46@tcp:44:lhsmtool_posix.0 Request processed in 4293us (4546us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051441.625698:0:8492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112218 00000100:00100000:2.0:1777051441.629406:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051441.629475:0:27884:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426035200 00000100:00100000:0.0:1777051441.629485:0:27884:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426035200 00000100:00100000:0.0:1777051441.629540:0:27884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 8059 00000100:00100000:0.0:1777051441.629550:0:27884:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94e624380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+52:2437:x1863365426035200:12345-192.168.201.46@tcp:16:lhsmtool_posix.0 00000001:00080000:1.0:1777051441.632407:0:9540:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0001: transno 4294968368 is committed 00000001:00080000:1.0:1777051441.632427:0:9540:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0001: transno 4294968367 is committed 00000100:00100000:0.0:1777051441.632603:0:27884:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94e624380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+49:2437:x1863365426035200:12345-192.168.201.46@tcp:16:lhsmtool_posix.0 Request processed in 3051us (3198us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051441.632620:0:27884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 8059 00000100:00100000:0.0:1777051441.635828:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051441.635920:0:6581:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426035456 00000100:00100000:1.0:1777051441.635932:0:6581:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426035456 00000100:00100000:1.0:1777051441.636007:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112219 00000100:00100000:1.0:1777051441.636022:0:6581:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f42d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+25:138114:x1863365426035456:12345-192.168.201.46@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1777051441.636439:0:6581:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1777051441.636481:0:6581:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d944a3f000/0x85f51a6b96716c1e lrc: 0/0,0 mode: --/PR res: [0x2000032e3:0x7:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6729 expref: 25 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051441.636524:0:6581:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e3:0x7:0x0].0x0 (ffff99d9413d0800) 00010000:00010000:1.0:1777051441.636532:0:6581:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1777051441.636579:0:6581:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cec00/0x85f51a6b96716c33 lrc: 3/0,1 mode: --/PW res: [0x2000032e3:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051441.636601:0:6581:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cec00/0x85f51a6b96716c33 lrc: 3/0,1 mode: PW/PW res: [0x2000032e3:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051441.636616:0:6581:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cec00/0x85f51a6b96716c33 lrc: 3/0,1 mode: PW/PW res: [0x2000032e3:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1777051441.637072:0:6581:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000001083095b reply state 00000000bb58d29f transno 30064771183 ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cec00/0x85f51a6b96716c33 lrc: 3/0,1 mode: PW/PW res: [0x2000032e3:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051441.637094:0:6581:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cec00/0x85f51a6b96716c33 lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e3:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051441.637104:0:6581:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e3:0x7:0x0].0x0 (ffff99d9413d0800) 00010000:00010000:1.0:1777051441.637108:0:6581:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1777051441.637112:0:6581:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1777051441.637285:0:6581:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f42d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+26:138114:x1863365426035456:12345-192.168.201.46@tcp:36:lhsmtool_posix.0 Request processed in 1264us (1457us total) trans 30064771183 rc 0/0 00000100:00100000:1.0:1777051441.637298:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112219 00000100:00100000:1.0:1777051441.641077:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051441.641187:0:46497:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426035584 00000100:00100000:2.0:1777051441.641232:0:46497:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426035584 00000100:00100000:2.0:1777051441.641305:0:46497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112220 00000100:00100000:2.0:1777051441.641321:0:46497:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da445dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:c11b6966-0775-44d2-bdc6-c74c26eb2226+26:138114:x1863365426035584:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1777051441.641349:0:46497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051441.641371:0:46497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d944a3fe00/0x85f51a6b96716c3a lrc: 2/0,0 mode: --/CR res: [0x2000032e3:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b673e expref: -99 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051441.641436:0:46497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d944a3fe00/0x85f51a6b96716c3a lrc: 3/0,0 mode: CR/CR res: [0x2000032e3:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b673e expref: 27 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051441.641458:0:46497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d944a3fe00/0x85f51a6b96716c3a lrc: 3/0,0 mode: CR/CR res: [0x2000032e3:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b673e expref: 27 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051441.641510:0:46497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e3:0x7:0x0].0x0 (ffff99d9413d0800) 00010000:00010000:2.0:1777051441.641515:0:46497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1777051441.641520:0:46497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d944a3fe00, rc 0) 00000100:00100000:2.0:1777051441.641579:0:46497:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da445dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:c11b6966-0775-44d2-bdc6-c74c26eb2226+27:138114:x1863365426035584:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 Request processed in 263us (507us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051441.641589:0:46497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112220 00000100:00100000:3.0:1777051441.643711:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051441.644102:0:55805:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426035712 00000100:00100000:1.0:1777051441.644112:0:55805:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426035712 00000100:00100000:1.0:1777051441.644178:0:55805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 8060 00000100:00100000:1.0:1777051441.644193:0:55805:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95fbaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c11b6966-0775-44d2-bdc6-c74c26eb2226+49:2437:x1863365426035712:12345-192.168.201.46@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1777051441.644428:0:55805:0:(ofd_lvb.c:305:ofd_lvbo_update()) res: [0x2c0000401:0x1e4:0x0] updating lvb size from disk: 0 -> 1048576 00002000:00010000:1.0:1777051441.644434:0:55805:0:(ofd_lvb.c:312:ofd_lvbo_update()) res: [0x2c0000401:0x1e4:0x0] updating lvb mtime from disk: 0 -> 1777051430 00002000:00010000:1.0:1777051441.644438:0:55805:0:(ofd_lvb.c:318:ofd_lvbo_update()) res: [0x2c0000401:0x1e4:0x0] updating lvb atime from disk: 0 -> 1777051430 00002000:00010000:1.0:1777051441.644442:0:55805:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x2c0000401:0x1e4:0x0] updating lvb ctime from disk: 0 -> 1777051430 00002000:00010000:1.0:1777051441.644446:0:55805:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x2c0000401:0x1e4:0x0] updating lvb blocks from disk: 0 -> 2048 00000100:00100000:1.0:1777051441.644514:0:55805:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95fbaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c11b6966-0775-44d2-bdc6-c74c26eb2226+50:2437:x1863365426035712:12345-192.168.201.46@tcp:2:lhsmtool_posix.0 Request processed in 323us (803us total) trans 4294968369 rc 0/0 00000100:00100000:1.0:1777051441.644527:0:55805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 8060 00000100:00100000:0.0:1777051441.646652:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051441.646719:0:27882:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426035968 00000100:00100000:3.0:1777051441.646725:0:27882:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426035968 00000100:00100000:3.0:1777051441.647054:0:27882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112221 00000100:00100000:3.0:1777051441.647066:0:27882:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f42f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+27:138114:x1863365426035968:12345-192.168.201.46@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1777051441.647130:0:27882:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2c00/0x85f51a6b96716c41 lrc: 3/0,1 mode: --/PW res: [0x2000032e3:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051441.647153:0:27882:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3c00/0x85f51a6b96716bed lrc: 2/0,0 mode: PR/PR res: [0x2000032e3:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6714 expref: 27 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051441.647167:0:27882:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2c00/0x85f51a6b96716c41 lrc: 4/0,1 mode: --/PW res: [0x2000032e3:0x7:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051441.647261:0:27882:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3c00/0x85f51a6b96716bed lrc: 3/0,0 mode: PR/PR res: [0x2000032e3:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6714 expref: 27 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051441.647284:0:27882:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3c00/0x85f51a6b96716bed lrc: 4/0,0 mode: PR/PR res: [0x2000032e3:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6714 expref: 27 pid: 27882 timeout: 8170 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051441.647311:0:27882:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7fdf3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27882:1863365452653312:192.168.201.46@tcp:104: 00000100:00100000:2.0:1777051441.647498:0:27882:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d95cb329c0 going to sleep for 11 seconds 00000100:00100000:0.0:1777051441.650595:0:27882:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7fdf3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27882:1863365452653312:192.168.201.46@tcp:104: 00010000:00010000:0.0:1777051441.650630:0:27882:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2c00/0x85f51a6b96716c41 lrc: 3/0,1 mode: --/PW res: [0x2000032e3:0x7:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051441.652513:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051441.652952:0:9550:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426036096 00000100:00100000:1.0:1777051441.652962:0:9550:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426036096 00010000:00010000:1.0:1777051441.653010:0:9550:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3c00/0x85f51a6b96716bed lrc: 4/0,0 mode: PR/PR res: [0x2000032e3:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6714 expref: 28 pid: 27882 timeout: 8170 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051441.653067:0:9550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3921 00000100:00100000:1.0:1777051441.653425:0:9550:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f42ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+28:2437:x1863365426036096:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1777051441.653449:0:9550:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1777051441.653461:0:9550:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3c00/0x85f51a6b96716bed lrc: 4/0,0 mode: PR/PR res: [0x2000032e3:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6714 expref: 28 pid: 27882 timeout: 8170 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051441.653483:0:9550:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3c00/0x85f51a6b96716bed lrc: 3/0,0 mode: PR/PR res: [0x2000032e3:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6714 expref: 28 pid: 27882 timeout: 8170 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051441.653534:0:9550:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3c00/0x85f51a6b96716bed lrc: 0/0,0 mode: --/PR res: [0x2000032e3:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6714 expref: 28 pid: 27882 timeout: 8170 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051441.653559:0:9550:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e3:0x7:0x0].0x0 (ffff99d9413d0800) 00010000:00010000:1.0:1777051441.653567:0:9550:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2c00/0x85f51a6b96716c41 lrc: 3/0,1 mode: --/PW res: [0x2000032e3:0x7:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051441.653581:0:9550:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2c00/0x85f51a6b96716c41 lrc: 3/0,1 mode: PW/PW res: [0x2000032e3:0x7:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051441.653593:0:9550:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2c00/0x85f51a6b96716c41 lrc: 4/0,1 mode: PW/PW res: [0x2000032e3:0x7:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051441.653635:0:9550:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1777051441.653702:0:9550:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f42ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+27:2437:x1863365426036096:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 621us (1192us total) trans 0 rc 0/0 00010000:00010000:0.0:1777051441.653709:0:27882:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2c00/0x85f51a6b96716c41 lrc: 3/0,1 mode: PW/PW res: [0x2000032e3:0x7:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051441.653719:0:9550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3921 00010000:00010000:0.0:1777051441.653767:0:27882:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2c00/0x85f51a6b96716c41 lrc: 3/0,1 mode: PW/PW res: [0x2000032e3:0x7:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051441.653823:0:27882:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2c00/0x85f51a6b96716c41 lrc: 3/0,1 mode: PW/PW res: [0x2000032e3:0x7:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051441.653837:0:27882:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2c00/0x85f51a6b96716c41 lrc: 2/0,0 mode: PW/PW res: [0x2000032e3:0x7:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051441.653849:0:27882:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2c00/0x85f51a6b96716c41 lrc: 3/0,0 mode: PW/PW res: [0x2000032e3:0x7:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051441.653860:0:27882:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d9559a2c00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:0.0:1777051441.653868:0:27882:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2c00/0x85f51a6b96716c41 lrc: 3/0,0 mode: PW/PW res: [0x2000032e3:0x7:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051441.653898:0:27882:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2c00/0x85f51a6b96716c41 lrc: 4/0,0 mode: PW/PW res: [0x2000032e3:0x7:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051441.653916:0:27882:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e3:0x7:0x0].0x0 (ffff99d9413d0800) 00010000:00010000:0.0:1777051441.653921:0:27882:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1777051441.653927:0:27882:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2c00/0x85f51a6b96716c41 lrc: 2/0,0 mode: --/PW res: [0x2000032e3:0x7:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051441.653937:0:27882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2c00/0x85f51a6b96716c41 lrc: 0/0,0 mode: --/PW res: [0x2000032e3:0x7:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051441.654022:0:27882:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f42f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+26:138114:x1863365426035968:12345-192.168.201.46@tcp:55:lhsmtool_posix.0 Request processed in 6955us (7369us total) trans 0 rc -22/-22 00000100:00100000:0.0:1777051441.654036:0:27882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112221 00000100:00100000:0.0:1777051441.660425:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051441.660555:0:27887:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426036224 00000100:00100000:2.0:1777051441.660568:0:27887:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426036224 00000100:00100000:2.0:1777051441.660674:0:27887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 8061 00000100:00100000:2.0:1777051441.660692:0:27887:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f42d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c11b6966-0775-44d2-bdc6-c74c26eb2226+50:2436:x1863365426036224:12345-192.168.201.46@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1777051441.660794:0:27887:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000b5832184/0x85f51a6b96716c48 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x1e4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 27887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051441.660831:0:27887:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f6fa49c7/0x85f51a6b96716c2c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6737 expref: 50 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051441.660847:0:27887:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1777051441.660850:0:27887:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1777051441.660857:0:27887:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b5832184/0x85f51a6b96716c48 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x1e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 27887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051441.660912:0:27887:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f6fa49c7/0x85f51a6b96716c2c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6737 expref: 50 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051441.660938:0:27887:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f6fa49c7/0x85f51a6b96716c2c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6737 expref: 50 pid: 13320 timeout: 8170 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051441.660964:0:27887:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94e624a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:27887:1863365452653440:192.168.201.46@tcp:104: 00000100:00100000:2.0:1777051441.661088:0:27887:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d95cf51d80 going to sleep for 11 seconds 00000100:00100000:0.0:1777051441.665550:0:27887:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94e624a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:27887:1863365452653440:192.168.201.46@tcp:104: 00010000:00010000:0.0:1777051441.665594:0:27887:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b5832184/0x85f51a6b96716c48 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x1e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 27887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051441.667144:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051441.667259:0:24467:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426036352 00000100:00100000:1.0:1777051441.667270:0:24467:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426036352 00010000:00010000:1.0:1777051441.667322:0:24467:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f6fa49c7/0x85f51a6b96716c2c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6737 expref: 51 pid: 13320 timeout: 8170 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051441.667385:0:24467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3922 00000100:00100000:1.0:1777051441.667403:0:24467:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f42dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+51:2437:x1863365426036352:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1777051441.667425:0:24467:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1777051441.667461:0:24467:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f6fa49c7/0x85f51a6b96716c2c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6737 expref: 51 pid: 13320 timeout: 8170 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051441.667484:0:24467:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f6fa49c7/0x85f51a6b96716c2c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6737 expref: 51 pid: 13320 timeout: 8170 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051441.667544:0:24467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f6fa49c7/0x85f51a6b96716c2c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6737 expref: 51 pid: 13320 timeout: 8170 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051441.667571:0:24467:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051441.667574:0:24467:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051441.667582:0:24467:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b5832184/0x85f51a6b96716c48 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x1e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 27887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051441.667598:0:24467:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b5832184/0x85f51a6b96716c48 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x1e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 27887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051441.667646:0:24467:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1777051441.667695:0:27887:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b5832184/0x85f51a6b96716c48 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x1e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 27887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051441.667709:0:27887:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b5832184/0x85f51a6b96716c48 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x1e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 27887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051441.667724:0:24467:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f42dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+50:2437:x1863365426036352:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 323us (580us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051441.667768:0:24467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3922 00010000:00010000:0.0:1777051441.667769:0:27887:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000b5832184/0x85f51a6b96716c48 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x1e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 27887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051441.667793:0:27887:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b5832184/0x85f51a6b96716c48 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x1e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 27887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051441.667808:0:27887:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b5832184/0x85f51a6b96716c48 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 27887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051441.667821:0:27887:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d944a3f000 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:0.0:1777051441.667829:0:27887:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b5832184/0x85f51a6b96716c48 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 27887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051441.667845:0:27887:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b5832184/0x85f51a6b96716c48 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 27887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051441.667889:0:27887:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b5832184/0x85f51a6b96716c48 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x1e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 27887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051441.667903:0:27887:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b5832184/0x85f51a6b96716c48 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x1e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 27887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051441.667995:0:27887:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f42d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c11b6966-0775-44d2-bdc6-c74c26eb2226+49:2436:x1863365426036224:12345-192.168.201.46@tcp:1:lhsmtool_posix.0 Request processed in 7306us (7580us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051441.668010:0:27887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 8061 00000100:00100000:0.0:1777051441.670409:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051441.670553:0:21368:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426036608 00000100:00100000:2.0:1777051441.670562:0:21368:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426036608 00000100:00100000:2.0:1777051441.670964:0:21368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112222 00000100:00100000:2.0:1777051441.670981:0:21368:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f42ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+26:138114:x1863365426036608:12345-192.168.201.46@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1777051441.671090:0:21368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d944a3f600/0x85f51a6b96716c4f lrc: 3/0,1 mode: --/PW res: [0x2000032e3:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051441.671112:0:21368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d944a3f600/0x85f51a6b96716c4f lrc: 3/0,1 mode: PW/PW res: [0x2000032e3:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051441.671124:0:21368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d944a3f600/0x85f51a6b96716c4f lrc: 3/0,1 mode: PW/PW res: [0x2000032e3:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051441.671386:0:21368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99d944a3e800/0x85f51a6b96716c56 lrc: 3/0,1 mode: --/EX res: [0x2000032e3:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051441.671400:0:21368:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99d944a3fe00/0x85f51a6b96716c3a lrc: 2/0,0 mode: CR/CR res: [0x2000032e3:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b673e expref: 27 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051441.671409:0:21368:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d944a3e800/0x85f51a6b96716c56 lrc: 4/0,1 mode: --/EX res: [0x2000032e3:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051441.671443:0:21368:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99d944a3fe00/0x85f51a6b96716c3a lrc: 3/0,0 mode: CR/CR res: [0x2000032e3:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b673e expref: 27 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051441.671457:0:21368:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99d944a3fe00/0x85f51a6b96716c3a lrc: 4/0,0 mode: CR/CR res: [0x2000032e3:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b673e expref: 27 pid: 46497 timeout: 8170 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051441.671474:0:21368:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94e624e00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:21368:1863365452653568:192.168.201.46@tcp:104: 00000100:00100000:2.0:1777051441.671572:0:21368:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d95cf51240 going to sleep for 11 seconds 00000100:00100000:2.0:1777051441.677894:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051441.677906:0:21368:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94e624e00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:21368:1863365452653568:192.168.201.46@tcp:104: 00010000:00010000:1.0:1777051441.677946:0:21368:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99d944a3e800/0x85f51a6b96716c56 lrc: 3/0,1 mode: --/EX res: [0x2000032e3:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051441.677977:0:47827:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426036736 00000100:00100000:0.0:1777051441.677985:0:47827:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426036736 00010000:00010000:0.0:1777051441.678017:0:47827:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d944a3fe00/0x85f51a6b96716c3a lrc: 4/0,0 mode: CR/CR res: [0x2000032e3:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b673e expref: 28 pid: 46497 timeout: 8170 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051441.678056:0:47827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3923 00000100:00100000:0.0:1777051441.678068:0:47827:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94e627800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+28:2436:x1863365426036736:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1777051441.678086:0:47827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777051441.678096:0:47827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99d944a3fe00/0x85f51a6b96716c3a lrc: 4/0,0 mode: CR/CR res: [0x2000032e3:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b673e expref: 28 pid: 46497 timeout: 8170 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051441.678114:0:47827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99d944a3fe00/0x85f51a6b96716c3a lrc: 3/0,0 mode: CR/CR res: [0x2000032e3:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b673e expref: 28 pid: 46497 timeout: 8170 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051441.678141:0:47827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d944a3fe00/0x85f51a6b96716c3a lrc: 0/0,0 mode: --/CR res: [0x2000032e3:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b673e expref: 28 pid: 46497 timeout: 8170 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051441.678158:0:47827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e3:0x7:0x0].0x0 (ffff99d9413d0800) 00010000:00010000:0.0:1777051441.678163:0:47827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99d944a3e800/0x85f51a6b96716c56 lrc: 3/0,1 mode: --/EX res: [0x2000032e3:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051441.678172:0:47827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99d944a3e800/0x85f51a6b96716c56 lrc: 3/0,1 mode: EX/EX res: [0x2000032e3:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051441.678179:0:47827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d944a3e800/0x85f51a6b96716c56 lrc: 4/0,1 mode: EX/EX res: [0x2000032e3:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051441.678259:0:47827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1777051441.678288:0:21368:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99d944a3e800/0x85f51a6b96716c56 lrc: 3/0,1 mode: EX/EX res: [0x2000032e3:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051441.678302:0:21368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d944a3e800/0x85f51a6b96716c56 lrc: 3/0,1 mode: EX/EX res: [0x2000032e3:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051441.678323:0:47827:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94e627800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+27:2436:x1863365426036736:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 254us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051441.678342:0:47827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3923 00000001:00080000:1.0:1777051441.678412:0:21368:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 30064771184 00000001:00080000:1.0:1777051441.678565:0:21368:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 30064771185 00000001:00080000:1.0:1777051441.678618:0:21368:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 30064771186 00000100:00100000:1.0:1777051441.679021:0:21368:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da445ddc00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-mdtlov_UUID:21368:1863365452653696:0@lo:1000:mdt00_005.0 00000100:00100000:1.0:1777051441.679087:0:21368:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051441.679141:0:21368:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d956bdaa80 going to sleep for 11 seconds 00000100:00100000:0.0:1777051441.679178:0:6585:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452653696 00000100:00100000:0.0:1777051441.679187:0:6585:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452653696 00000100:00100000:0.0:1777051441.679269:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8222 00000100:00080000:1.0:1777051441.679276:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1777051441.679283:0:6585:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da445dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:21368:x1863365452653696:12345-0@lo:1000:mdt00_005.0 00000100:00100000:0.0:1777051441.679431:0:6585:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da445dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:21368:x1863365452653696:12345-0@lo:1000:mdt00_005.0 Request processed in 151us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051441.679443:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8222 00000100:00100000:1.0:1777051441.679497:0:21368:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da445ddc00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-mdtlov_UUID:21368:1863365452653696:0@lo:1000:mdt00_005.0 00000001:00080000:1.0:1777051441.679640:0:21368:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 30064771187 00000100:00100000:1.0:1777051441.679683:0:21368:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da445ddc00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-mdtlov_UUID:21368:1863365452653824:0@lo:1000:mdt00_005.0 00000100:00100000:1.0:1777051441.679711:0:21368:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051441.679769:0:21368:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d9597676c0 going to sleep for 11 seconds 00000100:00100000:2.0:1777051441.679803:0:46500:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452653824 00000100:00100000:2.0:1777051441.679811:0:46500:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452653824 00000100:00100000:2.0:1777051441.679862:0:46500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8223 00000100:00100000:2.0:1777051441.679872:0:46500:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da445df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+5:21368:x1863365452653824:12345-0@lo:1000:mdt00_005.0 00000100:00100000:2.0:1777051441.680182:0:46500:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da445df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+6:21368:x1863365452653824:12345-0@lo:1000:mdt00_005.0 Request processed in 309us (466us total) trans 4294968370 rc 0/0 00000100:00100000:1.0:1777051441.680189:0:21368:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da445ddc00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-mdtlov_UUID:21368:1863365452653824:0@lo:1000:mdt00_005.0 00000100:00100000:2.0:1777051441.680211:0:46500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8223 00000001:00080000:1.0:1777051441.680256:0:21368:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 30064771188 00010000:00010000:1.0:1777051441.680286:0:21368:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99d944a3e800/0x85f51a6b96716c56 lrc: 3/0,1 mode: EX/EX res: [0x2000032e3:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051441.680299:0:21368:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d944a3e800/0x85f51a6b96716c56 lrc: 2/0,0 mode: EX/EX res: [0x2000032e3:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051441.680365:0:21368:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d944a3e800/0x85f51a6b96716c56 lrc: 3/0,0 mode: EX/EX res: [0x2000032e3:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051441.680374:0:21368:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d944a3e800 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:1.0:1777051441.680381:0:21368:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d944a3e800/0x85f51a6b96716c56 lrc: 3/0,0 mode: EX/EX res: [0x2000032e3:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051441.680394:0:21368:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d944a3e800/0x85f51a6b96716c56 lrc: 4/0,0 mode: EX/EX res: [0x2000032e3:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051441.680410:0:21368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e3:0x7:0x0].0x0 (ffff99d9413d0800) 00010000:00010000:1.0:1777051441.680415:0:21368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1777051441.680419:0:21368:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d944a3e800/0x85f51a6b96716c56 lrc: 2/0,0 mode: --/EX res: [0x2000032e3:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051441.680429:0:21368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d944a3e800/0x85f51a6b96716c56 lrc: 0/0,0 mode: --/EX res: [0x2000032e3:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051441.680474:0:21368:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cfc00/0x85f51a6b96716b8b lrc: 3/0,1 mode: EX/EX res: [0x2000032e3:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051441.680483:0:21368:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cfc00/0x85f51a6b96716b8b lrc: 2/0,0 mode: EX/EX res: [0x2000032e3:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051441.680491:0:21368:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cfc00/0x85f51a6b96716b8b lrc: 3/0,0 mode: EX/EX res: [0x2000032e3:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051441.680497:0:21368:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da7d5cfc00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:1.0:1777051441.680501:0:21368:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cfc00/0x85f51a6b96716b8b lrc: 3/0,0 mode: EX/EX res: [0x2000032e3:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051441.680509:0:21368:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cfc00/0x85f51a6b96716b8b lrc: 4/0,0 mode: EX/EX res: [0x2000032e3:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051441.680521:0:21368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e3:0x6:0x0].0x0 (ffff99d94e6b6800) 00010000:00010000:1.0:1777051441.680524:0:21368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1777051441.680532:0:21368:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cea00/0x85f51a6b96716b92 lrc: 2/0,0 mode: --/CR res: [0x2000032e3:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b66ff expref: 31 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051441.680545:0:21368:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cea00/0x85f51a6b96716b92 lrc: 2/0,0 mode: CR/CR res: [0x2000032e3:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b66ff expref: 31 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051441.680556:0:21368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cea00/0x85f51a6b96716b92 lrc: 3/0,0 mode: CR/CR res: [0x2000032e3:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b66ff expref: 31 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051441.680592:0:21368:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cea00/0x85f51a6b96716b92 lrc: 3/0,0 mode: CR/CR res: [0x2000032e3:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b66ff expref: 31 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051441.680617:0:21368:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d944e10000 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:21368:1863365452653952:192.168.201.46@tcp:105: 00000100:00100000:1.0:1777051441.680692:0:21368:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d959767480 going to sleep for 11 seconds 00000100:00100000:1.0:1777051441.684670:0:21368:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d944e10000 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:21368:1863365452653952:192.168.201.46@tcp:105: 00010000:00010000:1.0:1777051441.684701:0:21368:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cfc00/0x85f51a6b96716b8b lrc: 2/0,0 mode: --/EX res: [0x2000032e3:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051441.684713:0:21368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cfc00/0x85f51a6b96716b8b lrc: 0/0,0 mode: --/EX res: [0x2000032e3:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051441.684790:0:21368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cf200/0x85f51a6b96716c5d lrc: 3/0,1 mode: --/EX res: [0x2000032e3:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051441.684807:0:21368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cf200/0x85f51a6b96716c5d lrc: 3/0,1 mode: EX/EX res: [0x2000032e3:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051441.684819:0:21368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cf200/0x85f51a6b96716c5d lrc: 3/0,1 mode: EX/EX res: [0x2000032e3:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051441.684831:0:21368:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cf200/0x85f51a6b96716c5d lrc: 3/0,1 mode: EX/EX res: [0x2000032e3:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051441.684838:0:21368:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cf200/0x85f51a6b96716c5d lrc: 2/0,0 mode: EX/EX res: [0x2000032e3:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051441.684847:0:21368:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cf200/0x85f51a6b96716c5d lrc: 3/0,0 mode: EX/EX res: [0x2000032e3:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051441.684864:0:21368:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da7d5cf200 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:1.0:1777051441.684868:0:21368:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cf200/0x85f51a6b96716c5d lrc: 3/0,0 mode: EX/EX res: [0x2000032e3:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051441.684878:0:21368:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cf200/0x85f51a6b96716c5d lrc: 4/0,0 mode: EX/EX res: [0x2000032e3:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051441.684906:0:21368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e3:0x6:0x0].0x0 (ffff99d94e6b6800) 00010000:00010000:1.0:1777051441.684910:0:21368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777051441.684915:0:21368:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cf200/0x85f51a6b96716c5d lrc: 2/0,0 mode: --/EX res: [0x2000032e3:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051441.684923:0:21368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cf200/0x85f51a6b96716c5d lrc: 0/0,0 mode: --/EX res: [0x2000032e3:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051441.684935:0:21368:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d944a3f600/0x85f51a6b96716c4f lrc: 3/0,1 mode: PW/PW res: [0x2000032e3:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051441.684943:0:21368:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d944a3f600/0x85f51a6b96716c4f lrc: 2/0,0 mode: PW/PW res: [0x2000032e3:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051441.684951:0:21368:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d944a3f600/0x85f51a6b96716c4f lrc: 3/0,0 mode: PW/PW res: [0x2000032e3:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051441.684957:0:21368:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d944a3f600 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:1.0:1777051441.684961:0:21368:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d944a3f600/0x85f51a6b96716c4f lrc: 3/0,0 mode: PW/PW res: [0x2000032e3:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051441.684969:0:21368:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d944a3f600/0x85f51a6b96716c4f lrc: 4/0,0 mode: PW/PW res: [0x2000032e3:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051441.684979:0:21368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e3:0x6:0x0].0x0 (ffff99d94e6b6800) 00010000:00010000:1.0:1777051441.684983:0:21368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1777051441.684986:0:21368:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d944a3f600/0x85f51a6b96716c4f lrc: 2/0,0 mode: --/PW res: [0x2000032e3:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051441.685002:0:21368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d944a3f600/0x85f51a6b96716c4f lrc: 0/0,0 mode: --/PW res: [0x2000032e3:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051441.685177:0:21368:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f42ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+31:138114:x1863365426036608:12345-192.168.201.46@tcp:57:lhsmtool_posix.0 Request processed in 14200us (14770us total) trans 30064771189 rc 0/0 00000100:00100000:1.0:1777051441.685192:0:21368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112222 00000020:00080000:1.0:1777051441.685200:0:21368:0:(tgt_main.c:783:tgt_ses_key_exit()) total 6 transactions per RPC 00000100:00100000:2.0:1777051441.685631:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000040:00080000:3.0:1777051441.686058:0:103189:0:(llog.c:801:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:3.0:1777051441.686066:0:103189:0:(llog_cat.c:158:llog_cat_process_common()) processing log [0x1:0x2b:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1777051441.686092:0:103189:0:(llog.c:858:llog_process_thread()) stop processing plain [0x1:0x2b:0x0] index 7 count 5 00000040:00080000:3.0:1777051441.686102:0:103189:0:(llog.c:858:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00000100:00100000:1.0:1777051441.686459:0:6582:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426036864 00000100:00100000:1.0:1777051441.686468:0:6582:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426036864 00000100:00100000:1.0:1777051441.686531:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3395 00000100:00100000:1.0:1777051441.686543:0:6582:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94e624700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+32:138111:x1863365426036864:12345-192.168.201.46@tcp:49:cat.0 00000100:00100000:1.0:1777051441.686703:0:6582:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94e624700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+32:138111:x1863365426036864:12345-192.168.201.46@tcp:49:cat.0 Request processed in 161us (1073us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051441.686715:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3395 00000100:00100000:2.0:1777051441.689565:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051441.689938:0:6583:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426037120 00000100:00100000:3.0:1777051441.689947:0:6583:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426037120 00000100:00100000:3.0:1777051441.690003:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3396 00000100:00100000:3.0:1777051441.690017:0:6583:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94e625500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+31:138114:x1863365426037120:12345-192.168.201.46@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1777051441.690380:0:6583:0:(mdd_object.c:4010:mdd_close()) Object [0x2000032e3:0x7:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1777051441.690438:0:6583:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 30064771190 00010000:00010000:3.0:1777051441.690480:0:6583:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2000/0x85f51a6b96716c64 lrc: 3/0,1 mode: --/PW res: [0x2000032e3:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6583 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051441.690500:0:6583:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2000/0x85f51a6b96716c64 lrc: 3/0,1 mode: PW/PW res: [0x2000032e3:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6583 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051441.690517:0:6583:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2000/0x85f51a6b96716c64 lrc: 3/0,1 mode: PW/PW res: [0x2000032e3:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6583 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051441.690528:0:6583:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2000/0x85f51a6b96716c64 lrc: 4/0,1 mode: PW/PW res: [0x2000032e3:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6583 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051441.690538:0:6583:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2000/0x85f51a6b96716c64 lrc: 4/0,1 mode: PW/PW res: [0x2000032e3:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6583 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051441.690546:0:6583:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2000/0x85f51a6b96716c64 lrc: 3/0,0 mode: PW/PW res: [0x2000032e3:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6583 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051441.690574:0:6583:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1777051441.690645:0:38719:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:3.0:1777051441.690658:0:6583:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94e625500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+33:138114:x1863365426037120:12345-192.168.201.46@tcp:35:lhsmtool_posix.0 Request processed in 643us (1094us total) trans 30064771191 rc 0/0 00010000:00010000:0.0:1777051441.690659:0:38719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2000/0x85f51a6b96716c64 lrc: 2/0,0 mode: PW/PW res: [0x2000032e3:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6583 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051441.690675:0:38719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d9559a2000 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:0.0:1777051441.690682:0:38719:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2000/0x85f51a6b96716c64 lrc: 2/0,0 mode: PW/PW res: [0x2000032e3:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6583 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051441.690693:0:38719:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2000/0x85f51a6b96716c64 lrc: 3/0,0 mode: PW/PW res: [0x2000032e3:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6583 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051441.690712:0:38719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e3:0x7:0x0].0x0 (ffff99d9413d0800) 00010000:00010000:0.0:1777051441.690716:0:38719:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1777051441.690723:0:38719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2000/0x85f51a6b96716c64 lrc: 1/0,0 mode: --/PW res: [0x2000032e3:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6583 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051441.690759:0:38719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2000/0x85f51a6b96716c64 lrc: 0/0,0 mode: --/PW res: [0x2000032e3:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6583 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051441.690778:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777051441.690782:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777051441.690787:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777051441.690858:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3396 00000020:00080000:3.0:1777051441.690866:0:6583:0:(tgt_main.c:783:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1777051441.690933:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051441.690966:0:24468:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426037248 00000100:00100000:0.0:1777051441.690973:0:24468:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426037248 00000100:00100000:0.0:1777051441.691098:0:24468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 8062 00000100:00100000:0.0:1777051441.691111:0:24468:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94e625880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+49:138111:x1863365426037248:12345-192.168.201.46@tcp:101:cat.0 00010000:00010000:0.0:1777051441.691126:0:24468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051441.691150:0:24468:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006e1d9467/0x85f51a6b96716c6b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x1e4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6745 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1777051441.691199:0:24468:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x1e4:0x0] initial LVB size: 1048576, mtime: 0x69eba726, atime: 0x69eba726, ctime: 0x69eba726, blocks: 0x800 00010000:00010000:0.0:1777051441.691229:0:24468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777051441.691233:0:24468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777051441.691247:0:24468:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006e1d9467/0x85f51a6b96716c6b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6745 expref: 50 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051441.691311:0:24468:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006e1d9467/0x85f51a6b96716c6b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6745 expref: 50 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051441.691329:0:24468:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d950704c00, rc 0) 00000100:00100000:0.0:1777051441.691382:0:24468:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94e625880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+50:138111:x1863365426037248:12345-192.168.201.46@tcp:101:cat.0 Request processed in 273us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051441.691392:0:24468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 8062 00000100:00100000:0.0:1777051441.697283:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051441.697374:0:46207:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426037376 00000100:00100000:1.0:1777051441.697386:0:46207:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426037376 00002000:00100000:1.0:1777051441.697447:0:46207:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x1e4:0x0] (0->1048575) req@ffff99d94f42ca80 x1863365426037376/t0(0) o3->2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp:402/0 lens 488/0 e 0 to 0 dl 1777051452 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1777051441.697464:0:46207:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99d94f42ca80 with x1863365426037376 ext(0->1048575) 00002000:00010000:1.0:1777051441.697484:0:46207:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99d94f42ca80 00000100:00100000:1.0:1777051441.697534:0:46207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 1782 00000100:00100000:1.0:1777051441.697548:0:46207:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f42ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+50:2436:x1863365426037376:12345-192.168.201.46@tcp:3:cat.0 00000100:00100000:1.0:1777051441.712057:0:46207:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f42ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+50:2436:x1863365426037376:12345-192.168.201.46@tcp:3:cat.0 Request processed in 14492us (14765us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1777051441.712080:0:46207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 1782 00002000:00100000:1.0:1777051441.712106:0:46207:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x1e4:0x0] (0->1048575) req@ffff99d94f42ca80 x1863365426037376/t0(0) o3->2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp:402/0 lens 488/440 e 0 to 0 dl 1777051452 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1777051441.712124:0:46207:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99d94f42ca80 with x1863365426037376 ext(0->1048575) 00002000:00010000:1.0:1777051441.712135:0:46207:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99d94f42ca80 00000100:00100000:3.0:1777051441.723399:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051441.723512:0:46199:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426037504 00000100:00100000:2.0:1777051441.723529:0:46199:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426037504 00002000:00100000:2.0:1777051441.723601:0:46199:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x1e4:0x0] (1048576->1052671) req@ffff99da7fdf3b80 x1863365426037504/t0(0) o3->2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp:402/0 lens 488/0 e 0 to 0 dl 1777051452 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1777051441.723617:0:46199:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99da7fdf3b80 with x1863365426037504 ext(1048576->1052671) 00002000:00010000:2.0:1777051441.723625:0:46199:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99da7fdf3b80 00000100:00100000:2.0:1777051441.723674:0:46199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 1783 00000100:00100000:2.0:1777051441.723688:0:46199:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fdf3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+50:2437:x1863365426037504:12345-192.168.201.46@tcp:3:cat.0 00000100:00100000:2.0:1777051441.724003:0:46199:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fdf3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+50:2437:x1863365426037504:12345-192.168.201.46@tcp:3:cat.0 Request processed in 316us (615us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051441.724014:0:46199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 1783 00002000:00100000:2.0:1777051441.724023:0:46199:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x1e4:0x0] (1048576->1052671) req@ffff99da7fdf3b80 x1863365426037504/t0(0) o3->2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp:402/0 lens 488/440 e 0 to 0 dl 1777051452 ref 1 fl Complete:/600/0 rc 0/0 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1777051441.724034:0:46199:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99da7fdf3b80 with x1863365426037504 ext(1048576->1052671) 00002000:00010000:2.0:1777051441.724039:0:46199:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99da7fdf3b80 00000100:00100000:3.0:1777051441.729638:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051441.730111:0:6582:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426037760 00000100:00100000:1.0:1777051441.730127:0:6582:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426037760 00000100:00100000:1.0:1777051441.730579:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3397 00000100:00100000:1.0:1777051441.730596:0:6582:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95aecc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+32:138111:x1863365426037760:12345-192.168.201.46@tcp:35:cat.0 00000100:00100000:1.0:1777051441.730958:0:6582:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95aecc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+33:138111:x1863365426037760:12345-192.168.201.46@tcp:35:cat.0 Request processed in 365us (1330us total) trans 30064771192 rc 0/0 00000100:00100000:1.0:1777051441.730971:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3397 00000100:00100000:1.0:1777051441.942570:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94f42e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452654080:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1777051441.942696:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051441.943065:0:11727:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452654080 00000100:00100000:0.0:1777051441.943078:0:11727:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452654080 00000100:00100000:0.0:1777051441.943181:0:11727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8224 00000100:00100000:0.0:1777051441.943237:0:11727:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d944e10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3677:x1863365452654080:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1777051441.943303:0:11727:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4194304 pending 0 free 1441509376 avail 1295269888 00000100:00100000:0.0:1777051441.943384:0:11727:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d944e10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3677:x1863365452654080:12345-0@lo:41:osp-pre-0-1.0 Request processed in 191us (689us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051441.943397:0:11727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8224 00000100:00100000:1.0:1777051441.943481:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94f42e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452654080:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1777051442.084536:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051442.084613:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051442.084673:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051442.084686:0:103166:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426037888 00000100:00100000:1.0:1777051442.084705:0:103166:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426037888 00000100:00100000:3.0:1777051442.084718:0:6579:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426038016 00000100:00100000:3.0:1777051442.084764:0:6579:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426038016 00000100:00100000:0.0:1777051442.084779:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051442.084827:0:8470:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426038144 00000100:00100000:2.0:1777051442.084839:0:8470:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426038144 00000100:00100000:0.0:1777051442.084852:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051442.084868:0:103166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 184 00000100:00100000:3.0:1777051442.084874:0:6579:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426038272 00000100:00100000:3.0:1777051442.084884:0:6579:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426038272 00000100:00100000:1.0:1777051442.084896:0:103166:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942d2a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29c4352d-3260-4734-909d-9ea5de9e7fa4+12:2437:x1863365426037888:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:2.0:1777051442.084920:0:8470:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426038400 00000100:00100000:2.0:1777051442.084929:0:8470:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426038400 00000100:00100000:3.0:1777051442.084955:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13411 00000100:00100000:3.0:1777051442.084973:0:6579:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f42df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+18:2436:x1863365426038016:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:0.0:1777051442.084993:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13412 00000100:00100000:2.0:1777051442.085003:0:8470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10455 00000100:00100000:0.0:1777051442.085021:0:6581:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f42e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+53:2436:x1863365426038272:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:2.0:1777051442.085030:0:8470:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f42d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+52:2437:x1863365426038144:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:1.0:1777051442.085033:0:103166:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942d2a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29c4352d-3260-4734-909d-9ea5de9e7fa4+12:2437:x1863365426037888:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 142us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051442.085057:0:103166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 184 00000100:00100000:3.0:1777051442.085066:0:6579:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f42df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+18:2436:x1863365426038016:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 96us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051442.085082:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13411 00000100:00080000:3.0:1777051442.085138:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1777051442.085147:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1777051442.085561:0:27884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10456 00000100:00100000:1.0:1777051442.085580:0:27884:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f42fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+52:2437:x1863365426038400:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:0.0:1777051442.085588:0:6581:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f42e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+53:2436:x1863365426038272:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 575us (735us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051442.085600:0:8470:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f42d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+52:2437:x1863365426038144:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 578us (923us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051442.085614:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13412 00000100:00100000:2.0:1777051442.085625:0:8470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10455 00000100:00100000:1.0:1777051442.085646:0:27884:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f42fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+52:2437:x1863365426038400:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 69us (866us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051442.085663:0:27884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10456 00010000:00010000:1.0:1777051442.262806:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777051442.454589:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94e624e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3679:1863365452654464:0@lo:400:kworker.0 00000100:00100000:1.0:1777051442.455044:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95aecca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3678:1863365452654208:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1777051442.455430:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051442.455492:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94e627100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3678:1863365452654336:0@lo:400:kworker.0 00000100:00100000:2.0:1777051442.455537:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94e624a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3680:1863365452654592:0@lo:400:kworker.0 00000100:00100000:1.0:1777051442.455561:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051442.455633:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f9bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3678:1863365452654848:0@lo:400:kworker.0 00000100:00100000:2.0:1777051442.455660:0:6585:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452654208 00000100:00100000:2.0:1777051442.455673:0:6585:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452654208 00000100:00100000:1.0:1777051442.455710:0:103168:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452654336 00000100:00100000:1.0:1777051442.455751:0:103168:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452654336 00000100:00100000:3.0:1777051442.455756:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051442.455796:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8225 00000100:00100000:2.0:1777051442.455818:0:6585:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d944e10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3678:x1863365452654208:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1777051442.455844:0:103168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1777051442.455864:0:103168:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942d29850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f9351a01-5b0e-4470-97fd-58b9b4b312a2+23:3678:x1863365452654336:12345-0@lo:400:kworker.0 00000004:00000024:2.0:1777051442.455872:0:6585:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4194304 pending 0 free 1446113280 avail 1299873792 00000100:00100000:2.0:1777051442.455968:0:6585:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d944e10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3678:x1863365452654208:12345-0@lo:41:osp-pre-1-0.0 Request processed in 159us (540us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051442.455980:0:103168:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942d29850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f9351a01-5b0e-4470-97fd-58b9b4b312a2+23:3678:x1863365452654336:12345-0@lo:400:kworker.0 Request processed in 120us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051442.455982:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8225 00000100:00100000:1.0:1777051442.456001:0:103168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1777051442.456055:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051442.456110:0:6580:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452654464 00000100:00100000:2.0:1777051442.456113:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f9bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3680:1863365452655104:0@lo:400:kworker.0 00000100:00100000:1.0:1777051442.456119:0:6580:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452654464 00000100:00100000:2.0:1777051442.456533:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051442.456571:0:6580:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452654592 00000100:00100000:1.0:1777051442.456579:0:6580:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452654592 00000100:00100000:2.0:1777051442.456594:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955506a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3680:1863365452655616:0@lo:400:kworker.0 00000100:00080000:0.0:1777051442.456641:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1777051442.456652:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13413 00000100:00100000:2.0:1777051442.456653:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1777051442.456654:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1777051442.456674:0:6580:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95aeced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3679:x1863365452654464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777051442.456688:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051442.456800:0:3680:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1777051442.456815:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f9bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3680:1863365452654976:0@lo:400:kworker.0 00000100:00100000:0.0:1777051442.456911:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955505880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3678:1863365452655360:0@lo:400:kworker.0 00000100:00100000:1.0:1777051442.456923:0:6580:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95aeced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3679:x1863365452654464:12345-0@lo:400:kworker.0 Request processed in 251us (1904us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051442.456934:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051442.456945:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13413 00000100:00100000:1.0:1777051442.456977:0:6580:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452654848 00000100:00100000:1.0:1777051442.456984:0:6580:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452654848 00000100:00100000:2.0:1777051442.456984:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955504a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3680:1863365452655488:0@lo:400:kworker.0 00000100:00100000:0.0:1777051442.456993:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051442.457042:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051442.457056:0:6580:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452655360 00000100:00100000:1.0:1777051442.457063:0:6580:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452655360 00000100:00100000:0.0:1777051442.457088:0:3678:0:(client.c:3101:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 8589934703 gen 2 00000004:00080000:0.0:1777051442.457099:0:3678:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 8589934703 committed transno 8589934703 00000100:00100000:2.0:1777051442.457119:0:46497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13414 00000100:00100000:1.0:1777051442.457132:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13415 00000100:00100000:2.0:1777051442.457141:0:46497:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955507800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:lustre-MDT0001-lwp-OST0000_UUID+5:3680:x1863365452654592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777051442.457153:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95aecca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3678:1863365452654208:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1777051442.457156:0:6580:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f42c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3678:x1863365452654848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777051442.457191:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94e627100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3678:1863365452654336:0@lo:400:kworker.0 00000100:00100000:1.0:1777051442.457549:0:6580:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f42c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3678:x1863365452654848:12345-0@lo:400:kworker.0 Request processed in 400us (863us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051442.457553:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f9bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3678:1863365452654848:0@lo:400:kworker.0 00000100:00100000:2.0:1777051442.457557:0:46497:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955507800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:lustre-MDT0001-lwp-OST0000_UUID+5:3680:x1863365452654592:12345-0@lo:400:kworker.0 Request processed in 421us (1499us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051442.457579:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13415 00000100:00100000:2.0:1777051442.457591:0:46497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13414 00000100:00100000:1.0:1777051442.457623:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13416 00000100:00100000:0.0:1777051442.457625:0:3678:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1777051442.457640:0:6580:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7cd9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3678:x1863365452655360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777051442.457648:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d944d2b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3678:1863365452654720:0@lo:400:kworker.0 00000100:00100000:2.0:1777051442.457651:0:8468:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452655104 00000100:00100000:0.0:1777051442.458508:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051442.458571:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955506300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3678:1863365452655232:0@lo:400:kworker.0 00000100:00100000:0.0:1777051442.458611:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051442.458648:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955507100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3678:1863365452655744:0@lo:400:kworker.0 00000100:00100000:0.0:1777051442.458682:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051442.458778:0:46494:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452654720 00000100:00100000:2.0:1777051442.458778:0:8468:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452655104 00000100:00100000:0.0:1777051442.458789:0:46494:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452654720 00000100:00100000:2.0:1777051442.458838:0:8468:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452655616 00000100:00100000:2.0:1777051442.458844:0:8468:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452655616 00000100:00100000:0.0:1777051442.458870:0:46494:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452655744 00000100:00100000:0.0:1777051442.458878:0:46494:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452655744 00000100:00100000:2.0:1777051442.458885:0:8468:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452655488 00000100:00100000:2.0:1777051442.458893:0:8468:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452655488 00000100:00100000:0.0:1777051442.458919:0:46494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13417 00000100:00100000:0.0:1777051442.458936:0:46494:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7cd9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000-lwp-OST0001_UUID+5:3678:x1863365452654720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777051442.458942:0:8468:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452655232 00000100:00100000:2.0:1777051442.458950:0:8468:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452655232 00000100:00100000:2.0:1777051442.459002:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10457 00000100:00100000:2.0:1777051442.459018:0:8468:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955504700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3680:x1863365452655104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777051442.459044:0:46494:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7cd9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000-lwp-OST0001_UUID+5:3678:x1863365452654720:12345-0@lo:400:kworker.0 Request processed in 92us (514us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051442.459057:0:46494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13417 00000100:00100000:0.0:1777051442.459090:0:46494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13418 00000100:00100000:0.0:1777051442.459103:0:46494:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7cd9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000-lwp-MDT0001_UUID+5:3678:x1863365452655744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777051442.459157:0:46494:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7cd9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000-lwp-MDT0001_UUID+5:3678:x1863365452655744:12345-0@lo:400:kworker.0 Request processed in 58us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051442.459166:0:46494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13418 00000100:00100000:2.0:1777051442.459214:0:8468:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955504700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3680:x1863365452655104:12345-0@lo:400:kworker.0 Request processed in 200us (2687us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051442.459222:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10457 00000100:00100000:2.0:1777051442.459242:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10458 00000100:00100000:2.0:1777051442.459249:0:8468:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955505180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3680:x1863365452655616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777051442.459280:0:8468:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955505180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3680:x1863365452655616:12345-0@lo:400:kworker.0 Request processed in 34us (2638us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051442.459286:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10458 00000100:00100000:2.0:1777051442.459318:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10459 00000100:00100000:2.0:1777051442.459330:0:8468:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955505f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3680:x1863365452655488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777051442.459370:0:8468:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955505f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3680:x1863365452655488:12345-0@lo:400:kworker.0 Request processed in 43us (2329us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051442.459378:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10459 00000100:00100000:2.0:1777051442.459396:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10460 00000100:00100000:2.0:1777051442.459406:0:8468:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7cd9ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3678:x1863365452655232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777051442.459444:0:8468:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7cd9ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3678:x1863365452655232:12345-0@lo:400:kworker.0 Request processed in 39us (833us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051442.459453:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10460 00000100:00100000:2.0:1777051442.459566:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94e624e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3679:1863365452654464:0@lo:400:kworker.0 00000100:00100000:0.0:1777051442.459572:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d944d2b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3678:1863365452654720:0@lo:400:kworker.0 00000100:00100000:0.0:1777051442.459598:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955506300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3678:1863365452655232:0@lo:400:kworker.0 00000100:00100000:0.0:1777051442.459616:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955507100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3678:1863365452655744:0@lo:400:kworker.0 00000100:00100000:2.0:1777051442.459644:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955504a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3680:1863365452655488:0@lo:400:kworker.0 00000100:00100000:2.0:1777051442.459661:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94e624a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3680:1863365452654592:0@lo:400:kworker.0 00000100:00100000:2.0:1777051442.459674:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f9bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3680:1863365452655104:0@lo:400:kworker.0 00000100:00100000:2.0:1777051442.459684:0:3680:0:(client.c:3101:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294968367 gen 2 00000004:00080000:2.0:1777051442.459690:0:3680:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 4294968367 committed transno 4294968367 00000100:00100000:2.0:1777051442.459708:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955506a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3680:1863365452655616:0@lo:400:kworker.0 00000100:00100000:0.0:1777051442.459765:0:6584:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452654976 00000100:00100000:0.0:1777051442.459773:0:6584:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452654976 00000100:00080000:2.0:1777051442.459816:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1777051442.459823:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1777051442.459827:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1777051442.459833:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1777051442.459840:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8226 00000100:00100000:0.0:1777051442.459860:0:6584:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955504000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3680:x1863365452654976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777051442.459860:0:6580:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7cd9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3678:x1863365452655360:12345-0@lo:400:kworker.0 Request processed in 2218us (2866us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051442.459885:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13416 00000100:00100000:0.0:1777051442.459944:0:6584:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955504000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3680:x1863365452654976:12345-0@lo:400:kworker.0 Request processed in 92us (3013us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051442.459957:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8226 00000100:00100000:2.0:1777051442.459960:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955505880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3678:1863365452655360:0@lo:400:kworker.0 00000100:00100000:1.0:1777051442.459986:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f9bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3680:1863365452654976:0@lo:400:kworker.0 00000100:00100000:2.0:1777051442.967083:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95aecc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452656000:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1777051442.967189:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051442.967307:0:8473:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452656000 00000100:00100000:3.0:1777051442.967322:0:8473:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452656000 00000100:00100000:3.0:1777051442.967411:0:8473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5670 00000100:00100000:3.0:1777051442.967438:0:8473:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955506a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3679:x1863365452656000:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1777051442.967485:0:8473:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 481844800 pending 0 free 3642707968 avail 3411185664 00000100:00100000:1.0:1777051442.967529:0:3677:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1777051442.967573:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955505880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452655872:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1777051442.967575:0:8473:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955506a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3679:x1863365452656000:12345-0@lo:13:osp-pre-1-1.0 Request processed in 142us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051442.967589:0:8473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5670 00000100:00100000:1.0:1777051442.967626:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051442.967650:0:8473:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452655872 00000100:00100000:3.0:1777051442.967657:0:8473:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452655872 00000100:00100000:3.0:1777051442.967705:0:8473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5671 00000100:00100000:3.0:1777051442.967771:0:8473:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d944e10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3677:x1863365452655872:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1777051442.967805:0:8473:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 484539968 pending 0 free 3861622784 avail 3630100480 00000100:00100000:3.0:1777051442.967887:0:8473:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d944e10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3677:x1863365452655872:12345-0@lo:13:osp-pre-0-1.0 Request processed in 120us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051442.967936:0:8473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5671 00000100:00100000:0.0:1777051442.968628:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955505880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452655872:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1777051442.968754:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95aecc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452656000:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1777051443.286614:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777051444.310625:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1777051444.504087:0:3679:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1777051444.504126:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95a581880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3677:1863365452656256:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1777051444.504150:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955504a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452656128:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1777051444.504255:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051444.504412:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051444.504457:0:10113:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452656256 00000100:00100000:1.0:1777051444.504468:0:10113:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452656256 00000100:00080000:0.0:1777051444.504547:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1777051444.504549:0:10113:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452656128 00000100:00100000:1.0:1777051444.504557:0:10113:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452656128 00000100:00100000:3.0:1777051444.504606:0:8473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5672 00000100:00100000:1.0:1777051444.504620:0:10113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5673 00000100:00100000:3.0:1777051444.504628:0:8473:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94ed2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3677:x1863365452656256:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1777051444.504643:0:10113:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95aecc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3679:x1863365452656128:12345-0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1777051444.504646:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:3.0:1777051444.504662:0:8473:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 484539968 pending 0 free 3861622784 avail 3630100480 00002000:00000024:1.0:1777051444.504671:0:10113:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 481844800 pending 0 free 3642707968 avail 3411185664 00000100:00100000:3.0:1777051444.504779:0:8473:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94ed2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3677:x1863365452656256:12345-0@lo:13:osp-pre-0-0.0 Request processed in 160us (528us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051444.504799:0:8473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5672 00000100:00100000:1.0:1777051444.504800:0:10113:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95aecc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3679:x1863365452656128:12345-0@lo:13:osp-pre-1-0.0 Request processed in 158us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051444.504817:0:10113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5673 00000100:00100000:1.0:1777051444.504892:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95a581880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3677:1863365452656256:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1777051444.505022:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955504a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452656128:0@lo:13:osp-pre-1-0.0 00000001:00080000:3.0:1777051445.017807:0:8464:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0000: transno 4294968366 is committed 00000001:00080000:3.0:1777051445.017822:0:8464:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0000: transno 4294968365 is committed 00000001:00080000:3.0:1777051445.017830:0:8464:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0000: transno 4294968364 is committed 00010000:00010000:0.0:1777051445.334511:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1777051445.534074:0:104205:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934719 is committed 00000001:00080000:3.0:1777051445.534125:0:104205:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934718 is committed 00000020:00080000:3.0:1777051445.534455:0:104205:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff99d956bda480 refcount 2 committed 0 result 0 batchid 4294970583 00000020:00080000:3.0:1777051445.534465:0:104205:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff99da7b3b0800 obd lustre-OST0001-osc-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff99d956bda900 00000020:00080000:3.0:1777051445.534471:0:104205:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff99da7b3b0b00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff99d9537d1e00 00000020:00080000:3.0:1777051445.534559:0:104205:0:(update_trans.c:1333:distribute_txn_batchid_cb()) lustre-MDT0001: 4294970582 batchid updated 00000020:00080000:1.0:1777051445.534564:0:104230:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 4294970583 committed batchid 4294970581 00000020:00080000:1.0:1777051445.535487:0:104230:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 4294970582 00010000:00010000:2.0:1777051445.535552:0:3664:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff99d950705600/0x85f51a6b96716aff lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd2:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051445.535573:0:3664:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d950705600/0x85f51a6b96716aff lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd2:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6579 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051445.535586:0:3664:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99d950705600/0x85f51a6b96716aff lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd2:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6579 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051445.535596:0:3664:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d950705600 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:2.0:1777051445.535604:0:3664:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d950705600/0x85f51a6b96716aff lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd2:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6579 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051445.535616:0:3664:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d950705600/0x85f51a6b96716aff lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd2:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6579 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051445.535639:0:3664:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x6:0x0].0x0 (ffff99da59dd4c00) 00010000:00010000:2.0:1777051445.535644:0:3664:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777051445.535664:0:3664:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99d950705600/0x85f51a6b96716aff lrc: 2/0,0 mode: --/TXN res: [0x240000bd2:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6579 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051445.535706:0:3664:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d950705600/0x85f51a6b96716aff lrc: 0/0,0 mode: --/TXN res: [0x240000bd2:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6579 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051446.359578:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777051446.493755:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051446.493894:0:46494:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426038528 00000100:00100000:0.0:1777051446.493911:0:46494:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426038528 00000100:00080000:1.0:1777051446.494425:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1777051446.498103:0:46494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112223 00000100:00100000:0.0:1777051446.498132:0:46494:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95aecca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c11b6966-0775-44d2-bdc6-c74c26eb2226+33:138009:x1863365426038528:12345-192.168.201.46@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1777051446.498342:0:46494:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95aecca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c11b6966-0775-44d2-bdc6-c74c26eb2226+33:138009:x1863365426038528:12345-192.168.201.46@tcp:60:lhsmtool_posix.0 Request processed in 219us (4702us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051446.498358:0:46494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112223 00000100:00100000:3.0:1777051446.503372:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051446.503473:0:27885:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426038656 00000100:00100000:0.0:1777051446.503483:0:27885:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426038656 00000100:00100000:0.0:1777051446.503557:0:27885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112224 00000100:00100000:0.0:1777051446.503570:0:27885:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95aecf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c11b6966-0775-44d2-bdc6-c74c26eb2226+8:138009:x1863365426038656:12345-192.168.201.46@tcp:60:lhsmtool_posix.0 00000100:00080000:1.0:1777051446.503601:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1777051446.504023:0:27885:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95aecf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c11b6966-0775-44d2-bdc6-c74c26eb2226+8:138009:x1863365426038656:12345-192.168.201.46@tcp:60:lhsmtool_posix.0 Request processed in 451us (653us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051446.504038:0:27885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112224 00000100:00100000:1.0:1777051446.508109:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051446.508266:0:24269:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426038912 00000100:00100000:2.0:1777051446.508277:0:24269:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426038912 00000100:00100000:2.0:1777051446.508404:0:24269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3398 00000100:00100000:2.0:1777051446.508421:0:24269:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da6ff01c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+33:138009:x1863365426038912:12345-192.168.201.46@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1777051446.509127:0:24269:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da6ff01c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+34:138009:x1863365426038912:12345-192.168.201.46@tcp:35:lhsmtool_posix.0 Request processed in 707us (1021us total) trans 30064771193 rc 0/0 00000100:00100000:2.0:1777051446.509142:0:24269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3398 00000100:00100000:2.0:1777051447.062617:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7cd9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452656384:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1777051447.062828:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051447.062957:0:47208:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452656384 00000100:00100000:1.0:1777051447.062971:0:47208:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452656384 00000100:00100000:1.0:1777051447.063057:0:47208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8227 00000100:00100000:1.0:1777051447.063071:0:47208:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955505500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+6:3678:x1863365452656384:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1777051447.063120:0:47208:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4194304 pending 0 free 1441509376 avail 1295269888 00000100:00100000:1.0:1777051447.063244:0:47208:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955505500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+6:3678:x1863365452656384:12345-0@lo:41:osp-pre-0-1.0 Request processed in 174us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051447.063260:0:47208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8227 00000100:00100000:2.0:1777051447.063344:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7cd9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452656384:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1777051447.203454:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051447.203515:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051447.203577:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051447.203626:0:103169:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426039040 00000100:00100000:2.0:1777051447.203637:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051447.203674:0:103169:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426039040 00000100:00100000:2.0:1777051447.203711:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051447.203760:0:8468:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426039552 00000100:00100000:1.0:1777051447.203769:0:103169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 186 00000100:00100000:2.0:1777051447.203770:0:8468:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426039552 00000100:00100000:1.0:1777051447.203794:0:103169:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942d28c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:29c4352d-3260-4734-909d-9ea5de9e7fa4+12:2436:x1863365426039040:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:2.0:1777051447.203842:0:8468:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426040064 00000100:00100000:2.0:1777051447.203849:0:8468:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426040064 00000100:00100000:2.0:1777051447.203899:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10461 00000100:00100000:1.0:1777051447.203903:0:103169:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942d28c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:29c4352d-3260-4734-909d-9ea5de9e7fa4+12:2436:x1863365426039040:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 110us (451us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051447.203918:0:8468:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955505c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+49:2436:x1863365426039552:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:1.0:1777051447.203946:0:103169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 186 00000100:00100000:2.0:1777051447.203983:0:8468:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955505c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+49:2436:x1863365426039552:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 68us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051447.203999:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10461 00000100:00080000:1.0:1777051447.204008:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1777051447.204022:0:13320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10462 00000100:00100000:3.0:1777051447.204044:0:13320:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955507b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+50:2436:x1863365426040064:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:1.0:1777051447.204069:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051447.204130:0:13320:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955507b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+50:2436:x1863365426040064:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 88us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051447.204146:0:13320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10462 00000100:00100000:0.0:1777051447.204170:0:27882:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426039296 00000100:00100000:0.0:1777051447.204179:0:27882:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426039296 00000100:00100000:0.0:1777051447.204457:0:27882:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426039808 00000100:00100000:0.0:1777051447.204469:0:27882:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426039808 00000100:00100000:2.0:1777051447.204557:0:8492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426039168 00000100:00100000:2.0:1777051447.204565:0:8492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426039168 00000100:00100000:3.0:1777051447.204590:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13419 00000100:00100000:1.0:1777051447.204609:0:10328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13420 00000100:00100000:3.0:1777051447.204614:0:6579:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955507480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+8:2436:x1863365426039296:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:1.0:1777051447.204635:0:10328:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955506d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+52:2436:x1863365426039808:12345-192.168.201.46@tcp:400:kworker.0 00000100:00080000:0.0:1777051447.204673:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1777051447.204723:0:6579:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955507480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+8:2436:x1863365426039296:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 119us (1205us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051447.204736:0:10328:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955506d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+52:2436:x1863365426039808:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 108us (1100us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051447.205015:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13419 00000100:00100000:1.0:1777051447.205039:0:10328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13420 00000100:00100000:2.0:1777051447.205196:0:8492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13421 00000100:00100000:2.0:1777051447.205444:0:8492:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94ed2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+34:2436:x1863365426039168:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:2.0:1777051447.205517:0:8492:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94ed2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+34:2436:x1863365426039168:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 77us (1448us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051447.205532:0:8492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13421 00000100:00100000:3.0:1777051447.208082:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051447.208180:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051447.208234:0:8471:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426039424 00000100:00100000:2.0:1777051447.208244:0:8471:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426039424 00000100:00100000:2.0:1777051447.208324:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10463 00000100:00100000:2.0:1777051447.208339:0:8471:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95aecc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+51:2436:x1863365426039424:12345-192.168.201.46@tcp:400:kworker.0 00000100:00080000:1.0:1777051447.208357:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1777051447.208392:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051447.208435:0:8471:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95aecc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+51:2436:x1863365426039424:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 95us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051447.208449:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10463 00000100:00100000:2.0:1777051447.208473:0:8471:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426039936 00000100:00100000:2.0:1777051447.208482:0:8471:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426039936 00000100:00100000:0.0:1777051447.208486:0:46497:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426039680 00000100:00100000:0.0:1777051447.208498:0:46497:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426039680 00000100:00100000:2.0:1777051447.208581:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10464 00000100:00100000:0.0:1777051447.208586:0:46497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13422 00000100:00100000:2.0:1777051447.208602:0:8471:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955ebca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+52:2436:x1863365426039936:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:0.0:1777051447.208614:0:46497:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955ebd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+33:2436:x1863365426039680:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:2.0:1777051447.208715:0:8471:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955ebca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+52:2436:x1863365426039936:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 118us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051447.208737:0:46497:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955ebd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+33:2436:x1863365426039680:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 121us (545us total) trans 0 rc 0/0 00000100:00080000:3.0:1777051447.208737:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1777051447.208739:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10464 00000100:00080000:3.0:1777051447.208750:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1777051447.208766:0:46497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13422 00010000:00010000:1.0:1777051447.382446:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1777051447.574403:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955ebc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3679:1863365452656512:0@lo:400:kworker.0 00000100:00100000:2.0:1777051447.574462:0:3678:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1777051447.574496:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955ebf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3678:1863365452656896:0@lo:400:kworker.0 00000100:00100000:2.0:1777051447.574613:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051447.574630:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051447.574672:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955ebf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3680:1863365452656640:0@lo:400:kworker.0 00000100:00100000:2.0:1777051447.574764:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955ebd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3678:1863365452656768:0@lo:400:kworker.0 00000100:00100000:3.0:1777051447.574768:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051447.574784:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955ebe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3679:1863365452657024:0@lo:400:kworker.0 00000100:00100000:3.0:1777051447.574827:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955ebd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3680:1863365452657152:0@lo:400:kworker.0 00000100:00100000:2.0:1777051447.574848:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051447.574925:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051447.574940:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955ebce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3678:1863365452657408:0@lo:400:kworker.0 00000100:00100000:1.0:1777051447.574941:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955ebfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3677:1863365452657280:0@lo:400:kworker.0 00000100:00100000:0.0:1777051447.574976:0:103166:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452656512 00000100:00100000:3.0:1777051447.574982:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955ebdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3680:1863365452657664:0@lo:400:kworker.0 00000100:00100000:0.0:1777051447.574991:0:103166:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452656512 00000100:00100000:2.0:1777051447.575026:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051447.575082:0:103166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1777051447.575099:0:103166:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942d28050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9351a01-5b0e-4470-97fd-58b9b4b312a2+23:3679:x1863365452656512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777051447.575148:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94f51aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3678:1863365452657920:0@lo:400:kworker.0 00000100:00100000:1.0:1777051447.575150:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051447.575278:0:103166:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942d28050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9351a01-5b0e-4470-97fd-58b9b4b312a2+23:3679:x1863365452656512:12345-0@lo:400:kworker.0 Request processed in 179us (649us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051447.575280:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94f51b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452657792:0@lo:400:kworker.0 00000100:00100000:2.0:1777051447.575297:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051447.575312:0:103166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1777051447.575350:0:6581:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452656896 00000100:00100000:3.0:1777051447.575361:0:6581:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452656896 00000100:00100000:1.0:1777051447.575371:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051447.575401:0:6585:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452657152 00000100:00100000:0.0:1777051447.575403:0:27885:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452656640 00000100:00100000:2.0:1777051447.575413:0:6585:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452657152 00000100:00100000:0.0:1777051447.575415:0:27885:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452656640 00000100:00100000:3.0:1777051447.575465:0:6581:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452656768 00000100:00100000:1.0:1777051447.575472:0:8468:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452657408 00000100:00100000:3.0:1777051447.575475:0:6581:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452656768 00000100:00100000:1.0:1777051447.575484:0:8468:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452657408 00000100:00100000:0.0:1777051447.575504:0:27885:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452657920 00000100:00100000:2.0:1777051447.575510:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8228 00000100:00100000:0.0:1777051447.575515:0:27885:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452657920 00000100:00100000:2.0:1777051447.575539:0:6585:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f51a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3680:x1863365452657152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051447.575560:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13423 00000100:00100000:1.0:1777051447.575565:0:8468:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452657280 00000100:00100000:1.0:1777051447.575576:0:8468:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452657280 00000100:00100000:3.0:1777051447.575586:0:6581:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955504a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3678:x1863365452656896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777051447.575589:0:27885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13424 00000100:00100000:0.0:1777051447.575618:0:27885:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f51b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000-lwp-OST0000_UUID+5:3680:x1863365452656640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777051447.575667:0:6585:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f51a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3680:x1863365452657152:12345-0@lo:400:kworker.0 Request processed in 102us (705us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051447.575685:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8228 00000100:00100000:3.0:1777051447.575726:0:6581:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955504a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3678:x1863365452656896:12345-0@lo:400:kworker.0 Request processed in 149us (1116us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051447.575744:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13423 00000100:00100000:0.0:1777051447.575753:0:27885:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f51b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000-lwp-OST0000_UUID+5:3680:x1863365452656640:12345-0@lo:400:kworker.0 Request processed in 144us (990us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051447.575768:0:27885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13424 00000100:00100000:3.0:1777051447.575786:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13425 00000100:00100000:3.0:1777051447.575804:0:6581:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955505880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3678:x1863365452656768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777051447.575809:0:27885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13426 00000100:00100000:0.0:1777051447.575833:0:27885:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955506300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000-lwp-MDT0001_UUID+5:3678:x1863365452657920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051447.575886:0:6581:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955505880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3678:x1863365452656768:12345-0@lo:400:kworker.0 Request processed in 85us (1039us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051447.575901:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13425 00000100:00100000:0.0:1777051447.575918:0:27885:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955506300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000-lwp-MDT0001_UUID+5:3678:x1863365452657920:12345-0@lo:400:kworker.0 Request processed in 89us (628us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051447.575932:0:27885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13426 00000100:00080000:3.0:1777051447.575942:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1777051447.575952:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1777051447.575957:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1777051447.575963:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1777051447.576325:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051447.576368:0:8468:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452657792 00000100:00100000:0.0:1777051447.576372:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955ebdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3679:1863365452657536:0@lo:400:kworker.0 00000100:00100000:1.0:1777051447.576380:0:8468:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452657792 00000100:00100000:2.0:1777051447.576397:0:27884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10465 00000100:00100000:2.0:1777051447.576423:0:27884:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955507100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+6:3678:x1863365452657408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777051447.576438:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051447.576474:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10466 00000100:00100000:1.0:1777051447.576498:0:8468:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94ed2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3677:x1863365452657280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777051447.576519:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955ebc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3679:1863365452656512:0@lo:400:kworker.0 00000100:00100000:0.0:1777051447.576556:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7cd9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452658048:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1777051447.578058:0:27884:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955507100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+6:3678:x1863365452657408:12345-0@lo:400:kworker.0 Request processed in 1644us (3032us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051447.578075:0:27884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10465 00000100:00100000:0.0:1777051447.578089:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051447.578112:0:8468:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94ed2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3677:x1863365452657280:12345-0@lo:400:kworker.0 Request processed in 1619us (2965us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051447.578124:0:27884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10467 00000100:00100000:1.0:1777051447.578441:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10466 00000100:00100000:0.0:1777051447.578465:0:46497:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452657024 00000100:00100000:0.0:1777051447.578475:0:46497:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452657024 00000100:00100000:1.0:1777051447.578499:0:6580:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452657536 00000100:00100000:1.0:1777051447.578511:0:6580:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452657536 00000100:00100000:0.0:1777051447.578559:0:46497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13427 00000100:00100000:0.0:1777051447.578580:0:46497:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7cd9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:lustre-MDT0001-lwp-OST0001_UUID+5:3679:x1863365452657024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051447.578589:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13428 00000100:00100000:3.0:1777051447.578613:0:6581:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7cd9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3679:x1863365452657536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777051447.578664:0:27884:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94ed2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3677:x1863365452657792:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1777051447.578665:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1777051447.578679:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1777051447.578708:0:46497:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7cd9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:lustre-MDT0001-lwp-OST0001_UUID+5:3679:x1863365452657024:12345-0@lo:400:kworker.0 Request processed in 133us (2379us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051447.578725:0:46497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13427 00000100:00100000:3.0:1777051447.578758:0:6581:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7cd9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3679:x1863365452657536:12345-0@lo:400:kworker.0 Request processed in 148us (2321us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051447.578777:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13428 00000100:00100000:2.0:1777051447.578782:0:27884:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94ed2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3677:x1863365452657792:12345-0@lo:400:kworker.0 Request processed in 637us (3414us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051447.578800:0:27884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10467 00000100:00100000:2.0:1777051447.578895:0:46498:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452658048 00000100:00100000:2.0:1777051447.578905:0:46498:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452658048 00000100:00100000:3.0:1777051447.578976:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955ebce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3678:1863365452657408:0@lo:400:kworker.0 00000100:00100000:2.0:1777051447.578977:0:46498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8229 00000100:00100000:2.0:1777051447.579000:0:46498:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7cd9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+6:3679:x1863365452658048:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1777051447.579013:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94f51aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3678:1863365452657920:0@lo:400:kworker.0 00000004:00000024:2.0:1777051447.579045:0:46498:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4194304 pending 0 free 1446113280 avail 1299873792 00000100:00100000:3.0:1777051447.579046:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955ebf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3678:1863365452656896:0@lo:400:kworker.0 00000100:00100000:3.0:1777051447.579079:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955ebd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3678:1863365452656768:0@lo:400:kworker.0 00000100:00100000:1.0:1777051447.579119:0:3677:0:(client.c:3101:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968366 gen 2 00000004:00080000:1.0:1777051447.579132:0:3677:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff99d95aecce00, transno 4294968366 00000100:00100000:1.0:1777051447.579502:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955ebfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3677:1863365452657280:0@lo:400:kworker.0 00000100:00100000:1.0:1777051447.579548:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94f51b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452657792:0@lo:400:kworker.0 00000100:00100000:2.0:1777051447.579703:0:46498:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7cd9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+6:3679:x1863365452658048:12345-0@lo:41:osp-pre-1-0.0 Request processed in 145us (1057us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051447.579724:0:46498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8229 00000100:00100000:0.0:1777051447.579744:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7cd9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452658048:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1777051447.579779:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955ebe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3679:1863365452657024:0@lo:400:kworker.0 00000100:00100000:0.0:1777051447.579814:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955ebdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3679:1863365452657536:0@lo:400:kworker.0 00000100:00100000:1.0:1777051447.579873:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051447.579955:0:8470:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452657664 00000100:00100000:1.0:1777051447.579964:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955ebf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3680:1863365452656640:0@lo:400:kworker.0 00000100:00100000:3.0:1777051447.579967:0:8470:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452657664 00000100:00100000:1.0:1777051447.580000:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955ebd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3680:1863365452657152:0@lo:400:kworker.0 00000100:00100000:1.0:1777051447.580079:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10468 00000100:00100000:1.0:1777051447.580101:0:8468:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94ed2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3680:x1863365452657664:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1777051447.580129:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1777051447.580243:0:8468:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94ed2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3680:x1863365452657664:12345-0@lo:400:kworker.0 Request processed in 106us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051447.580259:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10468 00000100:00100000:3.0:1777051447.580458:0:3680:0:(client.c:3101:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294968365 gen 2 00000004:00080000:3.0:1777051447.580468:0:3680:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 4294968365 committed transno 4294968365 00000100:00100000:3.0:1777051447.580501:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955ebdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3680:1863365452657664:0@lo:400:kworker.0 00000001:00080000:1.0:1777051447.583760:0:103159:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771193 is committed 00000001:00080000:1.0:1777051447.583775:0:103159:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771192 is committed 00000020:00080000:1.0:1777051447.583805:0:103159:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff99d956bdaf00 refcount 2 committed 0 result 0 batchid 25769803779 00000020:00080000:1.0:1777051447.583815:0:103159:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff99da6ff5b400 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff99d956bdaa80 00010000:00010000:2.0:1777051447.583841:0:3663:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cec00/0x85f51a6b96716c33 lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e3:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1777051447.583858:0:103159:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff99da6ff5b200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff99d942d89600 00010000:00010000:2.0:1777051447.583868:0:3663:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cec00/0x85f51a6b96716c33 lrc: 2/0,0 mode: TXN/TXN res: [0x2000032e3:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051447.583886:0:3663:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cec00/0x85f51a6b96716c33 lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e3:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051447.583900:0:3663:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da7d5cec00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:2.0:1777051447.583910:0:3663:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cec00/0x85f51a6b96716c33 lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e3:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051447.583934:0:3663:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cec00/0x85f51a6b96716c33 lrc: 4/0,0 mode: TXN/TXN res: [0x2000032e3:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051447.583963:0:3663:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e3:0x7:0x0].0x0 (ffff99d9413d0800) 00010000:00010000:2.0:1777051447.583971:0:3663:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777051447.583980:0:3663:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cec00/0x85f51a6b96716c33 lrc: 2/0,0 mode: --/TXN res: [0x2000032e3:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051447.583994:0:3663:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cec00/0x85f51a6b96716c33 lrc: 0/0,0 mode: --/TXN res: [0x2000032e3:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1777051447.583997:0:103195:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 25769803779 committed batchid 25769803778 00000020:00080000:3.0:1777051447.584072:0:103195:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 25769803778 00000001:00080000:1.0:1777051447.585414:0:9540:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0001: transno 4294968370 is committed 00000001:00080000:1.0:1777051447.585429:0:9540:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0001: transno 4294968369 is committed 00000040:00080000:3.0:1777051447.831457:0:103189:0:(llog.c:801:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:3.0:1777051447.831470:0:103189:0:(llog_cat.c:158:llog_cat_process_common()) processing log [0x1:0x2b:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1777051447.831563:0:103189:0:(llog.c:858:llog_process_thread()) stop processing plain [0x1:0x2b:0x0] index 7 count 5 00000040:00080000:3.0:1777051447.831576:0:103189:0:(llog.c:858:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00000001:02000400:1.0:1777051447.843030:0:107848:0:(debug.c:645:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-hsm test 406: attempting to migrate HSM archived files is safe ========================================================== 13:24:06 (1777051446) 00000100:00100000:3.0:1777051447.926049:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051447.926360:0:27882:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426040192 00000100:00100000:2.0:1777051447.926376:0:27882:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426040192 00000100:00100000:2.0:1777051447.926461:0:27882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112225 00000100:00100000:2.0:1777051447.926480:0:27882:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f51aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+32:138698:x1863365426040192:12345-192.168.201.46@tcp:101:lfs.0 00010000:00010000:2.0:1777051447.926507:0:27882:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051447.926533:0:27882:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d9418d3400/0x85f51a6b96716c72 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b674c expref: -99 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051447.926613:0:27882:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9418d3000/0x85f51a6b96716c79 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051447.926666:0:27882:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d9418d3000/0x85f51a6b96716c79 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051447.926688:0:27882:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d9418d3000/0x85f51a6b96716c79 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051447.926715:0:27882:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9418d3c00/0x85f51a6b96716c80 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x45e84fca bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051447.926728:0:27882:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d9418d3c00/0x85f51a6b96716c80 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x45e84fca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051447.926740:0:27882:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d9418d3c00/0x85f51a6b96716c80 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x45e84fca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051447.926804:0:27882:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9418d3000/0x85f51a6b96716c79 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051447.926816:0:27882:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9418d3000/0x85f51a6b96716c79 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051447.926826:0:27882:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d9418d3000/0x85f51a6b96716c79 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051447.926837:0:27882:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d9418d3000/0x85f51a6b96716c79 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051447.926847:0:27882:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d9418d3000 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:2.0:1777051447.926853:0:27882:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d9418d3000/0x85f51a6b96716c79 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051447.926864:0:27882:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d9418d3000/0x85f51a6b96716c79 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051447.926883:0:27882:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d9533ab000) 00010000:00010000:2.0:1777051447.926888:0:27882:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777051447.926894:0:27882:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d9418d3000/0x85f51a6b96716c79 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051447.926905:0:27882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d9418d3000/0x85f51a6b96716c79 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051447.926925:0:27882:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9418d3c00/0x85f51a6b96716c80 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x45e84fca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051447.926934:0:27882:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d9418d3c00/0x85f51a6b96716c80 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x45e84fca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051447.926943:0:27882:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d9418d3c00/0x85f51a6b96716c80 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x45e84fca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051447.926952:0:27882:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d9418d3c00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:2.0:1777051447.926956:0:27882:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d9418d3c00/0x85f51a6b96716c80 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x45e84fca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051447.926966:0:27882:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d9418d3c00/0x85f51a6b96716c80 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x45e84fca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051447.926978:0:27882:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x45e84fca (ffff99da617f5900) 00010000:00010000:2.0:1777051447.926982:0:27882:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777051447.926986:0:27882:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d9418d3c00/0x85f51a6b96716c80 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x45e84fca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051447.926995:0:27882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d9418d3c00/0x85f51a6b96716c80 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x45e84fca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051447.927043:0:27882:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9418d3400/0x85f51a6b96716c72 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b674c expref: 33 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051447.927059:0:27882:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d9533ab000) 00010000:00010000:2.0:1777051447.927064:0:27882:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777051447.927072:0:27882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d9418d3400/0x85f51a6b96716c72 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b674c expref: 33 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051447.927359:0:27882:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d9418d3400, rc 0) 00000100:00100000:2.0:1777051447.927435:0:27882:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f51aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+32:138698:x1863365426040192:12345-192.168.201.46@tcp:101:lfs.0 Request processed in 959us (1393us total) trans 0 rc 301/301 00000100:00100000:2.0:1777051447.927448:0:27882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112225 00000100:00100000:1.0:1777051447.935312:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051447.935505:0:21368:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426040448 00000100:00100000:2.0:1777051447.935514:0:21368:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426040448 00000100:00100000:2.0:1777051447.935571:0:21368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112226 00000100:00100000:2.0:1777051447.935587:0:21368:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94ed2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+32:138698:x1863365426040448:12345-192.168.201.46@tcp:36:lfs.0 00010000:00010000:2.0:1777051447.935666:0:21368:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777051447.935693:0:21368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2a400/0x85f51a6b9671621c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b63b7 expref: 32 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051447.935711:0:21368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d9533ab000) 00010000:00010000:2.0:1777051447.935715:0:21368:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1777051447.936058:0:21368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9418d2000/0x85f51a6b96716c87 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051447.936079:0:21368:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2a000/0x85f51a6b967162c4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b63e8 expref: 22 pid: 21368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051447.936457:0:21368:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d9418d2000/0x85f51a6b96716c87 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051447.936506:0:21368:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2a000/0x85f51a6b967162c4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b63e8 expref: 22 pid: 21368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051447.936539:0:21368:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2a000/0x85f51a6b967162c4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b63e8 expref: 22 pid: 21368 timeout: 8177 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051447.936595:0:21368:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95fbac000 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:21368:1863365452658176:192.168.201.46@tcp:104: 00000100:00100000:2.0:1777051447.936708:0:21368:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d959767f00 going to sleep for 11 seconds 00000100:00100000:2.0:1777051447.940119:0:21368:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95fbac000 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:21368:1863365452658176:192.168.201.46@tcp:104: 00010000:00010000:2.0:1777051447.940143:0:21368:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99d9418d2000/0x85f51a6b96716c87 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051447.941497:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051447.941854:0:6564:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426040576 00000100:00100000:3.0:1777051447.941862:0:6564:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426040576 00010000:00010000:3.0:1777051447.942048:0:6564:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2a000/0x85f51a6b967162c4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b63e8 expref: 23 pid: 21368 timeout: 8177 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051447.942103:0:6564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3924 00000100:00100000:3.0:1777051447.942118:0:6564:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94ed2c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+23:2439:x1863365426040576:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1777051447.942134:0:6564:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777051447.942144:0:6564:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2a000/0x85f51a6b967162c4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b63e8 expref: 23 pid: 21368 timeout: 8177 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051447.942164:0:6564:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2a000/0x85f51a6b967162c4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b63e8 expref: 23 pid: 21368 timeout: 8177 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051447.942188:0:6564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2a000/0x85f51a6b967162c4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b63e8 expref: 23 pid: 21368 timeout: 8177 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051447.942206:0:6564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d9533ab000) 00010000:00010000:3.0:1777051447.942213:0:6564:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff99d9418d2000/0x85f51a6b96716c87 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051447.942227:0:6564:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99d9418d2000/0x85f51a6b96716c87 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051447.942238:0:6564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d9418d2000/0x85f51a6b96716c87 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051447.942278:0:6564:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1777051447.942294:0:21368:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99d9418d2000/0x85f51a6b96716c87 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051447.942309:0:21368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d9418d2000/0x85f51a6b96716c87 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051447.942338:0:21368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9418d3400/0x85f51a6b96716c8e lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x45e84fca bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051447.942351:0:21368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d9418d3400/0x85f51a6b96716c8e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x45e84fca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051447.942359:0:6564:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94ed2c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+22:2439:x1863365426040576:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 241us (861us total) trans 0 rc 0/0 00010000:00010000:2.0:1777051447.942371:0:21368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d9418d3400/0x85f51a6b96716c8e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x45e84fca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051447.942381:0:6564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3924 00010000:00010000:2.0:1777051447.944027:0:21368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9418d3c00/0x85f51a6b96716c95 lrc: 3/0,1 mode: --/PW res: [0x2000032e2:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051447.944043:0:21368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d9418d3c00/0x85f51a6b96716c95 lrc: 3/0,1 mode: PW/PW res: [0x2000032e2:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051447.944055:0:21368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d9418d3c00/0x85f51a6b96716c95 lrc: 3/0,1 mode: PW/PW res: [0x2000032e2:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1777051447.944075:0:21368:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000d8c00543 reply state 0000000086fff0ae transno 30064771194 ns: mdt-lustre-MDT0000_UUID lock: ffff99d9418d3c00/0x85f51a6b96716c95 lrc: 3/0,1 mode: PW/PW res: [0x2000032e2:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051447.944090:0:21368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d9418d3c00/0x85f51a6b96716c95 lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e2:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051447.944099:0:21368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0x8:0x0].0x0 (ffff99da617f5300) 00010000:00010000:2.0:1777051447.944104:0:21368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1777051447.944108:0:21368:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1777051447.944114:0:21368:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000032e2:0x8:0x0]: returning size 4096 00010000:00010000:2.0:1777051447.944123:0:21368:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9418d2000/0x85f51a6b96716c87 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051447.944133:0:21368:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d9418d2000/0x85f51a6b96716c87 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051447.944141:0:21368:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d9418d2000/0x85f51a6b96716c87 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051447.944150:0:21368:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d9418d2000 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:2.0:1777051447.944155:0:21368:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d9418d2000/0x85f51a6b96716c87 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051447.944165:0:21368:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d9418d2000/0x85f51a6b96716c87 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051447.944177:0:21368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d9533ab000) 00010000:00010000:2.0:1777051447.944182:0:21368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777051447.944187:0:21368:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d9418d2000/0x85f51a6b96716c87 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051447.944226:0:21368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d9418d2000/0x85f51a6b96716c87 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1777051447.944241:0:21368:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000d8c00543 reply state 0000000086fff0ae transno 30064771194 ns: mdt-lustre-MDT0000_UUID lock: ffff99d9418d3400/0x85f51a6b96716c8e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x45e84fca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051447.944253:0:21368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d9418d3400/0x85f51a6b96716c8e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x45e84fca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051447.944262:0:21368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x45e84fca (ffff99da617f5900) 00010000:00010000:2.0:1777051447.944266:0:21368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1777051447.944268:0:21368:0:(service.c:177:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1777051447.944353:0:21368:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94ed2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+33:138698:x1863365426040448:12345-192.168.201.46@tcp:36:lfs.0 Request processed in 8769us (9046us total) trans 30064771194 rc 0/0 00000100:00100000:2.0:1777051447.944365:0:21368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112226 00000100:00100000:1.0:1777051447.984080:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051447.984435:0:6580:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426040704 00000100:00100000:3.0:1777051447.984453:0:6580:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426040704 00000100:00100000:3.0:1777051447.984517:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112227 00000100:00100000:3.0:1777051447.984517:0:6580:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94ed2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+22:138707:x1863365426040704:12345-192.168.201.46@tcp:101:mkdir.0 00010000:00010000:3.0:1777051447.984517:0:6580:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777051447.984517:0:6580:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3000/0x85f51a6b96716c9c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6753 expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051447.984753:0:6580:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2600/0x85f51a6b96716ca3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051447.984753:0:6580:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2600/0x85f51a6b96716ca3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051447.984753:0:6580:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2600/0x85f51a6b96716ca3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1777051447.984753:0:6580:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 12288 00000004:00200000:3.0:1777051447.984753:0:6580:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1777051447.984910:0:6580:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2600/0x85f51a6b96716ca3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051447.984910:0:6580:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3000/0x85f51a6b96716c9c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6753 expref: 24 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051447.984977:0:6580:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2600/0x85f51a6b96716ca3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6753 expref: 23 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051447.984993:0:6580:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d9533ab000) 00010000:00010000:3.0:1777051447.984998:0:6580:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1777051447.984998:0:6580:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d9559a2600, rc 0) 00000100:00100000:3.0:1777051447.985007:0:6580:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94ed2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+23:138707:x1863365426040704:12345-192.168.201.46@tcp:101:mkdir.0 Request processed in 490us (945us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051447.985007:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112227 00000100:00100000:2.0:1777051447.988933:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051447.989588:0:6581:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426040960 00000100:00100000:2.0:1777051447.989599:0:6581:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426040960 00000100:00100000:2.0:1777051447.989716:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112228 00000100:00100000:2.0:1777051447.989735:0:6581:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95fbac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+23:138707:x1863365426040960:12345-192.168.201.46@tcp:36:mkdir.0 00010000:00010000:2.0:1777051447.989802:0:6581:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777051447.989838:0:6581:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2600/0x85f51a6b96716ca3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6753 expref: 23 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051447.989870:0:6581:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d9533ab000) 00010000:00010000:2.0:1777051447.989879:0:6581:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1777051447.990082:0:6581:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95fbac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+22:138707:x1863365426040960:12345-192.168.201.46@tcp:36:mkdir.0 Request processed in 350us (1152us total) trans 0 rc -17/-17 00000100:00100000:2.0:1777051447.990112:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112228 00000100:00100000:2.0:1777051447.995503:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051447.995554:0:46494:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426041088 00000100:00100000:3.0:1777051447.995565:0:46494:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426041088 00000100:00100000:3.0:1777051447.995666:0:46494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112229 00000100:00100000:3.0:1777051447.995683:0:46494:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95fbace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c11b6966-0775-44d2-bdc6-c74c26eb2226+22:138707:x1863365426041088:12345-192.168.201.46@tcp:101:mkdir.0 00010000:00010000:3.0:1777051447.995703:0:46494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777051447.995728:0:46494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3000/0x85f51a6b96716caa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b675a expref: -99 pid: 46494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051447.995799:0:46494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3a00/0x85f51a6b96716cb1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051447.995819:0:46494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3a00/0x85f51a6b96716cb1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051447.995835:0:46494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3a00/0x85f51a6b96716cb1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1777051447.995881:0:46494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 12288 00000004:00200000:3.0:1777051447.995887:0:46494:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1777051447.995911:0:46494:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3a00/0x85f51a6b96716cb1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051447.995942:0:46494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3000/0x85f51a6b96716caa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b675a expref: 24 pid: 46494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051447.995966:0:46494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3a00/0x85f51a6b96716cb1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b675a expref: 23 pid: 46494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051447.995979:0:46494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d9533ab000) 00010000:00010000:3.0:1777051447.995984:0:46494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1777051447.995987:0:46494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d9559a3a00, rc 0) 00000100:00100000:3.0:1777051447.996045:0:46494:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95fbace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c11b6966-0775-44d2-bdc6-c74c26eb2226+23:138707:x1863365426041088:12345-192.168.201.46@tcp:101:mkdir.0 Request processed in 368us (546us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051447.996055:0:46494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112229 00000100:00100000:1.0:1777051448.000053:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051448.000341:0:6579:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426041216 00000100:00100000:3.0:1777051448.000351:0:6579:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426041216 00000100:00080000:2.0:1777051448.000428:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1777051448.000436:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112230 00000100:00100000:3.0:1777051448.000450:0:6579:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95a581880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+23:138707:x1863365426041216:12345-192.168.201.46@tcp:101:mkdir.0 00010000:00010000:3.0:1777051448.000466:0:6579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777051448.000483:0:6579:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3800/0x85f51a6b96716cb8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6761 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051448.000543:0:6579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2800/0x85f51a6b96716cbf lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051448.000561:0:6579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2800/0x85f51a6b96716cbf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051448.000584:0:6579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2800/0x85f51a6b96716cbf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051448.000602:0:6579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2a00/0x85f51a6b96716cc6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x45e84fca bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051448.000613:0:6579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2a00/0x85f51a6b96716cc6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x45e84fca bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051448.000624:0:6579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2a00/0x85f51a6b96716cc6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x45e84fca bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051448.001111:0:6579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2200/0x85f51a6b96716ccd lrc: 3/1,0 mode: --/PR res: [0x2000032e2:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051448.001127:0:6579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2200/0x85f51a6b96716ccd lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0x8:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051448.001141:0:6579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2200/0x85f51a6b96716ccd lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0x8:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1777051448.001183:0:6579:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000032e2:0x8:0x0]: returning size 4096 00000004:00200000:3.0:1777051448.001189:0:6579:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1777051448.001246:0:6579:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2200/0x85f51a6b96716ccd lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0x8:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051448.001264:0:6579:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2800/0x85f51a6b96716cbf lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051448.001275:0:6579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2800/0x85f51a6b96716cbf lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051448.001293:0:6579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2800/0x85f51a6b96716cbf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051448.001304:0:6579:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2800/0x85f51a6b96716cbf lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051448.001315:0:6579:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d9559a2800 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:3.0:1777051448.001322:0:6579:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2800/0x85f51a6b96716cbf lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051448.001334:0:6579:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2800/0x85f51a6b96716cbf lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051448.001349:0:6579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d9533ab000) 00010000:00010000:3.0:1777051448.001354:0:6579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777051448.001361:0:6579:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2800/0x85f51a6b96716cbf lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051448.001374:0:6579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2800/0x85f51a6b96716cbf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051448.001399:0:6579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2a00/0x85f51a6b96716cc6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x45e84fca bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051448.001411:0:6579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2a00/0x85f51a6b96716cc6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x45e84fca bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051448.001418:0:6579:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2a00/0x85f51a6b96716cc6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x45e84fca bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051448.001424:0:6579:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d9559a2a00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:3.0:1777051448.001428:0:6579:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2a00/0x85f51a6b96716cc6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x45e84fca bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051448.001435:0:6579:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2a00/0x85f51a6b96716cc6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x45e84fca bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051448.001444:0:6579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x45e84fca (ffff99da617f5900) 00010000:00010000:3.0:1777051448.001446:0:6579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777051448.001449:0:6579:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2a00/0x85f51a6b96716cc6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x45e84fca bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051448.001455:0:6579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2a00/0x85f51a6b96716cc6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x45e84fca bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051448.001484:0:6579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3800/0x85f51a6b96716cb8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6761 expref: 25 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051448.001498:0:6579:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2200/0x85f51a6b96716ccd lrc: 3/0,0 mode: PR/PR res: [0x2000032e2:0x8:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6761 expref: 24 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051448.001507:0:6579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0x8:0x0].0x0 (ffff99da617f5300) 00010000:00010000:3.0:1777051448.001510:0:6579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1777051448.001513:0:6579:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d9559a2200, rc 0) 00000100:00100000:3.0:1777051448.001573:0:6579:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95a581880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+24:138707:x1863365426041216:12345-192.168.201.46@tcp:101:mkdir.0 Request processed in 1124us (1525us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051448.001584:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112230 00000100:00100000:2.0:1777051448.014025:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051448.014107:0:10328:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426041344 00000100:00100000:1.0:1777051448.014118:0:10328:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426041344 00000100:00100000:1.0:1777051448.014182:0:10328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112231 00000100:00100000:1.0:1777051448.014506:0:10328:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fdf2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+24:138708:x1863365426041344:12345-192.168.201.46@tcp:101:rm.0 00010000:00010000:1.0:1777051448.014536:0:10328:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777051448.014566:0:10328:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cee00/0x85f51a6b96716cd4 lrc: 2/0,0 mode: --/CR res: [0x2000032e2:0x8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6768 expref: -99 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051448.014695:0:10328:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce200/0x85f51a6b96716cdb lrc: 3/1,0 mode: --/CR res: [0x2000032e2:0x8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051448.014719:0:10328:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce200/0x85f51a6b96716cdb lrc: 3/1,0 mode: CR/CR res: [0x2000032e2:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051448.015025:0:10328:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce200/0x85f51a6b96716cdb lrc: 3/1,0 mode: CR/CR res: [0x2000032e2:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051448.015053:0:10328:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce800/0x85f51a6b96716ce2 lrc: 3/1,0 mode: --/PR res: [0x2000032e2:0x8:0x0].0x15f59727 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051448.015065:0:10328:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce800/0x85f51a6b96716ce2 lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0x8:0x0].0x15f59727 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051448.015073:0:10328:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce800/0x85f51a6b96716ce2 lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0x8:0x0].0x15f59727 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051448.015118:0:10328:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce200/0x85f51a6b96716cdb lrc: 4/1,0 mode: CR/CR res: [0x2000032e2:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051448.015129:0:10328:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce200/0x85f51a6b96716cdb lrc: 4/1,0 mode: CR/CR res: [0x2000032e2:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051448.015140:0:10328:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce200/0x85f51a6b96716cdb lrc: 3/0,0 mode: CR/CR res: [0x2000032e2:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051448.015157:0:10328:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce200/0x85f51a6b96716cdb lrc: 4/0,0 mode: CR/CR res: [0x2000032e2:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051448.015167:0:10328:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da7d5ce200 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:1.0:1777051448.015174:0:10328:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce200/0x85f51a6b96716cdb lrc: 4/0,0 mode: CR/CR res: [0x2000032e2:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051448.015185:0:10328:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce200/0x85f51a6b96716cdb lrc: 5/0,0 mode: CR/CR res: [0x2000032e2:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051448.015255:0:10328:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0x8:0x0].0x0 (ffff99da617f5300) 00010000:00010000:1.0:1777051448.015262:0:10328:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777051448.015270:0:10328:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce200/0x85f51a6b96716cdb lrc: 3/0,0 mode: --/CR res: [0x2000032e2:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051448.015283:0:10328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce200/0x85f51a6b96716cdb lrc: 0/0,0 mode: --/CR res: [0x2000032e2:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051448.015301:0:10328:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce800/0x85f51a6b96716ce2 lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0x8:0x0].0x15f59727 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051448.015312:0:10328:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce800/0x85f51a6b96716ce2 lrc: 2/0,0 mode: PR/PR res: [0x2000032e2:0x8:0x0].0x15f59727 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051448.015325:0:10328:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce800/0x85f51a6b96716ce2 lrc: 3/0,0 mode: PR/PR res: [0x2000032e2:0x8:0x0].0x15f59727 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051448.015336:0:10328:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da7d5ce800 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:1.0:1777051448.015342:0:10328:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce800/0x85f51a6b96716ce2 lrc: 3/0,0 mode: PR/PR res: [0x2000032e2:0x8:0x0].0x15f59727 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051448.015361:0:10328:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce800/0x85f51a6b96716ce2 lrc: 4/0,0 mode: PR/PR res: [0x2000032e2:0x8:0x0].0x15f59727 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051448.015375:0:10328:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0x8:0x0].0x15f59727 (ffff99d94e6b6400) 00010000:00010000:1.0:1777051448.015379:0:10328:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777051448.015384:0:10328:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce800/0x85f51a6b96716ce2 lrc: 2/0,0 mode: --/PR res: [0x2000032e2:0x8:0x0].0x15f59727 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051448.015394:0:10328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce800/0x85f51a6b96716ce2 lrc: 0/0,0 mode: --/PR res: [0x2000032e2:0x8:0x0].0x15f59727 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051448.015442:0:10328:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cee00/0x85f51a6b96716cd4 lrc: 1/0,0 mode: --/CR res: [0x2000032e2:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6768 expref: 25 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051448.015458:0:10328:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0x8:0x0].0x0 (ffff99da617f5300) 00010000:00010000:1.0:1777051448.015462:0:10328:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777051448.015468:0:10328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cee00/0x85f51a6b96716cd4 lrc: 0/0,0 mode: --/CR res: [0x2000032e2:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6768 expref: 25 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051448.015483:0:10328:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99da7d5cee00, rc 0) 00000100:00100000:1.0:1777051448.015559:0:10328:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fdf2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+24:138708:x1863365426041344:12345-192.168.201.46@tcp:101:rm.0 Request processed in 1363us (1542us total) trans 0 rc 301/301 00000100:00100000:1.0:1777051448.015573:0:10328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112231 00000100:00100000:2.0:1777051448.029166:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051448.029253:0:6580:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426041600 00000100:00100000:3.0:1777051448.029265:0:6580:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426041600 00000100:00100000:0.0:1777051448.029401:0:46497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112232 00000100:00100000:0.0:1777051448.029423:0:46497:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d956129180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:c11b6966-0775-44d2-bdc6-c74c26eb2226+24:138709:x1863365426041600:12345-192.168.201.46@tcp:101:dd.0 00010000:00010000:0.0:1777051448.029447:0:46497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051448.029452:0:46497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1777051448.029480:0:46497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2200/0x85f51a6b96716ccd lrc: 0/0,0 mode: --/PR res: [0x2000032e2:0x8:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6761 expref: 24 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051448.029526:0:46497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0x8:0x0].0x0 (ffff99da617f5300) 00010000:00010000:0.0:1777051448.029535:0:46497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1777051448.029554:0:46497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d950704800/0x85f51a6b96716ce9 lrc: 2/0,0 mode: --/CW res: [0x2000032e2:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b676f expref: -99 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051448.029710:0:46497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950705a00/0x85f51a6b96716cf0 lrc: 3/0,1 mode: --/CW res: [0x2000032e2:0x8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051448.029730:0:46497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d950705a00/0x85f51a6b96716cf0 lrc: 3/0,1 mode: CW/CW res: [0x2000032e2:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051448.029744:0:46497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d950705a00/0x85f51a6b96716cf0 lrc: 3/0,1 mode: CW/CW res: [0x2000032e2:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051448.030051:0:46497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950705e00/0x85f51a6b96716cf7 lrc: 3/0,1 mode: --/PW res: [0x2000032e2:0x8:0x0].0x15f59727 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051448.030065:0:46497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d950705e00/0x85f51a6b96716cf7 lrc: 3/0,1 mode: PW/PW res: [0x2000032e2:0x8:0x0].0x15f59727 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051448.030077:0:46497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d950705e00/0x85f51a6b96716cf7 lrc: 3/0,1 mode: PW/PW res: [0x2000032e2:0x8:0x0].0x15f59727 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1777051448.030590:0:46497:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x1e5:0x0], index 0: 0 00010000:00010000:0.0:1777051448.031153:0:46497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950704a00/0x85f51a6b96716cfe lrc: 3/1,0 mode: --/PR res: [0x2000032e3:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051448.031170:0:46497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d950704a00/0x85f51a6b96716cfe lrc: 3/1,0 mode: PR/PR res: [0x2000032e3:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051448.031184:0:46497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d950704a00/0x85f51a6b96716cfe lrc: 3/1,0 mode: PR/PR res: [0x2000032e3:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051448.031277:0:46497:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950705a00/0x85f51a6b96716cf0 lrc: 4/0,1 mode: CW/CW res: [0x2000032e2:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051448.031288:0:46497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950705a00/0x85f51a6b96716cf0 lrc: 4/0,1 mode: CW/CW res: [0x2000032e2:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051448.031295:0:46497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d950705a00/0x85f51a6b96716cf0 lrc: 3/0,0 mode: CW/CW res: [0x2000032e2:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051448.031303:0:46497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d950705a00/0x85f51a6b96716cf0 lrc: 4/0,0 mode: CW/CW res: [0x2000032e2:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051448.031309:0:46497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d950705a00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:0.0:1777051448.031313:0:46497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d950705a00/0x85f51a6b96716cf0 lrc: 4/0,0 mode: CW/CW res: [0x2000032e2:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051448.031321:0:46497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d950705a00/0x85f51a6b96716cf0 lrc: 5/0,0 mode: CW/CW res: [0x2000032e2:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051448.031336:0:46497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0x8:0x0].0x0 (ffff99da617f5300) 00010000:00010000:0.0:1777051448.031340:0:46497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777051448.031344:0:46497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d950705a00/0x85f51a6b96716cf0 lrc: 3/0,0 mode: --/CW res: [0x2000032e2:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051448.031351:0:46497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d950705a00/0x85f51a6b96716cf0 lrc: 0/0,0 mode: --/CW res: [0x2000032e2:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1777051448.031362:0:46497:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000004c142149 reply state 0000000085098339 transno 30064771195 ns: mdt-lustre-MDT0000_UUID lock: ffff99d950705e00/0x85f51a6b96716cf7 lrc: 3/0,1 mode: PW/PW res: [0x2000032e2:0x8:0x0].0x15f59727 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051448.031373:0:46497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d950705e00/0x85f51a6b96716cf7 lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e2:0x8:0x0].0x15f59727 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051448.031380:0:46497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0x8:0x0].0x15f59727 (ffff99da5fb45700) 00010000:00010000:0.0:1777051448.031383:0:46497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1777051448.031385:0:46497:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1777051448.031413:0:46497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d950704800/0x85f51a6b96716ce9 lrc: 0/0,0 mode: --/CW res: [0x2000032e2:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b676f expref: 26 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051448.031429:0:46497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950704a00/0x85f51a6b96716cfe lrc: 3/0,0 mode: PR/PR res: [0x2000032e3:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b676f expref: 25 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051448.031437:0:46497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e3:0x9:0x0].0x0 (ffff99da5fb45c00) 00010000:00010000:0.0:1777051448.031440:0:46497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1777051448.031442:0:46497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d950704a00, rc 0) 00000100:00100000:0.0:1777051448.031502:0:46497:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d956129180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:c11b6966-0775-44d2-bdc6-c74c26eb2226+26:138709:x1863365426041600:12345-192.168.201.46@tcp:101:dd.0 Request processed in 2088us (2343us total) trans 30064771195 rc 0/0 00000100:00100000:0.0:1777051448.031511:0:46497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112232 00000100:00100000:0.0:1777051448.065797:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051448.065932:0:8471:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426041728 00000100:00100000:2.0:1777051448.065947:0:8471:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426041728 00000100:00100000:2.0:1777051448.066041:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 8063 00000100:00100000:2.0:1777051448.066060:0:8471:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7cd9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+51:138709:x1863365426041728:12345-192.168.201.46@tcp:101:dd.0 00010000:00010000:2.0:1777051448.066087:0:8471:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051448.066117:0:8471:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000003e36261/0x85f51a6b96716d0c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6776 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1777051448.066162:0:8471:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x1e5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1777051448.066273:0:8471:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777051448.066281:0:8471:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777051448.066304:0:8471:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000003e36261/0x85f51a6b96716d0c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6776 expref: 52 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051448.066345:0:8471:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000003e36261/0x85f51a6b96716d0c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6776 expref: 52 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051448.066371:0:8471:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d9418d2400, rc 0) 00000100:00100000:2.0:1777051448.066485:0:8471:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7cd9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+52:138709:x1863365426041728:12345-192.168.201.46@tcp:101:dd.0 Request processed in 426us (696us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051448.066504:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 8063 00000100:00100000:1.0:1777051448.086526:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94f518700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452658432:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1777051448.086569:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95612b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3680:1863365452658304:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1777051448.086721:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051448.086783:0:8472:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452658432 00000100:00100000:0.0:1777051448.086796:0:8472:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452658432 00000100:00100000:0.0:1777051448.086917:0:8472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5674 00000100:00100000:0.0:1777051448.086935:0:8472:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f658700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3677:x1863365452658432:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1777051448.086976:0:8472:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 481844800 pending 0 free 3642707968 avail 3411185664 00000100:00100000:3.0:1777051448.087029:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051448.087145:0:8473:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452658304 00000100:00100000:2.0:1777051448.087155:0:8473:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452658304 00000100:00100000:2.0:1777051448.087247:0:8473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5675 00000100:00100000:2.0:1777051448.087263:0:8473:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f519180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3680:x1863365452658304:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1777051448.087291:0:8473:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 484539968 pending 0 free 3861622784 avail 3630100480 00000100:00100000:1.0:1777051448.087460:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94f518700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452658432:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1777051448.087584:0:8472:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f658700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3677:x1863365452658432:12345-0@lo:13:osp-pre-1-1.0 Request processed in 650us (862us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051448.087600:0:8472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5674 00000100:00100000:2.0:1777051448.087824:0:8473:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f519180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3680:x1863365452658304:12345-0@lo:13:osp-pre-0-1.0 Request processed in 563us (798us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051448.087837:0:8473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5675 00000100:00100000:3.0:1777051448.088064:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95612b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3680:1863365452658304:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1777051448.101017:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051448.101150:0:27888:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426041856 00000100:00100000:1.0:1777051448.101165:0:27888:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426041856 00002000:00100000:1.0:1777051448.101272:0:27888:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x1e5:0x0] (0->1048575) req@ffff99d95612b100 x1863365426041856/t0(0) o4->c11b6966-0775-44d2-bdc6-c74c26eb2226@192.168.201.46@tcp:409/0 lens 488/0 e 0 to 0 dl 1777051459 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1777051448.101296:0:27888:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99d95612b100 with x1863365426041856 ext(0->1048575) 00002000:00010000:1.0:1777051448.101306:0:27888:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99d95612b100 00000100:00100000:1.0:1777051448.101378:0:27888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 1784 00000100:00100000:1.0:1777051448.101396:0:27888:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95612b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+52:2436:x1863365426041856:12345-192.168.201.46@tcp:4:dd.0 00000100:00100000:1.0:1777051448.128383:0:27888:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95612b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+54:2436:x1863365426041856:12345-192.168.201.46@tcp:4:dd.0 Request processed in 26980us (27363us total) trans 4294968367 rc 0/0 00000100:00100000:1.0:1777051448.128423:0:27888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 1784 00002000:00100000:1.0:1777051448.128445:0:27888:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x1e5:0x0] (0->1048575) req@ffff99d95612b100 x1863365426041856/t4294968367(0) o4->c11b6966-0775-44d2-bdc6-c74c26eb2226@192.168.201.46@tcp:409/0 lens 488/448 e 0 to 0 dl 1777051459 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1777051448.128466:0:27888:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99d95612b100 with x1863365426041856 ext(0->1048575) 00002000:00010000:1.0:1777051448.128475:0:27888:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99d95612b100 00000100:00100000:2.0:1777051448.131150:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051448.131300:0:8492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426041984 00000100:00100000:1.0:1777051448.131312:0:8492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426041984 00000100:00100000:1.0:1777051448.131385:0:8492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112233 00000100:00100000:1.0:1777051448.131404:0:8492:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d956128e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+26:138709:x1863365426041984:12345-192.168.201.46@tcp:44:dd.0 00000001:00080000:1.0:1777051448.135260:0:103159:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771195 is committed 00000001:00080000:1.0:1777051448.135291:0:103159:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771194 is committed 00000020:00080000:1.0:1777051448.135303:0:103159:0:(update_trans.c:1333:distribute_txn_batchid_cb()) lustre-MDT0000: 25769803779 batchid updated 00010000:00010000:3.0:1777051448.135334:0:3664:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950705e00/0x85f51a6b96716cf7 lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e2:0x8:0x0].0x15f59727 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051448.135357:0:3664:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d950705e00/0x85f51a6b96716cf7 lrc: 2/0,0 mode: TXN/TXN res: [0x2000032e2:0x8:0x0].0x15f59727 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051448.135369:0:3663:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9418d3400/0x85f51a6b96716c8e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x45e84fca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051448.135372:0:3664:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d950705e00/0x85f51a6b96716cf7 lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e2:0x8:0x0].0x15f59727 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051448.135406:0:3663:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d9418d3400/0x85f51a6b96716c8e lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x45e84fca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051448.135408:0:3664:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d950705e00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:3.0:1777051448.135420:0:3664:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d950705e00/0x85f51a6b96716cf7 lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e2:0x8:0x0].0x15f59727 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051448.135457:0:3663:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d9418d3400/0x85f51a6b96716c8e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x45e84fca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051448.135461:0:3664:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d950705e00/0x85f51a6b96716cf7 lrc: 4/0,0 mode: TXN/TXN res: [0x2000032e2:0x8:0x0].0x15f59727 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051448.135482:0:3663:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d9418d3400 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:1.0:1777051448.135493:0:3663:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d9418d3400/0x85f51a6b96716c8e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x45e84fca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051448.135504:0:3664:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0x8:0x0].0x15f59727 (ffff99da5fb45700) 00010000:00010000:1.0:1777051448.135505:0:3663:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d9418d3400/0x85f51a6b96716c8e lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x45e84fca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051448.135519:0:3664:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777051448.135538:0:3663:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x45e84fca (ffff99da617f5900) 00010000:00010000:1.0:1777051448.135546:0:3663:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777051448.135554:0:3663:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d9418d3400/0x85f51a6b96716c8e lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x45e84fca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051448.135565:0:3663:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d9418d3400/0x85f51a6b96716c8e lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x45e84fca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051448.135594:0:3663:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9418d3c00/0x85f51a6b96716c95 lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e2:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051448.135605:0:3663:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d9418d3c00/0x85f51a6b96716c95 lrc: 2/0,0 mode: TXN/TXN res: [0x2000032e2:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051448.135615:0:3663:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d9418d3c00/0x85f51a6b96716c95 lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e2:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051448.135658:0:3663:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d9418d3c00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:1.0:1777051448.135665:0:3663:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d9418d3c00/0x85f51a6b96716c95 lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e2:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051448.135684:0:3663:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d9418d3c00/0x85f51a6b96716c95 lrc: 4/0,0 mode: TXN/TXN res: [0x2000032e2:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051448.135723:0:3663:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0x8:0x0].0x0 (ffff99da617f5300) 00010000:00010000:1.0:1777051448.135730:0:3663:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777051448.135732:0:3664:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d950705e00/0x85f51a6b96716cf7 lrc: 2/0,0 mode: --/TXN res: [0x2000032e2:0x8:0x0].0x15f59727 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051448.135738:0:3663:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d9418d3c00/0x85f51a6b96716c95 lrc: 2/0,0 mode: --/TXN res: [0x2000032e2:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051448.135764:0:3664:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d950705e00/0x85f51a6b96716cf7 lrc: 0/0,0 mode: --/TXN res: [0x2000032e2:0x8:0x0].0x15f59727 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051448.135767:0:3663:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d9418d3c00/0x85f51a6b96716c95 lrc: 0/0,0 mode: --/TXN res: [0x2000032e2:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1777051448.135849:0:103195:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 25769803779 00000020:00080000:3.0:1777051448.135875:0:103195:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 25769803779 00000100:00100000:1.0:1777051448.136370:0:8492:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d956128e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+24:138709:x1863365426041984:12345-192.168.201.46@tcp:44:dd.0 Request processed in 4965us (5219us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051448.136388:0:8492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112233 00000100:00100000:2.0:1777051448.139176:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051448.139298:0:8628:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426042112 00000100:00100000:1.0:1777051448.139311:0:8628:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426042112 00000100:00100000:1.0:1777051448.139374:0:8628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 8064 00000100:00100000:1.0:1777051448.139384:0:8628:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95612ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+54:2437:x1863365426042112:12345-192.168.201.46@tcp:16:dd.0 00000001:00080000:0.0:1777051448.141890:0:8464:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0000: transno 4294968367 is committed 00000100:00100000:1.0:1777051448.142376:0:8628:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95612ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+52:2437:x1863365426042112:12345-192.168.201.46@tcp:16:dd.0 Request processed in 2707us (3260us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051448.142392:0:8628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 8064 00000100:00100000:1.0:1777051448.146254:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051448.146367:0:6582:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426042368 00000100:00100000:2.0:1777051448.146379:0:6582:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426042368 00000100:00100000:2.0:1777051448.146459:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3399 00000100:00100000:2.0:1777051448.146475:0:6582:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f658a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+24:138709:x1863365426042368:12345-192.168.201.46@tcp:35:dd.0 00000100:00100000:2.0:1777051448.146859:0:6582:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f658a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+25:138709:x1863365426042368:12345-192.168.201.46@tcp:35:dd.0 Request processed in 386us (608us total) trans 30064771196 rc 0/0 00000100:00100000:2.0:1777051448.146869:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3399 00000100:00100000:2.0:1777051448.169667:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051448.169788:0:27885:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426042496 00000100:00100000:1.0:1777051448.169804:0:27885:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426042496 00000100:00100000:1.0:1777051448.169909:0:27885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112234 00000100:00100000:1.0:1777051448.169927:0:27885:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95612b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c11b6966-0775-44d2-bdc6-c74c26eb2226+25:138710:x1863365426042496:12345-192.168.201.46@tcp:101:lfs.0 00010000:00010000:1.0:1777051448.169986:0:27885:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777051448.170020:0:27885:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cfa00/0x85f51a6b96716d13 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b677d expref: -99 pid: 27885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051448.170110:0:27885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cf000/0x85f51a6b96716d1a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051448.170135:0:27885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cf000/0x85f51a6b96716d1a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051448.170154:0:27885:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cf000/0x85f51a6b96716d1a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051448.170181:0:27885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cfc00/0x85f51a6b96716d21 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x45e84fca bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051448.170235:0:27885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cfc00/0x85f51a6b96716d21 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x45e84fca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051448.170254:0:27885:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cfc00/0x85f51a6b96716d21 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x45e84fca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051448.170666:0:27885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cf200/0x85f51a6b96716d28 lrc: 3/1,0 mode: --/PR res: [0x2000032e2:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051448.170686:0:27885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cf200/0x85f51a6b96716d28 lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0x8:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051448.170700:0:27885:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cf200/0x85f51a6b96716d28 lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0x8:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1777051448.170753:0:27885:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000032e2:0x8:0x0]: returning size 4096 00000004:00200000:1.0:1777051448.170760:0:27885:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1777051448.170791:0:27885:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cf200/0x85f51a6b96716d28 lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0x8:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051448.170813:0:27885:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cf000/0x85f51a6b96716d1a lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051448.170827:0:27885:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cf000/0x85f51a6b96716d1a lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051448.170840:0:27885:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cf000/0x85f51a6b96716d1a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051448.170853:0:27885:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cf000/0x85f51a6b96716d1a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051448.170865:0:27885:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da7d5cf000 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:1.0:1777051448.170872:0:27885:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cf000/0x85f51a6b96716d1a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051448.170887:0:27885:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cf000/0x85f51a6b96716d1a lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051448.170906:0:27885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d9533ab000) 00010000:00010000:1.0:1777051448.170913:0:27885:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777051448.170921:0:27885:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cf000/0x85f51a6b96716d1a lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051448.170934:0:27885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cf000/0x85f51a6b96716d1a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051448.170955:0:27885:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cfc00/0x85f51a6b96716d21 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x45e84fca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051448.170968:0:27885:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cfc00/0x85f51a6b96716d21 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x45e84fca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051448.170980:0:27885:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cfc00/0x85f51a6b96716d21 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x45e84fca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051448.170991:0:27885:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da7d5cfc00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:1.0:1777051448.170996:0:27885:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cfc00/0x85f51a6b96716d21 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x45e84fca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051448.171008:0:27885:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cfc00/0x85f51a6b96716d21 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x45e84fca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051448.171024:0:27885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x45e84fca (ffff99d94e6b6400) 00010000:00010000:1.0:1777051448.171029:0:27885:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777051448.171035:0:27885:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cfc00/0x85f51a6b96716d21 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x45e84fca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051448.171580:0:27885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cfc00/0x85f51a6b96716d21 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x45e84fca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051448.171672:0:27885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cfa00/0x85f51a6b96716d13 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b677d expref: 27 pid: 27885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051448.171699:0:27885:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cf200/0x85f51a6b96716d28 lrc: 3/0,0 mode: PR/PR res: [0x2000032e2:0x8:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b677d expref: 26 pid: 27885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051448.171714:0:27885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0x8:0x0].0x0 (ffff99d94e6b6200) 00010000:00010000:1.0:1777051448.171718:0:27885:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1777051448.171723:0:27885:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99da7d5cf200, rc 0) 00000100:00100000:1.0:1777051448.171820:0:27885:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95612b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c11b6966-0775-44d2-bdc6-c74c26eb2226+26:138710:x1863365426042496:12345-192.168.201.46@tcp:101:lfs.0 Request processed in 1896us (2194us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051448.171842:0:27885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112234 00000100:00100000:1.0:1777051448.380238:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051448.380345:0:27882:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426042752 00000100:00100000:2.0:1777051448.380360:0:27882:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426042752 00000100:00100000:2.0:1777051448.380439:0:27882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112235 00000100:00100000:2.0:1777051448.380454:0:27882:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f659500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+26:138736:x1863365426042752:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1777051448.380482:0:27882:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051448.380509:0:27882:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d9418d2e00/0x85f51a6b96716d2f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6784 expref: -99 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051448.380670:0:27882:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9418d2200/0x85f51a6b96716d36 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051448.380707:0:27882:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d9418d2200/0x85f51a6b96716d36 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051448.380725:0:27882:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d9418d2200/0x85f51a6b96716d36 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051448.380749:0:27882:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9418d3c00/0x85f51a6b96716d3d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051448.380761:0:27882:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d9418d3c00/0x85f51a6b96716d3d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051448.380772:0:27882:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d9418d3c00/0x85f51a6b96716d3d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051448.380889:0:27882:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9418d3400/0x85f51a6b96716d44 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051448.380903:0:27882:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d9418d3400/0x85f51a6b96716d44 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051448.380914:0:27882:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d9418d3400/0x85f51a6b96716d44 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1777051448.380927:0:27882:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:2.0:1777051448.381026:0:27882:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9418d2200/0x85f51a6b96716d36 lrc: 4/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051448.381039:0:27882:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9418d2200/0x85f51a6b96716d36 lrc: 4/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051448.381049:0:27882:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d9418d2200/0x85f51a6b96716d36 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051448.381060:0:27882:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d9418d2200/0x85f51a6b96716d36 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051448.381070:0:27882:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d9418d2200 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:2.0:1777051448.381076:0:27882:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d9418d2200/0x85f51a6b96716d36 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051448.381086:0:27882:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d9418d2200/0x85f51a6b96716d36 lrc: 5/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051448.381103:0:27882:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff99d94e5e2500) 00010000:00010000:2.0:1777051448.381109:0:27882:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777051448.381116:0:27882:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d9418d2200/0x85f51a6b96716d36 lrc: 3/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051448.381126:0:27882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d9418d2200/0x85f51a6b96716d36 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051448.381144:0:27882:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9418d3c00/0x85f51a6b96716d3d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051448.381154:0:27882:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d9418d3c00/0x85f51a6b96716d3d lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051448.381163:0:27882:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d9418d3c00/0x85f51a6b96716d3d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051448.381171:0:27882:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d9418d3c00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:2.0:1777051448.381176:0:27882:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d9418d3c00/0x85f51a6b96716d3d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051448.381186:0:27882:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d9418d3c00/0x85f51a6b96716d3d lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051448.381252:0:27882:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff99d9502e3300) 00010000:00010000:2.0:1777051448.381258:0:27882:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777051448.381263:0:27882:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d9418d3c00/0x85f51a6b96716d3d lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051448.381272:0:27882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d9418d3c00/0x85f51a6b96716d3d lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051448.381681:0:27882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d9418d2e00/0x85f51a6b96716d2f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6784 expref: 29 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051448.381703:0:27882:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9418d3400/0x85f51a6b96716d44 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6784 expref: 28 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051448.381716:0:27882:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99d941e2ea00) 00010000:00010000:2.0:1777051448.381719:0:27882:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777051448.381723:0:27882:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d9418d3400, rc 0) 00000100:00100000:2.0:1777051448.381800:0:27882:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f659500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+28:138736:x1863365426042752:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 Request processed in 1349us (1616us total) trans 30064771197 rc 0/0 00000100:00100000:2.0:1777051448.381813:0:27882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112235 00000100:00100000:0.0:1777051448.384929:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051448.385033:0:9550:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426042880 00000100:00100000:1.0:1777051448.385043:0:9550:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426042880 00000100:00100000:1.0:1777051448.385119:0:9550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13707 00000100:00100000:1.0:1777051448.385134:0:9550:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7cd9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+28:2437:x1863365426042880:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1777051448.385151:0:9550:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1777051448.385177:0:9550:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d9418d3400/0x85f51a6b96716d44 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6784 expref: 28 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051448.385517:0:9550:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99d941e2ea00) 00010000:00010000:1.0:1777051448.385523:0:9550:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1777051448.385577:0:9550:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7cd9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+27:2437:x1863365426042880:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 444us (650us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051448.385590:0:9550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13707 00000100:00100000:1.0:1777051448.387087:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051448.387170:0:21368:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426043008 00000100:00100000:2.0:1777051448.387178:0:21368:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426043008 00000100:00100000:2.0:1777051448.387230:0:21368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112236 00000100:00100000:2.0:1777051448.387243:0:21368:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f65bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+27:138736:x1863365426043008:12345-192.168.201.46@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1777051448.387334:0:21368:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f65bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+27:138736:x1863365426043008:12345-192.168.201.46@tcp:59:lhsmtool_posix.0 Request processed in 94us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051448.387343:0:21368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112236 00000100:00100000:2.0:1777051448.390188:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051448.390356:0:6580:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426043136 00000100:00100000:1.0:1777051448.390365:0:6580:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426043136 00000100:00100000:1.0:1777051448.390449:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112237 00000100:00100000:1.0:1777051448.390464:0:6580:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d956129500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+8:138736:x1863365426043136:12345-192.168.201.46@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1777051448.390561:0:6580:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d956129500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+8:138736:x1863365426043136:12345-192.168.201.46@tcp:59:lhsmtool_posix.0 Request processed in 100us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051448.390569:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112237 00000100:00080000:2.0:1777051448.391265:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1777051448.404871:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051448.404973:0:6581:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426043264 00000100:00100000:2.0:1777051448.404986:0:6581:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426043264 00000100:00100000:2.0:1777051448.405080:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112238 00000100:00100000:2.0:1777051448.405098:0:6581:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7cd9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+31:138737:x1863365426043264:12345-192.168.201.46@tcp:101:lfs.0 00010000:00010000:2.0:1777051448.405129:0:6581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051448.405157:0:6581:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d9418d2e00/0x85f51a6b96716d52 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b678b expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051448.405279:0:6581:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9418d3c00/0x85f51a6b96716d59 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051448.405302:0:6581:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d9418d3c00/0x85f51a6b96716d59 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051448.405321:0:6581:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d9418d3c00/0x85f51a6b96716d59 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1777051448.405375:0:6581:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 12288 00000004:00200000:2.0:1777051448.405381:0:6581:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1777051448.405406:0:6581:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99d9418d3c00/0x85f51a6b96716d59 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051448.405441:0:6581:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d9418d2e00/0x85f51a6b96716d52 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b678b expref: 33 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051448.405479:0:6581:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9418d3c00/0x85f51a6b96716d59 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b678b expref: 32 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051448.405494:0:6581:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d9533ab000) 00010000:00010000:2.0:1777051448.405499:0:6581:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1777051448.405505:0:6581:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d9418d3c00, rc 0) 00000100:00100000:2.0:1777051448.405592:0:6581:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7cd9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+32:138737:x1863365426043264:12345-192.168.201.46@tcp:101:lfs.0 Request processed in 497us (726us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051448.405605:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112238 00010000:00010000:0.0:1777051448.407054:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777051448.408186:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051448.408302:0:46494:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426043392 00000100:00100000:2.0:1777051448.408311:0:46494:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426043392 00000100:00100000:2.0:1777051448.408374:0:46494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112239 00000100:00100000:2.0:1777051448.408388:0:46494:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f51b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+32:138737:x1863365426043392:12345-192.168.201.46@tcp:101:lfs.0 00010000:00010000:2.0:1777051448.408404:0:46494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051448.408420:0:46494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d9418d2200/0x85f51a6b96716d60 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6792 expref: -99 pid: 46494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051448.408465:0:46494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9418d3e00/0x85f51a6b96716d67 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051448.408477:0:46494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d9418d3e00/0x85f51a6b96716d67 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051448.408486:0:46494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d9418d3e00/0x85f51a6b96716d67 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051448.408500:0:46494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9418d2800/0x85f51a6b96716d6e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x45e84fca bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051448.408508:0:46494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d9418d2800/0x85f51a6b96716d6e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x45e84fca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051448.408515:0:46494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d9418d2800/0x85f51a6b96716d6e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x45e84fca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051448.408589:0:46494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9418d3a00/0x85f51a6b96716d75 lrc: 3/1,0 mode: --/PR res: [0x2000032e2:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051448.408600:0:46494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d9418d3a00/0x85f51a6b96716d75 lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0x8:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051448.408610:0:46494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d9418d3a00/0x85f51a6b96716d75 lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0x8:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1777051448.408674:0:46494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000032e2:0x8:0x0]: returning size 4096 00000004:00200000:2.0:1777051448.408680:0:46494:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1777051448.408700:0:46494:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99d9418d3a00/0x85f51a6b96716d75 lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0x8:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051448.408716:0:46494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9418d3e00/0x85f51a6b96716d67 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051448.408727:0:46494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d9418d3e00/0x85f51a6b96716d67 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051448.408737:0:46494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d9418d3e00/0x85f51a6b96716d67 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051448.408747:0:46494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d9418d3e00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:2.0:1777051448.408753:0:46494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d9418d3e00/0x85f51a6b96716d67 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051448.408766:0:46494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d9418d3e00/0x85f51a6b96716d67 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051448.408812:0:46494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d9533ab000) 00010000:00010000:2.0:1777051448.408822:0:46494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777051448.408829:0:46494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d9418d3e00/0x85f51a6b96716d67 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051448.408838:0:46494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d9418d3e00/0x85f51a6b96716d67 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051448.408856:0:46494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9418d2800/0x85f51a6b96716d6e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x45e84fca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051448.408866:0:46494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d9418d2800/0x85f51a6b96716d6e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x45e84fca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051448.408877:0:46494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d9418d2800/0x85f51a6b96716d6e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x45e84fca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051448.408885:0:46494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d9418d2800 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:2.0:1777051448.408913:0:46494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d9418d2800/0x85f51a6b96716d6e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x45e84fca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051448.408923:0:46494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d9418d2800/0x85f51a6b96716d6e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x45e84fca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051448.408932:0:46494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x45e84fca (ffff99d9502e3300) 00010000:00010000:2.0:1777051448.408935:0:46494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777051448.408939:0:46494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d9418d2800/0x85f51a6b96716d6e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x45e84fca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051448.408950:0:46494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d9418d2800/0x85f51a6b96716d6e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x45e84fca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051448.408980:0:46494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d9418d2200/0x85f51a6b96716d60 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6792 expref: 34 pid: 46494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051448.408992:0:46494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9418d3a00/0x85f51a6b96716d75 lrc: 3/0,0 mode: PR/PR res: [0x2000032e2:0x8:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6792 expref: 33 pid: 46494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051448.409002:0:46494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0x8:0x0].0x0 (ffff99d94e6b6200) 00010000:00010000:2.0:1777051448.409005:0:46494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1777051448.409009:0:46494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d9418d3a00, rc 0) 00000100:00100000:2.0:1777051448.409072:0:46494:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f51b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+33:138737:x1863365426043392:12345-192.168.201.46@tcp:101:lfs.0 Request processed in 685us (887us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051448.409084:0:46494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112239 00000100:00100000:1.0:1777051448.411507:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051448.411595:0:6579:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426043520 00000100:00100000:3.0:1777051448.411602:0:6579:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426043520 00000100:00100000:3.0:1777051448.411686:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112240 00000100:00100000:3.0:1777051448.411700:0:6579:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f658380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+33:138737:x1863365426043520:12345-192.168.201.46@tcp:101:lfs.0 00010000:00010000:3.0:1777051448.411716:0:6579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777051448.411732:0:6579:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3800/0x85f51a6b96716d7c lrc: 2/0,0 mode: --/CR res: [0x2000032e2:0x8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6799 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051448.411779:0:6579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2a00/0x85f51a6b96716d83 lrc: 3/1,0 mode: --/CR res: [0x2000032e2:0x8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051448.411791:0:6579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2a00/0x85f51a6b96716d83 lrc: 3/1,0 mode: CR/CR res: [0x2000032e2:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051448.411800:0:6579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2a00/0x85f51a6b96716d83 lrc: 3/1,0 mode: CR/CR res: [0x2000032e2:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051448.412111:0:6579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2800/0x85f51a6b96716d8a lrc: 3/1,0 mode: --/PR res: [0x2000032e2:0x8:0x0].0x15f59727 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051448.412124:0:6579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2800/0x85f51a6b96716d8a lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0x8:0x0].0x15f59727 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051448.412137:0:6579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2800/0x85f51a6b96716d8a lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0x8:0x0].0x15f59727 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051448.412246:0:6579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3000/0x85f51a6b96716d91 lrc: 3/1,0 mode: --/PR res: [0x2000032e3:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051448.412260:0:6579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3000/0x85f51a6b96716d91 lrc: 3/1,0 mode: PR/PR res: [0x2000032e3:0x9:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051448.412274:0:6579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3000/0x85f51a6b96716d91 lrc: 3/1,0 mode: PR/PR res: [0x2000032e3:0x9:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1777051448.412311:0:6579:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000032e3:0x9:0x0]: returning size 1048576 00000004:00200000:3.0:1777051448.412317:0:6579:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1777051448.412335:0:6579:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3000/0x85f51a6b96716d91 lrc: 3/1,0 mode: PR/PR res: [0x2000032e3:0x9:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051448.412351:0:6579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3000/0x85f51a6b96716d91 lrc: 3/1,0 mode: PR/PR res: [0x2000032e3:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051448.412364:0:6579:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2a00/0x85f51a6b96716d83 lrc: 4/1,0 mode: CR/CR res: [0x2000032e2:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051448.412373:0:6579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2a00/0x85f51a6b96716d83 lrc: 4/1,0 mode: CR/CR res: [0x2000032e2:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051448.412382:0:6579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2a00/0x85f51a6b96716d83 lrc: 3/0,0 mode: CR/CR res: [0x2000032e2:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051448.412390:0:6579:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2a00/0x85f51a6b96716d83 lrc: 4/0,0 mode: CR/CR res: [0x2000032e2:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051448.412396:0:6579:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d9559a2a00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:3.0:1777051448.412400:0:6579:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2a00/0x85f51a6b96716d83 lrc: 4/0,0 mode: CR/CR res: [0x2000032e2:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051448.412407:0:6579:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2a00/0x85f51a6b96716d83 lrc: 5/0,0 mode: CR/CR res: [0x2000032e2:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051448.412417:0:6579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0x8:0x0].0x0 (ffff99d94e6b6200) 00010000:00010000:3.0:1777051448.412421:0:6579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777051448.412425:0:6579:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2a00/0x85f51a6b96716d83 lrc: 3/0,0 mode: --/CR res: [0x2000032e2:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051448.412431:0:6579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2a00/0x85f51a6b96716d83 lrc: 0/0,0 mode: --/CR res: [0x2000032e2:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051448.412451:0:6579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2800/0x85f51a6b96716d8a lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0x8:0x0].0x15f59727 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051448.412457:0:6579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2800/0x85f51a6b96716d8a lrc: 2/0,0 mode: PR/PR res: [0x2000032e2:0x8:0x0].0x15f59727 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051448.412463:0:6579:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2800/0x85f51a6b96716d8a lrc: 3/0,0 mode: PR/PR res: [0x2000032e2:0x8:0x0].0x15f59727 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051448.412468:0:6579:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d9559a2800 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:3.0:1777051448.412470:0:6579:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2800/0x85f51a6b96716d8a lrc: 3/0,0 mode: PR/PR res: [0x2000032e2:0x8:0x0].0x15f59727 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051448.412476:0:6579:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2800/0x85f51a6b96716d8a lrc: 4/0,0 mode: PR/PR res: [0x2000032e2:0x8:0x0].0x15f59727 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051448.412482:0:6579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0x8:0x0].0x15f59727 (ffff99d9413d0200) 00010000:00010000:3.0:1777051448.412485:0:6579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777051448.412487:0:6579:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2800/0x85f51a6b96716d8a lrc: 2/0,0 mode: --/PR res: [0x2000032e2:0x8:0x0].0x15f59727 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051448.412493:0:6579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2800/0x85f51a6b96716d8a lrc: 0/0,0 mode: --/PR res: [0x2000032e2:0x8:0x0].0x15f59727 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051448.412519:0:6579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3800/0x85f51a6b96716d7c lrc: 0/0,0 mode: --/CR res: [0x2000032e2:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6799 expref: 35 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051448.412530:0:6579:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3000/0x85f51a6b96716d91 lrc: 3/0,0 mode: PR/PR res: [0x2000032e3:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6799 expref: 34 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051448.412547:0:6579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e3:0x9:0x0].0x0 (ffff99da5fb45c00) 00010000:00010000:3.0:1777051448.412551:0:6579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1777051448.412554:0:6579:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d9559a3000, rc 0) 00000100:00100000:3.0:1777051448.412610:0:6579:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f658380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+34:138737:x1863365426043520:12345-192.168.201.46@tcp:101:lfs.0 Request processed in 912us (1104us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051448.412651:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112240 00000100:00100000:0.0:1777051448.415603:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051448.415723:0:27887:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426043648 00000100:00100000:2.0:1777051448.415733:0:27887:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426043648 00000100:00100000:2.0:1777051448.416095:0:27887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 8065 00000100:00100000:2.0:1777051448.416113:0:27887:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7cd9e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+52:2436:x1863365426043648:12345-192.168.201.46@tcp:101:lfs.0 00010000:00010000:2.0:1777051448.416132:0:27887:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051448.416152:0:27887:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c67278d/0x85f51a6b96716d98 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x1e5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b67a0 expref: -99 pid: 27887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051448.416293:0:27887:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d956128700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:27887:1863365452658560:192.168.201.46@tcp:106: 00000100:00100000:2.0:1777051448.416385:0:27887:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d958f6d0c0 going to sleep for 11 seconds 00002000:00010000:2.0:1777051448.419270:0:27887:0:(ofd_lvb.c:259:ofd_lvbo_update()) res: [0x280000401:0x1e5:0x0] updating lvb size: 0 -> 1048576 00002000:00010000:2.0:1777051448.419278:0:27887:0:(ofd_lvb.c:265:ofd_lvbo_update()) res: [0x280000401:0x1e5:0x0] updating lvb mtime: 0 -> 1777051448 00002000:00010000:2.0:1777051448.419281:0:27887:0:(ofd_lvb.c:271:ofd_lvbo_update()) res: [0x280000401:0x1e5:0x0] updating lvb atime: 0 -> 1777051448 00002000:00010000:2.0:1777051448.419284:0:27887:0:(ofd_lvb.c:277:ofd_lvbo_update()) res: [0x280000401:0x1e5:0x0] updating lvb ctime: 0 -> 1777051448 00002000:00010000:2.0:1777051448.419288:0:27887:0:(ofd_lvb.c:283:ofd_lvbo_update()) res: [0x280000401:0x1e5:0x0] updating lvb blocks: 0 -> 2048 00000100:00100000:2.0:1777051448.419310:0:27887:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d956128700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:27887:1863365452658560:192.168.201.46@tcp:106: 00010000:00010000:2.0:1777051448.419351:0:27887:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004c67278d/0x85f51a6b96716d98 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x1e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b67a0 expref: 53 pid: 27887 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051448.419383:0:27887:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c67278d/0x85f51a6b96716d98 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x1e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b67a0 expref: 53 pid: 27887 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051448.419404:0:27887:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d9418d2200, rc 0) 00000100:00100000:2.0:1777051448.419466:0:27887:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7cd9e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+52:2436:x1863365426043648:12345-192.168.201.46@tcp:101:lfs.0 Request processed in 3356us (3866us total) trans 0 rc 301/301 00000100:00100000:2.0:1777051448.419480:0:27887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 8065 00000100:00100000:1.0:1777051448.423686:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051448.424045:0:21368:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426043776 00000100:00100000:2.0:1777051448.424054:0:21368:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426043776 00000100:00100000:2.0:1777051448.424125:0:21368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112241 00000100:00100000:2.0:1777051448.424140:0:21368:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f65ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+34:138737:x1863365426043776:12345-192.168.201.46@tcp:101:lfs.0 00010000:00010000:2.0:1777051448.424459:0:21368:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051448.424484:0:21368:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d9418d2800/0x85f51a6b96716d9f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b67a7 expref: -99 pid: 21368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051448.424571:0:21368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9418d3e00/0x85f51a6b96716da6 lrc: 3/1,0 mode: --/PR res: [0x2000032e2:0x8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051448.424591:0:21368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d9418d3e00/0x85f51a6b96716da6 lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0x8:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051448.424611:0:21368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d9418d3e00/0x85f51a6b96716da6 lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0x8:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1777051448.425021:0:21368:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000032e2:0x8:0x0]: returning size 4096 00000004:00200000:2.0:1777051448.425028:0:21368:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1777051448.425061:0:21368:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99d9418d3e00/0x85f51a6b96716da6 lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0x8:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051448.425099:0:21368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d9418d2800/0x85f51a6b96716d9f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b67a7 expref: 36 pid: 21368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051448.425121:0:21368:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9418d3e00/0x85f51a6b96716da6 lrc: 3/0,0 mode: PR/PR res: [0x2000032e2:0x8:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b67a7 expref: 35 pid: 21368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051448.425134:0:21368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0x8:0x0].0x0 (ffff99d94e6b6200) 00010000:00010000:2.0:1777051448.425139:0:21368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1777051448.425145:0:21368:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d9418d3e00, rc 0) 00000100:00100000:2.0:1777051448.425244:0:21368:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f65ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+35:138737:x1863365426043776:12345-192.168.201.46@tcp:101:lfs.0 Request processed in 1064us (1519us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051448.425257:0:21368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112241 00000100:00100000:0.0:1777051448.428560:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051448.428681:0:8470:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426043904 00000100:00100000:3.0:1777051448.428691:0:8470:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426043904 00000100:00100000:3.0:1777051448.429043:0:8470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 8066 00000100:00100000:3.0:1777051448.429057:0:8470:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7cd9f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+52:2437:x1863365426043904:12345-192.168.201.46@tcp:101:lfs.0 00010000:00010000:3.0:1777051448.429071:0:8470:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777051448.429084:0:8470:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000554aaf12/0x85f51a6b96716dad lrc: 2/0,0 mode: --/PR res: [0x280000401:0x1e5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b67ae expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051448.429132:0:8470:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94f518e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8470:1863365452658688:192.168.201.46@tcp:106: 00000100:00100000:3.0:1777051448.429257:0:8470:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d956bdaf00 going to sleep for 11 seconds 00000100:00100000:3.0:1777051448.431474:0:8470:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94f518e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8470:1863365452658688:192.168.201.46@tcp:106: 00010000:00010000:3.0:1777051448.431537:0:8470:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000554aaf12/0x85f51a6b96716dad lrc: 1/0,0 mode: --/PR res: [0x280000401:0x1e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b67ae expref: 53 pid: 8470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051448.431570:0:8470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000554aaf12/0x85f51a6b96716dad lrc: 0/0,0 mode: --/PR res: [0x280000401:0x1e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b67ae expref: 53 pid: 8470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051448.431590:0:8470:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d9559a3800, rc 0) 00000100:00100000:3.0:1777051448.431675:0:8470:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7cd9f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+52:2437:x1863365426043904:12345-192.168.201.46@tcp:101:lfs.0 Request processed in 2619us (3117us total) trans 0 rc 301/301 00000100:00100000:3.0:1777051448.431687:0:8470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 8066 00000100:00100000:1.0:1777051448.436322:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051448.436416:0:46497:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426044160 00000100:00100000:0.0:1777051448.436424:0:46497:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426044160 00000100:00100000:0.0:1777051448.436475:0:46497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112242 00000100:00100000:0.0:1777051448.436484:0:46497:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f65b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+35:138737:x1863365426044160:12345-192.168.201.46@tcp:58:lfs.0 00000040:00080000:0.0:1777051448.436663:0:46497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2b:0x0].7, 136 off9144 00000100:00100000:0.0:1777051448.436746:0:46497:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f65b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+35:138737:x1863365426044160:12345-192.168.201.46@tcp:58:lfs.0 Request processed in 260us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051448.436758:0:46497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112242 00000040:00080000:2.0:1777051448.726565:0:104226:0:(llog.c:801:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1777051448.726574:0:104226:0:(llog_cat.c:158:llog_cat_process_common()) processing log [0x1:0x12:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1777051448.727710:0:104226:0:(llog.c:858:llog_process_thread()) stop processing plain [0x1:0x12:0x0] index 64768 count 7 00000040:00080000:2.0:1777051448.727727:0:104226:0:(llog.c:858:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000040:00080000:3.0:1777051448.854453:0:103189:0:(llog.c:801:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:3.0:1777051448.854463:0:103189:0:(llog_cat.c:158:llog_cat_process_common()) processing log [0x1:0x2b:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1777051448.854499:0:103189:0:(llog.c:858:llog_process_thread()) stop processing plain [0x1:0x2b:0x0] index 8 count 6 00000040:00080000:3.0:1777051448.854512:0:103189:0:(llog.c:858:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00000100:00100000:3.0:1777051448.855278:0:103189:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94f518e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:103189:1863365452658816:192.168.201.46@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1777051448.855422:0:103189:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d956bdae40 going to sleep for 11 seconds 00000100:00100000:3.0:1777051448.858395:0:103189:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94f518e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:103189:1863365452658816:192.168.201.46@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1777051448.860605:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051448.860739:0:8492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426044288 00000100:00100000:2.0:1777051448.860776:0:8492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426044288 00000100:00100000:2.0:1777051448.860891:0:8492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112243 00000100:00100000:2.0:1777051448.860907:0:8492:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f658e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+27:138747:x1863365426044288:12345-192.168.201.46@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1777051448.860948:0:8492:0:(mdt_handler.c:7958:mdt_fid2path()) path get [0x2000032e3:0x9:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1777051448.861082:0:8492:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f658e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+27:138747:x1863365426044288:12345-192.168.201.46@tcp:53:lhsmtool_posix.0 Request processed in 177us (480us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051448.861103:0:8492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112243 00000100:00100000:1.0:1777051448.865524:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051448.865668:0:27885:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426044544 00000100:00100000:0.0:1777051448.865679:0:27885:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426044544 00000100:00100000:0.0:1777051448.865748:0:27885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112244 00000100:00100000:0.0:1777051448.865764:0:27885:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f659880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c11b6966-0775-44d2-bdc6-c74c26eb2226+27:138747:x1863365426044544:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1777051448.865784:0:27885:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051448.865812:0:27885:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d950705c00/0x85f51a6b96716db4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b67b5 expref: -99 pid: 27885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051448.865956:0:27885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950704600/0x85f51a6b96716dbb lrc: 3/1,0 mode: --/PR res: [0x2000032e3:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051448.865978:0:27885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d950704600/0x85f51a6b96716dbb lrc: 3/1,0 mode: PR/PR res: [0x2000032e3:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051448.865998:0:27885:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d950704600/0x85f51a6b96716dbb lrc: 3/1,0 mode: PR/PR res: [0x2000032e3:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1777051448.866016:0:27885:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000032e3:0x9:0x0]: returning size 1048576 00010000:00010000:0.0:1777051448.866149:0:27885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d950705c00/0x85f51a6b96716db4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b67b5 expref: 30 pid: 27885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051448.866177:0:27885:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950704600/0x85f51a6b96716dbb lrc: 3/0,0 mode: PR/PR res: [0x2000032e3:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b67b5 expref: 29 pid: 27885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051448.866191:0:27885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e3:0x9:0x0].0x0 (ffff99da5fb45c00) 00010000:00010000:0.0:1777051448.866278:0:27885:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1777051448.866286:0:27885:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d950704600, rc 0) 00000100:00100000:0.0:1777051448.866358:0:27885:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f659880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c11b6966-0775-44d2-bdc6-c74c26eb2226+29:138747:x1863365426044544:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 Request processed in 596us (840us total) trans 30064771198 rc 0/0 00000100:00100000:0.0:1777051448.866371:0:27885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112244 00000100:00100000:0.0:1777051448.870868:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051448.870952:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051448.871045:0:8468:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426044800 00000100:00100000:2.0:1777051448.871055:0:8468:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426044800 00000100:00100000:2.0:1777051448.871157:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 8067 00000100:00100000:2.0:1777051448.871173:0:8468:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7cd9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+52:2437:x1863365426044800:12345-192.168.201.46@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1777051448.871252:0:8468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000faa7c82b/0x85f51a6b96716dc9 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x1e5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051448.871284:0:8468:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000003e36261/0x85f51a6b96716d0c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6776 expref: 52 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051448.871299:0:8468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1777051448.871304:0:8468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1777051448.871309:0:8468:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000faa7c82b/0x85f51a6b96716dc9 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x1e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051448.871345:0:8468:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000003e36261/0x85f51a6b96716d0c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6776 expref: 52 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051448.871360:0:8468:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000003e36261/0x85f51a6b96716d0c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6776 expref: 52 pid: 8471 timeout: 8178 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051448.871377:0:8468:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d956128700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8468:1863365452658944:192.168.201.46@tcp:104: 00000100:00100000:2.0:1777051448.871470:0:8468:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d95c67b900 going to sleep for 11 seconds 00000100:00100000:1.0:1777051448.874179:0:24467:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426044672 00000100:00100000:1.0:1777051448.874189:0:24467:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426044672 00000100:00100000:1.0:1777051448.874322:0:24467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13708 00000100:00100000:1.0:1777051448.874340:0:24467:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7cd9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+29:2438:x1863365426044672:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1777051448.874358:0:24467:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1777051448.874388:0:24467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d950704600/0x85f51a6b96716dbb lrc: 0/0,0 mode: --/PR res: [0x2000032e3:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b67b5 expref: 29 pid: 27885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051448.874415:0:24467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e3:0x9:0x0].0x0 (ffff99da5fb45c00) 00010000:00010000:1.0:1777051448.874422:0:24467:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1777051448.874483:0:24467:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7cd9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+28:2438:x1863365426044672:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 148us (3620us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051448.874496:0:24467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13708 00000100:00100000:1.0:1777051448.875368:0:8468:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d956128700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8468:1863365452658944:192.168.201.46@tcp:104: 00010000:00010000:1.0:1777051448.875414:0:8468:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000faa7c82b/0x85f51a6b96716dc9 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x1e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051448.877951:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051448.878048:0:47827:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426044928 00000100:00100000:0.0:1777051448.878058:0:47827:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426044928 00010000:00010000:0.0:1777051448.878097:0:47827:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000003e36261/0x85f51a6b96716d0c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6776 expref: 53 pid: 8471 timeout: 8178 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051448.878156:0:47827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3925 00000100:00100000:0.0:1777051448.878169:0:47827:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da54220450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+53:2436:x1863365426044928:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1777051448.878187:0:47827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777051448.878250:0:47827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000003e36261/0x85f51a6b96716d0c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1e5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6776 expref: 53 pid: 8471 timeout: 8178 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051448.878281:0:47827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000003e36261/0x85f51a6b96716d0c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6776 expref: 53 pid: 8471 timeout: 8178 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051448.878314:0:47827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000003e36261/0x85f51a6b96716d0c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1e5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6776 expref: 53 pid: 8471 timeout: 8178 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051448.878336:0:47827:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777051448.878339:0:47827:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777051448.878345:0:47827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000faa7c82b/0x85f51a6b96716dc9 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x1e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051448.878361:0:47827:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000faa7c82b/0x85f51a6b96716dc9 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x1e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051448.878402:0:47827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1777051448.878466:0:47827:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da54220450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+52:2436:x1863365426044928:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 297us (515us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051448.878480:0:47827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3925 00010000:00010000:1.0:1777051448.879017:0:8468:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000faa7c82b/0x85f51a6b96716dc9 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051448.879036:0:8468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000faa7c82b/0x85f51a6b96716dc9 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051448.879076:0:8468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000faa7c82b/0x85f51a6b96716dc9 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051448.879089:0:8468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000faa7c82b/0x85f51a6b96716dc9 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051448.879102:0:8468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000faa7c82b/0x85f51a6b96716dc9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051448.879114:0:8468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d9418d3000 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:1.0:1777051448.879121:0:8468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000faa7c82b/0x85f51a6b96716dc9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051448.879135:0:8468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000faa7c82b/0x85f51a6b96716dc9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051448.879156:0:8468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000faa7c82b/0x85f51a6b96716dc9 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051448.879168:0:8468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000faa7c82b/0x85f51a6b96716dc9 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051448.879262:0:8468:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7cd9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+51:2437:x1863365426044800:12345-192.168.201.46@tcp:1:lhsmtool_posix.0 Request processed in 8089us (8307us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051448.879285:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 8067 00000100:00100000:3.0:1777051448.881573:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051448.881683:0:27882:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426045184 00000100:00100000:1.0:1777051448.881693:0:27882:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426045184 00000100:00100000:1.0:1777051448.881804:0:27882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112245 00000100:00100000:1.0:1777051448.881822:0:27882:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f518e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+28:138747:x1863365426045184:12345-192.168.201.46@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1777051448.881968:0:27882:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f518e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+28:138747:x1863365426045184:12345-192.168.201.46@tcp:57:lhsmtool_posix.0 Request processed in 152us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051448.881979:0:27882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112245 00000100:00100000:0.0:1777051448.884649:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051448.884719:0:8471:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426045312 00000100:00100000:1.0:1777051448.884728:0:8471:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426045312 00000100:00100000:1.0:1777051448.885133:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 8068 00000100:00100000:1.0:1777051448.885153:0:8471:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7cd9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+51:2438:x1863365426045312:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1777051448.885171:0:8471:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777051448.885196:0:8471:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000058c01b68/0x85f51a6b96716dd0 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b67bc expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1777051448.885229:0:8471:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x1e5:0x0] initial LVB size: 1048576, mtime: 0x69eba738, atime: 0x0, ctime: 0x69eba738, blocks: 0x800 00010000:00010000:1.0:1777051448.885251:0:8471:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051448.885255:0:8471:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051448.885267:0:8471:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000058c01b68/0x85f51a6b96716dd0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b67bc expref: 52 pid: 8471 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051448.885293:0:8471:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000058c01b68/0x85f51a6b96716dd0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b67bc expref: 52 pid: 8471 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051448.885324:0:8471:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99da7d5cfe00, rc 0) 00000100:00100000:1.0:1777051448.885392:0:8471:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7cd9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+52:2438:x1863365426045312:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 Request processed in 245us (783us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051448.885406:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 8068 00000100:00100000:1.0:1777051448.887542:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051448.887995:0:10328:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426045568 00000100:00100000:0.0:1777051448.888005:0:10328:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426045568 00000100:00100000:0.0:1777051448.888082:0:10328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112246 00000100:00100000:0.0:1777051448.888098:0:10328:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f658000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+28:138747:x1863365426045568:12345-192.168.201.46@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1777051448.888252:0:10328:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f658000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+28:138747:x1863365426045568:12345-192.168.201.46@tcp:57:lhsmtool_posix.0 Request processed in 154us (712us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051448.888266:0:10328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112246 00000100:00100000:3.0:1777051448.897175:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051448.897271:0:55658:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426045696 00000100:00100000:2.0:1777051448.897284:0:55658:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426045696 00002000:00100000:2.0:1777051448.897349:0:55658:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x1e5:0x0] (0->1048575) req@ffff99d94f518a80 x1863365426045696/t0(0) o3->c11b6966-0775-44d2-bdc6-c74c26eb2226@192.168.201.46@tcp:409/0 lens 488/0 e 0 to 0 dl 1777051459 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1777051448.897369:0:55658:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99d94f518a80 with x1863365426045696 ext(0->1048575) 00002000:00010000:2.0:1777051448.897379:0:55658:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99d94f518a80 00000100:00100000:2.0:1777051448.897429:0:55658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 1785 00000100:00100000:2.0:1777051448.897449:0:55658:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f518a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:c11b6966-0775-44d2-bdc6-c74c26eb2226+52:2436:x1863365426045696:12345-192.168.201.46@tcp:3:lhsmtool_posix.0 00000100:00100000:2.0:1777051448.916573:0:55658:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f518a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:c11b6966-0775-44d2-bdc6-c74c26eb2226+52:2436:x1863365426045696:12345-192.168.201.46@tcp:3:lhsmtool_posix.0 Request processed in 19118us (19393us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1777051448.916597:0:55658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 1785 00002000:00100000:2.0:1777051448.916652:0:55658:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x1e5:0x0] (0->1048575) req@ffff99d94f518a80 x1863365426045696/t0(0) o3->c11b6966-0775-44d2-bdc6-c74c26eb2226@192.168.201.46@tcp:409/0 lens 488/440 e 0 to 0 dl 1777051459 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1777051448.916669:0:55658:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99d94f518a80 with x1863365426045696 ext(0->1048575) 00002000:00010000:2.0:1777051448.916680:0:55658:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99d94f518a80 00000100:00100000:3.0:1777051448.934185:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051448.935709:0:6580:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426045824 00000100:00100000:1.0:1777051448.935725:0:6580:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426045824 00000100:00100000:1.0:1777051448.936115:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112247 00000100:00100000:1.0:1777051448.936134:0:6580:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f519f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+28:138747:x1863365426045824:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1777051448.936163:0:6580:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777051448.936190:0:6580:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce200/0x85f51a6b96716dd7 lrc: 2/0,0 mode: --/PR res: [0x2000032e3:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b67c3 expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051448.936275:0:6580:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce800/0x85f51a6b96716dde lrc: 3/1,0 mode: --/PR res: [0x2000032e3:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051448.936295:0:6580:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce800/0x85f51a6b96716dde lrc: 3/1,0 mode: PR/PR res: [0x2000032e3:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051448.936312:0:6580:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce800/0x85f51a6b96716dde lrc: 3/1,0 mode: PR/PR res: [0x2000032e3:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051448.936458:0:6580:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce200/0x85f51a6b96716dd7 lrc: 0/0,0 mode: --/PR res: [0x2000032e3:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b67c3 expref: 30 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051448.936481:0:6580:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce800/0x85f51a6b96716dde lrc: 3/0,0 mode: PR/PR res: [0x2000032e3:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b67c3 expref: 29 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051448.936495:0:6580:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e3:0x9:0x0].0x0 (ffff99da5fb45c00) 00010000:00010000:1.0:1777051448.936500:0:6580:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1777051448.936506:0:6580:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99da7d5ce800, rc 0) 00000100:00100000:1.0:1777051448.936596:0:6580:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f519f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+29:138747:x1863365426045824:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 Request processed in 466us (2422us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051448.936610:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112247 00000100:00100000:3.0:1777051448.942511:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051448.942608:0:6581:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426045952 00000100:00100000:2.0:1777051448.942661:0:6581:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426045952 00000100:00100000:2.0:1777051448.942745:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112248 00000100:00100000:2.0:1777051448.942762:0:6581:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f51bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+29:138747:x1863365426045952:12345-192.168.201.46@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1777051448.942799:0:6581:0:(mdt_handler.c:7958:mdt_fid2path()) path get [0x2000032e3:0x9:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1777051448.942967:0:6581:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f51bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+29:138747:x1863365426045952:12345-192.168.201.46@tcp:53:lhsmtool_posix.0 Request processed in 207us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051448.942981:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112248 00000100:00100000:1.0:1777051448.947316:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051448.947436:0:8628:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426046080 00000100:00100000:2.0:1777051448.947445:0:8628:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426046080 00000100:00100000:2.0:1777051448.947486:0:8628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 8069 00000100:00100000:2.0:1777051448.947494:0:8628:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da57c80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+52:2437:x1863365426046080:12345-192.168.201.46@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1777051448.947540:0:8628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000007e285376/0x85f51a6b96716de5 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x1e5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051448.947566:0:8628:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777051448.947569:0:8628:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777051448.947577:0:8628:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007e285376/0x85f51a6b96716de5 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x1e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051448.947599:0:8628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007e285376/0x85f51a6b96716de5 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x1e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051448.947664:0:8628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000007e285376/0x85f51a6b96716de5 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x1e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051448.947679:0:8628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007e285376/0x85f51a6b96716de5 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x1e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051448.947695:0:8628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007e285376/0x85f51a6b96716de5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x1e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051448.947709:0:8628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d950710a00 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:2.0:1777051448.947716:0:8628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007e285376/0x85f51a6b96716de5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x1e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051448.947738:0:8628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007e285376/0x85f51a6b96716de5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x1e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051448.947757:0:8628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007e285376/0x85f51a6b96716de5 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x1e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051448.948043:0:8628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007e285376/0x85f51a6b96716de5 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x1e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051448.948140:0:8628:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da57c80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+52:2437:x1863365426046080:12345-192.168.201.46@tcp:1:lhsmtool_posix.0 Request processed in 642us (826us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051448.948154:0:8628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 8069 00000100:00100000:3.0:1777051448.950056:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051448.950141:0:46494:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426046336 00000100:00100000:2.0:1777051448.950150:0:46494:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426046336 00000100:00100000:2.0:1777051448.950232:0:46494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112249 00000100:00100000:2.0:1777051448.950247:0:46494:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f518380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c11b6966-0775-44d2-bdc6-c74c26eb2226+29:138747:x1863365426046336:12345-192.168.201.46@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1777051448.950324:0:46494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710200/0x85f51a6b96716dec lrc: 3/0,1 mode: --/PW res: [0x2000032e3:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051448.950348:0:46494:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce800/0x85f51a6b96716dde lrc: 2/0,0 mode: PR/PR res: [0x2000032e3:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b67c3 expref: 29 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051448.950363:0:46494:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710200/0x85f51a6b96716dec lrc: 4/0,1 mode: --/PW res: [0x2000032e3:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051448.950419:0:46494:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce800/0x85f51a6b96716dde lrc: 3/0,0 mode: PR/PR res: [0x2000032e3:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b67c3 expref: 29 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051448.950446:0:46494:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce800/0x85f51a6b96716dde lrc: 4/0,0 mode: PR/PR res: [0x2000032e3:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b67c3 expref: 29 pid: 6580 timeout: 8178 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051448.950468:0:46494:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95612ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000_UUID:46494:1863365452659072:192.168.201.46@tcp:104: 00000100:00100000:2.0:1777051448.950575:0:46494:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da4a170300 going to sleep for 11 seconds 00000100:00100000:0.0:1777051448.952456:0:46494:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95612ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000_UUID:46494:1863365452659072:192.168.201.46@tcp:104: 00010000:00010000:0.0:1777051448.952485:0:46494:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710200/0x85f51a6b96716dec lrc: 3/0,1 mode: --/PW res: [0x2000032e3:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051448.952610:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051448.952737:0:6564:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426046464 00000100:00100000:1.0:1777051448.952744:0:6564:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426046464 00010000:00010000:1.0:1777051448.952775:0:6564:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce800/0x85f51a6b96716dde lrc: 4/0,0 mode: PR/PR res: [0x2000032e3:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b67c3 expref: 30 pid: 6580 timeout: 8178 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051448.953139:0:6564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3926 00000100:00100000:1.0:1777051448.953155:0:6564:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f519c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+30:2437:x1863365426046464:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1777051448.953172:0:6564:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1777051448.953209:0:6564:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce800/0x85f51a6b96716dde lrc: 4/0,0 mode: PR/PR res: [0x2000032e3:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b67c3 expref: 30 pid: 6580 timeout: 8178 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051448.953236:0:6564:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce800/0x85f51a6b96716dde lrc: 3/0,0 mode: PR/PR res: [0x2000032e3:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b67c3 expref: 30 pid: 6580 timeout: 8178 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051448.953264:0:6564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce800/0x85f51a6b96716dde lrc: 0/0,0 mode: --/PR res: [0x2000032e3:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b67c3 expref: 30 pid: 6580 timeout: 8178 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051448.953282:0:6564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e3:0x9:0x0].0x0 (ffff99da5fb45c00) 00010000:00010000:1.0:1777051448.953290:0:6564:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710200/0x85f51a6b96716dec lrc: 3/0,1 mode: --/PW res: [0x2000032e3:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051448.953303:0:6564:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710200/0x85f51a6b96716dec lrc: 3/0,1 mode: PW/PW res: [0x2000032e3:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051448.953314:0:6564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710200/0x85f51a6b96716dec lrc: 4/0,1 mode: PW/PW res: [0x2000032e3:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051448.953353:0:6564:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1777051448.953404:0:6564:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f519c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+29:2437:x1863365426046464:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 252us (797us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051448.953417:0:6564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3926 00010000:00010000:3.0:1777051448.953450:0:46494:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710200/0x85f51a6b96716dec lrc: 3/0,1 mode: PW/PW res: [0x2000032e3:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051448.953466:0:46494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710200/0x85f51a6b96716dec lrc: 3/0,1 mode: PW/PW res: [0x2000032e3:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051448.954440:0:46494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710200/0x85f51a6b96716dec lrc: 3/0,1 mode: PW/PW res: [0x2000032e3:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051448.954454:0:46494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710200/0x85f51a6b96716dec lrc: 2/0,0 mode: PW/PW res: [0x2000032e3:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051448.954530:0:46494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710200/0x85f51a6b96716dec lrc: 3/0,0 mode: PW/PW res: [0x2000032e3:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051448.954540:0:46494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d950710200 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:3.0:1777051448.954547:0:46494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710200/0x85f51a6b96716dec lrc: 3/0,0 mode: PW/PW res: [0x2000032e3:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051448.954557:0:46494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710200/0x85f51a6b96716dec lrc: 4/0,0 mode: PW/PW res: [0x2000032e3:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051448.954574:0:46494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e3:0x9:0x0].0x0 (ffff99da5fb45c00) 00010000:00010000:3.0:1777051448.954579:0:46494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1777051448.954585:0:46494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710200/0x85f51a6b96716dec lrc: 2/0,0 mode: --/PW res: [0x2000032e3:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051448.954595:0:46494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710200/0x85f51a6b96716dec lrc: 0/0,0 mode: --/PW res: [0x2000032e3:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051448.955256:0:46494:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f518380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c11b6966-0775-44d2-bdc6-c74c26eb2226+29:138747:x1863365426046336:12345-192.168.201.46@tcp:57:lhsmtool_posix.0 Request processed in 4787us (4980us total) trans 30064771199 rc 0/0 00000100:00100000:3.0:1777051448.955273:0:46494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112249 00000040:00080000:1.0:1777051448.955663:0:103189:0:(llog.c:801:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:1.0:1777051448.955671:0:103189:0:(llog_cat.c:158:llog_cat_process_common()) processing log [0x1:0x2b:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1777051448.956672:0:103189:0:(llog.c:858:llog_process_thread()) stop processing plain [0x1:0x2b:0x0] index 64768 count 6 00000040:00080000:1.0:1777051448.956684:0:103189:0:(llog.c:858:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00000100:00100000:3.0:1777051448.957448:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051448.957517:0:6583:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426046720 00000100:00100000:2.0:1777051448.957527:0:6583:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426046720 00000100:00100000:2.0:1777051448.957569:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3400 00000100:00100000:2.0:1777051448.957578:0:6583:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f518700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+29:138747:x1863365426046720:12345-192.168.201.46@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1777051448.957800:0:6583:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f518700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+30:138747:x1863365426046720:12345-192.168.201.46@tcp:35:lhsmtool_posix.0 Request processed in 219us (352us total) trans 30064771200 rc 0/0 00000100:00100000:2.0:1777051448.957813:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3400 00000040:00080000:3.0:1777051449.009646:0:107897:0:(llog.c:801:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:3.0:1777051449.009657:0:107897:0:(llog_cat.c:158:llog_cat_process_common()) processing log [0x1:0x2b:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1777051449.009718:0:107897:0:(llog.c:858:llog_process_thread()) stop processing plain [0x1:0x2b:0x0] index 8 count 6 00000040:00080000:3.0:1777051449.009728:0:107897:0:(llog.c:858:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00000100:00100000:3.0:1777051449.045651:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051449.045730:0:27887:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426046848 00000100:00100000:2.0:1777051449.045746:0:27887:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426046848 00000100:00100000:2.0:1777051449.045855:0:27887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 8070 00000100:00100000:2.0:1777051449.045875:0:27887:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f51b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+52:2439:x1863365426046848:12345-192.168.201.46@tcp:101:lfs.0 00010000:00010000:2.0:1777051449.045899:0:27887:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051449.045924:0:27887:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007e285376/0x85f51a6b96716df3 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x1e5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b67ca expref: -99 pid: 27887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051449.045980:0:27887:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777051449.045984:0:27887:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777051449.046003:0:27887:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007e285376/0x85f51a6b96716df3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x1e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b67ca expref: 53 pid: 27887 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051449.046034:0:27887:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007e285376/0x85f51a6b96716df3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x1e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b67ca expref: 53 pid: 27887 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051449.046055:0:27887:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d950710a00, rc 0) 00000100:00100000:2.0:1777051449.046459:0:27887:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f51b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+53:2439:x1863365426046848:12345-192.168.201.46@tcp:101:lfs.0 Request processed in 586us (849us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051449.046475:0:27887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 8070 00000100:00080000:3.0:1777051449.046493:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1777051449.053668:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051449.053780:0:6579:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426047104 00000100:00100000:3.0:1777051449.053794:0:6579:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426047104 00000100:00100000:3.0:1777051449.053902:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112250 00000100:00100000:3.0:1777051449.053922:0:6579:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d956129c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+35:138748:x1863365426047104:12345-192.168.201.46@tcp:101:lfs.0 00000100:00080000:2.0:1777051449.053924:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1777051449.053951:0:6579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777051449.053981:0:6579:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3200/0x85f51a6b96716dfa lrc: 2/0,0 mode: --/CR res: [0x2000032e3:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b67d1 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051449.054136:0:6579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3400/0x85f51a6b96716e01 lrc: 3/0,1 mode: --/PW res: [0x2000032e3:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051449.054176:0:6579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3400/0x85f51a6b96716e01 lrc: 3/0,1 mode: PW/PW res: [0x2000032e3:0x9:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051449.054196:0:6579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3400/0x85f51a6b96716e01 lrc: 3/0,1 mode: PW/PW res: [0x2000032e3:0x9:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1777051449.054216:0:6579:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000032e3:0x9:0x0]: returning size 1048576 00010000:00010000:3.0:1777051449.054376:0:6579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3200/0x85f51a6b96716dfa lrc: 0/0,0 mode: --/CR res: [0x2000032e3:0x9:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b67d1 expref: 38 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051449.054410:0:6579:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3400/0x85f51a6b96716e01 lrc: 3/0,0 mode: PW/PW res: [0x2000032e3:0x9:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b67d1 expref: 37 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051449.054426:0:6579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e3:0x9:0x0].0x0 (ffff99da5fb45c00) 00010000:00010000:3.0:1777051449.054432:0:6579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1777051449.054438:0:6579:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d9559a3400, rc 0) 00000100:00100000:3.0:1777051449.054558:0:6579:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d956129c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+37:138748:x1863365426047104:12345-192.168.201.46@tcp:101:lfs.0 Request processed in 642us (895us total) trans 30064771201 rc 0/0 00000100:00100000:3.0:1777051449.054573:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112250 00000100:00100000:3.0:1777051449.059495:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051449.059654:0:8470:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426047232 00000100:00100000:2.0:1777051449.059665:0:8470:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426047232 00000100:00100000:2.0:1777051449.059746:0:8470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 8071 00000100:00100000:2.0:1777051449.059771:0:8470:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7c9a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+53:2436:x1863365426047232:12345-192.168.201.46@tcp:1:lfs.0 00010000:00010000:2.0:1777051449.059866:0:8470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf80fdac/0x85f51a6b96716e0f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1e5:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051449.059902:0:8470:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000058c01b68/0x85f51a6b96716dd0 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x1e5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b67bc expref: 51 pid: 8471 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051449.059923:0:8470:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007e285376/0x85f51a6b96716df3 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x1e5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b67ca expref: 53 pid: 27887 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051449.059942:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777051449.059946:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777051449.059954:0:8470:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cf80fdac/0x85f51a6b96716e0f lrc: 5/0,1 mode: --/PW res: [0x280000401:0x1e5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051449.060008:0:8470:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007e285376/0x85f51a6b96716df3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x1e5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b67ca expref: 53 pid: 27887 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051449.060034:0:8470:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007e285376/0x85f51a6b96716df3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x1e5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b67ca expref: 53 pid: 27887 timeout: 8178 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051449.060412:0:8470:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d956129880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8470:1863365452659200:192.168.201.46@tcp:104: 00010000:00010000:2.0:1777051449.060571:0:8470:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000058c01b68/0x85f51a6b96716dd0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x1e5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b67bc expref: 51 pid: 8471 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051449.060594:0:8470:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000058c01b68/0x85f51a6b96716dd0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x1e5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b67bc expref: 51 pid: 8471 timeout: 8178 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051449.060650:0:8470:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95612a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8470:1863365452659328:192.168.201.46@tcp:104: 00000100:00100000:2.0:1777051449.060711:0:8470:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da4a170300 going to sleep for 11 seconds 00000100:00100000:2.0:1777051449.066703:0:8470:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d956129880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8470:1863365452659200:192.168.201.46@tcp:104: 00000100:00100000:2.0:1777051449.066732:0:8470:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95612a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8470:1863365452659328:192.168.201.46@tcp:104: 00010000:00010000:2.0:1777051449.066774:0:8470:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000cf80fdac/0x85f51a6b96716e0f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1e5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051449.067701:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051449.067818:0:9550:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426047360 00000100:00100000:1.0:1777051449.067829:0:9550:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426047360 00010000:00010000:1.0:1777051449.067881:0:9550:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007e285376/0x85f51a6b96716df3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x1e5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b67ca expref: 54 pid: 27887 timeout: 8178 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051449.067958:0:9550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3927 00000100:00100000:1.0:1777051449.067977:0:9550:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7cd9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+54:2437:x1863365426047360:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1777051449.068000:0:9550:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1777051449.068034:0:9550:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007e285376/0x85f51a6b96716df3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x1e5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b67ca expref: 54 pid: 27887 timeout: 8178 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051449.068065:0:9550:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007e285376/0x85f51a6b96716df3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x1e5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b67ca expref: 54 pid: 27887 timeout: 8178 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051449.068103:0:9550:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007e285376/0x85f51a6b96716df3 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x1e5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b67ca expref: 54 pid: 27887 timeout: 8178 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051449.068134:0:9550:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1777051449.068725:0:9550:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7cd9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+53:2437:x1863365426047360:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 747us (1022us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051449.069063:0:9550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3927 00000100:00100000:2.0:1777051449.069452:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051449.069516:0:24467:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426047488 00000100:00100000:0.0:1777051449.069530:0:24467:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426047488 00010000:00010000:0.0:1777051449.069601:0:24467:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000058c01b68/0x85f51a6b96716dd0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x1e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b67bc expref: 52 pid: 8471 timeout: 8178 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1777051449.069602:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1777051449.070031:0:24467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3928 00000100:00100000:0.0:1777051449.070050:0:24467:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95612a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+52:2437:x1863365426047488:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1777051449.070069:0:24467:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777051449.070092:0:24467:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000058c01b68/0x85f51a6b96716dd0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x1e5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b67bc expref: 52 pid: 8471 timeout: 8178 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051449.070129:0:24467:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000058c01b68/0x85f51a6b96716dd0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x1e5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b67bc expref: 52 pid: 8471 timeout: 8178 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051449.070160:0:24467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000058c01b68/0x85f51a6b96716dd0 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x1e5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b67bc expref: 52 pid: 8471 timeout: 8178 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051449.070184:0:24467:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777051449.070188:0:24467:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777051449.070195:0:24467:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000cf80fdac/0x85f51a6b96716e0f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051449.070273:0:24467:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cf80fdac/0x85f51a6b96716e0f lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051449.070339:0:24467:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1777051449.070402:0:8470:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000cf80fdac/0x85f51a6b96716e0f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051449.070414:0:24467:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95612a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+51:2437:x1863365426047488:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 363us (960us total) trans 0 rc 0/0 00010000:00010000:2.0:1777051449.070445:0:8470:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cf80fdac/0x85f51a6b96716e0f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051449.070449:0:24467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3928 00010000:00010000:2.0:1777051449.070495:0:8470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf80fdac/0x85f51a6b96716e0f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051449.070516:0:8470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cf80fdac/0x85f51a6b96716e0f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051449.070535:0:8470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cf80fdac/0x85f51a6b96716e0f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051449.070553:0:8470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d950711a00 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:2.0:1777051449.070562:0:8470:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf80fdac/0x85f51a6b96716e0f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051449.070580:0:8470:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf80fdac/0x85f51a6b96716e0f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051449.070606:0:8470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cf80fdac/0x85f51a6b96716e0f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051449.070664:0:8470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cf80fdac/0x85f51a6b96716e0f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051449.070786:0:8470:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7c9a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+52:2436:x1863365426047232:12345-192.168.201.46@tcp:1:lfs.0 Request processed in 11020us (11293us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051449.070807:0:8470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 8071 00000100:00100000:2.0:1777051449.073766:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051449.073876:0:46501:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426047744 00000100:00100000:3.0:1777051449.073887:0:46501:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426047744 00000100:00100000:3.0:1777051449.073990:0:46501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3401 00000100:00100000:3.0:1777051449.074020:0:46501:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d956129880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+37:138748:x1863365426047744:12345-192.168.201.46@tcp:35:lfs.0 00000004:00010000:3.0:1777051449.074115:0:46501:0:(mdt_open.c:1994:mdt_hsm_release()) ### [0x2000032e3:0x9:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3400/0x85f51a6b96716e01 lrc: 3/0,0 mode: PW/PW res: [0x2000032e3:0x9:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b67d1 expref: 37 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1777051449.074494:0:46501:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 30064771202 00000001:00080000:3.0:1777051449.075477:0:46501:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 30064771203 00010000:00010000:3.0:1777051449.075548:0:46501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3200/0x85f51a6b96716e16 lrc: 3/0,1 mode: --/EX res: [0x2000032e3:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 46501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051449.075578:0:46501:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99d950704a00/0x85f51a6b96716cfe lrc: 2/0,0 mode: PR/PR res: [0x2000032e3:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b676f expref: 29 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051449.075596:0:46501:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3000/0x85f51a6b96716d91 lrc: 2/0,0 mode: PR/PR res: [0x2000032e3:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6799 expref: 40 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051449.075645:0:46501:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3200/0x85f51a6b96716e16 lrc: 5/0,1 mode: --/EX res: [0x2000032e3:0x9:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 46501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051449.075699:0:46501:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3000/0x85f51a6b96716d91 lrc: 3/0,0 mode: PR/PR res: [0x2000032e3:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6799 expref: 40 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051449.075724:0:46501:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3000/0x85f51a6b96716d91 lrc: 4/0,0 mode: PR/PR res: [0x2000032e3:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6799 expref: 40 pid: 6579 timeout: 8178 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051449.075748:0:46501:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7c9a1c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:46501:1863365452659456:192.168.201.46@tcp:104: 00010000:00010000:3.0:1777051449.075898:0:46501:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99d950704a00/0x85f51a6b96716cfe lrc: 3/0,0 mode: PR/PR res: [0x2000032e3:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b676f expref: 29 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051449.075919:0:46501:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950704a00/0x85f51a6b96716cfe lrc: 4/0,0 mode: PR/PR res: [0x2000032e3:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b676f expref: 29 pid: 46497 timeout: 8178 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051449.075939:0:46501:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7c9a3800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:46501:1863365452659584:192.168.201.46@tcp:104: 00000100:00100000:3.0:1777051449.075990:0:46501:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d956bda600 going to sleep for 11 seconds 00000100:00100000:3.0:1777051449.081898:0:46501:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7c9a3800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:46501:1863365452659584:192.168.201.46@tcp:104: 00000100:00100000:2.0:1777051449.082064:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051449.082238:0:47827:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426047872 00000100:00100000:3.0:1777051449.082411:0:47827:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426047872 00010000:00010000:3.0:1777051449.082461:0:47827:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d950704a00/0x85f51a6b96716cfe lrc: 4/0,0 mode: PR/PR res: [0x2000032e3:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b676f expref: 30 pid: 46497 timeout: 8178 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051449.082549:0:47827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3929 00000100:00100000:3.0:1777051449.082569:0:47827:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d956128000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+30:2436:x1863365426047872:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1777051449.082591:0:47827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777051449.082605:0:47827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99d950704a00/0x85f51a6b96716cfe lrc: 4/0,0 mode: PR/PR res: [0x2000032e3:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b676f expref: 30 pid: 46497 timeout: 8178 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051449.082670:0:47827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99d950704a00/0x85f51a6b96716cfe lrc: 3/0,0 mode: PR/PR res: [0x2000032e3:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b676f expref: 30 pid: 46497 timeout: 8178 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051449.082707:0:47827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d950704a00/0x85f51a6b96716cfe lrc: 0/0,0 mode: --/PR res: [0x2000032e3:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b676f expref: 30 pid: 46497 timeout: 8178 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051449.082747:0:47827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e3:0x9:0x0].0x0 (ffff99da5fb45c00) 00010000:00010000:3.0:1777051449.082988:0:47827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3200/0x85f51a6b96716e16 lrc: 3/0,1 mode: --/EX res: [0x2000032e3:0x9:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 46501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051449.083006:0:47827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3200/0x85f51a6b96716e16 lrc: 3/0,1 mode: --/EX res: [0x2000032e3:0x9:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 46501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051449.083021:0:47827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1777051449.083115:0:47827:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d956128000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+29:2436:x1863365426047872:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 549us (1053us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051449.083453:0:47827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3929 00000100:00100000:3.0:1777051449.083540:0:46501:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7c9a1c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:46501:1863365452659456:192.168.201.46@tcp:104: 00000100:00100000:1.0:1777051449.083597:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00010000:00010000:3.0:1777051449.083598:0:46501:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3200/0x85f51a6b96716e16 lrc: 3/0,1 mode: --/EX res: [0x2000032e3:0x9:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 46501 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051449.083756:0:6566:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426048000 00000100:00100000:2.0:1777051449.083765:0:6566:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426048000 00010000:00010000:2.0:1777051449.083797:0:6566:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3000/0x85f51a6b96716d91 lrc: 4/0,0 mode: PR/PR res: [0x2000032e3:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6799 expref: 41 pid: 6579 timeout: 8178 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051449.083858:0:6566:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3930 00000100:00100000:2.0:1777051449.083877:0:6566:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f65aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+41:2436:x1863365426048000:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1777051449.083896:0:6566:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777051449.083907:0:6566:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3000/0x85f51a6b96716d91 lrc: 4/0,0 mode: PR/PR res: [0x2000032e3:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6799 expref: 41 pid: 6579 timeout: 8178 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051449.083931:0:6566:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3000/0x85f51a6b96716d91 lrc: 3/0,0 mode: PR/PR res: [0x2000032e3:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6799 expref: 41 pid: 6579 timeout: 8178 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051449.083959:0:6566:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3000/0x85f51a6b96716d91 lrc: 0/0,0 mode: --/PR res: [0x2000032e3:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6799 expref: 41 pid: 6579 timeout: 8178 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051449.083981:0:6566:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e3:0x9:0x0].0x0 (ffff99da5fb45c00) 00010000:00010000:2.0:1777051449.083986:0:6566:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3200/0x85f51a6b96716e16 lrc: 3/0,1 mode: --/EX res: [0x2000032e3:0x9:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 46501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051449.084005:0:6566:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3200/0x85f51a6b96716e16 lrc: 3/0,1 mode: EX/EX res: [0x2000032e3:0x9:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 46501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051449.084019:0:6566:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3200/0x85f51a6b96716e16 lrc: 4/0,1 mode: EX/EX res: [0x2000032e3:0x9:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 46501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051449.084761:0:6566:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1777051449.084781:0:46501:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3200/0x85f51a6b96716e16 lrc: 3/0,1 mode: EX/EX res: [0x2000032e3:0x9:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 46501 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051449.084797:0:6566:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f65aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+40:2436:x1863365426048000:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 933us (1216us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051449.084797:0:6566:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3930 00010000:00010000:3.0:1777051449.084797:0:46501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3200/0x85f51a6b96716e16 lrc: 3/0,1 mode: EX/EX res: [0x2000032e3:0x9:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 46501 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1777051449.084969:0:46501:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 30064771204 00000001:00080000:3.0:1777051449.085157:0:46501:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 30064771205 00000001:00080000:3.0:1777051449.085274:0:46501:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 30064771206 00000100:00100000:2.0:1777051449.085457:0:46501:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95612a680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:46501:1863365452659712:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:2.0:1777051449.085510:0:46501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051449.085564:0:46501:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da4a170300 going to sleep for 11 seconds 00000100:00100000:1.0:1777051449.085667:0:11727:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452659712 00000100:00100000:1.0:1777051449.085678:0:11727:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452659712 00000100:00080000:2.0:1777051449.086115:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1777051449.086130:0:11727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8230 00000100:00100000:1.0:1777051449.086509:0:11727:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d956128a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:46501:x1863365452659712:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:1.0:1777051449.087030:0:11727:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d956128a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:46501:x1863365452659712:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 882us (1515us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051449.087046:0:11727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8230 00000100:00100000:0.0:1777051449.090181:0:46501:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95612a680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:46501:1863365452659712:0@lo:1000:mdt_rdpg00_003.0 00000001:00080000:0.0:1777051449.090447:0:46501:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 30064771207 00000100:00100000:0.0:1777051449.090546:0:46501:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7cd9e680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:46501:1863365452659840:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:0.0:1777051449.090660:0:46501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051449.090716:0:46501:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da5837ae40 going to sleep for 11 seconds 00000100:00100000:3.0:1777051449.091267:0:6585:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452659840 00000100:00100000:3.0:1777051449.091280:0:6585:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452659840 00000100:00100000:3.0:1777051449.091369:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8231 00000100:00100000:3.0:1777051449.091387:0:6585:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7cd9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:46501:x1863365452659840:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1777051449.091675:0:6585:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7cd9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:46501:x1863365452659840:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 291us (1013us total) trans 4294968368 rc 0/0 00000100:00100000:3.0:1777051449.091695:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8231 00000100:00100000:1.0:1777051449.092317:0:46501:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7cd9e680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:46501:1863365452659840:0@lo:1000:mdt_rdpg00_003.0 00010000:00010000:1.0:1777051449.092370:0:46501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3200/0x85f51a6b96716e16 lrc: 3/0,1 mode: EX/EX res: [0x2000032e3:0x9:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 46501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051449.092389:0:46501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3200/0x85f51a6b96716e16 lrc: 2/0,0 mode: EX/EX res: [0x2000032e3:0x9:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 46501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051449.092404:0:46501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3200/0x85f51a6b96716e16 lrc: 3/0,0 mode: EX/EX res: [0x2000032e3:0x9:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 46501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051449.092418:0:46501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d9559a3200 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:1.0:1777051449.092426:0:46501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3200/0x85f51a6b96716e16 lrc: 3/0,0 mode: EX/EX res: [0x2000032e3:0x9:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 46501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051449.092443:0:46501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3200/0x85f51a6b96716e16 lrc: 4/0,0 mode: EX/EX res: [0x2000032e3:0x9:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 46501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051449.092468:0:46501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e3:0x9:0x0].0x0 (ffff99da5fb45c00) 00010000:00010000:1.0:1777051449.092476:0:46501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1777051449.092485:0:46501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3200/0x85f51a6b96716e16 lrc: 2/0,0 mode: --/EX res: [0x2000032e3:0x9:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 46501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051449.092498:0:46501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3200/0x85f51a6b96716e16 lrc: 0/0,0 mode: --/EX res: [0x2000032e3:0x9:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 46501 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1777051449.092733:0:46501:0:(mdd_object.c:4010:mdd_close()) Object [0x2000032e2:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1777051449.093186:0:46501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x27:0x0].4, 64 off8448 00000004:00080000:1.0:1777051449.093702:0:46501:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 8078286503913ns, next at 8079286499399ns, rc = 0 00000001:00080000:1.0:1777051449.093716:0:46501:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 30064771208 00010000:00010000:1.0:1777051449.093774:0:46501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e3:0x9:0x0].0x0 (ffff99da5fb45c00) 00010000:00010000:1.0:1777051449.093782:0:46501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1777051449.093795:0:46501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3400/0x85f51a6b96716e01 lrc: 0/0,0 mode: --/PW res: [0x2000032e3:0x9:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b67d1 expref: 44 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051449.094787:0:46501:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d956129880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+43:138748:x1863365426047744:12345-192.168.201.46@tcp:35:lfs.0 Request processed in 20778us (21023us total) trans 30064771209 rc 0/0 00000100:00100000:1.0:1777051449.094808:0:46501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3401 00000020:00080000:1.0:1777051449.094818:0:46501:0:(tgt_main.c:783:tgt_ses_key_exit()) total 8 transactions per RPC 00000100:00100000:1.0:1777051449.117194:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051449.117321:0:10328:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426048256 00000100:00100000:0.0:1777051449.117335:0:10328:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426048256 00000100:00100000:0.0:1777051449.117421:0:10328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112251 00000100:00100000:0.0:1777051449.117441:0:10328:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f659c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+43:138749:x1863365426048256:12345-192.168.201.46@tcp:101:lfs.0 00010000:00010000:0.0:1777051449.117477:0:10328:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051449.117525:0:10328:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d950705e00/0x85f51a6b96716e1d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b67d8 expref: -99 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1777051449.117696:0:10328:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000032e2:0x8:0x0]: returning size 4096 00010000:00010000:0.0:1777051449.117852:0:10328:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950705e00/0x85f51a6b96716e1d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b67d8 expref: 45 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051449.117877:0:10328:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d9533ab000) 00010000:00010000:0.0:1777051449.117882:0:10328:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1777051449.117889:0:10328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d950705e00/0x85f51a6b96716e1d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b67d8 expref: 45 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051449.117909:0:10328:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d950705e00, rc 0) 00000100:00100000:0.0:1777051449.117988:0:10328:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f659c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+44:138749:x1863365426048256:12345-192.168.201.46@tcp:101:lfs.0 Request processed in 551us (805us total) trans 30064771210 rc 301/301 00000100:00100000:0.0:1777051449.118003:0:10328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112251 00000100:00100000:2.0:1777051449.123105:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051449.123220:0:6583:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426048512 00000100:00100000:0.0:1777051449.123233:0:6583:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426048512 00000100:00100000:0.0:1777051449.123321:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3402 00000100:00100000:0.0:1777051449.123343:0:6583:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d956128380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+44:138749:x1863365426048512:12345-192.168.201.46@tcp:35:lfs.0 00000100:00100000:0.0:1777051449.123704:0:6583:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d956128380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+45:138749:x1863365426048512:12345-192.168.201.46@tcp:35:lfs.0 Request processed in 364us (601us total) trans 30064771211 rc 0/0 00000100:00100000:0.0:1777051449.123720:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3402 00000100:00100000:0.0:1777051449.129876:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051449.129966:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051449.130009:0:9550:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426048640 00000100:00100000:1.0:1777051449.130021:0:9550:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426048640 00000100:00100000:1.0:1777051449.130101:0:9550:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426048768 00000100:00100000:0.0:1777051449.130111:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051449.130111:0:9550:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426048768 00000100:00100000:1.0:1777051449.130176:0:9550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13709 00000100:00100000:1.0:1777051449.130193:0:9550:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7cd9ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+46:2437:x1863365426048640:12345-192.168.201.46@tcp:103:lfs.0 00000100:00100000:0.0:1777051449.130199:0:6565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13710 00010000:00010000:1.0:1777051449.130222:0:9550:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1777051449.130231:0:6565:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da53b97850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+46:2437:x1863365426048768:12345-192.168.201.46@tcp:103:lfs.0 00010000:00010000:0.0:1777051449.130255:0:6565:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1777051449.130266:0:9550:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d9418d3c00/0x85f51a6b96716d59 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b678b expref: 46 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051449.130290:0:6565:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d9418d3e00/0x85f51a6b96716da6 lrc: 0/0,0 mode: --/PR res: [0x2000032e2:0x8:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b67a7 expref: 45 pid: 21368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051449.130298:0:9550:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d9533ab000) 00010000:00010000:1.0:1777051449.130313:0:9550:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1777051449.130347:0:6565:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d9418d3a00/0x85f51a6b96716d75 lrc: 0/0,0 mode: --/PR res: [0x2000032e2:0x8:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6792 expref: 44 pid: 46494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051449.130373:0:6565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0x8:0x0].0x0 (ffff99d94e6b6200) 00010000:00010000:0.0:1777051449.130384:0:6565:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1777051449.130387:0:9550:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7cd9ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+43:2437:x1863365426048640:12345-192.168.201.46@tcp:103:lfs.0 Request processed in 190us (510us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051449.130405:0:9550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13709 00000100:00100000:0.0:1777051449.130478:0:6565:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da53b97850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+42:2437:x1863365426048768:12345-192.168.201.46@tcp:103:lfs.0 Request processed in 214us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051449.130497:0:6565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13710 00000100:00100000:0.0:1777051449.130695:0:6593:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426049024 00000100:00100000:0.0:1777051449.130704:0:6593:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426049024 00000100:00080000:2.0:1777051449.131101:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1777051449.131140:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 8 00000100:00100000:0.0:1777051449.131488:0:6593:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7cd9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_001:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+52:138749:x1863365426049024:12345-192.168.201.46@tcp:36:lfs.0 00010000:00010000:0.0:1777051449.131642:0:6593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950704800/0x85f51a6b96716e2b lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051449.131663:0:6593:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950704800/0x85f51a6b96716e2b lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051449.131682:0:6593:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950704800/0x85f51a6b96716e2b lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6593 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051449.131720:0:6593:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7cd9ca80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0001-mdtlov_UUID:6593:1863365452659968:0@lo:101:mdt_io00_001.0 00000100:00100000:0.0:1777051449.131781:0:6593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051449.131829:0:6593:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da5837af00 going to sleep for 11 seconds 00000100:00100000:3.0:1777051449.131920:0:6584:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452659968 00000100:00100000:3.0:1777051449.131931:0:6584:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452659968 00000100:00100000:3.0:1777051449.132027:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8232 00000100:00100000:3.0:1777051449.132045:0:6584:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7cd9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:6593:x1863365452659968:12345-0@lo:101:mdt_io00_001.0 00010000:00010000:3.0:1777051449.132066:0:6584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777051449.132101:0:6584:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2a00/0x85f51a6b96716e32 lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x85f51a6b96716e2b expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051449.132440:0:6584:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2a00/0x85f51a6b96716e32 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x85f51a6b96716e2b expref: 7 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051449.132469:0:6584:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2a00/0x85f51a6b96716e32 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b96716e2b expref: 7 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051449.132484:0:6584:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000004:0x1:0x0].0x0 (ffff99d9413d0200) 00010000:00010000:3.0:1777051449.132492:0:6584:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777051449.132498:0:6584:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d9559a2a00, rc 0) 00000100:00100000:3.0:1777051449.132593:0:6584:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7cd9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:6593:x1863365452659968:12345-0@lo:101:mdt_io00_001.0 Request processed in 551us (810us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051449.132605:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8232 00000100:00100000:2.0:1777051449.133174:0:6593:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7cd9ca80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0001-mdtlov_UUID:6593:1863365452659968:0@lo:101:mdt_io00_001.0 00010000:00010000:2.0:1777051449.133206:0:6593:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950704800/0x85f51a6b96716e2b lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x85f51a6b96716e32 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051449.133229:0:6593:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950704800/0x85f51a6b96716e2b lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x85f51a6b96716e32 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1777051449.133266:0:6593:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000004:00080000:2.0:1777051449.133300:0:6593:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000100:00100000:2.0:1777051449.133563:0:6593:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95612a300 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0001-mdtlov_UUID:6593:1863365452660096:0@lo:1000:mdt_io00_001.0 00000100:00100000:2.0:1777051449.133652:0:6593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051449.133708:0:6593:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da4a170b40 going to sleep for 11 seconds 00000100:00100000:1.0:1777051449.133952:0:47208:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452660096 00000100:00100000:1.0:1777051449.133961:0:47208:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452660096 00000100:00100000:1.0:1777051449.134036:0:47208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8233 00000100:00100000:1.0:1777051449.134052:0:47208:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d956128000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+7:6593:x1863365452660096:12345-0@lo:1000:mdt_io00_001.0 00000100:00100000:1.0:1777051449.134500:0:47208:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d956128000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+7:6593:x1863365452660096:12345-0@lo:1000:mdt_io00_001.0 Request processed in 450us (846us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051449.134517:0:47208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8233 00000100:00100000:3.0:1777051449.134592:0:6593:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95612a300 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0001-mdtlov_UUID:6593:1863365452660096:0@lo:1000:mdt_io00_001.0 00000100:00100000:2.0:1777051449.134928:0:6593:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95612a300 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0001-mdtlov_UUID:6593:1863365452660224:0@lo:1000:mdt_io00_001.0 00000100:00100000:2.0:1777051449.134985:0:6593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051449.135039:0:6593:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da6fdb6240 going to sleep for 11 seconds 00000100:00100000:3.0:1777051449.135225:0:46500:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452660224 00000100:00100000:3.0:1777051449.135236:0:46500:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452660224 00000100:00100000:3.0:1777051449.135308:0:46500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8234 00000100:00100000:2.0:1777051449.135371:0:46500:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95612a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+7:6593:x1863365452660224:12345-0@lo:1000:mdt_io00_001.0 00000100:00100000:2.0:1777051449.135520:0:46500:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95612a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+7:6593:x1863365452660224:12345-0@lo:1000:mdt_io00_001.0 Request processed in 195us (534us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051449.135534:0:46500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8234 00000100:00100000:3.0:1777051449.135716:0:6593:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95612a300 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0001-mdtlov_UUID:6593:1863365452660224:0@lo:1000:mdt_io00_001.0 00000100:00100000:3.0:1777051449.135785:0:6593:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7c9a1c00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0001-mdtlov_UUID:6593:1863365452660352:0@lo:1000:mdt_io00_001.0 00000100:00100000:3.0:1777051449.135834:0:6593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051449.135879:0:6593:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d956bda900 going to sleep for 11 seconds 00000100:00100000:2.0:1777051449.135930:0:46498:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452660352 00000100:00100000:2.0:1777051449.135940:0:46498:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452660352 00000100:00100000:2.0:1777051449.136013:0:46498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8235 00000100:00100000:2.0:1777051449.136028:0:46498:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7c9a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+7:6593:x1863365452660352:12345-0@lo:1000:mdt_io00_001.0 00000100:00100000:2.0:1777051449.136226:0:46498:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7c9a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+7:6593:x1863365452660352:12345-0@lo:1000:mdt_io00_001.0 Request processed in 200us (389us total) trans 0 rc 1/1 00000100:00100000:2.0:1777051449.136240:0:46498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8235 00000100:00100000:1.0:1777051449.136340:0:6593:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7c9a1c00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0001-mdtlov_UUID:6593:1863365452660352:0@lo:1000:mdt_io00_001.0 00000100:00100000:1.0:1777051449.136475:0:6593:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95f659f80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0001-mdtlov_UUID:6593:1863365452660480:0@lo:1000:mdt_io00_001.0 00000100:00100000:1.0:1777051449.136528:0:6593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051449.136575:0:6593:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da7b379e40 going to sleep for 11 seconds 00000100:00100000:2.0:1777051449.136659:0:11727:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452660480 00000100:00100000:2.0:1777051449.136669:0:11727:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452660480 00000100:00100000:2.0:1777051449.136730:0:11727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8236 00000100:00100000:2.0:1777051449.137074:0:11727:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f65b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:6593:x1863365452660480:12345-0@lo:1000:mdt_io00_001.0 00000100:00100000:2.0:1777051449.137353:0:11727:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f65b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:6593:x1863365452660480:12345-0@lo:1000:mdt_io00_001.0 Request processed in 610us (824us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051449.137368:0:11727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8236 00000100:00100000:2.0:1777051449.137420:0:6593:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95f659f80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0001-mdtlov_UUID:6593:1863365452660480:0@lo:1000:mdt_io00_001.0 00010000:00010000:2.0:1777051449.137503:0:6593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950711a00/0x85f51a6b96716e39 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 6593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051449.137522:0:6593:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950711a00/0x85f51a6b96716e39 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 6593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051449.137541:0:6593:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950711a00/0x85f51a6b96716e39 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x1000000000000 pid: 6593 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051449.137568:0:6593:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95612ad80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0001-mdtlov_UUID:6593:1863365452660608:0@lo:101:mdt_io00_001.0 00000100:00100000:2.0:1777051449.137663:0:6593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051449.137701:0:6593:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da6fdb6600 going to sleep for 11 seconds 00000100:00100000:3.0:1777051449.137991:0:6584:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452660608 00000100:00100000:3.0:1777051449.138003:0:6584:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452660608 00000100:00100000:3.0:1777051449.138074:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8237 00000100:00100000:3.0:1777051449.138092:0:6584:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d956128700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:6593:x1863365452660608:12345-0@lo:101:mdt_io00_001.0 00010000:00010000:3.0:1777051449.138111:0:6584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777051449.138426:0:6584:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3800/0x85f51a6b96716e40 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x85f51a6b96716e39 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051449.138522:0:6584:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3a00/0x85f51a6b96716cb1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b675a expref: 28 pid: 46494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051449.138544:0:6584:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3800/0x85f51a6b96716e40 lrc: 4/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x85f51a6b96716e39 expref: 8 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051449.138592:0:6584:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3a00/0x85f51a6b96716cb1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b675a expref: 28 pid: 46494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051449.138654:0:6584:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3a00/0x85f51a6b96716cb1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b675a expref: 28 pid: 46494 timeout: 8178 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051449.138996:0:6584:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95612b480 pname:cluuid:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000_UUID:6584:1863365452660736:192.168.201.46@tcp:104: 00000100:00100000:2.0:1777051449.139098:0:6584:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da6fdb6cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1777051449.142574:0:6584:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95612b480 pname:cluuid:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000_UUID:6584:1863365452660736:192.168.201.46@tcp:104: 00000100:00100000:3.0:1777051449.142583:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00010000:00010000:2.0:1777051449.142657:0:6584:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3800/0x85f51a6b96716e40 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b96716e39 expref: 8 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051449.142677:0:6584:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d9533ab000) 00010000:00010000:2.0:1777051449.142684:0:6584:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777051449.142692:0:6584:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3800/0x85f51a6b96716e40 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b96716e39 expref: 8 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051449.142709:0:6584:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d9559a3800, rc 0) 00000100:00100000:1.0:1777051449.142782:0:47827:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426049152 00000100:00100000:2.0:1777051449.142797:0:6584:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d956128700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:6593:x1863365452660608:12345-0@lo:101:mdt_io00_001.0 Request processed in 4708us (5131us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051449.142816:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8237 00000100:00100000:1.0:1777051449.142821:0:47827:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426049152 00010000:00010000:1.0:1777051449.142868:0:47827:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3a00/0x85f51a6b96716cb1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b675a expref: 29 pid: 46494 timeout: 8178 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051449.142928:0:47827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3931 00000100:00100000:1.0:1777051449.142945:0:47827:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7c9a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+29:2436:x1863365426049152:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1777051449.142964:0:47827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1777051449.142977:0:47827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3a00/0x85f51a6b96716cb1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b675a expref: 29 pid: 46494 timeout: 8178 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051449.143005:0:47827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3a00/0x85f51a6b96716cb1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b675a expref: 29 pid: 46494 timeout: 8178 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051449.143037:0:47827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3a00/0x85f51a6b96716cb1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b675a expref: 29 pid: 46494 timeout: 8178 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051449.143062:0:47827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d9533ab000) 00010000:00010000:1.0:1777051449.143073:0:47827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3800/0x85f51a6b96716e40 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b96716e39 expref: 7 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051449.143092:0:47827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3800/0x85f51a6b96716e40 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x85f51a6b96716e39 expref: 7 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051449.143110:0:47827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3800/0x85f51a6b96716e40 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x85f51a6b96716e39 expref: 7 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051449.143139:0:6593:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95612ad80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0001-mdtlov_UUID:6593:1863365452660608:0@lo:101:mdt_io00_001.0 00010000:00010000:1.0:1777051449.143162:0:47827:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3800/0x85f51a6b96716e40 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b96716e39 expref: 7 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051449.143167:0:6593:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950711a00/0x85f51a6b96716e39 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x85f51a6b96716e40 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051449.143184:0:47827:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95f65a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-MDT0000_UUID:47827:1863365452660864:0@lo:105: 00010000:00010000:3.0:1777051449.143184:0:6593:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950711a00/0x85f51a6b96716e39 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x85f51a6b96716e40 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051449.143281:0:47827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051449.143344:0:47827:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da7b379cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1777051449.143542:0:6562:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452660864 00000100:00100000:2.0:1777051449.143554:0:6562:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452660864 00000100:00100000:2.0:1777051449.143668:0:6562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1777051449.143687:0:6562:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f65b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:47827:x1863365452660864:12345-0@lo:105: 00010000:00010000:2.0:1777051449.143707:0:6562:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950711a00/0x85f51a6b96716e39 lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x85f51a6b96716e40 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051449.143747:0:6562:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950711a00/0x85f51a6b96716e39 lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x85f51a6b96716e40 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051449.143764:0:6562:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950711a00/0x85f51a6b96716e39 lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x85f51a6b96716e40 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051449.143779:0:6562:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950711a00/0x85f51a6b96716e39 lrc: 5/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x85f51a6b96716e40 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051449.143793:0:6562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950711a00/0x85f51a6b96716e39 lrc: 6/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x85f51a6b96716e40 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051449.143807:0:6562:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950711a00/0x85f51a6b96716e39 lrc: 6/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x85f51a6b96716e40 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051449.143864:0:6562:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff99d950711a00) 00000100:00100000:2.0:1777051449.143952:0:6562:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f65b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:47827:x1863365452660864:12345-0@lo:105: Request processed in 267us (669us total) trans 0 rc 0/0 00010000:00010000:3.0:1777051449.143956:0:6593:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950711a00/0x85f51a6b96716e39 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x85f51a6b96716e40 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051449.143976:0:6562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00010000:00010000:3.0:1777051449.143994:0:6593:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950711a00/0x85f51a6b96716e39 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x85f51a6b96716e40 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051449.144019:0:47827:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95f65a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-MDT0000_UUID:47827:1863365452660864:0@lo:105: 00000004:00080000:3.0:1777051449.144031:0:6593:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:0.0:1777051449.144072:0:47827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1777051449.144085:0:6593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d9559a2800/0x85f51a6b96716e47 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x45e84fca bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051449.144104:0:6593:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d9559a2800/0x85f51a6b96716e47 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x45e84fca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051449.144121:0:6593:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d9559a2800/0x85f51a6b96716e47 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x45e84fca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6593 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051449.144151:0:6593:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7c9a1c00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0001-mdtlov_UUID:6593:1863365452660992:0@lo:101:mdt_io00_001.0 00000100:00100000:0.0:1777051449.144166:0:47827:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7c9a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+28:2436:x1863365426049152:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 1217us (1587us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051449.144574:0:47827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3931 00000100:00100000:3.0:1777051449.146867:0:6593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051449.146925:0:6593:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d956bda540 going to sleep for 11 seconds 00000100:00100000:0.0:1777051449.146981:0:46498:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452660992 00000100:00100000:0.0:1777051449.146993:0:46498:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452660992 00000100:00100000:0.0:1777051449.147359:0:46498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8238 00000100:00100000:0.0:1777051449.147378:0:46498:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f97f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+8:6593:x1863365452660992:12345-0@lo:101:mdt_io00_001.0 00010000:00010000:0.0:1777051449.147401:0:46498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051449.147428:0:46498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d950705e00/0x85f51a6b96716e4e lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x45e84fca bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x85f51a6b96716e47 expref: -99 pid: 46498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051449.147520:0:46498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d950705e00/0x85f51a6b96716e4e lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x45e84fca bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x85f51a6b96716e47 expref: 9 pid: 46498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051449.147544:0:46498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950705e00/0x85f51a6b96716e4e lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x45e84fca bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b96716e47 expref: 9 pid: 46498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051449.147561:0:46498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x45e84fca (ffff99da42881d00) 00010000:00010000:0.0:1777051449.147567:0:46498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777051449.147572:0:46498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d950705e00, rc 0) 00000100:00100000:0.0:1777051449.147686:0:46498:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f97f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+9:6593:x1863365452660992:12345-0@lo:101:mdt_io00_001.0 Request processed in 312us (819us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051449.147701:0:46498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8238 00000100:00100000:3.0:1777051449.148481:0:6593:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7c9a1c00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0001-mdtlov_UUID:6593:1863365452660992:0@lo:101:mdt_io00_001.0 00010000:00010000:3.0:1777051449.148510:0:6593:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d9559a2800/0x85f51a6b96716e47 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x45e84fca bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x85f51a6b96716e4e expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051449.148533:0:6593:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d9559a2800/0x85f51a6b96716e47 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x45e84fca bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x85f51a6b96716e4e expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1777051449.148590:0:6593:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:3.0:1777051449.148678:0:6593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d9559a2e00/0x85f51a6b96716e55 lrc: 3/0,1 mode: --/EX res: [0x2000032e2:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051449.148694:0:6593:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d9559a2e00/0x85f51a6b96716e55 lrc: 3/0,1 mode: --/EX res: [0x2000032e2:0x8:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051449.148710:0:6593:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d9559a2e00/0x85f51a6b96716e55 lrc: 3/0,1 mode: --/EX res: [0x2000032e2:0x8:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6593 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051449.148737:0:6593:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95f97ea00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0001-mdtlov_UUID:6593:1863365452661120:0@lo:101:mdt_io00_001.0 00000100:00100000:3.0:1777051449.148812:0:6593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051449.148918:0:11727:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452661120 00000100:00100000:1.0:1777051449.148930:0:11727:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452661120 00000100:00100000:3.0:1777051449.148934:0:6593:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d956bda540 going to sleep for 11 seconds 00000100:00100000:1.0:1777051449.149006:0:11727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8239 00000100:00100000:1.0:1777051449.149024:0:11727:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f97ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:6593:x1863365452661120:12345-0@lo:101:mdt_io00_001.0 00010000:00010000:1.0:1777051449.149043:0:11727:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777051449.149065:0:11727:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cec00/0x85f51a6b96716e5c lrc: 2/0,0 mode: --/EX res: [0x2000032e2:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x85f51a6b96716e55 expref: -99 pid: 11727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051449.149100:0:11727:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cf200/0x85f51a6b96716d28 lrc: 2/0,0 mode: PR/PR res: [0x2000032e2:0x8:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b677d expref: 27 pid: 27885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051449.149117:0:11727:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cec00/0x85f51a6b96716e5c lrc: 4/0,0 mode: --/EX res: [0x2000032e2:0x8:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x85f51a6b96716e55 expref: 10 pid: 11727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051449.149184:0:11727:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cf200/0x85f51a6b96716d28 lrc: 3/0,0 mode: PR/PR res: [0x2000032e2:0x8:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b677d expref: 27 pid: 27885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051449.149211:0:11727:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cf200/0x85f51a6b96716d28 lrc: 4/0,0 mode: PR/PR res: [0x2000032e2:0x8:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b677d expref: 27 pid: 27885 timeout: 8178 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051449.149235:0:11727:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95f65a300 pname:cluuid:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000_UUID:11727:1863365452661248:192.168.201.46@tcp:104: 00000100:00100000:1.0:1777051449.149338:0:11727:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da7b379cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1777051449.156289:0:11727:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95f65a300 pname:cluuid:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000_UUID:11727:1863365452661248:192.168.201.46@tcp:104: 00000100:00100000:3.0:1777051449.156333:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00010000:00010000:1.0:1777051449.156340:0:11727:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cec00/0x85f51a6b96716e5c lrc: 3/0,0 mode: --/EX res: [0x2000032e2:0x8:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b96716e55 expref: 10 pid: 11727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051449.156374:0:11727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0x8:0x0].0x0 (ffff99d94e6b6200) 00010000:00010000:1.0:1777051449.156381:0:11727:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 25 00010000:00010000:1.0:1777051449.156390:0:11727:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cec00/0x85f51a6b96716e5c lrc: 3/0,0 mode: --/EX res: [0x2000032e2:0x8:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b96716e55 expref: 10 pid: 11727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051449.156407:0:11727:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cec00/0x85f51a6b96716e5c lrc: 3/0,0 mode: --/EX res: [0x2000032e2:0x8:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b96716e55 expref: 10 pid: 11727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051449.156423:0:11727:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cec00/0x85f51a6b96716e5c lrc: 3/0,0 mode: --/EX res: [0x2000032e2:0x8:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b96716e55 expref: 10 pid: 11727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051449.156505:0:11727:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99da7d5cec00, rc 0) 00000100:00100000:1.0:1777051449.156588:0:11727:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f97ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+10:6593:x1863365452661120:12345-0@lo:101:mdt_io00_001.0 Request processed in 7566us (7794us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051449.156603:0:11727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8239 00000100:00100000:2.0:1777051449.156775:0:6566:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426049280 00000100:00100000:2.0:1777051449.156810:0:6566:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426049280 00010000:00010000:2.0:1777051449.156865:0:6566:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cf200/0x85f51a6b96716d28 lrc: 4/0,0 mode: PR/PR res: [0x2000032e2:0x8:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b677d expref: 28 pid: 27885 timeout: 8178 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051449.156925:0:6566:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3932 00000100:00100000:2.0:1777051449.156941:0:6566:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f97d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+28:2437:x1863365426049280:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1777051449.156961:0:6566:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777051449.156973:0:6566:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cf200/0x85f51a6b96716d28 lrc: 4/0,0 mode: PR/PR res: [0x2000032e2:0x8:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b677d expref: 28 pid: 27885 timeout: 8178 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051449.156999:0:6566:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cf200/0x85f51a6b96716d28 lrc: 3/0,0 mode: PR/PR res: [0x2000032e2:0x8:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b677d expref: 28 pid: 27885 timeout: 8178 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051449.157029:0:6566:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cf200/0x85f51a6b96716d28 lrc: 0/0,0 mode: --/PR res: [0x2000032e2:0x8:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b677d expref: 28 pid: 27885 timeout: 8178 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051449.157049:0:6566:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0x8:0x0].0x0 (ffff99d94e6b6200) 00010000:00010000:2.0:1777051449.157058:0:6566:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cec00/0x85f51a6b96716e5c lrc: 2/0,0 mode: --/EX res: [0x2000032e2:0x8:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b96716e55 expref: 9 pid: 11727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051449.157077:0:6566:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cec00/0x85f51a6b96716e5c lrc: 2/0,0 mode: EX/EX res: [0x2000032e2:0x8:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x85f51a6b96716e55 expref: 9 pid: 11727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051449.157096:0:6566:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cec00/0x85f51a6b96716e5c lrc: 3/0,0 mode: EX/EX res: [0x2000032e2:0x8:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x85f51a6b96716e55 expref: 9 pid: 11727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051449.157496:0:6566:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cec00/0x85f51a6b96716e5c lrc: 3/0,0 mode: EX/EX res: [0x2000032e2:0x8:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b96716e55 expref: 9 pid: 11727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051449.157519:0:6566:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95612b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000_UUID:6566:1863365452661376:0@lo:105: 00000100:00100000:2.0:1777051449.157581:0:6566:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051449.157677:0:6566:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da6fdb6cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1777051449.157751:0:102039:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452661376 00000100:00100000:1.0:1777051449.157762:0:102039:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452661376 00000100:00100000:3.0:1777051449.157773:0:6593:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95f97ea00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0001-mdtlov_UUID:6593:1863365452661120:0@lo:101:mdt_io00_001.0 00010000:00010000:3.0:1777051449.157804:0:6593:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d9559a2e00/0x85f51a6b96716e55 lrc: 4/0,1 mode: --/EX res: [0x2000032e2:0x8:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x85f51a6b96716e5c expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051449.157846:0:6593:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d9559a2e00/0x85f51a6b96716e55 lrc: 4/0,1 mode: --/EX res: [0x2000032e2:0x8:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x85f51a6b96716e5c expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051449.157858:0:102039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1777051449.157886:0:102039:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95612ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0001-mdtlov_UUID+4:6566:x1863365452661376:12345-0@lo:105: 00010000:00010000:1.0:1777051449.157926:0:102039:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d9559a2e00/0x85f51a6b96716e55 lrc: 5/0,1 mode: --/EX res: [0x2000032e2:0x8:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x85f51a6b96716e5c expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051449.157945:0:102039:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d9559a2e00/0x85f51a6b96716e55 lrc: 5/0,1 mode: --/EX res: [0x2000032e2:0x8:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x85f51a6b96716e5c expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051449.157961:0:102039:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d9559a2e00/0x85f51a6b96716e55 lrc: 5/0,1 mode: --/EX res: [0x2000032e2:0x8:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x85f51a6b96716e5c expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051449.157976:0:102039:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d9559a2e00/0x85f51a6b96716e55 lrc: 5/0,1 mode: EX/EX res: [0x2000032e2:0x8:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x85f51a6b96716e5c expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051449.157989:0:102039:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d9559a2e00/0x85f51a6b96716e55 lrc: 6/0,1 mode: EX/EX res: [0x2000032e2:0x8:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x85f51a6b96716e5c expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051449.158003:0:102039:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d9559a2e00/0x85f51a6b96716e55 lrc: 6/0,1 mode: EX/EX res: [0x2000032e2:0x8:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x85f51a6b96716e5c expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051449.158044:0:102039:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff99d9559a2e00) 00000100:00100000:1.0:1777051449.158421:0:102039:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95612ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0001-mdtlov_UUID+4:6566:x1863365452661376:12345-0@lo:105: Request processed in 542us (839us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051449.158436:0:102039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00010000:00010000:3.0:1777051449.158449:0:6593:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d9559a2e00/0x85f51a6b96716e55 lrc: 4/0,1 mode: EX/EX res: [0x2000032e2:0x8:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x85f51a6b96716e5c expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051449.158469:0:6593:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d9559a2e00/0x85f51a6b96716e55 lrc: 4/0,1 mode: EX/EX res: [0x2000032e2:0x8:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x85f51a6b96716e5c expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1777051449.158507:0:6593:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x2000032e2:0x8:0x0] 00000100:00100000:3.0:1777051449.158570:0:6593:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95f97ea00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0001-mdtlov_UUID:6593:1863365452661504:0@lo:1000:mdt_io00_001.0 00000100:00100000:2.0:1777051449.158658:0:6566:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95612b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000_UUID:6566:1863365452661376:0@lo:105: 00000100:00100000:3.0:1777051449.158678:0:6593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1777051449.158690:0:6566:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1777051449.158749:0:6593:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d956bda0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1777051449.158761:0:6566:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f97d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+27:2437:x1863365426049280:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 1818us (2432us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051449.158779:0:6566:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3932 00000100:00100000:1.0:1777051449.158852:0:46500:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452661504 00000100:00100000:1.0:1777051449.158861:0:46500:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452661504 00000100:00100000:1.0:1777051449.159158:0:46500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8240 00000100:00100000:1.0:1777051449.159174:0:46500:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f97ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+10:6593:x1863365452661504:12345-0@lo:1000:mdt_io00_001.0 00000100:00100000:1.0:1777051449.159298:0:46500:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f97ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+10:6593:x1863365452661504:12345-0@lo:1000:mdt_io00_001.0 Request processed in 126us (622us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051449.159311:0:46500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8240 00000100:00100000:3.0:1777051449.159428:0:6593:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95f97ea00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0001-mdtlov_UUID:6593:1863365452661504:0@lo:1000:mdt_io00_001.0 00000004:00080000:3.0:1777051449.159476:0:6593:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x2000032e2:0x8:0x0] 00000100:00100000:3.0:1777051449.159515:0:6593:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95f97ea00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0001-mdtlov_UUID:6593:1863365452661632:0@lo:1000:mdt_io00_001.0 00000100:00100000:3.0:1777051449.159564:0:6593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051449.159657:0:6593:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d956bda0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1777051449.160067:0:47208:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452661632 00000100:00100000:1.0:1777051449.160075:0:47208:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452661632 00000100:00100000:1.0:1777051449.160137:0:47208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8241 00000100:00100000:1.0:1777051449.160148:0:47208:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f97dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+10:6593:x1863365452661632:12345-0@lo:1000:mdt_io00_001.0 00000100:00100000:1.0:1777051449.160256:0:47208:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f97dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+10:6593:x1863365452661632:12345-0@lo:1000:mdt_io00_001.0 Request processed in 107us (693us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051449.160277:0:47208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8241 00000100:00100000:3.0:1777051449.160361:0:6593:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95f97ea00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0001-mdtlov_UUID:6593:1863365452661632:0@lo:1000:mdt_io00_001.0 00000100:00100000:3.0:1777051449.160570:0:6593:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95f97ea00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0001-mdtlov_UUID:6593:1863365452661760:0@lo:1000:mdt_io00_001.0 00000100:00100000:3.0:1777051449.160692:0:6593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051449.160744:0:6593:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d956bda0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1777051449.160796:0:6585:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452661760 00000100:00100000:2.0:1777051449.160807:0:6585:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452661760 00000100:00100000:2.0:1777051449.160895:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8242 00000100:00100000:2.0:1777051449.160912:0:6585:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f97fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+10:6593:x1863365452661760:12345-0@lo:1000:mdt_io00_001.0 00000100:00100000:2.0:1777051449.161019:0:6585:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f97fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+10:6593:x1863365452661760:12345-0@lo:1000:mdt_io00_001.0 Request processed in 110us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051449.161034:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8242 00000100:00100000:3.0:1777051449.161493:0:6593:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95f97ea00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0001-mdtlov_UUID:6593:1863365452661760:0@lo:1000:mdt_io00_001.0 00000100:00100000:3.0:1777051449.161575:0:6593:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95f97ea00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0001-mdtlov_UUID:6593:1863365452661888:0@lo:1000:mdt_io00_001.0 00000100:00100000:3.0:1777051449.162024:0:6593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051449.162074:0:6593:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d956bda0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1777051449.162554:0:6584:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452661888 00000100:00100000:2.0:1777051449.162565:0:6584:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452661888 00000100:00100000:2.0:1777051449.162668:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8243 00000100:00100000:2.0:1777051449.162690:0:6584:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da6ff7c450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+10:6593:x1863365452661888:12345-0@lo:1000:mdt_io00_001.0 00000100:00100000:2.0:1777051449.163093:0:6584:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da6ff7c450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+10:6593:x1863365452661888:12345-0@lo:1000:mdt_io00_001.0 Request processed in 409us (1423us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051449.163685:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8243 00000100:00100000:3.0:1777051449.163818:0:6593:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95f97ea00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0001-mdtlov_UUID:6593:1863365452661888:0@lo:1000:mdt_io00_001.0 00000100:00100000:3.0:1777051449.163944:0:6593:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95f97ea00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0001-mdtlov_UUID:6593:1863365452662016:0@lo:1000:mdt_io00_001.0 00000100:00100000:3.0:1777051449.164010:0:6593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051449.164061:0:6593:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d956bda0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1777051449.164421:0:6584:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452662016 00000100:00100000:2.0:1777051449.164431:0:6584:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452662016 00000100:00100000:2.0:1777051449.164494:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8244 00000100:00100000:2.0:1777051449.164516:0:6584:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f97ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+10:6593:x1863365452662016:12345-0@lo:1000:mdt_io00_001.0 00000100:00100000:2.0:1777051449.164704:0:6584:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f97ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+10:6593:x1863365452662016:12345-0@lo:1000:mdt_io00_001.0 Request processed in 194us (693us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051449.165020:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8244 00000100:00100000:3.0:1777051449.165387:0:6593:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95f97ea00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0001-mdtlov_UUID:6593:1863365452662016:0@lo:1000:mdt_io00_001.0 00000100:00100000:3.0:1777051449.165472:0:6593:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95f97ea00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0001-mdtlov_UUID:6593:1863365452662144:0@lo:1000:mdt_io00_001.0 00000100:00100000:3.0:1777051449.165524:0:6593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051449.165596:0:6593:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d956bda0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1777051449.165667:0:6585:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452662144 00000100:00100000:1.0:1777051449.165678:0:6585:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452662144 00000100:00100000:1.0:1777051449.165749:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8245 00000100:00100000:1.0:1777051449.165765:0:6585:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f97df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+10:6593:x1863365452662144:12345-0@lo:1000:mdt_io00_001.0 00000100:00100000:1.0:1777051449.165896:0:6585:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f97df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+10:6593:x1863365452662144:12345-0@lo:1000:mdt_io00_001.0 Request processed in 134us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051449.165909:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8245 00000100:00100000:2.0:1777051449.165974:0:6593:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95f97ea00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0001-mdtlov_UUID:6593:1863365452662144:0@lo:1000:mdt_io00_001.0 00000100:00100000:2.0:1777051449.166045:0:6593:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d956128a80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0001-mdtlov_UUID:6593:1863365452662272:0@lo:1000:mdt_io00_001.0 00000100:00100000:2.0:1777051449.166088:0:6593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051449.166110:0:6593:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da6fdb6240 going to sleep for 11 seconds 00000100:00100000:3.0:1777051449.166166:0:46500:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452662272 00000100:00100000:3.0:1777051449.166175:0:46500:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452662272 00000100:00100000:3.0:1777051449.166276:0:46500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8246 00000100:00100000:3.0:1777051449.166293:0:46500:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d956128000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+10:6593:x1863365452662272:12345-0@lo:1000:mdt_io00_001.0 00000100:00100000:3.0:1777051449.166413:0:46500:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d956128000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+10:6593:x1863365452662272:12345-0@lo:1000:mdt_io00_001.0 Request processed in 122us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051449.166430:0:46500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8246 00000100:00100000:2.0:1777051449.166463:0:6593:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d956128a80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0001-mdtlov_UUID:6593:1863365452662272:0@lo:1000:mdt_io00_001.0 00000100:00100000:2.0:1777051449.166541:0:6593:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d956128a80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0001-mdtlov_UUID:6593:1863365452662400:0@lo:1000:mdt_io00_001.0 00000100:00100000:2.0:1777051449.166649:0:6593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051449.166966:0:6593:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da6fdb6240 going to sleep for 11 seconds 00000100:00100000:3.0:1777051449.168326:0:47208:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452662400 00000100:00100000:3.0:1777051449.168336:0:47208:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452662400 00000100:00100000:3.0:1777051449.168399:0:47208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8247 00000100:00100000:3.0:1777051449.168417:0:47208:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95612a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+10:6593:x1863365452662400:12345-0@lo:1000:mdt_io00_001.0 00000100:00100000:3.0:1777051449.168582:0:47208:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95612a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+10:6593:x1863365452662400:12345-0@lo:1000:mdt_io00_001.0 Request processed in 167us (1934us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051449.168598:0:47208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8247 00000100:00100000:2.0:1777051449.170553:0:6593:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d956128a80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0001-mdtlov_UUID:6593:1863365452662400:0@lo:1000:mdt_io00_001.0 00000100:00100000:2.0:1777051449.170679:0:6593:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d956128a80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0001-mdtlov_UUID:6593:1863365452662528:0@lo:1000:mdt_io00_001.0 00000100:00100000:2.0:1777051449.170745:0:6593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051449.170793:0:6593:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da6fdb6240 going to sleep for 11 seconds 00000100:00100000:1.0:1777051449.170808:0:6585:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452662528 00000100:00100000:1.0:1777051449.170819:0:6585:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452662528 00000100:00100000:1.0:1777051449.170891:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8248 00000100:00100000:1.0:1777051449.170916:0:6585:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d956128700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+10:6593:x1863365452662528:12345-0@lo:1000:mdt_io00_001.0 00000100:00100000:1.0:1777051449.171035:0:6585:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d956128700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+10:6593:x1863365452662528:12345-0@lo:1000:mdt_io00_001.0 Request processed in 131us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051449.171049:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8248 00000100:00100000:2.0:1777051449.171186:0:6593:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d956128a80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0001-mdtlov_UUID:6593:1863365452662528:0@lo:1000:mdt_io00_001.0 00000100:00100000:2.0:1777051449.171359:0:6593:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d956128a80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0001-mdtlov_UUID:6593:1863365452662656:0@lo:1000:mdt_io00_001.0 00000100:00100000:2.0:1777051449.171426:0:6593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051449.171474:0:6593:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da6fdb6600 going to sleep for 11 seconds 00000100:00100000:3.0:1777051449.171508:0:46498:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452662656 00000100:00100000:3.0:1777051449.171519:0:46498:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452662656 00000100:00100000:3.0:1777051449.171597:0:46498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8249 00000100:00100000:3.0:1777051449.171644:0:46498:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95612b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+10:6593:x1863365452662656:12345-0@lo:1000:mdt_io00_001.0 00000100:00100000:3.0:1777051449.172058:0:46498:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95612b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+10:6593:x1863365452662656:12345-0@lo:1000:mdt_io00_001.0 Request processed in 447us (631us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051449.172074:0:46498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8249 00000100:00100000:2.0:1777051449.173130:0:6593:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d956128a80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0001-mdtlov_UUID:6593:1863365452662656:0@lo:1000:mdt_io00_001.0 00000100:00100000:2.0:1777051449.173240:0:6593:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d956128a80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0001-mdtlov_UUID:6593:1863365452662784:0@lo:1000:mdt_io00_001.0 00000100:00100000:2.0:1777051449.173297:0:6593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051449.173343:0:6584:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452662784 00000100:00100000:2.0:1777051449.173351:0:6584:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452662784 00000100:00100000:2.0:1777051449.173409:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8250 00000100:00100000:2.0:1777051449.173426:0:6584:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95612a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+10:6593:x1863365452662784:12345-0@lo:1000:mdt_io00_001.0 00000100:00100000:2.0:1777051449.173513:0:6584:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95612a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+10:6593:x1863365452662784:12345-0@lo:1000:mdt_io00_001.0 Request processed in 92us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051449.173525:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8250 00000100:00100000:2.0:1777051449.173561:0:6593:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d94521c240 going to sleep for 11 seconds 00000100:00100000:2.0:1777051449.173586:0:6593:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d956128a80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0001-mdtlov_UUID:6593:1863365452662784:0@lo:1000:mdt_io00_001.0 00000100:00100000:2.0:1777051449.173996:0:6593:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d956128a80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0001-mdtlov_UUID:6593:1863365452662912:0@lo:1000:mdt_io00_001.0 00000100:00100000:2.0:1777051449.174045:0:6593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051449.174081:0:6593:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d94521c240 going to sleep for 11 seconds 00000100:00100000:3.0:1777051449.174137:0:11727:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452662912 00000100:00100000:3.0:1777051449.174147:0:11727:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452662912 00000100:00100000:3.0:1777051449.174217:0:11727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8251 00000100:00100000:3.0:1777051449.174233:0:11727:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942a0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+10:6593:x1863365452662912:12345-0@lo:1000:mdt_io00_001.0 00000100:00100000:3.0:1777051449.174345:0:11727:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942a0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+10:6593:x1863365452662912:12345-0@lo:1000:mdt_io00_001.0 Request processed in 115us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051449.174360:0:11727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8251 00000100:00100000:2.0:1777051449.175308:0:6593:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d956128a80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0001-mdtlov_UUID:6593:1863365452662912:0@lo:1000:mdt_io00_001.0 00000040:00080000:2.0:1777051449.177574:0:6593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000bd0:0x1:0x0].5, 2296 off38056 00000040:00080000:2.0:1777051449.177721:0:6593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2000032e1:0x1:0x0].5, 2376 off38584 00000004:00080000:2.0:1777051449.177741:0:6593:0:(osp_trans.c:1582:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff99da6fdb6cc0 with version 15 00000004:00080000:0.0:1777051449.177828:0:104211:0:(osp_trans.c:1330:osp_get_next_request()) ou ffff99d9596fa9c0 version 15 rpc_version 15 00000020:00100000:0.0:1777051449.177896:0:104211:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1777051449.177906:0:104211:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff99da7cd9e300 x1863365452663168/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 264/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1777051449.177929:0:104211:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7cd9e300 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:104211:1863365452663168:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1777051449.177983:0:104211:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051449.178018:0:104211:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da5837a840 going to sleep for 11 seconds 00000100:00100000:2.0:1777051449.178068:0:46500:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452663168 00000100:00100000:2.0:1777051449.178078:0:46500:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452663168 00000100:00100000:2.0:1777051449.178146:0:46500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8252 00000100:00100000:2.0:1777051449.178164:0:46500:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7cd9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+10:104211:x1863365452663168:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1777051449.180807:0:46500:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7cd9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+11:104211:x1863365452663168:12345-0@lo:1000:osp_up0-1.0 Request processed in 2643us (2816us total) trans 30064771212 rc 0/0 00000100:00100000:2.0:1777051449.180826:0:46500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8252 00000100:00100000:2.0:1777051449.180976:0:104211:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7cd9e300 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:104211:1863365452663168:0@lo:1000:osp_up0-1.0 00000004:00080000:2.0:1777051449.181045:0:6593:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x2000032e2:0x8:0x0] 00010000:00010000:2.0:1777051449.181073:0:6593:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d9559a2e00/0x85f51a6b96716e55 lrc: 4/0,1 mode: EX/EX res: [0x2000032e2:0x8:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x85f51a6b96716e5c expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051449.181094:0:6593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d9559a2e00/0x85f51a6b96716e55 lrc: 4/0,1 mode: EX/EX res: [0x2000032e2:0x8:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x85f51a6b96716e5c expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051449.181108:0:6593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d9559a2e00/0x85f51a6b96716e55 lrc: 3/0,0 mode: EX/EX res: [0x2000032e2:0x8:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x85f51a6b96716e5c expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051449.181142:0:6593:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1777051449.181265:0:6593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff99d950710a00/0x85f51a6b96716e63 lrc: 3/0,1 mode: --/PW res: [0x240000bd3:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051449.181289:0:6593:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d950710a00/0x85f51a6b96716e63 lrc: 3/0,1 mode: PW/PW res: [0x240000bd3:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051449.181312:0:6593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d950710a00/0x85f51a6b96716e63 lrc: 3/0,1 mode: PW/PW res: [0x240000bd3:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051449.181328:0:38719:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1777051449.181340:0:38719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d9559a2e00/0x85f51a6b96716e55 lrc: 2/0,0 mode: EX/EX res: [0x2000032e2:0x8:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x85f51a6b96716e5c expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051449.181343:0:6593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff99d950710400/0x85f51a6b96716e6a lrc: 3/0,1 mode: --/PW res: [0x240000bd0:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051449.181371:0:38719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d9559a2e00 already unused, calling callback (ffffffffc177eed0) 00010000:00010000:2.0:1777051449.181378:0:6593:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d950710400/0x85f51a6b96716e6a lrc: 3/0,1 mode: PW/PW res: [0x240000bd0:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051449.181381:0:38719:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d9559a2e00/0x85f51a6b96716e55 lrc: 3/0,0 mode: EX/EX res: [0x2000032e2:0x8:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x85f51a6b96716e5c expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1777051449.181415:0:38719:0:(mdt_handler.c:3963:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d9559a2e00/0x85f51a6b96716e55 lrc: 3/0,0 mode: EX/EX res: [0x2000032e2:0x8:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x85f51a6b96716e5c expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051449.181433:0:6593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d950710400/0x85f51a6b96716e6a lrc: 3/0,1 mode: PW/PW res: [0x240000bd0:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051449.181474:0:6593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950710e00/0x85f51a6b96716e71 lrc: 3/0,1 mode: --/PW res: [0x2000032e2:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 6593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051449.181488:0:6593:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950710e00/0x85f51a6b96716e71 lrc: 3/0,1 mode: --/PW res: [0x2000032e2:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 6593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051449.181490:0:38719:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d9559a2e00/0x85f51a6b96716e55 lrc: 2/0,0 mode: --/EX res: [0x2000032e2:0x8:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x85f51a6b96716e5c expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051449.181521:0:38719:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1777051449.181522:0:6593:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950710e00/0x85f51a6b96716e71 lrc: 3/0,1 mode: --/PW res: [0x2000032e2:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x1000000000000 pid: 6593 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051449.181555:0:6593:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d942a0df80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0001-mdtlov_UUID:6593:1863365452663296:0@lo:101:mdt_io00_001.0 00010000:00010000:0.0:1777051449.181563:0:38719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d9559a2e00/0x85f51a6b96716e55 lrc: 1/0,0 mode: --/EX res: [0x2000032e2:0x8:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x85f51a6b96716e5c expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051449.181579:0:38719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d9559a2e00/0x85f51a6b96716e55 lrc: 0/0,0 mode: --/EX res: [0x2000032e2:0x8:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x85f51a6b96716e5c expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051449.181640:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1777051449.181646:0:6593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1777051449.181648:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777051449.181656:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1777051449.181693:0:6593:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d94521cf00 going to sleep for 11 seconds 00000100:00100000:0.0:1777051449.181695:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7cd9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452663424:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1777051449.181756:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051449.181849:0:6564:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452663424 00000100:00100000:2.0:1777051449.181860:0:6564:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452663424 00000100:00100000:3.0:1777051449.181884:0:47208:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452663296 00000100:00100000:3.0:1777051449.181896:0:47208:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452663296 00000100:00100000:2.0:1777051449.181940:0:6564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13711 00000100:00100000:2.0:1777051449.181960:0:6564:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7cd9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+12:3678:x1863365452663424:12345-0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1777051449.181974:0:47208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8253 00010000:00010000:2.0:1777051449.181981:0:6564:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1777051449.181995:0:47208:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942a0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+12:6593:x1863365452663296:12345-0@lo:101:mdt_io00_001.0 00010000:00010000:2.0:1777051449.182013:0:6564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cec00/0x85f51a6b96716e5c lrc: 0/0,0 mode: --/EX res: [0x2000032e2:0x8:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x85f51a6b96716e55 expref: 12 pid: 11727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051449.182020:0:47208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051449.182044:0:6564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0x8:0x0].0x0 (ffff99d94e6b6200) 00010000:00010000:3.0:1777051449.182044:0:47208:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3400/0x85f51a6b96716e78 lrc: 2/0,0 mode: --/PW res: [0x2000032e2:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x85f51a6b96716e71 expref: -99 pid: 47208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051449.182059:0:6564:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1777051449.182401:0:47208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3400/0x85f51a6b96716e78 lrc: 3/0,0 mode: PW/PW res: [0x2000032e2:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x85f51a6b96716e71 expref: 12 pid: 47208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051449.182432:0:47208:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3400/0x85f51a6b96716e78 lrc: 3/0,0 mode: PW/PW res: [0x2000032e2:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b96716e71 expref: 12 pid: 47208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051449.182434:0:6564:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7cd9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+12:3678:x1863365452663424:12345-0@lo:103:ldlm_bl.0 Request processed in 474us (671us total) trans 0 rc 0/0 00010000:00010000:3.0:1777051449.182465:0:47208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0x8:0x0].0x0 (ffff99d94e6b6200) 00000100:00100000:2.0:1777051449.182468:0:6564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13711 00010000:00010000:3.0:1777051449.182476:0:47208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777051449.182483:0:47208:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d9559a3400, rc 0) 00000100:00100000:3.0:1777051449.182557:0:47208:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942a0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+11:6593:x1863365452663296:12345-0@lo:101:mdt_io00_001.0 Request processed in 568us (948us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051449.182558:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7cd9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452663424:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1777051449.182583:0:47208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8253 00000100:00100000:2.0:1777051449.182675:0:6593:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d942a0df80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0001-mdtlov_UUID:6593:1863365452663296:0@lo:101:mdt_io00_001.0 00010000:00010000:2.0:1777051449.182700:0:6593:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950710e00/0x85f51a6b96716e71 lrc: 4/0,1 mode: PW/PW res: [0x2000032e2:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x85f51a6b96716e78 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051449.182719:0:6593:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950710e00/0x85f51a6b96716e71 lrc: 4/0,1 mode: PW/PW res: [0x2000032e2:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x85f51a6b96716e78 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1777051449.182745:0:6593:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000004734d821 reply state 0000000077e4b1b9 transno 8589934720 ns: mdt-lustre-MDT0001_UUID lock: ffff99d950710400/0x85f51a6b96716e6a lrc: 3/0,1 mode: PW/PW res: [0x240000bd0:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051449.182763:0:6593:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d950710400/0x85f51a6b96716e6a lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd0:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051449.182775:0:6593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x3:0x0].0x0 (ffff99d9502e3c00) 00010000:00010000:2.0:1777051449.182780:0:6593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1777051449.182785:0:6593:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1777051449.182793:0:6593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950710e00/0x85f51a6b96716e71 lrc: 4/0,1 mode: PW/PW res: [0x2000032e2:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x85f51a6b96716e78 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051449.182807:0:6593:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950710e00/0x85f51a6b96716e71 lrc: 3/0,0 mode: PW/PW res: [0x2000032e2:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x85f51a6b96716e78 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1777051449.182821:0:6593:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x2000032e2:0x8:0x0] 00000004:00010000:2.0:1777051449.182831:0:6593:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000004734d821 reply state 0000000077e4b1b9 transno 8589934720 ns: mdt-lustre-MDT0001_UUID lock: ffff99d950710a00/0x85f51a6b96716e63 lrc: 3/0,1 mode: PW/PW res: [0x240000bd3:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051449.182845:0:6593:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d950710a00/0x85f51a6b96716e63 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd3:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051449.182863:0:6593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd3:0x4:0x0].0x0 (ffff99d9502e3d00) 00010000:00010000:2.0:1777051449.182867:0:6593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1777051449.182871:0:6593:0:(service.c:177:ptlrpc_save_lock()) nlocks 1 00000004:00080000:2.0:1777051449.182882:0:6593:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:2.0:1777051449.182894:0:6593:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950711a00/0x85f51a6b96716e39 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x85f51a6b96716e40 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051449.182908:0:6593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950711a00/0x85f51a6b96716e39 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x85f51a6b96716e40 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051449.182921:0:6593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950711a00/0x85f51a6b96716e39 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x85f51a6b96716e40 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051449.182955:0:6593:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:2.0:1777051449.182963:0:6593:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:2.0:1777051449.182971:0:6593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d9559a2800/0x85f51a6b96716e47 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x45e84fca bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x85f51a6b96716e4e expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051449.182985:0:6593:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d9559a2800/0x85f51a6b96716e47 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x45e84fca bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x85f51a6b96716e4e expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1777051449.183000:0:6593:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:2.0:1777051449.183010:0:6593:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950704800/0x85f51a6b96716e2b lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x85f51a6b96716e32 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051449.183016:0:6567:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777051449.183032:0:6593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950704800/0x85f51a6b96716e2b lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x85f51a6b96716e32 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051449.183032:0:6567:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950711a00/0x85f51a6b96716e39 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x85f51a6b96716e40 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051449.183404:0:6567:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d950711a00 already unused, calling callback (ffffffffc177eed0) 00010000:00010000:2.0:1777051449.183407:0:6593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950704800/0x85f51a6b96716e2b lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x85f51a6b96716e32 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051449.183416:0:6567:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950711a00/0x85f51a6b96716e39 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x85f51a6b96716e40 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777051449.183445:0:6567:0:(mdt_handler.c:3963:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950711a00/0x85f51a6b96716e39 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x85f51a6b96716e40 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051449.183461:0:6593:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1777051449.183520:0:6568:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1777051449.183533:0:6568:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950704800/0x85f51a6b96716e2b lrc: 2/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x85f51a6b96716e32 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051449.183555:0:6568:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d950704800 already unused, calling callback (ffffffffc177eed0) 00010000:00010000:0.0:1777051449.183566:0:6568:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950704800/0x85f51a6b96716e2b lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x85f51a6b96716e32 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051449.183570:0:6593:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7cd9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_001:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+54:138749:x1863365426049024:12345-192.168.201.46@tcp:36:lfs.0 Request processed in 52410us (53461us total) trans 8589934720 rc 0/0 00000004:00010000:0.0:1777051449.183599:0:6568:0:(mdt_handler.c:3963:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950704800/0x85f51a6b96716e2b lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x85f51a6b96716e32 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051449.183599:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 8 00010000:00010000:0.0:1777051449.183687:0:6568:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950704800/0x85f51a6b96716e2b lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x85f51a6b96716e32 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051449.183701:0:6568:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1777051449.183755:0:6568:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950704800/0x85f51a6b96716e2b lrc: 1/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x85f51a6b96716e32 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051449.183771:0:6568:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950704800/0x85f51a6b96716e2b lrc: 0/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x85f51a6b96716e32 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051449.183803:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1777051449.183808:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7cd9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452663552:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1777051449.183811:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777051449.183819:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1777051449.183870:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1777051449.183986:0:6567:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950711a00/0x85f51a6b96716e39 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x85f51a6b96716e40 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051449.184001:0:6567:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1777051449.184036:0:6567:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950711a00/0x85f51a6b96716e39 lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x85f51a6b96716e40 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051449.184052:0:6567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950711a00/0x85f51a6b96716e39 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x85f51a6b96716e40 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051449.184082:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777051449.184087:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1777051449.184090:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7cd9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3680:1863365452663680:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1777051449.184093:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1777051449.184150:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051449.184562:0:6565:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452663552 00000100:00100000:3.0:1777051449.184572:0:6565:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452663552 00000100:00100000:3.0:1777051449.184736:0:6565:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452663680 00000100:00100000:3.0:1777051449.184743:0:6565:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452663680 00000100:00100000:3.0:1777051449.184796:0:6565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13712 00000100:00100000:3.0:1777051449.184811:0:6565:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942a0df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+12:3679:x1863365452663552:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1777051449.184827:0:6565:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777051449.184849:0:6565:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2a00/0x85f51a6b96716e32 lrc: 0/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x85f51a6b96716e2b expref: 12 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051449.184872:0:6565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000004:0x1:0x0].0x0 (ffff99d9413d0200) 00010000:00010000:3.0:1777051449.184884:0:6565:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1777051449.185378:0:47827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13713 00000100:00100000:2.0:1777051449.185394:0:47827:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d956128a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:lustre-MDT0001-mdtlov_UUID+11:3680:x1863365452663680:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1777051449.185411:0:47827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777051449.185434:0:47827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3800/0x85f51a6b96716e40 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x85f51a6b96716e39 expref: 11 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051449.185457:0:47827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d9533ab000) 00010000:00010000:2.0:1777051449.185465:0:47827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1777051449.185483:0:6565:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942a0df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+10:3679:x1863365452663552:12345-0@lo:103:ldlm_bl.0 Request processed in 672us (1612us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051449.185497:0:6565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13712 00000100:00100000:2.0:1777051449.185576:0:47827:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d956128a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:lustre-MDT0001-mdtlov_UUID+9:3680:x1863365452663680:12345-0@lo:103:ldlm_bl.0 Request processed in 182us (1424us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051449.185592:0:47827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13713 00000100:00100000:2.0:1777051449.185687:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7cd9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3680:1863365452663680:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1777051449.187760:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7cd9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452663552:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1777051449.188127:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051449.188526:0:46497:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426049408 00000100:00100000:0.0:1777051449.188536:0:46497:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426049408 00000100:00100000:0.0:1777051449.188603:0:46497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112252 00000100:00100000:0.0:1777051449.188653:0:46497:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f97c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+42:138749:x1863365426049408:12345-192.168.201.46@tcp:101:lfs.0 00010000:00010000:0.0:1777051449.188678:0:46497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051449.188701:0:46497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d950705600/0x85f51a6b96716e7f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b67df expref: -99 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051449.188784:0:46497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950705c00/0x85f51a6b96716e86 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051449.188805:0:46497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d950705c00/0x85f51a6b96716e86 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051449.188832:0:46497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d950705c00/0x85f51a6b96716e86 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1777051449.188890:0:46497:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 12288 00000004:00200000:0.0:1777051449.188897:0:46497:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1777051449.188923:0:46497:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99d950705c00/0x85f51a6b96716e86 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051449.188959:0:46497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d950705600/0x85f51a6b96716e7f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b67df expref: 44 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051449.188983:0:46497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950705c00/0x85f51a6b96716e86 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b67df expref: 43 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051449.188998:0:46497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d9533ab000) 00010000:00010000:0.0:1777051449.189003:0:46497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1777051449.189008:0:46497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d950705c00, rc 0) 00000100:00100000:0.0:1777051449.189359:0:46497:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f97c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+43:138749:x1863365426049408:12345-192.168.201.46@tcp:101:lfs.0 Request processed in 707us (1232us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051449.189374:0:46497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112252 00000100:00100000:3.0:1777051449.193494:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051449.193698:0:8492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426049664 00000100:00100000:1.0:1777051449.193708:0:8492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426049664 00000100:00100000:1.0:1777051449.193772:0:8492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112253 00000100:00100000:1.0:1777051449.193791:0:8492:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f97e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+43:138749:x1863365426049664:12345-192.168.201.46@tcp:101:lfs.0 00010000:00010000:1.0:1777051449.193812:0:8492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777051449.193836:0:8492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce400/0x85f51a6b96716e8d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b67e6 expref: -99 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051449.193920:0:8492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cec00/0x85f51a6b96716e94 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051449.193940:0:8492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cec00/0x85f51a6b96716e94 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051449.193957:0:8492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cec00/0x85f51a6b96716e94 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051449.193977:0:8492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cf200/0x85f51a6b96716e9b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x45e84fca bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051449.193995:0:8492:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99d950705e00/0x85f51a6b96716e4e lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x45e84fca bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b96716e47 expref: 8 pid: 46498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051449.194009:0:8492:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cf200/0x85f51a6b96716e9b lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x45e84fca bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051449.194055:0:8492:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99d950705e00/0x85f51a6b96716e4e lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x45e84fca bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x85f51a6b96716e47 expref: 8 pid: 46498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051449.194079:0:8492:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95f65a300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8492:1863365452663808:0@lo:104: 00000100:00100000:1.0:1777051449.194457:0:8492:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051449.194509:0:8492:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da7b379cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1777051449.194965:0:99220:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452663808 00000100:00100000:3.0:1777051449.194974:0:99220:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452663808 00000100:00100000:3.0:1777051449.195040:0:99220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1777051449.195053:0:99220:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f659f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:8492:x1863365452663808:12345-0@lo:104: 00010000:00010000:3.0:1777051449.195392:0:99220:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d9559a2800/0x85f51a6b96716e47 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x45e84fca bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x85f51a6b96716e4e expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051449.195486:0:99220:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1777051449.195498:0:99220:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f659f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:8492:x1863365452663808:12345-0@lo:104: Request processed in 446us (1346us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051449.195510:0:99220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00010000:00010000:3.0:1777051449.195546:0:13753:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777051449.195557:0:13753:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d9559a2800/0x85f51a6b96716e47 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x45e84fca bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x85f51a6b96716e4e expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051449.195574:0:13753:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d9559a2800 already unused, calling callback (ffffffffc177eed0) 00010000:00010000:3.0:1777051449.195583:0:13753:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d9559a2800/0x85f51a6b96716e47 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x45e84fca bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0x85f51a6b96716e4e expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777051449.195636:0:13753:0:(mdt_handler.c:3963:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d9559a2800/0x85f51a6b96716e47 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x45e84fca bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0x85f51a6b96716e4e expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051449.195680:0:13753:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d9559a2800/0x85f51a6b96716e47 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x45e84fca bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x85f51a6b96716e4e expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051449.195695:0:13753:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1777051449.195728:0:8492:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95f65a300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8492:1863365452663808:0@lo:104: 00010000:00010000:3.0:1777051449.195728:0:13753:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d9559a2800/0x85f51a6b96716e47 lrc: 1/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x45e84fca bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x85f51a6b96716e4e expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051449.196050:0:13753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d9559a2800/0x85f51a6b96716e47 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x45e84fca bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x85f51a6b96716e4e expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051449.196055:0:8492:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cf200/0x85f51a6b96716e9b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x45e84fca bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051449.196378:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051449.196385:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051449.196389:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777051449.196410:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95f97f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452663936:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1777051449.196453:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051449.196650:0:6566:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452663936 00000100:00100000:2.0:1777051449.196661:0:6566:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452663936 00010000:00010000:2.0:1777051449.196701:0:6566:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d950705e00/0x85f51a6b96716e4e lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x45e84fca bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0x85f51a6b96716e47 expref: 9 pid: 46498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051449.196770:0:6566:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3933 00000100:00100000:2.0:1777051449.196785:0:6566:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f97e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+9:3677:x1863365452663936:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1777051449.196804:0:6566:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000001:00080000:1.0:1777051449.201418:0:103159:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771212 is committed 00000001:00080000:1.0:1777051449.201433:0:103159:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771211 is committed 00000004:00080000:1.0:1777051449.201447:0:103159:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:1.0:1777051449.201489:0:103159:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff99d941082600 refcount 2 committed 0 result 0 batchid 25769803780 00000020:00080000:1.0:1777051449.201499:0:103159:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff99d942aec500 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff99d9410826c0 00000020:00080000:1.0:1777051449.201505:0:103159:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff99d942aec900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff99da57b15400 00000001:00080000:1.0:1777051449.201552:0:103159:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771200 is committed 00000100:00100000:0.0:1777051449.201666:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7cd9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3678:1863365452664064:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1777051449.201713:0:6566:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d950705e00/0x85f51a6b96716e4e lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x45e84fca bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0x85f51a6b96716e47 expref: 8 pid: 46498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051449.201737:0:6566:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x45e84fca (ffff99da42881d00) 00010000:00010000:1.0:1777051449.201747:0:6566:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cf200/0x85f51a6b96716e9b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x45e84fca bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051449.201764:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1777051449.201766:0:6566:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cf200/0x85f51a6b96716e9b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x45e84fca bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051449.201783:0:6566:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cf200/0x85f51a6b96716e9b lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x45e84fca bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051449.201826:0:6566:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1777051449.201839:0:8468:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452664064 00000100:00100000:0.0:1777051449.201848:0:8468:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452664064 00000100:00100000:1.0:1777051449.201898:0:6566:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f97e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+7:3677:x1863365452663936:12345-0@lo:103:ldlm_bl.0 Request processed in 5113us (5439us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051449.201908:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8072 00000100:00100000:1.0:1777051449.201920:0:6566:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3933 00000100:00100000:0.0:1777051449.201929:0:8468:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7cd9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3678:x1863365452664064:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1777051449.201961:0:8468:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:485 count 1 00010000:00010000:1.0:1777051449.201974:0:8492:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cf200/0x85f51a6b96716e9b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x45e84fca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051449.201991:0:8492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cf200/0x85f51a6b96716e9b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x45e84fca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1777051449.202000:0:8468:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x1e5:0x0] initial LVB size: 1048576, mtime: 0x69eba738, atime: 0x0, ctime: 0x69eba738, blocks: 0x800 00010000:00010000:0.0:1777051449.202015:0:8468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e578232a/0x85f51a6b96716ea2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051449.202038:0:8468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777051449.202042:0:8468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777051449.202050:0:8468:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e578232a/0x85f51a6b96716ea2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051449.202072:0:8468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e578232a/0x85f51a6b96716ea2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051449.202089:0:8468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e578232a/0x85f51a6b96716ea2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051449.202104:0:8468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e578232a/0x85f51a6b96716ea2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051449.202132:0:8468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1777051449.202174:0:8492:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95f65a300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8492:1863365452664192:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1777051449.202301:0:8492:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051449.202343:0:8492:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da7b3793c0 going to sleep for 11 seconds 00000100:00100000:0.0:1777051449.202402:0:8468:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7cd9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3678:x1863365452664064:12345-0@lo:6:osp-syn-0-0.0 Request processed in 474us (638us total) trans 4294968369 rc 0/0 00000100:00100000:0.0:1777051449.202416:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8072 00000100:00100000:1.0:1777051449.202456:0:11727:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452664192 00010000:00010000:0.0:1777051449.202464:0:38719:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1777051449.202467:0:11727:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452664192 00010000:00010000:0.0:1777051449.202479:0:38719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e578232a/0x85f51a6b96716ea2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051449.202496:0:38719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d950704800 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:0.0:1777051449.202505:0:38719:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e578232a/0x85f51a6b96716ea2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051449.202523:0:38719:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e578232a/0x85f51a6b96716ea2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051449.202545:0:11727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8254 00010000:00010000:0.0:1777051449.202549:0:38719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e578232a/0x85f51a6b96716ea2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051449.202567:0:11727:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f65aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:8492:x1863365452664192:12345-0@lo:1000:mdt00_003.0 00010000:00010000:0.0:1777051449.202572:0:38719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e578232a/0x85f51a6b96716ea2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051449.202604:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777051449.202634:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777051449.202639:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1777051449.202722:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95f97f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452663936:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1777051449.202738:0:11727:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f65aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:8492:x1863365452664192:12345-0@lo:1000:mdt00_003.0 Request processed in 176us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051449.202752:0:11727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8254 00000004:00080000:0.0:1777051449.202786:0:3678:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99da7cd9c000/2, rc 0, transno 4294968369 00000100:00100000:0.0:1777051449.202800:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7cd9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3678:1863365452664064:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1777051449.202837:0:8492:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95f65a300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8492:1863365452664192:0@lo:1000:mdt00_003.0 00000020:00080000:3.0:1777051449.202895:0:103195:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 25769803780 committed batchid 25769803779 00010000:00010000:1.0:1777051449.202908:0:8492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cfa00/0x85f51a6b96716ea9 lrc: 3/1,0 mode: --/PR res: [0x240000bd3:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051449.202927:0:8492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cfa00/0x85f51a6b96716ea9 lrc: 3/1,0 mode: PR/PR res: [0x240000bd3:0x4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051449.202942:0:8492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cfa00/0x85f51a6b96716ea9 lrc: 3/1,0 mode: PR/PR res: [0x240000bd3:0x4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1777051449.202956:0:103195:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 25769803779 00010000:00010000:1.0:1777051449.202962:0:8492:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cec00/0x85f51a6b96716e94 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051449.202976:0:8492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cec00/0x85f51a6b96716e94 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051449.202986:0:8492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cec00/0x85f51a6b96716e94 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051449.202997:0:8492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cec00/0x85f51a6b96716e94 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051449.203008:0:8492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da7d5cec00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:1.0:1777051449.203016:0:8492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cec00/0x85f51a6b96716e94 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051449.203028:0:8492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cec00/0x85f51a6b96716e94 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051449.203047:0:8492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d9533ab000) 00010000:00010000:1.0:1777051449.203052:0:8492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777051449.203059:0:8492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cec00/0x85f51a6b96716e94 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051449.203071:0:8492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cec00/0x85f51a6b96716e94 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051449.203095:0:8492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cf200/0x85f51a6b96716e9b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x45e84fca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051449.203108:0:8492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cf200/0x85f51a6b96716e9b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x45e84fca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051449.203120:0:8492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cf200/0x85f51a6b96716e9b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x45e84fca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051449.203131:0:8492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da7d5cf200 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:1.0:1777051449.203137:0:8492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cf200/0x85f51a6b96716e9b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x45e84fca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051449.203148:0:8492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cf200/0x85f51a6b96716e9b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x45e84fca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051449.203452:0:8492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x45e84fca (ffff99da42881d00) 00010000:00010000:1.0:1777051449.203458:0:8492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777051449.203466:0:8492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cf200/0x85f51a6b96716e9b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x45e84fca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051449.203478:0:8492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cf200/0x85f51a6b96716e9b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x45e84fca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051449.203555:0:8492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce400/0x85f51a6b96716e8d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b67e6 expref: 34 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051449.203583:0:8492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cfa00/0x85f51a6b96716ea9 lrc: 3/0,0 mode: PR/PR res: [0x240000bd3:0x4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b67e6 expref: 33 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051449.203595:0:8492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd3:0x4:0x0].0x0 (ffff99d94e52a700) 00010000:00010000:1.0:1777051449.203600:0:8492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1777051449.203604:0:8492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99da7d5cfa00, rc 0) 00000100:00100000:1.0:1777051449.203718:0:8492:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f97e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+33:138749:x1863365426049664:12345-192.168.201.46@tcp:101:lfs.0 Request processed in 9930us (10223us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051449.203734:0:8492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112253 00000100:00100000:3.0:1777051449.208115:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051449.208524:0:27885:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426049920 00000100:00100000:1.0:1777051449.208534:0:27885:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426049920 00000100:00100000:1.0:1777051449.208636:0:27885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112254 00000100:00100000:1.0:1777051449.208653:0:27885:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f97c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+54:138749:x1863365426049920:12345-192.168.201.46@tcp:101:lfs.0 00010000:00010000:1.0:1777051449.208679:0:27885:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777051449.208702:0:27885:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d5cfc00/0x85f51a6b96716eb0 lrc: 2/0,0 mode: --/CR res: [0x240000bd3:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b67ed expref: -99 pid: 27885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1777051449.209185:0:27885:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000bd3:0x4:0x0]: returning size 4096 00010000:00010000:1.0:1777051449.209393:0:27885:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d5cfc00/0x85f51a6b96716eb0 lrc: 1/0,0 mode: --/CR res: [0x240000bd3:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b67ed expref: 56 pid: 27885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051449.209417:0:27885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd3:0x4:0x0].0x0 (ffff99d9502e3d00) 00010000:00010000:1.0:1777051449.209423:0:27885:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1777051449.209434:0:27885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d5cfc00/0x85f51a6b96716eb0 lrc: 0/0,0 mode: --/CR res: [0x240000bd3:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b67ed expref: 56 pid: 27885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051449.209459:0:27885:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99da7d5cfc00, rc 0) 00000100:00100000:1.0:1777051449.209537:0:27885:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f97c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+55:138749:x1863365426049920:12345-192.168.201.46@tcp:101:lfs.0 Request processed in 884us (1421us total) trans 8589934721 rc 301/301 00000100:00100000:1.0:1777051449.209552:0:27885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112254 00000100:00100000:3.0:1777051449.212656:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051449.213053:0:6579:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426050048 00000100:00100000:0.0:1777051449.213064:0:6579:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426050048 00000100:00100000:0.0:1777051449.213135:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112255 00000100:00100000:0.0:1777051449.213150:0:6579:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f97d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+55:138749:x1863365426050048:12345-192.168.201.46@tcp:101:lfs.0 00010000:00010000:0.0:1777051449.213170:0:6579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051449.213192:0:6579:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d950704800/0x85f51a6b96716ebe lrc: 2/0,0 mode: --/CR res: [0x240000bd0:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b67f4 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051449.213255:0:6579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d950705600/0x85f51a6b96716ec5 lrc: 3/1,0 mode: --/PR res: [0x240000bd0:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051449.213275:0:6579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d950705600/0x85f51a6b96716ec5 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051449.213295:0:6579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d950705600/0x85f51a6b96716ec5 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1777051449.213355:0:6579:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000bd0:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1777051449.213363:0:6579:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1777051449.213412:0:6579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d950704800/0x85f51a6b96716ebe lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b67f4 expref: 57 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051449.213483:0:6579:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99d950705600/0x85f51a6b96716ec5 lrc: 3/0,0 mode: PR/PR res: [0x240000bd0:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b67f4 expref: 56 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051449.213496:0:6579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x3:0x0].0x0 (ffff99d9502e3c00) 00010000:00010000:0.0:1777051449.213500:0:6579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1777051449.213506:0:6579:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d950705600, rc 0) 00000100:00100000:0.0:1777051449.213570:0:6579:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f97d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+56:138749:x1863365426050048:12345-192.168.201.46@tcp:101:lfs.0 Request processed in 422us (916us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051449.213582:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112255 00000100:00100000:3.0:1777051449.218931:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051449.219031:0:21368:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426050176 00000100:00100000:1.0:1777051449.219040:0:21368:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426050176 00000100:00100000:1.0:1777051449.219101:0:21368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112256 00000100:00100000:1.0:1777051449.219115:0:21368:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f97f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+33:138749:x1863365426050176:12345-192.168.201.46@tcp:101:lfs.0 00010000:00010000:1.0:1777051449.219135:0:21368:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777051449.219499:0:21368:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cfc00/0x85f51a6b96716ecc lrc: 2/0,0 mode: --/CR res: [0x2000032e2:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b67fb expref: -99 pid: 21368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051449.219568:0:21368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce400/0x85f51a6b96716ed3 lrc: 3/1,0 mode: --/PR res: [0x2000032e2:0x8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051449.219590:0:21368:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3400/0x85f51a6b96716e78 lrc: 2/0,0 mode: PW/PW res: [0x2000032e2:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b96716e71 expref: 6 pid: 47208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051449.219604:0:21368:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce400/0x85f51a6b96716ed3 lrc: 4/1,0 mode: --/PR res: [0x2000032e2:0x8:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051449.219683:0:21368:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3400/0x85f51a6b96716e78 lrc: 3/0,0 mode: PW/PW res: [0x2000032e2:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x85f51a6b96716e71 expref: 6 pid: 47208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051449.219990:0:21368:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95f65a300 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:21368:1863365452664320:0@lo:104: 00000100:00100000:1.0:1777051449.220047:0:21368:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051449.220100:0:21368:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da7b3793c0 going to sleep for 11 seconds 00000100:00100000:2.0:1777051449.220153:0:6563:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452664320 00000100:00100000:2.0:1777051449.220163:0:6563:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452664320 00000100:00100000:2.0:1777051449.220252:0:6563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1777051449.220271:0:6563:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f65b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:21368:x1863365452664320:12345-0@lo:104: 00010000:00010000:2.0:1777051449.220291:0:6563:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950710e00/0x85f51a6b96716e71 lrc: 3/0,0 mode: PW/PW res: [0x2000032e2:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x85f51a6b96716e78 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051449.220388:0:6563:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1777051449.220400:0:6563:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f65b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:21368:x1863365452664320:12345-0@lo:104: Request processed in 135us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051449.220413:0:6563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1777051449.220443:0:21368:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95f65a300 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:21368:1863365452664320:0@lo:104: 00010000:00010000:0.0:1777051449.220450:0:6568:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1777051449.220464:0:6568:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950710e00/0x85f51a6b96716e71 lrc: 3/0,0 mode: PW/PW res: [0x2000032e2:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x85f51a6b96716e78 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051449.220474:0:21368:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce400/0x85f51a6b96716ed3 lrc: 3/1,0 mode: --/PR res: [0x2000032e2:0x8:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051449.220478:0:6568:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d950710e00 already unused, calling callback (ffffffffc177eed0) 00010000:00010000:0.0:1777051449.220490:0:6568:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950710e00/0x85f51a6b96716e71 lrc: 4/0,0 mode: PW/PW res: [0x2000032e2:0x8:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0x85f51a6b96716e78 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1777051449.220510:0:6568:0:(mdt_handler.c:3963:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950710e00/0x85f51a6b96716e71 lrc: 4/0,0 mode: PW/PW res: [0x2000032e2:0x8:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0x85f51a6b96716e78 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051449.220544:0:6568:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950710e00/0x85f51a6b96716e71 lrc: 2/0,0 mode: --/PW res: [0x2000032e2:0x8:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x85f51a6b96716e78 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051449.220552:0:6568:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1777051449.220591:0:6568:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950710e00/0x85f51a6b96716e71 lrc: 1/0,0 mode: --/PW res: [0x2000032e2:0x8:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x85f51a6b96716e78 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051449.220600:0:6568:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950710e00/0x85f51a6b96716e71 lrc: 0/0,0 mode: --/PW res: [0x2000032e2:0x8:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x85f51a6b96716e78 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051449.220657:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777051449.220661:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777051449.220667:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1777051449.220667:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7cd9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452664448:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1777051449.220722:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051449.221109:0:24467:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452664448 00000100:00100000:3.0:1777051449.221118:0:24467:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452664448 00010000:00010000:3.0:1777051449.221152:0:24467:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3400/0x85f51a6b96716e78 lrc: 3/0,0 mode: PW/PW res: [0x2000032e2:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0x85f51a6b96716e71 expref: 7 pid: 47208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051449.221256:0:24467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3934 00000100:00100000:3.0:1777051449.221273:0:24467:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da54223450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+7:3679:x1863365452664448:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1777051449.221291:0:24467:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000020:00080000:1.0:1777051449.227278:0:103159:0:(update_trans.c:1333:distribute_txn_batchid_cb()) lustre-MDT0000: 25769803780 batchid updated 00000020:00080000:3.0:1777051449.227346:0:103195:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 25769803780 00000020:00080000:3.0:1777051449.227368:0:103195:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 25769803780 00010000:00010000:2.0:1777051449.227467:0:24467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3400/0x85f51a6b96716e78 lrc: 0/0,0 mode: --/PW res: [0x2000032e2:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0x85f51a6b96716e71 expref: 7 pid: 47208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051449.227494:0:24467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0x8:0x0].0x0 (ffff99d94e6b6200) 00010000:00010000:2.0:1777051449.227502:0:24467:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce400/0x85f51a6b96716ed3 lrc: 3/1,0 mode: --/PR res: [0x2000032e2:0x8:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051449.227517:0:24467:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce400/0x85f51a6b96716ed3 lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0x8:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051449.227536:0:24467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce400/0x85f51a6b96716ed3 lrc: 4/1,0 mode: PR/PR res: [0x2000032e2:0x8:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051449.227592:0:24467:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1777051449.227677:0:21368:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce400/0x85f51a6b96716ed3 lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051449.227696:0:21368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce400/0x85f51a6b96716ed3 lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051449.227702:0:24467:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da54223450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+6:3679:x1863365452664448:12345-0@lo:103:ldlm_bl.0 Request processed in 6430us (6974us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051449.227723:0:24467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3934 00000004:00200000:1.0:1777051449.227766:0:21368:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000032e2:0x8:0x0]: returning size 4096 00000004:00200000:1.0:1777051449.227776:0:21368:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000100:00100000:0.0:1777051449.227788:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7cd9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452664448:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1777051449.227836:0:21368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cfc00/0x85f51a6b96716ecc lrc: 0/0,0 mode: --/CR res: [0x2000032e2:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b67fb expref: 35 pid: 21368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051449.227865:0:21368:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce400/0x85f51a6b96716ed3 lrc: 3/0,0 mode: PR/PR res: [0x2000032e2:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b67fb expref: 34 pid: 21368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051449.227879:0:21368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0x8:0x0].0x0 (ffff99d94e6b6200) 00010000:00010000:1.0:1777051449.227884:0:21368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1777051449.227888:0:21368:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99da7d5ce400, rc 0) 00000100:00100000:1.0:1777051449.227956:0:21368:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f97f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+34:138749:x1863365426050176:12345-192.168.201.46@tcp:101:lfs.0 Request processed in 8842us (9037us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051449.227969:0:21368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112256 00000100:00100000:3.0:1777051449.232673:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051449.232786:0:46497:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426050304 00000100:00100000:0.0:1777051449.232816:0:46497:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426050304 00000100:00100000:0.0:1777051449.232895:0:46497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112257 00000100:00100000:0.0:1777051449.232910:0:46497:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f97ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+56:138749:x1863365426050304:12345-192.168.201.46@tcp:101:lfs.0 00010000:00010000:0.0:1777051449.232932:0:46497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051449.232960:0:46497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d950704800/0x85f51a6b96716eda lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6802 expref: -99 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051449.233034:0:46497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d950704600/0x85f51a6b96716ee1 lrc: 3/1,0 mode: --/PR res: [0x240000bd3:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051449.233061:0:46497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d950704600/0x85f51a6b96716ee1 lrc: 3/1,0 mode: PR/PR res: [0x240000bd3:0x4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051449.233077:0:46497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d950704600/0x85f51a6b96716ee1 lrc: 3/1,0 mode: PR/PR res: [0x240000bd3:0x4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1777051449.233259:0:46497:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000bd3:0x4:0x0]: returning size 4096 00000004:00200000:0.0:1777051449.233268:0:46497:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:0.0:1777051449.233295:0:46497:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff99d950704600/0x85f51a6b96716ee1 lrc: 3/1,0 mode: PR/PR res: [0x240000bd3:0x4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051449.233331:0:46497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d950704800/0x85f51a6b96716eda lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6802 expref: 58 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051449.233362:0:46497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99d950704600/0x85f51a6b96716ee1 lrc: 3/0,0 mode: PR/PR res: [0x240000bd3:0x4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6802 expref: 57 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051449.233376:0:46497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd3:0x4:0x0].0x0 (ffff99d9502e3d00) 00010000:00010000:0.0:1777051449.233381:0:46497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1777051449.233386:0:46497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d950704600, rc 0) 00000100:00100000:0.0:1777051449.233470:0:46497:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f97ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+57:138749:x1863365426050304:12345-192.168.201.46@tcp:101:lfs.0 Request processed in 562us (800us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051449.233482:0:46497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112257 00000100:00100000:3.0:1777051449.238432:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051449.238684:0:6582:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426050432 00000100:00100000:2.0:1777051449.238695:0:6582:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426050432 00000100:00100000:2.0:1777051449.238745:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3403 00000100:00100000:2.0:1777051449.238758:0:6582:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da6ff02450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+57:138749:x1863365426050432:12345-192.168.201.46@tcp:37:lfs.0 00000100:00100000:2.0:1777051449.244760:0:6582:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da6ff02450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+57:138749:x1863365426050432:12345-192.168.201.46@tcp:37:lfs.0 Request processed in 5992us (6322us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051449.244780:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3403 00000100:00100000:3.0:1777051449.248447:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051449.248555:0:24269:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426050560 00000100:00100000:2.0:1777051449.248567:0:24269:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426050560 00000100:00100000:2.0:1777051449.248949:0:24269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3404 00000100:00100000:2.0:1777051449.248969:0:24269:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f97f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+34:138749:x1863365426050560:12345-192.168.201.46@tcp:37:lfs.0 00000100:00100000:1.0:1777051449.254594:0:24269:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f97f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+34:138749:x1863365426050560:12345-192.168.201.46@tcp:37:lfs.0 Request processed in 5625us (6141us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051449.254635:0:24269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3404 00000100:00100000:0.0:1777051449.258044:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051449.258137:0:6581:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426050688 00000100:00100000:2.0:1777051449.258148:0:6581:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426050688 00000100:00100000:2.0:1777051449.258309:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112258 00000100:00100000:2.0:1777051449.258321:0:6581:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7cd9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+34:138749:x1863365426050688:12345-192.168.201.46@tcp:34:lfs.0 00010000:00010000:2.0:1777051449.258391:0:6581:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710200/0x85f51a6b96716ee8 lrc: 3/1,0 mode: --/CR res: [0x2000032e2:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051449.258411:0:6581:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710200/0x85f51a6b96716ee8 lrc: 3/1,0 mode: CR/CR res: [0x2000032e2:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051449.258425:0:6581:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710200/0x85f51a6b96716ee8 lrc: 3/1,0 mode: CR/CR res: [0x2000032e2:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051449.258441:0:6581:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950711400/0x85f51a6b96716eef lrc: 3/1,0 mode: --/PR res: [0x2000032e2:0x8:0x0].0x15f59727 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051449.258448:0:6581:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d950711400/0x85f51a6b96716eef lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0x8:0x0].0x15f59727 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051449.258454:0:6581:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d950711400/0x85f51a6b96716eef lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0x8:0x0].0x15f59727 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051449.258561:0:6581:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950711800/0x85f51a6b96716ef6 lrc: 3/1,0 mode: --/PR res: [0x2000032e3:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051449.258570:0:6581:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d950711800/0x85f51a6b96716ef6 lrc: 3/1,0 mode: PR/PR res: [0x2000032e3:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051449.258578:0:6581:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d950711800/0x85f51a6b96716ef6 lrc: 3/1,0 mode: PR/PR res: [0x2000032e3:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1777051449.258668:0:6581:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99d950711800/0x85f51a6b96716ef6 lrc: 3/1,0 mode: PR/PR res: [0x2000032e3:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051449.258682:0:6581:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710200/0x85f51a6b96716ee8 lrc: 3/1,0 mode: CR/CR res: [0x2000032e2:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051449.258690:0:6581:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710200/0x85f51a6b96716ee8 lrc: 2/0,0 mode: CR/CR res: [0x2000032e2:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051449.258698:0:6581:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710200/0x85f51a6b96716ee8 lrc: 3/0,0 mode: CR/CR res: [0x2000032e2:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051449.258709:0:6581:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d950710200 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:2.0:1777051449.258714:0:6581:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710200/0x85f51a6b96716ee8 lrc: 3/0,0 mode: CR/CR res: [0x2000032e2:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051449.258976:0:6581:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710200/0x85f51a6b96716ee8 lrc: 4/0,0 mode: CR/CR res: [0x2000032e2:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051449.258999:0:6581:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0x8:0x0].0x0 (ffff99d94e6b6200) 00010000:00010000:2.0:1777051449.259004:0:6581:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777051449.259012:0:6581:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710200/0x85f51a6b96716ee8 lrc: 2/0,0 mode: --/CR res: [0x2000032e2:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051449.259023:0:6581:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710200/0x85f51a6b96716ee8 lrc: 0/0,0 mode: --/CR res: [0x2000032e2:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051449.259043:0:6581:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950711400/0x85f51a6b96716eef lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0x8:0x0].0x15f59727 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051449.259053:0:6581:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d950711400/0x85f51a6b96716eef lrc: 2/0,0 mode: PR/PR res: [0x2000032e2:0x8:0x0].0x15f59727 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051449.259062:0:6581:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d950711400/0x85f51a6b96716eef lrc: 3/0,0 mode: PR/PR res: [0x2000032e2:0x8:0x0].0x15f59727 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051449.259071:0:6581:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d950711400 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:2.0:1777051449.259075:0:6581:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d950711400/0x85f51a6b96716eef lrc: 3/0,0 mode: PR/PR res: [0x2000032e2:0x8:0x0].0x15f59727 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051449.259085:0:6581:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d950711400/0x85f51a6b96716eef lrc: 4/0,0 mode: PR/PR res: [0x2000032e2:0x8:0x0].0x15f59727 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051449.259102:0:6581:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0x8:0x0].0x15f59727 (ffff99d9502e3b00) 00010000:00010000:2.0:1777051449.259107:0:6581:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777051449.259111:0:6581:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d950711400/0x85f51a6b96716eef lrc: 2/0,0 mode: --/PR res: [0x2000032e2:0x8:0x0].0x15f59727 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051449.259120:0:6581:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d950711400/0x85f51a6b96716eef lrc: 0/0,0 mode: --/PR res: [0x2000032e2:0x8:0x0].0x15f59727 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051449.259142:0:6581:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950711800/0x85f51a6b96716ef6 lrc: 3/1,0 mode: PR/PR res: [0x2000032e3:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051449.259153:0:6581:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d950711800/0x85f51a6b96716ef6 lrc: 2/0,0 mode: PR/PR res: [0x2000032e3:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051449.259161:0:6581:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d950711800/0x85f51a6b96716ef6 lrc: 3/0,0 mode: PR/PR res: [0x2000032e3:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051449.259169:0:6581:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d950711800 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:2.0:1777051449.259174:0:6581:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d950711800/0x85f51a6b96716ef6 lrc: 3/0,0 mode: PR/PR res: [0x2000032e3:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051449.259183:0:6581:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d950711800/0x85f51a6b96716ef6 lrc: 4/0,0 mode: PR/PR res: [0x2000032e3:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051449.259246:0:6581:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e3:0x9:0x0].0x0 (ffff99d9502e3f00) 00010000:00010000:2.0:1777051449.259252:0:6581:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777051449.259257:0:6581:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d950711800/0x85f51a6b96716ef6 lrc: 2/0,0 mode: --/PR res: [0x2000032e3:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051449.259266:0:6581:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d950711800/0x85f51a6b96716ef6 lrc: 0/0,0 mode: --/PR res: [0x2000032e3:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051449.259359:0:6581:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7cd9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+34:138749:x1863365426050688:12345-192.168.201.46@tcp:34:lfs.0 Request processed in 1037us (1317us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051449.259374:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112258 00000100:00100000:3.0:1777051449.261133:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051449.261263:0:46494:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426050944 00000100:00100000:0.0:1777051449.261274:0:46494:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426050944 00000100:00100000:0.0:1777051449.261367:0:46494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112259 00000100:00100000:0.0:1777051449.261382:0:46494:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f97ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+34:138749:x1863365426050944:12345-192.168.201.46@tcp:101:lfs.0 00010000:00010000:0.0:1777051449.261401:0:46494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051449.261425:0:46494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d950704e00/0x85f51a6b96716efd lrc: 2/0,0 mode: --/CR res: [0x2000032e3:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6809 expref: -99 pid: 46494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051449.261590:0:46494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950704400/0x85f51a6b96716f04 lrc: 3/0,1 mode: --/PW res: [0x2000032e3:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051449.261636:0:46494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d950704400/0x85f51a6b96716f04 lrc: 3/0,1 mode: PW/PW res: [0x2000032e3:0x9:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051449.261653:0:46494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d950704400/0x85f51a6b96716f04 lrc: 3/0,1 mode: PW/PW res: [0x2000032e3:0x9:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1777051449.261671:0:46494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000032e3:0x9:0x0]: returning size 1048576 00010000:00010000:0.0:1777051449.261845:0:46494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d950704e00/0x85f51a6b96716efd lrc: 0/0,0 mode: --/CR res: [0x2000032e3:0x9:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6809 expref: 37 pid: 46494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051449.261874:0:46494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950704400/0x85f51a6b96716f04 lrc: 3/0,0 mode: PW/PW res: [0x2000032e3:0x9:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6809 expref: 36 pid: 46494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051449.261887:0:46494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e3:0x9:0x0].0x0 (ffff99da42881100) 00010000:00010000:0.0:1777051449.261892:0:46494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1777051449.261896:0:46494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d950704400, rc 0) 00000100:00100000:0.0:1777051449.261962:0:46494:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f97ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+36:138749:x1863365426050944:12345-192.168.201.46@tcp:101:lfs.0 Request processed in 582us (830us total) trans 30064771213 rc 0/0 00000100:00100000:0.0:1777051449.261976:0:46494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112259 00000100:00100000:0.0:1777051449.265721:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051449.265805:0:27882:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426051072 00000100:00100000:3.0:1777051449.265815:0:27882:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426051072 00000100:00100000:3.0:1777051449.265873:0:27882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112260 00000100:00100000:3.0:1777051449.265886:0:27882:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7cd9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+36:138749:x1863365426051072:12345-192.168.201.46@tcp:101:lfs.0 00010000:00010000:3.0:1777051449.265907:0:27882:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777051449.265925:0:27882:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2a00/0x85f51a6b96716f12 lrc: 2/0,0 mode: --/CR res: [0x2000032e3:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6810 expref: -99 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051449.265984:0:27882:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2a00/0x85f51a6b96716f12 lrc: 3/0,0 mode: CR/CR res: [0x2000032e3:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6810 expref: 37 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051449.266003:0:27882:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2a00/0x85f51a6b96716f12 lrc: 3/0,0 mode: CR/CR res: [0x2000032e3:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6810 expref: 37 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051449.266030:0:27882:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e3:0x9:0x0].0x0 (ffff99da42881100) 00010000:00010000:3.0:1777051449.266037:0:27882:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1777051449.266042:0:27882:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d9559a2a00, rc 0) 00000100:00100000:3.0:1777051449.266109:0:27882:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7cd9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+37:138749:x1863365426051072:12345-192.168.201.46@tcp:101:lfs.0 Request processed in 225us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051449.266375:0:27882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112260 00000100:00100000:2.0:1777051449.271585:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051449.271666:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051449.271702:0:9550:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426051200 00000100:00100000:3.0:1777051449.271714:0:9550:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426051200 00000100:00100000:0.0:1777051449.272039:0:47827:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426051328 00000100:00100000:0.0:1777051449.272049:0:47827:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426051328 00000100:00100000:3.0:1777051449.272299:0:9550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13714 00000100:00100000:1.0:1777051449.272323:0:47597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13715 00000100:00100000:3.0:1777051449.272326:0:9550:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d956129880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+57:2436:x1863365426051200:12345-192.168.201.46@tcp:103:lfs.0 00000100:00100000:1.0:1777051449.272350:0:47597:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d956128380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+37:2437:x1863365426051328:12345-192.168.201.46@tcp:103:lfs.0 00010000:00010000:1.0:1777051449.272371:0:47597:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1777051449.272400:0:47597:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce400/0x85f51a6b96716ed3 lrc: 0/0,0 mode: --/PR res: [0x2000032e2:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b67fb expref: 37 pid: 21368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051449.272426:0:47597:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0x8:0x0].0x0 (ffff99d94e6b6200) 00010000:00010000:3.0:1777051449.272429:0:9550:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1777051449.272439:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00010000:00010000:1.0:1777051449.272446:0:47597:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1777051449.272464:0:9550:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d950704600/0x85f51a6b96716ee1 lrc: 0/0,0 mode: --/PR res: [0x240000bd3:0x4:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6802 expref: 57 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051449.272491:0:9550:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd3:0x4:0x0].0x0 (ffff99d9502e3d00) 00010000:00010000:3.0:1777051449.272499:0:9550:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1777051449.272526:0:47597:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d956128380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+36:2437:x1863365426051328:12345-192.168.201.46@tcp:103:lfs.0 Request processed in 183us (858us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051449.272542:0:47597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13715 00000100:00100000:0.0:1777051449.272556:0:6594:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426051712 00000100:00100000:2.0:1777051449.272567:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051449.272569:0:6594:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426051712 00000100:00100000:3.0:1777051449.272569:0:9550:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d956129880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+56:2436:x1863365426051200:12345-192.168.201.46@tcp:103:lfs.0 Request processed in 234us (969us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051449.272590:0:9550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13714 00000100:00100000:2.0:1777051449.272655:0:6566:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426051456 00000100:00100000:2.0:1777051449.272665:0:6566:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426051456 00000100:00100000:0.0:1777051449.272674:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 9 00000100:00100000:0.0:1777051449.272695:0:6594:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d956128a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+36:138749:x1863365426051712:12345-192.168.201.46@tcp:36:lfs.0 00000100:00100000:2.0:1777051449.272732:0:6566:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13716 00000100:00100000:2.0:1777051449.272752:0:6566:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942a0df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+56:2436:x1863365426051456:12345-192.168.201.46@tcp:103:lfs.0 00010000:00010000:2.0:1777051449.272771:0:6566:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777051449.272777:0:6594:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950704e00/0x85f51a6b96716f19 lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051449.272798:0:6594:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d950704e00/0x85f51a6b96716f19 lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051449.272816:0:6594:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d950704e00/0x85f51a6b96716f19 lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051449.272817:0:6566:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d950705600/0x85f51a6b96716ec5 lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b67f4 expref: 56 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051449.272855:0:6566:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x3:0x0].0x0 (ffff99d9502e3c00) 00000004:00080000:0.0:1777051449.272860:0:6594:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000bd3:0x4:0x0] 00010000:00010000:2.0:1777051449.272862:0:6566:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1777051449.272928:0:6566:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942a0df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+55:2436:x1863365426051456:12345-192.168.201.46@tcp:103:lfs.0 Request processed in 181us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051449.272941:0:6594:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7cd9ca80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6594:1863365452664576:0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1777051449.272954:0:6566:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13716 00000100:00100000:0.0:1777051449.273022:0:6594:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051449.273066:0:6594:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da5837a240 going to sleep for 11 seconds 00000100:00100000:2.0:1777051449.273103:0:46498:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452664576 00000100:00100000:2.0:1777051449.273111:0:46498:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452664576 00000100:00100000:2.0:1777051449.273166:0:46498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8255 00000100:00100000:2.0:1777051449.273177:0:46498:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7cd9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+6:6594:x1863365452664576:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1777051449.273355:0:46498:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7cd9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+6:6594:x1863365452664576:12345-0@lo:1000:mdt_io00_002.0 Request processed in 177us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051449.273370:0:46498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8255 00000100:00100000:1.0:1777051449.273414:0:6594:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7cd9ca80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6594:1863365452664576:0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1777051449.274419:0:6594:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95f65a300 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6594:1863365452664704:0@lo:403:mdt_io00_002.0 00000100:00100000:1.0:1777051449.274506:0:6594:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051449.274552:0:6594:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da7b3793c0 going to sleep for 11 seconds 00000100:00100000:2.0:1777051449.274646:0:6584:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452664704 00000100:00100000:2.0:1777051449.274655:0:6584:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452664704 00000100:00100000:2.0:1777051449.275007:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8256 00000100:00100000:2.0:1777051449.275018:0:6584:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f658a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6594:x1863365452664704:12345-0@lo:403:mdt_io00_002.0 00000100:00100000:2.0:1777051449.279001:0:6584:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f658a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6594:x1863365452664704:12345-0@lo:403:mdt_io00_002.0 Request processed in 3980us (4490us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051449.279018:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8256 00000100:00100000:1.0:1777051449.279055:0:6594:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95f65a300 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6594:1863365452664704:0@lo:403:mdt_io00_002.0 00000100:00100000:1.0:1777051449.280264:0:6594:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95f65a300 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6594:1863365452664832:0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1777051449.280311:0:6594:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051449.280345:0:6594:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da7b379e40 going to sleep for 11 seconds 00000100:00100000:3.0:1777051449.280388:0:11727:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452664832 00000100:00100000:3.0:1777051449.280398:0:11727:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452664832 00000100:00100000:3.0:1777051449.280471:0:11727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8257 00000100:00100000:3.0:1777051449.280486:0:11727:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fd63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6594:x1863365452664832:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1777051449.280598:0:11727:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fd63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6594:x1863365452664832:12345-0@lo:1000:mdt_io00_002.0 Request processed in 115us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051449.280698:0:11727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8257 00000100:00100000:1.0:1777051449.280966:0:6594:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95f65a300 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6594:1863365452664832:0@lo:1000:mdt_io00_002.0 00010000:00010000:1.0:1777051449.281044:0:6594:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff99da7d5ce400/0x85f51a6b96716f20 lrc: 3/0,1 mode: --/CW res: [0x240000bd0:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051449.281060:0:6594:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff99da7d5ce400/0x85f51a6b96716f20 lrc: 3/0,1 mode: --/CW res: [0x240000bd0:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051449.281090:0:6594:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff99da7d5ce400/0x85f51a6b96716f20 lrc: 3/0,1 mode: --/CW res: [0x240000bd0:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6594 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051449.281111:0:6594:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7fd63800 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6594:1863365452664960:0@lo:101:mdt_io00_002.0 00000100:00100000:1.0:1777051449.281149:0:6594:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051449.281191:0:6594:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da7b3793c0 going to sleep for 11 seconds 00000100:00100000:0.0:1777051449.281368:0:46500:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452664960 00000100:00100000:0.0:1777051449.281377:0:46500:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452664960 00000100:00100000:0.0:1777051449.281418:0:46500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8258 00000100:00100000:0.0:1777051449.281431:0:46500:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fd62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+6:6594:x1863365452664960:12345-0@lo:101:mdt_io00_002.0 00010000:00010000:0.0:1777051449.281447:0:46500:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051449.281469:0:46500:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d950705600/0x85f51a6b96716f27 lrc: 2/0,0 mode: --/CW res: [0x240000bd0:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x85f51a6b96716f20 expref: -99 pid: 46500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051449.281499:0:46500:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff99d950710400/0x85f51a6b96716e6a lrc: 2/0,1 mode: TXN/TXN res: [0x240000bd0:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051449.281512:0:46500:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d950705600/0x85f51a6b96716f27 lrc: 4/0,0 mode: --/CW res: [0x240000bd0:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x85f51a6b96716f20 expref: 7 pid: 46500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051449.281546:0:46500:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0001_UUID lock: ffff99d950710400/0x85f51a6b96716e6a lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd0:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 6593 initiator: MDT1 lru_score: 0 lru_type: 0 00080000:00080000:0.0:1777051449.281583:0:46500:0:(osd_handler.c:2852:osd_commit_async()) lustre-MDT0001: async commit OSD 00010000:00010000:0.0:1777051449.281677:0:46500:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99d950705600/0x85f51a6b96716f27 lrc: 3/0,0 mode: --/CW res: [0x240000bd0:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b96716f20 expref: 7 pid: 46500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051449.281693:0:46500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x3:0x0].0x0 (ffff99d9502e3c00) 00010000:00010000:0.0:1777051449.281698:0:46500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777051449.281704:0:46500:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff99d950705600/0x85f51a6b96716f27 lrc: 3/0,0 mode: --/CW res: [0x240000bd0:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b96716f20 expref: 7 pid: 46500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051449.281717:0:46500:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d950705600, rc 0) 00000100:00100000:0.0:1777051449.281809:0:46500:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fd62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+7:6594:x1863365452664960:12345-0@lo:101:mdt_io00_002.0 Request processed in 379us (658us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051449.281820:0:46500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8258 00000100:00100000:1.0:1777051449.281879:0:6594:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7fd63800 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6594:1863365452664960:0@lo:101:mdt_io00_002.0 00010000:00010000:1.0:1777051449.281900:0:6594:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff99da7d5ce400/0x85f51a6b96716f20 lrc: 4/0,1 mode: --/CW res: [0x240000bd0:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x85f51a6b96716f27 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051449.281913:0:6594:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0001-osp-MDT0000 lock: ffff99da7d5ce400/0x85f51a6b96716f20 lrc: 4/0,1 mode: --/CW res: [0x240000bd0:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x85f51a6b96716f27 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1777051449.284715:0:104205:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934721 is committed 00000020:00080000:3.0:1777051449.284739:0:104205:0:(update_trans.c:1333:distribute_txn_batchid_cb()) lustre-MDT0001: 4294970583 batchid updated 00010000:00010000:2.0:1777051449.284788:0:3664:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff99d950710a00/0x85f51a6b96716e63 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd3:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051449.284808:0:3664:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d950710a00/0x85f51a6b96716e63 lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd3:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051449.284820:0:3664:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99d950710a00/0x85f51a6b96716e63 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd3:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051449.284832:0:3664:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d950710a00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:2.0:1777051449.284839:0:3664:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d950710a00/0x85f51a6b96716e63 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd3:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051449.284853:0:3664:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d950710a00/0x85f51a6b96716e63 lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd3:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6593 initiator: MDT1 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1777051449.284856:0:104230:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 4294970583 00000020:00080000:1.0:1777051449.284879:0:104230:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 4294970583 00010000:00010000:2.0:1777051449.284882:0:3664:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd3:0x4:0x0].0x0 (ffff99d9502e3d00) 00010000:00010000:2.0:1777051449.284890:0:3664:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777051449.284897:0:3664:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99d950710a00/0x85f51a6b96716e63 lrc: 2/0,0 mode: --/TXN res: [0x240000bd3:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051449.284910:0:3664:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d950710a00/0x85f51a6b96716e63 lrc: 0/0,0 mode: --/TXN res: [0x240000bd3:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051449.284949:0:3664:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff99d950710400/0x85f51a6b96716e6a lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd0:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000020 pid: 6593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051449.284961:0:3664:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d950710400/0x85f51a6b96716e6a lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd0:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000020 pid: 6593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051449.284972:0:3664:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99d950710400/0x85f51a6b96716e6a lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd0:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 6593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051449.284982:0:3664:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d950710400 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:2.0:1777051449.284988:0:3664:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d950710400/0x85f51a6b96716e6a lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd0:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 6593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051449.284999:0:3664:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d950710400/0x85f51a6b96716e6a lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd0:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000020 pid: 6593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051449.285012:0:3664:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x3:0x0].0x0 (ffff99d9502e3c00) 00010000:00010000:2.0:1777051449.285017:0:3664:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777051449.285024:0:3664:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff99d950705600/0x85f51a6b96716f27 lrc: 2/0,0 mode: --/CW res: [0x240000bd0:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b96716f20 expref: 6 pid: 46500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051449.285043:0:3664:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff99d950705600/0x85f51a6b96716f27 lrc: 2/0,0 mode: CW/CW res: [0x240000bd0:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x85f51a6b96716f20 expref: 6 pid: 46500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051449.285058:0:3664:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d950705600/0x85f51a6b96716f27 lrc: 3/0,0 mode: CW/CW res: [0x240000bd0:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x85f51a6b96716f20 expref: 6 pid: 46500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051449.285102:0:3664:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0001_UUID lock: ffff99d950705600/0x85f51a6b96716f27 lrc: 3/0,0 mode: CW/CW res: [0x240000bd0:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b96716f20 expref: 6 pid: 46500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051449.285132:0:3664:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955612680 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_001:lustre-MDT0001_UUID:3664:1863365452665088:0@lo:105: 00000100:00100000:2.0:1777051449.285477:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051449.285543:0:3664:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d94521ccc0 going to sleep for 11 seconds 00000100:00100000:3.0:1777051449.285592:0:99220:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452665088 00000100:00100000:3.0:1777051449.285602:0:99220:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452665088 00000100:00100000:3.0:1777051449.285688:0:99220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1777051449.285701:0:99220:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955612300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-mdtlov_UUID+4:3664:x1863365452665088:12345-0@lo:105: 00010000:00010000:3.0:1777051449.285716:0:99220:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff99da7d5ce400/0x85f51a6b96716f20 lrc: 5/0,1 mode: --/CW res: [0x240000bd0:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x85f51a6b96716f27 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051449.285733:0:99220:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0001-osp-MDT0000 lock: ffff99da7d5ce400/0x85f51a6b96716f20 lrc: 5/0,1 mode: --/CW res: [0x240000bd0:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x85f51a6b96716f27 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051449.285748:0:99220:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0001-osp-MDT0000 lock: ffff99da7d5ce400/0x85f51a6b96716f20 lrc: 5/0,1 mode: --/CW res: [0x240000bd0:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x85f51a6b96716f27 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051449.285758:0:99220:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0001-osp-MDT0000 lock: ffff99da7d5ce400/0x85f51a6b96716f20 lrc: 5/0,1 mode: CW/CW res: [0x240000bd0:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x85f51a6b96716f27 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051449.285766:0:99220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff99da7d5ce400/0x85f51a6b96716f20 lrc: 6/0,1 mode: CW/CW res: [0x240000bd0:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x85f51a6b96716f27 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051449.285775:0:99220:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0001-osp-MDT0000 lock: ffff99da7d5ce400/0x85f51a6b96716f20 lrc: 6/0,1 mode: CW/CW res: [0x240000bd0:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x85f51a6b96716f27 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051449.286382:0:99220:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff99da7d5ce400) 00010000:00010000:1.0:1777051449.286437:0:6594:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0001-osp-MDT0000 lock: ffff99da7d5ce400/0x85f51a6b96716f20 lrc: 4/0,1 mode: CW/CW res: [0x240000bd0:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x85f51a6b96716f27 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051449.286461:0:6594:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff99da7d5ce400/0x85f51a6b96716f20 lrc: 4/0,1 mode: CW/CW res: [0x240000bd0:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x85f51a6b96716f27 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051449.286462:0:99220:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955612300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-mdtlov_UUID+4:3664:x1863365452665088:12345-0@lo:105: Request processed in 753us (976us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051449.286491:0:99220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000004:00080000:1.0:1777051449.286507:0:6594:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000bd0:0x3:0x0] 00000100:00100000:2.0:1777051449.286510:0:3664:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955612680 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_001:lustre-MDT0001_UUID:3664:1863365452665088:0@lo:105: 00010000:00010000:2.0:1777051449.286543:0:3664:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99d950710400/0x85f51a6b96716e6a lrc: 2/0,0 mode: --/TXN res: [0x240000bd0:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000020 pid: 6593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051449.286552:0:6594:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff99da7d5cf000/0x85f51a6b96716f2e lrc: 3/0,1 mode: --/PW res: [0x240000bd0:0x3:0x0].0x15f59727 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051449.286562:0:3664:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d950710400/0x85f51a6b96716e6a lrc: 0/0,0 mode: --/TXN res: [0x240000bd0:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000020 pid: 6593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051449.286574:0:6594:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff99da7d5cf000/0x85f51a6b96716f2e lrc: 3/0,1 mode: --/PW res: [0x240000bd0:0x3:0x0].0x15f59727 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051449.286601:0:6594:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff99da7d5cf000/0x85f51a6b96716f2e lrc: 3/0,1 mode: --/PW res: [0x240000bd0:0x3:0x0].0x15f59727 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6594 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051449.286653:0:6594:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7fd63800 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6594:1863365452665216:0@lo:101:mdt_io00_002.0 00000100:00100000:1.0:1777051449.286698:0:6594:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051449.286736:0:6594:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da7b3793c0 going to sleep for 11 seconds 00000100:00100000:3.0:1777051449.287013:0:47208:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452665216 00000100:00100000:3.0:1777051449.287023:0:47208:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452665216 00000100:00100000:3.0:1777051449.287077:0:47208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8259 00000100:00100000:3.0:1777051449.287088:0:47208:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fd61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+7:6594:x1863365452665216:12345-0@lo:101:mdt_io00_002.0 00010000:00010000:3.0:1777051449.287104:0:47208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777051449.287153:0:47208:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a2800/0x85f51a6b96716f35 lrc: 2/0,0 mode: --/PW res: [0x240000bd0:0x3:0x0].0x15f59727 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x85f51a6b96716f2e expref: -99 pid: 47208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051449.287182:0:47208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a2800/0x85f51a6b96716f35 lrc: 3/0,0 mode: PW/PW res: [0x240000bd0:0x3:0x0].0x15f59727 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x85f51a6b96716f2e expref: 8 pid: 47208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051449.287199:0:47208:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a2800/0x85f51a6b96716f35 lrc: 3/0,0 mode: PW/PW res: [0x240000bd0:0x3:0x0].0x15f59727 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b96716f2e expref: 8 pid: 47208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051449.287502:0:47208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x3:0x0].0x15f59727 (ffff99d9413d2000) 00010000:00010000:3.0:1777051449.287507:0:47208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777051449.287512:0:47208:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d9559a2800, rc 0) 00000100:00100000:3.0:1777051449.287576:0:47208:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fd61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+8:6594:x1863365452665216:12345-0@lo:101:mdt_io00_002.0 Request processed in 489us (877us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051449.287585:0:47208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8259 00000100:00100000:1.0:1777051449.287694:0:6594:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7fd63800 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6594:1863365452665216:0@lo:101:mdt_io00_002.0 00010000:00010000:1.0:1777051449.287715:0:6594:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff99da7d5cf000/0x85f51a6b96716f2e lrc: 4/0,1 mode: PW/PW res: [0x240000bd0:0x3:0x0].0x15f59727 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x85f51a6b96716f35 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051449.287736:0:6594:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff99da7d5cf000/0x85f51a6b96716f2e lrc: 4/0,1 mode: PW/PW res: [0x240000bd0:0x3:0x0].0x15f59727 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x85f51a6b96716f35 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1777051449.287757:0:6594:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000bd0:0x3:0x0] 00010000:00010000:1.0:1777051449.288065:0:6594:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce200/0x85f51a6b96716f3c lrc: 3/0,1 mode: --/CW res: [0x2000032e2:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051449.288080:0:6594:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce200/0x85f51a6b96716f3c lrc: 3/0,1 mode: CW/CW res: [0x2000032e2:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051449.288093:0:6594:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce200/0x85f51a6b96716f3c lrc: 3/0,1 mode: CW/CW res: [0x2000032e2:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051449.288112:0:6594:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cee00/0x85f51a6b96716f43 lrc: 3/0,1 mode: --/PW res: [0x2000032e2:0x8:0x0].0x15f59727 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051449.288123:0:6594:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cee00/0x85f51a6b96716f43 lrc: 3/0,1 mode: PW/PW res: [0x2000032e2:0x8:0x0].0x15f59727 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051449.288139:0:6594:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cee00/0x85f51a6b96716f43 lrc: 3/0,1 mode: PW/PW res: [0x2000032e2:0x8:0x0].0x15f59727 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051449.288184:0:6594:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cfe00/0x85f51a6b96716f4a lrc: 3/0,1 mode: --/EX res: [0x2000032e3:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051449.288263:0:6594:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99d950704400/0x85f51a6b96716f04 lrc: 2/0,0 mode: PW/PW res: [0x2000032e3:0x9:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6809 expref: 36 pid: 46494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051449.288276:0:6594:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cfe00/0x85f51a6b96716f4a lrc: 4/0,1 mode: --/EX res: [0x2000032e3:0x9:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051449.288315:0:6594:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99d950704400/0x85f51a6b96716f04 lrc: 3/0,0 mode: PW/PW res: [0x2000032e3:0x9:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6809 expref: 36 pid: 46494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051449.288337:0:6594:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950704400/0x85f51a6b96716f04 lrc: 4/0,0 mode: PW/PW res: [0x2000032e3:0x9:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6809 expref: 36 pid: 46494 timeout: 8178 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051449.288354:0:6594:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7fd63800 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000_UUID:6594:1863365452665344:192.168.201.46@tcp:104: 00000100:00100000:1.0:1777051449.288435:0:6594:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da7b3793c0 going to sleep for 11 seconds 00010000:00010000:1.0:1777051449.291441:0:6594:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.201.46@tcp) returned -22 from blocking AST (req@00000000e5ade576 x1863365452665344) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff99d950704400/0x85f51a6b96716f04 lrc: 4/0,0 mode: PW/PW res: [0x2000032e3:0x9:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6809 expref: 36 pid: 46494 timeout: 8178 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051449.291469:0:6594:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99d950704400/0x85f51a6b96716f04 lrc: 3/0,0 mode: PW/PW res: [0x2000032e3:0x9:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6809 expref: 36 pid: 46494 timeout: 8178 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051449.291488:0:6594:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d950704400/0x85f51a6b96716f04 lrc: 0/0,0 mode: --/PW res: [0x2000032e3:0x9:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6809 expref: 36 pid: 46494 timeout: 8178 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051449.291503:0:6594:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7fd63800 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000_UUID:6594:1863365452665344:192.168.201.46@tcp:104: 00010000:00010000:1.0:1777051449.291517:0:6594:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e3:0x9:0x0].0x0 (ffff99da42881100) 00010000:00010000:1.0:1777051449.291521:0:6594:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cfe00/0x85f51a6b96716f4a lrc: 3/0,1 mode: --/EX res: [0x2000032e3:0x9:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051449.291549:0:6594:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cfe00/0x85f51a6b96716f4a lrc: 3/0,1 mode: EX/EX res: [0x2000032e3:0x9:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x50290000000000 pid: 6594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051449.291566:0:6594:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cfe00/0x85f51a6b96716f4a lrc: 4/0,1 mode: EX/EX res: [0x2000032e3:0x9:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x50290000000000 pid: 6594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051449.291590:0:6594:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cfe00/0x85f51a6b96716f4a lrc: 3/0,1 mode: EX/EX res: [0x2000032e3:0x9:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051449.291602:0:6594:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cfe00/0x85f51a6b96716f4a lrc: 3/0,1 mode: EX/EX res: [0x2000032e3:0x9:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051449.291643:0:6594:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cfe00/0x85f51a6b96716f4a lrc: 3/0,1 mode: EX/EX res: [0x2000032e3:0x9:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051449.291701:0:6594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cfe00/0x85f51a6b96716f4a lrc: 3/0,1 mode: EX/EX res: [0x2000032e3:0x9:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051449.291714:0:6594:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cfe00/0x85f51a6b96716f4a lrc: 2/0,0 mode: EX/EX res: [0x2000032e3:0x9:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051449.291725:0:6594:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cfe00/0x85f51a6b96716f4a lrc: 3/0,0 mode: EX/EX res: [0x2000032e3:0x9:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051449.291734:0:6594:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da7d5cfe00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:1.0:1777051449.291740:0:6594:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cfe00/0x85f51a6b96716f4a lrc: 3/0,0 mode: EX/EX res: [0x2000032e3:0x9:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051449.291751:0:6594:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cfe00/0x85f51a6b96716f4a lrc: 4/0,0 mode: EX/EX res: [0x2000032e3:0x9:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051449.292026:0:6594:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e3:0x9:0x0].0x0 (ffff99da42881100) 00010000:00010000:1.0:1777051449.292031:0:6594:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 25 00010000:00010000:1.0:1777051449.292037:0:6594:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cfe00/0x85f51a6b96716f4a lrc: 2/0,0 mode: --/EX res: [0x2000032e3:0x9:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051449.292047:0:6594:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cfe00/0x85f51a6b96716f4a lrc: 0/0,0 mode: --/EX res: [0x2000032e3:0x9:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051449.292066:0:6594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce200/0x85f51a6b96716f3c lrc: 3/0,1 mode: CW/CW res: [0x2000032e2:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051449.292077:0:6594:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce200/0x85f51a6b96716f3c lrc: 2/0,0 mode: CW/CW res: [0x2000032e2:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051449.292087:0:6594:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce200/0x85f51a6b96716f3c lrc: 3/0,0 mode: CW/CW res: [0x2000032e2:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051449.292096:0:6594:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da7d5ce200 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:1.0:1777051449.292100:0:6594:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce200/0x85f51a6b96716f3c lrc: 3/0,0 mode: CW/CW res: [0x2000032e2:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051449.292111:0:6594:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce200/0x85f51a6b96716f3c lrc: 4/0,0 mode: CW/CW res: [0x2000032e2:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051449.292122:0:6594:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0x8:0x0].0x0 (ffff99d94e52a600) 00010000:00010000:1.0:1777051449.292126:0:6594:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777051449.292131:0:6594:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce200/0x85f51a6b96716f3c lrc: 2/0,0 mode: --/CW res: [0x2000032e2:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051449.292141:0:6594:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce200/0x85f51a6b96716f3c lrc: 0/0,0 mode: --/CW res: [0x2000032e2:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051449.292162:0:6594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cee00/0x85f51a6b96716f43 lrc: 3/0,1 mode: PW/PW res: [0x2000032e2:0x8:0x0].0x15f59727 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051449.292172:0:6594:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cee00/0x85f51a6b96716f43 lrc: 2/0,0 mode: PW/PW res: [0x2000032e2:0x8:0x0].0x15f59727 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051449.292182:0:6594:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cee00/0x85f51a6b96716f43 lrc: 3/0,0 mode: PW/PW res: [0x2000032e2:0x8:0x0].0x15f59727 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051449.292191:0:6594:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da7d5cee00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:1.0:1777051449.292227:0:6594:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cee00/0x85f51a6b96716f43 lrc: 3/0,0 mode: PW/PW res: [0x2000032e2:0x8:0x0].0x15f59727 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051449.292238:0:6594:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cee00/0x85f51a6b96716f43 lrc: 4/0,0 mode: PW/PW res: [0x2000032e2:0x8:0x0].0x15f59727 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051449.292251:0:6594:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0x8:0x0].0x15f59727 (ffff99d94e52ae00) 00010000:00010000:1.0:1777051449.292255:0:6594:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777051449.292259:0:6594:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cee00/0x85f51a6b96716f43 lrc: 2/0,0 mode: --/PW res: [0x2000032e2:0x8:0x0].0x15f59727 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051449.292269:0:6594:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cee00/0x85f51a6b96716f43 lrc: 0/0,0 mode: --/PW res: [0x2000032e2:0x8:0x0].0x15f59727 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6594 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1777051449.292289:0:6594:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000bd0:0x3:0x0] 00010000:00010000:1.0:1777051449.292297:0:6594:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff99da7d5ce400/0x85f51a6b96716f20 lrc: 4/0,1 mode: CW/CW res: [0x240000bd0:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x85f51a6b96716f27 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051449.292318:0:6594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff99da7d5ce400/0x85f51a6b96716f20 lrc: 4/0,1 mode: CW/CW res: [0x240000bd0:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x85f51a6b96716f27 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051449.292330:0:6594:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff99da7d5ce400/0x85f51a6b96716f20 lrc: 3/0,0 mode: CW/CW res: [0x240000bd0:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x85f51a6b96716f27 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051449.292361:0:6594:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1777051449.292368:0:6594:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000bd0:0x3:0x0] 00010000:00010000:1.0:1777051449.292374:0:6594:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff99da7d5cf000/0x85f51a6b96716f2e lrc: 4/0,1 mode: PW/PW res: [0x240000bd0:0x3:0x0].0x15f59727 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x85f51a6b96716f35 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051449.292386:0:6594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff99da7d5cf000/0x85f51a6b96716f2e lrc: 4/0,1 mode: PW/PW res: [0x240000bd0:0x3:0x0].0x15f59727 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x85f51a6b96716f35 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051449.292399:0:6594:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff99da7d5cf000/0x85f51a6b96716f2e lrc: 3/0,0 mode: PW/PW res: [0x240000bd0:0x3:0x0].0x15f59727 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x85f51a6b96716f35 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051449.292429:0:6594:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000004:00080000:1.0:1777051449.292445:0:6594:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000bd3:0x4:0x0] 00010000:00010000:0.0:1777051449.292447:0:6567:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1777051449.292458:0:6594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950704e00/0x85f51a6b96716f19 lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051449.292461:0:6567:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff99da7d5ce400/0x85f51a6b96716f20 lrc: 2/0,0 mode: CW/CW res: [0x240000bd0:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x85f51a6b96716f27 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051449.292490:0:6594:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d950704e00/0x85f51a6b96716f19 lrc: 2/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051449.292490:0:13753:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1777051449.292496:0:6567:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da7d5ce400 already unused, calling callback (ffffffffc177eed0) 00010000:00010000:3.0:1777051449.292502:0:13753:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff99da7d5cf000/0x85f51a6b96716f2e lrc: 2/0,0 mode: PW/PW res: [0x240000bd0:0x3:0x0].0x15f59727 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x85f51a6b96716f35 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051449.292509:0:6567:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff99da7d5ce400/0x85f51a6b96716f20 lrc: 3/0,0 mode: CW/CW res: [0x240000bd0:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x85f51a6b96716f27 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051449.292524:0:6594:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d950704e00/0x85f51a6b96716f19 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051449.292545:0:13753:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da7d5cf000 already unused, calling callback (ffffffffc177eed0) 00000004:00010000:0.0:1777051449.292558:0:6567:0:(mdt_handler.c:3963:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff99da7d5ce400/0x85f51a6b96716f20 lrc: 3/0,0 mode: CW/CW res: [0x240000bd0:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x85f51a6b96716f27 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051449.292558:0:6594:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d950704e00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:3.0:1777051449.292559:0:13753:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff99da7d5cf000/0x85f51a6b96716f2e lrc: 3/0,0 mode: PW/PW res: [0x240000bd0:0x3:0x0].0x15f59727 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x85f51a6b96716f35 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051449.292571:0:6594:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d950704e00/0x85f51a6b96716f19 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051449.292639:0:6594:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d950704e00/0x85f51a6b96716f19 lrc: 4/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6594 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777051449.292648:0:13753:0:(mdt_handler.c:3963:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff99da7d5cf000/0x85f51a6b96716f2e lrc: 3/0,0 mode: PW/PW res: [0x240000bd0:0x3:0x0].0x15f59727 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x85f51a6b96716f35 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051449.292681:0:6594:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000004:0x1:0x0].0x0 (ffff99da42881c00) 00010000:00010000:1.0:1777051449.292687:0:6594:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777051449.292693:0:6594:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d950704e00/0x85f51a6b96716f19 lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051449.292696:0:6567:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff99da7d5ce400/0x85f51a6b96716f20 lrc: 2/0,0 mode: --/CW res: [0x240000bd0:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x85f51a6b96716f27 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051449.292717:0:6594:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d950704e00/0x85f51a6b96716f19 lrc: 0/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051449.292722:0:6567:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1777051449.292737:0:13753:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff99da7d5cf000/0x85f51a6b96716f2e lrc: 2/0,0 mode: --/PW res: [0x240000bd0:0x3:0x0].0x15f59727 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x85f51a6b96716f35 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00020000:1.0:1777051449.292753:0:6594:0:(mdt_reint.c:2622:mdt_reint_migrate()) lustre-MDT0000: migrate [0x240000bd3:0x4:0x0]/f406.sanity-hsm failed: rc = -95 00010000:00010000:3.0:1777051449.292754:0:13753:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1777051449.293073:0:6567:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff99da7d5ce400/0x85f51a6b96716f20 lrc: 1/0,0 mode: --/CW res: [0x240000bd0:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x85f51a6b96716f27 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051449.293077:0:13753:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff99da7d5cf000/0x85f51a6b96716f2e lrc: 1/0,0 mode: --/PW res: [0x240000bd0:0x3:0x0].0x15f59727 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x85f51a6b96716f35 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051449.293355:0:13753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff99da7d5cf000/0x85f51a6b96716f2e lrc: 0/0,0 mode: --/PW res: [0x240000bd0:0x3:0x0].0x15f59727 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x85f51a6b96716f35 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051449.293375:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051449.293379:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777051449.293381:0:6567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff99da7d5ce400/0x85f51a6b96716f20 lrc: 0/0,0 mode: --/CW res: [0x240000bd0:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x85f51a6b96716f27 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051449.293383:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777051449.293415:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777051449.293418:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777051449.293422:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1777051449.293444:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95f97ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3677:1863365452665600:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1777051449.293494:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051449.293554:0:3679:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1777051449.293566:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7cd9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452665472:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1777051449.293603:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051449.293683:0:24467:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452665600 00000100:00100000:0.0:1777051449.293688:0:47827:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452665472 00000100:00100000:3.0:1777051449.293693:0:24467:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452665600 00000100:00100000:0.0:1777051449.293698:0:47827:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452665472 00000100:00100000:0.0:1777051449.293748:0:47827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13717 00000100:00100000:0.0:1777051449.293760:0:47827:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f518700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:lustre-MDT0000-mdtlov_UUID+9:3679:x1863365452665472:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1777051449.293774:0:47827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777051449.293792:0:47827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d950705600/0x85f51a6b96716f27 lrc: 0/0,0 mode: --/CW res: [0x240000bd0:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x85f51a6b96716f20 expref: 9 pid: 46500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051449.293810:0:47827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x3:0x0].0x0 (ffff99d9502e3c00) 00010000:00010000:0.0:1777051449.293822:0:47827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1777051449.293865:0:47827:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f518700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:lustre-MDT0000-mdtlov_UUID+8:3679:x1863365452665472:12345-0@lo:103:ldlm_bl.0 Request processed in 106us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051449.293875:0:47827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13717 00000100:00100000:0.0:1777051449.293924:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7cd9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452665472:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1777051449.294165:0:24467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13718 00000100:00100000:3.0:1777051449.294178:0:24467:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7cd9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+7:3677:x1863365452665600:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1777051449.294192:0:24467:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777051449.294212:0:24467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a2800/0x85f51a6b96716f35 lrc: 0/0,0 mode: --/PW res: [0x240000bd0:0x3:0x0].0x15f59727 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x85f51a6b96716f2e expref: 7 pid: 47208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051449.294499:0:24467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x3:0x0].0x15f59727 (ffff99d9413d2000) 00010000:00010000:3.0:1777051449.294511:0:24467:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1777051449.294577:0:24467:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7cd9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+6:3677:x1863365452665600:12345-0@lo:103:ldlm_bl.0 Request processed in 400us (1080us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051449.294652:0:24467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13718 00000100:00100000:0.0:1777051449.294994:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95f97ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3677:1863365452665600:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1777051449.313961:0:6594:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d956128a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+35:138749:x1863365426051712:12345-192.168.201.46@tcp:36:lfs.0 Request processed in 41266us (41519us total) trans 0 rc -95/-95 00000100:00100000:1.0:1777051449.313974:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 9 00000100:00100000:2.0:1777051449.317143:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051449.317482:0:46501:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426051968 00000100:00100000:2.0:1777051449.317491:0:46501:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426051968 00000100:00100000:2.0:1777051449.317541:0:46501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3405 00000100:00100000:2.0:1777051449.317554:0:46501:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955612680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+35:138749:x1863365426051968:12345-192.168.201.46@tcp:35:lfs.0 00000100:00100000:2.0:1777051449.317833:0:46501:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955612680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+36:138749:x1863365426051968:12345-192.168.201.46@tcp:35:lfs.0 Request processed in 278us (691us total) trans 30064771214 rc 0/0 00000100:00100000:2.0:1777051449.317845:0:46501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3405 00000100:00100000:2.0:1777051449.323363:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051449.323456:0:6583:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426052224 00000100:00100000:0.0:1777051449.323467:0:6583:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426052224 00000100:00100000:0.0:1777051449.323525:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3406 00000100:00100000:0.0:1777051449.323538:0:6583:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955610380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+52:138749:x1863365426052224:12345-192.168.201.46@tcp:35:lfs.0 00000100:00100000:0.0:1777051449.324071:0:6583:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955610380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+53:138749:x1863365426052224:12345-192.168.201.46@tcp:35:lfs.0 Request processed in 528us (704us total) trans 8589934722 rc 0/0 00000100:00100000:0.0:1777051449.324083:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3406 00000100:00100000:3.0:1777051449.326912:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051449.327007:0:10328:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426052352 00000100:00100000:0.0:1777051449.327014:0:10328:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426052352 00000100:00100000:0.0:1777051449.327071:0:10328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112261 00000100:00100000:0.0:1777051449.327084:0:10328:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f97dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+36:138749:x1863365426052352:12345-192.168.201.46@tcp:101:lfs.0 00010000:00010000:0.0:1777051449.327105:0:10328:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051449.327131:0:10328:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d950705600/0x85f51a6b96716f51 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6817 expref: -99 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051449.327263:0:10328:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950705000/0x85f51a6b96716f58 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051449.327284:0:10328:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d950705000/0x85f51a6b96716f58 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051449.327305:0:10328:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d950705000/0x85f51a6b96716f58 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051449.327325:0:10328:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950704800/0x85f51a6b96716f5f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x45e84fca bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051449.327335:0:10328:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d950704800/0x85f51a6b96716f5f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x45e84fca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051449.327344:0:10328:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d950704800/0x85f51a6b96716f5f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x45e84fca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051449.327415:0:10328:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950705e00/0x85f51a6b96716f66 lrc: 3/1,0 mode: --/PR res: [0x240000bd3:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051449.327426:0:10328:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d950705e00/0x85f51a6b96716f66 lrc: 3/1,0 mode: PR/PR res: [0x240000bd3:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051449.327436:0:10328:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d950705e00/0x85f51a6b96716f66 lrc: 3/1,0 mode: PR/PR res: [0x240000bd3:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1777051449.327462:0:10328:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99d950705e00/0x85f51a6b96716f66 lrc: 3/1,0 mode: PR/PR res: [0x240000bd3:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051449.327481:0:10328:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950705000/0x85f51a6b96716f58 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051449.327492:0:10328:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950705000/0x85f51a6b96716f58 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051449.327502:0:10328:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d950705000/0x85f51a6b96716f58 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051449.327519:0:10328:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d950705000/0x85f51a6b96716f58 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051449.327545:0:10328:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d950705000 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:0.0:1777051449.327557:0:10328:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d950705000/0x85f51a6b96716f58 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051449.327569:0:10328:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d950705000/0x85f51a6b96716f58 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051449.327585:0:10328:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d9533ab000) 00010000:00010000:0.0:1777051449.327590:0:10328:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777051449.327596:0:10328:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d950705000/0x85f51a6b96716f58 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051449.327629:0:10328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d950705000/0x85f51a6b96716f58 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051449.327648:0:10328:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950704800/0x85f51a6b96716f5f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x45e84fca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051449.327658:0:10328:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d950704800/0x85f51a6b96716f5f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x45e84fca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051449.327668:0:10328:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d950704800/0x85f51a6b96716f5f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x45e84fca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051449.327676:0:10328:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d950704800 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:0.0:1777051449.327680:0:10328:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d950704800/0x85f51a6b96716f5f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x45e84fca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051449.327697:0:10328:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d950704800/0x85f51a6b96716f5f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x45e84fca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051449.327709:0:10328:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x45e84fca (ffff99da42881600) 00010000:00010000:0.0:1777051449.327713:0:10328:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777051449.327718:0:10328:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d950704800/0x85f51a6b96716f5f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x45e84fca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051449.327727:0:10328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d950704800/0x85f51a6b96716f5f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x45e84fca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051449.327769:0:10328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d950705600/0x85f51a6b96716f51 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6817 expref: 38 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051449.327789:0:10328:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950705e00/0x85f51a6b96716f66 lrc: 3/0,0 mode: PR/PR res: [0x240000bd3:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6817 expref: 37 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051449.327800:0:10328:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd3:0x4:0x0].0x0 (ffff99d94e52a700) 00010000:00010000:0.0:1777051449.327803:0:10328:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1777051449.327807:0:10328:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d950705e00, rc 0) 00000100:00100000:0.0:1777051449.327869:0:10328:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f97dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+37:138749:x1863365426052352:12345-192.168.201.46@tcp:101:lfs.0 Request processed in 787us (960us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051449.327881:0:10328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112261 00000100:00100000:2.0:1777051449.334600:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051449.334734:0:6580:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426052480 00000100:00100000:1.0:1777051449.334747:0:6580:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426052480 00000100:00100000:1.0:1777051449.334827:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112262 00000100:00100000:1.0:1777051449.334840:0:6580:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955610a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+53:138749:x1863365426052480:12345-192.168.201.46@tcp:101:lfs.0 00010000:00010000:1.0:1777051449.334866:0:6580:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777051449.334893:0:6580:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d5cee00/0x85f51a6b96716f6d lrc: 2/0,0 mode: --/CR res: [0x240000bd3:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b681e expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051449.334955:0:6580:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d5ce200/0x85f51a6b96716f74 lrc: 3/1,0 mode: --/PR res: [0x240000bd3:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051449.334971:0:6580:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d5ce200/0x85f51a6b96716f74 lrc: 3/1,0 mode: PR/PR res: [0x240000bd3:0x4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6580 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051449.334983:0:6580:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d5ce200/0x85f51a6b96716f74 lrc: 3/1,0 mode: PR/PR res: [0x240000bd3:0x4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6580 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1777051449.335104:0:6580:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000bd3:0x4:0x0]: returning size 4096 00000004:00200000:1.0:1777051449.335115:0:6580:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1777051449.335161:0:6580:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d5cee00/0x85f51a6b96716f6d lrc: 0/0,0 mode: --/CR res: [0x240000bd3:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b681e expref: 55 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051449.335183:0:6580:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d5ce200/0x85f51a6b96716f74 lrc: 3/0,0 mode: PR/PR res: [0x240000bd3:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b681e expref: 54 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051449.335274:0:6580:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd3:0x4:0x0].0x0 (ffff99d94e52ae00) 00010000:00010000:1.0:1777051449.335280:0:6580:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1777051449.335286:0:6580:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99da7d5ce200, rc 0) 00000100:00100000:2.0:1777051449.335444:0:6580:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955610a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+54:138749:x1863365426052480:12345-192.168.201.46@tcp:101:lfs.0 Request processed in 603us (850us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051449.335454:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112262 00000100:00100000:3.0:1777051449.335658:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051449.335734:0:9550:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426052608 00000100:00100000:1.0:1777051449.335742:0:9550:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426052608 00000100:00100000:1.0:1777051449.335800:0:9550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13719 00000100:00100000:1.0:1777051449.335812:0:9550:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f97fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+37:2439:x1863365426052608:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1777051449.335836:0:9550:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1777051449.335859:0:9550:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d950705e00/0x85f51a6b96716f66 lrc: 0/0,0 mode: --/PR res: [0x240000bd3:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6817 expref: 37 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051449.335878:0:9550:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd3:0x4:0x0].0x0 (ffff99d94e52a700) 00010000:00010000:1.0:1777051449.335885:0:9550:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1777051449.335934:0:9550:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f97fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+36:2439:x1863365426052608:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 123us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051449.335946:0:9550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13719 00000100:00100000:2.0:1777051449.341779:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051449.341861:0:8492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426052864 00000100:00100000:1.0:1777051449.341871:0:8492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426052864 00000100:00100000:1.0:1777051449.341935:0:8492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112263 00000100:00100000:1.0:1777051449.341949:0:8492:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955611880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+54:138749:x1863365426052864:12345-192.168.201.46@tcp:36:lfs.0 00010000:00010000:1.0:1777051449.342070:0:8492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff99da7d5cee00/0x85f51a6b96716f7b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051449.342085:0:8492:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff99da7d5cee00/0x85f51a6b96716f7b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 8492 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051449.342099:0:8492:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff99da7d5cee00/0x85f51a6b96716f7b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x1000000000000 pid: 8492 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051449.342128:0:8492:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7fd63800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8492:1863365452665728:0@lo:101:mdt00_003.0 00000100:00100000:1.0:1777051449.342199:0:8492:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051449.342235:0:8492:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da7b379cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1777051449.342308:0:6585:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452665728 00000100:00100000:2.0:1777051449.342319:0:6585:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452665728 00000100:00100000:2.0:1777051449.342377:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8260 00000100:00100000:2.0:1777051449.342389:0:6585:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fd62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:8492:x1863365452665728:12345-0@lo:101:mdt00_003.0 00010000:00010000:2.0:1777051449.342405:0:6585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051449.342429:0:6585:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710400/0x85f51a6b96716f82 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x85f51a6b96716f7b expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051449.342464:0:6585:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99d950705c00/0x85f51a6b96716e86 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b67df expref: 35 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051449.342480:0:6585:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710400/0x85f51a6b96716f82 lrc: 4/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x85f51a6b96716f7b expref: 7 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051449.342518:0:6585:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99d950705c00/0x85f51a6b96716e86 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b67df expref: 35 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051449.342538:0:6585:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950705c00/0x85f51a6b96716e86 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b67df expref: 35 pid: 46497 timeout: 8178 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051449.342557:0:6585:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955613800 pname:cluuid:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000_UUID:6585:1863365452665856:192.168.201.46@tcp:104: 00000100:00100000:2.0:1777051449.342664:0:6585:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d94521c780 going to sleep for 11 seconds 00000100:00100000:1.0:1777051449.344530:0:6585:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955613800 pname:cluuid:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000_UUID:6585:1863365452665856:192.168.201.46@tcp:104: 00010000:00010000:1.0:1777051449.344564:0:6585:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710400/0x85f51a6b96716f82 lrc: 3/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b96716f7b expref: 7 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051449.344580:0:6585:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d9533ab000) 00010000:00010000:1.0:1777051449.344584:0:6585:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777051449.344590:0:6585:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710400/0x85f51a6b96716f82 lrc: 3/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b96716f7b expref: 7 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051449.344603:0:6585:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d950710400, rc 0) 00000100:00100000:1.0:1777051449.344715:0:6585:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fd62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:8492:x1863365452665728:12345-0@lo:101:mdt00_003.0 Request processed in 2327us (2519us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051449.344723:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8260 00000100:00100000:2.0:1777051449.345062:0:8492:0:(client.c:3101:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 30064771212 gen 2 00000004:00080000:2.0:1777051449.345072:0:8492:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 30064771212 committed transno 30064771212 00000020:00080000:2.0:1777051449.345079:0:8492:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff99da6fdb6240 refcount 2 committed 0 result 0 batchid 4294970584 00000020:00080000:2.0:1777051449.345085:0:8492:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff99da57b60800 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff99da6fdb6cc0 00000020:00080000:2.0:1777051449.345090:0:8492:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x2000032e1:0x1:0x0].5 00000020:00080000:2.0:1777051449.345094:0:8492:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff99da57b60300 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff99d9537d0c00 00000020:00080000:2.0:1777051449.345099:0:8492:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x240000bd0:0x1:0x0].5 00000100:00100000:2.0:1777051449.345146:0:8492:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7fd63800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8492:1863365452665728:0@lo:101:mdt00_003.0 00010000:00010000:2.0:1777051449.345166:0:8492:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff99da7d5cee00/0x85f51a6b96716f7b lrc: 4/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x85f51a6b96716f82 expref: -99 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051449.345181:0:8492:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff99da7d5cee00/0x85f51a6b96716f7b lrc: 4/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x85f51a6b96716f82 expref: -99 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1777051449.345312:0:104230:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 4294970584 committed batchid 4294970583 00000020:00080000:1.0:1777051449.345389:0:104230:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 4294970583 00000100:00100000:2.0:1777051449.345565:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051449.345738:0:6566:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426052992 00000100:00100000:1.0:1777051449.345746:0:6566:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426052992 00010000:00010000:1.0:1777051449.345776:0:6566:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d950705c00/0x85f51a6b96716e86 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b67df expref: 36 pid: 46497 timeout: 8178 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051449.345821:0:6566:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3935 00000100:00100000:1.0:1777051449.345833:0:6566:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da54223850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+36:2436:x1863365426052992:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1777051449.345850:0:6566:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1777051449.345861:0:6566:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99d950705c00/0x85f51a6b96716e86 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b67df expref: 36 pid: 46497 timeout: 8178 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051449.345880:0:6566:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99d950705c00/0x85f51a6b96716e86 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b67df expref: 36 pid: 46497 timeout: 8178 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051449.345922:0:6566:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d950705c00/0x85f51a6b96716e86 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b67df expref: 36 pid: 46497 timeout: 8178 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051449.345941:0:6566:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d9533ab000) 00010000:00010000:1.0:1777051449.345949:0:6566:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710400/0x85f51a6b96716f82 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b96716f7b expref: 6 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051449.345963:0:6566:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710400/0x85f51a6b96716f82 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x85f51a6b96716f7b expref: 6 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051449.345977:0:6566:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710400/0x85f51a6b96716f82 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x85f51a6b96716f7b expref: 6 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051449.346019:0:6566:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710400/0x85f51a6b96716f82 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b96716f7b expref: 6 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051449.346035:0:6566:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7fd63100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000_UUID:6566:1863365452665984:0@lo:105: 00000100:00100000:1.0:1777051449.346083:0:6566:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051449.346130:0:6566:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da7b3799c0 going to sleep for 11 seconds 00000100:00100000:0.0:1777051449.346181:0:102039:0:(service.c:153:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1777051449.346200:0:102039:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452665984 00000100:00100000:0.0:1777051449.346207:0:102039:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452665984 00000100:00100000:0.0:1777051449.346262:0:102039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1777051449.346274:0:102039:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5faf2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0001-mdtlov_UUID+4:6566:x1863365452665984:12345-0@lo:105: 00010000:00010000:0.0:1777051449.346290:0:102039:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff99da7d5cee00/0x85f51a6b96716f7b lrc: 5/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x85f51a6b96716f82 expref: -99 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051449.346306:0:102039:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff99da7d5cee00/0x85f51a6b96716f7b lrc: 5/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x85f51a6b96716f82 expref: -99 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051449.346320:0:102039:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff99da7d5cee00/0x85f51a6b96716f7b lrc: 5/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x85f51a6b96716f82 expref: -99 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051449.346333:0:102039:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff99da7d5cee00/0x85f51a6b96716f7b lrc: 5/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x85f51a6b96716f82 expref: -99 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051449.346345:0:102039:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff99da7d5cee00/0x85f51a6b96716f7b lrc: 6/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x85f51a6b96716f82 expref: -99 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051449.346358:0:102039:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff99da7d5cee00/0x85f51a6b96716f7b lrc: 6/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x85f51a6b96716f82 expref: -99 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051449.346389:0:102039:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff99da7d5cee00) 00010000:00010000:2.0:1777051449.346438:0:8492:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff99da7d5cee00/0x85f51a6b96716f7b lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x85f51a6b96716f82 expref: -99 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051449.346461:0:8492:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff99da7d5cee00/0x85f51a6b96716f7b lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x85f51a6b96716f82 expref: -99 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051449.346477:0:102039:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5faf2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0001-mdtlov_UUID+4:6566:x1863365452665984:12345-0@lo:105: Request processed in 176us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051449.346492:0:102039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000004:00080000:2.0:1777051449.346493:0:8492:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000100:00100000:1.0:1777051449.346503:0:6566:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7fd63100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000_UUID:6566:1863365452665984:0@lo:105: 00010000:00010000:1.0:1777051449.346527:0:6566:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1777051449.346544:0:8492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950710a00/0x85f51a6b96716f89 lrc: 3/0,1 mode: --/EX res: [0x240000bd3:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051449.346558:0:8492:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950710a00/0x85f51a6b96716f89 lrc: 3/0,1 mode: --/EX res: [0x240000bd3:0x4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 8492 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051449.346587:0:8492:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950710a00/0x85f51a6b96716f89 lrc: 3/0,1 mode: --/EX res: [0x240000bd3:0x4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 8492 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051449.346590:0:6566:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da54223850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+35:2436:x1863365426052992:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 756us (1024us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051449.346643:0:6566:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3935 00000100:00100000:2.0:1777051449.346654:0:8492:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955613480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8492:1863365452666112:0@lo:101:mdt00_003.0 00000100:00100000:2.0:1777051449.346714:0:8492:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051449.346762:0:8492:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d94521ce40 going to sleep for 11 seconds 00000100:00100000:0.0:1777051449.347089:0:46498:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452666112 00000100:00100000:0.0:1777051449.347097:0:46498:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452666112 00000100:00100000:0.0:1777051449.347151:0:46498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8261 00000100:00100000:0.0:1777051449.347163:0:46498:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955611f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+7:8492:x1863365452666112:12345-0@lo:101:mdt00_003.0 00010000:00010000:0.0:1777051449.347180:0:46498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051449.347208:0:46498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d950705600/0x85f51a6b96716f90 lrc: 2/0,0 mode: --/EX res: [0x240000bd3:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x85f51a6b96716f89 expref: -99 pid: 46498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051449.347238:0:46498:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cfa00/0x85f51a6b96716ea9 lrc: 2/0,0 mode: PR/PR res: [0x240000bd3:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b67e6 expref: 34 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051449.347254:0:46498:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d950705600/0x85f51a6b96716f90 lrc: 4/0,0 mode: --/EX res: [0x240000bd3:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x85f51a6b96716f89 expref: 8 pid: 46498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051449.347287:0:46498:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cfa00/0x85f51a6b96716ea9 lrc: 3/0,0 mode: PR/PR res: [0x240000bd3:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b67e6 expref: 34 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051449.347308:0:46498:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cfa00/0x85f51a6b96716ea9 lrc: 4/0,0 mode: PR/PR res: [0x240000bd3:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b67e6 expref: 34 pid: 8492 timeout: 8178 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051449.347327:0:46498:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94f51a680 pname:cluuid:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000_UUID:46498:1863365452666240:192.168.201.46@tcp:104: 00000100:00100000:0.0:1777051449.347416:0:46498:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da5837a240 going to sleep for 11 seconds 00000100:00100000:0.0:1777051449.349511:0:46498:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94f51a680 pname:cluuid:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000_UUID:46498:1863365452666240:192.168.201.46@tcp:104: 00010000:00010000:0.0:1777051449.349539:0:46498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950705600/0x85f51a6b96716f90 lrc: 3/0,0 mode: --/EX res: [0x240000bd3:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b96716f89 expref: 8 pid: 46498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051449.349553:0:46498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd3:0x4:0x0].0x0 (ffff99d94e52a700) 00010000:00010000:0.0:1777051449.349558:0:46498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1777051449.349563:0:46498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99d950705600/0x85f51a6b96716f90 lrc: 3/0,0 mode: --/EX res: [0x240000bd3:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b96716f89 expref: 8 pid: 46498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051449.349575:0:46498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d950705600, rc 0) 00000100:00100000:0.0:1777051449.349662:0:46498:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955611f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+8:8492:x1863365452666112:12345-0@lo:101:mdt00_003.0 Request processed in 2500us (2948us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051449.349672:0:46498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8261 00000100:00100000:2.0:1777051449.349767:0:8492:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955613480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8492:1863365452666112:0@lo:101:mdt00_003.0 00010000:00010000:2.0:1777051449.349794:0:8492:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950710a00/0x85f51a6b96716f89 lrc: 4/0,1 mode: --/EX res: [0x240000bd3:0x4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x85f51a6b96716f90 expref: -99 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051449.349813:0:8492:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950710a00/0x85f51a6b96716f89 lrc: 4/0,1 mode: --/EX res: [0x240000bd3:0x4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x85f51a6b96716f90 expref: -99 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051449.349916:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051449.350045:0:6564:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426053120 00000100:00100000:0.0:1777051449.350052:0:6564:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426053120 00010000:00010000:0.0:1777051449.350344:0:6564:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cfa00/0x85f51a6b96716ea9 lrc: 4/0,0 mode: PR/PR res: [0x240000bd3:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b67e6 expref: 35 pid: 8492 timeout: 8178 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051449.350395:0:6564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3936 00000100:00100000:0.0:1777051449.350406:0:6564:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f97fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+35:2437:x1863365426053120:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1777051449.350420:0:6564:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777051449.350427:0:6564:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cfa00/0x85f51a6b96716ea9 lrc: 4/0,0 mode: PR/PR res: [0x240000bd3:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b67e6 expref: 35 pid: 8492 timeout: 8178 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051449.350444:0:6564:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cfa00/0x85f51a6b96716ea9 lrc: 3/0,0 mode: PR/PR res: [0x240000bd3:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b67e6 expref: 35 pid: 8492 timeout: 8178 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051449.350466:0:6564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cfa00/0x85f51a6b96716ea9 lrc: 0/0,0 mode: --/PR res: [0x240000bd3:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b67e6 expref: 35 pid: 8492 timeout: 8178 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051449.350481:0:6564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd3:0x4:0x0].0x0 (ffff99d94e52a700) 00010000:00010000:0.0:1777051449.350488:0:6564:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99d950705600/0x85f51a6b96716f90 lrc: 2/0,0 mode: --/EX res: [0x240000bd3:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b96716f89 expref: 7 pid: 46498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051449.350499:0:6564:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99d950705600/0x85f51a6b96716f90 lrc: 2/0,0 mode: EX/EX res: [0x240000bd3:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x85f51a6b96716f89 expref: 7 pid: 46498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051449.350509:0:6564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d950705600/0x85f51a6b96716f90 lrc: 3/0,0 mode: EX/EX res: [0x240000bd3:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x85f51a6b96716f89 expref: 7 pid: 46498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051449.350544:0:6564:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff99d950705600/0x85f51a6b96716f90 lrc: 3/0,0 mode: EX/EX res: [0x240000bd3:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b96716f89 expref: 7 pid: 46498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051449.350558:0:6564:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94f51a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000_UUID:6564:1863365452666368:0@lo:105: 00000100:00100000:0.0:1777051449.350598:0:6564:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051449.350657:0:6564:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da5837a240 going to sleep for 11 seconds 00000100:00100000:1.0:1777051449.350679:0:6562:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452666368 00000100:00100000:1.0:1777051449.350688:0:6562:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452666368 00000100:00100000:1.0:1777051449.350750:0:6562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1777051449.350767:0:6562:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f519c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:6564:x1863365452666368:12345-0@lo:105: 00010000:00010000:1.0:1777051449.350780:0:6562:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950710a00/0x85f51a6b96716f89 lrc: 5/0,1 mode: --/EX res: [0x240000bd3:0x4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x85f51a6b96716f90 expref: -99 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051449.350795:0:6562:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950710a00/0x85f51a6b96716f89 lrc: 5/0,1 mode: --/EX res: [0x240000bd3:0x4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x85f51a6b96716f90 expref: -99 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051449.350808:0:6562:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950710a00/0x85f51a6b96716f89 lrc: 5/0,1 mode: --/EX res: [0x240000bd3:0x4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x85f51a6b96716f90 expref: -99 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051449.350821:0:6562:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950710a00/0x85f51a6b96716f89 lrc: 5/0,1 mode: EX/EX res: [0x240000bd3:0x4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x85f51a6b96716f90 expref: -99 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051449.350841:0:6562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950710a00/0x85f51a6b96716f89 lrc: 6/0,1 mode: EX/EX res: [0x240000bd3:0x4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x85f51a6b96716f90 expref: -99 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051449.350851:0:6562:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950710a00/0x85f51a6b96716f89 lrc: 6/0,1 mode: EX/EX res: [0x240000bd3:0x4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x85f51a6b96716f90 expref: -99 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051449.350886:0:6562:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff99d950710a00) 00000100:00100000:1.0:1777051449.350939:0:6562:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f519c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:6564:x1863365452666368:12345-0@lo:105: Request processed in 173us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051449.350950:0:6562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00010000:00010000:2.0:1777051449.350962:0:8492:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950710a00/0x85f51a6b96716f89 lrc: 4/0,1 mode: EX/EX res: [0x240000bd3:0x4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x85f51a6b96716f90 expref: -99 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051449.350980:0:8492:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950710a00/0x85f51a6b96716f89 lrc: 4/0,1 mode: EX/EX res: [0x240000bd3:0x4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x85f51a6b96716f90 expref: -99 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051449.350996:0:6564:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94f51a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000_UUID:6564:1863365452666368:0@lo:105: 00010000:00010000:0.0:1777051449.351016:0:6564:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1777051449.351021:0:8492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff99d950711e00/0x85f51a6b96716f97 lrc: 3/0,1 mode: --/EX res: [0x240000bd3:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051449.351041:0:8492:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d5ce200/0x85f51a6b96716f74 lrc: 2/0,0 mode: PR/PR res: [0x240000bd3:0x4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b681e expref: 54 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051449.351055:0:8492:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d950711e00/0x85f51a6b96716f97 lrc: 4/0,1 mode: --/EX res: [0x240000bd3:0x4:0x0].0x0 bits 0x3e/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8492 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051449.351075:0:6564:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f97fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+34:2437:x1863365426053120:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 667us (1159us total) trans 0 rc 0/0 00010000:00010000:2.0:1777051449.351088:0:8492:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d5ce200/0x85f51a6b96716f74 lrc: 3/0,0 mode: PR/PR res: [0x240000bd3:0x4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b681e expref: 54 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051449.351090:0:6564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3936 00010000:00010000:2.0:1777051449.351115:0:8492:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d5ce200/0x85f51a6b96716f74 lrc: 4/0,0 mode: PR/PR res: [0x240000bd3:0x4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b681e expref: 54 pid: 6580 timeout: 8178 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051449.351133:0:8492:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955613480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:8492:1863365452666496:192.168.201.46@tcp:104: 00000100:00100000:2.0:1777051449.351237:0:8492:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d94521ce40 going to sleep for 11 seconds 00000100:00100000:2.0:1777051449.353761:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051449.353775:0:8492:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955613480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:8492:1863365452666496:192.168.201.46@tcp:104: 00010000:00010000:1.0:1777051449.353802:0:8492:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff99d950711e00/0x85f51a6b96716f97 lrc: 3/0,1 mode: --/EX res: [0x240000bd3:0x4:0x0].0x0 bits 0x3e/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8492 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051449.353849:0:24467:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426053248 00000100:00100000:3.0:1777051449.353858:0:24467:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426053248 00010000:00010000:3.0:1777051449.353888:0:24467:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d5ce200/0x85f51a6b96716f74 lrc: 4/0,0 mode: PR/PR res: [0x240000bd3:0x4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b681e expref: 55 pid: 6580 timeout: 8178 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051449.353932:0:24467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3937 00000100:00100000:3.0:1777051449.353943:0:24467:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955610700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+55:2437:x1863365426053248:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1777051449.353956:0:24467:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777051449.353964:0:24467:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d5ce200/0x85f51a6b96716f74 lrc: 4/0,0 mode: PR/PR res: [0x240000bd3:0x4:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b681e expref: 55 pid: 6580 timeout: 8178 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051449.353981:0:24467:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d5ce200/0x85f51a6b96716f74 lrc: 3/0,0 mode: PR/PR res: [0x240000bd3:0x4:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b681e expref: 55 pid: 6580 timeout: 8178 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051449.354019:0:24467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d5ce200/0x85f51a6b96716f74 lrc: 0/0,0 mode: --/PR res: [0x240000bd3:0x4:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b681e expref: 55 pid: 6580 timeout: 8178 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051449.354060:0:24467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd3:0x4:0x0].0x0 (ffff99d94e52ae00) 00010000:00010000:3.0:1777051449.354068:0:24467:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff99d950711e00/0x85f51a6b96716f97 lrc: 3/0,1 mode: --/EX res: [0x240000bd3:0x4:0x0].0x0 bits 0x3e/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8492 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051449.354080:0:24467:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff99d950711e00/0x85f51a6b96716f97 lrc: 3/0,1 mode: EX/EX res: [0x240000bd3:0x4:0x0].0x0 bits 0x3e/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8492 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051449.354090:0:24467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d950711e00/0x85f51a6b96716f97 lrc: 4/0,1 mode: EX/EX res: [0x240000bd3:0x4:0x0].0x0 bits 0x3e/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8492 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051449.354126:0:24467:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1777051449.354179:0:8492:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff99d950711e00/0x85f51a6b96716f97 lrc: 3/0,1 mode: EX/EX res: [0x240000bd3:0x4:0x0].0x0 bits 0x3e/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8492 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051449.354182:0:24467:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955610700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+54:2437:x1863365426053248:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 238us (424us total) trans 0 rc 0/0 00010000:00010000:1.0:1777051449.354203:0:8492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d950711e00/0x85f51a6b96716f97 lrc: 3/0,1 mode: EX/EX res: [0x240000bd3:0x4:0x0].0x0 bits 0x3e/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8492 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051449.354243:0:8492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d5ce800/0x85f51a6b96716f9e lrc: 3/0,1 mode: --/EX res: [0x240000bd0:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051449.354251:0:24467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3937 00010000:00010000:1.0:1777051449.354268:0:8492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d5ce800/0x85f51a6b96716f9e lrc: 3/0,1 mode: EX/EX res: [0x240000bd0:0x3:0x0].0x0 bits 0x3f/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8492 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051449.354284:0:8492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d5ce800/0x85f51a6b96716f9e lrc: 3/0,1 mode: EX/EX res: [0x240000bd0:0x3:0x0].0x0 bits 0x3f/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8492 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051449.354331:0:8492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff99da7d5cfe00/0x85f51a6b96716fa5 lrc: 3/0,1 mode: --/EX res: [0x2000032e2:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051449.354343:0:8492:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff99da7d5cfe00/0x85f51a6b96716fa5 lrc: 3/0,1 mode: --/EX res: [0x2000032e2:0x8:0x0].0x0 bits 0x3f/0x0 rrc: 2 type: IBT flags: 0x0 pid: 8492 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051449.354357:0:8492:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff99da7d5cfe00/0x85f51a6b96716fa5 lrc: 3/0,1 mode: --/EX res: [0x2000032e2:0x8:0x0].0x0 bits 0x3f/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 8492 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051449.354380:0:8492:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7fd63100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8492:1863365452666624:0@lo:101:mdt00_003.0 00000100:00100000:1.0:1777051449.354423:0:8492:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051449.354456:0:8492:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da7b379300 going to sleep for 11 seconds 00000100:00100000:2.0:1777051449.354507:0:6584:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452666624 00000100:00100000:2.0:1777051449.354517:0:6584:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452666624 00000100:00100000:2.0:1777051449.354569:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8262 00000100:00100000:2.0:1777051449.354582:0:6584:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fd61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:8492:x1863365452666624:12345-0@lo:101:mdt00_003.0 00010000:00010000:2.0:1777051449.354599:0:6584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051449.354653:0:6584:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710e00/0x85f51a6b96716fac lrc: 2/0,0 mode: --/EX res: [0x2000032e2:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x85f51a6b96716fa5 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051449.354683:0:6584:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710e00/0x85f51a6b96716fac lrc: 3/0,0 mode: EX/EX res: [0x2000032e2:0x8:0x0].0x0 bits 0x3f/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x85f51a6b96716fa5 expref: 9 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051449.354704:0:6584:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710e00/0x85f51a6b96716fac lrc: 3/0,0 mode: EX/EX res: [0x2000032e2:0x8:0x0].0x0 bits 0x3f/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b96716fa5 expref: 9 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051449.355019:0:6584:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0x8:0x0].0x0 (ffff99d9502e3f00) 00010000:00010000:2.0:1777051449.355025:0:6584:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3f 00010000:00010000:2.0:1777051449.355030:0:6584:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d950710e00, rc 0) 00000100:00100000:2.0:1777051449.355102:0:6584:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fd61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:8492:x1863365452666624:12345-0@lo:101:mdt00_003.0 Request processed in 522us (677us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051449.355113:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8262 00000100:00100000:1.0:1777051449.355235:0:8492:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7fd63100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8492:1863365452666624:0@lo:101:mdt00_003.0 00010000:00010000:1.0:1777051449.355258:0:8492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff99da7d5cfe00/0x85f51a6b96716fa5 lrc: 4/0,1 mode: EX/EX res: [0x2000032e2:0x8:0x0].0x0 bits 0x3f/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x85f51a6b96716fac expref: -99 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051449.355273:0:8492:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff99da7d5cfe00/0x85f51a6b96716fa5 lrc: 4/0,1 mode: EX/EX res: [0x2000032e2:0x8:0x0].0x0 bits 0x3f/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x85f51a6b96716fac expref: -99 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051449.356872:0:8492:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94f51a680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8492:1863365452666752:0@lo:403:mdt00_003.0 00000100:00100000:0.0:1777051449.356923:0:8492:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051449.356956:0:8492:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da5837a240 going to sleep for 11 seconds 00000100:00100000:3.0:1777051449.357020:0:11727:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452666752 00000100:00100000:3.0:1777051449.357028:0:11727:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452666752 00000100:00100000:3.0:1777051449.357073:0:11727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8263 00000100:00100000:3.0:1777051449.357085:0:11727:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f518700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:8492:x1863365452666752:12345-0@lo:403:mdt00_003.0 00000100:00100000:3.0:1777051449.359557:0:11727:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f518700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:8492:x1863365452666752:12345-0@lo:403:mdt00_003.0 Request processed in 2472us (2632us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051449.359569:0:11727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8263 00000100:00100000:0.0:1777051449.359647:0:8492:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94f51a680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8492:1863365452666752:0@lo:403:mdt00_003.0 00010000:00010000:0.0:1777051449.361025:0:8492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d5ce800/0x85f51a6b96716f9e lrc: 3/0,1 mode: EX/EX res: [0x240000bd0:0x3:0x0].0x0 bits 0x3f/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8492 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051449.361042:0:8492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d5ce800/0x85f51a6b96716f9e lrc: 2/0,0 mode: EX/EX res: [0x240000bd0:0x3:0x0].0x0 bits 0x3f/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8492 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051449.361054:0:8492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d5ce800/0x85f51a6b96716f9e lrc: 3/0,0 mode: EX/EX res: [0x240000bd0:0x3:0x0].0x0 bits 0x3f/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8492 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051449.361063:0:8492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da7d5ce800 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:0.0:1777051449.361069:0:8492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d5ce800/0x85f51a6b96716f9e lrc: 3/0,0 mode: EX/EX res: [0x240000bd0:0x3:0x0].0x0 bits 0x3f/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8492 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051449.361082:0:8492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d5ce800/0x85f51a6b96716f9e lrc: 4/0,0 mode: EX/EX res: [0x240000bd0:0x3:0x0].0x0 bits 0x3f/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8492 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051449.361097:0:8492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x3:0x0].0x0 (ffff99d94e52a600) 00010000:00010000:0.0:1777051449.361102:0:8492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3f 00010000:00010000:0.0:1777051449.361108:0:8492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d5ce800/0x85f51a6b96716f9e lrc: 2/0,0 mode: --/EX res: [0x240000bd0:0x3:0x0].0x0 bits 0x3f/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8492 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051449.361117:0:8492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d5ce800/0x85f51a6b96716f9e lrc: 0/0,0 mode: --/EX res: [0x240000bd0:0x3:0x0].0x0 bits 0x3f/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8492 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051449.361141:0:8492:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff99da7d5cfe00/0x85f51a6b96716fa5 lrc: 4/0,1 mode: EX/EX res: [0x2000032e2:0x8:0x0].0x0 bits 0x3f/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x85f51a6b96716fac expref: -99 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051449.361153:0:8492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff99da7d5cfe00/0x85f51a6b96716fa5 lrc: 4/0,1 mode: EX/EX res: [0x2000032e2:0x8:0x0].0x0 bits 0x3f/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x85f51a6b96716fac expref: -99 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051449.361165:0:8492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff99da7d5cfe00/0x85f51a6b96716fa5 lrc: 3/0,0 mode: EX/EX res: [0x2000032e2:0x8:0x0].0x0 bits 0x3f/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x85f51a6b96716fac expref: -99 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051449.361256:0:38719:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1777051449.361260:0:8492:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1777051449.361269:0:38719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff99da7d5cfe00/0x85f51a6b96716fa5 lrc: 4/0,0 mode: EX/EX res: [0x2000032e2:0x8:0x0].0x0 bits 0x3f/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x85f51a6b96716fac expref: -99 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1777051449.361273:0:8492:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x2000032e2:0x8:0x0] 00010000:00010000:2.0:1777051449.361290:0:38719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da7d5cfe00 already unused, calling callback (ffffffffc177eed0) 00010000:00010000:0.0:1777051449.361291:0:8492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff99d950711e00/0x85f51a6b96716f97 lrc: 3/0,1 mode: EX/EX res: [0x240000bd3:0x4:0x0].0x0 bits 0x3e/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8492 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051449.361302:0:38719:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff99da7d5cfe00/0x85f51a6b96716fa5 lrc: 3/0,0 mode: EX/EX res: [0x2000032e2:0x8:0x0].0x0 bits 0x3f/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x85f51a6b96716fac expref: -99 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051449.361307:0:8492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d950711e00/0x85f51a6b96716f97 lrc: 2/0,0 mode: EX/EX res: [0x240000bd3:0x4:0x0].0x0 bits 0x3e/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8492 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051449.361336:0:8492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99d950711e00/0x85f51a6b96716f97 lrc: 3/0,0 mode: EX/EX res: [0x240000bd3:0x4:0x0].0x0 bits 0x3e/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8492 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1777051449.361347:0:38719:0:(mdt_handler.c:3963:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff99da7d5cfe00/0x85f51a6b96716fa5 lrc: 3/0,0 mode: EX/EX res: [0x2000032e2:0x8:0x0].0x0 bits 0x3f/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x85f51a6b96716fac expref: -99 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051449.361374:0:8492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d950711e00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:0.0:1777051449.361381:0:8492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d950711e00/0x85f51a6b96716f97 lrc: 3/0,0 mode: EX/EX res: [0x240000bd3:0x4:0x0].0x0 bits 0x3e/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8492 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051449.361392:0:8492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d950711e00/0x85f51a6b96716f97 lrc: 4/0,0 mode: EX/EX res: [0x240000bd3:0x4:0x0].0x0 bits 0x3e/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8492 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051449.361405:0:38719:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff99da7d5cfe00/0x85f51a6b96716fa5 lrc: 2/0,0 mode: --/EX res: [0x2000032e2:0x8:0x0].0x0 bits 0x3f/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x85f51a6b96716fac expref: -99 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051449.361408:0:8492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd3:0x4:0x0].0x0 (ffff99d94e52ae00) 00010000:00010000:0.0:1777051449.361418:0:8492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3e 00010000:00010000:0.0:1777051449.361425:0:8492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99d950711e00/0x85f51a6b96716f97 lrc: 2/0,0 mode: --/EX res: [0x240000bd3:0x4:0x0].0x0 bits 0x3e/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8492 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051449.361427:0:38719:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1777051449.361440:0:8492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d950711e00/0x85f51a6b96716f97 lrc: 0/0,0 mode: --/EX res: [0x240000bd3:0x4:0x0].0x0 bits 0x3e/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8492 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051449.361461:0:8492:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950710a00/0x85f51a6b96716f89 lrc: 4/0,1 mode: EX/EX res: [0x240000bd3:0x4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x85f51a6b96716f90 expref: -99 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051449.361473:0:8492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950710a00/0x85f51a6b96716f89 lrc: 4/0,1 mode: EX/EX res: [0x240000bd3:0x4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x85f51a6b96716f90 expref: -99 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051449.361484:0:8492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950710a00/0x85f51a6b96716f89 lrc: 3/0,0 mode: EX/EX res: [0x240000bd3:0x4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x85f51a6b96716f90 expref: -99 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051449.361502:0:38719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff99da7d5cfe00/0x85f51a6b96716fa5 lrc: 1/0,0 mode: --/EX res: [0x2000032e2:0x8:0x0].0x0 bits 0x3f/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x85f51a6b96716fac expref: -99 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051449.361511:0:8492:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1777051449.361524:0:38719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff99da7d5cfe00/0x85f51a6b96716fa5 lrc: 0/0,0 mode: --/EX res: [0x2000032e2:0x8:0x0].0x0 bits 0x3f/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x85f51a6b96716fac expref: -99 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1777051449.361525:0:8492:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000100:00100000:3.0:1777051449.361534:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955610e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452666880:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1777051449.361542:0:6568:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1777051449.361554:0:6568:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950710a00/0x85f51a6b96716f89 lrc: 2/0,0 mode: EX/EX res: [0x240000bd3:0x4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x85f51a6b96716f90 expref: -99 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051449.361563:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777051449.361569:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777051449.361576:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777051449.361579:0:6568:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d950710a00 already unused, calling callback (ffffffffc177eed0) 00010000:00010000:0.0:1777051449.361588:0:6568:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950710a00/0x85f51a6b96716f89 lrc: 3/0,0 mode: EX/EX res: [0x240000bd3:0x4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x85f51a6b96716f90 expref: -99 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1777051449.361601:0:6568:0:(mdt_handler.c:3963:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950710a00/0x85f51a6b96716f89 lrc: 3/0,0 mode: EX/EX res: [0x240000bd3:0x4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x85f51a6b96716f90 expref: -99 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051449.361602:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1777051449.361665:0:6568:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950710a00/0x85f51a6b96716f89 lrc: 2/0,0 mode: --/EX res: [0x240000bd3:0x4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x85f51a6b96716f90 expref: -99 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051449.361676:0:6568:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1777051449.361721:0:6568:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950710a00/0x85f51a6b96716f89 lrc: 1/0,0 mode: --/EX res: [0x240000bd3:0x4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x85f51a6b96716f90 expref: -99 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051449.361734:0:6568:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950710a00/0x85f51a6b96716f89 lrc: 0/0,0 mode: --/EX res: [0x240000bd3:0x4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x85f51a6b96716f90 expref: -99 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051449.362022:0:9550:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452666880 00000100:00100000:1.0:1777051449.362031:0:9550:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452666880 00000100:00100000:3.0:1777051449.362032:0:3680:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:0.0:1777051449.362053:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777051449.362054:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94f51a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3680:1863365452667008:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1777051449.362060:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777051449.362067:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777051449.362085:0:8492:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff99da7d5cee00/0x85f51a6b96716f7b lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x85f51a6b96716f82 expref: -99 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051449.362099:0:8492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff99da7d5cee00/0x85f51a6b96716f7b lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x85f51a6b96716f82 expref: -99 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051449.362113:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1777051449.362120:0:8492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff99da7d5cee00/0x85f51a6b96716f7b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x85f51a6b96716f82 expref: -99 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051449.362152:0:8492:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1777051449.362458:0:9550:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452667008 00000100:00100000:1.0:1777051449.362468:0:9550:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452667008 00000100:00100000:0.0:1777051449.362482:0:47827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13720 00010000:00010000:3.0:1777051449.362499:0:13753:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1777051449.362501:0:47827:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f97ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:lustre-MDT0001-mdtlov_UUID+10:3678:x1863365452666880:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1777051449.362511:0:13753:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff99da7d5cee00/0x85f51a6b96716f7b lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x85f51a6b96716f82 expref: -99 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051449.362512:0:6566:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13721 00010000:00010000:0.0:1777051449.362524:0:47827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1777051449.362536:0:6566:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f97d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+10:3680:x1863365452667008:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1777051449.362536:0:13753:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da7d5cee00 already unused, calling callback (ffffffffc177eed0) 00010000:00010000:3.0:1777051449.362549:0:13753:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff99da7d5cee00/0x85f51a6b96716f7b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x85f51a6b96716f82 expref: -99 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051449.362552:0:47827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710e00/0x85f51a6b96716fac lrc: 0/0,0 mode: --/EX res: [0x2000032e2:0x8:0x0].0x0 bits 0x3f/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x85f51a6b96716fa5 expref: 10 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051449.362558:0:6566:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000004:00010000:3.0:1777051449.362587:0:13753:0:(mdt_handler.c:3963:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff99da7d5cee00/0x85f51a6b96716f7b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x85f51a6b96716f82 expref: -99 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051449.362588:0:6566:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d950705600/0x85f51a6b96716f90 lrc: 0/0,0 mode: --/EX res: [0x240000bd3:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x85f51a6b96716f89 expref: 9 pid: 46498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051449.362592:0:47827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0x8:0x0].0x0 (ffff99d9502e3f00) 00010000:00010000:0.0:1777051449.362642:0:47827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1777051449.362653:0:6566:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd3:0x4:0x0].0x0 (ffff99d94e52a700) 00010000:00010000:2.0:1777051449.362667:0:6566:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1777051449.362667:0:13753:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff99da7d5cee00/0x85f51a6b96716f7b lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x85f51a6b96716f82 expref: -99 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051449.362690:0:13753:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1777051449.362721:0:47827:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f97ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:lustre-MDT0001-mdtlov_UUID+8:3678:x1863365452666880:12345-0@lo:103:ldlm_bl.0 Request processed in 225us (1119us total) trans 0 rc 0/0 00010000:00010000:3.0:1777051449.362726:0:13753:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff99da7d5cee00/0x85f51a6b96716f7b lrc: 1/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x85f51a6b96716f82 expref: -99 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051449.362734:0:6566:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f97d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+8:3680:x1863365452667008:12345-0@lo:103:ldlm_bl.0 Request processed in 202us (623us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051449.362743:0:47827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13720 00010000:00010000:3.0:1777051449.362759:0:13753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff99da7d5cee00/0x85f51a6b96716f7b lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x85f51a6b96716f82 expref: -99 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051449.362764:0:6566:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13721 00010000:00010000:3.0:1777051449.362791:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051449.362796:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051449.362803:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1777051449.362811:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955610e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452666880:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1777051449.362811:0:3679:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1777051449.362822:0:8492:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955611880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+53:138749:x1863365426052864:12345-192.168.201.46@tcp:36:lfs.0 Request processed in 20870us (21044us total) trans 0 rc -39/-39 00000100:00100000:0.0:1777051449.362836:0:8492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112263 00000100:00100000:3.0:1777051449.362847:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94f51a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3680:1863365452667008:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1777051449.362956:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95f97e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452667136:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1777051449.362999:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051449.363668:0:6564:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452667136 00000100:00100000:1.0:1777051449.363676:0:6564:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452667136 00000100:00100000:1.0:1777051449.363986:0:6564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13722 00000100:00100000:1.0:1777051449.364016:0:6564:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955611c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+7:3679:x1863365452667136:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1777051449.364031:0:6564:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1777051449.364050:0:6564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710400/0x85f51a6b96716f82 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x85f51a6b96716f7b expref: 7 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051449.364071:0:6564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d9533ab000) 00010000:00010000:1.0:1777051449.364078:0:6564:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1777051449.364137:0:6564:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955611c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+6:3679:x1863365452667136:12345-0@lo:103:ldlm_bl.0 Request processed in 124us (1137us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051449.364447:0:6564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13722 00000100:00100000:3.0:1777051449.364516:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95f97e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452667136:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1777051449.378747:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051449.378933:0:27885:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426053376 00000100:00100000:1.0:1777051449.378946:0:27885:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426053376 00000100:00100000:1.0:1777051449.379020:0:27885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112264 00000100:00100000:1.0:1777051449.379032:0:27885:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955610000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+34:138750:x1863365426053376:12345-192.168.201.46@tcp:101:lfs.0 00010000:00010000:1.0:1777051449.379052:0:27885:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777051449.379073:0:27885:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce400/0x85f51a6b96716fb3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6825 expref: -99 pid: 27885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051449.379137:0:27885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cf000/0x85f51a6b96716fba lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051449.379151:0:27885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cf000/0x85f51a6b96716fba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051449.379161:0:27885:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cf000/0x85f51a6b96716fba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1777051449.379226:0:27885:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 12288 00000004:00200000:1.0:1777051449.379230:0:27885:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1777051449.379248:0:27885:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cf000/0x85f51a6b96716fba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051449.379314:0:27885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce400/0x85f51a6b96716fb3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6825 expref: 36 pid: 27885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051449.379341:0:27885:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cf000/0x85f51a6b96716fba lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6825 expref: 35 pid: 27885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051449.379358:0:27885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d9533ab000) 00010000:00010000:1.0:1777051449.379363:0:27885:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1777051449.379369:0:27885:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99da7d5cf000, rc 0) 00000100:00100000:2.0:1777051449.379578:0:27885:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955610000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+35:138750:x1863365426053376:12345-192.168.201.46@tcp:101:lfs.0 Request processed in 546us (838us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051449.379589:0:27885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112264 00000100:00100000:0.0:1777051449.385500:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051449.385626:0:6579:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426053504 00000100:00100000:3.0:1777051449.385639:0:6579:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426053504 00000100:00100000:3.0:1777051449.385710:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112265 00000100:00100000:3.0:1777051449.385741:0:6579:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f51a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+35:138750:x1863365426053504:12345-192.168.201.46@tcp:101:lfs.0 00010000:00010000:3.0:1777051449.385764:0:6579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777051449.385789:0:6579:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3a00/0x85f51a6b96716fc1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b682c expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051449.385860:0:6579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2800/0x85f51a6b96716fc8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051449.385879:0:6579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2800/0x85f51a6b96716fc8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051449.385919:0:6579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2800/0x85f51a6b96716fc8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051449.385941:0:6579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3200/0x85f51a6b96716fcf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x45e84fca bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051449.385951:0:6579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3200/0x85f51a6b96716fcf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x45e84fca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051449.385958:0:6579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3200/0x85f51a6b96716fcf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x45e84fca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051449.386052:0:6579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3000/0x85f51a6b96716fd6 lrc: 3/1,0 mode: --/PR res: [0x240000bd3:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051449.386066:0:6579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3000/0x85f51a6b96716fd6 lrc: 3/1,0 mode: PR/PR res: [0x240000bd3:0x4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051449.386077:0:6579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3000/0x85f51a6b96716fd6 lrc: 3/1,0 mode: PR/PR res: [0x240000bd3:0x4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777051449.386104:0:6579:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3000/0x85f51a6b96716fd6 lrc: 3/1,0 mode: PR/PR res: [0x240000bd3:0x4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051449.386122:0:6579:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2800/0x85f51a6b96716fc8 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051449.386133:0:6579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2800/0x85f51a6b96716fc8 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051449.386143:0:6579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2800/0x85f51a6b96716fc8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051449.386153:0:6579:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2800/0x85f51a6b96716fc8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051449.386171:0:6579:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d9559a2800 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:3.0:1777051449.386451:0:6579:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2800/0x85f51a6b96716fc8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051449.386470:0:6579:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2800/0x85f51a6b96716fc8 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051449.386490:0:6579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d9533ab000) 00010000:00010000:3.0:1777051449.386496:0:6579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777051449.386503:0:6579:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2800/0x85f51a6b96716fc8 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051449.386515:0:6579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2800/0x85f51a6b96716fc8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051449.386531:0:6579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3200/0x85f51a6b96716fcf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x45e84fca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051449.386538:0:6579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3200/0x85f51a6b96716fcf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x45e84fca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051449.386545:0:6579:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3200/0x85f51a6b96716fcf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x45e84fca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051449.386550:0:6579:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d9559a3200 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:3.0:1777051449.386553:0:6579:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3200/0x85f51a6b96716fcf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x45e84fca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051449.386558:0:6579:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3200/0x85f51a6b96716fcf lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x45e84fca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051449.386571:0:6579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x45e84fca (ffff99d9413d2000) 00010000:00010000:3.0:1777051449.386573:0:6579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777051449.386576:0:6579:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3200/0x85f51a6b96716fcf lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x45e84fca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051449.386582:0:6579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3200/0x85f51a6b96716fcf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x45e84fca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051449.386651:0:6579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3a00/0x85f51a6b96716fc1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b682c expref: 37 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051449.386673:0:6579:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3000/0x85f51a6b96716fd6 lrc: 3/0,0 mode: PR/PR res: [0x240000bd3:0x4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b682c expref: 36 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051449.386685:0:6579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd3:0x4:0x0].0x0 (ffff99d9413d2f00) 00010000:00010000:3.0:1777051449.386689:0:6579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1777051449.386693:0:6579:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d9559a3000, rc 0) 00000100:00100000:3.0:1777051449.386765:0:6579:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f51a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+36:138750:x1863365426053504:12345-192.168.201.46@tcp:101:lfs.0 Request processed in 1042us (1272us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051449.387045:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112265 00000100:00100000:0.0:1777051449.390139:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051449.390488:0:21368:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426053632 00000100:00100000:1.0:1777051449.390498:0:21368:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426053632 00000100:00100000:1.0:1777051449.390559:0:21368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112266 00000100:00100000:1.0:1777051449.390572:0:21368:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d956128380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+53:138750:x1863365426053632:12345-192.168.201.46@tcp:101:lfs.0 00010000:00010000:1.0:1777051449.390588:0:21368:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777051449.390643:0:21368:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d5ce400/0x85f51a6b96716fdd lrc: 2/0,0 mode: --/CR res: [0x240000bd3:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6833 expref: -99 pid: 21368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051449.390702:0:21368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d5cec00/0x85f51a6b96716fe4 lrc: 3/1,0 mode: --/PR res: [0x240000bd3:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051449.390718:0:21368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d5cec00/0x85f51a6b96716fe4 lrc: 3/1,0 mode: PR/PR res: [0x240000bd3:0x4:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21368 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051449.390731:0:21368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d5cec00/0x85f51a6b96716fe4 lrc: 3/1,0 mode: PR/PR res: [0x240000bd3:0x4:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21368 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1777051449.391136:0:21368:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000bd3:0x4:0x0]: returning size 4096 00000004:00200000:1.0:1777051449.391144:0:21368:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1777051449.391248:0:21368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d5ce400/0x85f51a6b96716fdd lrc: 0/0,0 mode: --/CR res: [0x240000bd3:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6833 expref: 55 pid: 21368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051449.391276:0:21368:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d5cec00/0x85f51a6b96716fe4 lrc: 3/0,0 mode: PR/PR res: [0x240000bd3:0x4:0x0].0x0 bits 0x10/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6833 expref: 54 pid: 21368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051449.391289:0:21368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd3:0x4:0x0].0x0 (ffff99d94e52ac00) 00010000:00010000:1.0:1777051449.391298:0:21368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:1.0:1777051449.391304:0:21368:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99da7d5cec00, rc 0) 00000100:00100000:0.0:1777051449.391440:0:21368:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d956128380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+54:138750:x1863365426053632:12345-192.168.201.46@tcp:101:lfs.0 Request processed in 866us (1301us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051449.391453:0:21368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112266 00000100:00100000:2.0:1777051449.397163:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051449.397270:0:46497:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426053760 00000100:00100000:0.0:1777051449.397298:0:46497:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426053760 00000100:00100000:0.0:1777051449.397361:0:46497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112267 00000100:00100000:0.0:1777051449.397377:0:46497:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955612a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+36:138750:x1863365426053760:12345-192.168.201.46@tcp:101:lfs.0 00010000:00010000:0.0:1777051449.397397:0:46497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051449.397423:0:46497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d950705a00/0x85f51a6b96716feb lrc: 2/0,0 mode: --/CR res: [0x2000032e2:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b683a expref: -99 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051449.397488:0:46497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950704a00/0x85f51a6b96716ff2 lrc: 3/1,0 mode: --/CR res: [0x2000032e2:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051449.397506:0:46497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d950704a00/0x85f51a6b96716ff2 lrc: 3/1,0 mode: CR/CR res: [0x2000032e2:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051449.397520:0:46497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d950704a00/0x85f51a6b96716ff2 lrc: 3/1,0 mode: CR/CR res: [0x2000032e2:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051449.397540:0:46497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950705400/0x85f51a6b96716ff9 lrc: 3/1,0 mode: --/PR res: [0x2000032e2:0x8:0x0].0x15f59727 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051449.397552:0:46497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d950705400/0x85f51a6b96716ff9 lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0x8:0x0].0x15f59727 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051449.397563:0:46497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d950705400/0x85f51a6b96716ff9 lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0x8:0x0].0x15f59727 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051449.397682:0:46497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950705600/0x85f51a6b96717000 lrc: 3/1,0 mode: --/PR res: [0x2000032e3:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051449.397697:0:46497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d950705600/0x85f51a6b96717000 lrc: 3/1,0 mode: PR/PR res: [0x2000032e3:0x9:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051449.397708:0:46497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d950705600/0x85f51a6b96717000 lrc: 3/1,0 mode: PR/PR res: [0x2000032e3:0x9:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1777051449.397752:0:46497:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000032e3:0x9:0x0]: returning size 1048576 00000004:00200000:0.0:1777051449.397758:0:46497:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1777051449.397782:0:46497:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99d950705600/0x85f51a6b96717000 lrc: 3/1,0 mode: PR/PR res: [0x2000032e3:0x9:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051449.397798:0:46497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d950705600/0x85f51a6b96717000 lrc: 3/1,0 mode: PR/PR res: [0x2000032e3:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051449.397810:0:46497:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950704a00/0x85f51a6b96716ff2 lrc: 4/1,0 mode: CR/CR res: [0x2000032e2:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051449.397820:0:46497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950704a00/0x85f51a6b96716ff2 lrc: 4/1,0 mode: CR/CR res: [0x2000032e2:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051449.397830:0:46497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d950704a00/0x85f51a6b96716ff2 lrc: 3/0,0 mode: CR/CR res: [0x2000032e2:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051449.397839:0:46497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d950704a00/0x85f51a6b96716ff2 lrc: 4/0,0 mode: CR/CR res: [0x2000032e2:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051449.397848:0:46497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d950704a00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:0.0:1777051449.397853:0:46497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d950704a00/0x85f51a6b96716ff2 lrc: 4/0,0 mode: CR/CR res: [0x2000032e2:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051449.397863:0:46497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d950704a00/0x85f51a6b96716ff2 lrc: 5/0,0 mode: CR/CR res: [0x2000032e2:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051449.397877:0:46497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0x8:0x0].0x0 (ffff99da42881600) 00010000:00010000:0.0:1777051449.397881:0:46497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777051449.397888:0:46497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d950704a00/0x85f51a6b96716ff2 lrc: 3/0,0 mode: --/CR res: [0x2000032e2:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051449.397897:0:46497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d950704a00/0x85f51a6b96716ff2 lrc: 0/0,0 mode: --/CR res: [0x2000032e2:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051449.397917:0:46497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950705400/0x85f51a6b96716ff9 lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0x8:0x0].0x15f59727 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051449.397926:0:46497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d950705400/0x85f51a6b96716ff9 lrc: 2/0,0 mode: PR/PR res: [0x2000032e2:0x8:0x0].0x15f59727 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051449.397932:0:46497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d950705400/0x85f51a6b96716ff9 lrc: 3/0,0 mode: PR/PR res: [0x2000032e2:0x8:0x0].0x15f59727 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051449.397936:0:46497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d950705400 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:0.0:1777051449.397939:0:46497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d950705400/0x85f51a6b96716ff9 lrc: 3/0,0 mode: PR/PR res: [0x2000032e2:0x8:0x0].0x15f59727 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051449.397946:0:46497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d950705400/0x85f51a6b96716ff9 lrc: 4/0,0 mode: PR/PR res: [0x2000032e2:0x8:0x0].0x15f59727 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051449.397954:0:46497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0x8:0x0].0x15f59727 (ffff99da42881300) 00010000:00010000:0.0:1777051449.397956:0:46497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777051449.397958:0:46497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d950705400/0x85f51a6b96716ff9 lrc: 2/0,0 mode: --/PR res: [0x2000032e2:0x8:0x0].0x15f59727 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051449.397964:0:46497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d950705400/0x85f51a6b96716ff9 lrc: 0/0,0 mode: --/PR res: [0x2000032e2:0x8:0x0].0x15f59727 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051449.397993:0:46497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d950705a00/0x85f51a6b96716feb lrc: 0/0,0 mode: --/CR res: [0x2000032e2:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b683a expref: 38 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051449.398006:0:46497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950705600/0x85f51a6b96717000 lrc: 3/0,0 mode: PR/PR res: [0x2000032e3:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b683a expref: 37 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051449.398014:0:46497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e3:0x9:0x0].0x0 (ffff99da42881100) 00010000:00010000:0.0:1777051449.398016:0:46497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1777051449.398019:0:46497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d950705600, rc 0) 00000100:00100000:0.0:1777051449.398072:0:46497:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955612a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+37:138750:x1863365426053760:12345-192.168.201.46@tcp:101:lfs.0 Request processed in 700us (926us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051449.398080:0:46497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112267 00000100:00100000:1.0:1777051449.402647:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051449.402754:0:6581:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426053888 00000100:00100000:2.0:1777051449.402764:0:6581:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426053888 00000100:00100000:2.0:1777051449.402831:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112268 00000100:00100000:2.0:1777051449.402845:0:6581:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fd63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+54:138750:x1863365426053888:12345-192.168.201.46@tcp:101:lfs.0 00010000:00010000:2.0:1777051449.402864:0:6581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051449.402888:0:6581:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d950711600/0x85f51a6b96717007 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6841 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051449.402949:0:6581:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d950711a00/0x85f51a6b9671700e lrc: 3/1,0 mode: --/PR res: [0x240000bd3:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051449.402966:0:6581:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d950711a00/0x85f51a6b9671700e lrc: 3/1,0 mode: PR/PR res: [0x240000bd3:0x4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6581 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051449.402981:0:6581:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d950711a00/0x85f51a6b9671700e lrc: 3/1,0 mode: PR/PR res: [0x240000bd3:0x4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6581 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1777051449.403086:0:6581:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000bd3:0x4:0x0]: returning size 4096 00000004:00200000:2.0:1777051449.403093:0:6581:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:2.0:1777051449.403114:0:6581:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff99d950711a00/0x85f51a6b9671700e lrc: 3/1,0 mode: PR/PR res: [0x240000bd3:0x4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6581 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051449.403150:0:6581:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d950711600/0x85f51a6b96717007 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6841 expref: 56 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051449.403176:0:6581:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99d950711a00/0x85f51a6b9671700e lrc: 3/0,0 mode: PR/PR res: [0x240000bd3:0x4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6841 expref: 55 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051449.403189:0:6581:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd3:0x4:0x0].0x0 (ffff99d94e52ac00) 00010000:00010000:2.0:1777051449.403193:0:6581:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1777051449.403239:0:6581:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d950711a00, rc 0) 00000100:00100000:2.0:1777051449.403316:0:6581:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fd63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+55:138750:x1863365426053888:12345-192.168.201.46@tcp:101:lfs.0 Request processed in 473us (674us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051449.403328:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112268 00000100:00100000:3.0:1777051449.406645:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051449.406760:0:46494:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426054016 00000100:00100000:0.0:1777051449.406770:0:46494:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426054016 00000100:00100000:0.0:1777051449.406833:0:46494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112269 00000100:00100000:0.0:1777051449.406845:0:46494:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f97e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+55:138750:x1863365426054016:12345-192.168.201.46@tcp:101:lfs.0 00010000:00010000:0.0:1777051449.406862:0:46494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051449.406883:0:46494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d950705a00/0x85f51a6b96717015 lrc: 2/0,0 mode: --/CR res: [0x240000bd0:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6848 expref: -99 pid: 46494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051449.406935:0:46494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d950705400/0x85f51a6b9671701c lrc: 3/1,0 mode: --/PR res: [0x240000bd0:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051449.406950:0:46494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d950705400/0x85f51a6b9671701c lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 46494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051449.406965:0:46494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d950705400/0x85f51a6b9671701c lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 46494 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1777051449.407001:0:46494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000bd0:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1777051449.407007:0:46494:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1777051449.407059:0:46494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d950705a00/0x85f51a6b96717015 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6848 expref: 57 pid: 46494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051449.407082:0:46494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99d950705400/0x85f51a6b9671701c lrc: 3/0,0 mode: PR/PR res: [0x240000bd0:0x3:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6848 expref: 56 pid: 46494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051449.407095:0:46494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x3:0x0].0x0 (ffff99da42881600) 00010000:00010000:0.0:1777051449.407100:0:46494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1777051449.407105:0:46494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d950705400, rc 0) 00000100:00100000:0.0:1777051449.407464:0:46494:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f97e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+56:138750:x1863365426054016:12345-192.168.201.46@tcp:101:lfs.0 Request processed in 315us (517us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051449.407479:0:46494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112269 00000100:00100000:0.0:1777051449.409104:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051449.409448:0:27882:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426054144 00000100:00100000:1.0:1777051449.409459:0:27882:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426054144 00000100:00100000:1.0:1777051449.409550:0:27882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112270 00000100:00100000:1.0:1777051449.409565:0:27882:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d956129880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+37:138750:x1863365426054144:12345-192.168.201.46@tcp:101:lfs.0 00010000:00010000:1.0:1777051449.409581:0:27882:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777051449.409638:0:27882:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cfc00/0x85f51a6b96717023 lrc: 2/0,0 mode: --/CR res: [0x2000032e2:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b684f expref: -99 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051449.409704:0:27882:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce400/0x85f51a6b9671702a lrc: 3/1,0 mode: --/PR res: [0x2000032e2:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051449.409720:0:27882:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce400/0x85f51a6b9671702a lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051449.409734:0:27882:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce400/0x85f51a6b9671702a lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1777051449.409769:0:27882:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000032e2:0x8:0x0]: returning size 4096 00000004:00200000:1.0:1777051449.409775:0:27882:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1777051449.409812:0:27882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cfc00/0x85f51a6b96717023 lrc: 0/0,0 mode: --/CR res: [0x2000032e2:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b684f expref: 39 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051449.410107:0:27882:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce400/0x85f51a6b9671702a lrc: 3/0,0 mode: PR/PR res: [0x2000032e2:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b684f expref: 38 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051449.410122:0:27882:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0x8:0x0].0x0 (ffff99d94e52af00) 00010000:00010000:1.0:1777051449.410127:0:27882:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1777051449.410131:0:27882:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99da7d5ce400, rc 0) 00000100:00100000:1.0:1777051449.410230:0:27882:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d956129880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+38:138750:x1863365426054144:12345-192.168.201.46@tcp:101:lfs.0 Request processed in 636us (1095us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051449.410242:0:27882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112270 00000100:00100000:1.0:1777051449.419552:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051449.419661:0:24467:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426054400 00000100:00100000:3.0:1777051449.419957:0:24467:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426054400 00000100:00100000:3.0:1777051449.420045:0:24467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13723 00000100:00100000:3.0:1777051449.420060:0:24467:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fd61c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+38:138750:x1863365426054400:12345-192.168.201.46@tcp:103:lfs.0 00010000:00010000:3.0:1777051449.420392:0:24467:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1777051449.420425:0:24467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d950705600/0x85f51a6b96717000 lrc: 0/0,0 mode: --/PR res: [0x2000032e3:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b683a expref: 38 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051449.420464:0:24467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2a00/0x85f51a6b96716f12 lrc: 0/0,0 mode: --/CR res: [0x2000032e3:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6810 expref: 37 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051449.420509:0:24467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e3:0x9:0x0].0x0 (ffff99da42881100) 00010000:00010000:3.0:1777051449.420524:0:24467:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1777051449.421023:0:24467:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fd61c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+36:138750:x1863365426054400:12345-192.168.201.46@tcp:103:lfs.0 Request processed in 962us (1474us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051449.421038:0:24467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13723 00000100:00100000:3.0:1777051449.422820:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051449.422919:0:10328:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426054528 00000100:00100000:0.0:1777051449.422927:0:10328:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426054528 00000100:00100000:0.0:1777051449.422995:0:10328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112271 00000100:00100000:0.0:1777051449.423008:0:10328:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7c9a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+36:138750:x1863365426054528:12345-192.168.201.46@tcp:58:lfs.0 00010000:00010000:0.0:1777051449.423114:0:10328:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950704a00/0x85f51a6b96717031 lrc: 3/0,1 mode: --/EX res: [0x2000032e3:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051449.423135:0:10328:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d950704a00/0x85f51a6b96717031 lrc: 3/0,1 mode: EX/EX res: [0x2000032e3:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051449.423161:0:10328:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d950704a00/0x85f51a6b96717031 lrc: 3/0,1 mode: EX/EX res: [0x2000032e3:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1777051449.423328:0:10328:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2b:0x0].8, 136 off9280 00000100:00100000:0.0:1777051449.423418:0:10328:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7c9a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+36:138750:x1863365426054528:12345-192.168.201.46@tcp:58:lfs.0 Request processed in 410us (600us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051449.423431:0:10328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112271 00010000:00010000:0.0:1777051449.430493:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1777051449.623467:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7fd60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3677:1863365452667392:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1777051449.624227:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051449.624283:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955613100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3677:1863365452667264:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1777051449.624324:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051449.624412:0:10113:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452667392 00000100:00100000:2.0:1777051449.624425:0:10113:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452667392 00000100:00100000:1.0:1777051449.624432:0:47388:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452667264 00000100:00100000:1.0:1777051449.624442:0:47388:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452667264 00000100:00100000:2.0:1777051449.624550:0:10113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5676 00000100:00100000:1.0:1777051449.624571:0:47388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5677 00000100:00100000:2.0:1777051449.624573:0:10113:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95612ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3677:x1863365452667392:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1777051449.624594:0:47388:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7cd9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3677:x1863365452667264:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1777051449.624636:0:10113:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491904576 pending 0 free 3861622784 avail 3629027328 00002000:00000024:1.0:1777051449.624650:0:47388:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 481844800 pending 0 free 3642707968 avail 3411185664 00000100:00100000:2.0:1777051449.624726:0:10113:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95612ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3677:x1863365452667392:12345-0@lo:13:osp-pre-0-0.0 Request processed in 160us (498us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051449.624740:0:10113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5676 00000100:00080000:3.0:1777051449.624824:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1777051449.624828:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7fd60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3677:1863365452667392:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1777051449.624847:0:47388:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7cd9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3677:x1863365452667264:12345-0@lo:13:osp-pre-1-0.0 Request processed in 256us (515us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051449.624860:0:3677:0:(client.c:3101:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968370 gen 2 00000100:00100000:0.0:1777051449.624866:0:47388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5677 00000004:00080000:2.0:1777051449.624872:0:3677:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 4294968370 committed transno 4294968370 00000100:00100000:2.0:1777051449.624919:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955613100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3677:1863365452667264:0@lo:13:osp-pre-1-0.0 00000040:00080000:3.0:1777051450.009576:0:103189:0:(llog.c:801:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:3.0:1777051450.009586:0:103189:0:(llog_cat.c:158:llog_cat_process_common()) processing log [0x1:0x2b:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1777051450.009659:0:103189:0:(llog.c:858:llog_process_thread()) stop processing plain [0x1:0x2b:0x0] index 9 count 7 00000040:00080000:3.0:1777051450.009670:0:103189:0:(llog.c:858:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00000100:00100000:3.0:1777051450.009881:0:103189:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7c9a1180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:103189:1863365452667520:192.168.201.46@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1777051450.010009:0:103189:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d956bda840 going to sleep for 11 seconds 00000100:00100000:1.0:1777051450.013376:0:103189:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7c9a1180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:103189:1863365452667520:192.168.201.46@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1777051450.013573:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051450.013659:0:6580:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426054656 00000100:00100000:2.0:1777051450.013669:0:6580:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426054656 00000100:00100000:2.0:1777051450.013769:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112272 00000100:00080000:0.0:1777051450.013785:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1777051450.013786:0:6580:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7cd9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+22:138760:x1863365426054656:12345-192.168.201.46@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1777051450.013833:0:6580:0:(mdt_handler.c:7958:mdt_fid2path()) path get [0x2000032e3:0x9:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1777051450.013963:0:6580:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7cd9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+22:138760:x1863365426054656:12345-192.168.201.46@tcp:53:lhsmtool_posix.0 Request processed in 178us (387us total) trans 0 rc -66/-66 00000100:00100000:2.0:1777051450.013988:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112272 00000100:00100000:0.0:1777051450.016491:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051450.016964:0:8492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426054784 00000100:00100000:2.0:1777051450.016973:0:8492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426054784 00000100:00100000:2.0:1777051450.017046:0:8492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112273 00000100:00100000:2.0:1777051450.017061:0:8492:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7cd9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+8:138760:x1863365426054784:12345-192.168.201.46@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1777051450.017088:0:8492:0:(mdt_handler.c:7958:mdt_fid2path()) path get [0x240000bd3:0x4:0x0] from 18446744073709551615 #-1 00000100:00100000:2.0:1777051450.017513:0:8492:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7cd9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+8:138760:x1863365426054784:12345-192.168.201.46@tcp:53:lhsmtool_posix.0 Request processed in 454us (1023us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051450.017527:0:8492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112273 00000100:00080000:0.0:1777051450.017661:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1777051450.021110:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051450.021212:0:27885:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426054912 00000100:00100000:1.0:1777051450.021221:0:27885:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426054912 00000100:00100000:1.0:1777051450.021287:0:27885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112274 00000100:00100000:1.0:1777051450.021303:0:27885:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f42d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c11b6966-0775-44d2-bdc6-c74c26eb2226+22:138760:x1863365426054912:12345-192.168.201.46@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1777051450.021383:0:27885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cfe00/0x85f51a6b96717038 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051450.021411:0:27885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cfe00/0x85f51a6b96717038 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051450.021503:0:27885:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cfe00/0x85f51a6b96717038 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051450.021587:0:27885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950704600/0x85f51a6b9671703f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x9556c717 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051450.021640:0:27885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d950704600/0x85f51a6b9671703f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x9556c717 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051450.021656:0:27885:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d950704600/0x85f51a6b9671703f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x9556c717 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051450.021698:0:27885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950704400/0x85f51a6b96717046 lrc: 3/1,0 mode: --/PR res: [0x2000032e3:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051450.021714:0:27885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d950704400/0x85f51a6b96717046 lrc: 3/1,0 mode: PR/PR res: [0x2000032e3:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051450.021987:0:27885:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d950704400/0x85f51a6b96717046 lrc: 3/1,0 mode: PR/PR res: [0x2000032e3:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1777051450.022039:0:27885:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000032e3:0x9:0x0]: returning size 1048576 00000004:00200000:0.0:1777051450.022047:0:27885:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1777051450.022064:0:27885:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99d950704400/0x85f51a6b96717046 lrc: 3/1,0 mode: PR/PR res: [0x2000032e3:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051450.022084:0:27885:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cfe00/0x85f51a6b96717038 lrc: 4/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051450.022096:0:27885:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cfe00/0x85f51a6b96717038 lrc: 4/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051450.022106:0:27885:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cfe00/0x85f51a6b96717038 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051450.022118:0:27885:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cfe00/0x85f51a6b96717038 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051450.022129:0:27885:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da7d5cfe00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:0.0:1777051450.022136:0:27885:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cfe00/0x85f51a6b96717038 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051450.022148:0:27885:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cfe00/0x85f51a6b96717038 lrc: 5/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051450.022165:0:27885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99d941e2ea00) 00010000:00010000:0.0:1777051450.022170:0:27885:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777051450.022179:0:27885:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cfe00/0x85f51a6b96717038 lrc: 3/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051450.022190:0:27885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cfe00/0x85f51a6b96717038 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051450.022235:0:27885:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950704600/0x85f51a6b9671703f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x9556c717 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051450.022248:0:27885:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d950704600/0x85f51a6b9671703f lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x9556c717 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051450.022258:0:27885:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d950704600/0x85f51a6b9671703f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x9556c717 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051450.022270:0:27885:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d950704600 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:0.0:1777051450.022275:0:27885:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d950704600/0x85f51a6b9671703f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x9556c717 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051450.022286:0:27885:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d950704600/0x85f51a6b9671703f lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x9556c717 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051450.022300:0:27885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x9556c717 (ffff99d94e52a800) 00010000:00010000:0.0:1777051450.022305:0:27885:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777051450.022309:0:27885:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d950704600/0x85f51a6b9671703f lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x9556c717 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051450.022320:0:27885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d950704600/0x85f51a6b9671703f lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x9556c717 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051450.022345:0:27885:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950704400/0x85f51a6b96717046 lrc: 3/1,0 mode: PR/PR res: [0x2000032e3:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051450.022355:0:27885:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d950704400/0x85f51a6b96717046 lrc: 2/0,0 mode: PR/PR res: [0x2000032e3:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051450.022366:0:27885:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d950704400/0x85f51a6b96717046 lrc: 3/0,0 mode: PR/PR res: [0x2000032e3:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051450.022376:0:27885:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d950704400 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:0.0:1777051450.022381:0:27885:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d950704400/0x85f51a6b96717046 lrc: 3/0,0 mode: PR/PR res: [0x2000032e3:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051450.022392:0:27885:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d950704400/0x85f51a6b96717046 lrc: 4/0,0 mode: PR/PR res: [0x2000032e3:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051450.022411:0:27885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e3:0x9:0x0].0x0 (ffff99da42881300) 00010000:00010000:0.0:1777051450.022415:0:27885:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777051450.022419:0:27885:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d950704400/0x85f51a6b96717046 lrc: 2/0,0 mode: --/PR res: [0x2000032e3:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051450.022430:0:27885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d950704400/0x85f51a6b96717046 lrc: 0/0,0 mode: --/PR res: [0x2000032e3:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051450.022513:0:27885:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f42d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c11b6966-0775-44d2-bdc6-c74c26eb2226+22:138760:x1863365426054912:12345-192.168.201.46@tcp:34:lhsmtool_posix.0 Request processed in 1212us (1404us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051450.022528:0:27885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112274 00000100:00100000:3.0:1777051450.024525:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051450.024641:0:6579:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426055168 00000100:00100000:1.0:1777051450.024651:0:6579:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426055168 00000100:00100000:1.0:1777051450.025048:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112275 00000100:00100000:1.0:1777051450.025065:0:6579:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7c9a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+22:138760:x1863365426055168:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1777051450.025084:0:6579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777051450.025106:0:6579:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cee00/0x85f51a6b9671704d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6856 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051450.025216:0:6579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce800/0x85f51a6b96717054 lrc: 3/1,0 mode: --/PR res: [0x2000032e3:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051450.025235:0:6579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce800/0x85f51a6b96717054 lrc: 3/1,0 mode: PR/PR res: [0x2000032e3:0x9:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051450.025252:0:6579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce800/0x85f51a6b96717054 lrc: 3/1,0 mode: PR/PR res: [0x2000032e3:0x9:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1777051450.025268:0:6579:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000032e3:0x9:0x0]: returning size 1048576 00010000:00010000:1.0:1777051450.025367:0:6579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce800/0x85f51a6b96717054 lrc: 3/1,0 mode: PR/PR res: [0x2000032e3:0x9:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051450.025379:0:6579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce800/0x85f51a6b96717054 lrc: 2/0,0 mode: PR/PR res: [0x2000032e3:0x9:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051450.025419:0:6579:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce800/0x85f51a6b96717054 lrc: 3/0,0 mode: PR/PR res: [0x2000032e3:0x9:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051450.025435:0:6579:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da7d5ce800 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:1.0:1777051450.025441:0:6579:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce800/0x85f51a6b96717054 lrc: 3/0,0 mode: PR/PR res: [0x2000032e3:0x9:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051450.025452:0:6579:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce800/0x85f51a6b96717054 lrc: 4/0,0 mode: PR/PR res: [0x2000032e3:0x9:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051450.025468:0:6579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e3:0x9:0x0].0x0 (ffff99da42881300) 00010000:00010000:1.0:1777051450.025472:0:6579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1777051450.025478:0:6579:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce800/0x85f51a6b96717054 lrc: 2/0,0 mode: --/PR res: [0x2000032e3:0x9:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051450.025488:0:6579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce800/0x85f51a6b96717054 lrc: 0/0,0 mode: --/PR res: [0x2000032e3:0x9:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051450.025537:0:6579:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cee00/0x85f51a6b9671704d lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6856 expref: 24 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051450.025553:0:6579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99d941e2ea00) 00010000:00010000:1.0:1777051450.025557:0:6579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1777051450.025564:0:6579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cee00/0x85f51a6b9671704d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6856 expref: 24 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051450.025579:0:6579:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99da7d5cee00, rc 0) 00000100:00100000:1.0:1777051450.025671:0:6579:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7c9a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+23:138760:x1863365426055168:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 Request processed in 610us (1148us total) trans 30064771215 rc 301/301 00000100:00100000:1.0:1777051450.025684:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112275 00000100:00100000:3.0:1777051450.031452:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051450.032011:0:10328:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426055296 00000100:00100000:0.0:1777051450.032023:0:10328:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426055296 00000100:00100000:0.0:1777051450.032108:0:10328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112276 00000100:00100000:0.0:1777051450.032127:0:10328:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7c9a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+23:138760:x1863365426055296:12345-192.168.201.46@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1777051450.032169:0:10328:0:(mdt_handler.c:7958:mdt_fid2path()) path get [0x2000032e3:0x9:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1777051450.032886:0:10328:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7c9a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+23:138760:x1863365426055296:12345-192.168.201.46@tcp:53:lhsmtool_posix.0 Request processed in 761us (1439us total) trans 0 rc -66/-66 00000100:00100000:0.0:1777051450.032902:0:10328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112276 00000100:00100000:2.0:1777051450.038862:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051450.038963:0:46497:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426055424 00000100:00100000:1.0:1777051450.038975:0:46497:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426055424 00000100:00100000:1.0:1777051450.039054:0:46497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112277 00000100:00100000:1.0:1777051450.039070:0:46497:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955613100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:c11b6966-0775-44d2-bdc6-c74c26eb2226+8:138760:x1863365426055424:12345-192.168.201.46@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1777051450.039102:0:46497:0:(mdt_handler.c:7958:mdt_fid2path()) path get [0x240000bd3:0x4:0x0] from 18446744073709551615 #-1 00000100:00100000:1.0:1777051450.039266:0:46497:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955613100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:c11b6966-0775-44d2-bdc6-c74c26eb2226+8:138760:x1863365426055424:12345-192.168.201.46@tcp:53:lhsmtool_posix.0 Request processed in 197us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051450.039294:0:46497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112277 00000100:00100000:0.0:1777051450.043807:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051450.043884:0:6581:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426055552 00000100:00100000:2.0:1777051450.043895:0:6581:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426055552 00000100:00100000:2.0:1777051450.043981:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112278 00000100:00100000:2.0:1777051450.043998:0:6581:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f42d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+23:138760:x1863365426055552:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1777051450.044021:0:6581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051450.044051:0:6581:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d950711e00/0x85f51a6b96717062 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b685d expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051450.044435:0:6581:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710400/0x85f51a6b96717069 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051450.044456:0:6581:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710400/0x85f51a6b96717069 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051450.044477:0:6581:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710400/0x85f51a6b96717069 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1777051450.044853:0:6581:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 12288 00000004:00200000:2.0:1777051450.044861:0:6581:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1777051450.044890:0:6581:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710400/0x85f51a6b96717069 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051450.044931:0:6581:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d950711e00/0x85f51a6b96717062 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b685d expref: 25 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051450.044958:0:6581:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710400/0x85f51a6b96717069 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b685d expref: 24 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051450.044973:0:6581:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d9533ab000) 00010000:00010000:2.0:1777051450.044978:0:6581:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1777051450.044984:0:6581:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d950710400, rc 0) 00000100:00100000:2.0:1777051450.045068:0:6581:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f42d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+24:138760:x1863365426055552:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 Request processed in 1073us (1263us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051450.045082:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112278 00000100:00100000:0.0:1777051450.047437:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051450.047521:0:46494:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426055680 00000100:00100000:1.0:1777051450.047532:0:46494:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426055680 00000100:00100000:1.0:1777051450.047639:0:46494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112279 00000100:00100000:1.0:1777051450.047658:0:46494:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f42fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c11b6966-0775-44d2-bdc6-c74c26eb2226+24:138760:x1863365426055680:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1777051450.047678:0:46494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777051450.047702:0:46494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cee00/0x85f51a6b96717070 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6864 expref: -99 pid: 46494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051450.047770:0:46494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce800/0x85f51a6b96717077 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051450.047789:0:46494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce800/0x85f51a6b96717077 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051450.047806:0:46494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce800/0x85f51a6b96717077 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051450.047836:0:46494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce200/0x85f51a6b9671707e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x45e84fca bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051450.047847:0:46494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce200/0x85f51a6b9671707e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x45e84fca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051450.047863:0:46494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce200/0x85f51a6b9671707e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x45e84fca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051450.047928:0:46494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cfa00/0x85f51a6b96717085 lrc: 3/1,0 mode: --/PR res: [0x240000bd3:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051450.047944:0:46494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cfa00/0x85f51a6b96717085 lrc: 3/1,0 mode: PR/PR res: [0x240000bd3:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051450.047958:0:46494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cfa00/0x85f51a6b96717085 lrc: 3/1,0 mode: PR/PR res: [0x240000bd3:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1777051450.048007:0:46494:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cfa00/0x85f51a6b96717085 lrc: 3/1,0 mode: PR/PR res: [0x240000bd3:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051450.048028:0:46494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce800/0x85f51a6b96717077 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051450.048041:0:46494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce800/0x85f51a6b96717077 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051450.048055:0:46494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce800/0x85f51a6b96717077 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051450.048068:0:46494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da7d5ce800 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:1.0:1777051450.048076:0:46494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce800/0x85f51a6b96717077 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051450.048090:0:46494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce800/0x85f51a6b96717077 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051450.048110:0:46494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d9533ab000) 00010000:00010000:1.0:1777051450.048117:0:46494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777051450.048124:0:46494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce800/0x85f51a6b96717077 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051450.048135:0:46494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce800/0x85f51a6b96717077 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051450.048154:0:46494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce200/0x85f51a6b9671707e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x45e84fca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051450.048166:0:46494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce200/0x85f51a6b9671707e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x45e84fca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051450.048178:0:46494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce200/0x85f51a6b9671707e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x45e84fca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051450.048264:0:46494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da7d5ce200 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:1.0:1777051450.048271:0:46494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce200/0x85f51a6b9671707e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x45e84fca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051450.048285:0:46494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce200/0x85f51a6b9671707e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x45e84fca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051450.048306:0:46494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x45e84fca (ffff99d94e52ab00) 00010000:00010000:1.0:1777051450.048312:0:46494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777051450.048319:0:46494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce200/0x85f51a6b9671707e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x45e84fca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051450.048332:0:46494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce200/0x85f51a6b9671707e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x45e84fca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051450.048390:0:46494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cee00/0x85f51a6b96717070 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6864 expref: 26 pid: 46494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051450.048428:0:46494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cfa00/0x85f51a6b96717085 lrc: 3/0,0 mode: PR/PR res: [0x240000bd3:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6864 expref: 25 pid: 46494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051450.048442:0:46494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd3:0x4:0x0].0x0 (ffff99d9413d2f00) 00010000:00010000:1.0:1777051450.048449:0:46494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1777051450.048455:0:46494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99da7d5cfa00, rc 0) 00000100:00100000:1.0:1777051450.048550:0:46494:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f42fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c11b6966-0775-44d2-bdc6-c74c26eb2226+25:138760:x1863365426055680:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 Request processed in 894us (1115us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051450.048565:0:46494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112279 00000100:00100000:3.0:1777051450.054156:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051450.054260:0:6579:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426055808 00000100:00100000:3.0:1777051450.054269:0:6579:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426055808 00000100:00100000:3.0:1777051450.054322:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112280 00000100:00100000:3.0:1777051450.054335:0:6579:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7c9a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+8:138760:x1863365426055808:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1777051450.054352:0:6579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777051450.054375:0:6579:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a3a00/0x85f51a6b9671708c lrc: 2/0,0 mode: --/CR res: [0x240000bd3:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b686b expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051450.054446:0:6579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a2a00/0x85f51a6b96717093 lrc: 3/1,0 mode: --/PR res: [0x240000bd3:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051450.054475:0:6579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a2a00/0x85f51a6b96717093 lrc: 3/1,0 mode: PR/PR res: [0x240000bd3:0x4:0x0].0x0 bits 0x10/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051450.054498:0:6579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a2a00/0x85f51a6b96717093 lrc: 3/1,0 mode: PR/PR res: [0x240000bd3:0x4:0x0].0x0 bits 0x10/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1777051450.054649:0:6579:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000bd3:0x4:0x0]: returning size 4096 00000004:00200000:3.0:1777051450.054658:0:6579:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1777051450.054714:0:6579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a3a00/0x85f51a6b9671708c lrc: 0/0,0 mode: --/CR res: [0x240000bd3:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b686b expref: 10 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051450.054744:0:6579:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a2a00/0x85f51a6b96717093 lrc: 3/0,0 mode: PR/PR res: [0x240000bd3:0x4:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b686b expref: 9 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051450.054759:0:6579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd3:0x4:0x0].0x0 (ffff99d94e52ac00) 00010000:00010000:3.0:1777051450.054765:0:6579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:3.0:1777051450.054771:0:6579:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d9559a2a00, rc 0) 00000100:00100000:3.0:1777051450.054844:0:6579:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7c9a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+9:138760:x1863365426055808:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 Request processed in 508us (690us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051450.054859:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112280 00000040:00080000:2.0:1777051450.058261:0:107948:0:(llog.c:801:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:2.0:1777051450.058271:0:107948:0:(llog_cat.c:158:llog_cat_process_common()) processing log [0x1:0x2b:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1777051450.058354:0:107948:0:(llog.c:858:llog_process_thread()) stop processing plain [0x1:0x2b:0x0] index 9 count 7 00000040:00080000:2.0:1777051450.058367:0:107948:0:(llog.c:858:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00000100:00100000:3.0:1777051450.058980:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051450.059820:0:21368:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426055936 00000100:00100000:1.0:1777051450.059833:0:21368:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426055936 00000100:00100000:1.0:1777051450.059937:0:21368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112281 00000100:00100000:1.0:1777051450.059959:0:21368:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7c9a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+9:138760:x1863365426055936:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1777051450.059982:0:21368:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777051450.060006:0:21368:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d5ce800/0x85f51a6b9671709a lrc: 2/0,0 mode: --/CR res: [0x240000bd0:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6872 expref: -99 pid: 21368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051450.060073:0:21368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d5cfe00/0x85f51a6b967170a1 lrc: 3/1,0 mode: --/PR res: [0x240000bd0:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051450.060093:0:21368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d5cfe00/0x85f51a6b967170a1 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 21368 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051450.060113:0:21368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d5cfe00/0x85f51a6b967170a1 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21368 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1777051450.060159:0:21368:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000bd0:0x3:0x0]: returning size 4096 00000004:00200000:1.0:1777051450.060168:0:21368:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1777051450.060259:0:21368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d5ce800/0x85f51a6b9671709a lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6872 expref: 11 pid: 21368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051450.060290:0:21368:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d5cfe00/0x85f51a6b967170a1 lrc: 3/0,0 mode: PR/PR res: [0x240000bd0:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6872 expref: 10 pid: 21368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051450.060305:0:21368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x3:0x0].0x0 (ffff99da42881600) 00010000:00010000:1.0:1777051450.060311:0:21368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1777051450.060316:0:21368:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99da7d5cfe00, rc 0) 00000100:00100000:1.0:1777051450.060384:0:21368:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7c9a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+10:138760:x1863365426055936:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 Request processed in 432us (1407us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051450.060396:0:21368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112281 00000100:00100000:3.0:1777051450.063239:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051450.063737:0:6580:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426056064 00000100:00100000:2.0:1777051450.063748:0:6580:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426056064 00000100:00100000:2.0:1777051450.063889:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112282 00000100:00100000:2.0:1777051450.063908:0:6580:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7c9a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+25:138760:x1863365426056064:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1777051450.063928:0:6580:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051450.063952:0:6580:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d950711800/0x85f51a6b967170a8 lrc: 2/0,0 mode: --/CR res: [0x2000032e2:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6879 expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051450.064018:0:6580:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950711400/0x85f51a6b967170af lrc: 3/1,0 mode: --/PR res: [0x2000032e2:0x8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051450.064037:0:6580:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d950711400/0x85f51a6b967170af lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0x8:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051450.064054:0:6580:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d950711400/0x85f51a6b967170af lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0x8:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1777051450.064096:0:6580:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000032e2:0x8:0x0]: returning size 4096 00000004:00200000:2.0:1777051450.064104:0:6580:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:2.0:1777051450.064151:0:6580:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d950711800/0x85f51a6b967170a8 lrc: 0/0,0 mode: --/CR res: [0x2000032e2:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6879 expref: 27 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051450.064177:0:6580:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950711400/0x85f51a6b967170af lrc: 3/0,0 mode: PR/PR res: [0x2000032e2:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6879 expref: 26 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051450.064192:0:6580:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0x8:0x0].0x0 (ffff99d94e52af00) 00010000:00010000:2.0:1777051450.064197:0:6580:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1777051450.064275:0:6580:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d950711400, rc 0) 00000100:00100000:2.0:1777051450.064350:0:6580:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7c9a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+26:138760:x1863365426056064:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 Request processed in 446us (1114us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051450.064365:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112282 00000100:00100000:2.0:1777051450.067173:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051450.067396:0:8492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426056192 00000100:00100000:3.0:1777051450.067405:0:8492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426056192 00000100:00100000:3.0:1777051450.067490:0:8492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112283 00000100:00100000:3.0:1777051450.067510:0:8492:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955610e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+26:138760:x1863365426056192:12345-192.168.201.46@tcp:34:lhsmtool_posix.0 00000100:00100000:3.0:1777051450.067742:0:8492:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955610e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+26:138760:x1863365426056192:12345-192.168.201.46@tcp:34:lhsmtool_posix.0 Request processed in 233us (569us total) trans 0 rc -2/-2 00000100:00100000:3.0:1777051450.067760:0:8492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112283 00000100:00100000:3.0:1777051450.076236:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051450.076370:0:27885:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426056448 00000100:00100000:0.0:1777051450.076384:0:27885:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426056448 00000100:00100000:0.0:1777051450.076493:0:27885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112284 00000100:00100000:0.0:1777051450.076514:0:27885:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94c128380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c11b6966-0775-44d2-bdc6-c74c26eb2226+26:138760:x1863365426056448:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1777051450.076542:0:27885:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051450.076550:0:27885:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1777051450.076666:0:27885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d950711400/0x85f51a6b967170af lrc: 0/0,0 mode: --/PR res: [0x2000032e2:0x8:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6879 expref: 26 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051450.076701:0:27885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0x8:0x0].0x0 (ffff99d94e52af00) 00010000:00010000:0.0:1777051450.076710:0:27885:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1777051450.076731:0:27885:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d950705c00/0x85f51a6b967170b6 lrc: 2/0,0 mode: --/CW res: [0x2000032e2:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6880 expref: -99 pid: 27885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051450.078121:0:27885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950704800/0x85f51a6b967170bd lrc: 3/1,0 mode: --/PR res: [0x2000032e3:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051450.078153:0:27885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d950704800/0x85f51a6b967170bd lrc: 3/1,0 mode: PR/PR res: [0x2000032e3:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051450.078179:0:27885:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d950704800/0x85f51a6b967170bd lrc: 3/1,0 mode: PR/PR res: [0x2000032e3:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1777051450.079023:0:27885:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000032e3:0xa:0x0]: returning size 0 00010000:00010000:0.0:1777051450.079124:0:27885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d950705c00/0x85f51a6b967170b6 lrc: 0/0,0 mode: --/CW res: [0x2000032e2:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6880 expref: 28 pid: 27885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051450.079161:0:27885:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950704800/0x85f51a6b967170bd lrc: 3/0,0 mode: PR/PR res: [0x2000032e3:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6880 expref: 27 pid: 27885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051450.079568:0:27885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e3:0xa:0x0].0x0 (ffff99da42881900) 00010000:00010000:0.0:1777051450.079577:0:27885:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1777051450.079583:0:27885:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d950704800, rc 0) 00000100:00100000:0.0:1777051450.080649:0:27885:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94c128380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c11b6966-0775-44d2-bdc6-c74c26eb2226+27:138760:x1863365426056448:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 Request processed in 4131us (4411us total) trans 30064771216 rc 0/0 00000100:00100000:0.0:1777051450.080677:0:27885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112284 00000100:00100000:2.0:1777051450.089091:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051450.089642:0:6579:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426056704 00000100:00100000:3.0:1777051450.089667:0:6579:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426056704 00000100:00100000:3.0:1777051450.089849:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112285 00000100:00100000:3.0:1777051450.089878:0:6579:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955613480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+27:138760:x1863365426056704:12345-192.168.201.46@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1777051450.091049:0:6579:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777051450.091109:0:6579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d950704800/0x85f51a6b967170bd lrc: 0/0,0 mode: --/PR res: [0x2000032e3:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6880 expref: 27 pid: 27885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051450.091586:0:6579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e3:0xa:0x0].0x0 (ffff99da42881900) 00010000:00010000:3.0:1777051450.091649:0:6579:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1777051450.091714:0:6579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3a00/0x85f51a6b967170cb lrc: 3/0,1 mode: --/CW res: [0x2000032e2:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051450.091751:0:6579:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce400/0x85f51a6b9671702a lrc: 2/0,0 mode: PR/PR res: [0x2000032e2:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b684f expref: 35 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051450.091770:0:6579:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3a00/0x85f51a6b967170cb lrc: 4/0,1 mode: --/CW res: [0x2000032e2:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051450.091848:0:6579:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce400/0x85f51a6b9671702a lrc: 3/0,0 mode: PR/PR res: [0x2000032e2:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b684f expref: 35 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051450.091887:0:6579:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce400/0x85f51a6b9671702a lrc: 4/0,0 mode: PR/PR res: [0x2000032e2:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b684f expref: 35 pid: 27882 timeout: 8179 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051450.091934:0:6579:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94c12a300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6579:1863365452667648:192.168.201.46@tcp:104: 00000100:00100000:3.0:1777051450.092088:0:6579:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d956bdae40 going to sleep for 11 seconds 00000100:00100000:2.0:1777051450.102852:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051450.103022:0:47597:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426056832 00000100:00100000:1.0:1777051450.103035:0:47597:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426056832 00010000:00010000:1.0:1777051450.103113:0:47597:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce400/0x85f51a6b9671702a lrc: 5/0,0 mode: PR/PR res: [0x2000032e2:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b684f expref: 36 pid: 27882 timeout: 8179 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051450.103237:0:47597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3938 00000100:00100000:1.0:1777051450.103267:0:47597:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da48748450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+36:2436:x1863365426056832:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1777051450.103290:0:47597:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1777051450.103312:0:47597:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce400/0x85f51a6b9671702a lrc: 5/0,0 mode: PR/PR res: [0x2000032e2:0x8:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b684f expref: 36 pid: 27882 timeout: 8179 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051450.103348:0:47597:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce400/0x85f51a6b9671702a lrc: 4/0,0 mode: PR/PR res: [0x2000032e2:0x8:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b684f expref: 36 pid: 27882 timeout: 8179 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051450.103402:0:47597:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0x8:0x0].0x0 (ffff99d94e52af00) 00010000:00010000:1.0:1777051450.103413:0:47597:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3a00/0x85f51a6b967170cb lrc: 3/0,1 mode: --/CW res: [0x2000032e2:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051450.103439:0:47597:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3a00/0x85f51a6b967170cb lrc: 3/0,1 mode: CW/CW res: [0x2000032e2:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051450.103454:0:47597:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3a00/0x85f51a6b967170cb lrc: 4/0,1 mode: CW/CW res: [0x2000032e2:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051450.103496:0:47597:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1777051450.103580:0:47597:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da48748450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+36:2436:x1863365426056832:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 328us (745us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051450.103644:0:47597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3938 00010000:00010000:3.0:1777051450.105689:0:6579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce400/0x85f51a6b9671702a lrc: 0/0,0 mode: --/PR res: [0x2000032e2:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b684f expref: 35 pid: 27882 timeout: 8179 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051450.106589:0:6579:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94c12a300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6579:1863365452667648:192.168.201.46@tcp:104: 00010000:00010000:3.0:1777051450.106668:0:6579:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3a00/0x85f51a6b967170cb lrc: 3/0,1 mode: CW/CW res: [0x2000032e2:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051450.106872:0:6579:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3a00/0x85f51a6b967170cb lrc: 3/0,1 mode: CW/CW res: [0x2000032e2:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051450.106903:0:6579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3a00/0x85f51a6b967170cb lrc: 3/0,1 mode: CW/CW res: [0x2000032e2:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051450.106958:0:6579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce800/0x85f51a6b967170d2 lrc: 3/0,1 mode: --/PW res: [0x2000032e2:0x8:0x0].0x71e3d71f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051450.106990:0:6579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce800/0x85f51a6b967170d2 lrc: 3/0,1 mode: PW/PW res: [0x2000032e2:0x8:0x0].0x71e3d71f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051450.107018:0:6579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce800/0x85f51a6b967170d2 lrc: 3/0,1 mode: PW/PW res: [0x2000032e2:0x8:0x0].0x71e3d71f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051450.107112:0:6579:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3a00/0x85f51a6b967170cb lrc: 4/0,1 mode: CW/CW res: [0x2000032e2:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051450.107128:0:6579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3a00/0x85f51a6b967170cb lrc: 4/0,1 mode: CW/CW res: [0x2000032e2:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051450.107153:0:6579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3a00/0x85f51a6b967170cb lrc: 3/0,0 mode: CW/CW res: [0x2000032e2:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051450.107699:0:6579:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3a00/0x85f51a6b967170cb lrc: 4/0,0 mode: CW/CW res: [0x2000032e2:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051450.107722:0:6579:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d9559a3a00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:1.0:1777051450.107729:0:6579:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3a00/0x85f51a6b967170cb lrc: 4/0,0 mode: CW/CW res: [0x2000032e2:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051450.107745:0:6579:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3a00/0x85f51a6b967170cb lrc: 5/0,0 mode: CW/CW res: [0x2000032e2:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051450.107776:0:6579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0x8:0x0].0x0 (ffff99d94e52af00) 00010000:00010000:1.0:1777051450.107783:0:6579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777051450.107791:0:6579:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3a00/0x85f51a6b967170cb lrc: 3/0,0 mode: --/CW res: [0x2000032e2:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051450.107814:0:6579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3a00/0x85f51a6b967170cb lrc: 0/0,0 mode: --/CW res: [0x2000032e2:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051450.107861:0:6579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce800/0x85f51a6b967170d2 lrc: 3/0,1 mode: PW/PW res: [0x2000032e2:0x8:0x0].0x71e3d71f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051450.107875:0:6579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce800/0x85f51a6b967170d2 lrc: 2/0,0 mode: PW/PW res: [0x2000032e2:0x8:0x0].0x71e3d71f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051450.107898:0:6579:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce800/0x85f51a6b967170d2 lrc: 3/0,0 mode: PW/PW res: [0x2000032e2:0x8:0x0].0x71e3d71f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051450.107910:0:6579:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da7d5ce800 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:1.0:1777051450.107930:0:6579:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce800/0x85f51a6b967170d2 lrc: 3/0,0 mode: PW/PW res: [0x2000032e2:0x8:0x0].0x71e3d71f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051450.107944:0:6579:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce800/0x85f51a6b967170d2 lrc: 4/0,0 mode: PW/PW res: [0x2000032e2:0x8:0x0].0x71e3d71f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051450.107971:0:6579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0x8:0x0].0x71e3d71f (ffff99d94e52ab00) 00010000:00010000:1.0:1777051450.107977:0:6579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777051450.107983:0:6579:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce800/0x85f51a6b967170d2 lrc: 2/0,0 mode: --/PW res: [0x2000032e2:0x8:0x0].0x71e3d71f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051450.108017:0:6579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce800/0x85f51a6b967170d2 lrc: 0/0,0 mode: --/PW res: [0x2000032e2:0x8:0x0].0x71e3d71f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051450.108179:0:6579:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955613480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+26:138760:x1863365426056704:12345-192.168.201.46@tcp:36:lhsmtool_posix.0 Request processed in 18302us (19092us total) trans 0 rc -2/-2 00000100:00100000:1.0:1777051450.108197:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112285 00000100:00100000:2.0:1777051450.116634:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051450.117175:0:10328:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426057088 00000100:00100000:3.0:1777051450.117188:0:10328:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426057088 00000100:00100000:3.0:1777051450.117296:0:10328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112286 00000100:00100000:3.0:1777051450.117321:0:10328:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955612300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+26:138760:x1863365426057088:12345-192.168.201.46@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1777051450.117590:0:10328:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff99d950705600/0x85f51a6b967170d9 lrc: 3/0,1 mode: --/CW res: [0x240000bd0:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051450.117646:0:10328:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff99d950705600/0x85f51a6b967170d9 lrc: 3/0,1 mode: --/CW res: [0x240000bd0:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051450.117670:0:10328:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff99d950705600/0x85f51a6b967170d9 lrc: 3/0,1 mode: --/CW res: [0x240000bd0:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051450.117713:0:10328:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94f42ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:10328:1863365452667776:0@lo:101:mdt00_004.0 00000100:00100000:0.0:1777051450.117801:0:10328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051450.117866:0:10328:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da5837ad80 going to sleep for 11 seconds 00000100:00100000:3.0:1777051450.120592:0:46500:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452667776 00000100:00100000:3.0:1777051450.120647:0:46500:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452667776 00000100:00100000:3.0:1777051450.121093:0:46500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8264 00000100:00100000:3.0:1777051450.121113:0:46500:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f42dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+6:10328:x1863365452667776:12345-0@lo:101:mdt00_004.0 00010000:00010000:3.0:1777051450.121139:0:46500:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777051450.121192:0:46500:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a3200/0x85f51a6b967170e0 lrc: 2/0,0 mode: --/CW res: [0x240000bd0:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x85f51a6b967170d9 expref: -99 pid: 46500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051450.121285:0:46500:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff99d950705400/0x85f51a6b9671701c lrc: 2/0,0 mode: PR/PR res: [0x240000bd0:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6848 expref: 55 pid: 46494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051450.121304:0:46500:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d5cfe00/0x85f51a6b967170a1 lrc: 2/0,0 mode: PR/PR res: [0x240000bd0:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6872 expref: 9 pid: 21368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051450.121326:0:46500:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a3200/0x85f51a6b967170e0 lrc: 5/0,0 mode: --/CW res: [0x240000bd0:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x85f51a6b967170d9 expref: 7 pid: 46500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051450.121438:0:46500:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d5cfe00/0x85f51a6b967170a1 lrc: 3/0,0 mode: PR/PR res: [0x240000bd0:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6872 expref: 9 pid: 21368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051450.121477:0:46500:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d5cfe00/0x85f51a6b967170a1 lrc: 4/0,0 mode: PR/PR res: [0x240000bd0:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6872 expref: 9 pid: 21368 timeout: 8179 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051450.121508:0:46500:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94c12a300 pname:cluuid:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001_UUID:46500:1863365452667904:192.168.201.46@tcp:104: 00010000:00010000:2.0:1777051450.121708:0:46500:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff99d950705400/0x85f51a6b9671701c lrc: 3/0,0 mode: PR/PR res: [0x240000bd0:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6848 expref: 55 pid: 46494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051450.121735:0:46500:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff99d950705400/0x85f51a6b9671701c lrc: 4/0,0 mode: PR/PR res: [0x240000bd0:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6848 expref: 55 pid: 46494 timeout: 8179 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051450.121764:0:46500:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955613800 pname:cluuid:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001_UUID:46500:1863365452668032:192.168.201.46@tcp:104: 00000100:00100000:2.0:1777051450.121828:0:46500:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d956bdae40 going to sleep for 11 seconds 00000100:00100000:2.0:1777051450.124855:0:46500:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94c12a300 pname:cluuid:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001_UUID:46500:1863365452667904:192.168.201.46@tcp:104: 00000100:00100000:2.0:1777051450.124923:0:46500:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955613800 pname:cluuid:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001_UUID:46500:1863365452668032:192.168.201.46@tcp:104: 00010000:00010000:2.0:1777051450.124976:0:46500:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a3200/0x85f51a6b967170e0 lrc: 3/0,0 mode: --/CW res: [0x240000bd0:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b967170d9 expref: 7 pid: 46500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051450.125004:0:46500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x3:0x0].0x0 (ffff99da42881600) 00010000:00010000:2.0:1777051450.125010:0:46500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777051450.125018:0:46500:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a3200/0x85f51a6b967170e0 lrc: 3/0,0 mode: --/CW res: [0x240000bd0:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b967170d9 expref: 7 pid: 46500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051450.125041:0:46500:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d9559a3200, rc 0) 00000100:00100000:2.0:1777051450.125156:0:46500:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f42dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+7:10328:x1863365452667776:12345-0@lo:101:mdt00_004.0 Request processed in 4033us (7350us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051450.125175:0:46500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8264 00000100:00100000:3.0:1777051450.125271:0:10328:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94f42ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:10328:1863365452667776:0@lo:101:mdt00_004.0 00010000:00010000:3.0:1777051450.125314:0:10328:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff99d950705600/0x85f51a6b967170d9 lrc: 4/0,1 mode: --/CW res: [0x240000bd0:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x85f51a6b967170e0 expref: -99 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051450.125337:0:10328:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0001-osp-MDT0000 lock: ffff99d950705600/0x85f51a6b967170d9 lrc: 4/0,1 mode: --/CW res: [0x240000bd0:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x85f51a6b967170e0 expref: -99 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051450.126676:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051450.126758:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051450.126813:0:6566:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426057216 00000100:00100000:3.0:1777051450.126828:0:6566:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426057216 00010000:00010000:3.0:1777051450.126884:0:6566:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d950705400/0x85f51a6b9671701c lrc: 4/0,0 mode: PR/PR res: [0x240000bd0:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6848 expref: 56 pid: 46494 timeout: 8179 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051450.127014:0:6565:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426057344 00000100:00100000:0.0:1777051450.127024:0:6565:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426057344 00010000:00010000:0.0:1777051450.127062:0:6565:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d5cfe00/0x85f51a6b967170a1 lrc: 4/0,0 mode: PR/PR res: [0x240000bd0:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6872 expref: 10 pid: 21368 timeout: 8179 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051450.127138:0:6565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3939 00000100:00100000:0.0:1777051450.127156:0:6565:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955610700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+10:2439:x1863365426057344:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1777051450.127182:0:6565:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777051450.127193:0:6565:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d5cfe00/0x85f51a6b967170a1 lrc: 4/0,0 mode: PR/PR res: [0x240000bd0:0x3:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6872 expref: 10 pid: 21368 timeout: 8179 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051450.127221:0:6565:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d5cfe00/0x85f51a6b967170a1 lrc: 3/0,0 mode: PR/PR res: [0x240000bd0:0x3:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6872 expref: 10 pid: 21368 timeout: 8179 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051450.127259:0:6565:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d5cfe00/0x85f51a6b967170a1 lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x3:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6872 expref: 10 pid: 21368 timeout: 8179 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051450.127283:0:6565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x3:0x0].0x0 (ffff99da42881600) 00010000:00010000:0.0:1777051450.127298:0:6565:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a3200/0x85f51a6b967170e0 lrc: 2/0,0 mode: --/CW res: [0x240000bd0:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b967170d9 expref: 6 pid: 46500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051450.127316:0:6565:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1777051450.127382:0:6565:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955610700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+9:2439:x1863365426057344:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 225us (618us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051450.127397:0:6565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3939 00000100:00100000:0.0:1777051450.127947:0:24467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3940 00000100:00100000:0.0:1777051450.127974:0:24467:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955613800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+56:2437:x1863365426057216:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1777051450.127994:0:24467:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777051450.128010:0:24467:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff99d950705400/0x85f51a6b9671701c lrc: 4/0,0 mode: PR/PR res: [0x240000bd0:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6848 expref: 56 pid: 46494 timeout: 8179 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051450.128032:0:24467:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff99d950705400/0x85f51a6b9671701c lrc: 3/0,0 mode: PR/PR res: [0x240000bd0:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6848 expref: 56 pid: 46494 timeout: 8179 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051450.128063:0:24467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d950705400/0x85f51a6b9671701c lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6848 expref: 56 pid: 46494 timeout: 8179 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051450.128089:0:24467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x3:0x0].0x0 (ffff99da42881600) 00010000:00010000:0.0:1777051450.128099:0:24467:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a3200/0x85f51a6b967170e0 lrc: 2/0,0 mode: --/CW res: [0x240000bd0:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b967170d9 expref: 6 pid: 46500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051450.128120:0:24467:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a3200/0x85f51a6b967170e0 lrc: 2/0,0 mode: CW/CW res: [0x240000bd0:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x85f51a6b967170d9 expref: 6 pid: 46500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051450.128144:0:24467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a3200/0x85f51a6b967170e0 lrc: 3/0,0 mode: CW/CW res: [0x240000bd0:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x85f51a6b967170d9 expref: 6 pid: 46500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051450.129040:0:24467:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a3200/0x85f51a6b967170e0 lrc: 3/0,0 mode: CW/CW res: [0x240000bd0:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b967170d9 expref: 6 pid: 46500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051450.129071:0:24467:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94ed2f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001_UUID:24467:1863365452668160:0@lo:105: 00000100:00100000:0.0:1777051450.129508:0:24467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051450.129565:0:24467:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da5837af00 going to sleep for 11 seconds 00000100:00100000:2.0:1777051450.129644:0:6563:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452668160 00000100:00100000:2.0:1777051450.129662:0:6563:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452668160 00000100:00100000:2.0:1777051450.129763:0:6563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1777051450.129787:0:6563:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94ed2df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-mdtlov_UUID+4:24467:x1863365452668160:12345-0@lo:105: 00010000:00010000:2.0:1777051450.129809:0:6563:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff99d950705600/0x85f51a6b967170d9 lrc: 5/0,1 mode: --/CW res: [0x240000bd0:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x85f51a6b967170e0 expref: -99 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051450.129836:0:6563:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0001-osp-MDT0000 lock: ffff99d950705600/0x85f51a6b967170d9 lrc: 5/0,1 mode: --/CW res: [0x240000bd0:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x85f51a6b967170e0 expref: -99 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051450.129855:0:6563:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0001-osp-MDT0000 lock: ffff99d950705600/0x85f51a6b967170d9 lrc: 5/0,1 mode: --/CW res: [0x240000bd0:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x85f51a6b967170e0 expref: -99 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051450.129877:0:6563:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0001-osp-MDT0000 lock: ffff99d950705600/0x85f51a6b967170d9 lrc: 5/0,1 mode: CW/CW res: [0x240000bd0:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x85f51a6b967170e0 expref: -99 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051450.129908:0:6563:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff99d950705600/0x85f51a6b967170d9 lrc: 6/0,1 mode: CW/CW res: [0x240000bd0:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x85f51a6b967170e0 expref: -99 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051450.129929:0:6563:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0001-osp-MDT0000 lock: ffff99d950705600/0x85f51a6b967170d9 lrc: 6/0,1 mode: CW/CW res: [0x240000bd0:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x85f51a6b967170e0 expref: -99 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051450.130010:0:6563:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff99d950705600) 00010000:00010000:0.0:1777051450.130057:0:10328:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0001-osp-MDT0000 lock: ffff99d950705600/0x85f51a6b967170d9 lrc: 4/0,1 mode: CW/CW res: [0x240000bd0:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x85f51a6b967170e0 expref: -99 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051450.130078:0:10328:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff99d950705600/0x85f51a6b967170d9 lrc: 4/0,1 mode: CW/CW res: [0x240000bd0:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x85f51a6b967170e0 expref: -99 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051450.130124:0:6563:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94ed2df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-mdtlov_UUID+4:24467:x1863365452668160:12345-0@lo:105: Request processed in 337us (613us total) trans 0 rc 0/0 00000004:00080000:0.0:1777051450.130132:0:10328:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000bd0:0x3:0x0] 00000100:00100000:2.0:1777051450.130146:0:6563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00010000:00010000:0.0:1777051450.130196:0:10328:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff99d950705a00/0x85f51a6b967170e7 lrc: 3/0,1 mode: --/PW res: [0x240000bd0:0x3:0x0].0x71e3d71f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051450.130220:0:10328:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff99d950705a00/0x85f51a6b967170e7 lrc: 3/0,1 mode: --/PW res: [0x240000bd0:0x3:0x0].0x71e3d71f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051450.130237:0:10328:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff99d950705a00/0x85f51a6b967170e7 lrc: 3/0,1 mode: --/PW res: [0x240000bd0:0x3:0x0].0x71e3d71f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051450.130275:0:10328:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94ed2fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:10328:1863365452668288:0@lo:101:mdt00_004.0 00000100:00100000:0.0:1777051450.130334:0:10328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051450.130382:0:10328:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da5837ae40 going to sleep for 11 seconds 00000100:00100000:0.0:1777051450.130457:0:47208:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452668288 00000100:00100000:0.0:1777051450.130471:0:47208:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452668288 00000100:00100000:0.0:1777051450.130528:0:47208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8265 00000100:00100000:0.0:1777051450.130542:0:47208:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94ed2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+7:10328:x1863365452668288:12345-0@lo:101:mdt00_004.0 00010000:00010000:0.0:1777051450.130569:0:47208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1777051450.130588:0:24467:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94ed2f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001_UUID:24467:1863365452668160:0@lo:105: 00010000:00010000:2.0:1777051450.130647:0:24467:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1777051450.130683:0:47208:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d950705000/0x85f51a6b967170ee lrc: 2/0,0 mode: --/PW res: [0x240000bd0:0x3:0x0].0x71e3d71f bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x85f51a6b967170e7 expref: -99 pid: 47208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051450.130714:0:24467:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955613800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+55:2437:x1863365426057216:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 2752us (4041us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051450.130726:0:24467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3940 00010000:00010000:0.0:1777051450.130732:0:47208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d950705000/0x85f51a6b967170ee lrc: 3/0,0 mode: PW/PW res: [0x240000bd0:0x3:0x0].0x71e3d71f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x85f51a6b967170e7 expref: 8 pid: 47208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051450.130765:0:47208:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99d950705000/0x85f51a6b967170ee lrc: 3/0,0 mode: PW/PW res: [0x240000bd0:0x3:0x0].0x71e3d71f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b967170e7 expref: 8 pid: 47208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051450.130782:0:47208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x3:0x0].0x71e3d71f (ffff99da42881c00) 00010000:00010000:0.0:1777051450.130788:0:47208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777051450.130798:0:47208:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d950705000, rc 0) 00000100:00100000:0.0:1777051450.130887:0:47208:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94ed2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+8:10328:x1863365452668288:12345-0@lo:101:mdt00_004.0 Request processed in 347us (552us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051450.130901:0:47208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8265 00000100:00100000:2.0:1777051450.130960:0:10328:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94ed2fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:10328:1863365452668288:0@lo:101:mdt00_004.0 00010000:00010000:2.0:1777051450.131373:0:10328:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff99d950705a00/0x85f51a6b967170e7 lrc: 4/0,1 mode: PW/PW res: [0x240000bd0:0x3:0x0].0x71e3d71f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x85f51a6b967170ee expref: -99 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051450.131404:0:10328:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff99d950705a00/0x85f51a6b967170e7 lrc: 4/0,1 mode: PW/PW res: [0x240000bd0:0x3:0x0].0x71e3d71f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x85f51a6b967170ee expref: -99 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1777051450.131438:0:10328:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000bd0:0x3:0x0] 00000100:00100000:2.0:1777051450.131513:0:10328:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955611c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:10328:1863365452668416:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1777051450.131677:0:10328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051450.131732:0:10328:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da6fc653c0 going to sleep for 11 seconds 00000100:00100000:0.0:1777051450.131803:0:6585:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452668416 00000100:00100000:0.0:1777051450.131815:0:6585:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452668416 00000100:00100000:0.0:1777051450.131930:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8266 00000100:00100000:0.0:1777051450.131955:0:6585:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d944070380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:10328:x1863365452668416:12345-0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1777051450.132105:0:6585:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d944070380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:10328:x1863365452668416:12345-0@lo:1000:mdt00_004.0 Request processed in 159us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051450.132125:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8266 00000100:00100000:2.0:1777051450.132387:0:10328:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955611c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:10328:1863365452668416:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1777051450.132495:0:10328:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d944071500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:10328:1863365452668544:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1777051450.132556:0:10328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051450.132651:0:10328:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d944a9f000 going to sleep for 11 seconds 00000100:00100000:0.0:1777051450.133002:0:46498:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452668544 00000100:00100000:0.0:1777051450.133014:0:46498:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452668544 00000100:00100000:0.0:1777051450.133099:0:46498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8267 00000100:00100000:0.0:1777051450.133119:0:46498:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d944073800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+8:10328:x1863365452668544:12345-0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1777051450.133323:0:10328:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d944071500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:10328:1863365452668544:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1777051450.133426:0:10328:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d944071500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:10328:1863365452668672:0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1777051450.133711:0:46498:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d944073800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+8:10328:x1863365452668544:12345-0@lo:1000:mdt00_004.0 Request processed in 596us (1150us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051450.133728:0:46498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8267 00000100:00100000:2.0:1777051450.133744:0:10328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051450.134163:0:10328:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d944a9f000 going to sleep for 11 seconds 00000100:00100000:0.0:1777051450.134180:0:46498:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452668672 00000100:00100000:0.0:1777051450.134196:0:46498:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452668672 00000100:00100000:0.0:1777051450.134361:0:46498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8268 00000100:00100000:0.0:1777051450.134380:0:46498:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d944073480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+8:10328:x1863365452668672:12345-0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1777051450.134544:0:46498:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d944073480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+8:10328:x1863365452668672:12345-0@lo:1000:mdt00_004.0 Request processed in 167us (804us total) trans 0 rc -2/-2 00000100:00100000:0.0:1777051450.134560:0:46498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8268 00000100:00100000:3.0:1777051450.134997:0:10328:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d944071500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:10328:1863365452668672:0@lo:1000:mdt00_004.0 00000004:00080000:3.0:1777051450.135044:0:10328:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000bd0:0x3:0x0] 00010000:00010000:3.0:1777051450.135059:0:10328:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff99d950705600/0x85f51a6b967170d9 lrc: 4/0,1 mode: CW/CW res: [0x240000bd0:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x85f51a6b967170e0 expref: -99 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051450.135085:0:10328:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff99d950705600/0x85f51a6b967170d9 lrc: 4/0,1 mode: CW/CW res: [0x240000bd0:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x85f51a6b967170e0 expref: -99 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051450.135103:0:10328:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff99d950705600/0x85f51a6b967170d9 lrc: 3/0,0 mode: CW/CW res: [0x240000bd0:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x85f51a6b967170e0 expref: -99 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051450.135563:0:10328:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:3.0:1777051450.135584:0:10328:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000bd0:0x3:0x0] 00010000:00010000:3.0:1777051450.135626:0:10328:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff99d950705a00/0x85f51a6b967170e7 lrc: 4/0,1 mode: PW/PW res: [0x240000bd0:0x3:0x0].0x71e3d71f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x85f51a6b967170ee expref: -99 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051450.135644:0:10328:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff99d950705a00/0x85f51a6b967170e7 lrc: 4/0,1 mode: PW/PW res: [0x240000bd0:0x3:0x0].0x71e3d71f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x85f51a6b967170ee expref: -99 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051450.135663:0:10328:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff99d950705a00/0x85f51a6b967170e7 lrc: 3/0,0 mode: PW/PW res: [0x240000bd0:0x3:0x0].0x71e3d71f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x85f51a6b967170ee expref: -99 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051450.135706:0:10328:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:3.0:1777051450.136169:0:10328:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955612300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+26:138760:x1863365426057088:12345-192.168.201.46@tcp:36:lhsmtool_posix.0 Request processed in 18856us (19579us total) trans 0 rc -2/-2 00000100:00100000:3.0:1777051450.136186:0:10328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112286 00010000:00010000:0.0:1777051450.136396:0:6568:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1777051450.136411:0:6568:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff99d950705600/0x85f51a6b967170d9 lrc: 2/0,0 mode: CW/CW res: [0x240000bd0:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x85f51a6b967170e0 expref: -99 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051450.136437:0:6568:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d950705600 already unused, calling callback (ffffffffc177eed0) 00010000:00010000:0.0:1777051450.136448:0:6568:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff99d950705600/0x85f51a6b967170d9 lrc: 3/0,0 mode: CW/CW res: [0x240000bd0:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x85f51a6b967170e0 expref: -99 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1777051450.136468:0:6568:0:(mdt_handler.c:3963:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff99d950705600/0x85f51a6b967170d9 lrc: 3/0,0 mode: CW/CW res: [0x240000bd0:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x85f51a6b967170e0 expref: -99 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051450.136499:0:38719:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777051450.136513:0:38719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff99d950705a00/0x85f51a6b967170e7 lrc: 2/0,0 mode: PW/PW res: [0x240000bd0:0x3:0x0].0x71e3d71f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x85f51a6b967170ee expref: -99 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051450.136530:0:6568:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff99d950705600/0x85f51a6b967170d9 lrc: 2/0,0 mode: --/CW res: [0x240000bd0:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x85f51a6b967170e0 expref: -99 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051450.136542:0:38719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d950705a00 already unused, calling callback (ffffffffc177eed0) 00010000:00010000:3.0:1777051450.136557:0:38719:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff99d950705a00/0x85f51a6b967170e7 lrc: 3/0,0 mode: PW/PW res: [0x240000bd0:0x3:0x0].0x71e3d71f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x85f51a6b967170ee expref: -99 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051450.136571:0:6568:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00000004:00010000:3.0:1777051450.136630:0:38719:0:(mdt_handler.c:3963:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff99d950705a00/0x85f51a6b967170e7 lrc: 3/0,0 mode: PW/PW res: [0x240000bd0:0x3:0x0].0x71e3d71f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x85f51a6b967170ee expref: -99 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051450.136657:0:6568:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff99d950705600/0x85f51a6b967170d9 lrc: 1/0,0 mode: --/CW res: [0x240000bd0:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x85f51a6b967170e0 expref: -99 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051450.136694:0:6568:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff99d950705600/0x85f51a6b967170d9 lrc: 0/0,0 mode: --/CW res: [0x240000bd0:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x85f51a6b967170e0 expref: -99 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051450.136698:0:38719:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff99d950705a00/0x85f51a6b967170e7 lrc: 2/0,0 mode: --/PW res: [0x240000bd0:0x3:0x0].0x71e3d71f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x85f51a6b967170ee expref: -99 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051450.136727:0:38719:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1777051450.136744:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777051450.136751:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777051450.136756:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051450.136771:0:38719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff99d950705a00/0x85f51a6b967170e7 lrc: 1/0,0 mode: --/PW res: [0x240000bd0:0x3:0x0].0x71e3d71f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x85f51a6b967170ee expref: -99 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051450.136788:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94ed2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3678:1863365452668800:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1777051450.137156:0:38719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff99d950705a00/0x85f51a6b967170e7 lrc: 0/0,0 mode: --/PW res: [0x240000bd0:0x3:0x0].0x71e3d71f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x85f51a6b967170ee expref: -99 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051450.137262:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051450.137268:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051450.137279:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777051450.137303:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94c128a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452668928:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1777051450.137317:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051450.137391:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051450.137440:0:9550:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452668800 00000100:00100000:0.0:1777051450.137452:0:9550:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452668800 00000100:00100000:0.0:1777051450.137536:0:9550:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452668928 00000100:00100000:0.0:1777051450.137545:0:9550:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452668928 00000100:00100000:0.0:1777051450.137639:0:9550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13724 00000100:00100000:0.0:1777051450.137661:0:9550:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94ed2c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000-mdtlov_UUID+9:3678:x1863365452668800:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1777051450.137679:0:9550:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777051450.137710:0:9550:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a3200/0x85f51a6b967170e0 lrc: 0/0,0 mode: --/CW res: [0x240000bd0:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x85f51a6b967170d9 expref: 9 pid: 46500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051450.137739:0:9550:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x3:0x0].0x0 (ffff99da42881600) 00010000:00010000:0.0:1777051450.137754:0:9550:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1777051450.137822:0:9550:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94ed2c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000-mdtlov_UUID+8:3678:x1863365452668800:12345-0@lo:103:ldlm_bl.0 Request processed in 163us (514us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051450.137837:0:9550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13724 00000100:00100000:0.0:1777051450.137871:0:9550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13725 00000100:00100000:0.0:1777051450.137884:0:9550:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94c12bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000-mdtlov_UUID+7:3679:x1863365452668928:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1777051450.137911:0:9550:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777051450.137937:0:9550:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d950705000/0x85f51a6b967170ee lrc: 0/0,0 mode: --/PW res: [0x240000bd0:0x3:0x0].0x71e3d71f bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x85f51a6b967170e7 expref: 7 pid: 47208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051450.137959:0:9550:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x3:0x0].0x71e3d71f (ffff99da42881c00) 00010000:00010000:0.0:1777051450.137972:0:9550:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1777051450.138035:0:9550:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94c12bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000-mdtlov_UUID+6:3679:x1863365452668928:12345-0@lo:103:ldlm_bl.0 Request processed in 152us (647us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051450.138049:0:9550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13725 00000100:00100000:0.0:1777051450.138115:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94c128a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452668928:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1777051450.138241:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94ed2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3678:1863365452668800:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1777051450.143301:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051450.143400:0:46497:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426057472 00000100:00100000:1.0:1777051450.143412:0:46497:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426057472 00000100:00100000:1.0:1777051450.143503:0:46497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112287 00000100:00100000:1.0:1777051450.143530:0:46497:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d944071f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:c11b6966-0775-44d2-bdc6-c74c26eb2226+26:138760:x1863365426057472:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1777051450.143555:0:46497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777051450.143581:0:46497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce800/0x85f51a6b967170f5 lrc: 2/0,0 mode: --/PR res: [0x2000032e3:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6887 expref: -99 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051450.143680:0:46497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cee00/0x85f51a6b967170fc lrc: 3/1,0 mode: --/PR res: [0x2000032e3:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051450.143697:0:46497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cee00/0x85f51a6b967170fc lrc: 3/1,0 mode: PR/PR res: [0x2000032e3:0xa:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051450.143726:0:46497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cee00/0x85f51a6b967170fc lrc: 3/1,0 mode: PR/PR res: [0x2000032e3:0xa:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051450.143908:0:46497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce800/0x85f51a6b967170f5 lrc: 0/0,0 mode: --/PR res: [0x2000032e3:0xa:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6887 expref: 28 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051450.143940:0:46497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cee00/0x85f51a6b967170fc lrc: 3/0,0 mode: PR/PR res: [0x2000032e3:0xa:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6887 expref: 27 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051450.143952:0:46497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e3:0xa:0x0].0x0 (ffff99d94e52ab00) 00010000:00010000:1.0:1777051450.143956:0:46497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1777051450.143960:0:46497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99da7d5cee00, rc 0) 00000100:00100000:1.0:1777051450.144040:0:46497:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d944071f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:c11b6966-0775-44d2-bdc6-c74c26eb2226+27:138760:x1863365426057472:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 Request processed in 517us (747us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051450.144059:0:46497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112287 00000100:00100000:0.0:1777051450.147575:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051450.147886:0:6581:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426057728 00000100:00100000:2.0:1777051450.147900:0:6581:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426057728 00000100:00100000:2.0:1777051450.147977:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112288 00000100:00100000:2.0:1777051450.148009:0:6581:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94ed2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+27:138760:x1863365426057728:12345-192.168.201.46@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1777051450.149052:0:6581:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710e00/0x85f51a6b96717103 lrc: 3/0,1 mode: --/PW res: [0x2000032e3:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051450.149086:0:6581:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710e00/0x85f51a6b96717103 lrc: 3/0,1 mode: PW/PW res: [0x2000032e3:0xa:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051450.149107:0:6581:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710e00/0x85f51a6b96717103 lrc: 3/0,1 mode: PW/PW res: [0x2000032e3:0xa:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1777051450.149386:0:6581:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000e8185c5d reply state 0000000087e31f59 transno 30064771217 ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710e00/0x85f51a6b96717103 lrc: 3/0,1 mode: PW/PW res: [0x2000032e3:0xa:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051450.149457:0:6581:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710e00/0x85f51a6b96717103 lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e3:0xa:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051450.149485:0:6581:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e3:0xa:0x0].0x0 (ffff99d94e52ab00) 00010000:00010000:2.0:1777051450.149496:0:6581:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1777051450.149503:0:6581:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1777051450.149677:0:6581:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94ed2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+29:138760:x1863365426057728:12345-192.168.201.46@tcp:36:lhsmtool_posix.0 Request processed in 1685us (2108us total) trans 30064771217 rc 0/0 00000100:00100000:2.0:1777051450.149692:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112288 00000100:00100000:1.0:1777051450.153781:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051450.153886:0:46494:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426057856 00000100:00100000:2.0:1777051450.153898:0:46494:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426057856 00000100:00100000:2.0:1777051450.153978:0:46494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112289 00000100:00100000:2.0:1777051450.153998:0:46494:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fd61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c11b6966-0775-44d2-bdc6-c74c26eb2226+29:138760:x1863365426057856:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1777051450.154027:0:46494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051450.154051:0:46494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d950711600/0x85f51a6b9671710a lrc: 2/0,0 mode: --/CR res: [0x2000032e3:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b688e expref: -99 pid: 46494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051450.154117:0:46494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d950711600/0x85f51a6b9671710a lrc: 3/0,0 mode: CR/CR res: [0x2000032e3:0xa:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b688e expref: 30 pid: 46494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051450.154144:0:46494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950711600/0x85f51a6b9671710a lrc: 3/0,0 mode: CR/CR res: [0x2000032e3:0xa:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b688e expref: 30 pid: 46494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051450.154159:0:46494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e3:0xa:0x0].0x0 (ffff99d94e52ab00) 00010000:00010000:2.0:1777051450.154165:0:46494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1777051450.154171:0:46494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d950711600, rc 0) 00000100:00100000:2.0:1777051450.154281:0:46494:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fd61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c11b6966-0775-44d2-bdc6-c74c26eb2226+30:138760:x1863365426057856:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 Request processed in 250us (466us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051450.154301:0:46494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112289 00000100:00100000:3.0:1777051450.158032:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051450.159110:0:6582:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426057984 00000100:00100000:2.0:1777051450.159122:0:6582:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426057984 00000100:00100000:2.0:1777051450.159229:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3407 00000100:00100000:2.0:1777051450.159268:0:6582:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94c12b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+30:138760:x1863365426057984:12345-192.168.201.46@tcp:49:lhsmtool_posix.0 00000100:00100000:2.0:1777051450.159414:0:6582:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94c12b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+30:138760:x1863365426057984:12345-192.168.201.46@tcp:49:lhsmtool_posix.0 Request processed in 150us (1383us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051450.159431:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3407 00000100:00100000:0.0:1777051450.168478:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051450.168562:0:24269:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426058240 00000100:00100000:2.0:1777051450.168576:0:24269:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426058240 00000100:00100000:2.0:1777051450.168699:0:24269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3408 00000100:00100000:2.0:1777051450.168719:0:24269:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da6ff00050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+30:138760:x1863365426058240:12345-192.168.201.46@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1777051450.169070:0:24269:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da6ff00050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+31:138760:x1863365426058240:12345-192.168.201.46@tcp:35:lhsmtool_posix.0 Request processed in 352us (597us total) trans 30064771218 rc 0/0 00000100:00100000:2.0:1777051450.169088:0:24269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3408 00000100:00100000:0.0:1777051450.176068:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051450.176233:0:27882:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426058496 00000100:00100000:2.0:1777051450.176245:0:27882:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426058496 00000100:00100000:2.0:1777051450.176339:0:27882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112290 00000100:00100000:2.0:1777051450.176359:0:27882:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94ed2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+31:138760:x1863365426058496:12345-192.168.201.46@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1777051450.176527:0:27882:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94ed2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+31:138760:x1863365426058496:12345-192.168.201.46@tcp:57:lhsmtool_posix.0 Request processed in 163us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051450.176544:0:27882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112290 00000100:00100000:3.0:1777051450.182236:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051450.182388:0:21368:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426058752 00000100:00100000:2.0:1777051450.182401:0:21368:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426058752 00000100:00100000:2.0:1777051450.182475:0:21368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112291 00000100:00100000:2.0:1777051450.182493:0:21368:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94c12b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+31:138760:x1863365426058752:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1777051450.182523:0:21368:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051450.182557:0:21368:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d950711e00/0x85f51a6b96717111 lrc: 2/0,0 mode: --/CR res: [0x2000032e3:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6895 expref: -99 pid: 21368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051450.183078:0:21368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710200/0x85f51a6b96717118 lrc: 3/0,1 mode: --/EX res: [0x2000032e3:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051450.183110:0:21368:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99d950711600/0x85f51a6b9671710a lrc: 2/0,0 mode: CR/CR res: [0x2000032e3:0xa:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b688e expref: 32 pid: 46494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051450.183487:0:21368:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710200/0x85f51a6b96717118 lrc: 4/0,1 mode: --/EX res: [0x2000032e3:0xa:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051450.183548:0:21368:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99d950711600/0x85f51a6b9671710a lrc: 3/0,0 mode: CR/CR res: [0x2000032e3:0xa:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b688e expref: 32 pid: 46494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051450.183576:0:21368:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950711600/0x85f51a6b9671710a lrc: 4/0,0 mode: CR/CR res: [0x2000032e3:0xa:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b688e expref: 32 pid: 46494 timeout: 8179 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051450.183640:0:21368:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d944072d80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:21368:1863365452669056:192.168.201.46@tcp:104: 00000100:00100000:2.0:1777051450.184119:0:21368:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d944a9f0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1777051450.188050:0:21368:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d944072d80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:21368:1863365452669056:192.168.201.46@tcp:104: 00010000:00010000:1.0:1777051450.188107:0:21368:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710200/0x85f51a6b96717118 lrc: 3/0,1 mode: --/EX res: [0x2000032e3:0xa:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051450.189105:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051450.189805:0:6564:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426058880 00000100:00100000:3.0:1777051450.189817:0:6564:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426058880 00010000:00010000:3.0:1777051450.189861:0:6564:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d950711600/0x85f51a6b9671710a lrc: 4/0,0 mode: CR/CR res: [0x2000032e3:0xa:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b688e expref: 33 pid: 46494 timeout: 8179 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051450.189934:0:6564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3941 00000100:00100000:3.0:1777051450.189952:0:6564:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d944070000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+33:2436:x1863365426058880:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1777051450.189974:0:6564:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777051450.189986:0:6564:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99d950711600/0x85f51a6b9671710a lrc: 4/0,0 mode: CR/CR res: [0x2000032e3:0xa:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b688e expref: 33 pid: 46494 timeout: 8179 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051450.190008:0:6564:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99d950711600/0x85f51a6b9671710a lrc: 3/0,0 mode: CR/CR res: [0x2000032e3:0xa:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b688e expref: 33 pid: 46494 timeout: 8179 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051450.190042:0:6564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d950711600/0x85f51a6b9671710a lrc: 0/0,0 mode: --/CR res: [0x2000032e3:0xa:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b688e expref: 33 pid: 46494 timeout: 8179 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051450.190066:0:6564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e3:0xa:0x0].0x0 (ffff99d94e52ab00) 00010000:00010000:3.0:1777051450.190074:0:6564:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710200/0x85f51a6b96717118 lrc: 3/0,1 mode: --/EX res: [0x2000032e3:0xa:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051450.190090:0:6564:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710200/0x85f51a6b96717118 lrc: 3/0,1 mode: EX/EX res: [0x2000032e3:0xa:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051450.190103:0:6564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710200/0x85f51a6b96717118 lrc: 4/0,1 mode: EX/EX res: [0x2000032e3:0xa:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051450.190162:0:6564:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1777051450.190566:0:21368:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710200/0x85f51a6b96717118 lrc: 3/0,1 mode: EX/EX res: [0x2000032e3:0xa:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051450.190582:0:6564:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d944070000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+32:2436:x1863365426058880:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 631us (1475us total) trans 0 rc 0/0 00010000:00010000:2.0:1777051450.190590:0:21368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710200/0x85f51a6b96717118 lrc: 3/0,1 mode: EX/EX res: [0x2000032e3:0xa:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051450.190640:0:6564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3941 00000004:00200000:2.0:1777051450.190655:0:21368:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000032e3:0xa:0x0]: returning size 0 00000004:00080000:2.0:1777051450.190889:0:21368:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x1e5:0x0], index 1: 0 00010000:00010000:2.0:1777051450.191034:0:21368:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710200/0x85f51a6b96717118 lrc: 3/0,1 mode: EX/EX res: [0x2000032e3:0xa:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051450.191052:0:21368:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710200/0x85f51a6b96717118 lrc: 2/0,0 mode: EX/EX res: [0x2000032e3:0xa:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051450.191066:0:21368:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710200/0x85f51a6b96717118 lrc: 3/0,0 mode: EX/EX res: [0x2000032e3:0xa:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051450.191079:0:21368:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d950710200 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:2.0:1777051450.191086:0:21368:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710200/0x85f51a6b96717118 lrc: 3/0,0 mode: EX/EX res: [0x2000032e3:0xa:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051450.191100:0:21368:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710200/0x85f51a6b96717118 lrc: 4/0,0 mode: EX/EX res: [0x2000032e3:0xa:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051450.191121:0:21368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e3:0xa:0x0].0x0 (ffff99d94e52ab00) 00010000:00010000:2.0:1777051450.191128:0:21368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1777051450.191134:0:21368:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710200/0x85f51a6b96717118 lrc: 2/0,0 mode: --/EX res: [0x2000032e3:0xa:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051450.191146:0:21368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710200/0x85f51a6b96717118 lrc: 0/0,0 mode: --/EX res: [0x2000032e3:0xa:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051450.191246:0:21368:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950711e00/0x85f51a6b96717111 lrc: 1/0,0 mode: --/CR res: [0x2000032e3:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6895 expref: 32 pid: 21368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051450.191269:0:21368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e3:0xa:0x0].0x0 (ffff99d94e52ab00) 00010000:00010000:2.0:1777051450.191276:0:21368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1777051450.191286:0:21368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d950711e00/0x85f51a6b96717111 lrc: 0/0,0 mode: --/CR res: [0x2000032e3:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6895 expref: 32 pid: 21368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051450.191318:0:21368:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d950711e00, rc 0) 00000100:00100000:2.0:1777051450.191391:0:21368:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94c12b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+31:138760:x1863365426058752:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 Request processed in 8901us (9192us total) trans 30064771219 rc 301/301 00000100:00100000:2.0:1777051450.191406:0:21368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112291 00000100:00100000:2.0:1777051450.195032:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051450.195120:0:46501:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426059136 00000100:00100000:3.0:1777051450.195129:0:46501:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426059136 00000100:00100000:3.0:1777051450.195186:0:46501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3409 00000100:00100000:3.0:1777051450.195200:0:46501:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d944071180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+31:138760:x1863365426059136:12345-192.168.201.46@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1777051450.195585:0:46501:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d944071180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+32:138760:x1863365426059136:12345-192.168.201.46@tcp:35:lhsmtool_posix.0 Request processed in 384us (553us total) trans 30064771220 rc 0/0 00000100:00100000:3.0:1777051450.195635:0:46501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3409 00000100:00100000:2.0:1777051450.199834:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051450.200332:0:6580:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426059264 00000100:00100000:0.0:1777051450.200342:0:6580:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426059264 00000100:00100000:0.0:1777051450.200435:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112292 00000100:00100000:0.0:1777051450.200454:0:6580:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d944070e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+32:138760:x1863365426059264:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1777051450.200487:0:6580:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051450.200516:0:6580:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d950704800/0x85f51a6b96717126 lrc: 2/0,0 mode: --/CR res: [0x2000032e3:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b689c expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051450.200732:0:6580:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950705c00/0x85f51a6b9671712d lrc: 3/1,0 mode: --/PR res: [0x2000032e3:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051450.201054:0:6580:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d950705c00/0x85f51a6b9671712d lrc: 3/1,0 mode: PR/PR res: [0x2000032e3:0xa:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051450.201078:0:6580:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d950705c00/0x85f51a6b9671712d lrc: 3/1,0 mode: PR/PR res: [0x2000032e3:0xa:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1777051450.201132:0:6580:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000032e3:0xa:0x0]: returning size 0 00000004:00200000:0.0:1777051450.201139:0:6580:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1777051450.201165:0:6580:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99d950705c00/0x85f51a6b9671712d lrc: 3/1,0 mode: PR/PR res: [0x2000032e3:0xa:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051450.201210:0:6580:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d950704800/0x85f51a6b96717126 lrc: 0/0,0 mode: --/CR res: [0x2000032e3:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b689c expref: 34 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051450.201242:0:6580:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950705c00/0x85f51a6b9671712d lrc: 3/0,0 mode: PR/PR res: [0x2000032e3:0xa:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b689c expref: 33 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051450.201255:0:6580:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e3:0xa:0x0].0x0 (ffff99d94e52ab00) 00010000:00010000:0.0:1777051450.201259:0:6580:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1777051450.201263:0:6580:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d950705c00, rc 0) 00000100:00100000:0.0:1777051450.201386:0:6580:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d944070e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+33:138760:x1863365426059264:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 Request processed in 936us (1559us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051450.201404:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112292 00000100:00100000:0.0:1777051450.204967:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051450.205061:0:8471:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426059392 00000100:00100000:1.0:1777051450.205354:0:8471:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426059392 00000100:00080000:0.0:1777051450.205476:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1777051450.205505:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 8073 00000100:00100000:1.0:1777051450.205526:0:8471:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94ed2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+48:2436:x1863365426059392:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1777051450.205547:0:8471:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777051450.205571:0:8471:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000019569fc6/0x85f51a6b96717134 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b68a3 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1777051450.205660:0:8471:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x1e5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777051450.205687:0:8471:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051450.205691:0:8471:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051450.205704:0:8471:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000019569fc6/0x85f51a6b96717134 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b68a3 expref: 49 pid: 8471 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051450.206053:0:8471:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000019569fc6/0x85f51a6b96717134 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b68a3 expref: 49 pid: 8471 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051450.206076:0:8471:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99da7d5ce800, rc 0) 00000100:00100000:1.0:1777051450.206961:0:8471:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94ed2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+49:2436:x1863365426059392:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 Request processed in 1440us (1996us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051450.206975:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 8073 00000100:00100000:3.0:1777051450.212504:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051450.212715:0:8492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426059648 00000100:00100000:0.0:1777051450.212727:0:8492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426059648 00000100:00100000:0.0:1777051450.212812:0:8492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112293 00000100:00100000:0.0:1777051450.212830:0:8492:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94c129500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+33:138760:x1863365426059648:12345-192.168.201.46@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1777051450.212970:0:8492:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94c129500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+33:138760:x1863365426059648:12345-192.168.201.46@tcp:57:lhsmtool_posix.0 Request processed in 142us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051450.212986:0:8492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112293 00000100:00100000:2.0:1777051450.224055:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051450.224552:0:8628:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426059776 00000100:00100000:3.0:1777051450.224566:0:8628:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426059776 00000100:00100000:3.0:1777051450.224661:0:8628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 8074 00000100:00100000:3.0:1777051450.224677:0:8628:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d944072d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+49:138760:x1863365426059776:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1777051450.224699:0:8628:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777051450.224722:0:8628:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003cc0662d/0x85f51a6b9671713b lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b68aa expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051450.224766:0:8628:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000019569fc6/0x85f51a6b96717134 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b68a3 expref: 50 pid: 8471 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051450.224801:0:8628:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051450.224804:0:8628:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051450.224812:0:8628:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003cc0662d/0x85f51a6b9671713b lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b68aa expref: 50 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051450.224860:0:8628:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000019569fc6/0x85f51a6b96717134 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b68a3 expref: 50 pid: 8471 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051450.224885:0:8628:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000019569fc6/0x85f51a6b96717134 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b68a3 expref: 50 pid: 8471 timeout: 8179 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051450.224909:0:8628:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94c12ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8628:1863365452669184:192.168.201.46@tcp:104: 00000100:00100000:3.0:1777051450.225031:0:8628:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d956bda540 going to sleep for 11 seconds 00000100:00100000:3.0:1777051450.227275:0:8628:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94c12ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8628:1863365452669184:192.168.201.46@tcp:104: 00010000:00010000:3.0:1777051450.227322:0:8628:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003cc0662d/0x85f51a6b9671713b lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b68aa expref: 50 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051450.227455:0:8628:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d9559a2800, rc 0) 00000100:00100000:3.0:1777051450.227526:0:8628:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d944072d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+50:138760:x1863365426059776:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 Request processed in 2850us (3474us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051450.227541:0:8628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 8074 00000100:00100000:2.0:1777051450.228015:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051450.228135:0:24467:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426059904 00000100:00100000:0.0:1777051450.228147:0:24467:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426059904 00010000:00010000:0.0:1777051450.228242:0:24467:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000019569fc6/0x85f51a6b96717134 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b68a3 expref: 50 pid: 8471 timeout: 8179 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051450.228306:0:24467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3942 00000100:00100000:0.0:1777051450.228323:0:24467:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d944071500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+50:2437:x1863365426059904:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1777051450.228341:0:24467:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777051450.228368:0:24467:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000019569fc6/0x85f51a6b96717134 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b68a3 expref: 50 pid: 8471 timeout: 8179 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051450.228394:0:24467:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000019569fc6/0x85f51a6b96717134 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b68a3 expref: 50 pid: 8471 timeout: 8179 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051450.228425:0:24467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000019569fc6/0x85f51a6b96717134 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b68a3 expref: 50 pid: 8471 timeout: 8179 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051450.228444:0:24467:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777051450.228447:0:24467:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777051450.228456:0:24467:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003cc0662d/0x85f51a6b9671713b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b68aa expref: 49 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051450.228471:0:24467:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003cc0662d/0x85f51a6b9671713b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b68aa expref: 49 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051450.228526:0:24467:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000003cc0662d/0x85f51a6b9671713b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b68aa expref: 49 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051450.228546:0:24467:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94ed2f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:24467:1863365452669312:192.168.201.46@tcp:105: 00000100:00100000:0.0:1777051450.228661:0:24467:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da5837a840 going to sleep for 11 seconds 00000100:00100000:2.0:1777051450.231662:0:24467:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94ed2f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:24467:1863365452669312:192.168.201.46@tcp:105: 00010000:00010000:2.0:1777051450.231690:0:24467:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1777051450.231762:0:24467:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d944071500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+49:2437:x1863365426059904:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 3443us (3750us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051450.231773:0:24467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3942 00000100:00100000:0.0:1777051450.261403:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051450.261619:0:46203:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426060032 00000100:00100000:3.0:1777051450.261633:0:46203:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426060032 00002000:00100000:3.0:1777051450.261695:0:46203:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x1e5:0x0] (0->1048575) req@ffff99d94ed2f480 x1863365426060032/t0(0) o4->c11b6966-0775-44d2-bdc6-c74c26eb2226@192.168.201.46@tcp:411/0 lens 488/0 e 0 to 0 dl 1777051461 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1777051450.261715:0:46203:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99d94ed2f480 with x1863365426060032 ext(0->1048575) 00002000:00010000:3.0:1777051450.261724:0:46203:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99d94ed2f480 00000100:00100000:3.0:1777051450.261774:0:46203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 1786 00000100:00100000:3.0:1777051450.261789:0:46203:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94ed2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:c11b6966-0775-44d2-bdc6-c74c26eb2226+49:2436:x1863365426060032:12345-192.168.201.46@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1777051450.291970:0:46203:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94ed2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:c11b6966-0775-44d2-bdc6-c74c26eb2226+51:2436:x1863365426060032:12345-192.168.201.46@tcp:4:lhsmtool_posix.0 Request processed in 30175us (30569us total) trans 4294968371 rc 0/0 00000100:00100000:0.0:1777051450.291988:0:46203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 1786 00002000:00100000:0.0:1777051450.292009:0:46203:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x1e5:0x0] (0->1048575) req@ffff99d94ed2f480 x1863365426060032/t4294968371(0) o4->c11b6966-0775-44d2-bdc6-c74c26eb2226@192.168.201.46@tcp:411/0 lens 488/448 e 0 to 0 dl 1777051461 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1777051450.292026:0:46203:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99d94ed2f480 with x1863365426060032 ext(0->1048575) 00002000:00010000:0.0:1777051450.292035:0:46203:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99d94ed2f480 00000100:00100000:0.0:1777051450.297490:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051450.297627:0:27885:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426060160 00000100:00100000:3.0:1777051450.297641:0:27885:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426060160 00000100:00100000:3.0:1777051450.297719:0:27885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112294 00000100:00100000:3.0:1777051450.297734:0:27885:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f42ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c11b6966-0775-44d2-bdc6-c74c26eb2226+33:138760:x1863365426060160:12345-192.168.201.46@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1777051450.300131:0:103159:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771220 is committed 00000001:00080000:1.0:1777051450.300160:0:103159:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771214 is committed 00010000:00010000:2.0:1777051450.300175:0:3663:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710e00/0x85f51a6b96717103 lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e3:0xa:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051450.300190:0:3663:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710e00/0x85f51a6b96717103 lrc: 2/0,0 mode: TXN/TXN res: [0x2000032e3:0xa:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051450.300198:0:3663:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710e00/0x85f51a6b96717103 lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e3:0xa:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051450.300443:0:3663:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d950710e00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:2.0:1777051450.300450:0:3663:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710e00/0x85f51a6b96717103 lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e3:0xa:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051450.300463:0:3663:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710e00/0x85f51a6b96717103 lrc: 4/0,0 mode: TXN/TXN res: [0x2000032e3:0xa:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051450.300485:0:3663:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e3:0xa:0x0].0x0 (ffff99d94e52ab00) 00010000:00010000:2.0:1777051450.300490:0:3663:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1777051450.300496:0:3663:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710e00/0x85f51a6b96717103 lrc: 2/0,0 mode: --/TXN res: [0x2000032e3:0xa:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051450.300506:0:3663:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710e00/0x85f51a6b96717103 lrc: 0/0,0 mode: --/TXN res: [0x2000032e3:0xa:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051450.300637:0:27885:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f42ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c11b6966-0775-44d2-bdc6-c74c26eb2226+26:138760:x1863365426060160:12345-192.168.201.46@tcp:44:lhsmtool_posix.0 Request processed in 2903us (3439us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051450.300651:0:27885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112294 00000100:00100000:2.0:1777051450.307069:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051450.307164:0:27887:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426060288 00000100:00100000:0.0:1777051450.307176:0:27887:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426060288 00000100:00100000:0.0:1777051450.307247:0:27887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 8075 00000100:00100000:0.0:1777051450.307258:0:27887:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955612680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c11b6966-0775-44d2-bdc6-c74c26eb2226+51:2439:x1863365426060288:12345-192.168.201.46@tcp:16:lhsmtool_posix.0 00000001:00080000:1.0:1777051450.309699:0:9540:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0001: transno 4294968371 is committed 00000100:00100000:0.0:1777051450.309880:0:27887:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955612680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c11b6966-0775-44d2-bdc6-c74c26eb2226+49:2439:x1863365426060288:12345-192.168.201.46@tcp:16:lhsmtool_posix.0 Request processed in 2620us (2814us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051450.309893:0:27887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 8075 00000100:00100000:0.0:1777051450.312369:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051450.312435:0:6579:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426060544 00000100:00100000:3.0:1777051450.312444:0:6579:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426060544 00000100:00100000:3.0:1777051450.312507:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112295 00000100:00100000:3.0:1777051450.312521:0:6579:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95aecc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+26:138760:x1863365426060544:12345-192.168.201.46@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1777051450.312576:0:6579:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777051450.312644:0:6579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d950705c00/0x85f51a6b9671712d lrc: 0/0,0 mode: --/PR res: [0x2000032e3:0xa:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b689c expref: 26 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051450.312669:0:6579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e3:0xa:0x0].0x0 (ffff99d94e52ab00) 00010000:00010000:3.0:1777051450.312677:0:6579:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1777051450.312713:0:6579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2200/0x85f51a6b96717142 lrc: 3/0,1 mode: --/PW res: [0x2000032e3:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051450.312733:0:6579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2200/0x85f51a6b96717142 lrc: 3/0,1 mode: PW/PW res: [0x2000032e3:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051450.312748:0:6579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2200/0x85f51a6b96717142 lrc: 3/0,1 mode: PW/PW res: [0x2000032e3:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777051450.313160:0:6579:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000009ea7d02 reply state 00000000d2c73b33 transno 30064771221 ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2200/0x85f51a6b96717142 lrc: 3/0,1 mode: PW/PW res: [0x2000032e3:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051450.313180:0:6579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2200/0x85f51a6b96717142 lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e3:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051450.313192:0:6579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e3:0xa:0x0].0x0 (ffff99d94e52ab00) 00010000:00010000:3.0:1777051450.313197:0:6579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1777051450.313200:0:6579:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1777051450.313336:0:6579:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95aecc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+27:138760:x1863365426060544:12345-192.168.201.46@tcp:36:lhsmtool_posix.0 Request processed in 815us (966us total) trans 30064771221 rc 0/0 00000100:00100000:3.0:1777051450.313350:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112295 00000100:00100000:2.0:1777051450.315441:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051450.315510:0:10328:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426060672 00000100:00100000:3.0:1777051450.315519:0:10328:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426060672 00000100:00100000:3.0:1777051450.315565:0:10328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112296 00000100:00100000:3.0:1777051450.315574:0:10328:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955610380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+27:138760:x1863365426060672:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1777051450.315615:0:10328:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777051450.315632:0:10328:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2600/0x85f51a6b96717149 lrc: 2/0,0 mode: --/CR res: [0x2000032e3:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b68b1 expref: -99 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051450.315671:0:10328:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2600/0x85f51a6b96717149 lrc: 3/0,0 mode: CR/CR res: [0x2000032e3:0xa:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b68b1 expref: 28 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051450.315684:0:10328:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2600/0x85f51a6b96717149 lrc: 3/0,0 mode: CR/CR res: [0x2000032e3:0xa:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b68b1 expref: 28 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051450.315698:0:10328:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e3:0xa:0x0].0x0 (ffff99d94e52ab00) 00010000:00010000:3.0:1777051450.315702:0:10328:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1777051450.315705:0:10328:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d9559a2600, rc 0) 00000100:00100000:3.0:1777051450.315742:0:10328:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955610380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+28:138760:x1863365426060672:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 Request processed in 170us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051450.315749:0:10328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112296 00000100:00100000:2.0:1777051450.318528:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051450.318631:0:8470:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426060800 00000100:00100000:0.0:1777051450.318638:0:8470:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426060800 00000100:00100000:0.0:1777051450.318686:0:8470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 8076 00000100:00100000:0.0:1777051450.318699:0:8470:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955611c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+49:2437:x1863365426060800:12345-192.168.201.46@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1777051450.319104:0:8470:0:(ofd_lvb.c:305:ofd_lvbo_update()) res: [0x2c0000401:0x1e5:0x0] updating lvb size from disk: 0 -> 1048576 00002000:00010000:0.0:1777051450.319111:0:8470:0:(ofd_lvb.c:312:ofd_lvbo_update()) res: [0x2c0000401:0x1e5:0x0] updating lvb mtime from disk: 0 -> 1777051448 00002000:00010000:0.0:1777051450.319121:0:8470:0:(ofd_lvb.c:318:ofd_lvbo_update()) res: [0x2c0000401:0x1e5:0x0] updating lvb atime from disk: 0 -> 1777051448 00002000:00010000:0.0:1777051450.319124:0:8470:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x2c0000401:0x1e5:0x0] updating lvb ctime from disk: 0 -> 1777051448 00002000:00010000:0.0:1777051450.319128:0:8470:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x2c0000401:0x1e5:0x0] updating lvb blocks from disk: 0 -> 2048 00000100:00100000:0.0:1777051450.319179:0:8470:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955611c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+50:2437:x1863365426060800:12345-192.168.201.46@tcp:2:lhsmtool_posix.0 Request processed in 481us (652us total) trans 4294968372 rc 0/0 00000100:00100000:0.0:1777051450.319190:0:8470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 8076 00000100:00100000:0.0:1777051450.321577:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051450.321681:0:46497:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426061056 00000100:00100000:1.0:1777051450.321688:0:46497:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426061056 00000100:00100000:1.0:1777051450.321998:0:46497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112297 00000100:00100000:1.0:1777051450.322016:0:46497:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95aecd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:c11b6966-0775-44d2-bdc6-c74c26eb2226+28:138760:x1863365426061056:12345-192.168.201.46@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1777051450.322069:0:46497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce200/0x85f51a6b96717150 lrc: 3/0,1 mode: --/PW res: [0x2000032e3:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051450.322091:0:46497:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cee00/0x85f51a6b967170fc lrc: 2/0,0 mode: PR/PR res: [0x2000032e3:0xa:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6887 expref: 28 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051450.322112:0:46497:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce200/0x85f51a6b96717150 lrc: 4/0,1 mode: --/PW res: [0x2000032e3:0xa:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051450.322150:0:46497:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cee00/0x85f51a6b967170fc lrc: 3/0,0 mode: PR/PR res: [0x2000032e3:0xa:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6887 expref: 28 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051450.322170:0:46497:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cee00/0x85f51a6b967170fc lrc: 4/0,0 mode: PR/PR res: [0x2000032e3:0xa:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6887 expref: 28 pid: 46497 timeout: 8179 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051450.322191:0:46497:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7fd60700 pname:cluuid:pid:xid:nid:opc:job mdt00_009:lustre-MDT0000_UUID:46497:1863365452669440:192.168.201.46@tcp:104: 00000100:00100000:1.0:1777051450.322333:0:46497:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da7b379cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1777051450.327812:0:46497:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7fd60700 pname:cluuid:pid:xid:nid:opc:job mdt00_009:lustre-MDT0000_UUID:46497:1863365452669440:192.168.201.46@tcp:104: 00000100:00100000:2.0:1777051450.327813:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00010000:00010000:1.0:1777051450.327848:0:46497:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce200/0x85f51a6b96717150 lrc: 3/0,1 mode: --/PW res: [0x2000032e3:0xa:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051450.327918:0:6565:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426061184 00000100:00100000:0.0:1777051450.327928:0:6565:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426061184 00010000:00010000:0.0:1777051450.327977:0:6565:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cee00/0x85f51a6b967170fc lrc: 4/0,0 mode: PR/PR res: [0x2000032e3:0xa:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6887 expref: 29 pid: 46497 timeout: 8179 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051450.328037:0:6565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3943 00000100:00100000:0.0:1777051450.328052:0:6565:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da54220850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+29:2437:x1863365426061184:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1777051450.328069:0:6565:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777051450.328079:0:6565:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cee00/0x85f51a6b967170fc lrc: 4/0,0 mode: PR/PR res: [0x2000032e3:0xa:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6887 expref: 29 pid: 46497 timeout: 8179 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051450.328422:0:6565:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cee00/0x85f51a6b967170fc lrc: 3/0,0 mode: PR/PR res: [0x2000032e3:0xa:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6887 expref: 29 pid: 46497 timeout: 8179 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051450.328453:0:6565:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cee00/0x85f51a6b967170fc lrc: 0/0,0 mode: --/PR res: [0x2000032e3:0xa:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6887 expref: 29 pid: 46497 timeout: 8179 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051450.328477:0:6565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e3:0xa:0x0].0x0 (ffff99d94e52ab00) 00010000:00010000:0.0:1777051450.328483:0:6565:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce200/0x85f51a6b96717150 lrc: 3/0,1 mode: --/PW res: [0x2000032e3:0xa:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051450.328495:0:6565:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce200/0x85f51a6b96717150 lrc: 3/0,1 mode: PW/PW res: [0x2000032e3:0xa:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051450.328504:0:6565:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce200/0x85f51a6b96717150 lrc: 4/0,1 mode: PW/PW res: [0x2000032e3:0xa:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051450.328537:0:6565:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1777051450.328622:0:6565:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da54220850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+28:2437:x1863365426061184:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 541us (782us total) trans 0 rc 0/0 00010000:00010000:1.0:1777051450.328630:0:46497:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce200/0x85f51a6b96717150 lrc: 3/0,1 mode: PW/PW res: [0x2000032e3:0xa:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051450.328634:0:6565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3943 00010000:00010000:1.0:1777051450.328642:0:46497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce200/0x85f51a6b96717150 lrc: 3/0,1 mode: PW/PW res: [0x2000032e3:0xa:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051450.328683:0:46497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce200/0x85f51a6b96717150 lrc: 3/0,1 mode: PW/PW res: [0x2000032e3:0xa:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051450.328694:0:46497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce200/0x85f51a6b96717150 lrc: 2/0,0 mode: PW/PW res: [0x2000032e3:0xa:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051450.328705:0:46497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce200/0x85f51a6b96717150 lrc: 3/0,0 mode: PW/PW res: [0x2000032e3:0xa:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051450.328714:0:46497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da7d5ce200 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:1.0:1777051450.328721:0:46497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce200/0x85f51a6b96717150 lrc: 3/0,0 mode: PW/PW res: [0x2000032e3:0xa:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051450.328732:0:46497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce200/0x85f51a6b96717150 lrc: 4/0,0 mode: PW/PW res: [0x2000032e3:0xa:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051450.328748:0:46497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e3:0xa:0x0].0x0 (ffff99d94e52ab00) 00010000:00010000:1.0:1777051450.328752:0:46497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1777051450.328758:0:46497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce200/0x85f51a6b96717150 lrc: 2/0,0 mode: --/PW res: [0x2000032e3:0xa:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051450.328767:0:46497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce200/0x85f51a6b96717150 lrc: 0/0,0 mode: --/PW res: [0x2000032e3:0xa:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051450.328823:0:46497:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95aecd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:c11b6966-0775-44d2-bdc6-c74c26eb2226+27:138760:x1863365426061056:12345-192.168.201.46@tcp:55:lhsmtool_posix.0 Request processed in 6811us (7248us total) trans 0 rc -22/-22 00000100:00100000:1.0:1777051450.328835:0:46497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112297 00000100:00100000:2.0:1777051450.331801:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051450.331880:0:27884:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426061312 00000100:00100000:0.0:1777051450.331888:0:27884:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426061312 00000100:00100000:0.0:1777051450.331937:0:27884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 8077 00000100:00100000:0.0:1777051450.331955:0:27884:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955610700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+50:2436:x1863365426061312:12345-192.168.201.46@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1777051450.332012:0:27884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000014e1a6e3/0x85f51a6b96717157 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 27884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051450.332040:0:27884:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003cc0662d/0x85f51a6b9671713b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b68aa expref: 50 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051450.332053:0:27884:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1777051450.332056:0:27884:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1777051450.332062:0:27884:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000014e1a6e3/0x85f51a6b96717157 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 27884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051450.332102:0:27884:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003cc0662d/0x85f51a6b9671713b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b68aa expref: 50 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051450.332121:0:27884:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003cc0662d/0x85f51a6b9671713b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b68aa expref: 50 pid: 8628 timeout: 8179 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051450.332142:0:27884:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95aecdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:27884:1863365452669568:192.168.201.46@tcp:104: 00000100:00100000:0.0:1777051450.332227:0:27884:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da5837ae40 going to sleep for 11 seconds 00000100:00100000:0.0:1777051450.334771:0:27884:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95aecdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:27884:1863365452669568:192.168.201.46@tcp:104: 00010000:00010000:0.0:1777051450.334797:0:27884:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000014e1a6e3/0x85f51a6b96717157 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 27884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051450.344517:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051450.344653:0:47827:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426061440 00000100:00100000:0.0:1777051450.344665:0:47827:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426061440 00010000:00010000:0.0:1777051450.344710:0:47827:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003cc0662d/0x85f51a6b9671713b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b68aa expref: 51 pid: 8628 timeout: 8179 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051450.344767:0:47827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3944 00000100:00100000:0.0:1777051450.344781:0:47827:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955613800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+51:2437:x1863365426061440:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1777051450.344800:0:47827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777051450.344827:0:47827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003cc0662d/0x85f51a6b9671713b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b68aa expref: 51 pid: 8628 timeout: 8179 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051450.344860:0:47827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003cc0662d/0x85f51a6b9671713b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b68aa expref: 51 pid: 8628 timeout: 8179 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051450.344889:0:47827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003cc0662d/0x85f51a6b9671713b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b68aa expref: 51 pid: 8628 timeout: 8179 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051450.344912:0:47827:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777051450.344915:0:47827:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777051450.344922:0:47827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000014e1a6e3/0x85f51a6b96717157 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 27884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051450.344933:0:47827:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000014e1a6e3/0x85f51a6b96717157 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 27884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051450.344973:0:47827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1777051450.345031:0:47827:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955613800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+50:2437:x1863365426061440:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 251us (522us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051450.345043:0:47827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3944 00010000:00010000:3.0:1777051450.345075:0:27884:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000014e1a6e3/0x85f51a6b96717157 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 27884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051450.345096:0:27884:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000014e1a6e3/0x85f51a6b96717157 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 27884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051450.345129:0:27884:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000014e1a6e3/0x85f51a6b96717157 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 27884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051450.345144:0:27884:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000014e1a6e3/0x85f51a6b96717157 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 27884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051450.345160:0:27884:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000014e1a6e3/0x85f51a6b96717157 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 27884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051450.345172:0:27884:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d950705c00 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:3.0:1777051450.345180:0:27884:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000014e1a6e3/0x85f51a6b96717157 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 27884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051450.345235:0:27884:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000014e1a6e3/0x85f51a6b96717157 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 27884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051450.345258:0:27884:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000014e1a6e3/0x85f51a6b96717157 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 27884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051450.345271:0:27884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000014e1a6e3/0x85f51a6b96717157 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 27884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051450.345401:0:27884:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955610700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+49:2436:x1863365426061312:12345-192.168.201.46@tcp:1:lhsmtool_posix.0 Request processed in 13449us (13597us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051450.345415:0:27884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 8077 00000100:00100000:2.0:1777051450.348252:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051450.348453:0:6581:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426061696 00000100:00100000:3.0:1777051450.348462:0:6581:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426061696 00000100:00100000:3.0:1777051450.348527:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112298 00000100:00100000:3.0:1777051450.348540:0:6581:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95088b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+27:138760:x1863365426061696:12345-192.168.201.46@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1777051450.348646:0:6581:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2000/0x85f51a6b9671715e lrc: 3/0,1 mode: --/PW res: [0x2000032e3:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051450.348666:0:6581:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2000/0x85f51a6b9671715e lrc: 3/0,1 mode: PW/PW res: [0x2000032e3:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051450.349161:0:6581:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2000/0x85f51a6b9671715e lrc: 3/0,1 mode: PW/PW res: [0x2000032e3:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051450.349359:0:6581:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3c00/0x85f51a6b96717165 lrc: 3/0,1 mode: --/EX res: [0x2000032e3:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051450.349373:0:6581:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2600/0x85f51a6b96717149 lrc: 2/0,0 mode: CR/CR res: [0x2000032e3:0xa:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b68b1 expref: 28 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051450.349381:0:6581:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3c00/0x85f51a6b96717165 lrc: 4/0,1 mode: --/EX res: [0x2000032e3:0xa:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051450.349409:0:6581:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2600/0x85f51a6b96717149 lrc: 3/0,0 mode: CR/CR res: [0x2000032e3:0xa:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b68b1 expref: 28 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051450.349423:0:6581:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2600/0x85f51a6b96717149 lrc: 4/0,0 mode: CR/CR res: [0x2000032e3:0xa:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b68b1 expref: 28 pid: 10328 timeout: 8179 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051450.349471:0:6581:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94c12ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6581:1863365452669696:192.168.201.46@tcp:104: 00000100:00100000:3.0:1777051450.349538:0:6581:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d956bdae40 going to sleep for 11 seconds 00000100:00100000:3.0:1777051450.351941:0:6581:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94c12ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6581:1863365452669696:192.168.201.46@tcp:104: 00010000:00010000:3.0:1777051450.351964:0:6581:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3c00/0x85f51a6b96717165 lrc: 3/0,1 mode: --/EX res: [0x2000032e3:0xa:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051450.352961:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051450.353048:0:6564:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426061824 00000100:00100000:3.0:1777051450.353057:0:6564:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426061824 00010000:00010000:3.0:1777051450.353089:0:6564:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2600/0x85f51a6b96717149 lrc: 4/0,0 mode: CR/CR res: [0x2000032e3:0xa:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b68b1 expref: 29 pid: 10328 timeout: 8179 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051450.353147:0:6564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3945 00000100:00100000:3.0:1777051450.353161:0:6564:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d950888380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+29:2437:x1863365426061824:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1777051450.353368:0:6564:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777051450.353379:0:6564:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2600/0x85f51a6b96717149 lrc: 4/0,0 mode: CR/CR res: [0x2000032e3:0xa:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b68b1 expref: 29 pid: 10328 timeout: 8179 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051450.353398:0:6564:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2600/0x85f51a6b96717149 lrc: 3/0,0 mode: CR/CR res: [0x2000032e3:0xa:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b68b1 expref: 29 pid: 10328 timeout: 8179 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051450.353421:0:6564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2600/0x85f51a6b96717149 lrc: 0/0,0 mode: --/CR res: [0x2000032e3:0xa:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b68b1 expref: 29 pid: 10328 timeout: 8179 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051450.353440:0:6564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e3:0xa:0x0].0x0 (ffff99d94e52ab00) 00010000:00010000:3.0:1777051450.353447:0:6564:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3c00/0x85f51a6b96717165 lrc: 3/0,1 mode: --/EX res: [0x2000032e3:0xa:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051450.353458:0:6564:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3c00/0x85f51a6b96717165 lrc: 3/0,1 mode: EX/EX res: [0x2000032e3:0xa:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051450.353467:0:6564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3c00/0x85f51a6b96717165 lrc: 4/0,1 mode: EX/EX res: [0x2000032e3:0xa:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051450.353514:0:6564:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1777051450.353567:0:6564:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d950888380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+28:2437:x1863365426061824:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 407us (606us total) trans 0 rc 0/0 00010000:00010000:2.0:1777051450.353575:0:6581:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3c00/0x85f51a6b96717165 lrc: 3/0,1 mode: EX/EX res: [0x2000032e3:0xa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051450.353584:0:6564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3945 00010000:00010000:2.0:1777051450.353624:0:6581:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3c00/0x85f51a6b96717165 lrc: 3/0,1 mode: EX/EX res: [0x2000032e3:0xa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1777051450.353711:0:6581:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 30064771222 00000001:00080000:2.0:1777051450.353845:0:6581:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 30064771223 00000001:00080000:2.0:1777051450.353896:0:6581:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 30064771224 00000100:00100000:2.0:1777051450.353980:0:6581:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d950888a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6581:1863365452669824:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1777051450.354065:0:6581:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051450.354393:0:6581:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d944a9f480 going to sleep for 11 seconds 00000100:00100000:3.0:1777051450.354425:0:11727:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452669824 00000100:00100000:3.0:1777051450.354434:0:11727:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452669824 00000100:00100000:3.0:1777051450.354496:0:11727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8269 00000100:00100000:3.0:1777051450.354511:0:11727:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d950889180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6581:x1863365452669824:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1777051450.354642:0:11727:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d950889180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6581:x1863365452669824:12345-0@lo:1000:mdt00_002.0 Request processed in 135us (576us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051450.354654:0:11727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8269 00000100:00100000:2.0:1777051450.354706:0:6581:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d950888a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6581:1863365452669824:0@lo:1000:mdt00_002.0 00000001:00080000:2.0:1777051450.354844:0:6581:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 30064771225 00000100:00100000:2.0:1777051450.354903:0:6581:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d950888a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6581:1863365452669952:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1777051450.354945:0:6581:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051450.354985:0:6581:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d944a9f6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1777051450.355043:0:46500:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452669952 00000100:00100000:0.0:1777051450.355052:0:46500:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452669952 00000100:00100000:0.0:1777051450.355102:0:46500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8270 00000100:00100000:0.0:1777051450.355418:0:46500:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95088bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+5:6581:x1863365452669952:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1777051450.355628:0:46500:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95088bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+6:6581:x1863365452669952:12345-0@lo:1000:mdt00_002.0 Request processed in 216us (680us total) trans 4294968373 rc 0/0 00000100:00100000:0.0:1777051450.355641:0:46500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8270 00000100:00100000:2.0:1777051450.355681:0:6581:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d950888a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6581:1863365452669952:0@lo:1000:mdt00_002.0 00000001:00080000:2.0:1777051450.355748:0:6581:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 30064771226 00010000:00010000:2.0:1777051450.355773:0:6581:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3c00/0x85f51a6b96717165 lrc: 3/0,1 mode: EX/EX res: [0x2000032e3:0xa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051450.355782:0:6581:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3c00/0x85f51a6b96717165 lrc: 2/0,0 mode: EX/EX res: [0x2000032e3:0xa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051450.355789:0:6581:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3c00/0x85f51a6b96717165 lrc: 3/0,0 mode: EX/EX res: [0x2000032e3:0xa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051450.355794:0:6581:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d9559a3c00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:2.0:1777051450.355799:0:6581:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3c00/0x85f51a6b96717165 lrc: 3/0,0 mode: EX/EX res: [0x2000032e3:0xa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051450.355806:0:6581:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3c00/0x85f51a6b96717165 lrc: 4/0,0 mode: EX/EX res: [0x2000032e3:0xa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051450.355816:0:6581:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e3:0xa:0x0].0x0 (ffff99d94e52ab00) 00010000:00010000:2.0:1777051450.355819:0:6581:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1777051450.355822:0:6581:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3c00/0x85f51a6b96717165 lrc: 2/0,0 mode: --/EX res: [0x2000032e3:0xa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051450.355828:0:6581:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3c00/0x85f51a6b96717165 lrc: 0/0,0 mode: --/EX res: [0x2000032e3:0xa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051450.355848:0:6581:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950704a00/0x85f51a6b96717031 lrc: 3/0,1 mode: EX/EX res: [0x2000032e3:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051450.355855:0:6581:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d950704a00/0x85f51a6b96717031 lrc: 2/0,0 mode: EX/EX res: [0x2000032e3:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051450.355860:0:6581:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d950704a00/0x85f51a6b96717031 lrc: 3/0,0 mode: EX/EX res: [0x2000032e3:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051450.355865:0:6581:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d950704a00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:2.0:1777051450.355867:0:6581:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d950704a00/0x85f51a6b96717031 lrc: 3/0,0 mode: EX/EX res: [0x2000032e3:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051450.355873:0:6581:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d950704a00/0x85f51a6b96717031 lrc: 4/0,0 mode: EX/EX res: [0x2000032e3:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051450.355879:0:6581:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e3:0x9:0x0].0x0 (ffff99da42881300) 00010000:00010000:2.0:1777051450.355881:0:6581:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1777051450.355884:0:6581:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d950704a00/0x85f51a6b96717031 lrc: 2/0,0 mode: --/EX res: [0x2000032e3:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051450.355889:0:6581:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d950704a00/0x85f51a6b96717031 lrc: 0/0,0 mode: --/EX res: [0x2000032e3:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051450.355908:0:6581:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710200/0x85f51a6b9671716c lrc: 3/0,1 mode: --/EX res: [0x2000032e3:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051450.355918:0:6581:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710200/0x85f51a6b9671716c lrc: 3/0,1 mode: EX/EX res: [0x2000032e3:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051450.355928:0:6581:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710200/0x85f51a6b9671716c lrc: 3/0,1 mode: EX/EX res: [0x2000032e3:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051450.355938:0:6581:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710200/0x85f51a6b9671716c lrc: 3/0,1 mode: EX/EX res: [0x2000032e3:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051450.355948:0:6581:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710200/0x85f51a6b9671716c lrc: 2/0,0 mode: EX/EX res: [0x2000032e3:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051450.355956:0:6581:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710200/0x85f51a6b9671716c lrc: 3/0,0 mode: EX/EX res: [0x2000032e3:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051450.355964:0:6581:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d950710200 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:2.0:1777051450.355969:0:6581:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710200/0x85f51a6b9671716c lrc: 3/0,0 mode: EX/EX res: [0x2000032e3:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051450.355979:0:6581:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710200/0x85f51a6b9671716c lrc: 4/0,0 mode: EX/EX res: [0x2000032e3:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051450.355990:0:6581:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e3:0x9:0x0].0x0 (ffff99da42881300) 00010000:00010000:2.0:1777051450.355994:0:6581:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777051450.355998:0:6581:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710200/0x85f51a6b9671716c lrc: 2/0,0 mode: --/EX res: [0x2000032e3:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051450.356006:0:6581:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710200/0x85f51a6b9671716c lrc: 0/0,0 mode: --/EX res: [0x2000032e3:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051450.356020:0:6581:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2000/0x85f51a6b9671715e lrc: 3/0,1 mode: PW/PW res: [0x2000032e3:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051450.356029:0:6581:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2000/0x85f51a6b9671715e lrc: 2/0,0 mode: PW/PW res: [0x2000032e3:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051450.356038:0:6581:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2000/0x85f51a6b9671715e lrc: 3/0,0 mode: PW/PW res: [0x2000032e3:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051450.356045:0:6581:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d9559a2000 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:2.0:1777051450.356049:0:6581:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2000/0x85f51a6b9671715e lrc: 3/0,0 mode: PW/PW res: [0x2000032e3:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051450.356059:0:6581:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2000/0x85f51a6b9671715e lrc: 4/0,0 mode: PW/PW res: [0x2000032e3:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051450.356069:0:6581:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e3:0x9:0x0].0x0 (ffff99da42881300) 00010000:00010000:2.0:1777051450.356073:0:6581:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1777051450.356077:0:6581:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2000/0x85f51a6b9671715e lrc: 2/0,0 mode: --/PW res: [0x2000032e3:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051450.356085:0:6581:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2000/0x85f51a6b9671715e lrc: 0/0,0 mode: --/PW res: [0x2000032e3:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051450.356264:0:6581:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95088b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+32:138760:x1863365426061696:12345-192.168.201.46@tcp:57:lhsmtool_posix.0 Request processed in 7724us (8063us total) trans 30064771227 rc 0/0 00000100:00100000:2.0:1777051450.356278:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112298 00000020:00080000:2.0:1777051450.356284:0:6581:0:(tgt_main.c:783:tgt_ses_key_exit()) total 6 transactions per RPC 00000040:00080000:1.0:1777051450.356355:0:103189:0:(llog.c:801:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:1.0:1777051450.356362:0:103189:0:(llog_cat.c:158:llog_cat_process_common()) processing log [0x1:0x2b:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1777051450.357053:0:103189:0:(llog.c:858:llog_process_thread()) stop processing plain [0x1:0x2b:0x0] index 64768 count 7 00000040:00080000:1.0:1777051450.357064:0:103189:0:(llog.c:858:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00000100:00100000:2.0:1777051450.358112:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051450.358807:0:6583:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426062080 00000100:00100000:0.0:1777051450.358816:0:6583:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426062080 00000100:00100000:0.0:1777051450.358878:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3410 00000100:00100000:0.0:1777051450.358894:0:6583:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95088a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+32:138760:x1863365426062080:12345-192.168.201.46@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1777051450.359164:0:6583:0:(mdd_object.c:4010:mdd_close()) Object [0x2000032e3:0xa:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1777051450.359262:0:6583:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 30064771228 00010000:00010000:0.0:1777051450.359307:0:6583:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950705e00/0x85f51a6b96717173 lrc: 3/0,1 mode: --/PW res: [0x2000032e3:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6583 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051450.359321:0:6583:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d950705e00/0x85f51a6b96717173 lrc: 3/0,1 mode: PW/PW res: [0x2000032e3:0xa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6583 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051450.359332:0:6583:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d950705e00/0x85f51a6b96717173 lrc: 3/0,1 mode: PW/PW res: [0x2000032e3:0xa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6583 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051450.359340:0:6583:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950705e00/0x85f51a6b96717173 lrc: 4/0,1 mode: PW/PW res: [0x2000032e3:0xa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6583 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051450.359346:0:6583:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950705e00/0x85f51a6b96717173 lrc: 4/0,1 mode: PW/PW res: [0x2000032e3:0xa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6583 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051450.359352:0:6583:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d950705e00/0x85f51a6b96717173 lrc: 3/0,0 mode: PW/PW res: [0x2000032e3:0xa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6583 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051450.359374:0:6583:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1777051450.359451:0:13753:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1777051450.359454:0:6583:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95088a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+34:138760:x1863365426062080:12345-192.168.201.46@tcp:35:lhsmtool_posix.0 Request processed in 564us (1345us total) trans 30064771229 rc 0/0 00010000:00010000:3.0:1777051450.359465:0:13753:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d950705e00/0x85f51a6b96717173 lrc: 2/0,0 mode: PW/PW res: [0x2000032e3:0xa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6583 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051450.359473:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3410 00000020:00080000:0.0:1777051450.359483:0:6583:0:(tgt_main.c:783:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1777051450.359487:0:13753:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d950705e00 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:3.0:1777051450.359497:0:13753:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d950705e00/0x85f51a6b96717173 lrc: 2/0,0 mode: PW/PW res: [0x2000032e3:0xa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6583 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051450.359511:0:13753:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d950705e00/0x85f51a6b96717173 lrc: 3/0,0 mode: PW/PW res: [0x2000032e3:0xa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6583 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051450.359531:0:13753:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e3:0xa:0x0].0x0 (ffff99d94e52ab00) 00010000:00010000:3.0:1777051450.359536:0:13753:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1777051450.359543:0:13753:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d950705e00/0x85f51a6b96717173 lrc: 1/0,0 mode: --/PW res: [0x2000032e3:0xa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6583 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051450.359552:0:13753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d950705e00/0x85f51a6b96717173 lrc: 0/0,0 mode: --/PW res: [0x2000032e3:0xa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6583 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051450.359569:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051450.359571:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051450.359575:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777051450.454468:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777051451.479367:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1777051451.798717:0:104226:0:(llog.c:801:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1777051451.798730:0:104226:0:(llog_cat.c:158:llog_cat_process_common()) processing log [0x1:0x12:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1777051451.799133:0:104226:0:(llog.c:858:llog_process_thread()) stop processing plain [0x1:0x12:0x0] index 9 count 7 00000040:00080000:0.0:1777051451.799150:0:104226:0:(llog.c:858:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000040:00080000:0.0:1777051451.815937:0:108001:0:(llog.c:801:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:0.0:1777051451.815950:0:108001:0:(llog_cat.c:158:llog_cat_process_common()) processing log [0x1:0x2b:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1777051451.816015:0:108001:0:(llog.c:858:llog_process_thread()) stop processing plain [0x1:0x2b:0x0] index 9 count 7 00000040:00080000:0.0:1777051451.816032:0:108001:0:(llog.c:858:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00000100:00100000:0.0:1777051451.881336:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051451.881500:0:46494:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426062208 00000100:00100000:1.0:1777051451.881517:0:46494:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426062208 00000100:00100000:1.0:1777051451.881675:0:46494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112299 00000100:00080000:0.0:1777051451.881687:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1777051451.881699:0:46494:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95aecdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+33:138770:x1863365426062208:12345-192.168.201.46@tcp:101:lfs.0 00010000:00010000:1.0:1777051451.881730:0:46494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777051451.881766:0:46494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce200/0x85f51a6b9671717a lrc: 2/0,0 mode: --/CR res: [0x2000032e2:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b68b8 expref: -99 pid: 46494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051451.881895:0:46494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cf200/0x85f51a6b96717181 lrc: 3/1,0 mode: --/CR res: [0x2000032e2:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051451.881921:0:46494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cf200/0x85f51a6b96717181 lrc: 3/1,0 mode: CR/CR res: [0x2000032e2:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051451.881945:0:46494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cf200/0x85f51a6b96717181 lrc: 3/1,0 mode: CR/CR res: [0x2000032e2:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051451.881973:0:46494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cfc00/0x85f51a6b96717188 lrc: 3/1,0 mode: --/PR res: [0x2000032e2:0x8:0x0].0x15f59727 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051451.882017:0:46494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cfc00/0x85f51a6b96717188 lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0x8:0x0].0x15f59727 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051451.882034:0:46494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cfc00/0x85f51a6b96717188 lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0x8:0x0].0x15f59727 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051451.882135:0:46494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cee00/0x85f51a6b9671718f lrc: 3/1,0 mode: --/PR res: [0x2000032e3:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051451.882145:0:46494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cee00/0x85f51a6b9671718f lrc: 3/1,0 mode: PR/PR res: [0x2000032e3:0x9:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051451.882154:0:46494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cee00/0x85f51a6b9671718f lrc: 3/1,0 mode: PR/PR res: [0x2000032e3:0x9:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1777051451.882249:0:46494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000032e3:0x9:0x0]: returning size 1048576 00000004:00200000:1.0:1777051451.882258:0:46494:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1777051451.882292:0:46494:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cee00/0x85f51a6b9671718f lrc: 3/1,0 mode: PR/PR res: [0x2000032e3:0x9:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051451.882322:0:46494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cee00/0x85f51a6b9671718f lrc: 3/1,0 mode: PR/PR res: [0x2000032e3:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051451.882337:0:46494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cf200/0x85f51a6b96717181 lrc: 3/1,0 mode: CR/CR res: [0x2000032e2:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051451.882350:0:46494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cf200/0x85f51a6b96717181 lrc: 2/0,0 mode: CR/CR res: [0x2000032e2:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051451.882363:0:46494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cf200/0x85f51a6b96717181 lrc: 3/0,0 mode: CR/CR res: [0x2000032e2:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051451.882375:0:46494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da7d5cf200 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:1.0:1777051451.882382:0:46494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cf200/0x85f51a6b96717181 lrc: 3/0,0 mode: CR/CR res: [0x2000032e2:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051451.882396:0:46494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cf200/0x85f51a6b96717181 lrc: 4/0,0 mode: CR/CR res: [0x2000032e2:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051451.882416:0:46494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0x8:0x0].0x0 (ffff99d94e629b00) 00010000:00010000:1.0:1777051451.882422:0:46494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777051451.882429:0:46494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cf200/0x85f51a6b96717181 lrc: 2/0,0 mode: --/CR res: [0x2000032e2:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051451.882442:0:46494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cf200/0x85f51a6b96717181 lrc: 0/0,0 mode: --/CR res: [0x2000032e2:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051451.882464:0:46494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cfc00/0x85f51a6b96717188 lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0x8:0x0].0x15f59727 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051451.882477:0:46494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cfc00/0x85f51a6b96717188 lrc: 2/0,0 mode: PR/PR res: [0x2000032e2:0x8:0x0].0x15f59727 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051451.882490:0:46494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cfc00/0x85f51a6b96717188 lrc: 3/0,0 mode: PR/PR res: [0x2000032e2:0x8:0x0].0x15f59727 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051451.882500:0:46494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da7d5cfc00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:1.0:1777051451.882507:0:46494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cfc00/0x85f51a6b96717188 lrc: 3/0,0 mode: PR/PR res: [0x2000032e2:0x8:0x0].0x15f59727 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051451.882520:0:46494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cfc00/0x85f51a6b96717188 lrc: 4/0,0 mode: PR/PR res: [0x2000032e2:0x8:0x0].0x15f59727 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051451.882538:0:46494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0x8:0x0].0x15f59727 (ffff99d94e629e00) 00010000:00010000:1.0:1777051451.882543:0:46494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777051451.882550:0:46494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cfc00/0x85f51a6b96717188 lrc: 2/0,0 mode: --/PR res: [0x2000032e2:0x8:0x0].0x15f59727 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051451.882562:0:46494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cfc00/0x85f51a6b96717188 lrc: 0/0,0 mode: --/PR res: [0x2000032e2:0x8:0x0].0x15f59727 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051451.882656:0:46494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce200/0x85f51a6b9671717a lrc: 0/0,0 mode: --/CR res: [0x2000032e2:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b68b8 expref: 35 pid: 46494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051451.882692:0:46494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cee00/0x85f51a6b9671718f lrc: 3/0,0 mode: PR/PR res: [0x2000032e3:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b68b8 expref: 34 pid: 46494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051451.882707:0:46494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e3:0x9:0x0].0x0 (ffff99d94e629a00) 00010000:00010000:1.0:1777051451.882713:0:46494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1777051451.882718:0:46494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99da7d5cee00, rc 0) 00000100:00100000:1.0:1777051451.882811:0:46494:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95aecdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+34:138770:x1863365426062208:12345-192.168.201.46@tcp:101:lfs.0 Request processed in 1117us (1484us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051451.882836:0:46494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112299 00000100:00100000:3.0:1777051451.889294:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051451.889405:0:8471:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426062336 00000100:00100000:1.0:1777051451.889417:0:8471:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426062336 00000100:00100000:1.0:1777051451.889521:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 8078 00000100:00080000:0.0:1777051451.889533:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1777051451.889546:0:8471:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94c12ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+50:2438:x1863365426062336:12345-192.168.201.46@tcp:101:lfs.0 00010000:00010000:1.0:1777051451.889601:0:8471:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777051451.889635:0:8471:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000019569fc6/0x85f51a6b96717196 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b68bf expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1777051451.889674:0:8471:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x1e5:0x0] initial LVB size: 1048576, mtime: 0x69eba738, atime: 0x69eba738, ctime: 0x69eba738, blocks: 0x800 00010000:00010000:1.0:1777051451.889700:0:8471:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051451.889705:0:8471:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051451.889718:0:8471:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000019569fc6/0x85f51a6b96717196 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b68bf expref: 51 pid: 8471 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051451.889751:0:8471:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000019569fc6/0x85f51a6b96717196 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b68bf expref: 51 pid: 8471 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051451.889774:0:8471:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99da7d5ce800, rc 0) 00000100:00100000:1.0:1777051451.889890:0:8471:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94c12ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+51:2438:x1863365426062336:12345-192.168.201.46@tcp:101:lfs.0 Request processed in 352us (600us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051451.889905:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 8078 00000100:00100000:3.0:1777051451.895886:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051451.896291:0:27882:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426062464 00000100:00100000:0.0:1777051451.896306:0:27882:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426062464 00000100:00100000:0.0:1777051451.896438:0:27882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112300 00000100:00100000:0.0:1777051451.896458:0:27882:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94c12a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+55:138770:x1863365426062464:12345-192.168.201.46@tcp:101:lfs.0 00010000:00010000:0.0:1777051451.896485:0:27882:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051451.896518:0:27882:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d950705e00/0x85f51a6b9671719d lrc: 2/0,0 mode: --/CR res: [0x240000bd0:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b68c6 expref: -99 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051451.896718:0:27882:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d950704a00/0x85f51a6b967171a4 lrc: 3/1,0 mode: --/PR res: [0x240000bd0:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051451.896744:0:27882:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d950704a00/0x85f51a6b967171a4 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 27882 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051451.896776:0:27882:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d950704a00/0x85f51a6b967171a4 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 27882 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1777051451.896782:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00200000:0.0:1777051451.896848:0:27882:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000bd0:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1777051451.896859:0:27882:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1777051451.896917:0:27882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d950705e00/0x85f51a6b9671719d lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b68c6 expref: 57 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051451.896949:0:27882:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99d950704a00/0x85f51a6b967171a4 lrc: 3/0,0 mode: PR/PR res: [0x240000bd0:0x3:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b68c6 expref: 56 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051451.896965:0:27882:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x3:0x0].0x0 (ffff99da42881c00) 00010000:00010000:0.0:1777051451.896971:0:27882:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1777051451.896977:0:27882:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d950704a00, rc 0) 00000100:00100000:0.0:1777051451.897061:0:27882:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94c12a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+56:138770:x1863365426062464:12345-192.168.201.46@tcp:101:lfs.0 Request processed in 608us (1183us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051451.897073:0:27882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112300 00000100:00100000:0.0:1777051451.902473:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051451.902604:0:21368:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426062592 00000100:00100000:1.0:1777051451.902618:0:21368:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426062592 00000100:00100000:1.0:1777051451.903376:0:21368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112301 00000100:00100000:1.0:1777051451.903396:0:21368:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95aecf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+34:138770:x1863365426062592:12345-192.168.201.46@tcp:101:lfs.0 00010000:00010000:1.0:1777051451.903419:0:21368:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777051451.903449:0:21368:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce200/0x85f51a6b967171ab lrc: 2/0,0 mode: --/CR res: [0x2000032e2:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b68cd expref: -99 pid: 21368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051451.903530:0:21368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cfc00/0x85f51a6b967171b2 lrc: 3/1,0 mode: --/PR res: [0x2000032e2:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051451.903552:0:21368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cfc00/0x85f51a6b967171b2 lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051451.903600:0:21368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cfc00/0x85f51a6b967171b2 lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1777051451.903653:0:21368:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000032e2:0x8:0x0]: returning size 4096 00000004:00200000:1.0:1777051451.903661:0:21368:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1777051451.903715:0:21368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce200/0x85f51a6b967171ab lrc: 0/0,0 mode: --/CR res: [0x2000032e2:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b68cd expref: 36 pid: 21368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051451.903743:0:21368:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cfc00/0x85f51a6b967171b2 lrc: 3/0,0 mode: PR/PR res: [0x2000032e2:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b68cd expref: 35 pid: 21368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051451.904091:0:21368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0x8:0x0].0x0 (ffff99d94e629b00) 00010000:00010000:1.0:1777051451.904098:0:21368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1777051451.904103:0:21368:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99da7d5cfc00, rc 0) 00000100:00100000:1.0:1777051451.904188:0:21368:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95aecf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+35:138770:x1863365426062592:12345-192.168.201.46@tcp:101:lfs.0 Request processed in 795us (1717us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051451.904240:0:21368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112301 00000100:00100000:0.0:1777051451.912010:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051451.912119:0:6580:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426062848 00000100:00100000:2.0:1777051451.912134:0:6580:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426062848 00000100:00100000:2.0:1777051451.912228:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112302 00000100:00100000:2.0:1777051451.912251:0:6580:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95aecc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+35:138770:x1863365426062848:12345-192.168.201.46@tcp:58:lfs.0 00000040:00080000:2.0:1777051451.912474:0:6580:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2b:0x0].9, 136 off9416 00000100:00100000:2.0:1777051451.912646:0:6580:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95aecc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+35:138770:x1863365426062848:12345-192.168.201.46@tcp:58:lfs.0 Request processed in 389us (633us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051451.912662:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112302 00000100:00100000:0.0:1777051452.182421:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d950889880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3680:1863365452670080:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1777051452.182509:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051452.182606:0:46498:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452670080 00000100:00100000:1.0:1777051452.182617:0:46498:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452670080 00000100:00100000:1.0:1777051452.182680:0:46498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8271 00000100:00100000:1.0:1777051452.182697:0:46498:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95aecce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:3680:x1863365452670080:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1777051452.182742:0:46498:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4194304 pending 0 free 1441497088 avail 1295257600 00000100:00100000:1.0:1777051452.182820:0:46498:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95aecce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:3680:x1863365452670080:12345-0@lo:41:osp-pre-0-1.0 Request processed in 127us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051452.182832:0:46498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8271 00000100:00100000:0.0:1777051452.182904:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d950889880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3680:1863365452670080:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1777051452.323659:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051452.323733:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051452.323807:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051452.323859:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051452.323890:0:8492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426063104 00000100:00100000:2.0:1777051452.323902:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051452.323909:0:8492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426063104 00000100:00100000:1.0:1777051452.323961:0:103168:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426062976 00000100:00100000:1.0:1777051452.323971:0:103168:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426062976 00000100:00100000:2.0:1777051452.323978:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051452.324016:0:8492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426063232 00000100:00100000:0.0:1777051452.324025:0:8492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426063232 00000100:00100000:1.0:1777051452.324053:0:103168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 188 00000100:00100000:2.0:1777051452.324064:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051452.324079:0:103168:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f345450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:29c4352d-3260-4734-909d-9ea5de9e7fa4+12:2437:x1863365426062976:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:0.0:1777051452.324081:0:8492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426063616 00000100:00100000:0.0:1777051452.324090:0:8492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426063616 00000100:00100000:2.0:1777051452.324130:0:8628:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426063360 00000100:00100000:0.0:1777051452.324371:0:8492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13429 00000100:00100000:0.0:1777051452.324390:0:8492:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95088b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+34:2436:x1863365426063104:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:2.0:1777051452.324455:0:8628:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426063360 00000100:00100000:1.0:1777051452.324462:0:103168:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f345450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:29c4352d-3260-4734-909d-9ea5de9e7fa4+12:2437:x1863365426062976:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 390us (814us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051452.324467:0:8492:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95088b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+34:2436:x1863365426063104:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 76us (726us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051452.324491:0:103168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 188 00000100:00100000:0.0:1777051452.324492:0:8492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13429 00000100:00100000:2.0:1777051452.324590:0:8628:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426063488 00000100:00080000:1.0:1777051452.324593:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1777051452.324599:0:8628:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426063488 00000100:00080000:1.0:1777051452.324604:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1777051452.324610:0:8492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13430 00000100:00080000:1.0:1777051452.324612:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1777051452.324625:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1777051452.324632:0:8492:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95088aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+9:2437:x1863365426063232:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:2.0:1777051452.324665:0:8628:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426063872 00000100:00100000:1.0:1777051452.324667:0:46494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13431 00000100:00100000:2.0:1777051452.324677:0:8628:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426063872 00000100:00100000:0.0:1777051452.324689:0:8492:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95088aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+9:2437:x1863365426063232:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 64us (833us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051452.324700:0:46494:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95088ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+35:2436:x1863365426063616:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:0.0:1777051452.324710:0:8492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13430 00000100:00100000:2.0:1777051452.324756:0:8628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10469 00000100:00100000:1.0:1777051452.324766:0:46494:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95088ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+35:2436:x1863365426063616:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 76us (860us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051452.324776:0:13320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10470 00000100:00100000:2.0:1777051452.324788:0:8628:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d950889500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+51:2436:x1863365426063360:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:1.0:1777051452.324790:0:46494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13431 00000100:00100000:0.0:1777051452.324815:0:13320:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d950889c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+49:2437:x1863365426063488:12345-192.168.201.46@tcp:400:kworker.0 00000100:00080000:1.0:1777051452.324838:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1777051452.324873:0:13320:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d950889c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+49:2437:x1863365426063488:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 75us (916us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051452.324887:0:27887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10471 00000100:00100000:0.0:1777051452.324900:0:13320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10470 00000100:00100000:1.0:1777051452.324908:0:27887:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d950889880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+52:2436:x1863365426063872:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:2.0:1777051452.324915:0:8628:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d950889500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+51:2436:x1863365426063360:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 136us (1100us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051452.324952:0:8628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10469 00000100:00100000:1.0:1777051452.325003:0:27887:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d950889880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+52:2436:x1863365426063872:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 100us (940us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051452.325016:0:27887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10471 00000100:00100000:0.0:1777051452.325952:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051452.326008:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051452.326108:0:10328:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426063744 00000100:00100000:3.0:1777051452.326118:0:10328:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426063744 00000100:00100000:3.0:1777051452.326255:0:10328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13432 00000100:00100000:3.0:1777051452.326276:0:10328:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94ed2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+56:2437:x1863365426063744:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:3.0:1777051452.326351:0:10328:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94ed2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+56:2437:x1863365426063744:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 79us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051452.326363:0:10328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13432 00000100:00100000:1.0:1777051452.326594:0:27884:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426064000 00000100:00100000:1.0:1777051452.326601:0:27884:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426064000 00000100:00100000:1.0:1777051452.326736:0:27884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10472 00000100:00100000:1.0:1777051452.326751:0:27884:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d944070000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+51:2436:x1863365426064000:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:1.0:1777051452.327312:0:27884:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d944070000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+51:2436:x1863365426064000:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 564us (1301us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051452.327325:0:27884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10472 00000040:00080000:3.0:1777051452.440257:0:103189:0:(llog.c:801:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:3.0:1777051452.440268:0:103189:0:(llog_cat.c:158:llog_cat_process_common()) processing log [0x1:0x2b:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1777051452.440315:0:103189:0:(llog.c:858:llog_process_thread()) stop processing plain [0x1:0x2b:0x0] index 10 count 8 00000040:00080000:3.0:1777051452.440328:0:103189:0:(llog.c:858:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00000100:00100000:3.0:1777051452.440519:0:103189:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94c129180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:103189:1863365452670208:192.168.201.46@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1777051452.440680:0:103189:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da4a170300 going to sleep for 11 seconds 00000100:00100000:3.0:1777051452.444206:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051452.444317:0:46497:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426064128 00000100:00100000:0.0:1777051452.444328:0:46497:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426064128 00000100:00100000:1.0:1777051452.444374:0:103189:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94c129180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:103189:1863365452670208:192.168.201.46@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1777051452.444410:0:46497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112303 00000100:00100000:0.0:1777051452.444430:0:46497:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94c129c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:c11b6966-0775-44d2-bdc6-c74c26eb2226+34:138780:x1863365426064128:12345-192.168.201.46@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1777051452.444488:0:46497:0:(mdt_handler.c:7958:mdt_fid2path()) path get [0x2000032e3:0x9:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1777051452.444647:0:46497:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94c129c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:c11b6966-0775-44d2-bdc6-c74c26eb2226+34:138780:x1863365426064128:12345-192.168.201.46@tcp:53:lhsmtool_posix.0 Request processed in 221us (456us total) trans 0 rc -66/-66 00000100:00100000:0.0:1777051452.444670:0:46497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112303 00000100:00100000:0.0:1777051452.448999:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051452.449079:0:8492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426064256 00000100:00100000:3.0:1777051452.449088:0:8492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426064256 00000100:00100000:3.0:1777051452.449442:0:8492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112304 00000100:00100000:3.0:1777051452.449457:0:8492:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d944071500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+9:138780:x1863365426064256:12345-192.168.201.46@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1777051452.449543:0:8492:0:(mdt_handler.c:7958:mdt_fid2path()) path get [0x240000bd3:0x4:0x0] from 18446744073709551615 #-1 00000100:00100000:3.0:1777051452.450644:0:8492:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d944071500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+9:138780:x1863365426064256:12345-192.168.201.46@tcp:53:lhsmtool_posix.0 Request processed in 1187us (1646us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051452.450658:0:8492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112304 00000100:00100000:1.0:1777051452.453923:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051452.454598:0:27882:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426064512 00000100:00100000:0.0:1777051452.454607:0:27882:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426064512 00000100:00100000:0.0:1777051452.454670:0:27882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112305 00000100:00100000:0.0:1777051452.454684:0:27882:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fd60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+34:138780:x1863365426064512:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1777051452.454704:0:27882:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051452.454730:0:27882:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d950704800/0x85f51a6b967171b9 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b68d4 expref: -99 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051452.454847:0:27882:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950705a00/0x85f51a6b967171c0 lrc: 3/1,0 mode: --/PR res: [0x2000032e3:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051452.454869:0:27882:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d950705a00/0x85f51a6b967171c0 lrc: 3/1,0 mode: PR/PR res: [0x2000032e3:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051452.454887:0:27882:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d950705a00/0x85f51a6b967171c0 lrc: 3/1,0 mode: PR/PR res: [0x2000032e3:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1777051452.454904:0:27882:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000032e3:0x9:0x0]: returning size 1048576 00010000:00010000:0.0:1777051452.455058:0:27882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d950704800/0x85f51a6b967171b9 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b68d4 expref: 37 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051452.455082:0:27882:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950705a00/0x85f51a6b967171c0 lrc: 3/0,0 mode: PR/PR res: [0x2000032e3:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b68d4 expref: 36 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051452.455094:0:27882:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e3:0x9:0x0].0x0 (ffff99d94e629a00) 00010000:00010000:0.0:1777051452.455099:0:27882:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1777051452.455105:0:27882:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d950705a00, rc 0) 00000100:00100000:0.0:1777051452.455174:0:27882:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fd60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+36:138780:x1863365426064512:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 Request processed in 492us (1252us total) trans 30064771230 rc 0/0 00000100:00100000:0.0:1777051452.455186:0:27882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112305 00000100:00100000:0.0:1777051452.459726:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051452.459798:0:27885:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426064768 00000100:00100000:2.0:1777051452.459808:0:27885:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426064768 00000100:00100000:2.0:1777051452.459895:0:27885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112306 00000100:00100000:2.0:1777051452.459911:0:27885:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955ebca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c11b6966-0775-44d2-bdc6-c74c26eb2226+36:138780:x1863365426064768:12345-192.168.201.46@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1777051452.459993:0:27885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950711800/0x85f51a6b967171ce lrc: 3/0,1 mode: --/PW res: [0x2000032e3:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051452.460014:0:27885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d950711800/0x85f51a6b967171ce lrc: 3/0,1 mode: PW/PW res: [0x2000032e3:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051452.460030:0:27885:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d950711800/0x85f51a6b967171ce lrc: 3/0,1 mode: PW/PW res: [0x2000032e3:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051452.460231:0:27885:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950711800/0x85f51a6b967171ce lrc: 3/0,1 mode: PW/PW res: [0x2000032e3:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051452.460240:0:27885:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d950711800/0x85f51a6b967171ce lrc: 2/0,0 mode: PW/PW res: [0x2000032e3:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051452.460247:0:27885:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d950711800/0x85f51a6b967171ce lrc: 3/0,0 mode: PW/PW res: [0x2000032e3:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051452.460254:0:27885:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d950711800 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:2.0:1777051452.460259:0:27885:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d950711800/0x85f51a6b967171ce lrc: 3/0,0 mode: PW/PW res: [0x2000032e3:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051452.460267:0:27885:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d950711800/0x85f51a6b967171ce lrc: 4/0,0 mode: PW/PW res: [0x2000032e3:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051452.460278:0:27885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e3:0x9:0x0].0x0 (ffff99d94e629a00) 00010000:00010000:2.0:1777051452.460281:0:27885:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1777051452.460285:0:27885:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d950711800/0x85f51a6b967171ce lrc: 2/0,0 mode: --/PW res: [0x2000032e3:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051452.460291:0:27885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d950711800/0x85f51a6b967171ce lrc: 0/0,0 mode: --/PW res: [0x2000032e3:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051452.460513:0:27885:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955ebca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c11b6966-0775-44d2-bdc6-c74c26eb2226+37:138780:x1863365426064768:12345-192.168.201.46@tcp:57:lhsmtool_posix.0 Request processed in 603us (790us total) trans 30064771231 rc 0/0 00000100:00100000:2.0:1777051452.460528:0:27885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112306 00000040:00080000:1.0:1777051452.460541:0:103189:0:(llog.c:801:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:1.0:1777051452.460550:0:103189:0:(llog_cat.c:158:llog_cat_process_common()) processing log [0x1:0x2b:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1777051452.461853:0:103189:0:(llog.c:858:llog_process_thread()) stop processing plain [0x1:0x2b:0x0] index 64768 count 8 00000040:00080000:1.0:1777051452.461864:0:103189:0:(llog.c:858:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00000100:00100000:1.0:1777051452.464157:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051452.464238:0:6582:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426065024 00000100:00100000:3.0:1777051452.464253:0:6582:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426065024 00000100:00100000:3.0:1777051452.464336:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3411 00000100:00100000:3.0:1777051452.464351:0:6582:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fd62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+37:138780:x1863365426065024:12345-192.168.201.46@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1777051452.464517:0:6582:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fd62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+38:138780:x1863365426065024:12345-192.168.201.46@tcp:35:lhsmtool_posix.0 Request processed in 169us (362us total) trans 30064771232 rc 0/0 00000100:00100000:3.0:1777051452.464531:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3411 00010000:00010000:1.0:1777051452.503348:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1777051452.521256:0:108052:0:(llog.c:801:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:1.0:1777051452.521265:0:108052:0:(llog_cat.c:158:llog_cat_process_common()) processing log [0x1:0x2b:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1777051452.521323:0:108052:0:(llog.c:858:llog_process_thread()) stop processing plain [0x1:0x2b:0x0] index 10 count 8 00000040:00080000:1.0:1777051452.521329:0:108052:0:(llog.c:858:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00000100:00100000:3.0:1777051452.555153:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051452.555191:0:21368:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426065280 00000100:00100000:1.0:1777051452.555219:0:21368:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426065280 00000100:00100000:1.0:1777051452.555314:0:21368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112307 00000100:00100000:1.0:1777051452.555355:0:21368:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94c129f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+35:138781:x1863365426065280:12345-192.168.201.46@tcp:101:cat.0 00010000:00010000:1.0:1777051452.555383:0:21368:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777051452.555412:0:21368:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cfe00/0x85f51a6b967171d5 lrc: 2/0,0 mode: --/CR res: [0x2000032e3:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b68db expref: -99 pid: 21368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051452.555548:0:21368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cf200/0x85f51a6b967171dc lrc: 3/1,0 mode: --/PR res: [0x2000032e3:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051452.555595:0:21368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cf200/0x85f51a6b967171dc lrc: 3/1,0 mode: PR/PR res: [0x2000032e3:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051452.555614:0:21368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cf200/0x85f51a6b967171dc lrc: 3/1,0 mode: PR/PR res: [0x2000032e3:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1777051452.555634:0:21368:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000032e3:0x9:0x0]: returning size 1048576 00010000:00010000:1.0:1777051452.555775:0:21368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cfe00/0x85f51a6b967171d5 lrc: 0/0,0 mode: --/CR res: [0x2000032e3:0x9:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b68db expref: 38 pid: 21368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051452.555801:0:21368:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cf200/0x85f51a6b967171dc lrc: 3/0,0 mode: PR/PR res: [0x2000032e3:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b68db expref: 37 pid: 21368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051452.555815:0:21368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e3:0x9:0x0].0x0 (ffff99d94e629a00) 00010000:00010000:1.0:1777051452.555819:0:21368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1777051452.555824:0:21368:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99da7d5cf200, rc 0) 00000100:00100000:1.0:1777051452.555996:0:21368:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94c129f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+37:138781:x1863365426065280:12345-192.168.201.46@tcp:101:cat.0 Request processed in 669us (851us total) trans 30064771233 rc 0/0 00000100:00100000:1.0:1777051452.556009:0:21368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112307 00000100:00100000:0.0:1777051452.562843:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051452.562939:0:24467:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426065408 00000100:00100000:2.0:1777051452.562952:0:24467:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426065408 00000100:00100000:2.0:1777051452.563072:0:24467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13726 00000100:00100000:2.0:1777051452.563091:0:24467:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955ebdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+37:2439:x1863365426065408:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1777051452.563112:0:24467:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777051452.563142:0:24467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cf200/0x85f51a6b967171dc lrc: 0/0,0 mode: --/PR res: [0x2000032e3:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b68db expref: 37 pid: 21368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051452.563170:0:24467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e3:0x9:0x0].0x0 (ffff99d94e629a00) 00010000:00010000:2.0:1777051452.563178:0:24467:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1777051452.563304:0:24467:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955ebdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+36:2439:x1863365426065408:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 216us (466us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051452.563320:0:24467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13726 00000100:00100000:0.0:1777051452.567293:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051452.567540:0:8476:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426065536 00000100:00100000:2.0:1777051452.567590:0:8476:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426065536 00002000:00100000:2.0:1777051452.567696:0:8476:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x1e5:0x0] (0->1048575) req@ffff99d955ebd500 x1863365426065536/t0(0) o3->2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp:413/0 lens 488/0 e 0 to 0 dl 1777051463 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1777051452.567719:0:8476:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99d955ebd500 with x1863365426065536 ext(0->1048575) 00002000:00010000:2.0:1777051452.567730:0:8476:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99d955ebd500 00000100:00100000:2.0:1777051452.567822:0:8476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 1787 00000100:00100000:2.0:1777051452.567846:0:8476:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955ebd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+51:2436:x1863365426065536:12345-192.168.201.46@tcp:3:cat.0 00000100:00100000:2.0:1777051452.606459:0:8476:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955ebd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+51:2436:x1863365426065536:12345-192.168.201.46@tcp:3:cat.0 Request processed in 38600us (39150us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1777051452.606492:0:8476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 1787 00002000:00100000:2.0:1777051452.606514:0:8476:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x1e5:0x0] (0->1048575) req@ffff99d955ebd500 x1863365426065536/t0(0) o3->2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp:413/0 lens 488/440 e 0 to 0 dl 1777051463 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1777051452.606547:0:8476:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99d955ebd500 with x1863365426065536 ext(0->1048575) 00002000:00010000:2.0:1777051452.606682:0:8476:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99d955ebd500 00000100:00100000:1.0:1777051452.640387:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051452.640721:0:46207:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426065664 00000100:00100000:0.0:1777051452.640738:0:46207:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426065664 00002000:00100000:0.0:1777051452.640841:0:46207:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x1e5:0x0] (1048576->1052671) req@ffff99da7fd61500 x1863365426065664/t0(0) o3->2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp:413/0 lens 488/0 e 0 to 0 dl 1777051463 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1777051452.640864:0:46207:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99da7fd61500 with x1863365426065664 ext(1048576->1052671) 00002000:00010000:0.0:1777051452.640885:0:46207:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99da7fd61500 00000100:00100000:0.0:1777051452.640968:0:46207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 1788 00000100:00100000:0.0:1777051452.640987:0:46207:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fd61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+51:2437:x1863365426065664:12345-192.168.201.46@tcp:3:cat.0 00000100:00100000:0.0:1777051452.641324:0:46207:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fd61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+51:2437:x1863365426065664:12345-192.168.201.46@tcp:3:cat.0 Request processed in 339us (956us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051452.641351:0:46207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 1788 00002000:00100000:0.0:1777051452.641368:0:46207:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x1e5:0x0] (1048576->1052671) req@ffff99da7fd61500 x1863365426065664/t0(0) o3->2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp:413/0 lens 488/440 e 0 to 0 dl 1777051463 ref 1 fl Complete:/600/0 rc 0/0 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1777051452.641397:0:46207:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99da7fd61500 with x1863365426065664 ext(1048576->1052671) 00002000:00010000:0.0:1777051452.641406:0:46207:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99da7fd61500 00000100:00100000:1.0:1777051452.662023:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051452.663121:0:24269:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426065920 00000100:00100000:3.0:1777051452.663136:0:24269:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426065920 00000100:00100000:3.0:1777051452.663668:0:24269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3412 00000100:00100000:3.0:1777051452.663688:0:24269:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fd60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+36:138781:x1863365426065920:12345-192.168.201.46@tcp:35:cat.0 00000100:00100000:3.0:1777051452.664051:0:24269:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fd60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+37:138781:x1863365426065920:12345-192.168.201.46@tcp:35:cat.0 Request processed in 365us (2036us total) trans 30064771234 rc 0/0 00000100:00100000:3.0:1777051452.664075:0:24269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3412 00000100:00100000:3.0:1777051452.686005:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051452.686098:0:6580:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426066176 00000100:00100000:2.0:1777051452.686114:0:6580:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426066176 00000100:00100000:2.0:1777051452.686252:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112308 00000100:00100000:2.0:1777051452.686276:0:6580:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94c129180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+56:138782:x1863365426066176:12345-192.168.201.46@tcp:101:lfs.0 00010000:00010000:2.0:1777051452.686309:0:6580:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051452.686347:0:6580:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d950711800/0x85f51a6b967171ea lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b68e2 expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1777051452.686672:0:6580:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000bd3:0x4:0x0]: returning size 4096 00010000:00010000:2.0:1777051452.686825:0:6580:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99d950711800/0x85f51a6b967171ea lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b68e2 expref: 58 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051452.686855:0:6580:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d9502e3b00) 00010000:00010000:2.0:1777051452.686861:0:6580:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1777051452.686873:0:6580:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d950711800/0x85f51a6b967171ea lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b68e2 expref: 58 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051452.686907:0:6580:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d950711800, rc 0) 00000100:00100000:2.0:1777051452.687021:0:6580:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94c129180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+57:138782:x1863365426066176:12345-192.168.201.46@tcp:101:lfs.0 Request processed in 749us (1024us total) trans 8589934723 rc 301/301 00000100:00100000:2.0:1777051452.687039:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112308 00000100:00100000:1.0:1777051452.692707:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051452.692835:0:46501:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426066432 00000100:00100000:2.0:1777051452.692850:0:46501:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426066432 00000100:00100000:2.0:1777051452.692928:0:46501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3413 00000100:00100000:2.0:1777051452.692954:0:46501:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fd60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+57:138782:x1863365426066432:12345-192.168.201.46@tcp:35:lfs.0 00000100:00100000:2.0:1777051452.693690:0:46501:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fd60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+58:138782:x1863365426066432:12345-192.168.201.46@tcp:35:lfs.0 Request processed in 742us (983us total) trans 8589934724 rc 0/0 00000100:00100000:2.0:1777051452.693709:0:46501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3413 00000100:00100000:3.0:1777051452.695909:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955ebf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3677:1863365452670336:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1777051452.696024:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051452.696708:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94c12b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3678:1863365452670464:0@lo:400:kworker.0 00000100:00100000:2.0:1777051452.696789:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051452.696870:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d943d93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3678:1863365452670976:0@lo:400:kworker.0 00000100:00100000:2.0:1777051452.696930:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051452.696972:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d943d91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452671488:0@lo:400:kworker.0 00000100:00100000:2.0:1777051452.697016:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051452.697049:0:3678:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1777051452.697060:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d943d93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3678:1863365452670848:0@lo:400:kworker.0 00000100:00100000:2.0:1777051452.697237:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051452.697274:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d943d93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3678:1863365452671360:0@lo:400:kworker.0 00000100:00100000:2.0:1777051452.697316:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051452.697373:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94c128a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3679:1863365452670592:0@lo:400:kworker.0 00000100:00100000:2.0:1777051452.697378:0:103163:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452670464 00000100:00100000:2.0:1777051452.697390:0:103163:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452670464 00000100:00100000:3.0:1777051452.697457:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051452.697468:0:103163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1777051452.697486:0:103163:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f345050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9351a01-5b0e-4470-97fd-58b9b4b312a2+23:3678:x1863365452670464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051452.697512:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d943d90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452671104:0@lo:400:kworker.0 00000100:00100000:2.0:1777051452.697613:0:103163:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f345050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9351a01-5b0e-4470-97fd-58b9b4b312a2+23:3678:x1863365452670464:12345-0@lo:400:kworker.0 Request processed in 128us (826us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051452.697628:0:103163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1777051452.697654:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051452.697696:0:46494:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452670976 00000100:00100000:3.0:1777051452.697703:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d943d92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452671616:0@lo:400:kworker.0 00000100:00100000:2.0:1777051452.697708:0:46494:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452670976 00000100:00100000:3.0:1777051452.697771:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051452.697788:0:46494:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452670848 00000100:00100000:2.0:1777051452.697797:0:46494:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452670848 00000100:00100000:3.0:1777051452.697825:0:3679:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1777051452.697845:0:46494:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452671360 00000100:00100000:3.0:1777051452.697845:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94c12a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3679:1863365452670720:0@lo:400:kworker.0 00000100:00100000:2.0:1777051452.697856:0:46494:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452671360 00000100:00100000:2.0:1777051452.697909:0:46494:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452670592 00000100:00100000:3.0:1777051452.697910:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051452.697921:0:46494:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452670592 00000100:00100000:2.0:1777051452.697974:0:46494:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452670720 00000100:00100000:2.0:1777051452.697981:0:46494:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452670720 00000100:00100000:2.0:1777051452.698022:0:46494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13433 00000100:00100000:2.0:1777051452.698035:0:46494:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d9533bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0001-lwp-OST0001_UUID+5:3678:x1863365452670976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051452.698093:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d943d90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452671232:0@lo:400:kworker.0 00000100:00100000:2.0:1777051452.698100:0:46494:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d9533bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0001-lwp-OST0001_UUID+5:3678:x1863365452670976:12345-0@lo:400:kworker.0 Request processed in 66us (1170us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051452.698124:0:46494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13433 00000100:00100000:2.0:1777051452.698153:0:46494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13434 00000100:00100000:2.0:1777051452.698166:0:46494:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d9533bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000-lwp-OST0001_UUID+5:3678:x1863365452670848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051452.698184:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051452.698338:0:6585:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452670336 00000100:00100000:0.0:1777051452.698349:0:6585:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452670336 00000100:00100000:0.0:1777051452.698422:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8272 00000100:00100000:0.0:1777051452.698436:0:6585:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94c12bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3677:x1863365452670336:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1777051452.698475:0:6585:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4194304 pending 0 free 1446100992 avail 1299861504 00000100:00100000:3.0:1777051452.699046:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d943d91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3679:1863365452671744:0@lo:400:kworker.0 00000100:00100000:2.0:1777051452.699060:0:46494:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d9533bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000-lwp-OST0001_UUID+5:3678:x1863365452670848:12345-0@lo:400:kworker.0 Request processed in 890us (1818us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051452.699075:0:46494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13434 00000100:00100000:2.0:1777051452.699109:0:46494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13435 00000100:00100000:3.0:1777051452.699121:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051452.699132:0:46494:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d9533bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000-lwp-MDT0000_UUID+5:3678:x1863365452671360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777051452.699532:0:46494:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d9533bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000-lwp-MDT0000_UUID+5:3678:x1863365452671360:12345-0@lo:400:kworker.0 Request processed in 405us (2212us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051452.699582:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051452.699588:0:46494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13435 00000100:00100000:2.0:1777051452.699621:0:46494:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452671744 00000100:00100000:2.0:1777051452.699629:0:46494:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452671744 00000100:00100000:3.0:1777051452.699663:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051452.699670:0:46494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13436 00000100:00100000:2.0:1777051452.699684:0:46494:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d943d92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000-lwp-OST0000_UUID+5:3679:x1863365452670592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777051452.699761:0:46494:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d943d92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000-lwp-OST0000_UUID+5:3679:x1863365452670592:12345-0@lo:400:kworker.0 Request processed in 80us (2306us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051452.699785:0:46494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13436 00000100:00100000:3.0:1777051452.699798:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051452.699815:0:46494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13437 00000100:00100000:2.0:1777051452.699829:0:46494:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d943d91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0001-lwp-OST0000_UUID+5:3679:x1863365452670720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051452.699864:0:8628:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452671488 00000100:00100000:3.0:1777051452.699874:0:8628:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452671488 00000100:00100000:2.0:1777051452.699884:0:46494:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d943d91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0001-lwp-OST0000_UUID+5:3679:x1863365452670720:12345-0@lo:400:kworker.0 Request processed in 57us (1976us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051452.699894:0:46494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13437 00000100:00100000:2.0:1777051452.699920:0:46494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13438 00000100:00100000:2.0:1777051452.699933:0:46494:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d943d92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000-lwp-MDT0001_UUID+5:3679:x1863365452671744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051452.699948:0:8628:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452671104 00000100:00100000:2.0:1777051452.699977:0:46494:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d943d92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000-lwp-MDT0001_UUID+5:3679:x1863365452671744:12345-0@lo:400:kworker.0 Request processed in 48us (862us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051452.699987:0:46494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13438 00000100:00100000:2.0:1777051452.700021:0:8471:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452671616 00000100:00100000:2.0:1777051452.700028:0:8471:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452671616 00000100:00100000:2.0:1777051452.700072:0:8471:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452671232 00000100:00100000:2.0:1777051452.700078:0:8471:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452671232 00000100:00100000:2.0:1777051452.700434:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10473 00000100:00100000:2.0:1777051452.700453:0:8471:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d9533bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3678:x1863365452671488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777051452.700517:0:8471:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d9533bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3678:x1863365452671488:12345-0@lo:400:kworker.0 Request processed in 69us (3500us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051452.700528:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10473 00000100:00100000:1.0:1777051452.700537:0:13320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10474 00000100:00100000:1.0:1777051452.700591:0:13320:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d943d90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3679:x1863365452671616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051452.700603:0:8628:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452671104 00000100:00100000:0.0:1777051452.700663:0:6585:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94c12bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3677:x1863365452670336:12345-0@lo:41:osp-pre-1-0.0 Request processed in 2228us (4639us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051452.700667:0:13320:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d943d90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3679:x1863365452671616:12345-0@lo:400:kworker.0 Request processed in 118us (2898us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051452.700680:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8272 00000100:00100000:1.0:1777051452.700680:0:13320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10474 00000100:00100000:3.0:1777051452.700694:0:8628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10475 00000100:00100000:3.0:1777051452.700716:0:8628:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d943d91880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3679:x1863365452671232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777051452.700724:0:13320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10476 00000100:00100000:0.0:1777051452.700731:0:6565:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426066560 00000100:00100000:0.0:1777051452.700739:0:6565:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426066560 00000100:00100000:1.0:1777051452.700746:0:13320:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d943d91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3679:x1863365452671104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777051452.700793:0:6565:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426066688 00000100:00100000:0.0:1777051452.700799:0:6565:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426066688 00000100:00100000:1.0:1777051452.700819:0:13320:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d943d91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3679:x1863365452671104:12345-0@lo:400:kworker.0 Request processed in 78us (3170us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051452.700834:0:13320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10476 00000100:00100000:0.0:1777051452.700852:0:6565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13727 00000100:00100000:3.0:1777051452.700866:0:8628:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d943d91880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3679:x1863365452671232:12345-0@lo:400:kworker.0 Request processed in 155us (2682us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051452.700874:0:6565:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da4384e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+38:2436:x1863365426066560:12345-192.168.201.46@tcp:103:lfs.0 00000100:00100000:3.0:1777051452.700893:0:8628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10475 00010000:00010000:0.0:1777051452.700902:0:6565:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1777051452.700910:0:47827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13728 00000100:00100000:1.0:1777051452.700927:0:47827:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da4384ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+38:2436:x1863365426066688:12345-192.168.201.46@tcp:103:lfs.0 00010000:00010000:0.0:1777051452.700938:0:6565:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cf000/0x85f51a6b96716fba lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6825 expref: 38 pid: 27885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051452.700942:0:47827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1777051452.700967:0:47827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3000/0x85f51a6b96716fd6 lrc: 0/0,0 mode: --/PR res: [0x240000bd3:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b682c expref: 37 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051452.700973:0:6565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d9533ab000) 00010000:00010000:0.0:1777051452.700983:0:6565:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1777051452.700990:0:47827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd3:0x4:0x0].0x0 (ffff99d9413d2f00) 00010000:00010000:1.0:1777051452.700997:0:47827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1777051452.701030:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955ebf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3677:1863365452670336:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1777051452.701061:0:6565:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da4384e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+36:2436:x1863365426066560:12345-192.168.201.46@tcp:103:lfs.0 Request processed in 192us (1514us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051452.701061:0:47827:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da4384ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+36:2436:x1863365426066688:12345-192.168.201.46@tcp:103:lfs.0 Request processed in 134us (1399us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051452.701078:0:6565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13727 00000100:00100000:1.0:1777051452.701406:0:47827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13728 00000100:00080000:3.0:1777051452.701458:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1777051452.701468:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1777051452.701475:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1777051452.701481:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1777051452.701622:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d943d93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3678:1863365452670848:0@lo:400:kworker.0 00000100:00100000:2.0:1777051452.701674:0:6593:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426066944 00000100:00100000:2.0:1777051452.701683:0:6593:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426066944 00000100:00100000:2.0:1777051452.701753:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10 00000100:00100000:2.0:1777051452.701767:0:6593:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da4384d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_001:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+58:138782:x1863365426066944:12345-192.168.201.46@tcp:36:lfs.0 00010000:00010000:2.0:1777051452.701882:0:6593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950711800/0x85f51a6b967171f8 lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051452.701900:0:6593:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950711800/0x85f51a6b967171f8 lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051452.701917:0:6593:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950711800/0x85f51a6b967171f8 lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6593 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051452.701946:0:6593:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d9533bed80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0001-mdtlov_UUID:6593:1863365452671872:0@lo:101:mdt_io00_001.0 00000100:00100000:3.0:1777051452.702888:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d943d93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3678:1863365452671360:0@lo:400:kworker.0 00000100:00100000:2.0:1777051452.702918:0:6593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051452.702925:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d943d93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3678:1863365452670976:0@lo:400:kworker.0 00000100:00100000:3.0:1777051452.702950:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d943d91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452671488:0@lo:400:kworker.0 00000100:00100000:3.0:1777051452.702975:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94c12b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3678:1863365452670464:0@lo:400:kworker.0 00000100:00100000:2.0:1777051452.703000:0:6593:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d956bda840 going to sleep for 11 seconds 00000100:00100000:0.0:1777051452.703035:0:6584:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452671872 00000100:00100000:0.0:1777051452.703047:0:6584:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452671872 00000100:00100000:0.0:1777051452.703126:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8273 00000100:00100000:3.0:1777051452.703139:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94c12a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3679:1863365452670720:0@lo:400:kworker.0 00000100:00100000:0.0:1777051452.703150:0:6584:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d9533bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:6593:x1863365452671872:12345-0@lo:101:mdt_io00_001.0 00010000:00010000:0.0:1777051452.703221:0:6584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051452.703255:0:6584:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d774600/0x85f51a6b967171ff lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x85f51a6b967171f8 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051452.703307:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d943d90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452671232:0@lo:400:kworker.0 00010000:00010000:0.0:1777051452.703312:0:6584:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d774600/0x85f51a6b967171ff lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x85f51a6b967171f8 expref: 7 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051452.703338:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d943d91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3679:1863365452671744:0@lo:400:kworker.0 00010000:00010000:0.0:1777051452.703364:0:6584:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d774600/0x85f51a6b967171ff lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b967171f8 expref: 7 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051452.703365:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94c128a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3679:1863365452670592:0@lo:400:kworker.0 00010000:00010000:0.0:1777051452.703394:0:6584:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000004:0x1:0x0].0x0 (ffff99da42881600) 00000100:00100000:3.0:1777051452.703394:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d943d90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452671104:0@lo:400:kworker.0 00010000:00010000:0.0:1777051452.703410:0:6584:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777051452.703417:0:6584:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99da7d774600, rc 0) 00000100:00100000:3.0:1777051452.703426:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d943d92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452671616:0@lo:400:kworker.0 00000100:00100000:0.0:1777051452.703510:0:6584:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d9533bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:6593:x1863365452671872:12345-0@lo:101:mdt_io00_001.0 Request processed in 368us (596us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051452.703523:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8273 00000100:00100000:2.0:1777051452.703698:0:6593:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d9533bed80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0001-mdtlov_UUID:6593:1863365452671872:0@lo:101:mdt_io00_001.0 00010000:00010000:2.0:1777051452.703727:0:6593:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950711800/0x85f51a6b967171f8 lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x85f51a6b967171ff expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051452.703750:0:6593:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950711800/0x85f51a6b967171f8 lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x85f51a6b967171ff expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1777051452.703782:0:6593:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000004:00080000:2.0:1777051452.703799:0:6593:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000100:00100000:2.0:1777051452.703854:0:6593:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d9533bed80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0001-mdtlov_UUID:6593:1863365452672000:0@lo:1000:mdt_io00_001.0 00000100:00100000:2.0:1777051452.703905:0:6593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051452.703951:0:6593:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da5837acc0 going to sleep for 11 seconds 00000100:00100000:0.0:1777051452.704010:0:47208:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452672000 00000100:00100000:0.0:1777051452.704020:0:47208:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452672000 00000100:00100000:0.0:1777051452.704078:0:47208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8274 00000100:00100000:0.0:1777051452.704093:0:47208:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d9533bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+7:6593:x1863365452672000:12345-0@lo:1000:mdt_io00_001.0 00000100:00100000:0.0:1777051452.704250:0:47208:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d9533bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+7:6593:x1863365452672000:12345-0@lo:1000:mdt_io00_001.0 Request processed in 158us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051452.704266:0:47208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8274 00000100:00100000:3.0:1777051452.704353:0:6593:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d9533bed80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0001-mdtlov_UUID:6593:1863365452672000:0@lo:1000:mdt_io00_001.0 00000100:00100000:3.0:1777051452.704467:0:6593:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da4384fb80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0001-mdtlov_UUID:6593:1863365452672128:0@lo:1000:mdt_io00_001.0 00000100:00100000:3.0:1777051452.704518:0:6593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051452.704584:0:6593:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da4a170900 going to sleep for 11 seconds 00000100:00100000:0.0:1777051452.704638:0:6585:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452672128 00000100:00100000:0.0:1777051452.704648:0:6585:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452672128 00000100:00100000:0.0:1777051452.704720:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8275 00000100:00100000:0.0:1777051452.704737:0:6585:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da4384d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:6593:x1863365452672128:12345-0@lo:1000:mdt_io00_001.0 00000100:00100000:0.0:1777051452.704850:0:6585:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da4384d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:6593:x1863365452672128:12345-0@lo:1000:mdt_io00_001.0 Request processed in 114us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051452.704867:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8275 00000100:00100000:3.0:1777051452.704925:0:6593:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da4384fb80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0001-mdtlov_UUID:6593:1863365452672128:0@lo:1000:mdt_io00_001.0 00000100:00100000:3.0:1777051452.705000:0:6593:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da4384fb80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0001-mdtlov_UUID:6593:1863365452672256:0@lo:1000:mdt_io00_001.0 00000100:00100000:3.0:1777051452.705047:0:6593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051452.706076:0:6584:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452672256 00000100:00100000:0.0:1777051452.706089:0:6584:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452672256 00000100:00100000:3.0:1777051452.706101:0:6593:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da4a170300 going to sleep for 11 seconds 00000100:00100000:3.0:1777051452.706526:0:46500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8276 00000100:00100000:3.0:1777051452.706546:0:46500:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da4384dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+7:6593:x1863365452672256:12345-0@lo:1000:mdt_io00_001.0 00000100:00100000:3.0:1777051452.706737:0:46500:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da4384dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+7:6593:x1863365452672256:12345-0@lo:1000:mdt_io00_001.0 Request processed in 196us (1688us total) trans 0 rc 1/1 00000100:00100000:3.0:1777051452.706752:0:46500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8276 00000100:00100000:2.0:1777051452.706828:0:6593:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da4384fb80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0001-mdtlov_UUID:6593:1863365452672256:0@lo:1000:mdt_io00_001.0 00010000:00010000:2.0:1777051452.706907:0:6593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950710e00/0x85f51a6b96717206 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 6593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051452.706924:0:6593:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950710e00/0x85f51a6b96717206 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 6593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051452.706941:0:6593:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950710e00/0x85f51a6b96717206 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x1000000000000 pid: 6593 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051452.706997:0:6593:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d9533bc380 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0001-mdtlov_UUID:6593:1863365452672384:0@lo:101:mdt_io00_001.0 00000100:00100000:2.0:1777051452.707048:0:6593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051452.707390:0:6593:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da5837ae40 going to sleep for 11 seconds 00000100:00100000:3.0:1777051452.707471:0:46498:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452672384 00000100:00100000:3.0:1777051452.707483:0:46498:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452672384 00000100:00100000:3.0:1777051452.707586:0:46498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8277 00000100:00100000:3.0:1777051452.707603:0:46498:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d9533bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+7:6593:x1863365452672384:12345-0@lo:101:mdt_io00_001.0 00010000:00010000:3.0:1777051452.707619:0:46498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777051452.707638:0:46498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2c00/0x85f51a6b9671720d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x85f51a6b96717206 expref: -99 pid: 46498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051452.707667:0:46498:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710400/0x85f51a6b96717069 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b685d expref: 37 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051452.707680:0:46498:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2c00/0x85f51a6b9671720d lrc: 4/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x85f51a6b96717206 expref: 8 pid: 46498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051452.707713:0:46498:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710400/0x85f51a6b96717069 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b685d expref: 37 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051452.707732:0:46498:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710400/0x85f51a6b96717069 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b685d expref: 37 pid: 6581 timeout: 8181 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051452.707749:0:46498:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da4384e300 pname:cluuid:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000_UUID:46498:1863365452672512:192.168.201.46@tcp:104: 00000100:00100000:3.0:1777051452.707869:0:46498:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da43840e40 going to sleep for 11 seconds 00000100:00100000:2.0:1777051452.713649:0:46498:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da4384e300 pname:cluuid:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000_UUID:46498:1863365452672512:192.168.201.46@tcp:104: 00010000:00010000:2.0:1777051452.713698:0:46498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2c00/0x85f51a6b9671720d lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b96717206 expref: 8 pid: 46498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051452.713719:0:46498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d9533ab000) 00010000:00010000:2.0:1777051452.713725:0:46498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777051452.713733:0:46498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2c00/0x85f51a6b9671720d lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b96717206 expref: 8 pid: 46498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051452.713749:0:46498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d9559a2c00, rc 0) 00000100:00100000:2.0:1777051452.713836:0:46498:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d9533bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+8:6593:x1863365452672384:12345-0@lo:101:mdt_io00_001.0 Request processed in 6235us (6784us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051452.713853:0:46498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8277 00000100:00100000:3.0:1777051452.713937:0:6593:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d9533bc380 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0001-mdtlov_UUID:6593:1863365452672384:0@lo:101:mdt_io00_001.0 00010000:00010000:3.0:1777051452.713984:0:6593:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950710e00/0x85f51a6b96717206 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x85f51a6b9671720d expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051452.714041:0:6593:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950710e00/0x85f51a6b96717206 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x85f51a6b9671720d expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051452.714068:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051452.714450:0:6564:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426067072 00000100:00100000:2.0:1777051452.714462:0:6564:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426067072 00010000:00010000:2.0:1777051452.714510:0:6564:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710400/0x85f51a6b96717069 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b685d expref: 38 pid: 6581 timeout: 8181 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051452.714602:0:6564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3946 00000100:00100000:2.0:1777051452.714621:0:6564:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955ebdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+38:2436:x1863365426067072:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1777051452.714645:0:6564:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777051452.714658:0:6564:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710400/0x85f51a6b96717069 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b685d expref: 38 pid: 6581 timeout: 8181 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051452.714686:0:6564:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710400/0x85f51a6b96717069 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b685d expref: 38 pid: 6581 timeout: 8181 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051452.714735:0:6564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710400/0x85f51a6b96717069 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b685d expref: 38 pid: 6581 timeout: 8181 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051452.714759:0:6564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d9533ab000) 00010000:00010000:2.0:1777051452.714770:0:6564:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2c00/0x85f51a6b9671720d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b96717206 expref: 7 pid: 46498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051452.714790:0:6564:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2c00/0x85f51a6b9671720d lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x85f51a6b96717206 expref: 7 pid: 46498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051452.714808:0:6564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2c00/0x85f51a6b9671720d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x85f51a6b96717206 expref: 7 pid: 46498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051452.714854:0:6564:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2c00/0x85f51a6b9671720d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b96717206 expref: 7 pid: 46498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051452.714878:0:6564:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d9533bf480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000_UUID:6564:1863365452672640:0@lo:105: 00000100:00100000:2.0:1777051452.714937:0:6564:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051452.715036:0:6564:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da5837af00 going to sleep for 11 seconds 00000100:00100000:3.0:1777051452.715059:0:99220:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452672640 00000100:00100000:3.0:1777051452.715070:0:99220:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452672640 00000100:00100000:3.0:1777051452.715139:0:99220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1777051452.715150:0:99220:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d9533bed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:6564:x1863365452672640:12345-0@lo:105: 00010000:00010000:3.0:1777051452.715163:0:99220:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950710e00/0x85f51a6b96717206 lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x85f51a6b9671720d expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051452.715175:0:99220:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950710e00/0x85f51a6b96717206 lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x85f51a6b9671720d expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051452.715187:0:99220:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950710e00/0x85f51a6b96717206 lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x85f51a6b9671720d expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051452.715238:0:99220:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950710e00/0x85f51a6b96717206 lrc: 5/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x85f51a6b9671720d expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051452.715255:0:99220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950710e00/0x85f51a6b96717206 lrc: 6/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x85f51a6b9671720d expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051452.715272:0:99220:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950710e00/0x85f51a6b96717206 lrc: 6/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x85f51a6b9671720d expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051452.715325:0:99220:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff99d950710e00) 00010000:00010000:2.0:1777051452.715373:0:6593:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950710e00/0x85f51a6b96717206 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x85f51a6b9671720d expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051452.715392:0:6593:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950710e00/0x85f51a6b96717206 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x85f51a6b9671720d expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051452.715416:0:99220:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d9533bed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:6564:x1863365452672640:12345-0@lo:105: Request processed in 263us (477us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051452.715432:0:99220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000004:00080000:2.0:1777051452.715433:0:6593:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000100:00100000:0.0:1777051452.715491:0:6564:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d9533bf480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000_UUID:6564:1863365452672640:0@lo:105: 00010000:00010000:2.0:1777051452.715497:0:6593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950710200/0x85f51a6b96717214 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x45e84fca bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051452.715514:0:6593:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950710200/0x85f51a6b96717214 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x45e84fca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051452.715531:0:6593:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950710200/0x85f51a6b96717214 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x45e84fca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051452.715570:0:6564:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1777051452.715586:0:6593:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d9533bc380 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0001-mdtlov_UUID:6593:1863365452672768:0@lo:101:mdt_io00_001.0 00000100:00100000:2.0:1777051452.715660:0:6593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051452.715672:0:6564:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955ebdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+37:2436:x1863365426067072:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 1041us (1596us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051452.715693:0:6564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3946 00000100:00100000:2.0:1777051452.715707:0:6593:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da5837af00 going to sleep for 11 seconds 00000100:00100000:2.0:1777051452.715760:0:11727:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452672768 00000100:00100000:2.0:1777051452.715767:0:11727:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452672768 00000100:00100000:2.0:1777051452.715843:0:11727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8278 00000100:00100000:2.0:1777051452.715860:0:11727:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d9533bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:6593:x1863365452672768:12345-0@lo:101:mdt_io00_001.0 00010000:00010000:2.0:1777051452.715879:0:11727:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051452.715904:0:11727:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d950711400/0x85f51a6b9671721b lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x45e84fca bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x85f51a6b96717214 expref: -99 pid: 11727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051452.715937:0:11727:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d950711400/0x85f51a6b9671721b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x45e84fca bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x85f51a6b96717214 expref: 9 pid: 11727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051452.715957:0:11727:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950711400/0x85f51a6b9671721b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x45e84fca bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b96717214 expref: 9 pid: 11727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051452.715971:0:11727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x45e84fca (ffff99d9502e3700) 00010000:00010000:2.0:1777051452.715977:0:11727:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777051452.715982:0:11727:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d950711400, rc 0) 00000100:00100000:2.0:1777051452.716047:0:11727:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d9533bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:6593:x1863365452672768:12345-0@lo:101:mdt_io00_001.0 Request processed in 193us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051452.716057:0:11727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8278 00000100:00100000:2.0:1777051452.716432:0:6593:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d9533bc380 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0001-mdtlov_UUID:6593:1863365452672768:0@lo:101:mdt_io00_001.0 00010000:00010000:2.0:1777051452.716456:0:6593:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950710200/0x85f51a6b96717214 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x45e84fca bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x85f51a6b9671721b expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051452.716471:0:6593:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950710200/0x85f51a6b96717214 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x45e84fca bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x85f51a6b9671721b expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1777051452.716498:0:6593:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:2.0:1777051452.716540:0:6593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950711e00/0x85f51a6b96717222 lrc: 3/0,1 mode: --/EX res: [0x240000bd3:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051452.716584:0:6593:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950711e00/0x85f51a6b96717222 lrc: 3/0,1 mode: --/EX res: [0x240000bd3:0x4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051452.716599:0:6593:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950711e00/0x85f51a6b96717222 lrc: 3/0,1 mode: --/EX res: [0x240000bd3:0x4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6593 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051452.716624:0:6593:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d9533bc380 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0001-mdtlov_UUID:6593:1863365452672896:0@lo:101:mdt_io00_001.0 00000100:00100000:2.0:1777051452.716678:0:6593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051452.716719:0:6593:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da5837af00 going to sleep for 11 seconds 00000100:00100000:0.0:1777051452.717844:0:6584:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452672896 00000100:00100000:0.0:1777051452.717853:0:6584:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452672896 00000100:00100000:0.0:1777051452.717916:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8279 00000100:00100000:0.0:1777051452.717930:0:6584:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942d22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:6593:x1863365452672896:12345-0@lo:101:mdt_io00_001.0 00010000:00010000:0.0:1777051452.717948:0:6584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051452.717970:0:6584:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d775c00/0x85f51a6b96717229 lrc: 2/0,0 mode: --/EX res: [0x240000bd3:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x85f51a6b96717222 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051452.718003:0:6584:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cfa00/0x85f51a6b96717085 lrc: 2/0,0 mode: PR/PR res: [0x240000bd3:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6864 expref: 36 pid: 46494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051452.718020:0:6584:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d775c00/0x85f51a6b96717229 lrc: 4/0,0 mode: --/EX res: [0x240000bd3:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x85f51a6b96717222 expref: 10 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051452.718058:0:6584:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cfa00/0x85f51a6b96717085 lrc: 3/0,0 mode: PR/PR res: [0x240000bd3:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6864 expref: 36 pid: 46494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051452.718080:0:6584:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cfa00/0x85f51a6b96717085 lrc: 4/0,0 mode: PR/PR res: [0x240000bd3:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6864 expref: 36 pid: 46494 timeout: 8181 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051452.718438:0:6584:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955ebe680 pname:cluuid:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000_UUID:6584:1863365452673024:192.168.201.46@tcp:104: 00000100:00100000:0.0:1777051452.718534:0:6584:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da6fc653c0 going to sleep for 11 seconds 00000100:00100000:0.0:1777051452.723368:0:6584:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955ebe680 pname:cluuid:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000_UUID:6584:1863365452673024:192.168.201.46@tcp:104: 00010000:00010000:0.0:1777051452.723408:0:6584:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d775c00/0x85f51a6b96717229 lrc: 3/0,0 mode: --/EX res: [0x240000bd3:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b96717222 expref: 10 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051452.723429:0:6584:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd3:0x4:0x0].0x0 (ffff99d9413d2f00) 00010000:00010000:0.0:1777051452.723436:0:6584:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1777051452.723446:0:6584:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d775c00/0x85f51a6b96717229 lrc: 3/0,0 mode: --/EX res: [0x240000bd3:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b96717222 expref: 10 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051452.723463:0:6584:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99da7d775c00, rc 0) 00000100:00100000:0.0:1777051452.723580:0:6584:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942d22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+10:6593:x1863365452672896:12345-0@lo:101:mdt_io00_001.0 Request processed in 5620us (6871us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051452.723593:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8279 00000100:00100000:2.0:1777051452.726112:0:6593:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d9533bc380 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0001-mdtlov_UUID:6593:1863365452672896:0@lo:101:mdt_io00_001.0 00010000:00010000:2.0:1777051452.726141:0:6593:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950711e00/0x85f51a6b96717222 lrc: 4/0,1 mode: --/EX res: [0x240000bd3:0x4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x85f51a6b96717229 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051452.726445:0:6593:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950711e00/0x85f51a6b96717222 lrc: 4/0,1 mode: --/EX res: [0x240000bd3:0x4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x85f51a6b96717229 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051452.726524:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051452.726645:0:24467:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426067200 00000100:00100000:2.0:1777051452.726673:0:24467:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426067200 00010000:00010000:2.0:1777051452.726727:0:24467:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cfa00/0x85f51a6b96717085 lrc: 4/0,0 mode: PR/PR res: [0x240000bd3:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6864 expref: 37 pid: 46494 timeout: 8181 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051452.726785:0:24467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3947 00000100:00100000:2.0:1777051452.726805:0:24467:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da48748c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+37:2436:x1863365426067200:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1777051452.726827:0:24467:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777051452.726838:0:24467:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cfa00/0x85f51a6b96717085 lrc: 4/0,0 mode: PR/PR res: [0x240000bd3:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6864 expref: 37 pid: 46494 timeout: 8181 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051452.726865:0:24467:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cfa00/0x85f51a6b96717085 lrc: 3/0,0 mode: PR/PR res: [0x240000bd3:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6864 expref: 37 pid: 46494 timeout: 8181 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051452.726900:0:24467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cfa00/0x85f51a6b96717085 lrc: 0/0,0 mode: --/PR res: [0x240000bd3:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6864 expref: 37 pid: 46494 timeout: 8181 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051452.726930:0:24467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd3:0x4:0x0].0x0 (ffff99d9413d2f00) 00010000:00010000:2.0:1777051452.726947:0:24467:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d775c00/0x85f51a6b96717229 lrc: 2/0,0 mode: --/EX res: [0x240000bd3:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b96717222 expref: 9 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051452.726974:0:24467:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d775c00/0x85f51a6b96717229 lrc: 2/0,0 mode: EX/EX res: [0x240000bd3:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x85f51a6b96717222 expref: 9 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051452.727003:0:24467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d775c00/0x85f51a6b96717229 lrc: 3/0,0 mode: EX/EX res: [0x240000bd3:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x85f51a6b96717222 expref: 9 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051452.727087:0:24467:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d775c00/0x85f51a6b96717229 lrc: 3/0,0 mode: EX/EX res: [0x240000bd3:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b96717222 expref: 9 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051452.727112:0:24467:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d942d23480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000_UUID:24467:1863365452673152:0@lo:105: 00000100:00100000:2.0:1777051452.727182:0:24467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051452.727321:0:24467:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da5837af00 going to sleep for 11 seconds 00000100:00100000:2.0:1777051452.727377:0:102039:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452673152 00000100:00100000:2.0:1777051452.727386:0:102039:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452673152 00000100:00100000:2.0:1777051452.727461:0:102039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1777051452.727480:0:102039:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942d20700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0001-mdtlov_UUID+4:24467:x1863365452673152:12345-0@lo:105: 00010000:00010000:2.0:1777051452.727497:0:102039:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950711e00/0x85f51a6b96717222 lrc: 5/0,1 mode: --/EX res: [0x240000bd3:0x4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x85f51a6b96717229 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051452.727513:0:102039:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950711e00/0x85f51a6b96717222 lrc: 5/0,1 mode: --/EX res: [0x240000bd3:0x4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x85f51a6b96717229 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051452.727527:0:102039:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950711e00/0x85f51a6b96717222 lrc: 5/0,1 mode: --/EX res: [0x240000bd3:0x4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x85f51a6b96717229 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051452.727540:0:102039:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950711e00/0x85f51a6b96717222 lrc: 5/0,1 mode: EX/EX res: [0x240000bd3:0x4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x85f51a6b96717229 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051452.727584:0:102039:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950711e00/0x85f51a6b96717222 lrc: 6/0,1 mode: EX/EX res: [0x240000bd3:0x4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x85f51a6b96717229 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051452.727601:0:102039:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950711e00/0x85f51a6b96717222 lrc: 6/0,1 mode: EX/EX res: [0x240000bd3:0x4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x85f51a6b96717229 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051452.727651:0:102039:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff99d950711e00) 00000100:00100000:2.0:1777051452.727738:0:102039:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942d20700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0001-mdtlov_UUID+4:24467:x1863365452673152:12345-0@lo:105: Request processed in 261us (556us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051452.727755:0:102039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1777051452.727846:0:24467:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d942d23480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000_UUID:24467:1863365452673152:0@lo:105: 00010000:00010000:2.0:1777051452.727886:0:24467:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1777051452.727962:0:24467:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da48748c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+36:2436:x1863365426067200:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 1161us (1439us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051452.727977:0:24467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3947 00010000:00010000:2.0:1777051452.728293:0:6593:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950711e00/0x85f51a6b96717222 lrc: 4/0,1 mode: EX/EX res: [0x240000bd3:0x4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x85f51a6b96717229 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051452.728314:0:6593:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950711e00/0x85f51a6b96717222 lrc: 4/0,1 mode: EX/EX res: [0x240000bd3:0x4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x85f51a6b96717229 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051452.728412:0:6593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff99d950711600/0x85f51a6b96717230 lrc: 3/0,1 mode: --/EX res: [0x240000bd3:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051452.728433:0:6593:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d950711600/0x85f51a6b96717230 lrc: 3/0,1 mode: EX/EX res: [0x240000bd3:0x4:0x0].0x0 bits 0x24/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051452.728446:0:6593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d950711600/0x85f51a6b96717230 lrc: 3/0,1 mode: EX/EX res: [0x240000bd3:0x4:0x0].0x0 bits 0x24/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6593 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051452.728717:0:6593:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d942d23480 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0001-mdtlov_UUID:6593:1863365452673280:0@lo:1000:mdt_io00_001.0 00000100:00100000:2.0:1777051452.728778:0:6593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051452.728817:0:6593:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da5837acc0 going to sleep for 11 seconds 00000100:00100000:0.0:1777051452.728830:0:47208:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452673280 00000100:00100000:0.0:1777051452.728842:0:47208:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452673280 00000100:00100000:0.0:1777051452.728916:0:47208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8280 00000100:00100000:0.0:1777051452.728941:0:47208:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942d21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+10:6593:x1863365452673280:12345-0@lo:1000:mdt_io00_001.0 00000100:00100000:0.0:1777051452.729095:0:47208:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942d21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+10:6593:x1863365452673280:12345-0@lo:1000:mdt_io00_001.0 Request processed in 161us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051452.729111:0:47208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8280 00000100:00100000:2.0:1777051452.729452:0:6593:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d942d23480 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0001-mdtlov_UUID:6593:1863365452673280:0@lo:1000:mdt_io00_001.0 00010000:00010000:2.0:1777051452.729624:0:6593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff99d950711600/0x85f51a6b96717230 lrc: 3/0,1 mode: EX/EX res: [0x240000bd3:0x4:0x0].0x0 bits 0x24/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051452.729641:0:6593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d950711600/0x85f51a6b96717230 lrc: 2/0,0 mode: EX/EX res: [0x240000bd3:0x4:0x0].0x0 bits 0x24/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051452.729653:0:6593:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99d950711600/0x85f51a6b96717230 lrc: 3/0,0 mode: EX/EX res: [0x240000bd3:0x4:0x0].0x0 bits 0x24/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051452.729664:0:6593:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d950711600 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:2.0:1777051452.729672:0:6593:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d950711600/0x85f51a6b96717230 lrc: 3/0,0 mode: EX/EX res: [0x240000bd3:0x4:0x0].0x0 bits 0x24/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051452.729685:0:6593:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d950711600/0x85f51a6b96717230 lrc: 4/0,0 mode: EX/EX res: [0x240000bd3:0x4:0x0].0x0 bits 0x24/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051452.729706:0:6593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd3:0x4:0x0].0x0 (ffff99d94e52ac00) 00010000:00010000:2.0:1777051452.729712:0:6593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 24 00010000:00010000:2.0:1777051452.729719:0:6593:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99d950711600/0x85f51a6b96717230 lrc: 2/0,0 mode: --/EX res: [0x240000bd3:0x4:0x0].0x0 bits 0x24/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051452.729729:0:6593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d950711600/0x85f51a6b96717230 lrc: 0/0,0 mode: --/EX res: [0x240000bd3:0x4:0x0].0x0 bits 0x24/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051452.729746:0:6593:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950711e00/0x85f51a6b96717222 lrc: 4/0,1 mode: EX/EX res: [0x240000bd3:0x4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x85f51a6b96717229 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051452.729756:0:6593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950711e00/0x85f51a6b96717222 lrc: 4/0,1 mode: EX/EX res: [0x240000bd3:0x4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x85f51a6b96717229 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051452.729765:0:6593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950711e00/0x85f51a6b96717222 lrc: 3/0,0 mode: EX/EX res: [0x240000bd3:0x4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x85f51a6b96717229 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051452.729798:0:6593:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:2.0:1777051452.729807:0:6593:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:2.0:1777051452.729814:0:6593:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950710e00/0x85f51a6b96717206 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x85f51a6b9671720d expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051452.729823:0:6593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950710e00/0x85f51a6b96717206 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x85f51a6b9671720d expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051452.729833:0:6593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950710e00/0x85f51a6b96717206 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x85f51a6b9671720d expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051452.729866:0:6593:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000004:00080000:2.0:1777051452.729873:0:6593:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:3.0:1777051452.729877:0:13753:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1777051452.729883:0:6567:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777051452.729883:0:6593:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950710200/0x85f51a6b96717214 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x45e84fca bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x85f51a6b9671721b expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051452.729891:0:13753:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950711e00/0x85f51a6b96717222 lrc: 2/0,0 mode: EX/EX res: [0x240000bd3:0x4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x85f51a6b96717229 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051452.729899:0:6567:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950710e00/0x85f51a6b96717206 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x85f51a6b9671720d expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051452.729923:0:6593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950710200/0x85f51a6b96717214 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x45e84fca bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x85f51a6b9671721b expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051452.729968:0:6593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950710200/0x85f51a6b96717214 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x45e84fca bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x85f51a6b9671721b expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051452.729973:0:6567:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d950710e00 already unused, calling callback (ffffffffc177eed0) 00010000:00010000:0.0:1777051452.729989:0:6567:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950710e00/0x85f51a6b96717206 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x85f51a6b9671720d expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051452.729989:0:13753:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d950711e00 already unused, calling callback (ffffffffc177eed0) 00010000:00010000:3.0:1777051452.730005:0:13753:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950711e00/0x85f51a6b96717222 lrc: 3/0,0 mode: EX/EX res: [0x240000bd3:0x4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x85f51a6b96717229 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051452.730009:0:6593:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:0.0:1777051452.730011:0:6567:0:(mdt_handler.c:3963:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950710e00/0x85f51a6b96717206 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x85f51a6b9671720d expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1777051452.730030:0:6593:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:2.0:1777051452.730052:0:6568:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000004:00010000:3.0:1777051452.730052:0:13753:0:(mdt_handler.c:3963:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950711e00/0x85f51a6b96717222 lrc: 3/0,0 mode: EX/EX res: [0x240000bd3:0x4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x85f51a6b96717229 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051452.730065:0:6568:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950710200/0x85f51a6b96717214 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x45e84fca bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x85f51a6b9671721b expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051452.730077:0:6567:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950710e00/0x85f51a6b96717206 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x85f51a6b9671720d expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051452.730105:0:13753:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950711e00/0x85f51a6b96717222 lrc: 2/0,0 mode: --/EX res: [0x240000bd3:0x4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x85f51a6b96717229 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051452.730116:0:6567:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1777051452.730119:0:6568:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d950710200 already unused, calling callback (ffffffffc177eed0) 00010000:00010000:2.0:1777051452.730133:0:6568:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950710200/0x85f51a6b96717214 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x45e84fca bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x85f51a6b9671721b expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051452.730134:0:13753:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00000004:00010000:2.0:1777051452.730155:0:6568:0:(mdt_handler.c:3963:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950710200/0x85f51a6b96717214 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x45e84fca bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x85f51a6b9671721b expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051452.730164:0:6567:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950710e00/0x85f51a6b96717206 lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x85f51a6b9671720d expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051452.730172:0:13753:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950711e00/0x85f51a6b96717222 lrc: 1/0,0 mode: --/EX res: [0x240000bd3:0x4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x85f51a6b96717229 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051452.730203:0:13753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950711e00/0x85f51a6b96717222 lrc: 0/0,0 mode: --/EX res: [0x240000bd3:0x4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x85f51a6b96717229 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051452.730235:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051452.730239:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777051452.730244:0:6568:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950710200/0x85f51a6b96717214 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x45e84fca bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x85f51a6b9671721b expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051452.730247:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777051452.730278:0:6568:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1777051452.730313:0:6593:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950711800/0x85f51a6b967171f8 lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x85f51a6b967171ff expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051452.730318:0:6567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950710e00/0x85f51a6b96717206 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x85f51a6b9671720d expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051452.730324:0:6568:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950710200/0x85f51a6b96717214 lrc: 1/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x45e84fca bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x85f51a6b9671721b expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051452.730354:0:6593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950711800/0x85f51a6b967171f8 lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x85f51a6b967171ff expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051452.730369:0:6593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950711800/0x85f51a6b967171f8 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x85f51a6b967171ff expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051452.730370:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777051452.730378:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777051452.730379:0:6568:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950710200/0x85f51a6b96717214 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x45e84fca bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x85f51a6b9671721b expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051452.730386:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1777051452.730412:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955ebe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452673408:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1777051452.730427:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777051452.730433:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777051452.730439:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1777051452.730455:0:3680:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1777051452.730476:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d942d23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3680:1863365452673664:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1777051452.730484:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1777051452.730529:0:6593:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1777051452.730544:0:3677:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1777051452.730544:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051452.730590:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da4384c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452673536:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1777051452.730597:0:38719:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777051452.730608:0:38719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950711800/0x85f51a6b967171f8 lrc: 2/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x85f51a6b967171ff expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051452.730622:0:38719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d950711800 already unused, calling callback (ffffffffc177eed0) 00010000:00010000:3.0:1777051452.730630:0:38719:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950711800/0x85f51a6b967171f8 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x85f51a6b967171ff expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051452.730641:0:47827:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452673408 00000004:00010000:3.0:1777051452.730645:0:38719:0:(mdt_handler.c:3963:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950711800/0x85f51a6b967171f8 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x85f51a6b967171ff expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051452.730650:0:47827:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452673408 00000100:00100000:0.0:1777051452.730657:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1777051452.730699:0:38719:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950711800/0x85f51a6b967171f8 lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x85f51a6b967171ff expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051452.730711:0:38719:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1777051452.730716:0:47827:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452673664 00000100:00100000:2.0:1777051452.730724:0:47827:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452673664 00000100:00100000:0.0:1777051452.730736:0:9550:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452673536 00010000:00010000:3.0:1777051452.730740:0:38719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950711800/0x85f51a6b967171f8 lrc: 1/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x85f51a6b967171ff expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051452.730744:0:9550:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452673536 00010000:00010000:3.0:1777051452.730759:0:38719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950711800/0x85f51a6b967171f8 lrc: 0/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x85f51a6b967171ff expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051452.730778:0:47827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13729 00000100:00100000:2.0:1777051452.730796:0:47827:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955ebfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:lustre-MDT0001-mdtlov_UUID+12:3677:x1863365452673408:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1777051452.730798:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051452.730807:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777051452.730815:0:47827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777051452.730816:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1777051452.730826:0:9550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13730 00010000:00010000:2.0:1777051452.730844:0:47827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2c00/0x85f51a6b9671720d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x85f51a6b96717206 expref: 12 pid: 46498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051452.730847:0:9550:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942d20000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+12:3680:x1863365452673664:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1777051452.730872:0:9550:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777051452.730876:0:47827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d9533ab000) 00010000:00010000:2.0:1777051452.730885:0:47827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1777051452.730888:0:6593:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da4384d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_001:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+58:138782:x1863365426066944:12345-192.168.201.46@tcp:36:lfs.0 Request processed in 29116us (31089us total) trans 0 rc -114/-114 00010000:00010000:0.0:1777051452.730899:0:9550:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d950711400/0x85f51a6b9671721b lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x45e84fca bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x85f51a6b96717214 expref: 11 pid: 11727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051452.730911:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10 00010000:00010000:0.0:1777051452.730939:0:9550:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x45e84fca (ffff99d9502e3700) 00000100:00100000:2.0:1777051452.730945:0:47827:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955ebfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:lustre-MDT0001-mdtlov_UUID+10:3677:x1863365452673408:12345-0@lo:103:ldlm_bl.0 Request processed in 152us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051452.730959:0:47827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13729 00010000:00010000:0.0:1777051452.730960:0:9550:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1777051452.731000:0:47827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13731 00000100:00100000:3.0:1777051452.731000:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da4384c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3680:1863365452673792:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1777051452.731021:0:9550:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942d20000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+9:3680:x1863365452673664:12345-0@lo:103:ldlm_bl.0 Request processed in 179us (477us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051452.731022:0:47827:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955ebd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:lustre-MDT0001-mdtlov_UUID+9:3677:x1863365452673536:12345-0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1777051452.731045:0:9550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13730 00010000:00010000:2.0:1777051452.731046:0:47827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777051452.731074:0:47827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d775c00/0x85f51a6b96717229 lrc: 0/0,0 mode: --/EX res: [0x240000bd3:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x85f51a6b96717222 expref: 8 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051452.731074:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1777051452.731100:0:47827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd3:0x4:0x0].0x0 (ffff99d9413d2f00) 00010000:00010000:2.0:1777051452.731113:0:47827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1777051452.731138:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d942d23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3680:1863365452673664:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1777051452.731174:0:47827:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955ebd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:lustre-MDT0001-mdtlov_UUID+7:3677:x1863365452673536:12345-0@lo:103:ldlm_bl.0 Request processed in 154us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051452.731489:0:6566:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452673792 00000100:00100000:3.0:1777051452.731499:0:6566:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452673792 00000100:00100000:2.0:1777051452.731542:0:47827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13731 00000100:00100000:2.0:1777051452.731607:0:47827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13732 00000100:00100000:2.0:1777051452.731623:0:47827:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da4384ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:lustre-MDT0001-mdtlov_UUID+7:3680:x1863365452673792:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1777051452.731638:0:47827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777051452.731660:0:47827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d774600/0x85f51a6b967171ff lrc: 0/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x85f51a6b967171f8 expref: 7 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051452.731689:0:47827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000004:0x1:0x0].0x0 (ffff99da42881600) 00010000:00010000:2.0:1777051452.731705:0:47827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1777051452.731770:0:47827:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da4384ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:lustre-MDT0001-mdtlov_UUID+6:3680:x1863365452673792:12345-0@lo:103:ldlm_bl.0 Request processed in 145us (694us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051452.731782:0:47827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13732 00000100:00100000:2.0:1777051452.731942:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da4384c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3680:1863365452673792:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1777051452.731980:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da4384c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452673536:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1777051452.731997:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955ebe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452673408:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1777051452.734658:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051452.734748:0:46494:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426067328 00000100:00100000:3.0:1777051452.734758:0:46494:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426067328 00000100:00100000:3.0:1777051452.734821:0:46494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112309 00000100:00100000:3.0:1777051452.734837:0:46494:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955ebf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+35:138782:x1863365426067328:12345-192.168.201.46@tcp:101:lfs.0 00010000:00010000:3.0:1777051452.734863:0:46494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777051452.734886:0:46494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2800/0x85f51a6b96717237 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b68e9 expref: -99 pid: 46494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051452.734966:0:46494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2600/0x85f51a6b9671723e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051452.734985:0:46494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2600/0x85f51a6b9671723e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051452.735001:0:46494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2600/0x85f51a6b9671723e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1777051452.735052:0:46494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 12288 00000004:00200000:3.0:1777051452.735061:0:46494:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1777051452.735089:0:46494:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2600/0x85f51a6b9671723e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051452.735129:0:46494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2800/0x85f51a6b96717237 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b68e9 expref: 37 pid: 46494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051452.735486:0:46494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2600/0x85f51a6b9671723e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b68e9 expref: 36 pid: 46494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051452.735503:0:46494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d9533ab000) 00010000:00010000:3.0:1777051452.735508:0:46494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1777051452.735513:0:46494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d9559a2600, rc 0) 00000100:00100000:3.0:1777051452.735640:0:46494:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955ebf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+36:138782:x1863365426067328:12345-192.168.201.46@tcp:101:lfs.0 Request processed in 795us (973us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051452.735654:0:46494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112309 00000100:00100000:2.0:1777051452.740192:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051452.740297:0:27882:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426067584 00000100:00100000:0.0:1777051452.740307:0:27882:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426067584 00000100:00100000:0.0:1777051452.740367:0:27882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112310 00000100:00100000:0.0:1777051452.740383:0:27882:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942d21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+36:138782:x1863365426067584:12345-192.168.201.46@tcp:101:lfs.0 00010000:00010000:0.0:1777051452.740405:0:27882:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051452.740428:0:27882:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d774600/0x85f51a6b96717245 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b68f0 expref: -99 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051452.740505:0:27882:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d775c00/0x85f51a6b9671724c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051452.740521:0:27882:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d775c00/0x85f51a6b9671724c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051452.740532:0:27882:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d775c00/0x85f51a6b9671724c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051452.740580:0:27882:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d774400/0x85f51a6b96717253 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x45e84fca bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051452.740595:0:27882:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d774400/0x85f51a6b96717253 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x45e84fca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051452.740607:0:27882:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d774400/0x85f51a6b96717253 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x45e84fca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051452.740693:0:27882:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d774000/0x85f51a6b9671725a lrc: 3/1,0 mode: --/PR res: [0x240000bd3:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051452.740707:0:27882:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d774000/0x85f51a6b9671725a lrc: 3/1,0 mode: PR/PR res: [0x240000bd3:0x4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051452.740721:0:27882:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d774000/0x85f51a6b9671725a lrc: 3/1,0 mode: PR/PR res: [0x240000bd3:0x4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051452.740740:0:27882:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d775c00/0x85f51a6b9671724c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051452.740751:0:27882:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d775c00/0x85f51a6b9671724c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051452.740761:0:27882:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d775c00/0x85f51a6b9671724c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051452.740771:0:27882:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d775c00/0x85f51a6b9671724c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051452.740782:0:27882:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da7d775c00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:0.0:1777051452.740788:0:27882:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d775c00/0x85f51a6b9671724c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051452.740800:0:27882:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d775c00/0x85f51a6b9671724c lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051452.740816:0:27882:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d9533ab000) 00010000:00010000:0.0:1777051452.740820:0:27882:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777051452.740826:0:27882:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d775c00/0x85f51a6b9671724c lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051452.740835:0:27882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d775c00/0x85f51a6b9671724c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051452.740851:0:27882:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d774400/0x85f51a6b96717253 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x45e84fca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051452.740861:0:27882:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d774400/0x85f51a6b96717253 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x45e84fca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051452.740870:0:27882:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d774400/0x85f51a6b96717253 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x45e84fca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051452.740878:0:27882:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da7d774400 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:0.0:1777051452.740883:0:27882:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d774400/0x85f51a6b96717253 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x45e84fca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051452.740892:0:27882:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d774400/0x85f51a6b96717253 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x45e84fca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051452.740903:0:27882:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x45e84fca (ffff99da42881900) 00010000:00010000:0.0:1777051452.740907:0:27882:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777051452.740911:0:27882:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d774400/0x85f51a6b96717253 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x45e84fca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051452.740926:0:27882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d774400/0x85f51a6b96717253 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x45e84fca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051452.740969:0:27882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d774600/0x85f51a6b96717245 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b68f0 expref: 38 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051452.740988:0:27882:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d774000/0x85f51a6b9671725a lrc: 3/0,0 mode: PR/PR res: [0x240000bd3:0x4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b68f0 expref: 37 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051452.741000:0:27882:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd3:0x4:0x0].0x0 (ffff99da42881d00) 00010000:00010000:0.0:1777051452.741004:0:27882:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1777051452.741008:0:27882:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99da7d774000, rc 0) 00000100:00100000:0.0:1777051452.741155:0:27882:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942d21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+37:138782:x1863365426067584:12345-192.168.201.46@tcp:101:lfs.0 Request processed in 775us (968us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051452.741167:0:27882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112310 00000100:00100000:2.0:1777051452.744710:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051452.744794:0:10328:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426067840 00000100:00100000:3.0:1777051452.744803:0:10328:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426067840 00000100:00100000:3.0:1777051452.744855:0:10328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112311 00000100:00100000:3.0:1777051452.744866:0:10328:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942d22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+58:138782:x1863365426067840:12345-192.168.201.46@tcp:101:lfs.0 00010000:00010000:3.0:1777051452.744880:0:10328:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777051452.744895:0:10328:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a3c00/0x85f51a6b96717261 lrc: 2/0,0 mode: --/CR res: [0x240000bd3:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b68f7 expref: -99 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1777051452.745037:0:10328:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000bd3:0x4:0x0]: returning size 4096 00010000:00010000:3.0:1777051452.745154:0:10328:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a3c00/0x85f51a6b96717261 lrc: 1/0,0 mode: --/CR res: [0x240000bd3:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b68f7 expref: 60 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051452.745175:0:10328:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd3:0x4:0x0].0x0 (ffff99d94e52ac00) 00010000:00010000:3.0:1777051452.745180:0:10328:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1777051452.745187:0:10328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a3c00/0x85f51a6b96717261 lrc: 0/0,0 mode: --/CR res: [0x240000bd3:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b68f7 expref: 60 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051452.745277:0:10328:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d9559a3c00, rc 0) 00000100:00100000:3.0:1777051452.745344:0:10328:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942d22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+59:138782:x1863365426067840:12345-192.168.201.46@tcp:101:lfs.0 Request processed in 477us (636us total) trans 8589934725 rc 301/301 00000100:00100000:3.0:1777051452.745355:0:10328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112311 00000100:00100000:3.0:1777051452.750766:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051452.750861:0:6583:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426067968 00000100:00100000:2.0:1777051452.750872:0:6583:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426067968 00000100:00100000:2.0:1777051452.750945:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3414 00000100:00100000:2.0:1777051452.750975:0:6583:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da6ff03c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+59:138782:x1863365426067968:12345-192.168.201.46@tcp:37:lfs.0 00000100:00100000:0.0:1777051452.756513:0:6583:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da6ff03c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+59:138782:x1863365426067968:12345-192.168.201.46@tcp:37:lfs.0 Request processed in 5552us (5748us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051452.756530:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3414 00000100:00100000:3.0:1777051452.760174:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051452.760290:0:6582:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426068096 00000100:00100000:1.0:1777051452.760301:0:6582:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426068096 00000100:00100000:1.0:1777051452.760366:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3415 00000100:00100000:1.0:1777051452.760382:0:6582:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da4384c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+37:138782:x1863365426068096:12345-192.168.201.46@tcp:37:lfs.0 00000100:00100000:1.0:1777051452.764117:0:6582:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da4384c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+37:138782:x1863365426068096:12345-192.168.201.46@tcp:37:lfs.0 Request processed in 3733us (3942us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051452.764133:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3415 00000100:00100000:2.0:1777051452.768458:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051452.768532:0:6581:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426068352 00000100:00100000:3.0:1777051452.768541:0:6581:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426068352 00000100:00100000:3.0:1777051452.768624:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112312 00000100:00100000:3.0:1777051452.768635:0:6581:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942d21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+37:138782:x1863365426068352:12345-192.168.201.46@tcp:101:lfs.0 00010000:00010000:3.0:1777051452.768652:0:6581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777051452.768678:0:6581:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3c00/0x85f51a6b9671726f lrc: 2/0,0 mode: --/CR res: [0x2000032e3:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b68fe expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051452.768800:0:6581:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2800/0x85f51a6b96717276 lrc: 3/0,1 mode: --/PW res: [0x2000032e3:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051452.768821:0:6581:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2800/0x85f51a6b96717276 lrc: 3/0,1 mode: PW/PW res: [0x2000032e3:0x9:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051452.768837:0:6581:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2800/0x85f51a6b96717276 lrc: 3/0,1 mode: PW/PW res: [0x2000032e3:0x9:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1777051452.768853:0:6581:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000032e3:0x9:0x0]: returning size 1048576 00010000:00010000:3.0:1777051452.768995:0:6581:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3c00/0x85f51a6b9671726f lrc: 0/0,0 mode: --/CR res: [0x2000032e3:0x9:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b68fe expref: 40 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051452.769027:0:6581:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2800/0x85f51a6b96717276 lrc: 3/0,0 mode: PW/PW res: [0x2000032e3:0x9:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b68fe expref: 39 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051452.769037:0:6581:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e3:0x9:0x0].0x0 (ffff99d94e629a00) 00010000:00010000:3.0:1777051452.769041:0:6581:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1777051452.769044:0:6581:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d9559a2800, rc 0) 00000100:00100000:3.0:1777051452.769388:0:6581:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942d21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+39:138782:x1863365426068352:12345-192.168.201.46@tcp:101:lfs.0 Request processed in 466us (646us total) trans 30064771235 rc 0/0 00000100:00100000:3.0:1777051452.769400:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112312 00000100:00100000:3.0:1777051452.772043:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051452.772473:0:27884:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426068480 00000100:00100000:1.0:1777051452.772482:0:27884:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426068480 00000100:00100000:1.0:1777051452.772547:0:27884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 8079 00000100:00100000:1.0:1777051452.772586:0:27884:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da4384f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+51:2437:x1863365426068480:12345-192.168.201.46@tcp:1:lfs.0 00010000:00010000:1.0:1777051452.772625:0:27884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f6fa49c7/0x85f51a6b96717284 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 27884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051452.772659:0:27884:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000019569fc6/0x85f51a6b96717196 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b68bf expref: 51 pid: 8471 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051452.772953:0:27884:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051452.772958:0:27884:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051452.772965:0:27884:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f6fa49c7/0x85f51a6b96717284 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 27884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051452.773020:0:27884:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000019569fc6/0x85f51a6b96717196 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b68bf expref: 51 pid: 8471 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051452.773044:0:27884:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000019569fc6/0x85f51a6b96717196 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b68bf expref: 51 pid: 8471 timeout: 8181 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051452.773070:0:27884:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7fd63800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:27884:1863365452673920:192.168.201.46@tcp:104: 00000100:00100000:1.0:1777051452.773142:0:27884:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d94480c0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1777051452.775778:0:27884:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7fd63800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:27884:1863365452673920:192.168.201.46@tcp:104: 00010000:00010000:1.0:1777051452.776082:0:27884:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f6fa49c7/0x85f51a6b96717284 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 27884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051452.778680:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051452.779067:0:6566:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426068608 00000100:00100000:2.0:1777051452.779076:0:6566:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426068608 00010000:00010000:2.0:1777051452.779113:0:6566:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000019569fc6/0x85f51a6b96717196 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b68bf expref: 52 pid: 8471 timeout: 8181 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051452.779165:0:6566:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3948 00000100:00100000:2.0:1777051452.779177:0:6566:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da4384ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+52:2436:x1863365426068608:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1777051452.779257:0:6566:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777051452.779287:0:6566:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000019569fc6/0x85f51a6b96717196 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b68bf expref: 52 pid: 8471 timeout: 8181 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051452.779309:0:6566:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000019569fc6/0x85f51a6b96717196 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b68bf expref: 52 pid: 8471 timeout: 8181 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051452.779353:0:6566:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000019569fc6/0x85f51a6b96717196 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b68bf expref: 52 pid: 8471 timeout: 8181 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051452.779373:0:6566:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777051452.779376:0:6566:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777051452.779383:0:6566:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f6fa49c7/0x85f51a6b96717284 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 27884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051452.779397:0:6566:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f6fa49c7/0x85f51a6b96717284 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 27884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051452.779439:0:6566:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1777051452.779499:0:27884:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f6fa49c7/0x85f51a6b96717284 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 27884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051452.779503:0:6566:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da4384ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+51:2436:x1863365426068608:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 325us (822us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051452.779531:0:6566:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3948 00010000:00010000:1.0:1777051452.779576:0:27884:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f6fa49c7/0x85f51a6b96717284 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 27884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051452.779615:0:27884:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f6fa49c7/0x85f51a6b96717284 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 27884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051452.779629:0:27884:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f6fa49c7/0x85f51a6b96717284 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 27884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051452.779642:0:27884:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f6fa49c7/0x85f51a6b96717284 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 27884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051452.779653:0:27884:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da7d5cf200 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:1.0:1777051452.779661:0:27884:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f6fa49c7/0x85f51a6b96717284 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 27884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051452.779675:0:27884:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f6fa49c7/0x85f51a6b96717284 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 27884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051452.779701:0:27884:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f6fa49c7/0x85f51a6b96717284 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 27884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051452.779713:0:27884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f6fa49c7/0x85f51a6b96717284 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 27884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051452.779792:0:27884:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da4384f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+50:2437:x1863365426068480:12345-192.168.201.46@tcp:1:lfs.0 Request processed in 7208us (7750us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051452.779804:0:27884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 8079 00000100:00100000:3.0:1777051452.783078:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051452.784011:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051452.784137:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051452.784219:0:47597:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426068736 00000100:00100000:0.0:1777051452.784228:0:47597:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426068736 00000100:00100000:0.0:1777051452.784305:0:47597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13733 00000100:00100000:0.0:1777051452.784326:0:47597:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da4384df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+59:2437:x1863365426068736:12345-192.168.201.46@tcp:103:lfs.0 00010000:00010000:0.0:1777051452.784369:0:47597:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777051452.784390:0:47597:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d950711a00/0x85f51a6b9671700e lrc: 0/0,0 mode: --/PR res: [0x240000bd3:0x4:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6841 expref: 59 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051452.784439:0:47597:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd3:0x4:0x0].0x0 (ffff99d94e52ac00) 00010000:00010000:0.0:1777051452.784446:0:47597:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1777051452.784460:0:47827:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426068864 00000100:00100000:2.0:1777051452.784471:0:47827:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426068864 00000100:00100000:0.0:1777051452.784527:0:47597:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da4384df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+58:2437:x1863365426068736:12345-192.168.201.46@tcp:103:lfs.0 Request processed in 208us (1449us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051452.784536:0:47827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13734 00000100:00100000:2.0:1777051452.784583:0:47827:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da4874b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+39:2437:x1863365426068864:12345-192.168.201.46@tcp:103:lfs.0 00000100:00100000:0.0:1777051452.784598:0:47597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13733 00010000:00010000:2.0:1777051452.784602:0:47827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777051452.784631:0:47827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cfc00/0x85f51a6b967171b2 lrc: 0/0,0 mode: --/PR res: [0x2000032e2:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b68cd expref: 39 pid: 21368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051452.784654:0:47827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0x8:0x0].0x0 (ffff99d94e629b00) 00010000:00010000:2.0:1777051452.784669:0:47827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1777051452.784714:0:47827:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da4874b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+38:2437:x1863365426068864:12345-192.168.201.46@tcp:103:lfs.0 Request processed in 164us (704us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051452.784722:0:47827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13734 00000100:00100000:2.0:1777051452.785227:0:6564:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426068992 00000100:00100000:2.0:1777051452.785236:0:6564:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426068992 00000100:00100000:2.0:1777051452.785296:0:6564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13735 00000100:00100000:3.0:1777051452.785308:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051452.785320:0:6564:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da4384c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+58:2437:x1863365426068992:12345-192.168.201.46@tcp:103:lfs.0 00010000:00010000:2.0:1777051452.785336:0:6564:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777051452.785359:0:6564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d950704a00/0x85f51a6b967171a4 lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b68c6 expref: 58 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051452.785364:0:6594:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426069248 00000100:00100000:0.0:1777051452.785374:0:6594:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426069248 00010000:00010000:2.0:1777051452.785386:0:6564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x3:0x0].0x0 (ffff99da42881c00) 00010000:00010000:2.0:1777051452.785397:0:6564:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1777051452.785445:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 11 00000100:00100000:2.0:1777051452.785448:0:6564:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da4384c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+57:2437:x1863365426068992:12345-192.168.201.46@tcp:103:lfs.0 Request processed in 132us (1307us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051452.785468:0:6564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13735 00000100:00100000:0.0:1777051452.785470:0:6594:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da4384c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+38:138782:x1863365426069248:12345-192.168.201.46@tcp:36:lfs.0 00010000:00010000:0.0:1777051452.785573:0:6594:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777051452.785612:0:6594:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cee00/0x85f51a6b9671718f lrc: 0/0,0 mode: --/PR res: [0x2000032e3:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b68b8 expref: 38 pid: 46494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051452.785633:0:6594:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e3:0x9:0x0].0x0 (ffff99d94e629a00) 00010000:00010000:0.0:1777051452.785638:0:6594:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1777051452.785666:0:6594:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d775000/0x85f51a6b9671728b lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051452.785683:0:6594:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d775000/0x85f51a6b9671728b lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051452.785697:0:6594:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d775000/0x85f51a6b9671728b lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6594 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1777051452.785720:0:6594:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000bd3:0x4:0x0] 00000100:00100000:0.0:1777051452.785782:0:6594:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955ebce00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6594:1863365452674048:0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1777051452.785837:0:6594:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051452.785873:0:6594:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d95c67b600 going to sleep for 11 seconds 00000100:00100000:2.0:1777051452.785926:0:11727:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452674048 00000100:00100000:2.0:1777051452.785935:0:11727:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452674048 00000100:00100000:2.0:1777051452.786075:0:11727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8281 00000100:00100000:2.0:1777051452.786092:0:11727:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955ebc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6594:x1863365452674048:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1777051452.786210:0:11727:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955ebc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6594:x1863365452674048:12345-0@lo:1000:mdt_io00_002.0 Request processed in 121us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051452.786221:0:11727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8281 00000100:00100000:0.0:1777051452.786312:0:6594:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955ebce00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6594:1863365452674048:0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1777051452.787142:0:6594:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955ebce00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6594:1863365452674176:0@lo:403:mdt_io00_002.0 00000100:00100000:0.0:1777051452.787191:0:6594:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051452.787250:0:6594:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d95c67b600 going to sleep for 11 seconds 00000100:00100000:2.0:1777051452.787298:0:6585:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452674176 00000100:00100000:2.0:1777051452.787306:0:6585:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452674176 00000100:00100000:2.0:1777051452.787353:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8282 00000100:00100000:2.0:1777051452.787364:0:6585:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955ebfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6594:x1863365452674176:12345-0@lo:403:mdt_io00_002.0 00000100:00100000:2.0:1777051452.790347:0:6585:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955ebfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6594:x1863365452674176:12345-0@lo:403:mdt_io00_002.0 Request processed in 2976us (3149us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051452.790363:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8282 00000100:00100000:0.0:1777051452.790405:0:6594:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955ebce00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6594:1863365452674176:0@lo:403:mdt_io00_002.0 00010000:00010000:0.0:1777051452.791500:0:6594:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff99da7d775a00/0x85f51a6b96717292 lrc: 3/0,1 mode: --/CW res: [0x240000bd0:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051452.791511:0:6594:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff99da7d775a00/0x85f51a6b96717292 lrc: 3/0,1 mode: --/CW res: [0x240000bd0:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051452.791522:0:6594:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff99da7d775a00/0x85f51a6b96717292 lrc: 3/0,1 mode: --/CW res: [0x240000bd0:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6594 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051452.791539:0:6594:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955ebce00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6594:1863365452674304:0@lo:101:mdt_io00_002.0 00000100:00100000:0.0:1777051452.791603:0:6594:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051452.791629:0:6594:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d95c67b600 going to sleep for 11 seconds 00000100:00100000:2.0:1777051452.791684:0:46498:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452674304 00000100:00100000:2.0:1777051452.791693:0:46498:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452674304 00000100:00100000:2.0:1777051452.792008:0:46498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8283 00000100:00100000:2.0:1777051452.792021:0:46498:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955ebd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+6:6594:x1863365452674304:12345-0@lo:101:mdt_io00_002.0 00010000:00010000:2.0:1777051452.792038:0:46498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051452.792060:0:46498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d950711a00/0x85f51a6b96717299 lrc: 2/0,0 mode: --/CW res: [0x240000bd0:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x85f51a6b96717292 expref: -99 pid: 46498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051452.792092:0:46498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d950711a00/0x85f51a6b96717299 lrc: 3/0,0 mode: CW/CW res: [0x240000bd0:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x85f51a6b96717292 expref: 7 pid: 46498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051452.792111:0:46498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99d950711a00/0x85f51a6b96717299 lrc: 3/0,0 mode: CW/CW res: [0x240000bd0:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b96717292 expref: 7 pid: 46498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051452.792124:0:46498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x3:0x0].0x0 (ffff99d9502e3900) 00010000:00010000:2.0:1777051452.792128:0:46498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777051452.792133:0:46498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d950711a00, rc 0) 00000100:00100000:2.0:1777051452.792457:0:46498:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955ebd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+7:6594:x1863365452674304:12345-0@lo:101:mdt_io00_002.0 Request processed in 436us (850us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051452.792469:0:46498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8283 00000100:00100000:0.0:1777051452.792625:0:6594:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955ebce00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6594:1863365452674304:0@lo:101:mdt_io00_002.0 00010000:00010000:0.0:1777051452.792647:0:6594:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff99da7d775a00/0x85f51a6b96717292 lrc: 4/0,1 mode: CW/CW res: [0x240000bd0:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x85f51a6b96717299 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051452.792662:0:6594:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff99da7d775a00/0x85f51a6b96717292 lrc: 4/0,1 mode: CW/CW res: [0x240000bd0:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x85f51a6b96717299 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1777051452.792684:0:6594:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000bd0:0x3:0x0] 00010000:00010000:0.0:1777051452.792709:0:6594:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff99da7d775800/0x85f51a6b967172a0 lrc: 3/0,1 mode: --/PW res: [0x240000bd0:0x3:0x0].0x15f59727 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051452.792722:0:6594:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff99da7d775800/0x85f51a6b967172a0 lrc: 3/0,1 mode: --/PW res: [0x240000bd0:0x3:0x0].0x15f59727 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051452.792730:0:6594:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff99da7d775800/0x85f51a6b967172a0 lrc: 3/0,1 mode: --/PW res: [0x240000bd0:0x3:0x0].0x15f59727 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6594 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051452.792742:0:6594:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955ebce00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6594:1863365452674432:0@lo:101:mdt_io00_002.0 00000100:00100000:0.0:1777051452.792767:0:6594:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051452.792791:0:6594:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d95c67b600 going to sleep for 11 seconds 00000100:00100000:3.0:1777051452.792859:0:46500:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452674432 00000100:00100000:3.0:1777051452.792867:0:46500:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452674432 00000100:00100000:3.0:1777051452.792922:0:46500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8284 00000100:00100000:3.0:1777051452.792935:0:46500:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955ebe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+7:6594:x1863365452674432:12345-0@lo:101:mdt_io00_002.0 00010000:00010000:3.0:1777051452.792958:0:46500:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777051452.793036:0:46500:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a3c00/0x85f51a6b967172a7 lrc: 2/0,0 mode: --/PW res: [0x240000bd0:0x3:0x0].0x15f59727 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x85f51a6b967172a0 expref: -99 pid: 46500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051452.793072:0:46500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a3c00/0x85f51a6b967172a7 lrc: 3/0,0 mode: PW/PW res: [0x240000bd0:0x3:0x0].0x15f59727 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x85f51a6b967172a0 expref: 8 pid: 46500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051452.793101:0:46500:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a3c00/0x85f51a6b967172a7 lrc: 3/0,0 mode: PW/PW res: [0x240000bd0:0x3:0x0].0x15f59727 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b967172a0 expref: 8 pid: 46500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051452.793114:0:46500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x3:0x0].0x15f59727 (ffff99d9413d2300) 00010000:00010000:3.0:1777051452.793118:0:46500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777051452.793122:0:46500:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d9559a3c00, rc 0) 00000100:00100000:3.0:1777051452.793178:0:46500:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955ebe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+8:6594:x1863365452674432:12345-0@lo:101:mdt_io00_002.0 Request processed in 245us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051452.793234:0:46500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8284 00000100:00100000:0.0:1777051452.793237:0:6594:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955ebce00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6594:1863365452674432:0@lo:101:mdt_io00_002.0 00010000:00010000:0.0:1777051452.793262:0:6594:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff99da7d775800/0x85f51a6b967172a0 lrc: 4/0,1 mode: PW/PW res: [0x240000bd0:0x3:0x0].0x15f59727 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x85f51a6b967172a7 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051452.793278:0:6594:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff99da7d775800/0x85f51a6b967172a0 lrc: 4/0,1 mode: PW/PW res: [0x240000bd0:0x3:0x0].0x15f59727 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x85f51a6b967172a7 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1777051452.793299:0:6594:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000bd0:0x3:0x0] 00010000:00010000:0.0:1777051452.793321:0:6594:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d774200/0x85f51a6b967172ae lrc: 3/0,1 mode: --/CW res: [0x2000032e2:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051452.793335:0:6594:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d774200/0x85f51a6b967172ae lrc: 3/0,1 mode: CW/CW res: [0x2000032e2:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051452.793348:0:6594:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d774200/0x85f51a6b967172ae lrc: 3/0,1 mode: CW/CW res: [0x2000032e2:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051452.793365:0:6594:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d775e00/0x85f51a6b967172b5 lrc: 3/0,1 mode: --/PW res: [0x2000032e2:0x8:0x0].0x15f59727 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051452.793382:0:6594:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d775e00/0x85f51a6b967172b5 lrc: 3/0,1 mode: PW/PW res: [0x2000032e2:0x8:0x0].0x15f59727 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051452.793393:0:6594:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d775e00/0x85f51a6b967172b5 lrc: 3/0,1 mode: PW/PW res: [0x2000032e2:0x8:0x0].0x15f59727 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051452.793439:0:6594:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d775600/0x85f51a6b967172bc lrc: 3/0,1 mode: --/EX res: [0x2000032e3:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051452.793457:0:6594:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99d950705a00/0x85f51a6b967171c0 lrc: 2/0,0 mode: PR/PR res: [0x2000032e3:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b68d4 expref: 35 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051452.793471:0:6594:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2800/0x85f51a6b96717276 lrc: 2/0,0 mode: PW/PW res: [0x2000032e3:0x9:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b68fe expref: 37 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051452.793483:0:6594:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d775600/0x85f51a6b967172bc lrc: 5/0,1 mode: --/EX res: [0x2000032e3:0x9:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051452.793515:0:6594:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2800/0x85f51a6b96717276 lrc: 3/0,0 mode: PW/PW res: [0x2000032e3:0x9:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b68fe expref: 37 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051452.793534:0:6594:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2800/0x85f51a6b96717276 lrc: 4/0,0 mode: PW/PW res: [0x2000032e3:0x9:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b68fe expref: 37 pid: 6581 timeout: 8181 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051452.793613:0:6594:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955ebce00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000_UUID:6594:1863365452674560:192.168.201.46@tcp:104: 00010000:00010000:0.0:1777051452.793714:0:6594:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99d950705a00/0x85f51a6b967171c0 lrc: 3/0,0 mode: PR/PR res: [0x2000032e3:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b68d4 expref: 35 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051452.793742:0:6594:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950705a00/0x85f51a6b967171c0 lrc: 4/0,0 mode: PR/PR res: [0x2000032e3:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b68d4 expref: 35 pid: 27882 timeout: 8181 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051452.793760:0:6594:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955ebdc00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000_UUID:6594:1863365452674688:192.168.201.46@tcp:104: 00000100:00100000:0.0:1777051452.793800:0:6594:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d95c67b600 going to sleep for 11 seconds 00010000:00010000:0.0:1777051452.796949:0:6594:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.201.46@tcp) returned -22 from blocking AST (req@00000000e6ef88d0 x1863365452674560) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2800/0x85f51a6b96717276 lrc: 4/0,0 mode: PW/PW res: [0x2000032e3:0x9:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b68fe expref: 37 pid: 6581 timeout: 8181 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051452.796976:0:6594:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2800/0x85f51a6b96717276 lrc: 3/0,0 mode: PW/PW res: [0x2000032e3:0x9:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b68fe expref: 37 pid: 6581 timeout: 8181 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051452.797002:0:6594:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2800/0x85f51a6b96717276 lrc: 0/0,0 mode: --/PW res: [0x2000032e3:0x9:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b68fe expref: 37 pid: 6581 timeout: 8181 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051452.797021:0:6594:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955ebce00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000_UUID:6594:1863365452674560:192.168.201.46@tcp:104: 00000100:00100000:0.0:1777051452.799784:0:6594:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955ebdc00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000_UUID:6594:1863365452674688:192.168.201.46@tcp:104: 00010000:00010000:0.0:1777051452.799832:0:6594:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e3:0x9:0x0].0x0 (ffff99d94e629a00) 00010000:00010000:0.0:1777051452.799841:0:6594:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d775600/0x85f51a6b967172bc lrc: 3/0,1 mode: --/EX res: [0x2000032e3:0x9:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051452.799855:0:6594:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d775600/0x85f51a6b967172bc lrc: 3/0,1 mode: --/EX res: [0x2000032e3:0x9:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051452.799866:0:6594:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d775600/0x85f51a6b967172bc lrc: 3/0,1 mode: --/EX res: [0x2000032e3:0x9:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051452.799888:0:6594:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d775600/0x85f51a6b967172bc lrc: 3/0,1 mode: --/EX res: [0x2000032e3:0x9:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6594 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051452.800581:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051452.800689:0:6566:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426069376 00000100:00100000:2.0:1777051452.800699:0:6566:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426069376 00010000:00010000:2.0:1777051452.800743:0:6566:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d950705a00/0x85f51a6b967171c0 lrc: 4/0,0 mode: PR/PR res: [0x2000032e3:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b68d4 expref: 36 pid: 27882 timeout: 8181 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051452.800799:0:6566:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3949 00000100:00100000:2.0:1777051452.800812:0:6566:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da4384e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+36:2437:x1863365426069376:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1777051452.800831:0:6566:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777051452.800841:0:6566:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99d950705a00/0x85f51a6b967171c0 lrc: 4/0,0 mode: PR/PR res: [0x2000032e3:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b68d4 expref: 36 pid: 27882 timeout: 8181 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051452.800863:0:6566:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99d950705a00/0x85f51a6b967171c0 lrc: 3/0,0 mode: PR/PR res: [0x2000032e3:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b68d4 expref: 36 pid: 27882 timeout: 8181 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051452.800889:0:6566:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d950705a00/0x85f51a6b967171c0 lrc: 0/0,0 mode: --/PR res: [0x2000032e3:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b68d4 expref: 36 pid: 27882 timeout: 8181 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051452.800909:0:6566:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e3:0x9:0x0].0x0 (ffff99d94e629a00) 00010000:00010000:2.0:1777051452.800916:0:6566:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d775600/0x85f51a6b967172bc lrc: 3/0,1 mode: --/EX res: [0x2000032e3:0x9:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051452.800929:0:6566:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d775600/0x85f51a6b967172bc lrc: 3/0,1 mode: EX/EX res: [0x2000032e3:0x9:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051452.800941:0:6566:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d775600/0x85f51a6b967172bc lrc: 4/0,1 mode: EX/EX res: [0x2000032e3:0x9:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051452.801000:0:6566:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1777051452.801058:0:6594:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d775600/0x85f51a6b967172bc lrc: 3/0,1 mode: EX/EX res: [0x2000032e3:0x9:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051452.801074:0:6594:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d775600/0x85f51a6b967172bc lrc: 3/0,1 mode: EX/EX res: [0x2000032e3:0x9:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6594 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051452.801088:0:6566:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da4384e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+35:2437:x1863365426069376:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 271us (502us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051452.801114:0:6566:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3949 00000100:00100000:0.0:1777051452.801283:0:6594:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955ebdc00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6594:1863365452674816:0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1777051452.801347:0:6594:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051452.801420:0:6594:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d95c67b3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1777051452.801460:0:6584:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452674816 00000100:00100000:2.0:1777051452.801469:0:6584:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452674816 00000100:00100000:2.0:1777051452.801540:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8285 00000100:00100000:2.0:1777051452.801581:0:6584:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955ebce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:6594:x1863365452674816:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1777051452.801751:0:6584:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955ebce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:6594:x1863365452674816:12345-0@lo:1000:mdt_io00_002.0 Request processed in 198us (403us total) trans 0 rc -2/-2 00000100:00100000:2.0:1777051452.801763:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8285 00000100:00100000:0.0:1777051452.802030:0:6594:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955ebdc00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6594:1863365452674816:0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1777051452.802097:0:6594:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955ebdc00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6594:1863365452674944:0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1777051452.802138:0:6594:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051452.802469:0:6594:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d95c67b3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1777051452.802531:0:47208:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452674944 00000100:00100000:2.0:1777051452.802540:0:47208:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452674944 00000100:00100000:2.0:1777051452.802629:0:47208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8286 00000100:00100000:2.0:1777051452.802642:0:47208:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955ebdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+8:6594:x1863365452674944:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1777051452.802749:0:47208:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955ebdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+8:6594:x1863365452674944:12345-0@lo:1000:mdt_io00_002.0 Request processed in 106us (607us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051452.802762:0:47208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8286 00000100:00100000:0.0:1777051452.802827:0:6594:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955ebdc00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6594:1863365452674944:0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1777051452.803641:0:6594:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955ebdc00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6594:1863365452675072:0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1777051452.803687:0:6594:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051452.803725:0:6594:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d95c67b3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1777051452.803777:0:11727:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452675072 00000100:00100000:2.0:1777051452.803786:0:11727:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452675072 00000100:00100000:2.0:1777051452.803846:0:11727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8287 00000100:00100000:2.0:1777051452.803857:0:11727:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955ebf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+8:6594:x1863365452675072:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1777051452.803943:0:11727:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955ebf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+8:6594:x1863365452675072:12345-0@lo:1000:mdt_io00_002.0 Request processed in 86us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051452.803955:0:11727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8287 00000100:00100000:0.0:1777051452.804028:0:6594:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955ebdc00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6594:1863365452675072:0@lo:1000:mdt_io00_002.0 00000040:00080000:0.0:1777051452.804895:0:6594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2000032e0:0x2:0x0].2, 1368 off36288 00000040:00080000:0.0:1777051452.804982:0:6594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000bd1:0x2:0x0].2, 1448 off36568 00000100:00100000:0.0:1777051452.805026:0:6594:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955ebdc00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6594:1863365452675200:0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1777051452.805388:0:6594:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051452.805421:0:6594:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d95c67bf00 going to sleep for 11 seconds 00000100:00100000:2.0:1777051452.805590:0:6585:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452675200 00000100:00100000:2.0:1777051452.805598:0:6585:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452675200 00000100:00100000:2.0:1777051452.805654:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8288 00000100:00100000:2.0:1777051452.805667:0:6585:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d944071180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6594:x1863365452675200:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1777051452.805807:0:6585:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d944071180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6594:x1863365452675200:12345-0@lo:1000:mdt_io00_002.0 Request processed in 141us (418us total) trans 4294968374 rc 0/0 00000100:00100000:2.0:1777051452.805818:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8288 00000100:00100000:0.0:1777051452.805875:0:6594:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955ebdc00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6594:1863365452675200:0@lo:1000:mdt_io00_002.0 00000004:00080000:0.0:1777051452.805889:0:6594:0:(osp_trans.c:1582:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff99d95c67b3c0 with version 5 00000004:00080000:1.0:1777051452.805989:0:103175:0:(osp_trans.c:1330:osp_get_next_request()) ou ffff99d9594cf180 version 5 rpc_version 5 00000020:00100000:1.0:1777051452.806033:0:103175:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1777051452.806045:0:103175:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff99da7fd63800 x1863365452675456/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 3584/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1777051452.806069:0:103175:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7fd63800 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:103175:1863365452675456:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1777051452.806117:0:103175:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051452.806424:0:103175:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d94480c0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1777051452.806482:0:46498:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452675456 00000100:00100000:3.0:1777051452.806491:0:46498:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452675456 00000100:00100000:2.0:1777051452.806628:0:46498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8289 00000100:00100000:2.0:1777051452.806641:0:46498:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fd62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+8:103175:x1863365452675456:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1777051452.807425:0:46498:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fd62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+9:103175:x1863365452675456:12345-0@lo:1000:osp_up1-0.0 Request processed in 782us (1303us total) trans 8589934726 rc 0/0 00000100:00100000:2.0:1777051452.807439:0:46498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8289 00000100:00100000:1.0:1777051452.807544:0:103175:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7fd63800 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:103175:1863365452675456:0@lo:1000:osp_up1-0.0 00000004:00010000:2.0:1777051452.807646:0:6594:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000476cb6c3 reply state 00000000e02e11c6 transno 30064771236 ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d775600/0x85f51a6b967172bc lrc: 3/0,1 mode: EX/EX res: [0x2000032e3:0x9:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051452.807685:0:6594:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d775600/0x85f51a6b967172bc lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e3:0x9:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051452.807699:0:6594:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e3:0x9:0x0].0x0 (ffff99d94e629a00) 00010000:00010000:2.0:1777051452.807703:0:6594:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 25 00000100:00100000:2.0:1777051452.807709:0:6594:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1777051452.807719:0:6594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d774200/0x85f51a6b967172ae lrc: 3/0,1 mode: CW/CW res: [0x2000032e2:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051452.807731:0:6594:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d774200/0x85f51a6b967172ae lrc: 2/0,0 mode: CW/CW res: [0x2000032e2:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051452.807741:0:6594:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d774200/0x85f51a6b967172ae lrc: 3/0,0 mode: CW/CW res: [0x2000032e2:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051452.807751:0:6594:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da7d774200 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:2.0:1777051452.807758:0:6594:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d774200/0x85f51a6b967172ae lrc: 3/0,0 mode: CW/CW res: [0x2000032e2:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051452.807775:0:6594:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d774200/0x85f51a6b967172ae lrc: 4/0,0 mode: CW/CW res: [0x2000032e2:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051452.807788:0:6594:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0x8:0x0].0x0 (ffff99da42881100) 00010000:00010000:2.0:1777051452.807793:0:6594:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777051452.807798:0:6594:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d774200/0x85f51a6b967172ae lrc: 2/0,0 mode: --/CW res: [0x2000032e2:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051452.807806:0:6594:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d774200/0x85f51a6b967172ae lrc: 0/0,0 mode: --/CW res: [0x2000032e2:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6594 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1777051452.807833:0:6594:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000476cb6c3 reply state 00000000e02e11c6 transno 30064771236 ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d775e00/0x85f51a6b967172b5 lrc: 3/0,1 mode: PW/PW res: [0x2000032e2:0x8:0x0].0x15f59727 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051452.807846:0:6594:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d775e00/0x85f51a6b967172b5 lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e2:0x8:0x0].0x15f59727 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051452.807856:0:6594:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0x8:0x0].0x15f59727 (ffff99da42881c00) 00010000:00010000:2.0:1777051452.807859:0:6594:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1777051452.807862:0:6594:0:(service.c:177:ptlrpc_save_lock()) nlocks 1 00000004:00080000:2.0:1777051452.807869:0:6594:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000bd0:0x3:0x0] 00010000:00010000:2.0:1777051452.807878:0:6594:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff99da7d775a00/0x85f51a6b96717292 lrc: 4/0,1 mode: CW/CW res: [0x240000bd0:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x85f51a6b96717299 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051452.807891:0:6594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff99da7d775a00/0x85f51a6b96717292 lrc: 4/0,1 mode: CW/CW res: [0x240000bd0:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x85f51a6b96717299 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051452.807903:0:6594:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff99da7d775a00/0x85f51a6b96717292 lrc: 3/0,0 mode: CW/CW res: [0x240000bd0:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x85f51a6b96717299 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051452.807943:0:6594:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:2.0:1777051452.807951:0:6594:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000bd0:0x3:0x0] 00010000:00010000:2.0:1777051452.807958:0:6594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff99da7d775800/0x85f51a6b967172a0 lrc: 4/0,1 mode: PW/PW res: [0x240000bd0:0x3:0x0].0x15f59727 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x85f51a6b967172a7 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051452.807970:0:6594:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff99da7d775800/0x85f51a6b967172a0 lrc: 3/0,0 mode: PW/PW res: [0x240000bd0:0x3:0x0].0x15f59727 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x85f51a6b967172a7 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1777051452.807990:0:6594:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000bd3:0x4:0x0] 00010000:00010000:2.0:1777051452.808017:0:6594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d775000/0x85f51a6b9671728b lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051452.808023:0:13753:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777051452.808038:0:13753:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff99da7d775a00/0x85f51a6b96717292 lrc: 2/0,0 mode: CW/CW res: [0x240000bd0:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x85f51a6b96717299 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051452.808041:0:6594:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d775000/0x85f51a6b9671728b lrc: 2/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051452.808075:0:6594:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d775000/0x85f51a6b9671728b lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051452.808075:0:13753:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da7d775a00 already unused, calling callback (ffffffffc177eed0) 00010000:00010000:3.0:1777051452.808087:0:13753:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff99da7d775a00/0x85f51a6b96717292 lrc: 3/0,0 mode: CW/CW res: [0x240000bd0:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x85f51a6b96717299 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051452.808092:0:6594:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da7d775000 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:2.0:1777051452.808101:0:6594:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d775000/0x85f51a6b9671728b lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6594 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777051452.808111:0:13753:0:(mdt_handler.c:3963:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff99da7d775a00/0x85f51a6b96717292 lrc: 3/0,0 mode: CW/CW res: [0x240000bd0:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x85f51a6b96717299 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051452.808117:0:6594:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d775000/0x85f51a6b9671728b lrc: 4/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051452.808155:0:6594:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000004:0x1:0x0].0x0 (ffff99da42881900) 00010000:00010000:2.0:1777051452.808160:0:6594:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777051452.808165:0:6594:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d775000/0x85f51a6b9671728b lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051452.808173:0:13753:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff99da7d775a00/0x85f51a6b96717292 lrc: 2/0,0 mode: --/CW res: [0x240000bd0:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x85f51a6b96717299 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051452.808201:0:6594:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d775000/0x85f51a6b9671728b lrc: 0/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051452.808225:0:13753:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1777051452.808261:0:13753:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff99da7d775a00/0x85f51a6b96717292 lrc: 1/0,0 mode: --/CW res: [0x240000bd0:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x85f51a6b96717299 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051452.808276:0:13753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff99da7d775a00/0x85f51a6b96717292 lrc: 0/0,0 mode: --/CW res: [0x240000bd0:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x85f51a6b96717299 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051452.808303:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051452.808306:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051452.808309:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1777051452.808330:0:3678:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1777051452.808347:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da4384ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3678:1863365452675584:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1777051452.808396:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051452.808441:0:6594:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da4384c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+38:138782:x1863365426069248:12345-192.168.201.46@tcp:36:lfs.0 Request processed in 22976us (23136us total) trans 30064771236 rc 0/0 00000100:00100000:2.0:1777051452.808457:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 11 00000100:00100000:3.0:1777051452.808630:0:47597:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452675584 00000100:00100000:3.0:1777051452.808638:0:47597:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452675584 00000100:00100000:3.0:1777051452.808697:0:47597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13736 00000100:00100000:3.0:1777051452.808710:0:47597:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fd60380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0000-mdtlov_UUID+9:3678:x1863365452675584:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1777051452.808726:0:47597:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777051452.808751:0:47597:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d950711a00/0x85f51a6b96717299 lrc: 0/0,0 mode: --/CW res: [0x240000bd0:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x85f51a6b96717292 expref: 9 pid: 46498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051452.808769:0:47597:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x3:0x0].0x0 (ffff99d9502e3900) 00010000:00010000:3.0:1777051452.808781:0:47597:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1777051452.809079:0:47597:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fd60380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0000-mdtlov_UUID+8:3678:x1863365452675584:12345-0@lo:103:ldlm_bl.0 Request processed in 369us (681us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051452.809093:0:47597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13736 00000100:00100000:0.0:1777051452.809660:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da4384ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3678:1863365452675584:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1777051452.813928:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051452.814040:0:24269:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426069632 00000100:00100000:2.0:1777051452.814050:0:24269:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426069632 00000100:00100000:2.0:1777051452.814117:0:24269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3416 00000100:00100000:2.0:1777051452.814131:0:24269:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da4384e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+57:138782:x1863365426069632:12345-192.168.201.46@tcp:35:lfs.0 00000100:00100000:2.0:1777051452.814379:0:24269:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da4384e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+58:138782:x1863365426069632:12345-192.168.201.46@tcp:35:lfs.0 Request processed in 249us (456us total) trans 8589934727 rc 0/0 00000100:00100000:2.0:1777051452.814392:0:24269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3416 00000100:00100000:1.0:1777051452.821014:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051452.821275:0:46497:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426069888 00000100:00100000:2.0:1777051452.821285:0:46497:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426069888 00000100:00100000:2.0:1777051452.821349:0:46497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112313 00000100:00100000:2.0:1777051452.821362:0:46497:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fd60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+58:138782:x1863365426069888:12345-192.168.201.46@tcp:36:lfs.0 00010000:00010000:2.0:1777051452.821529:0:46497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950710400/0x85f51a6b967172c3 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051452.821546:0:46497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950710400/0x85f51a6b967172c3 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051452.821588:0:46497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950710400/0x85f51a6b967172c3 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x1000000000000 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051452.821619:0:46497:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d942d20000 pname:cluuid:pid:xid:nid:opc:job mdt00_009:lustre-MDT0001-mdtlov_UUID:46497:1863365452675712:0@lo:101:mdt00_009.0 00000100:00100000:2.0:1777051452.821675:0:46497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051452.821724:0:46497:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da43840e40 going to sleep for 11 seconds 00000100:00100000:3.0:1777051452.823509:0:46500:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452675712 00000100:00100000:3.0:1777051452.823519:0:46500:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452675712 00000100:00100000:3.0:1777051452.823610:0:46500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8290 00000100:00100000:3.0:1777051452.823623:0:46500:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942d21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+6:46497:x1863365452675712:12345-0@lo:101:mdt00_009.0 00010000:00010000:3.0:1777051452.823641:0:46500:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777051452.823664:0:46500:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3200/0x85f51a6b967172ca lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x85f51a6b967172c3 expref: -99 pid: 46500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051452.823699:0:46500:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2600/0x85f51a6b9671723e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b68e9 expref: 37 pid: 46494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051452.823715:0:46500:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3200/0x85f51a6b967172ca lrc: 4/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x85f51a6b967172c3 expref: 7 pid: 46500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051452.823751:0:46500:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2600/0x85f51a6b9671723e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b68e9 expref: 37 pid: 46494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051452.823771:0:46500:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2600/0x85f51a6b9671723e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b68e9 expref: 37 pid: 46494 timeout: 8182 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051452.823789:0:46500:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da4384fb80 pname:cluuid:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000_UUID:46500:1863365452675840:192.168.201.46@tcp:104: 00000100:00100000:3.0:1777051452.823887:0:46500:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da4570d180 going to sleep for 11 seconds 00000100:00100000:0.0:1777051452.828610:0:46500:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da4384fb80 pname:cluuid:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000_UUID:46500:1863365452675840:192.168.201.46@tcp:104: 00010000:00010000:0.0:1777051452.828653:0:46500:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3200/0x85f51a6b967172ca lrc: 3/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b967172c3 expref: 7 pid: 46500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051452.828669:0:46500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d9533ab000) 00010000:00010000:0.0:1777051452.828674:0:46500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777051452.828680:0:46500:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3200/0x85f51a6b967172ca lrc: 3/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b967172c3 expref: 7 pid: 46500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051452.828694:0:46500:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d9559a3200, rc 0) 00000100:00100000:0.0:1777051452.828776:0:46500:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942d21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+7:46497:x1863365452675712:12345-0@lo:101:mdt00_009.0 Request processed in 5154us (7099us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051452.828788:0:46500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8290 00000100:00100000:1.0:1777051452.828936:0:46497:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d942d20000 pname:cluuid:pid:xid:nid:opc:job mdt00_009:lustre-MDT0001-mdtlov_UUID:46497:1863365452675712:0@lo:101:mdt00_009.0 00010000:00010000:1.0:1777051452.828961:0:46497:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950710400/0x85f51a6b967172c3 lrc: 4/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x85f51a6b967172ca expref: -99 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051452.828987:0:46497:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950710400/0x85f51a6b967172c3 lrc: 4/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x85f51a6b967172ca expref: -99 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051452.829001:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051452.829645:0:24467:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426070016 00000100:00100000:3.0:1777051452.829654:0:24467:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426070016 00010000:00010000:3.0:1777051452.829692:0:24467:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2600/0x85f51a6b9671723e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b68e9 expref: 38 pid: 46494 timeout: 8182 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051452.829742:0:24467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3950 00000100:00100000:3.0:1777051452.829755:0:24467:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942d22d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+38:2436:x1863365426070016:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1777051452.829773:0:24467:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777051452.829783:0:24467:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2600/0x85f51a6b9671723e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b68e9 expref: 38 pid: 46494 timeout: 8182 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051452.829817:0:24467:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2600/0x85f51a6b9671723e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b68e9 expref: 38 pid: 46494 timeout: 8182 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051452.829848:0:24467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2600/0x85f51a6b9671723e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b68e9 expref: 38 pid: 46494 timeout: 8182 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051452.829870:0:24467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d9533ab000) 00010000:00010000:3.0:1777051452.829879:0:24467:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3200/0x85f51a6b967172ca lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b967172c3 expref: 6 pid: 46500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051452.829895:0:24467:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3200/0x85f51a6b967172ca lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x85f51a6b967172c3 expref: 6 pid: 46500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051452.829910:0:24467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3200/0x85f51a6b967172ca lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x85f51a6b967172c3 expref: 6 pid: 46500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051452.829950:0:24467:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3200/0x85f51a6b967172ca lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b967172c3 expref: 6 pid: 46500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051452.829969:0:24467:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da4384fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000_UUID:24467:1863365452675968:0@lo:105: 00000100:00100000:3.0:1777051452.830525:0:24467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051452.830614:0:24467:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da4570dc00 going to sleep for 11 seconds 00000100:00100000:2.0:1777051452.830655:0:6562:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452675968 00000100:00100000:2.0:1777051452.830665:0:6562:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452675968 00000100:00100000:2.0:1777051452.830736:0:6562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1777051452.830753:0:6562:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da4384ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:24467:x1863365452675968:12345-0@lo:105: 00010000:00010000:2.0:1777051452.831049:0:6562:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950710400/0x85f51a6b967172c3 lrc: 5/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x85f51a6b967172ca expref: -99 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051452.831065:0:6562:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950710400/0x85f51a6b967172c3 lrc: 5/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x85f51a6b967172ca expref: -99 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051452.831081:0:6562:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950710400/0x85f51a6b967172c3 lrc: 5/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x85f51a6b967172ca expref: -99 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051452.831094:0:6562:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950710400/0x85f51a6b967172c3 lrc: 5/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x85f51a6b967172ca expref: -99 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051452.831108:0:6562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950710400/0x85f51a6b967172c3 lrc: 6/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x85f51a6b967172ca expref: -99 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051452.831124:0:6562:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950710400/0x85f51a6b967172c3 lrc: 6/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x85f51a6b967172ca expref: -99 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051452.831451:0:6562:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff99d950710400) 00000100:00100000:2.0:1777051452.831513:0:6562:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da4384ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:24467:x1863365452675968:12345-0@lo:105: Request processed in 764us (987us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051452.831532:0:6562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1777051452.831775:0:24467:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da4384fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000_UUID:24467:1863365452675968:0@lo:105: 00010000:00010000:3.0:1777051452.831801:0:24467:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1777051452.831891:0:46497:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950710400/0x85f51a6b967172c3 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x85f51a6b967172ca expref: -99 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051452.831908:0:46497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950710400/0x85f51a6b967172c3 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x85f51a6b967172ca expref: -99 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1777051452.831957:0:46497:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:1.0:1777051452.832007:0:46497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff99da7d5cf200/0x85f51a6b967172d1 lrc: 3/0,1 mode: --/EX res: [0x240000bd3:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051452.832021:0:46497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff99da7d5cf200/0x85f51a6b967172d1 lrc: 3/0,1 mode: --/EX res: [0x240000bd3:0x4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051452.832035:0:46497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff99da7d5cf200/0x85f51a6b967172d1 lrc: 3/0,1 mode: --/EX res: [0x240000bd3:0x4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051452.832062:0:46497:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95f97f100 pname:cluuid:pid:xid:nid:opc:job mdt00_009:lustre-MDT0001-mdtlov_UUID:46497:1863365452676096:0@lo:101:mdt00_009.0 00000100:00100000:1.0:1777051452.832111:0:46497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051452.832149:0:46497:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d941082600 going to sleep for 11 seconds 00000100:00100000:0.0:1777051452.832481:0:6584:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452676096 00000100:00100000:0.0:1777051452.832493:0:6584:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452676096 00000100:00100000:1.0:1777051452.832641:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8291 00000100:00100000:1.0:1777051452.832656:0:6584:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f97fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:46497:x1863365452676096:12345-0@lo:101:mdt00_009.0 00010000:00010000:1.0:1777051452.832675:0:6584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777051452.832696:0:6584:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce400/0x85f51a6b967172d8 lrc: 2/0,0 mode: --/EX res: [0x240000bd3:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x85f51a6b967172d1 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051452.832739:0:6584:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d774000/0x85f51a6b9671725a lrc: 2/0,0 mode: PR/PR res: [0x240000bd3:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b68f0 expref: 37 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051452.832753:0:6584:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce400/0x85f51a6b967172d8 lrc: 4/0,0 mode: --/EX res: [0x240000bd3:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x85f51a6b967172d1 expref: 8 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051452.833086:0:6584:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d774000/0x85f51a6b9671725a lrc: 3/0,0 mode: PR/PR res: [0x240000bd3:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b68f0 expref: 37 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051452.833105:0:6584:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d774000/0x85f51a6b9671725a lrc: 4/0,0 mode: PR/PR res: [0x240000bd3:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b68f0 expref: 37 pid: 27882 timeout: 8182 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051452.833390:0:6584:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95f97ca80 pname:cluuid:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000_UUID:6584:1863365452676224:192.168.201.46@tcp:104: 00000100:00100000:1.0:1777051452.833464:0:6584:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d94480c0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1777051452.833638:0:24467:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942d22d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+37:2436:x1863365426070016:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 3883us (4646us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051452.833651:0:24467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3950 00000100:00100000:1.0:1777051452.837408:0:6584:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95f97ca80 pname:cluuid:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000_UUID:6584:1863365452676224:192.168.201.46@tcp:104: 00010000:00010000:1.0:1777051452.837441:0:6584:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce400/0x85f51a6b967172d8 lrc: 3/0,0 mode: --/EX res: [0x240000bd3:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b967172d1 expref: 8 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051452.837458:0:6584:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd3:0x4:0x0].0x0 (ffff99da42881d00) 00010000:00010000:1.0:1777051452.837463:0:6584:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1777051452.837468:0:6584:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce400/0x85f51a6b967172d8 lrc: 3/0,0 mode: --/EX res: [0x240000bd3:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b967172d1 expref: 8 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051452.837483:0:6584:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99da7d5ce400, rc 0) 00000100:00100000:1.0:1777051452.837582:0:6584:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f97fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:46497:x1863365452676096:12345-0@lo:101:mdt00_009.0 Request processed in 4928us (5469us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051452.837595:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8291 00000100:00100000:3.0:1777051452.837657:0:46497:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95f97f100 pname:cluuid:pid:xid:nid:opc:job mdt00_009:lustre-MDT0001-mdtlov_UUID:46497:1863365452676096:0@lo:101:mdt00_009.0 00010000:00010000:3.0:1777051452.837683:0:46497:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff99da7d5cf200/0x85f51a6b967172d1 lrc: 4/0,1 mode: --/EX res: [0x240000bd3:0x4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x85f51a6b967172d8 expref: -99 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051452.837710:0:46497:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff99da7d5cf200/0x85f51a6b967172d1 lrc: 4/0,1 mode: --/EX res: [0x240000bd3:0x4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x85f51a6b967172d8 expref: -99 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051452.839157:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051452.839250:0:6564:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426070144 00000100:00100000:0.0:1777051452.839259:0:6564:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426070144 00010000:00010000:0.0:1777051452.839296:0:6564:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d774000/0x85f51a6b9671725a lrc: 4/0,0 mode: PR/PR res: [0x240000bd3:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b68f0 expref: 37 pid: 27882 timeout: 8182 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051452.839356:0:6564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3951 00000100:00100000:0.0:1777051452.839370:0:6564:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942d20a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+37:2436:x1863365426070144:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1777051452.839388:0:6564:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777051452.839399:0:6564:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d774000/0x85f51a6b9671725a lrc: 4/0,0 mode: PR/PR res: [0x240000bd3:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b68f0 expref: 37 pid: 27882 timeout: 8182 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051452.839421:0:6564:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d774000/0x85f51a6b9671725a lrc: 3/0,0 mode: PR/PR res: [0x240000bd3:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b68f0 expref: 37 pid: 27882 timeout: 8182 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051452.839449:0:6564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d774000/0x85f51a6b9671725a lrc: 0/0,0 mode: --/PR res: [0x240000bd3:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b68f0 expref: 37 pid: 27882 timeout: 8182 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051452.839470:0:6564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd3:0x4:0x0].0x0 (ffff99da42881d00) 00010000:00010000:0.0:1777051452.839479:0:6564:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce400/0x85f51a6b967172d8 lrc: 2/0,0 mode: --/EX res: [0x240000bd3:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b967172d1 expref: 7 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051452.839494:0:6564:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce400/0x85f51a6b967172d8 lrc: 2/0,0 mode: EX/EX res: [0x240000bd3:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x85f51a6b967172d1 expref: 7 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051452.839507:0:6564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce400/0x85f51a6b967172d8 lrc: 3/0,0 mode: EX/EX res: [0x240000bd3:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x85f51a6b967172d1 expref: 7 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051452.839543:0:6564:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce400/0x85f51a6b967172d8 lrc: 3/0,0 mode: EX/EX res: [0x240000bd3:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b967172d1 expref: 7 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051452.839597:0:6564:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d944d28e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000_UUID:6564:1863365452676352:0@lo:105: 00000100:00100000:0.0:1777051452.839645:0:6564:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051452.839690:0:6564:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d95c67bf00 going to sleep for 11 seconds 00000100:00100000:2.0:1777051452.839727:0:102039:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452676352 00000100:00100000:2.0:1777051452.839736:0:102039:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452676352 00000100:00100000:2.0:1777051452.839790:0:102039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1777051452.839801:0:102039:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d944d29180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0001-mdtlov_UUID+4:6564:x1863365452676352:12345-0@lo:105: 00010000:00010000:2.0:1777051452.839815:0:102039:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff99da7d5cf200/0x85f51a6b967172d1 lrc: 5/0,1 mode: --/EX res: [0x240000bd3:0x4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x85f51a6b967172d8 expref: -99 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051452.839831:0:102039:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff99da7d5cf200/0x85f51a6b967172d1 lrc: 5/0,1 mode: --/EX res: [0x240000bd3:0x4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x85f51a6b967172d8 expref: -99 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051452.839848:0:102039:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff99da7d5cf200/0x85f51a6b967172d1 lrc: 5/0,1 mode: --/EX res: [0x240000bd3:0x4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x85f51a6b967172d8 expref: -99 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051452.839863:0:102039:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff99da7d5cf200/0x85f51a6b967172d1 lrc: 5/0,1 mode: EX/EX res: [0x240000bd3:0x4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x85f51a6b967172d8 expref: -99 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051452.839877:0:102039:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff99da7d5cf200/0x85f51a6b967172d1 lrc: 6/0,1 mode: EX/EX res: [0x240000bd3:0x4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x85f51a6b967172d8 expref: -99 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051452.839889:0:102039:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff99da7d5cf200/0x85f51a6b967172d1 lrc: 6/0,1 mode: EX/EX res: [0x240000bd3:0x4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x85f51a6b967172d8 expref: -99 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051452.839941:0:102039:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff99da7d5cf200) 00000100:00100000:2.0:1777051452.840005:0:102039:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d944d29180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0001-mdtlov_UUID+4:6564:x1863365452676352:12345-0@lo:105: Request processed in 204us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051452.840018:0:102039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1777051452.840059:0:6564:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d944d28e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000_UUID:6564:1863365452676352:0@lo:105: 00010000:00010000:0.0:1777051452.840080:0:6564:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1777051452.840125:0:46497:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff99da7d5cf200/0x85f51a6b967172d1 lrc: 4/0,1 mode: EX/EX res: [0x240000bd3:0x4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x85f51a6b967172d8 expref: -99 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051452.840142:0:6564:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942d20a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+36:2436:x1863365426070144:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 771us (985us total) trans 0 rc 0/0 00010000:00010000:1.0:1777051452.840147:0:46497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff99da7d5cf200/0x85f51a6b967172d1 lrc: 4/0,1 mode: EX/EX res: [0x240000bd3:0x4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x85f51a6b967172d8 expref: -99 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051452.840167:0:6564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3951 00010000:00010000:1.0:1777051452.840250:0:46497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d5cee00/0x85f51a6b967172df lrc: 3/0,1 mode: --/EX res: [0x240000bd3:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051452.840271:0:46497:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d5cec00/0x85f51a6b96716fe4 lrc: 2/0,0 mode: PR/PR res: [0x240000bd3:0x4:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6833 expref: 58 pid: 21368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051452.840281:0:46497:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a2a00/0x85f51a6b96717093 lrc: 2/0,0 mode: PR/PR res: [0x240000bd3:0x4:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b686b expref: 8 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051452.840289:0:46497:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d5cee00/0x85f51a6b967172df lrc: 5/0,1 mode: --/EX res: [0x240000bd3:0x4:0x0].0x0 bits 0x3e/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051452.840313:0:46497:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a2a00/0x85f51a6b96717093 lrc: 3/0,0 mode: PR/PR res: [0x240000bd3:0x4:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b686b expref: 8 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051452.840328:0:46497:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a2a00/0x85f51a6b96717093 lrc: 4/0,0 mode: PR/PR res: [0x240000bd3:0x4:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b686b expref: 8 pid: 6579 timeout: 8182 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051452.840347:0:46497:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95f97f100 pname:cluuid:pid:xid:nid:opc:job mdt00_009:lustre-MDT0001_UUID:46497:1863365452676480:192.168.201.46@tcp:104: 00010000:00010000:1.0:1777051452.840452:0:46497:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d5cec00/0x85f51a6b96716fe4 lrc: 3/0,0 mode: PR/PR res: [0x240000bd3:0x4:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6833 expref: 58 pid: 21368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051452.840477:0:46497:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d5cec00/0x85f51a6b96716fe4 lrc: 4/0,0 mode: PR/PR res: [0x240000bd3:0x4:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6833 expref: 58 pid: 21368 timeout: 8182 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051452.840494:0:46497:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95f97ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_009:lustre-MDT0001_UUID:46497:1863365452676608:192.168.201.46@tcp:104: 00000100:00100000:1.0:1777051452.840522:0:46497:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d94480c0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1777051452.849166:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051452.849542:0:6566:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426070272 00000100:00100000:2.0:1777051452.849584:0:6566:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426070272 00000100:00100000:0.0:1777051452.849627:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00010000:00010000:2.0:1777051452.849637:0:6566:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a2a00/0x85f51a6b96717093 lrc: 5/0,0 mode: PR/PR res: [0x240000bd3:0x4:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b686b expref: 9 pid: 6579 timeout: 8182 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051452.849694:0:6566:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426070400 00000100:00100000:2.0:1777051452.850008:0:6566:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426070400 00000100:00100000:3.0:1777051452.850018:0:47827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3952 00000100:00100000:3.0:1777051452.850041:0:47827:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d944d28e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+9:2436:x1863365426070272:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1777051452.850049:0:6566:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d5cec00/0x85f51a6b96716fe4 lrc: 5/0,0 mode: PR/PR res: [0x240000bd3:0x4:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6833 expref: 59 pid: 21368 timeout: 8182 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051452.850075:0:47827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1777051452.850084:0:46497:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95f97f100 pname:cluuid:pid:xid:nid:opc:job mdt00_009:lustre-MDT0001_UUID:46497:1863365452676480:192.168.201.46@tcp:104: 00010000:00010000:3.0:1777051452.850093:0:47827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a2a00/0x85f51a6b96717093 lrc: 4/0,0 mode: PR/PR res: [0x240000bd3:0x4:0x0].0x0 bits 0x10/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b686b expref: 9 pid: 6579 timeout: 8182 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051452.850118:0:46497:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95f97ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_009:lustre-MDT0001_UUID:46497:1863365452676608:192.168.201.46@tcp:104: 00010000:00010000:3.0:1777051452.850129:0:47827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a2a00/0x85f51a6b96717093 lrc: 3/0,0 mode: PR/PR res: [0x240000bd3:0x4:0x0].0x0 bits 0x10/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b686b expref: 9 pid: 6579 timeout: 8182 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051452.851604:0:6566:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3953 00000100:00100000:2.0:1777051452.851669:0:6566:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da4874a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+59:2436:x1863365426070400:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1777051452.851691:0:6566:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777051452.851704:0:6566:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d5cec00/0x85f51a6b96716fe4 lrc: 4/0,0 mode: PR/PR res: [0x240000bd3:0x4:0x0].0x0 bits 0x10/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6833 expref: 59 pid: 21368 timeout: 8182 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051452.853309:0:46497:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d5cee00/0x85f51a6b967172df lrc: 3/0,1 mode: --/EX res: [0x240000bd3:0x4:0x0].0x0 bits 0x3e/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051452.853513:0:47827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a2a00/0x85f51a6b96717093 lrc: 0/0,0 mode: --/PR res: [0x240000bd3:0x4:0x0].0x0 bits 0x10/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b686b expref: 9 pid: 6579 timeout: 8182 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051452.853545:0:47827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd3:0x4:0x0].0x0 (ffff99d94e52ac00) 00010000:00010000:3.0:1777051452.853580:0:47827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d5cee00/0x85f51a6b967172df lrc: 3/0,1 mode: --/EX res: [0x240000bd3:0x4:0x0].0x0 bits 0x3e/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051452.853595:0:47827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d5cee00/0x85f51a6b967172df lrc: 3/0,1 mode: --/EX res: [0x240000bd3:0x4:0x0].0x0 bits 0x3e/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051452.853605:0:47827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d5cee00/0x85f51a6b967172df lrc: 3/0,1 mode: --/EX res: [0x240000bd3:0x4:0x0].0x0 bits 0x3e/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051452.853615:0:47827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d5cee00/0x85f51a6b967172df lrc: 3/0,1 mode: --/EX res: [0x240000bd3:0x4:0x0].0x0 bits 0x3e/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051452.853632:0:47827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d5cee00/0x85f51a6b967172df lrc: 3/0,1 mode: --/EX res: [0x240000bd3:0x4:0x0].0x0 bits 0x3e/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051452.853655:0:47827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1777051452.853670:0:6566:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d5cec00/0x85f51a6b96716fe4 lrc: 3/0,0 mode: PR/PR res: [0x240000bd3:0x4:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6833 expref: 59 pid: 21368 timeout: 8182 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051452.853702:0:6566:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d5cec00/0x85f51a6b96716fe4 lrc: 0/0,0 mode: --/PR res: [0x240000bd3:0x4:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6833 expref: 59 pid: 21368 timeout: 8182 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051452.853732:0:6566:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd3:0x4:0x0].0x0 (ffff99d94e52ac00) 00000100:00100000:3.0:1777051452.854033:0:47827:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d944d28e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+8:2436:x1863365426070272:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 3996us (4872us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051452.854048:0:47827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3952 00010000:00010000:2.0:1777051452.854060:0:6566:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d5cee00/0x85f51a6b967172df lrc: 3/0,1 mode: --/EX res: [0x240000bd3:0x4:0x0].0x0 bits 0x3e/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051452.854076:0:6566:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d5cee00/0x85f51a6b967172df lrc: 3/0,1 mode: EX/EX res: [0x240000bd3:0x4:0x0].0x0 bits 0x3e/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051452.854090:0:6566:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d5cee00/0x85f51a6b967172df lrc: 4/0,1 mode: EX/EX res: [0x240000bd3:0x4:0x0].0x0 bits 0x3e/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051452.854140:0:6566:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1777051452.854180:0:6566:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da4874a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+58:2436:x1863365426070400:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 2562us (4554us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051452.854192:0:6566:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3953 00010000:00010000:1.0:1777051452.854592:0:46497:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d5cee00/0x85f51a6b967172df lrc: 3/0,1 mode: EX/EX res: [0x240000bd3:0x4:0x0].0x0 bits 0x3e/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051452.854609:0:46497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d5cee00/0x85f51a6b967172df lrc: 3/0,1 mode: EX/EX res: [0x240000bd3:0x4:0x0].0x0 bits 0x3e/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051452.854657:0:46497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d5cfc00/0x85f51a6b967172e6 lrc: 3/0,1 mode: --/EX res: [0x240000bd0:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051452.854673:0:46497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d5cfc00/0x85f51a6b967172e6 lrc: 3/0,1 mode: EX/EX res: [0x240000bd0:0x3:0x0].0x0 bits 0x3f/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051452.854687:0:46497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d5cfc00/0x85f51a6b967172e6 lrc: 3/0,1 mode: EX/EX res: [0x240000bd0:0x3:0x0].0x0 bits 0x3f/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051452.854735:0:46497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff99da7d5cfe00/0x85f51a6b967172ed lrc: 3/0,1 mode: --/EX res: [0x2000032e2:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051452.854756:0:46497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff99da7d5cfe00/0x85f51a6b967172ed lrc: 3/0,1 mode: --/EX res: [0x2000032e2:0x8:0x0].0x0 bits 0x3f/0x0 rrc: 2 type: IBT flags: 0x0 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051452.854773:0:46497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff99da7d5cfe00/0x85f51a6b967172ed lrc: 3/0,1 mode: --/EX res: [0x2000032e2:0x8:0x0].0x0 bits 0x3f/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051452.854800:0:46497:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95f97ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_009:lustre-MDT0001-mdtlov_UUID:46497:1863365452676736:0@lo:101:mdt00_009.0 00000100:00100000:1.0:1777051452.854850:0:46497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051452.854901:0:46497:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d94480c0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1777051452.854950:0:47208:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452676736 00000100:00100000:0.0:1777051452.854961:0:47208:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452676736 00000100:00100000:0.0:1777051452.855028:0:47208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8292 00000100:00100000:0.0:1777051452.855042:0:47208:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f97f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+8:46497:x1863365452676736:12345-0@lo:101:mdt00_009.0 00010000:00010000:0.0:1777051452.855063:0:47208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051452.855089:0:47208:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d774a00/0x85f51a6b967172f4 lrc: 2/0,0 mode: --/EX res: [0x2000032e2:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x85f51a6b967172ed expref: -99 pid: 47208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051452.855120:0:47208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d774a00/0x85f51a6b967172f4 lrc: 3/0,0 mode: EX/EX res: [0x2000032e2:0x8:0x0].0x0 bits 0x3f/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x85f51a6b967172ed expref: 9 pid: 47208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051452.855141:0:47208:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d774a00/0x85f51a6b967172f4 lrc: 3/0,0 mode: EX/EX res: [0x2000032e2:0x8:0x0].0x0 bits 0x3f/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b967172ed expref: 9 pid: 47208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051452.855205:0:47208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0x8:0x0].0x0 (ffff99da42881900) 00010000:00010000:0.0:1777051452.855213:0:47208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3f 00010000:00010000:0.0:1777051452.855218:0:47208:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99da7d774a00, rc 0) 00000100:00100000:0.0:1777051452.855305:0:47208:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f97f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+9:46497:x1863365452676736:12345-0@lo:101:mdt00_009.0 Request processed in 265us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051452.855323:0:47208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8292 00000100:00100000:1.0:1777051452.855385:0:46497:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95f97ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_009:lustre-MDT0001-mdtlov_UUID:46497:1863365452676736:0@lo:101:mdt00_009.0 00010000:00010000:1.0:1777051452.855411:0:46497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff99da7d5cfe00/0x85f51a6b967172ed lrc: 4/0,1 mode: EX/EX res: [0x2000032e2:0x8:0x0].0x0 bits 0x3f/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x85f51a6b967172f4 expref: -99 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051452.855432:0:46497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff99da7d5cfe00/0x85f51a6b967172ed lrc: 4/0,1 mode: EX/EX res: [0x2000032e2:0x8:0x0].0x0 bits 0x3f/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x85f51a6b967172f4 expref: -99 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051452.856935:0:46497:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95f97ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_009:lustre-MDT0001-mdtlov_UUID:46497:1863365452676864:0@lo:403:mdt00_009.0 00000100:00100000:1.0:1777051452.856993:0:46497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051452.857027:0:46497:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d94480c0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1777051452.859231:0:11727:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452676864 00000100:00100000:2.0:1777051452.859243:0:11727:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452676864 00000100:00100000:2.0:1777051452.859317:0:11727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8293 00000100:00100000:2.0:1777051452.859334:0:11727:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f97d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:46497:x1863365452676864:12345-0@lo:403:mdt00_009.0 00000100:00100000:2.0:1777051452.862075:0:11727:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f97d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:46497:x1863365452676864:12345-0@lo:403:mdt00_009.0 Request processed in 2741us (5077us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051452.862091:0:11727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8293 00000100:00100000:1.0:1777051452.862156:0:46497:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95f97ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_009:lustre-MDT0001-mdtlov_UUID:46497:1863365452676864:0@lo:403:mdt00_009.0 00000040:00080000:1.0:1777051452.863687:0:46497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000bd0:0x1:0x0].6, 392 off38448 00000040:00080000:1.0:1777051452.863931:0:46497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2000032e1:0x1:0x0].6, 472 off39056 00000004:00080000:1.0:1777051452.863944:0:46497:0:(osp_trans.c:1582:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff99d94480c0c0 with version 16 00000004:00080000:2.0:1777051452.864053:0:104211:0:(osp_trans.c:1330:osp_get_next_request()) ou ffff99d9596fa9c0 version 16 rpc_version 16 00000020:00100000:2.0:1777051452.864094:0:104211:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1777051452.864107:0:104211:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff99d942d22d80 x1863365452677120/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1432/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1777051452.864152:0:104211:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d942d22d80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:104211:1863365452677120:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1777051452.864216:0:104211:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051452.864257:0:104211:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da438409c0 going to sleep for 11 seconds 00000100:00100000:0.0:1777051452.864882:0:6585:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452677120 00000100:00100000:0.0:1777051452.864892:0:6585:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452677120 00000100:00100000:0.0:1777051452.864946:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8294 00000100:00100000:0.0:1777051452.864956:0:6585:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942d20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:104211:x1863365452677120:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1777051452.865293:0:6585:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942d20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+10:104211:x1863365452677120:12345-0@lo:1000:osp_up0-1.0 Request processed in 336us (1076us total) trans 30064771237 rc 0/0 00000100:00100000:0.0:1777051452.865307:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8294 00000100:00100000:2.0:1777051452.865417:0:104211:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d942d22d80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:104211:1863365452677120:0@lo:1000:osp_up0-1.0 00000004:00010000:1.0:1777051452.865493:0:46497:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000833bde2a reply state 00000000e19eca12 transno 8589934728 ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d5cfc00/0x85f51a6b967172e6 lrc: 3/0,1 mode: EX/EX res: [0x240000bd0:0x3:0x0].0x0 bits 0x3f/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051452.865527:0:46497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d5cfc00/0x85f51a6b967172e6 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd0:0x3:0x0].0x0 bits 0x3f/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051452.865544:0:46497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x3:0x0].0x0 (ffff99d94e629300) 00010000:00010000:1.0:1777051452.865576:0:46497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3f 00000100:00100000:1.0:1777051452.865583:0:46497:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1777051452.865594:0:46497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff99da7d5cfe00/0x85f51a6b967172ed lrc: 4/0,1 mode: EX/EX res: [0x2000032e2:0x8:0x0].0x0 bits 0x3f/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x85f51a6b967172f4 expref: -99 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051452.865610:0:46497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff99da7d5cfe00/0x85f51a6b967172ed lrc: 3/0,0 mode: EX/EX res: [0x2000032e2:0x8:0x0].0x0 bits 0x3f/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x85f51a6b967172f4 expref: -99 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1777051452.865631:0:46497:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000833bde2a reply state 00000000e19eca12 transno 8589934728 ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d5cee00/0x85f51a6b967172df lrc: 3/0,1 mode: EX/EX res: [0x240000bd3:0x4:0x0].0x0 bits 0x3e/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051452.865647:0:46497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d5cee00/0x85f51a6b967172df lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd3:0x4:0x0].0x0 bits 0x3e/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051452.865658:0:46497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd3:0x4:0x0].0x0 (ffff99d94e52ac00) 00010000:00010000:1.0:1777051452.865662:0:46497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3e 00000100:00100000:1.0:1777051452.865666:0:46497:0:(service.c:177:ptlrpc_save_lock()) nlocks 1 00010000:00010000:1.0:1777051452.865673:0:46497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff99da7d5cf200/0x85f51a6b967172d1 lrc: 4/0,1 mode: EX/EX res: [0x240000bd3:0x4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x85f51a6b967172d8 expref: -99 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051452.865687:0:46497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff99da7d5cf200/0x85f51a6b967172d1 lrc: 3/0,0 mode: EX/EX res: [0x240000bd3:0x4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x85f51a6b967172d8 expref: -99 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1777051452.865703:0:46497:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:1.0:1777051452.865712:0:46497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950710400/0x85f51a6b967172c3 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x85f51a6b967172ca expref: -99 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051452.865726:0:46497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950710400/0x85f51a6b967172c3 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x85f51a6b967172ca expref: -99 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051452.866158:0:46497:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fd60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+59:138782:x1863365426069888:12345-192.168.201.46@tcp:36:lfs.0 Request processed in 44793us (45162us total) trans 8589934728 rc 0/0 00000100:00100000:1.0:1777051452.866172:0:46497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112313 00000100:00100000:3.0:1777051452.888329:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051452.888714:0:46494:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426070528 00000100:00100000:2.0:1777051452.888728:0:46494:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426070528 00000100:00100000:2.0:1777051452.888801:0:46494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112314 00000100:00100000:2.0:1777051452.888816:0:46494:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da4384fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+36:138783:x1863365426070528:12345-192.168.201.46@tcp:101:lfs.0 00010000:00010000:2.0:1777051452.888846:0:46494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051452.888883:0:46494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710a00/0x85f51a6b967172fb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6905 expref: -99 pid: 46494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051452.888992:0:46494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950711800/0x85f51a6b96717302 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051452.889016:0:46494:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3200/0x85f51a6b967172ca lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b967172c3 expref: 9 pid: 46500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051452.889031:0:46494:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d950711800/0x85f51a6b96717302 lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051452.889075:0:46494:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3200/0x85f51a6b967172ca lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x85f51a6b967172c3 expref: 9 pid: 46500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051452.889419:0:46494:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d942d20000 pname:cluuid:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000_UUID:46494:1863365452677248:0@lo:104: 00000100:00100000:2.0:1777051452.889487:0:46494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051452.889536:0:46494:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d956bda300 going to sleep for 11 seconds 00000100:00100000:3.0:1777051452.889992:0:99220:0:(service.c:153:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1777051452.890133:0:99220:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452677248 00000100:00100000:3.0:1777051452.890140:0:99220:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452677248 00000100:00100000:3.0:1777051452.890192:0:99220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1777051452.890205:0:99220:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da6fd55050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:46494:x1863365452677248:12345-0@lo:104: 00010000:00010000:3.0:1777051452.890225:0:99220:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950710400/0x85f51a6b967172c3 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x85f51a6b967172ca expref: -99 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051452.890381:0:46494:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d942d20000 pname:cluuid:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000_UUID:46494:1863365452677248:0@lo:104: 00010000:00010000:2.0:1777051452.890410:0:46494:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99d950711800/0x85f51a6b96717302 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051452.890443:0:99220:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1777051452.890458:0:99220:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da6fd55050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:46494:x1863365452677248:12345-0@lo:104: Request processed in 253us (968us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051452.890471:0:99220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00010000:00010000:0.0:1777051452.890609:0:6567:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1777051452.890620:0:6567:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950710400/0x85f51a6b967172c3 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x85f51a6b967172ca expref: -99 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051452.890634:0:6567:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d950710400 already unused, calling callback (ffffffffc177eed0) 00010000:00010000:0.0:1777051452.890642:0:6567:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950710400/0x85f51a6b967172c3 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x13 rrc: 3 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0x85f51a6b967172ca expref: -99 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1777051452.890658:0:6567:0:(mdt_handler.c:3963:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950710400/0x85f51a6b967172c3 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x13 rrc: 3 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0x85f51a6b967172ca expref: -99 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051452.890693:0:6567:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950710400/0x85f51a6b967172c3 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x13 rrc: 3 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x85f51a6b967172ca expref: -99 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051452.890701:0:6567:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1777051452.890736:0:6567:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950710400/0x85f51a6b967172c3 lrc: 1/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x13 rrc: 3 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x85f51a6b967172ca expref: -99 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051452.890749:0:6567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff99d950710400/0x85f51a6b967172c3 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x13 rrc: 3 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x85f51a6b967172ca expref: -99 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051452.890769:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777051452.890774:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777051452.890777:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1777051452.890796:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d944d29c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452677376:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1777051452.890847:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051452.890929:0:24467:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452677376 00000100:00100000:2.0:1777051452.890937:0:24467:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452677376 00010000:00010000:2.0:1777051452.890967:0:24467:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3200/0x85f51a6b967172ca lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0x85f51a6b967172c3 expref: 10 pid: 46500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051452.891014:0:24467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3954 00000100:00100000:2.0:1777051452.891025:0:24467:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f97ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+10:3678:x1863365452677376:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1777051452.891041:0:24467:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777051452.896164:0:103159:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff99da7d775800/0x85f51a6b967172a0 lrc: 3/0,0 mode: PW/PW res: [0x240000bd0:0x3:0x0].0x15f59727 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x85f51a6b967172a7 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777051452.896190:0:103159:0:(mdt_handler.c:3963:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff99da7d775800/0x85f51a6b967172a0 lrc: 3/0,0 mode: PW/PW res: [0x240000bd0:0x3:0x0].0x15f59727 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x85f51a6b967172a7 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051452.896316:0:103159:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff99da7d775800/0x85f51a6b967172a0 lrc: 2/0,0 mode: --/PW res: [0x240000bd0:0x3:0x0].0x15f59727 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x85f51a6b967172a7 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051452.896329:0:103159:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1777051452.896432:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da4384ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452677504:0@lo:103:jbd2/dm-0-8.0 00000100:00100000:0.0:1777051452.896515:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051452.896619:0:6564:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452677504 00000100:00100000:2.0:1777051452.896628:0:6564:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452677504 00010000:00010000:3.0:1777051452.896659:0:103159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff99da7d775800/0x85f51a6b967172a0 lrc: 0/0,0 mode: --/PW res: [0x240000bd0:0x3:0x0].0x15f59727 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x85f51a6b967172a7 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1777051452.896698:0:103159:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771237 is committed 00000100:00100000:2.0:1777051452.896704:0:6564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13737 00000001:00080000:3.0:1777051452.896999:0:103159:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771236 is committed 00000100:00100000:2.0:1777051452.897019:0:6564:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d944d2b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+8:3679:x1863365452677504:12345-0@lo:103:jbd2/dm-0-8.0 00000001:00080000:3.0:1777051452.897036:0:103159:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771232 is committed 00010000:00010000:2.0:1777051452.897041:0:6564:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777051452.897073:0:6564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a3c00/0x85f51a6b967172a7 lrc: 0/0,0 mode: --/PW res: [0x240000bd0:0x3:0x0].0x15f59727 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x85f51a6b967172a0 expref: 8 pid: 46500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1777051452.897075:0:103159:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff99d944a9f480 refcount 2 committed 0 result 0 batchid 25769803781 00000020:00080000:3.0:1777051452.897089:0:103159:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff99da7d813100 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff99d944a9f0c0 00000020:00080000:3.0:1777051452.897101:0:103159:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff99da7d813800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff99da57b15200 00010000:00010000:2.0:1777051452.897110:0:6564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x3:0x0].0x15f59727 (ffff99d9413d2300) 00010000:00010000:2.0:1777051452.897128:0:6564:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1777051452.897187:0:3663:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2200/0x85f51a6b96717142 lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e3:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051452.897201:0:3663:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2200/0x85f51a6b96717142 lrc: 2/0,0 mode: TXN/TXN res: [0x2000032e3:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051452.897211:0:3663:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2200/0x85f51a6b96717142 lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e3:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051452.897221:0:3663:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d9559a2200 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:3.0:1777051452.897228:0:3663:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2200/0x85f51a6b96717142 lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e3:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051452.897241:0:3663:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2200/0x85f51a6b96717142 lrc: 4/0,0 mode: TXN/TXN res: [0x2000032e3:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051452.897256:0:3663:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e3:0xa:0x0].0x0 (ffff99d94e52ab00) 00010000:00010000:3.0:1777051452.897261:0:3663:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777051452.897267:0:3663:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2200/0x85f51a6b96717142 lrc: 2/0,0 mode: --/TXN res: [0x2000032e3:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051452.897390:0:3663:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2200/0x85f51a6b96717142 lrc: 0/0,0 mode: --/TXN res: [0x2000032e3:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051452.897400:0:6564:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d944d2b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+7:3679:x1863365452677504:12345-0@lo:103:jbd2/dm-0-8.0 Request processed in 677us (879us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051452.897420:0:6564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13737 00010000:00010000:3.0:1777051452.897451:0:3664:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d775e00/0x85f51a6b967172b5 lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e2:0x8:0x0].0x15f59727 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051452.897466:0:3664:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d775e00/0x85f51a6b967172b5 lrc: 2/0,0 mode: TXN/TXN res: [0x2000032e2:0x8:0x0].0x15f59727 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051452.897477:0:3664:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d775e00/0x85f51a6b967172b5 lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e2:0x8:0x0].0x15f59727 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051452.897488:0:3664:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da7d775e00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:3.0:1777051452.897494:0:3664:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d775e00/0x85f51a6b967172b5 lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e2:0x8:0x0].0x15f59727 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6594 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1777051452.897500:0:103195:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 25769803781 committed batchid 25769803780 00010000:00010000:3.0:1777051452.897506:0:3664:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d775e00/0x85f51a6b967172b5 lrc: 4/0,0 mode: TXN/TXN res: [0x2000032e2:0x8:0x0].0x15f59727 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051452.897520:0:24467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3200/0x85f51a6b967172ca lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0x85f51a6b967172c3 expref: 9 pid: 46500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051452.897528:0:3664:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0x8:0x0].0x15f59727 (ffff99da42881c00) 00010000:00010000:3.0:1777051452.897541:0:3664:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777051452.897576:0:3664:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d775e00/0x85f51a6b967172b5 lrc: 2/0,0 mode: --/TXN res: [0x2000032e2:0x8:0x0].0x15f59727 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051452.897580:0:24467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d9533ab000) 00010000:00010000:2.0:1777051452.897595:0:24467:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99d950711800/0x85f51a6b96717302 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051452.897597:0:3664:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d775e00/0x85f51a6b967172b5 lrc: 0/0,0 mode: --/TXN res: [0x2000032e2:0x8:0x0].0x15f59727 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051452.897626:0:24467:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99d950711800/0x85f51a6b96717302 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1777051452.897629:0:103195:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 25769803780 00010000:00010000:3.0:1777051452.897640:0:3664:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d775600/0x85f51a6b967172bc lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e3:0x9:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051452.897646:0:24467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d950711800/0x85f51a6b96717302 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051452.897684:0:3664:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d775600/0x85f51a6b967172bc lrc: 2/0,0 mode: TXN/TXN res: [0x2000032e3:0x9:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051452.897695:0:3664:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d775600/0x85f51a6b967172bc lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e3:0x9:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051452.897703:0:3664:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da7d775600 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:3.0:1777051452.897708:0:3664:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d775600/0x85f51a6b967172bc lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e3:0x9:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051452.897718:0:24467:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1777051452.897719:0:3664:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d775600/0x85f51a6b967172bc lrc: 4/0,0 mode: TXN/TXN res: [0x2000032e3:0x9:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051452.897736:0:3664:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e3:0x9:0x0].0x0 (ffff99d94e629a00) 00010000:00010000:3.0:1777051452.897741:0:3664:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 25 00010000:00010000:3.0:1777051452.897746:0:3664:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d775600/0x85f51a6b967172bc lrc: 2/0,0 mode: --/TXN res: [0x2000032e3:0x9:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051452.897756:0:3664:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d775600/0x85f51a6b967172bc lrc: 0/0,0 mode: --/TXN res: [0x2000032e3:0x9:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6594 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051452.897789:0:24467:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f97ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+8:3678:x1863365452677376:12345-0@lo:103:ldlm_bl.0 Request processed in 6761us (6936us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051452.897803:0:24467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3954 00000100:00100000:1.0:1777051452.897815:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d944d29c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452677376:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1777051452.897887:0:46494:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99d950711800/0x85f51a6b96717302 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051452.897904:0:46494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d950711800/0x85f51a6b96717302 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051452.897919:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da4384ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452677504:0@lo:103:jbd2/dm-0-8.0 00000004:00200000:1.0:1777051452.897964:0:46494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 12288 00000004:00200000:1.0:1777051452.897972:0:46494:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1777051452.898001:0:46494:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99d950711800/0x85f51a6b96717302 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051452.898041:0:46494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710a00/0x85f51a6b967172fb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6905 expref: 33 pid: 46494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051452.898066:0:46494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950711800/0x85f51a6b96717302 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6905 expref: 32 pid: 46494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051452.898080:0:46494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d9533ab000) 00010000:00010000:1.0:1777051452.898086:0:46494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1777051452.898090:0:46494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d950711800, rc 0) 00000100:00100000:1.0:1777051452.898162:0:46494:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da4384fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+32:138783:x1863365426070528:12345-192.168.201.46@tcp:101:lfs.0 Request processed in 9350us (9847us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051452.898170:0:46494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112314 00000100:00100000:2.0:1777051452.902286:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051452.902286:0:21368:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426070784 00000100:00100000:3.0:1777051452.902286:0:21368:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426070784 00000100:00100000:3.0:1777051452.902286:0:21368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112315 00000100:00100000:3.0:1777051452.902286:0:21368:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942d20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+32:138783:x1863365426070784:12345-192.168.201.46@tcp:101:lfs.0 00010000:00010000:3.0:1777051452.902286:0:21368:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777051452.902286:0:21368:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2a00/0x85f51a6b96717309 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b690c expref: -99 pid: 21368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051452.902353:0:21368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2000/0x85f51a6b96717310 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051452.902370:0:21368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2000/0x85f51a6b96717310 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051452.902385:0:21368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2000/0x85f51a6b96717310 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051452.902409:0:21368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2600/0x85f51a6b96717317 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x45e84fca bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051452.902423:0:21368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2600/0x85f51a6b96717317 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x45e84fca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051452.902434:0:21368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2600/0x85f51a6b96717317 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x45e84fca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051452.902501:0:21368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3a00/0x85f51a6b9671731e lrc: 3/1,0 mode: --/PR res: [0x240000bd3:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051452.902513:0:21368:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce400/0x85f51a6b967172d8 lrc: 2/0,0 mode: EX/EX res: [0x240000bd3:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b967172d1 expref: 7 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051452.902523:0:21368:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3a00/0x85f51a6b9671731e lrc: 4/1,0 mode: --/PR res: [0x240000bd3:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051452.902581:0:21368:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce400/0x85f51a6b967172d8 lrc: 3/0,0 mode: EX/EX res: [0x240000bd3:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x85f51a6b967172d1 expref: 7 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051452.902602:0:21368:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da4384ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:21368:1863365452677632:0@lo:104: 00000100:00100000:3.0:1777051452.902656:0:21368:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051452.902748:0:21368:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da4570d180 going to sleep for 11 seconds 00000100:00100000:0.0:1777051452.902753:0:6563:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452677632 00000100:00100000:0.0:1777051452.902763:0:6563:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452677632 00000100:00100000:0.0:1777051452.902820:0:6563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1777051452.902833:0:6563:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da4384ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:21368:x1863365452677632:12345-0@lo:104: 00010000:00010000:0.0:1777051452.902852:0:6563:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff99da7d5cf200/0x85f51a6b967172d1 lrc: 3/0,0 mode: EX/EX res: [0x240000bd3:0x4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x85f51a6b967172d8 expref: -99 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051452.902940:0:6563:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1777051452.902951:0:6563:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da4384ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:21368:x1863365452677632:12345-0@lo:104: Request processed in 120us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051452.902983:0:6563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00010000:00010000:2.0:1777051452.903004:0:6568:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777051452.903017:0:6568:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff99da7d5cf200/0x85f51a6b967172d1 lrc: 3/0,0 mode: EX/EX res: [0x240000bd3:0x4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x85f51a6b967172d8 expref: -99 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051452.903034:0:6568:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da7d5cf200 already unused, calling callback (ffffffffc177eed0) 00010000:00010000:2.0:1777051452.903044:0:6568:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff99da7d5cf200/0x85f51a6b967172d1 lrc: 4/0,0 mode: EX/EX res: [0x240000bd3:0x4:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0x85f51a6b967172d8 expref: -99 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1777051452.903059:0:6568:0:(mdt_handler.c:3963:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff99da7d5cf200/0x85f51a6b967172d1 lrc: 4/0,0 mode: EX/EX res: [0x240000bd3:0x4:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0x85f51a6b967172d8 expref: -99 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051452.903074:0:21368:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da4384ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:21368:1863365452677632:0@lo:104: 00010000:00010000:2.0:1777051452.903101:0:6568:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff99da7d5cf200/0x85f51a6b967172d1 lrc: 2/0,0 mode: --/EX res: [0x240000bd3:0x4:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x85f51a6b967172d8 expref: -99 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051452.903102:0:21368:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3a00/0x85f51a6b9671731e lrc: 3/1,0 mode: --/PR res: [0x240000bd3:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051452.903155:0:6568:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1777051452.903191:0:6568:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff99da7d5cf200/0x85f51a6b967172d1 lrc: 1/0,0 mode: --/EX res: [0x240000bd3:0x4:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x85f51a6b967172d8 expref: -99 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051452.903214:0:6568:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff99da7d5cf200/0x85f51a6b967172d1 lrc: 0/0,0 mode: --/EX res: [0x240000bd3:0x4:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x85f51a6b967172d8 expref: -99 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051452.903247:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777051452.903252:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1777051452.903255:0:3679:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:2.0:1777051452.903258:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1777051452.903277:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d942d23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452677760:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1777051452.903342:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051452.903423:0:9550:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452677760 00000100:00100000:1.0:1777051452.903432:0:9550:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452677760 00010000:00010000:1.0:1777051452.903463:0:9550:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce400/0x85f51a6b967172d8 lrc: 3/0,0 mode: EX/EX res: [0x240000bd3:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0x85f51a6b967172d1 expref: 8 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051452.903510:0:9550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3955 00000100:00100000:1.0:1777051452.903523:0:9550:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d944d29c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+8:3679:x1863365452677760:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1777051452.903538:0:9550:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000020:00080000:3.0:1777051452.906441:0:103159:0:(update_trans.c:1333:distribute_txn_batchid_cb()) lustre-MDT0000: 25769803781 batchid updated 00000020:00080000:1.0:1777051452.906529:0:103195:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 25769803781 00000020:00080000:1.0:1777051452.906581:0:103195:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 25769803781 00010000:00010000:0.0:1777051452.906639:0:9550:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce400/0x85f51a6b967172d8 lrc: 0/0,0 mode: --/EX res: [0x240000bd3:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0x85f51a6b967172d1 expref: 8 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051452.906662:0:9550:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd3:0x4:0x0].0x0 (ffff99da42881d00) 00010000:00010000:0.0:1777051452.906668:0:9550:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3a00/0x85f51a6b9671731e lrc: 3/1,0 mode: --/PR res: [0x240000bd3:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051452.906682:0:9550:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3a00/0x85f51a6b9671731e lrc: 3/1,0 mode: PR/PR res: [0x240000bd3:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051452.906693:0:9550:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3a00/0x85f51a6b9671731e lrc: 4/1,0 mode: PR/PR res: [0x240000bd3:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051452.906740:0:9550:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1777051452.906811:0:9550:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d944d29c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+7:3679:x1863365452677760:12345-0@lo:103:ldlm_bl.0 Request processed in 3287us (3466us total) trans 0 rc 0/0 00010000:00010000:3.0:1777051452.906815:0:21368:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3a00/0x85f51a6b9671731e lrc: 3/1,0 mode: PR/PR res: [0x240000bd3:0x4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051452.906828:0:9550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3955 00010000:00010000:3.0:1777051452.906842:0:21368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3a00/0x85f51a6b9671731e lrc: 3/1,0 mode: PR/PR res: [0x240000bd3:0x4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051452.906869:0:21368:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2000/0x85f51a6b96717310 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051452.906882:0:21368:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2000/0x85f51a6b96717310 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051452.906894:0:21368:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2000/0x85f51a6b96717310 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051452.906906:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d942d23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452677760:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1777051452.906909:0:21368:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d9559a2000 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:3.0:1777051452.906922:0:21368:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2000/0x85f51a6b96717310 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051452.906935:0:21368:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2000/0x85f51a6b96717310 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051452.906953:0:21368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d9533ab000) 00010000:00010000:3.0:1777051452.906959:0:21368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777051452.906966:0:21368:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2000/0x85f51a6b96717310 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051452.906976:0:21368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2000/0x85f51a6b96717310 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051452.907011:0:21368:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2600/0x85f51a6b96717317 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x45e84fca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051452.907028:0:21368:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2600/0x85f51a6b96717317 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x45e84fca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051452.907038:0:21368:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2600/0x85f51a6b96717317 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x45e84fca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051452.907047:0:21368:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d9559a2600 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:3.0:1777051452.907051:0:21368:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2600/0x85f51a6b96717317 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x45e84fca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051452.907062:0:21368:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2600/0x85f51a6b96717317 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x45e84fca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051452.907075:0:21368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x45e84fca (ffff99d9413d0900) 00010000:00010000:3.0:1777051452.907079:0:21368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777051452.907084:0:21368:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2600/0x85f51a6b96717317 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x45e84fca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051452.907094:0:21368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2600/0x85f51a6b96717317 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x45e84fca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051452.907148:0:21368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2a00/0x85f51a6b96717309 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b690c expref: 34 pid: 21368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051452.907179:0:21368:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3a00/0x85f51a6b9671731e lrc: 3/0,0 mode: PR/PR res: [0x240000bd3:0x4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b690c expref: 33 pid: 21368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051452.907191:0:21368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd3:0x4:0x0].0x0 (ffff99da42881d00) 00010000:00010000:3.0:1777051452.907234:0:21368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1777051452.907239:0:21368:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d9559a3a00, rc 0) 00000100:00100000:3.0:1777051452.907303:0:21368:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942d20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+33:138783:x1863365426070784:12345-192.168.201.46@tcp:101:lfs.0 Request processed in 5009us (5009us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051452.907316:0:21368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112315 00000100:00100000:0.0:1777051452.913510:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051452.913708:0:27885:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426071040 00000100:00100000:2.0:1777051452.913718:0:27885:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426071040 00000100:00100000:2.0:1777051452.913779:0:27885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112316 00000100:00100000:2.0:1777051452.913793:0:27885:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d944d29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+59:138783:x1863365426071040:12345-192.168.201.46@tcp:101:lfs.0 00010000:00010000:2.0:1777051452.913820:0:27885:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051452.913842:0:27885:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d950711e00/0x85f51a6b96717325 lrc: 2/0,0 mode: --/CR res: [0x240000bd3:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6913 expref: -99 pid: 27885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1777051452.914010:0:27885:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000bd3:0x4:0x0]: returning size 4096 00010000:00010000:2.0:1777051452.914116:0:27885:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99d950711e00/0x85f51a6b96717325 lrc: 1/0,0 mode: --/CR res: [0x240000bd3:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6913 expref: 61 pid: 27885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051452.914137:0:27885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd3:0x4:0x0].0x0 (ffff99d94e52ac00) 00010000:00010000:2.0:1777051452.914142:0:27885:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1777051452.914150:0:27885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d950711e00/0x85f51a6b96717325 lrc: 0/0,0 mode: --/CR res: [0x240000bd3:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6913 expref: 61 pid: 27885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051452.914168:0:27885:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d950711e00, rc 0) 00000100:00100000:2.0:1777051452.914255:0:27885:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d944d29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+60:138783:x1863365426071040:12345-192.168.201.46@tcp:101:lfs.0 Request processed in 462us (750us total) trans 8589934729 rc 301/301 00000100:00100000:2.0:1777051452.914316:0:27885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112316 00000100:00100000:0.0:1777051452.920140:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051452.920232:0:8492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426071168 00000100:00100000:3.0:1777051452.920243:0:8492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426071168 00000100:00100000:3.0:1777051452.920303:0:8492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112317 00000100:00100000:3.0:1777051452.920313:0:8492:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d944d28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+60:138783:x1863365426071168:12345-192.168.201.46@tcp:101:lfs.0 00010000:00010000:3.0:1777051452.920330:0:8492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777051452.920346:0:8492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a2a00/0x85f51a6b96717333 lrc: 2/0,0 mode: --/CR res: [0x240000bd0:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b691a expref: -99 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051452.920423:0:8492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a2600/0x85f51a6b9671733a lrc: 3/1,0 mode: --/PR res: [0x240000bd0:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051452.920444:0:8492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a2600/0x85f51a6b9671733a lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8492 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051452.920458:0:8492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a2600/0x85f51a6b9671733a lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8492 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1777051452.920494:0:8492:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000bd0:0x3:0x0]: returning size 4096 00000004:00200000:3.0:1777051452.920499:0:8492:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:3.0:1777051452.920529:0:8492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a2a00/0x85f51a6b96717333 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b691a expref: 62 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051452.920575:0:8492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a2600/0x85f51a6b9671733a lrc: 3/0,0 mode: PR/PR res: [0x240000bd0:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b691a expref: 61 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051452.920591:0:8492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x3:0x0].0x0 (ffff99d94e629300) 00010000:00010000:3.0:1777051452.920595:0:8492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1777051452.920600:0:8492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d9559a2600, rc 0) 00000100:00100000:3.0:1777051452.920655:0:8492:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d944d28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+61:138783:x1863365426071168:12345-192.168.201.46@tcp:101:lfs.0 Request processed in 342us (518us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051452.920663:0:8492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112317 00000100:00100000:1.0:1777051452.924368:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051452.924462:0:46501:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426071424 00000100:00100000:2.0:1777051452.924471:0:46501:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426071424 00000100:00100000:2.0:1777051452.924539:0:46501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3417 00000100:00100000:2.0:1777051452.924581:0:46501:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942a0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+61:138783:x1863365426071424:12345-192.168.201.46@tcp:35:lfs.0 00000100:00100000:2.0:1777051452.925091:0:46501:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942a0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+62:138783:x1863365426071424:12345-192.168.201.46@tcp:35:lfs.0 Request processed in 539us (726us total) trans 8589934730 rc 0/0 00000100:00100000:2.0:1777051452.925104:0:46501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3417 00000100:00100000:0.0:1777051452.944687:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051452.944799:0:6580:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426071552 00000100:00100000:2.0:1777051452.944812:0:6580:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426071552 00000100:00100000:2.0:1777051452.944887:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112318 00000100:00100000:2.0:1777051452.944899:0:6580:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+62:138785:x1863365426071552:12345-192.168.201.46@tcp:101:lfs.0 00010000:00010000:2.0:1777051452.944927:0:6580:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051452.944950:0:6580:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d950711e00/0x85f51a6b96717341 lrc: 2/0,0 mode: --/CR res: [0x240000bd0:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6921 expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051452.945020:0:6580:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d950711400/0x85f51a6b96717348 lrc: 3/1,0 mode: --/CR res: [0x240000bd0:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051452.945039:0:6580:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d950711400/0x85f51a6b96717348 lrc: 3/1,0 mode: CR/CR res: [0x240000bd0:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6580 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051452.945055:0:6580:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d950711400/0x85f51a6b96717348 lrc: 3/1,0 mode: CR/CR res: [0x240000bd0:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6580 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051452.945075:0:6580:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d950710e00/0x85f51a6b9671734f lrc: 3/1,0 mode: --/PR res: [0x240000bd0:0x3:0x0].0x15f59727 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051452.945094:0:6580:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d950710e00/0x85f51a6b9671734f lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x3:0x0].0x15f59727 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6580 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051452.945104:0:6580:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d950710e00/0x85f51a6b9671734f lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x3:0x0].0x15f59727 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6580 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051452.945479:0:6580:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d950710a00/0x85f51a6b96717356 lrc: 3/1,0 mode: --/PR res: [0x240000bd3:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051452.945492:0:6580:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d950710a00/0x85f51a6b96717356 lrc: 3/1,0 mode: PR/PR res: [0x240000bd3:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6580 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051452.945503:0:6580:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d950710a00/0x85f51a6b96717356 lrc: 3/1,0 mode: PR/PR res: [0x240000bd3:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6580 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1777051452.945574:0:6580:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000bd3:0x7:0x0]: returning size 1048576 00000004:00200000:2.0:1777051452.945580:0:6580:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1777051452.945605:0:6580:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff99d950710a00/0x85f51a6b96717356 lrc: 3/1,0 mode: PR/PR res: [0x240000bd3:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6580 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051452.945621:0:6580:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d950710a00/0x85f51a6b96717356 lrc: 3/1,0 mode: PR/PR res: [0x240000bd3:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6580 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051452.945634:0:6580:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d950711400/0x85f51a6b96717348 lrc: 4/1,0 mode: CR/CR res: [0x240000bd0:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6580 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051452.945644:0:6580:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d950711400/0x85f51a6b96717348 lrc: 4/1,0 mode: CR/CR res: [0x240000bd0:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6580 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051452.945650:0:6580:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d950711400/0x85f51a6b96717348 lrc: 3/0,0 mode: CR/CR res: [0x240000bd0:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6580 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051452.945661:0:6580:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99d950711400/0x85f51a6b96717348 lrc: 4/0,0 mode: CR/CR res: [0x240000bd0:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6580 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051452.945668:0:6580:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d950711400 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:2.0:1777051452.945673:0:6580:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d950711400/0x85f51a6b96717348 lrc: 4/0,0 mode: CR/CR res: [0x240000bd0:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6580 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051452.945683:0:6580:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d950711400/0x85f51a6b96717348 lrc: 5/0,0 mode: CR/CR res: [0x240000bd0:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6580 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051452.945698:0:6580:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x3:0x0].0x0 (ffff99d94e629300) 00010000:00010000:2.0:1777051452.945702:0:6580:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777051452.945707:0:6580:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99d950711400/0x85f51a6b96717348 lrc: 3/0,0 mode: --/CR res: [0x240000bd0:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6580 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051452.945716:0:6580:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d950711400/0x85f51a6b96717348 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6580 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051452.945731:0:6580:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d950710e00/0x85f51a6b9671734f lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x3:0x0].0x15f59727 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6580 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051452.945740:0:6580:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d950710e00/0x85f51a6b9671734f lrc: 2/0,0 mode: PR/PR res: [0x240000bd0:0x3:0x0].0x15f59727 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6580 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051452.945749:0:6580:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99d950710e00/0x85f51a6b9671734f lrc: 3/0,0 mode: PR/PR res: [0x240000bd0:0x3:0x0].0x15f59727 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6580 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051452.945756:0:6580:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d950710e00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:2.0:1777051452.945760:0:6580:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d950710e00/0x85f51a6b9671734f lrc: 3/0,0 mode: PR/PR res: [0x240000bd0:0x3:0x0].0x15f59727 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6580 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051452.945773:0:6580:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d950710e00/0x85f51a6b9671734f lrc: 4/0,0 mode: PR/PR res: [0x240000bd0:0x3:0x0].0x15f59727 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6580 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051452.945793:0:6580:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x3:0x0].0x15f59727 (ffff99d9502e3000) 00010000:00010000:2.0:1777051452.945796:0:6580:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777051452.945800:0:6580:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99d950710e00/0x85f51a6b9671734f lrc: 2/0,0 mode: --/PR res: [0x240000bd0:0x3:0x0].0x15f59727 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6580 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051452.945810:0:6580:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d950710e00/0x85f51a6b9671734f lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x3:0x0].0x15f59727 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6580 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051452.945848:0:6580:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d950711e00/0x85f51a6b96717341 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6921 expref: 64 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051452.945867:0:6580:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99d950710a00/0x85f51a6b96717356 lrc: 3/0,0 mode: PR/PR res: [0x240000bd3:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6921 expref: 63 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051452.945874:0:6580:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd3:0x7:0x0].0x0 (ffff99d9502e3900) 00010000:00010000:2.0:1777051452.945876:0:6580:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1777051452.945879:0:6580:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d950710a00, rc 0) 00000100:00100000:2.0:1777051452.945953:0:6580:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+63:138785:x1863365426071552:12345-192.168.201.46@tcp:101:lfs.0 Request processed in 1053us (1276us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051452.945964:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112318 00000100:00100000:0.0:1777051452.968190:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051452.968344:0:8628:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426071680 00000100:00100000:3.0:1777051452.968357:0:8628:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426071680 00000100:00100000:2.0:1777051452.968588:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 8080 00000100:00100000:2.0:1777051452.968606:0:8468:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+50:2436:x1863365426071680:12345-192.168.201.46@tcp:101:lfs.0 00010000:00010000:2.0:1777051452.968630:0:8468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051452.968656:0:8468:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000009adbf32/0x85f51a6b9671735d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6928 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1777051452.968690:0:8468:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x1e5:0x0] initial LVB size: 1048576, mtime: 0x69eba738, atime: 0x69eba738, ctime: 0x69eba738, blocks: 0x800 00010000:00010000:2.0:1777051452.969009:0:8468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777051452.969013:0:8468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777051452.969024:0:8468:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000009adbf32/0x85f51a6b9671735d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6928 expref: 51 pid: 8468 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051452.969053:0:8468:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000009adbf32/0x85f51a6b9671735d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6928 expref: 51 pid: 8468 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051452.969074:0:8468:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d950711e00, rc 0) 00000100:00100000:2.0:1777051452.969147:0:8468:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+51:2436:x1863365426071680:12345-192.168.201.46@tcp:101:lfs.0 Request processed in 546us (968us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051452.969159:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 8080 00000100:00100000:1.0:1777051452.972849:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051452.972942:0:6579:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426071808 00000100:00100000:3.0:1777051452.972961:0:6579:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426071808 00000100:00100000:3.0:1777051452.973035:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112319 00000100:00100000:3.0:1777051452.973049:0:6579:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f65b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+63:138787:x1863365426071808:12345-192.168.201.46@tcp:101:lfs.0 00010000:00010000:3.0:1777051452.973068:0:6579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777051452.973093:0:6579:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a2a00/0x85f51a6b96717364 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b692f expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051452.973172:0:6579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a2000/0x85f51a6b9671736b lrc: 3/1,0 mode: --/PR res: [0x240000bd3:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051452.973192:0:6579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a2000/0x85f51a6b9671736b lrc: 3/1,0 mode: PR/PR res: [0x240000bd3:0x4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051452.973264:0:6579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a2000/0x85f51a6b9671736b lrc: 3/1,0 mode: PR/PR res: [0x240000bd3:0x4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1777051452.973369:0:6579:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000bd3:0x4:0x0]: returning size 4096 00000004:00200000:3.0:1777051452.973376:0:6579:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1777051452.973401:0:6579:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a2000/0x85f51a6b9671736b lrc: 3/1,0 mode: PR/PR res: [0x240000bd3:0x4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051452.973436:0:6579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a2a00/0x85f51a6b96717364 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b692f expref: 65 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051452.973469:0:6579:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a2000/0x85f51a6b9671736b lrc: 3/0,0 mode: PR/PR res: [0x240000bd3:0x4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b692f expref: 64 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051452.973481:0:6579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd3:0x4:0x0].0x0 (ffff99d94e52ac00) 00010000:00010000:3.0:1777051452.973485:0:6579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1777051452.973490:0:6579:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d9559a2000, rc 0) 00000100:00100000:3.0:1777051452.973578:0:6579:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f65b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+64:138787:x1863365426071808:12345-192.168.201.46@tcp:101:lfs.0 Request processed in 531us (734us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051452.973588:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112319 00000100:00100000:0.0:1777051452.978456:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051452.978615:0:27882:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426072064 00000100:00100000:1.0:1777051452.978625:0:27882:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426072064 00000100:00100000:1.0:1777051452.978691:0:27882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112320 00000100:00100000:1.0:1777051452.978705:0:27882:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+64:138787:x1863365426072064:12345-192.168.201.46@tcp:58:lfs.0 00000040:00080000:1.0:1777051452.978887:0:27882:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].9, 136 off9416 00000100:00100000:1.0:1777051452.978980:0:27882:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+64:138787:x1863365426072064:12345-192.168.201.46@tcp:58:lfs.0 Request processed in 277us (528us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051452.978992:0:27882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112320 00000100:00100000:0.0:1777051453.206772:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da4384ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452677888:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1777051453.206859:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da4384df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452678016:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1777051453.206867:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051453.206986:0:8472:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452677888 00000100:00100000:2.0:1777051453.206997:0:8472:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452677888 00000100:00100000:2.0:1777051453.207062:0:8472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5678 00000100:00100000:2.0:1777051453.207076:0:8472:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3677:x1863365452677888:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1777051453.207099:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:2.0:1777051453.207115:0:8472:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 489209408 pending 0 free 3641659392 avail 3410137088 00000100:00100000:1.0:1777051453.207169:0:10113:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452678016 00000100:00100000:1.0:1777051453.207177:0:10113:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452678016 00000100:00100000:2.0:1777051453.207193:0:8472:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3677:x1863365452677888:12345-0@lo:13:osp-pre-1-1.0 Request processed in 117us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051453.207223:0:10113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5679 00000100:00100000:1.0:1777051453.207235:0:10113:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f659f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3678:x1863365452678016:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1777051453.207260:0:8472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5678 00002000:00000024:1.0:1777051453.207273:0:10113:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491904576 pending 0 free 3861622784 avail 3630100480 00000100:00100000:1.0:1777051453.207339:0:10113:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f659f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3678:x1863365452678016:12345-0@lo:13:osp-pre-0-1.0 Request processed in 103us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051453.207353:0:10113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5679 00000100:00100000:1.0:1777051453.207463:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da4384df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452678016:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1777051453.209471:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da4384ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452677888:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1777051453.527510:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1777051453.562599:0:108103:0:(llog.c:801:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1777051453.562609:0:108103:0:(llog_cat.c:158:llog_cat_process_common()) processing log [0x1:0x12:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1777051453.562686:0:108103:0:(llog.c:858:llog_process_thread()) stop processing plain [0x1:0x12:0x0] index 10 count 8 00000040:00080000:1.0:1777051453.562697:0:108103:0:(llog.c:858:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000040:00080000:2.0:1777051453.846767:0:104226:0:(llog.c:801:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1777051453.846777:0:104226:0:(llog_cat.c:158:llog_cat_process_common()) processing log [0x1:0x12:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1777051453.846814:0:104226:0:(llog.c:858:llog_process_thread()) stop processing plain [0x1:0x12:0x0] index 10 count 8 00000040:00080000:2.0:1777051453.846829:0:104226:0:(llog.c:858:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1777051453.847088:0:104226:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d942d23480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0001_UUID:104226:1863365452678144:192.168.201.46@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1777051453.847529:0:104226:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d95875d780 going to sleep for 11 seconds 00000100:00100000:2.0:1777051453.849836:0:104226:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d942d23480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0001_UUID:104226:1863365452678144:192.168.201.46@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1777051453.850771:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051453.850852:0:10328:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426072192 00000100:00100000:3.0:1777051453.850862:0:10328:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426072192 00000100:00100000:3.0:1777051453.850947:0:10328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112321 00000100:00100000:3.0:1777051453.850962:0:10328:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942d23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+8:138798:x1863365426072192:12345-192.168.201.46@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1777051453.851003:0:10328:0:(mdt_handler.c:7958:mdt_fid2path()) path get [0x240000bd3:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1777051453.851168:0:10328:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942d23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+8:138798:x1863365426072192:12345-192.168.201.46@tcp:53:lhsmtool_posix.0 Request processed in 208us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051453.851182:0:10328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112321 00000100:00100000:0.0:1777051453.857069:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051453.857441:0:6581:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426072448 00000100:00100000:1.0:1777051453.857451:0:6581:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426072448 00000100:00100000:1.0:1777051453.857513:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112322 00000100:00100000:1.0:1777051453.857525:0:6581:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+8:138798:x1863365426072448:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1777051453.857575:0:6581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777051453.857657:0:6581:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d5ce800/0x85f51a6b96717372 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6936 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051453.858023:0:6581:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d5ce400/0x85f51a6b96717379 lrc: 3/1,0 mode: --/PR res: [0x240000bd3:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051453.858043:0:6581:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d5ce400/0x85f51a6b96717379 lrc: 3/1,0 mode: PR/PR res: [0x240000bd3:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6581 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051453.858065:0:6581:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d5ce400/0x85f51a6b96717379 lrc: 3/1,0 mode: PR/PR res: [0x240000bd3:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6581 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1777051453.858080:0:6581:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000bd3:0x7:0x0]: returning size 1048576 00010000:00010000:1.0:1777051453.858490:0:6581:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d5ce800/0x85f51a6b96717372 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6936 expref: 11 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051453.858519:0:6581:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d5ce400/0x85f51a6b96717379 lrc: 3/0,0 mode: PR/PR res: [0x240000bd3:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6936 expref: 10 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051453.858531:0:6581:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd3:0x7:0x0].0x0 (ffff99d9502e3900) 00010000:00010000:1.0:1777051453.858564:0:6581:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1777051453.858569:0:6581:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99da7d5ce400, rc 0) 00000100:00100000:1.0:1777051453.858632:0:6581:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+10:138798:x1863365426072448:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 Request processed in 1109us (1569us total) trans 8589934731 rc 0/0 00000100:00100000:1.0:1777051453.858642:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112322 00000100:00100000:0.0:1777051453.864090:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051453.864186:0:55805:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426072576 00000100:00100000:3.0:1777051453.864195:0:55805:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426072576 00000100:00100000:3.0:1777051453.864311:0:55805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 8081 00000100:00100000:3.0:1777051453.864324:0:55805:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94e627b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c11b6966-0775-44d2-bdc6-c74c26eb2226+49:2436:x1863365426072576:12345-192.168.201.46@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1777051453.864362:0:55805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000004de0ac37/0x85f51a6b96717387 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051453.864383:0:55805:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051453.864386:0:55805:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051453.864392:0:55805:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004de0ac37/0x85f51a6b96717387 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 55805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051453.864411:0:55805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004de0ac37/0x85f51a6b96717387 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 55805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051453.864440:0:55805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000004de0ac37/0x85f51a6b96717387 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 55805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051453.864452:0:55805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004de0ac37/0x85f51a6b96717387 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 55805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051453.864464:0:55805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004de0ac37/0x85f51a6b96717387 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 55805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051453.864474:0:55805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d9559a2a00 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:3.0:1777051453.864480:0:55805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004de0ac37/0x85f51a6b96717387 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 55805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051453.864492:0:55805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004de0ac37/0x85f51a6b96717387 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 55805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051453.864511:0:55805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004de0ac37/0x85f51a6b96717387 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 55805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051453.864522:0:55805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004de0ac37/0x85f51a6b96717387 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 55805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051453.864621:0:55805:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94e627b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c11b6966-0775-44d2-bdc6-c74c26eb2226+49:2436:x1863365426072576:12345-192.168.201.46@tcp:1:lhsmtool_posix.0 Request processed in 298us (534us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051453.864629:0:55805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 8081 00000100:00100000:2.0:1777051453.866583:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051453.866674:0:46497:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426072832 00000100:00100000:1.0:1777051453.866682:0:46497:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426072832 00000100:00100000:1.0:1777051453.866743:0:46497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112323 00000100:00100000:1.0:1777051453.866755:0:46497:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942d20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:c11b6966-0775-44d2-bdc6-c74c26eb2226+10:138798:x1863365426072832:12345-192.168.201.46@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1777051453.867128:0:46497:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942d20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:c11b6966-0775-44d2-bdc6-c74c26eb2226+10:138798:x1863365426072832:12345-192.168.201.46@tcp:57:lhsmtool_posix.0 Request processed in 373us (545us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051453.867147:0:46497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112323 00000100:00100000:0.0:1777051453.871120:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051453.871484:0:8470:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426072960 00000100:00100000:2.0:1777051453.871498:0:8470:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426072960 00000100:00100000:2.0:1777051453.871577:0:8470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 8082 00000100:00100000:2.0:1777051453.871591:0:8470:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94e625180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+49:2437:x1863365426072960:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1777051453.871620:0:8470:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051453.871638:0:8470:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000017bbe7c3/0x85f51a6b9671738e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b693d expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051453.871665:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777051453.871668:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777051453.871678:0:8470:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000017bbe7c3/0x85f51a6b9671738e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b693d expref: 50 pid: 8470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051453.871699:0:8470:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000017bbe7c3/0x85f51a6b9671738e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b693d expref: 50 pid: 8470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051453.871717:0:8470:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d950711600, rc 0) 00000100:00100000:2.0:1777051453.872028:0:8470:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94e625180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+50:2437:x1863365426072960:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 Request processed in 439us (911us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051453.872040:0:8470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 8082 00000100:00100000:0.0:1777051453.874105:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051453.874564:0:6579:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426073216 00000100:00100000:3.0:1777051453.874574:0:6579:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426073216 00000100:00100000:3.0:1777051453.874644:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112324 00000100:00100000:3.0:1777051453.874659:0:6579:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94e624380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+10:138798:x1863365426073216:12345-192.168.201.46@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1777051453.874753:0:6579:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94e624380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+10:138798:x1863365426073216:12345-192.168.201.46@tcp:57:lhsmtool_posix.0 Request processed in 98us (650us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051453.874764:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112324 00000100:00100000:3.0:1777051453.884256:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051453.884326:0:46199:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426073344 00000100:00100000:0.0:1777051453.884338:0:46199:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426073344 00002000:00100000:0.0:1777051453.884414:0:46199:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x1e5:0x0] (0->1048575) req@ffff99da4384ea00 x1863365426073344/t0(0) o3->c11b6966-0775-44d2-bdc6-c74c26eb2226@192.168.201.46@tcp:414/0 lens 488/0 e 0 to 0 dl 1777051464 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1777051453.884437:0:46199:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99da4384ea00 with x1863365426073344 ext(0->1048575) 00002000:00010000:0.0:1777051453.884446:0:46199:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99da4384ea00 00000100:00100000:0.0:1777051453.884485:0:46199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 1789 00000100:00100000:0.0:1777051453.884499:0:46199:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da4384ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:c11b6966-0775-44d2-bdc6-c74c26eb2226+50:2436:x1863365426073344:12345-192.168.201.46@tcp:3:lhsmtool_posix.0 00000100:00100000:2.0:1777051453.898359:0:46199:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da4384ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:c11b6966-0775-44d2-bdc6-c74c26eb2226+50:2436:x1863365426073344:12345-192.168.201.46@tcp:3:lhsmtool_posix.0 Request processed in 13587us (13836us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1777051453.898380:0:46199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 1789 00002000:00100000:2.0:1777051453.898406:0:46199:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x1e5:0x0] (0->1048575) req@ffff99da4384ea00 x1863365426073344/t0(0) o3->c11b6966-0775-44d2-bdc6-c74c26eb2226@192.168.201.46@tcp:414/0 lens 488/440 e 0 to 0 dl 1777051464 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1777051453.898423:0:46199:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99da4384ea00 with x1863365426073344 ext(0->1048575) 00002000:00010000:2.0:1777051453.898430:0:46199:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99da4384ea00 00000100:00100000:3.0:1777051453.908171:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051453.908285:0:27882:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426073472 00000100:00100000:1.0:1777051453.908300:0:27882:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426073472 00000100:00100000:1.0:1777051453.908382:0:27882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112325 00000100:00100000:1.0:1777051453.908400:0:27882:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da4384df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+10:138798:x1863365426073472:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1777051453.908426:0:27882:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777051453.908454:0:27882:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d5ce800/0x85f51a6b96717395 lrc: 2/0,0 mode: --/PR res: [0x240000bd3:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6944 expref: -99 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051453.908499:0:27882:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d5cf200/0x85f51a6b9671739c lrc: 3/1,0 mode: --/PR res: [0x240000bd3:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051453.908519:0:27882:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d5cf200/0x85f51a6b9671739c lrc: 3/1,0 mode: PR/PR res: [0x240000bd3:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 27882 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051453.908563:0:27882:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d5cf200/0x85f51a6b9671739c lrc: 3/1,0 mode: PR/PR res: [0x240000bd3:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 27882 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051453.908738:0:27882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d5ce800/0x85f51a6b96717395 lrc: 0/0,0 mode: --/PR res: [0x240000bd3:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6944 expref: 12 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051453.908766:0:27882:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d5cf200/0x85f51a6b9671739c lrc: 3/0,0 mode: PR/PR res: [0x240000bd3:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6944 expref: 11 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051453.908780:0:27882:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd3:0x7:0x0].0x0 (ffff99d9502e3900) 00010000:00010000:1.0:1777051453.908784:0:27882:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1777051453.908790:0:27882:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99da7d5cf200, rc 0) 00000100:00100000:1.0:1777051453.908860:0:27882:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da4384df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+11:138798:x1863365426073472:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 Request processed in 464us (695us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051453.908872:0:27882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112325 00000100:00100000:3.0:1777051453.913032:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051453.913123:0:27885:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426073600 00000100:00100000:2.0:1777051453.913131:0:27885:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426073600 00000100:00100000:2.0:1777051453.913175:0:27885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112326 00000100:00100000:2.0:1777051453.913184:0:27885:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da4384ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c11b6966-0775-44d2-bdc6-c74c26eb2226+11:138798:x1863365426073600:12345-192.168.201.46@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1777051453.913258:0:27885:0:(mdt_handler.c:7958:mdt_fid2path()) path get [0x240000bd3:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1777051453.913464:0:27885:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da4384ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c11b6966-0775-44d2-bdc6-c74c26eb2226+11:138798:x1863365426073600:12345-192.168.201.46@tcp:53:lhsmtool_posix.0 Request processed in 279us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051453.913472:0:27885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112326 00000100:00100000:0.0:1777051453.916771:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051453.917616:0:24468:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426073728 00000100:00100000:2.0:1777051453.917624:0:24468:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426073728 00000100:00100000:2.0:1777051453.917685:0:24468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 8083 00000100:00100000:2.0:1777051453.917697:0:24468:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94e625880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+50:2437:x1863365426073728:12345-192.168.201.46@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1777051453.917740:0:24468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000cf80fdac/0x85f51a6b967173a3 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051453.917762:0:24468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777051453.917765:0:24468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777051453.917771:0:24468:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cf80fdac/0x85f51a6b967173a3 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051453.917798:0:24468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cf80fdac/0x85f51a6b967173a3 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051453.917826:0:24468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000cf80fdac/0x85f51a6b967173a3 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051453.917839:0:24468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cf80fdac/0x85f51a6b967173a3 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051453.917850:0:24468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cf80fdac/0x85f51a6b967173a3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051453.917857:0:24468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d950711a00 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:2.0:1777051453.917861:0:24468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cf80fdac/0x85f51a6b967173a3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051453.917874:0:24468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cf80fdac/0x85f51a6b967173a3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051453.917893:0:24468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cf80fdac/0x85f51a6b967173a3 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051453.917906:0:24468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cf80fdac/0x85f51a6b967173a3 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051453.917999:0:24468:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94e625880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+50:2437:x1863365426073728:12345-192.168.201.46@tcp:1:lhsmtool_posix.0 Request processed in 303us (1230us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051453.918012:0:24468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 8083 00000100:00100000:3.0:1777051453.921585:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051453.921679:0:8492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426073984 00000100:00100000:0.0:1777051453.921687:0:8492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426073984 00000100:00100000:0.0:1777051453.921741:0:8492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112327 00000100:00100000:0.0:1777051453.921755:0:8492:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da4384c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+11:138798:x1863365426073984:12345-192.168.201.46@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1777051453.921825:0:8492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d774200/0x85f51a6b967173aa lrc: 3/0,1 mode: --/PW res: [0x240000bd3:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051453.921847:0:8492:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d5cf200/0x85f51a6b9671739c lrc: 2/0,0 mode: PR/PR res: [0x240000bd3:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6944 expref: 11 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051453.921860:0:8492:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d774200/0x85f51a6b967173aa lrc: 4/0,1 mode: --/PW res: [0x240000bd3:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8492 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051453.921900:0:8492:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d5cf200/0x85f51a6b9671739c lrc: 3/0,0 mode: PR/PR res: [0x240000bd3:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6944 expref: 11 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051453.921920:0:8492:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d5cf200/0x85f51a6b9671739c lrc: 4/0,0 mode: PR/PR res: [0x240000bd3:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6944 expref: 11 pid: 27882 timeout: 8183 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051453.921942:0:8492:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94e627800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:8492:1863365452678272:192.168.201.46@tcp:104: 00000100:00100000:0.0:1777051453.922023:0:8492:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d95cb329c0 going to sleep for 11 seconds 00000100:00100000:0.0:1777051453.924242:0:8492:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94e627800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:8492:1863365452678272:192.168.201.46@tcp:104: 00010000:00010000:0.0:1777051453.924270:0:8492:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d774200/0x85f51a6b967173aa lrc: 3/0,1 mode: --/PW res: [0x240000bd3:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8492 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051453.926768:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051453.926948:0:6566:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426074112 00000100:00100000:2.0:1777051453.926958:0:6566:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426074112 00010000:00010000:2.0:1777051453.926997:0:6566:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d5cf200/0x85f51a6b9671739c lrc: 4/0,0 mode: PR/PR res: [0x240000bd3:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6944 expref: 12 pid: 27882 timeout: 8183 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051453.927049:0:6566:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3956 00000100:00100000:2.0:1777051453.927062:0:6566:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da4384e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+12:2436:x1863365426074112:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1777051453.927080:0:6566:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777051453.927091:0:6566:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d5cf200/0x85f51a6b9671739c lrc: 4/0,0 mode: PR/PR res: [0x240000bd3:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6944 expref: 12 pid: 27882 timeout: 8183 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051453.927112:0:6566:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d5cf200/0x85f51a6b9671739c lrc: 3/0,0 mode: PR/PR res: [0x240000bd3:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6944 expref: 12 pid: 27882 timeout: 8183 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051453.927140:0:6566:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d5cf200/0x85f51a6b9671739c lrc: 0/0,0 mode: --/PR res: [0x240000bd3:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6944 expref: 12 pid: 27882 timeout: 8183 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051453.927162:0:6566:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd3:0x7:0x0].0x0 (ffff99d9502e3900) 00010000:00010000:2.0:1777051453.927169:0:6566:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d774200/0x85f51a6b967173aa lrc: 3/0,1 mode: --/PW res: [0x240000bd3:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8492 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051453.927182:0:6566:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d774200/0x85f51a6b967173aa lrc: 3/0,1 mode: PW/PW res: [0x240000bd3:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8492 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051453.927255:0:6566:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d774200/0x85f51a6b967173aa lrc: 4/0,1 mode: PW/PW res: [0x240000bd3:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8492 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051453.927295:0:6566:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1777051453.927349:0:6566:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da4384e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+11:2436:x1863365426074112:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 287us (583us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051453.927363:0:6566:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3956 00010000:00010000:3.0:1777051453.927440:0:8492:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d774200/0x85f51a6b967173aa lrc: 3/0,1 mode: PW/PW res: [0x240000bd3:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8492 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051453.927457:0:8492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d774200/0x85f51a6b967173aa lrc: 3/0,1 mode: PW/PW res: [0x240000bd3:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8492 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051453.927961:0:8492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d774200/0x85f51a6b967173aa lrc: 3/0,1 mode: PW/PW res: [0x240000bd3:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8492 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051453.927977:0:8492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d774200/0x85f51a6b967173aa lrc: 2/0,0 mode: PW/PW res: [0x240000bd3:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8492 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051453.927990:0:8492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d774200/0x85f51a6b967173aa lrc: 3/0,0 mode: PW/PW res: [0x240000bd3:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8492 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051453.927999:0:8492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da7d774200 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:0.0:1777051453.928004:0:8492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d774200/0x85f51a6b967173aa lrc: 3/0,0 mode: PW/PW res: [0x240000bd3:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8492 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051453.928014:0:8492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d774200/0x85f51a6b967173aa lrc: 4/0,0 mode: PW/PW res: [0x240000bd3:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8492 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051453.928029:0:8492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd3:0x7:0x0].0x0 (ffff99d9502e3900) 00010000:00010000:0.0:1777051453.928034:0:8492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1777051453.928039:0:8492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d774200/0x85f51a6b967173aa lrc: 2/0,0 mode: --/PW res: [0x240000bd3:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8492 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051453.928048:0:8492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d774200/0x85f51a6b967173aa lrc: 0/0,0 mode: --/PW res: [0x240000bd3:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8492 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051453.928191:0:8492:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da4384c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+11:138798:x1863365426073984:12345-192.168.201.46@tcp:57:lhsmtool_posix.0 Request processed in 6436us (6606us total) trans 8589934732 rc 0/0 00000100:00100000:0.0:1777051453.928247:0:8492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112327 00000040:00080000:2.0:1777051453.928301:0:104226:0:(llog.c:801:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1777051453.928309:0:104226:0:(llog_cat.c:158:llog_cat_process_common()) processing log [0x1:0x12:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1777051453.929423:0:104226:0:(llog.c:858:llog_process_thread()) stop processing plain [0x1:0x12:0x0] index 64768 count 8 00000040:00080000:2.0:1777051453.929438:0:104226:0:(llog.c:858:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1777051453.931488:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051453.931798:0:6583:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426074368 00000100:00100000:0.0:1777051453.931808:0:6583:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426074368 00000100:00100000:0.0:1777051453.931867:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3418 00000100:00100000:0.0:1777051453.931877:0:6583:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f519c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+11:138798:x1863365426074368:12345-192.168.201.46@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1777051453.932103:0:6583:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f519c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+12:138798:x1863365426074368:12345-192.168.201.46@tcp:35:lhsmtool_posix.0 Request processed in 225us (617us total) trans 8589934733 rc 0/0 00000100:00100000:0.0:1777051453.932115:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3418 00010000:00010000:3.0:1777051454.550740:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1777051454.742457:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7fd60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452678400:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1777051454.742579:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051454.742644:0:3679:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1777051454.742663:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95f65b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452678528:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1777051454.742721:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051454.743063:0:8472:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452678400 00000100:00100000:1.0:1777051454.743076:0:8472:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452678400 00000100:00100000:2.0:1777051454.743095:0:8473:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452678528 00000100:00100000:2.0:1777051454.743105:0:8473:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452678528 00000100:00100000:1.0:1777051454.743177:0:8472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5680 00000100:00100000:2.0:1777051454.743256:0:8473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5681 00000100:00100000:2.0:1777051454.743276:0:8473:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d9533bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3679:x1863365452678528:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1777051454.743293:0:8472:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d9533bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3679:x1863365452678400:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1777051454.743308:0:8473:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491904576 pending 0 free 3861622784 avail 3630100480 00002000:00000024:1.0:1777051454.743320:0:8472:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 489209408 pending 0 free 3641659392 avail 3410137088 00000100:00100000:2.0:1777051454.743389:0:8473:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d9533bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3679:x1863365452678528:12345-0@lo:13:osp-pre-0-0.0 Request processed in 118us (667us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051454.743403:0:8472:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d9533bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3679:x1863365452678400:12345-0@lo:13:osp-pre-1-0.0 Request processed in 207us (823us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051454.743410:0:8473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5681 00000100:00100000:1.0:1777051454.743426:0:8472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5680 00000100:00100000:2.0:1777051454.743644:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95f65b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452678528:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1777051454.743663:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7fd60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452678400:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1777051454.744030:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1777051454.744040:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1777051454.746616:0:104205:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff99da7d5cfe00/0x85f51a6b967172ed lrc: 3/0,0 mode: EX/EX res: [0x2000032e2:0x8:0x0].0x0 bits 0x3f/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x85f51a6b967172f4 expref: -99 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777051454.746641:0:104205:0:(mdt_handler.c:3963:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff99da7d5cfe00/0x85f51a6b967172ed lrc: 3/0,0 mode: EX/EX res: [0x2000032e2:0x8:0x0].0x0 bits 0x3f/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x85f51a6b967172f4 expref: -99 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051454.747010:0:104205:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff99da7d5cfe00/0x85f51a6b967172ed lrc: 2/0,0 mode: --/EX res: [0x2000032e2:0x8:0x0].0x0 bits 0x3f/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x85f51a6b967172f4 expref: -99 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051454.747024:0:104205:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1777051454.747089:0:104205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff99da7d5cfe00/0x85f51a6b967172ed lrc: 0/0,0 mode: --/EX res: [0x2000032e2:0x8:0x0].0x0 bits 0x3f/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x85f51a6b967172f4 expref: -99 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1777051454.747120:0:104205:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934733 is committed 00000001:00080000:3.0:1777051454.747155:0:104205:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934730 is committed 00000001:00080000:3.0:1777051454.747176:0:104205:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934726 is committed 00000020:00080000:3.0:1777051454.747191:0:104205:0:(update_trans.c:1333:distribute_txn_batchid_cb()) lustre-MDT0001: 4294970584 batchid updated 00010000:00010000:3.0:1777051454.747233:0:3664:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d5cee00/0x85f51a6b967172df lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd3:0x4:0x0].0x0 bits 0x3e/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051454.747249:0:3664:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d5cee00/0x85f51a6b967172df lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd3:0x4:0x0].0x0 bits 0x3e/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051454.747270:0:3664:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d5cee00/0x85f51a6b967172df lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd3:0x4:0x0].0x0 bits 0x3e/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051454.747281:0:3664:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da7d5cee00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:3.0:1777051454.747289:0:3664:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d5cee00/0x85f51a6b967172df lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd3:0x4:0x0].0x0 bits 0x3e/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051454.747301:0:3664:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d5cee00/0x85f51a6b967172df lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd3:0x4:0x0].0x0 bits 0x3e/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051454.747320:0:3664:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd3:0x4:0x0].0x0 (ffff99d94e52ac00) 00010000:00010000:3.0:1777051454.747326:0:3664:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3e 00010000:00010000:3.0:1777051454.747333:0:3664:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d5cee00/0x85f51a6b967172df lrc: 2/0,0 mode: --/TXN res: [0x240000bd3:0x4:0x0].0x0 bits 0x3e/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051454.747344:0:3664:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d5cee00/0x85f51a6b967172df lrc: 0/0,0 mode: --/TXN res: [0x240000bd3:0x4:0x0].0x0 bits 0x3e/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051454.747363:0:3664:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d5cfc00/0x85f51a6b967172e6 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd0:0x3:0x0].0x0 bits 0x3f/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051454.747373:0:3664:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d5cfc00/0x85f51a6b967172e6 lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd0:0x3:0x0].0x0 bits 0x3f/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051454.747382:0:3664:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d5cfc00/0x85f51a6b967172e6 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd0:0x3:0x0].0x0 bits 0x3f/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051454.747441:0:3664:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da7d5cfc00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:3.0:1777051454.747448:0:3664:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d5cfc00/0x85f51a6b967172e6 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd0:0x3:0x0].0x0 bits 0x3f/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051454.747466:0:3664:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d5cfc00/0x85f51a6b967172e6 lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd0:0x3:0x0].0x0 bits 0x3f/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051454.747482:0:3664:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x3:0x0].0x0 (ffff99d94e629300) 00010000:00010000:3.0:1777051454.747487:0:3664:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3f 00010000:00010000:3.0:1777051454.747492:0:3664:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d5cfc00/0x85f51a6b967172e6 lrc: 2/0,0 mode: --/TXN res: [0x240000bd0:0x3:0x0].0x0 bits 0x3f/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051454.747501:0:3664:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d5cfc00/0x85f51a6b967172e6 lrc: 0/0,0 mode: --/TXN res: [0x240000bd0:0x3:0x0].0x0 bits 0x3f/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1777051454.747553:0:104230:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 4294970584 00000004:00080000:3.0:1777051454.747626:0:104230:0:(osp_trans.c:1582:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff99d958f6df00 with version 17 00000020:00080000:3.0:1777051454.747639:0:104230:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4294970584 cancel update log [0x2000032e1:0x1:0x0].5: rc = 0 00000020:00080000:3.0:1777051454.747733:0:104230:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4294970584 cancel update log [0x240000bd0:0x1:0x0].5: rc = 0 00000020:00080000:3.0:1777051454.747745:0:104230:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 4294970584 00000100:00100000:2.0:1777051454.748155:0:3678:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1777051454.748176:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94ed2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452678656:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:2.0:1777051454.748284:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1777051454.748344:0:104211:0:(osp_trans.c:1330:osp_get_next_request()) ou ffff99d9596fa9c0 version 17 rpc_version 17 00000020:00100000:2.0:1777051454.748374:0:104211:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1777051454.748386:0:104211:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff99d955613800 x1863365452678912/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1777051454.748415:0:104211:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955613800 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:104211:1863365452678912:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1777051454.748463:0:104211:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051454.748494:0:104211:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d95875d6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1777051454.748550:0:46498:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452678912 00000100:00100000:2.0:1777051454.748558:0:46498:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452678912 00000100:00100000:2.0:1777051454.748618:0:46498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8295 00000100:00100000:2.0:1777051454.748634:0:46498:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95088a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+7:104211:x1863365452678912:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1777051454.748824:0:46498:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95088a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+8:104211:x1863365452678912:12345-0@lo:1000:osp_up0-1.0 Request processed in 193us (360us total) trans 30064771238 rc 0/0 00000100:00100000:2.0:1777051454.748837:0:46498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8295 00000100:00100000:0.0:1777051454.748953:0:104211:0:(client.c:3101:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 30064771237 gen 2 00000004:00080000:0.0:1777051454.748963:0:104211:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 30064771237 committed transno 30064771237 00000020:00080000:0.0:1777051454.748969:0:104211:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff99da7da32d80 refcount 2 committed 0 result 0 batchid 4294970585 00000020:00080000:0.0:1777051454.748978:0:104211:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff99d9418ec600 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff99d94480c0c0 00000020:00080000:0.0:1777051454.748983:0:104211:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x2000032e1:0x1:0x0].6 00000020:00080000:0.0:1777051454.748987:0:104211:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff99d9418ec300 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff99da57ad2a00 00000020:00080000:0.0:1777051454.748992:0:104211:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x240000bd0:0x1:0x0].6 00000100:00100000:0.0:1777051454.749050:0:104211:0:(client.c:3145:ptlrpc_free_committed()) @@@ stopping search req@ffff99d955613800 x1863365452678912/t30064771238(30064771238) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 1777051470 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1777051454.749080:0:104211:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955613800 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:104211:1863365452678912:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1777051454.749094:0:47597:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452678656 00000100:00100000:3.0:1777051454.749102:0:47597:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452678656 00000020:00080000:2.0:1777051454.749106:0:104230:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 4294970585 committed batchid 4294970584 00000020:00080000:2.0:1777051454.749160:0:104230:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 4294970584 00000100:00100000:3.0:1777051454.749173:0:47597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13738 00000100:00100000:3.0:1777051454.749189:0:47597:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fd60380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+8:3678:x1863365452678656:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:2.0:1777051454.749291:0:47597:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777051454.749326:0:47597:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d774a00/0x85f51a6b967172f4 lrc: 0/0,0 mode: --/EX res: [0x2000032e2:0x8:0x0].0x0 bits 0x3f/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x85f51a6b967172ed expref: 8 pid: 47208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051454.749355:0:47597:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0x8:0x0].0x0 (ffff99da42881900) 00010000:00010000:2.0:1777051454.749376:0:47597:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1777051454.749446:0:47597:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fd60380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+7:3678:x1863365452678656:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 260us (1161us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051454.749465:0:47597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13738 00000100:00100000:3.0:1777051454.749506:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94ed2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452678656:0@lo:103:jbd2/dm-1-8.0 00000001:00080000:2.0:1777051454.750765:0:8464:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0000: transno 4294968369 is committed 00000040:00080000:3.0:1777051455.245942:0:108154:0:(llog.c:801:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1777051455.246012:0:108154:0:(llog_cat.c:158:llog_cat_process_common()) processing log [0x1:0x12:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1777051455.246109:0:108154:0:(llog.c:858:llog_process_thread()) stop processing plain [0x1:0x12:0x0] index 10 count 8 00000040:00080000:3.0:1777051455.246120:0:108154:0:(llog.c:858:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1777051455.314195:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051455.314307:0:46497:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426074624 00000100:00100000:1.0:1777051455.314322:0:46497:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426074624 00000100:00080000:0.0:1777051455.314446:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1777051455.314498:0:46497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112328 00000100:00100000:1.0:1777051455.314544:0:46497:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94ed2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+55:138807:x1863365426074624:12345-192.168.201.46@tcp:101:lfs.0 00010000:00010000:1.0:1777051455.314574:0:46497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777051455.314603:0:46497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d5cec00/0x85f51a6b967173b1 lrc: 2/0,0 mode: --/CR res: [0x240000bd3:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b694b expref: -99 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051455.314762:0:46497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d5cfc00/0x85f51a6b967173b8 lrc: 3/0,1 mode: --/PW res: [0x240000bd3:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051455.314780:0:46497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d5cfc00/0x85f51a6b967173b8 lrc: 3/0,1 mode: PW/PW res: [0x240000bd3:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051455.314795:0:46497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d5cfc00/0x85f51a6b967173b8 lrc: 3/0,1 mode: PW/PW res: [0x240000bd3:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1777051455.314809:0:46497:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000bd3:0x7:0x0]: returning size 1048576 00010000:00010000:1.0:1777051455.314941:0:46497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d5cec00/0x85f51a6b967173b1 lrc: 0/0,0 mode: --/CR res: [0x240000bd3:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b694b expref: 58 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051455.314969:0:46497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d5cfc00/0x85f51a6b967173b8 lrc: 3/0,0 mode: PW/PW res: [0x240000bd3:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b694b expref: 57 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051455.314992:0:46497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd3:0x7:0x0].0x0 (ffff99d9502e3900) 00010000:00010000:1.0:1777051455.314997:0:46497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1777051455.315002:0:46497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99da7d5cfc00, rc 0) 00000100:00100000:1.0:1777051455.315388:0:46497:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94ed2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+57:138807:x1863365426074624:12345-192.168.201.46@tcp:101:lfs.0 Request processed in 873us (1198us total) trans 8589934734 rc 0/0 00000100:00100000:1.0:1777051455.315402:0:46497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112328 00000100:00100000:2.0:1777051455.320714:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051455.320842:0:27884:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426074752 00000100:00100000:1.0:1777051455.320854:0:27884:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426074752 00000100:00080000:0.0:1777051455.320963:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1777051455.320982:0:27884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 8084 00000100:00100000:1.0:1777051455.321002:0:27884:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d950888380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+51:2436:x1863365426074752:12345-192.168.201.46@tcp:1:lfs.0 00010000:00010000:1.0:1777051455.321053:0:27884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006d318a1c/0x85f51a6b967173c6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 27884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051455.321086:0:27884:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000009adbf32/0x85f51a6b9671735d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6928 expref: 51 pid: 8468 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051455.321105:0:27884:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000017bbe7c3/0x85f51a6b9671738e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b693d expref: 49 pid: 8470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051455.321119:0:27884:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051455.321122:0:27884:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051455.321128:0:27884:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006d318a1c/0x85f51a6b967173c6 lrc: 5/0,1 mode: --/PW res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 27884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051455.321452:0:27884:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000017bbe7c3/0x85f51a6b9671738e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b693d expref: 49 pid: 8470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051455.321482:0:27884:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000017bbe7c3/0x85f51a6b9671738e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b693d expref: 49 pid: 8470 timeout: 8184 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051455.321507:0:27884:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95f65a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:27884:1863365452679040:192.168.201.46@tcp:104: 00010000:00010000:1.0:1777051455.321672:0:27884:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000009adbf32/0x85f51a6b9671735d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6928 expref: 51 pid: 8468 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051455.321692:0:27884:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000009adbf32/0x85f51a6b9671735d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6928 expref: 51 pid: 8468 timeout: 8184 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051455.321712:0:27884:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95f65b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:27884:1863365452679168:192.168.201.46@tcp:104: 00000100:00100000:1.0:1777051455.322049:0:27884:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d95dc37f00 going to sleep for 11 seconds 00000100:00100000:1.0:1777051455.324877:0:27884:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95f65a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:27884:1863365452679040:192.168.201.46@tcp:104: 00000100:00100000:1.0:1777051455.326862:0:27884:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95f65b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:27884:1863365452679168:192.168.201.46@tcp:104: 00010000:00010000:1.0:1777051455.326906:0:27884:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000006d318a1c/0x85f51a6b967173c6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 27884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051455.329247:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051455.329319:0:24467:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426074880 00000100:00100000:2.0:1777051455.329331:0:24467:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426074880 00010000:00010000:2.0:1777051455.329377:0:24467:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000009adbf32/0x85f51a6b9671735d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6928 expref: 52 pid: 8468 timeout: 8184 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051455.329446:0:24467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3957 00000100:00100000:2.0:1777051455.329468:0:24467:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94e627800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+52:2437:x1863365426074880:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1777051455.329506:0:24467:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777051455.329570:0:24467:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000009adbf32/0x85f51a6b9671735d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6928 expref: 52 pid: 8468 timeout: 8184 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051455.329592:0:24467:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000009adbf32/0x85f51a6b9671735d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6928 expref: 52 pid: 8468 timeout: 8184 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051455.329630:0:24467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000009adbf32/0x85f51a6b9671735d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6928 expref: 52 pid: 8468 timeout: 8184 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051455.329656:0:24467:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1777051455.330044:0:24467:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94e627800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+51:2437:x1863365426074880:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 582us (798us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051455.330065:0:24467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3957 00000100:00100000:0.0:1777051455.356144:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051455.356248:0:9550:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426075008 00000100:00100000:1.0:1777051455.356261:0:9550:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426075008 00010000:00010000:1.0:1777051455.356329:0:9550:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000017bbe7c3/0x85f51a6b9671738e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b693d expref: 50 pid: 8470 timeout: 8184 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051455.356391:0:9550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3958 00000100:00100000:1.0:1777051455.356411:0:9550:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da4874a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+50:2437:x1863365426075008:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1777051455.356434:0:9550:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1777051455.356465:0:9550:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000017bbe7c3/0x85f51a6b9671738e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b693d expref: 50 pid: 8470 timeout: 8184 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051455.356489:0:9550:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000017bbe7c3/0x85f51a6b9671738e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b693d expref: 50 pid: 8470 timeout: 8184 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051455.356557:0:9550:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000017bbe7c3/0x85f51a6b9671738e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b693d expref: 50 pid: 8470 timeout: 8184 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051455.356578:0:9550:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051455.356581:0:9550:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051455.356588:0:9550:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006d318a1c/0x85f51a6b967173c6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 27884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051455.356603:0:9550:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006d318a1c/0x85f51a6b967173c6 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 27884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051455.356673:0:9550:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1777051455.356738:0:9550:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da4874a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+49:2437:x1863365426075008:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 332us (600us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051455.356754:0:9550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3958 00010000:00010000:2.0:1777051455.356764:0:27884:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000006d318a1c/0x85f51a6b967173c6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 27884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051455.356785:0:27884:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006d318a1c/0x85f51a6b967173c6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 27884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1777051455.356806:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1777051455.356819:0:27884:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006d318a1c/0x85f51a6b967173c6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 27884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051455.356835:0:27884:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006d318a1c/0x85f51a6b967173c6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 27884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051455.356850:0:27884:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006d318a1c/0x85f51a6b967173c6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 27884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051455.356861:0:27884:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da7d5cee00 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:2.0:1777051455.356869:0:27884:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006d318a1c/0x85f51a6b967173c6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 27884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051455.356885:0:27884:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006d318a1c/0x85f51a6b967173c6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 27884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051455.356906:0:27884:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006d318a1c/0x85f51a6b967173c6 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 27884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051455.356945:0:27884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006d318a1c/0x85f51a6b967173c6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 27884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051455.357060:0:27884:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d950888380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+50:2436:x1863365426074752:12345-192.168.201.46@tcp:1:lfs.0 Request processed in 36062us (36349us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051455.357076:0:27884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 8084 00000100:00100000:0.0:1777051455.361487:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051455.361608:0:6582:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426075264 00000100:00100000:2.0:1777051455.361621:0:6582:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426075264 00000100:00100000:2.0:1777051455.361700:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3419 00000100:00100000:2.0:1777051455.361717:0:6582:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da6ff02050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+57:138807:x1863365426075264:12345-192.168.201.46@tcp:35:lfs.0 00000004:00010000:2.0:1777051455.361803:0:6582:0:(mdt_open.c:1994:mdt_hsm_release()) ### [0x240000bd3:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d5cfc00/0x85f51a6b967173b8 lrc: 3/0,0 mode: PW/PW res: [0x240000bd3:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b694b expref: 57 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1777051455.362101:0:6582:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 8589934735 00000100:00100000:2.0:1777051455.362334:0:6582:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f9bb800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6582:1863365452679296:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1777051455.362408:0:6582:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051455.362545:0:6582:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d9591dc840 going to sleep for 11 seconds 00000100:00100000:0.0:1777051455.362719:0:46500:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452679296 00000100:00100000:0.0:1777051455.363011:0:46500:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452679296 00000100:00100000:0.0:1777051455.363093:0:46500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8296 00000100:00100000:0.0:1777051455.363107:0:46500:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+7:6582:x1863365452679296:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1777051455.363580:0:46500:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+7:6582:x1863365452679296:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 474us (1170us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051455.363597:0:46500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8296 00000100:00100000:0.0:1777051455.363994:0:6582:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f9bb800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6582:1863365452679296:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1777051455.364441:0:6582:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 8589934736 00010000:00010000:0.0:1777051455.364542:0:6582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d775c00/0x85f51a6b967173cd lrc: 3/0,1 mode: --/EX res: [0x240000bd3:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051455.364570:0:6582:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff99d950710a00/0x85f51a6b96717356 lrc: 2/0,0 mode: PR/PR res: [0x240000bd3:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6921 expref: 60 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051455.364589:0:6582:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d5ce400/0x85f51a6b96717379 lrc: 2/0,0 mode: PR/PR res: [0x240000bd3:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6936 expref: 8 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051455.364606:0:6582:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d775c00/0x85f51a6b967173cd lrc: 5/0,1 mode: --/EX res: [0x240000bd3:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6582 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051455.364648:0:6582:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d5ce400/0x85f51a6b96717379 lrc: 3/0,0 mode: PR/PR res: [0x240000bd3:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6936 expref: 8 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051455.364671:0:6582:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d5ce400/0x85f51a6b96717379 lrc: 4/0,0 mode: PR/PR res: [0x240000bd3:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6936 expref: 8 pid: 6581 timeout: 8184 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051455.364689:0:6582:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94e624700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001_UUID:6582:1863365452679424:192.168.201.46@tcp:104: 00010000:00010000:0.0:1777051455.364800:0:6582:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff99d950710a00/0x85f51a6b96717356 lrc: 3/0,0 mode: PR/PR res: [0x240000bd3:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6921 expref: 60 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051455.364819:0:6582:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff99d950710a00/0x85f51a6b96717356 lrc: 4/0,0 mode: PR/PR res: [0x240000bd3:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6921 expref: 60 pid: 6580 timeout: 8184 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051455.364841:0:6582:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94e625500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001_UUID:6582:1863365452679552:192.168.201.46@tcp:104: 00000100:00100000:0.0:1777051455.364890:0:6582:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d942ccda80 going to sleep for 11 seconds 00000100:00100000:2.0:1777051455.368682:0:6582:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94e624700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001_UUID:6582:1863365452679424:192.168.201.46@tcp:104: 00000100:00100000:2.0:1777051455.368704:0:6582:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94e625500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001_UUID:6582:1863365452679552:192.168.201.46@tcp:104: 00010000:00010000:2.0:1777051455.368737:0:6582:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d775c00/0x85f51a6b967173cd lrc: 3/0,1 mode: --/EX res: [0x240000bd3:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6582 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051455.370071:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051455.370209:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051455.370336:0:6564:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426075392 00000100:00100000:1.0:1777051455.370347:0:6564:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426075392 00010000:00010000:1.0:1777051455.370424:0:6564:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d5ce400/0x85f51a6b96717379 lrc: 4/0,0 mode: PR/PR res: [0x240000bd3:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6936 expref: 9 pid: 6581 timeout: 8184 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051455.370481:0:6564:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426075520 00000100:00100000:1.0:1777051455.370488:0:6564:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426075520 00010000:00010000:1.0:1777051455.370556:0:6564:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d950710a00/0x85f51a6b96717356 lrc: 4/0,0 mode: PR/PR res: [0x240000bd3:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6921 expref: 61 pid: 6580 timeout: 8184 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051455.370600:0:6564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3959 00000100:00100000:1.0:1777051455.370627:0:6564:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9b9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+9:2436:x1863365426075392:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1777051455.370651:0:6564:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1777051455.370663:0:6564:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d5ce400/0x85f51a6b96717379 lrc: 4/0,0 mode: PR/PR res: [0x240000bd3:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6936 expref: 9 pid: 6581 timeout: 8184 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051455.371372:0:6566:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3960 00000100:00100000:3.0:1777051455.371396:0:6566:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+61:2436:x1863365426075520:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1777051455.371412:0:6566:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777051455.371424:0:6566:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff99d950710a00/0x85f51a6b96717356 lrc: 4/0,0 mode: PR/PR res: [0x240000bd3:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6921 expref: 61 pid: 6580 timeout: 8184 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051455.371469:0:6564:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d5ce400/0x85f51a6b96717379 lrc: 3/0,0 mode: PR/PR res: [0x240000bd3:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6936 expref: 9 pid: 6581 timeout: 8184 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1777051455.371548:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1777051455.372949:0:6566:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff99d950710a00/0x85f51a6b96717356 lrc: 3/0,0 mode: PR/PR res: [0x240000bd3:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6921 expref: 61 pid: 6580 timeout: 8184 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051455.373009:0:6566:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d950710a00/0x85f51a6b96717356 lrc: 0/0,0 mode: --/PR res: [0x240000bd3:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6921 expref: 61 pid: 6580 timeout: 8184 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051455.373034:0:6566:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd3:0x7:0x0].0x0 (ffff99d9502e3900) 00010000:00010000:3.0:1777051455.373042:0:6566:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d775c00/0x85f51a6b967173cd lrc: 3/0,1 mode: --/EX res: [0x240000bd3:0x7:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6582 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051455.373056:0:6566:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d775c00/0x85f51a6b967173cd lrc: 3/0,1 mode: --/EX res: [0x240000bd3:0x7:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6582 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051455.373068:0:6566:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1777051455.373160:0:6566:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+60:2436:x1863365426075520:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 1755us (2934us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051455.373176:0:6566:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3960 00010000:00010000:1.0:1777051455.373382:0:6564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d5ce400/0x85f51a6b96717379 lrc: 0/0,0 mode: --/PR res: [0x240000bd3:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6936 expref: 9 pid: 6581 timeout: 8184 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051455.373412:0:6564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd3:0x7:0x0].0x0 (ffff99d9502e3900) 00010000:00010000:1.0:1777051455.373421:0:6564:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d775c00/0x85f51a6b967173cd lrc: 3/0,1 mode: --/EX res: [0x240000bd3:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6582 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051455.373437:0:6564:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d775c00/0x85f51a6b967173cd lrc: 3/0,1 mode: EX/EX res: [0x240000bd3:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6582 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051455.373451:0:6564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d775c00/0x85f51a6b967173cd lrc: 4/0,1 mode: EX/EX res: [0x240000bd3:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6582 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051455.373545:0:6564:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1777051455.373579:0:6582:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d775c00/0x85f51a6b967173cd lrc: 3/0,1 mode: EX/EX res: [0x240000bd3:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6582 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051455.373600:0:6582:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d775c00/0x85f51a6b967173cd lrc: 3/0,1 mode: EX/EX res: [0x240000bd3:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6582 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051455.373614:0:6564:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9b9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+8:2436:x1863365426075392:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 2996us (3540us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051455.373633:0:6564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3959 00000001:00080000:0.0:1777051455.374143:0:6582:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 8589934737 00000001:00080000:0.0:1777051455.374347:0:6582:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 8589934738 00000100:00100000:0.0:1777051455.374479:0:6582:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94e624a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6582:1863365452679680:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1777051455.374581:0:6582:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051455.374631:0:6582:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d942ccd9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1777051455.374694:0:6584:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452679680 00000100:00100000:1.0:1777051455.374706:0:6584:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452679680 00000100:00080000:0.0:1777051455.374779:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1777051455.374796:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8297 00000100:00100000:1.0:1777051455.374813:0:6584:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94e624e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:6582:x1863365452679680:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1777051455.375008:0:6584:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94e624e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:6582:x1863365452679680:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 197us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051455.375022:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8297 00000100:00100000:0.0:1777051455.377181:0:6582:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94e624a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6582:1863365452679680:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1777051455.377381:0:6582:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 8589934739 00000100:00100000:0.0:1777051455.377459:0:6582:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94e624a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6582:1863365452679808:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1777051455.377546:0:6582:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051455.377592:0:6582:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d942ccd3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1777051455.377601:0:47208:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452679808 00000100:00100000:1.0:1777051455.377623:0:47208:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452679808 00000100:00100000:1.0:1777051455.377699:0:47208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8298 00000100:00100000:1.0:1777051455.377712:0:47208:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94e627100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+5:6582:x1863365452679808:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1777051455.377902:0:47208:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94e627100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+6:6582:x1863365452679808:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 190us (392us total) trans 4294968375 rc 0/0 00000100:00100000:1.0:1777051455.377915:0:47208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8298 00000100:00100000:3.0:1777051455.378008:0:6582:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94e624a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6582:1863365452679808:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1777051455.378082:0:6582:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 8589934740 00010000:00010000:3.0:1777051455.378465:0:6582:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d775c00/0x85f51a6b967173cd lrc: 3/0,1 mode: EX/EX res: [0x240000bd3:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6582 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051455.378485:0:6582:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d775c00/0x85f51a6b967173cd lrc: 2/0,0 mode: EX/EX res: [0x240000bd3:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6582 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051455.378500:0:6582:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d775c00/0x85f51a6b967173cd lrc: 3/0,0 mode: EX/EX res: [0x240000bd3:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6582 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051455.378539:0:6582:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da7d775c00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:3.0:1777051455.378547:0:6582:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d775c00/0x85f51a6b967173cd lrc: 3/0,0 mode: EX/EX res: [0x240000bd3:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6582 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051455.378561:0:6582:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d775c00/0x85f51a6b967173cd lrc: 4/0,0 mode: EX/EX res: [0x240000bd3:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6582 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051455.378581:0:6582:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd3:0x7:0x0].0x0 (ffff99d9502e3900) 00010000:00010000:3.0:1777051455.378587:0:6582:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1777051455.378595:0:6582:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d775c00/0x85f51a6b967173cd lrc: 2/0,0 mode: --/EX res: [0x240000bd3:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6582 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051455.378606:0:6582:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d775c00/0x85f51a6b967173cd lrc: 0/0,0 mode: --/EX res: [0x240000bd3:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6582 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1777051455.378743:0:6582:0:(mdd_object.c:4010:mdd_close()) Object [0x240000bd3:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1777051455.379392:0:6582:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].4, 64 off8448 00000004:00080000:3.0:1777051455.379414:0:6582:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 8084572215991ns, next at 8085572211213ns, rc = 0 00000001:00080000:3.0:1777051455.379428:0:6582:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 8589934741 00010000:00010000:3.0:1777051455.379472:0:6582:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd3:0x7:0x0].0x0 (ffff99d9502e3900) 00010000:00010000:3.0:1777051455.379478:0:6582:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1777051455.379488:0:6582:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d5cfc00/0x85f51a6b967173b8 lrc: 0/0,0 mode: --/PW res: [0x240000bd3:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b694b expref: 64 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051455.379672:0:6582:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da6ff02050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+63:138807:x1863365426075264:12345-192.168.201.46@tcp:35:lfs.0 Request processed in 17955us (18190us total) trans 8589934742 rc 0/0 00000100:00100000:3.0:1777051455.379695:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3419 00000020:00080000:3.0:1777051455.379703:0:6582:0:(tgt_main.c:783:tgt_ses_key_exit()) total 8 transactions per RPC 00000001:00080000:0.0:1777051455.383432:0:9540:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0001: transno 4294968375 is committed 00000001:00080000:0.0:1777051455.383451:0:9540:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0001: transno 4294968374 is committed 00000001:00080000:0.0:1777051455.383470:0:9540:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0001: transno 4294968372 is committed 00000100:00100000:3.0:1777051455.406667:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051455.406738:0:46494:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426075648 00000100:00100000:3.0:1777051455.406753:0:46494:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426075648 00000100:00100000:3.0:1777051455.406844:0:46494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112329 00000100:00100000:3.0:1777051455.406865:0:46494:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942a0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+63:138808:x1863365426075648:12345-192.168.201.46@tcp:101:lfs.0 00010000:00010000:3.0:1777051455.406902:0:46494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777051455.406938:0:46494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e6e7800/0x85f51a6b967173d4 lrc: 2/0,0 mode: --/CR res: [0x240000bd0:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6952 expref: -99 pid: 46494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051455.407040:0:46494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e6e6c00/0x85f51a6b967173db lrc: 3/1,0 mode: --/CR res: [0x240000bd0:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051455.407066:0:46494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e6e6c00/0x85f51a6b967173db lrc: 3/1,0 mode: CR/CR res: [0x240000bd0:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 46494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051455.407094:0:46494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e6e6c00/0x85f51a6b967173db lrc: 3/1,0 mode: CR/CR res: [0x240000bd0:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 46494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051455.407131:0:46494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e6e6200/0x85f51a6b967173e2 lrc: 3/1,0 mode: --/PR res: [0x240000bd0:0x3:0x0].0x15f59727 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051455.407158:0:46494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e6e6200/0x85f51a6b967173e2 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x3:0x0].0x15f59727 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051455.407183:0:46494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e6e6200/0x85f51a6b967173e2 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x3:0x0].0x15f59727 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 46494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051455.407359:0:46494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e6e6400/0x85f51a6b967173e9 lrc: 3/1,0 mode: --/PR res: [0x240000bd3:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051455.407376:0:46494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e6e6400/0x85f51a6b967173e9 lrc: 3/1,0 mode: PR/PR res: [0x240000bd3:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051455.407392:0:46494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e6e6400/0x85f51a6b967173e9 lrc: 3/1,0 mode: PR/PR res: [0x240000bd3:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 46494 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1777051455.407451:0:46494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000bd3:0x7:0x0]: returning size 1048576 00000004:00200000:3.0:1777051455.407460:0:46494:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1777051455.407490:0:46494:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e6e6400/0x85f51a6b967173e9 lrc: 3/1,0 mode: PR/PR res: [0x240000bd3:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 46494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051455.407539:0:46494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e6e6400/0x85f51a6b967173e9 lrc: 3/1,0 mode: PR/PR res: [0x240000bd3:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051455.407555:0:46494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e6e6c00/0x85f51a6b967173db lrc: 3/1,0 mode: CR/CR res: [0x240000bd0:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 46494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051455.407568:0:46494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e6e6c00/0x85f51a6b967173db lrc: 2/0,0 mode: CR/CR res: [0x240000bd0:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 46494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051455.407580:0:46494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e6e6c00/0x85f51a6b967173db lrc: 3/0,0 mode: CR/CR res: [0x240000bd0:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 46494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051455.407593:0:46494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94e6e6c00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:3.0:1777051455.407601:0:46494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e6e6c00/0x85f51a6b967173db lrc: 3/0,0 mode: CR/CR res: [0x240000bd0:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 46494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051455.407614:0:46494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e6e6c00/0x85f51a6b967173db lrc: 4/0,0 mode: CR/CR res: [0x240000bd0:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 46494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051455.407638:0:46494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x3:0x0].0x0 (ffff99d94e629300) 00010000:00010000:3.0:1777051455.407645:0:46494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777051455.407653:0:46494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e6e6c00/0x85f51a6b967173db lrc: 2/0,0 mode: --/CR res: [0x240000bd0:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 46494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051455.407665:0:46494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e6e6c00/0x85f51a6b967173db lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 46494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051455.407691:0:46494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e6e6200/0x85f51a6b967173e2 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x3:0x0].0x15f59727 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051455.407702:0:46494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e6e6200/0x85f51a6b967173e2 lrc: 2/0,0 mode: PR/PR res: [0x240000bd0:0x3:0x0].0x15f59727 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 46494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051455.407713:0:46494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e6e6200/0x85f51a6b967173e2 lrc: 3/0,0 mode: PR/PR res: [0x240000bd0:0x3:0x0].0x15f59727 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 46494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051455.407724:0:46494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94e6e6200 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:3.0:1777051455.407731:0:46494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e6e6200/0x85f51a6b967173e2 lrc: 3/0,0 mode: PR/PR res: [0x240000bd0:0x3:0x0].0x15f59727 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 46494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051455.407743:0:46494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e6e6200/0x85f51a6b967173e2 lrc: 4/0,0 mode: PR/PR res: [0x240000bd0:0x3:0x0].0x15f59727 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 46494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051455.407759:0:46494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x3:0x0].0x15f59727 (ffff99d9413d2100) 00010000:00010000:3.0:1777051455.407765:0:46494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777051455.407771:0:46494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e6e6200/0x85f51a6b967173e2 lrc: 2/0,0 mode: --/PR res: [0x240000bd0:0x3:0x0].0x15f59727 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 46494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051455.407782:0:46494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e6e6200/0x85f51a6b967173e2 lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x3:0x0].0x15f59727 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 46494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051455.407848:0:46494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e6e7800/0x85f51a6b967173d4 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6952 expref: 65 pid: 46494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051455.407888:0:46494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e6e6400/0x85f51a6b967173e9 lrc: 3/0,0 mode: PR/PR res: [0x240000bd3:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6952 expref: 64 pid: 46494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051455.407902:0:46494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd3:0x7:0x0].0x0 (ffff99d9413d2800) 00010000:00010000:3.0:1777051455.407908:0:46494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1777051455.407913:0:46494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d94e6e6400, rc 0) 00000100:00100000:3.0:1777051455.408023:0:46494:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942a0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+64:138808:x1863365426075648:12345-192.168.201.46@tcp:101:lfs.0 Request processed in 1163us (1369us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051455.408038:0:46494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112329 00000100:00100000:0.0:1777051455.436703:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051455.437689:0:24467:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426075904 00000100:00100000:3.0:1777051455.437705:0:24467:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426075904 00000100:00100000:3.0:1777051455.438440:0:24467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13739 00000100:00100000:3.0:1777051455.438461:0:24467:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94e625500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+64:138808:x1863365426075904:12345-192.168.201.46@tcp:103:lfs.0 00010000:00010000:3.0:1777051455.438486:0:24467:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777051455.438545:0:24467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e6e6400/0x85f51a6b967173e9 lrc: 0/0,0 mode: --/PR res: [0x240000bd3:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6952 expref: 64 pid: 46494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051455.438577:0:24467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd3:0x7:0x0].0x0 (ffff99d9413d2800) 00010000:00010000:3.0:1777051455.438594:0:24467:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1777051455.439032:0:24467:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94e625500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+63:138808:x1863365426075904:12345-192.168.201.46@tcp:103:lfs.0 Request processed in 573us (2338us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051455.439049:0:24467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13739 00000100:00100000:0.0:1777051455.446086:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051455.446183:0:21368:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426076032 00000100:00100000:3.0:1777051455.446195:0:21368:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426076032 00000100:00100000:3.0:1777051455.446267:0:21368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112330 00000100:00100000:3.0:1777051455.446299:0:21368:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94e624700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+63:138808:x1863365426076032:12345-192.168.201.46@tcp:58:lfs.0 00010000:00010000:0.0:1777051455.446608:0:21368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d775000/0x85f51a6b967173f0 lrc: 3/0,1 mode: --/EX res: [0x240000bd3:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051455.446653:0:21368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d775000/0x85f51a6b967173f0 lrc: 3/0,1 mode: EX/EX res: [0x240000bd3:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21368 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051455.446674:0:21368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d775000/0x85f51a6b967173f0 lrc: 3/0,1 mode: EX/EX res: [0x240000bd3:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21368 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1777051455.447143:0:21368:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].10, 136 off9552 00000100:00100000:0.0:1777051455.447598:0:21368:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94e624700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+63:138808:x1863365426076032:12345-192.168.201.46@tcp:58:lfs.0 Request processed in 1311us (1512us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051455.447615:0:21368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112330 00010000:00010000:3.0:1777051455.574692:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1777051455.959742:0:104226:0:(llog.c:801:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1777051455.959754:0:104226:0:(llog_cat.c:158:llog_cat_process_common()) processing log [0x1:0x12:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1777051455.959799:0:104226:0:(llog.c:858:llog_process_thread()) stop processing plain [0x1:0x12:0x0] index 11 count 9 00000040:00080000:2.0:1777051455.959813:0:104226:0:(llog.c:858:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1777051455.959991:0:104226:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f9b8380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0001_UUID:104226:1863365452679936:192.168.201.46@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1777051455.961074:0:104226:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d9591dc000 going to sleep for 11 seconds 00000100:00100000:2.0:1777051455.966994:0:104226:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f9b8380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0001_UUID:104226:1863365452679936:192.168.201.46@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1777051455.967530:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051455.967631:0:10328:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426076160 00000100:00100000:3.0:1777051455.967643:0:10328:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426076160 00000100:00100000:3.0:1777051455.967725:0:10328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112331 00000100:00100000:3.0:1777051455.967740:0:10328:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f65b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+8:138819:x1863365426076160:12345-192.168.201.46@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1777051455.967786:0:10328:0:(mdt_handler.c:7958:mdt_fid2path()) path get [0x240000bd3:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1777051455.967994:0:10328:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f65b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+8:138819:x1863365426076160:12345-192.168.201.46@tcp:53:lhsmtool_posix.0 Request processed in 254us (495us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051455.968008:0:10328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112331 00000100:00100000:3.0:1777051455.971196:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051455.971299:0:6581:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426076288 00000100:00100000:1.0:1777051455.971309:0:6581:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426076288 00000100:00080000:0.0:1777051455.971376:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1777051455.971399:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112332 00000100:00100000:1.0:1777051455.971417:0:6581:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f519c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+22:138819:x1863365426076288:12345-192.168.201.46@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1777051455.971534:0:6581:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cfe00/0x85f51a6b967173f7 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051455.971569:0:6581:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cfe00/0x85f51a6b967173f7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051455.971590:0:6581:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cfe00/0x85f51a6b967173f7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051455.971617:0:6581:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce800/0x85f51a6b967173fe lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xa446056e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051455.971630:0:6581:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce800/0x85f51a6b967173fe lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xa446056e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051455.971644:0:6581:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce800/0x85f51a6b967173fe lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xa446056e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051455.971698:0:6581:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cf200/0x85f51a6b96717405 lrc: 3/1,0 mode: --/PR res: [0x240000bd3:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051455.971713:0:6581:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cf200/0x85f51a6b96717405 lrc: 3/1,0 mode: PR/PR res: [0x240000bd3:0x7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051455.971727:0:6581:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cf200/0x85f51a6b96717405 lrc: 3/1,0 mode: PR/PR res: [0x240000bd3:0x7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1777051455.971753:0:6581:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cf200/0x85f51a6b96717405 lrc: 3/1,0 mode: PR/PR res: [0x240000bd3:0x7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051455.971770:0:6581:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cfe00/0x85f51a6b967173f7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051455.971782:0:6581:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cfe00/0x85f51a6b967173f7 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051455.971802:0:6581:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cfe00/0x85f51a6b967173f7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051455.971814:0:6581:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da7d5cfe00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:1.0:1777051455.971821:0:6581:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cfe00/0x85f51a6b967173f7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051455.971834:0:6581:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cfe00/0x85f51a6b967173f7 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051455.971853:0:6581:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99d941e2ea00) 00010000:00010000:1.0:1777051455.971859:0:6581:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777051455.971867:0:6581:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cfe00/0x85f51a6b967173f7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051455.971879:0:6581:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cfe00/0x85f51a6b967173f7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051455.971897:0:6581:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce800/0x85f51a6b967173fe lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xa446056e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051455.971929:0:6581:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce800/0x85f51a6b967173fe lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xa446056e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051455.971940:0:6581:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce800/0x85f51a6b967173fe lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xa446056e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051455.971951:0:6581:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da7d5ce800 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:1.0:1777051455.971957:0:6581:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce800/0x85f51a6b967173fe lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xa446056e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051455.971977:0:6581:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce800/0x85f51a6b967173fe lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xa446056e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051455.971992:0:6581:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xa446056e (ffff99d94e629800) 00010000:00010000:1.0:1777051455.971997:0:6581:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777051455.972002:0:6581:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce800/0x85f51a6b967173fe lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xa446056e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051455.972012:0:6581:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce800/0x85f51a6b967173fe lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xa446056e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051455.972039:0:6581:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cf200/0x85f51a6b96717405 lrc: 3/1,0 mode: PR/PR res: [0x240000bd3:0x7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051455.972051:0:6581:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cf200/0x85f51a6b96717405 lrc: 2/0,0 mode: PR/PR res: [0x240000bd3:0x7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051455.972062:0:6581:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cf200/0x85f51a6b96717405 lrc: 3/0,0 mode: PR/PR res: [0x240000bd3:0x7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051455.972073:0:6581:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da7d5cf200 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:1.0:1777051455.972078:0:6581:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cf200/0x85f51a6b96717405 lrc: 3/0,0 mode: PR/PR res: [0x240000bd3:0x7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051455.972090:0:6581:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cf200/0x85f51a6b96717405 lrc: 4/0,0 mode: PR/PR res: [0x240000bd3:0x7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051455.972398:0:6581:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd3:0x7:0x0].0x0 (ffff99d94e629d00) 00010000:00010000:1.0:1777051455.972405:0:6581:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1777051455.972412:0:6581:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cf200/0x85f51a6b96717405 lrc: 2/0,0 mode: --/PR res: [0x240000bd3:0x7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051455.972432:0:6581:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cf200/0x85f51a6b96717405 lrc: 0/0,0 mode: --/PR res: [0x240000bd3:0x7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051455.972550:0:6581:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f519c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+22:138819:x1863365426076288:12345-192.168.201.46@tcp:34:lhsmtool_posix.0 Request processed in 1136us (1356us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051455.972564:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112332 00000100:00100000:0.0:1777051455.975680:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051455.975769:0:46497:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426076416 00000100:00100000:1.0:1777051455.975779:0:46497:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426076416 00000100:00100000:1.0:1777051455.975856:0:46497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112333 00000100:00100000:1.0:1777051455.975873:0:46497:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94e627800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:c11b6966-0775-44d2-bdc6-c74c26eb2226+8:138819:x1863365426076416:12345-192.168.201.46@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1777051455.975937:0:46497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d5cfa00/0x85f51a6b9671740c lrc: 3/1,0 mode: --/PR res: [0x240000bd3:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051455.975958:0:46497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d5cfa00/0x85f51a6b9671740c lrc: 3/1,0 mode: PR/PR res: [0x240000bd3:0x7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051455.975975:0:46497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d5cfa00/0x85f51a6b9671740c lrc: 3/1,0 mode: PR/PR res: [0x240000bd3:0x7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1777051455.976031:0:46497:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000bd3:0x7:0x0]: returning size 1048576 00000004:00200000:1.0:1777051455.976038:0:46497:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:1.0:1777051455.976055:0:46497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d5cfa00/0x85f51a6b9671740c lrc: 3/1,0 mode: PR/PR res: [0x240000bd3:0x7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051455.976066:0:46497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d5cfa00/0x85f51a6b9671740c lrc: 2/0,0 mode: PR/PR res: [0x240000bd3:0x7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051455.976077:0:46497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d5cfa00/0x85f51a6b9671740c lrc: 3/0,0 mode: PR/PR res: [0x240000bd3:0x7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051455.976094:0:46497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da7d5cfa00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:1.0:1777051455.976099:0:46497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d5cfa00/0x85f51a6b9671740c lrc: 3/0,0 mode: PR/PR res: [0x240000bd3:0x7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051455.976109:0:46497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d5cfa00/0x85f51a6b9671740c lrc: 4/0,0 mode: PR/PR res: [0x240000bd3:0x7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051455.976123:0:46497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd3:0x7:0x0].0x0 (ffff99da42881900) 00010000:00010000:1.0:1777051455.976127:0:46497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1777051455.976133:0:46497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d5cfa00/0x85f51a6b9671740c lrc: 2/0,0 mode: --/PR res: [0x240000bd3:0x7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051455.976142:0:46497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d5cfa00/0x85f51a6b9671740c lrc: 0/0,0 mode: --/PR res: [0x240000bd3:0x7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051455.976233:0:46497:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94e627800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:c11b6966-0775-44d2-bdc6-c74c26eb2226+8:138819:x1863365426076416:12345-192.168.201.46@tcp:34:lhsmtool_posix.0 Request processed in 362us (551us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051455.976248:0:46497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112333 00000100:00100000:0.0:1777051455.982323:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051455.982418:0:46494:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426076672 00000100:00100000:3.0:1777051455.982430:0:46494:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426076672 00000100:00100000:3.0:1777051455.982538:0:46494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112334 00000100:00100000:3.0:1777051455.982554:0:46494:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942d22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c11b6966-0775-44d2-bdc6-c74c26eb2226+8:138819:x1863365426076672:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1777051455.982573:0:46494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777051455.982598:0:46494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e6e6400/0x85f51a6b96717413 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6959 expref: -99 pid: 46494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051455.982717:0:46494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e6e7800/0x85f51a6b9671741a lrc: 3/1,0 mode: --/PR res: [0x240000bd3:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051455.982738:0:46494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e6e7800/0x85f51a6b9671741a lrc: 3/1,0 mode: PR/PR res: [0x240000bd3:0x7:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 46494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051455.982755:0:46494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e6e7800/0x85f51a6b9671741a lrc: 3/1,0 mode: PR/PR res: [0x240000bd3:0x7:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 46494 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1777051455.982780:0:46494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000bd3:0x7:0x0]: returning size 1048576 00010000:00010000:3.0:1777051455.982885:0:46494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e6e7800/0x85f51a6b9671741a lrc: 3/1,0 mode: PR/PR res: [0x240000bd3:0x7:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 46494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051455.982895:0:46494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e6e7800/0x85f51a6b9671741a lrc: 2/0,0 mode: PR/PR res: [0x240000bd3:0x7:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 46494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051455.982903:0:46494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e6e7800/0x85f51a6b9671741a lrc: 3/0,0 mode: PR/PR res: [0x240000bd3:0x7:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 46494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051455.982909:0:46494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94e6e7800 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:3.0:1777051455.982913:0:46494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e6e7800/0x85f51a6b9671741a lrc: 3/0,0 mode: PR/PR res: [0x240000bd3:0x7:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 46494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051455.982921:0:46494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e6e7800/0x85f51a6b9671741a lrc: 4/0,0 mode: PR/PR res: [0x240000bd3:0x7:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 46494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051455.982938:0:46494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd3:0x7:0x0].0x0 (ffff99da42881900) 00010000:00010000:3.0:1777051455.982943:0:46494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1777051455.982950:0:46494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e6e7800/0x85f51a6b9671741a lrc: 2/0,0 mode: --/PR res: [0x240000bd3:0x7:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 46494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051455.982961:0:46494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e6e7800/0x85f51a6b9671741a lrc: 0/0,0 mode: --/PR res: [0x240000bd3:0x7:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 46494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051455.983021:0:46494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e6e6400/0x85f51a6b96717413 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6959 expref: 10 pid: 46494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051455.983036:0:46494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99d9413d2800) 00010000:00010000:3.0:1777051455.983038:0:46494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1777051455.983043:0:46494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e6e6400/0x85f51a6b96717413 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6959 expref: 10 pid: 46494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051455.983061:0:46494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d94e6e6400, rc 0) 00000100:00100000:3.0:1777051455.983160:0:46494:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942d22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c11b6966-0775-44d2-bdc6-c74c26eb2226+9:138819:x1863365426076672:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 Request processed in 605us (837us total) trans 8589934743 rc 301/301 00000100:00100000:3.0:1777051455.983175:0:46494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112334 00000100:00100000:3.0:1777051455.987670:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051455.987768:0:27882:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426076800 00000100:00100000:1.0:1777051455.987778:0:27882:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426076800 00000100:00100000:1.0:1777051455.987842:0:27882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112335 00000100:00100000:1.0:1777051455.987858:0:27882:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94c128a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+9:138819:x1863365426076800:12345-192.168.201.46@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1777051455.987932:0:27882:0:(mdt_handler.c:7958:mdt_fid2path()) path get [0x240000bd3:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1777051455.988119:0:27882:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94c128a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+9:138819:x1863365426076800:12345-192.168.201.46@tcp:53:lhsmtool_posix.0 Request processed in 264us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051455.988132:0:27882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112335 00000100:00100000:0.0:1777051455.991410:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051455.992787:0:27885:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426076928 00000100:00100000:2.0:1777051455.992806:0:27885:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426076928 00000100:00100000:2.0:1777051455.992909:0:27885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112336 00000100:00100000:2.0:1777051455.992925:0:27885:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d951fa3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c11b6966-0775-44d2-bdc6-c74c26eb2226+22:138819:x1863365426076928:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1777051455.992956:0:27885:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051455.992994:0:27885:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710a00/0x85f51a6b96717428 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6960 expref: -99 pid: 27885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051455.993124:0:27885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950711e00/0x85f51a6b9671742f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051455.993149:0:27885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d950711e00/0x85f51a6b9671742f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051455.993168:0:27885:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d950711e00/0x85f51a6b9671742f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1777051455.993281:0:27885:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 12288 00000004:00200000:2.0:1777051455.993289:0:27885:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1777051455.993322:0:27885:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99d950711e00/0x85f51a6b9671742f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051455.993362:0:27885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710a00/0x85f51a6b96717428 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6960 expref: 24 pid: 27885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051455.993399:0:27885:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950711e00/0x85f51a6b9671742f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6960 expref: 23 pid: 27885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051455.993413:0:27885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d9533ab000) 00010000:00010000:2.0:1777051455.993418:0:27885:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1777051455.993423:0:27885:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d950711e00, rc 0) 00000100:00100000:2.0:1777051455.993555:0:27885:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d951fa3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c11b6966-0775-44d2-bdc6-c74c26eb2226+23:138819:x1863365426076928:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 Request processed in 632us (2147us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051455.993568:0:27885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112336 00000100:00100000:0.0:1777051455.997948:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051455.998069:0:8492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426077056 00000100:00100000:3.0:1777051455.998107:0:8492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426077056 00000100:00100000:3.0:1777051455.998237:0:8492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112337 00000100:00100000:3.0:1777051455.998261:0:8492:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d951fa2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+23:138819:x1863365426077056:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1777051455.998291:0:8492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777051455.998322:0:8492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e6e6400/0x85f51a6b96717436 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6967 expref: -99 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051455.998412:0:8492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e6e7800/0x85f51a6b9671743d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051455.998436:0:8492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e6e7800/0x85f51a6b9671743d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051455.998455:0:8492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e6e7800/0x85f51a6b9671743d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051455.998479:0:8492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e6e6200/0x85f51a6b96717444 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x45e84fca bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051455.998493:0:8492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e6e6200/0x85f51a6b96717444 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x45e84fca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051455.998551:0:8492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e6e6200/0x85f51a6b96717444 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x45e84fca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051455.998642:0:8492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e6e6c00/0x85f51a6b9671744b lrc: 3/1,0 mode: --/PR res: [0x240000bd3:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051455.998659:0:8492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e6e6c00/0x85f51a6b9671744b lrc: 3/1,0 mode: PR/PR res: [0x240000bd3:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051455.998673:0:8492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e6e6c00/0x85f51a6b9671744b lrc: 3/1,0 mode: PR/PR res: [0x240000bd3:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777051455.998706:0:8492:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e6e6c00/0x85f51a6b9671744b lrc: 3/1,0 mode: PR/PR res: [0x240000bd3:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051455.998728:0:8492:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e6e7800/0x85f51a6b9671743d lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051455.998740:0:8492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e6e7800/0x85f51a6b9671743d lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051455.998752:0:8492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e6e7800/0x85f51a6b9671743d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051455.998764:0:8492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e6e7800/0x85f51a6b9671743d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051455.998775:0:8492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94e6e7800 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:3.0:1777051455.998782:0:8492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e6e7800/0x85f51a6b9671743d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051455.998797:0:8492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e6e7800/0x85f51a6b9671743d lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051455.998817:0:8492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d9533ab000) 00010000:00010000:3.0:1777051455.998823:0:8492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777051455.998829:0:8492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e6e7800/0x85f51a6b9671743d lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051455.998842:0:8492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e6e7800/0x85f51a6b9671743d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051455.998863:0:8492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e6e6200/0x85f51a6b96717444 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x45e84fca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051455.998875:0:8492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e6e6200/0x85f51a6b96717444 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x45e84fca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051455.998886:0:8492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e6e6200/0x85f51a6b96717444 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x45e84fca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051455.998895:0:8492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94e6e6200 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:3.0:1777051455.998900:0:8492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e6e6200/0x85f51a6b96717444 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x45e84fca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051455.998912:0:8492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e6e6200/0x85f51a6b96717444 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x45e84fca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051455.998926:0:8492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x45e84fca (ffff99d9413d2800) 00010000:00010000:3.0:1777051455.998931:0:8492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777051455.998937:0:8492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e6e6200/0x85f51a6b96717444 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x45e84fca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051455.998949:0:8492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e6e6200/0x85f51a6b96717444 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x45e84fca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051455.999011:0:8492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e6e6400/0x85f51a6b96717436 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6967 expref: 25 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051455.999037:0:8492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e6e6c00/0x85f51a6b9671744b lrc: 3/0,0 mode: PR/PR res: [0x240000bd3:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6967 expref: 24 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051455.999052:0:8492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd3:0x4:0x0].0x0 (ffff99da42881d00) 00010000:00010000:3.0:1777051455.999057:0:8492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1777051455.999061:0:8492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d94e6e6c00, rc 0) 00000100:00100000:3.0:1777051455.999157:0:8492:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d951fa2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+24:138819:x1863365426077056:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 Request processed in 904us (1215us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051455.999172:0:8492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112337 00000100:00100000:3.0:1777051456.002671:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051456.002759:0:6580:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426077184 00000100:00100000:2.0:1777051456.002773:0:6580:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426077184 00000100:00100000:2.0:1777051456.002864:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112338 00000100:00100000:2.0:1777051456.002879:0:6580:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94c12a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+9:138819:x1863365426077184:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1777051456.002903:0:6580:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051456.002932:0:6580:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d950711600/0x85f51a6b96717452 lrc: 2/0,0 mode: --/CR res: [0x240000bd3:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b696e expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051456.003009:0:6580:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d950710400/0x85f51a6b96717459 lrc: 3/1,0 mode: --/PR res: [0x240000bd3:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051456.003030:0:6580:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d950710400/0x85f51a6b96717459 lrc: 3/1,0 mode: PR/PR res: [0x240000bd3:0x4:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6580 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051456.003047:0:6580:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d950710400/0x85f51a6b96717459 lrc: 3/1,0 mode: PR/PR res: [0x240000bd3:0x4:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6580 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1777051456.003212:0:6580:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000bd3:0x4:0x0]: returning size 4096 00000004:00200000:2.0:1777051456.003221:0:6580:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:2.0:1777051456.003283:0:6580:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d950711600/0x85f51a6b96717452 lrc: 0/0,0 mode: --/CR res: [0x240000bd3:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b696e expref: 11 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051456.003316:0:6580:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99d950710400/0x85f51a6b96717459 lrc: 3/0,0 mode: PR/PR res: [0x240000bd3:0x4:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b696e expref: 10 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051456.003326:0:6580:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd3:0x4:0x0].0x0 (ffff99d94e52ac00) 00010000:00010000:2.0:1777051456.003329:0:6580:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:2.0:1777051456.003333:0:6580:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d950710400, rc 0) 00000100:00100000:2.0:1777051456.003526:0:6580:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94c12a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+10:138819:x1863365426077184:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 Request processed in 535us (747us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051456.003540:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112338 00000100:00100000:0.0:1777051456.006725:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051456.006815:0:6579:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426077312 00000100:00100000:3.0:1777051456.006826:0:6579:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426077312 00000100:00100000:3.0:1777051456.006906:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112339 00000100:00100000:3.0:1777051456.006923:0:6579:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d951fa1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+10:138819:x1863365426077312:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1777051456.006940:0:6579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777051456.006960:0:6579:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e6e7a00/0x85f51a6b96717460 lrc: 2/0,0 mode: --/CR res: [0x240000bd0:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6975 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051456.007014:0:6579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e6e7400/0x85f51a6b96717467 lrc: 3/1,0 mode: --/PR res: [0x240000bd0:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051456.007030:0:6579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e6e7400/0x85f51a6b96717467 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051456.007052:0:6579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e6e7400/0x85f51a6b96717467 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1777051456.007089:0:6579:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000bd0:0x3:0x0]: returning size 4096 00000004:00200000:3.0:1777051456.007096:0:6579:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:3.0:1777051456.007129:0:6579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e6e7a00/0x85f51a6b96717460 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6975 expref: 12 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051456.007155:0:6579:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e6e7400/0x85f51a6b96717467 lrc: 3/0,0 mode: PR/PR res: [0x240000bd0:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6975 expref: 11 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051456.007167:0:6579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x3:0x0].0x0 (ffff99d94e629300) 00010000:00010000:3.0:1777051456.007524:0:6579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1777051456.007532:0:6579:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d94e6e7400, rc 0) 00000100:00100000:3.0:1777051456.007607:0:6579:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d951fa1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+11:138819:x1863365426077312:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 Request processed in 686us (887us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051456.007621:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112339 00000100:00100000:0.0:1777051456.013436:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051456.013619:0:21368:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426077568 00000100:00100000:1.0:1777051456.013636:0:21368:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426077568 00000100:00100000:1.0:1777051456.013726:0:21368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112340 00000100:00100000:1.0:1777051456.014023:0:21368:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d951fa3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+11:138819:x1863365426077568:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1777051456.014052:0:21368:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777051456.014057:0:21368:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1777051456.014096:0:21368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e6e7400/0x85f51a6b96717467 lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6975 expref: 11 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051456.014126:0:21368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x3:0x0].0x0 (ffff99d94e629300) 00010000:00010000:1.0:1777051456.014134:0:21368:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1777051456.014153:0:21368:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d5cfa00/0x85f51a6b9671746e lrc: 2/0,0 mode: --/CW res: [0x240000bd0:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b697c expref: -99 pid: 21368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051456.015178:0:21368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d5cf200/0x85f51a6b96717475 lrc: 3/1,0 mode: --/PR res: [0x240000bd2:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051456.015266:0:21368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d5cf200/0x85f51a6b96717475 lrc: 3/1,0 mode: PR/PR res: [0x240000bd2:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21368 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051456.015288:0:21368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d5cf200/0x85f51a6b96717475 lrc: 3/1,0 mode: PR/PR res: [0x240000bd2:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21368 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1777051456.015307:0:21368:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000bd2:0x7:0x0]: returning size 0 00010000:00010000:1.0:1777051456.015373:0:21368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d5cfa00/0x85f51a6b9671746e lrc: 0/0,0 mode: --/CW res: [0x240000bd0:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b697c expref: 13 pid: 21368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051456.015399:0:21368:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d5cf200/0x85f51a6b96717475 lrc: 3/0,0 mode: PR/PR res: [0x240000bd2:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b697c expref: 12 pid: 21368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051456.015421:0:21368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x7:0x0].0x0 (ffff99d94e629d00) 00010000:00010000:1.0:1777051456.015426:0:21368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1777051456.015430:0:21368:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99da7d5cf200, rc 0) 00000100:00100000:1.0:1777051456.015545:0:21368:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d951fa3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+12:138819:x1863365426077568:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 Request processed in 1806us (2113us total) trans 8589934744 rc 0/0 00000100:00100000:1.0:1777051456.015558:0:21368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112340 00000100:00100000:0.0:1777051456.021692:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051456.021822:0:10328:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426077824 00000100:00100000:3.0:1777051456.021834:0:10328:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426077824 00000100:00100000:3.0:1777051456.021912:0:10328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112341 00000100:00100000:3.0:1777051456.021940:0:10328:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d951fa1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+12:138819:x1863365426077824:12345-192.168.201.46@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1777051456.022004:0:10328:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777051456.022035:0:10328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d5cf200/0x85f51a6b96717475 lrc: 0/0,0 mode: --/PR res: [0x240000bd2:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b697c expref: 12 pid: 21368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051456.022062:0:10328:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x7:0x0].0x0 (ffff99d94e629d00) 00010000:00010000:3.0:1777051456.022078:0:10328:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1777051456.022103:0:10328:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e6e7a00/0x85f51a6b96717483 lrc: 3/0,1 mode: --/CW res: [0x240000bd0:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051456.022123:0:10328:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a2600/0x85f51a6b9671733a lrc: 2/0,0 mode: PR/PR res: [0x240000bd0:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b691a expref: 62 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051456.022138:0:10328:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e6e7a00/0x85f51a6b96717483 lrc: 4/0,1 mode: --/CW res: [0x240000bd0:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10328 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051456.022186:0:10328:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a2600/0x85f51a6b9671733a lrc: 3/0,0 mode: PR/PR res: [0x240000bd0:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b691a expref: 62 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051456.022276:0:10328:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a2600/0x85f51a6b9671733a lrc: 4/0,0 mode: PR/PR res: [0x240000bd0:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b691a expref: 62 pid: 8492 timeout: 8185 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051456.022303:0:10328:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94c12b800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:10328:1863365452680064:192.168.201.46@tcp:104: 00000100:00100000:3.0:1777051456.022432:0:10328:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d958f6de40 going to sleep for 11 seconds 00000100:00100000:3.0:1777051456.025824:0:10328:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94c12b800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:10328:1863365452680064:192.168.201.46@tcp:104: 00010000:00010000:3.0:1777051456.025858:0:10328:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e6e7a00/0x85f51a6b96717483 lrc: 3/0,1 mode: --/CW res: [0x240000bd0:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10328 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051456.027785:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051456.028609:0:9550:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426077952 00000100:00100000:1.0:1777051456.028621:0:9550:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426077952 00010000:00010000:1.0:1777051456.028670:0:9550:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a2600/0x85f51a6b9671733a lrc: 4/0,0 mode: PR/PR res: [0x240000bd0:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b691a expref: 63 pid: 8492 timeout: 8185 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051456.028738:0:9550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3961 00000100:00100000:1.0:1777051456.028755:0:9550:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d951fa0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+63:2437:x1863365426077952:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1777051456.028775:0:9550:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1777051456.028788:0:9550:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a2600/0x85f51a6b9671733a lrc: 4/0,0 mode: PR/PR res: [0x240000bd0:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b691a expref: 63 pid: 8492 timeout: 8185 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051456.028815:0:9550:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a2600/0x85f51a6b9671733a lrc: 3/0,0 mode: PR/PR res: [0x240000bd0:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b691a expref: 63 pid: 8492 timeout: 8185 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051456.028845:0:9550:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d9559a2600/0x85f51a6b9671733a lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b691a expref: 63 pid: 8492 timeout: 8185 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051456.028872:0:9550:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x3:0x0].0x0 (ffff99d94e629300) 00010000:00010000:1.0:1777051456.028880:0:9550:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e6e7a00/0x85f51a6b96717483 lrc: 3/0,1 mode: --/CW res: [0x240000bd0:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10328 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051456.028897:0:9550:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e6e7a00/0x85f51a6b96717483 lrc: 3/0,1 mode: CW/CW res: [0x240000bd0:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 10328 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051456.028911:0:9550:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e6e7a00/0x85f51a6b96717483 lrc: 4/0,1 mode: CW/CW res: [0x240000bd0:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 10328 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051456.028953:0:9550:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1777051456.029034:0:9550:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d951fa0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+62:2437:x1863365426077952:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 281us (1253us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051456.029050:0:9550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3961 00010000:00010000:3.0:1777051456.029651:0:10328:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e6e7a00/0x85f51a6b96717483 lrc: 3/0,1 mode: CW/CW res: [0x240000bd0:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10328 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051456.030571:0:10328:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e6e7a00/0x85f51a6b96717483 lrc: 3/0,1 mode: CW/CW res: [0x240000bd0:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10328 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051456.030611:0:10328:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e6e6400/0x85f51a6b9671748a lrc: 3/0,1 mode: --/PW res: [0x240000bd0:0x3:0x0].0x85b77358 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051456.030645:0:10328:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e6e6400/0x85f51a6b9671748a lrc: 3/0,1 mode: PW/PW res: [0x240000bd0:0x3:0x0].0x85b77358 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10328 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051456.031016:0:10328:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e6e6400/0x85f51a6b9671748a lrc: 3/0,1 mode: PW/PW res: [0x240000bd0:0x3:0x0].0x85b77358 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10328 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051456.031083:0:10328:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e6e7a00/0x85f51a6b96717483 lrc: 4/0,1 mode: CW/CW res: [0x240000bd0:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10328 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051456.031098:0:10328:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e6e7a00/0x85f51a6b96717483 lrc: 4/0,1 mode: CW/CW res: [0x240000bd0:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10328 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051456.031110:0:10328:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e6e7a00/0x85f51a6b96717483 lrc: 3/0,0 mode: CW/CW res: [0x240000bd0:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10328 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051456.031121:0:10328:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e6e7a00/0x85f51a6b96717483 lrc: 4/0,0 mode: CW/CW res: [0x240000bd0:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10328 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051456.031133:0:10328:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94e6e7a00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:3.0:1777051456.031140:0:10328:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e6e7a00/0x85f51a6b96717483 lrc: 4/0,0 mode: CW/CW res: [0x240000bd0:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10328 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051456.031153:0:10328:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e6e7a00/0x85f51a6b96717483 lrc: 5/0,0 mode: CW/CW res: [0x240000bd0:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10328 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051456.031172:0:10328:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x3:0x0].0x0 (ffff99d94e629300) 00010000:00010000:3.0:1777051456.031175:0:10328:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777051456.031181:0:10328:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e6e7a00/0x85f51a6b96717483 lrc: 3/0,0 mode: --/CW res: [0x240000bd0:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10328 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051456.031189:0:10328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e6e7a00/0x85f51a6b96717483 lrc: 0/0,0 mode: --/CW res: [0x240000bd0:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10328 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051456.031237:0:10328:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e6e6400/0x85f51a6b9671748a lrc: 3/0,1 mode: PW/PW res: [0x240000bd0:0x3:0x0].0x85b77358 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10328 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051456.031246:0:10328:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e6e6400/0x85f51a6b9671748a lrc: 2/0,0 mode: PW/PW res: [0x240000bd0:0x3:0x0].0x85b77358 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10328 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051456.031253:0:10328:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e6e6400/0x85f51a6b9671748a lrc: 3/0,0 mode: PW/PW res: [0x240000bd0:0x3:0x0].0x85b77358 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10328 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051456.031259:0:10328:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94e6e6400 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:3.0:1777051456.031262:0:10328:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e6e6400/0x85f51a6b9671748a lrc: 3/0,0 mode: PW/PW res: [0x240000bd0:0x3:0x0].0x85b77358 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10328 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051456.031269:0:10328:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e6e6400/0x85f51a6b9671748a lrc: 4/0,0 mode: PW/PW res: [0x240000bd0:0x3:0x0].0x85b77358 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10328 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051456.031277:0:10328:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x3:0x0].0x85b77358 (ffff99d9413d2800) 00010000:00010000:3.0:1777051456.031280:0:10328:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777051456.031283:0:10328:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e6e6400/0x85f51a6b9671748a lrc: 2/0,0 mode: --/PW res: [0x240000bd0:0x3:0x0].0x85b77358 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10328 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051456.031293:0:10328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e6e6400/0x85f51a6b9671748a lrc: 0/0,0 mode: --/PW res: [0x240000bd0:0x3:0x0].0x85b77358 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10328 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051456.031401:0:10328:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d951fa1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+11:138819:x1863365426077824:12345-192.168.201.46@tcp:36:lhsmtool_posix.0 Request processed in 9473us (9713us total) trans 0 rc -2/-2 00000100:00100000:3.0:1777051456.031415:0:10328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112341 00000100:00100000:0.0:1777051456.036313:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051456.036442:0:8492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426078080 00000100:00100000:1.0:1777051456.036456:0:8492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426078080 00000100:00100000:1.0:1777051456.036571:0:8492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112342 00000100:00100000:1.0:1777051456.036593:0:8492:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d951fa3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+11:138819:x1863365426078080:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1777051456.036615:0:8492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777051456.036641:0:8492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d5ce800/0x85f51a6b96717491 lrc: 2/0,0 mode: --/PR res: [0x240000bd2:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6983 expref: -99 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051456.036696:0:8492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d5cfe00/0x85f51a6b96717498 lrc: 3/1,0 mode: --/PR res: [0x240000bd2:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051456.036716:0:8492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d5cfe00/0x85f51a6b96717498 lrc: 3/1,0 mode: PR/PR res: [0x240000bd2:0x7:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8492 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051456.036733:0:8492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d5cfe00/0x85f51a6b96717498 lrc: 3/1,0 mode: PR/PR res: [0x240000bd2:0x7:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8492 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051456.036881:0:8492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d5ce800/0x85f51a6b96717491 lrc: 0/0,0 mode: --/PR res: [0x240000bd2:0x7:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6983 expref: 13 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051456.036918:0:8492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d5cfe00/0x85f51a6b96717498 lrc: 3/0,0 mode: PR/PR res: [0x240000bd2:0x7:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6983 expref: 12 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051456.036936:0:8492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x7:0x0].0x0 (ffff99d94e629800) 00010000:00010000:1.0:1777051456.036942:0:8492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1777051456.036948:0:8492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99da7d5cfe00, rc 0) 00000100:00100000:1.0:1777051456.037045:0:8492:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d951fa3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+12:138819:x1863365426078080:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 Request processed in 459us (734us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051456.037060:0:8492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112342 00000100:00100000:1.0:1777051456.040559:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051456.040697:0:46497:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426078336 00000100:00100000:2.0:1777051456.040710:0:46497:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426078336 00000100:00100000:2.0:1777051456.040803:0:46497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112343 00000100:00100000:2.0:1777051456.040821:0:46497:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f65a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:c11b6966-0775-44d2-bdc6-c74c26eb2226+12:138819:x1863365426078336:12345-192.168.201.46@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1777051456.040931:0:46497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff99d950711600/0x85f51a6b9671749f lrc: 3/0,1 mode: --/PW res: [0x240000bd2:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051456.040956:0:46497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d950711600/0x85f51a6b9671749f lrc: 3/0,1 mode: PW/PW res: [0x240000bd2:0x7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051456.040974:0:46497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d950711600/0x85f51a6b9671749f lrc: 3/0,1 mode: PW/PW res: [0x240000bd2:0x7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1777051456.041186:0:46497:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000235327be reply state 00000000700ea2f2 transno 8589934745 ns: mdt-lustre-MDT0001_UUID lock: ffff99d950711600/0x85f51a6b9671749f lrc: 3/0,1 mode: PW/PW res: [0x240000bd2:0x7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051456.041264:0:46497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d950711600/0x85f51a6b9671749f lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd2:0x7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051456.041280:0:46497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x7:0x0].0x0 (ffff99d94e629800) 00010000:00010000:2.0:1777051456.041286:0:46497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1777051456.041292:0:46497:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1777051456.041424:0:46497:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f65a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:c11b6966-0775-44d2-bdc6-c74c26eb2226+14:138819:x1863365426078336:12345-192.168.201.46@tcp:36:lhsmtool_posix.0 Request processed in 602us (867us total) trans 8589934745 rc 0/0 00000100:00100000:2.0:1777051456.041442:0:46497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112343 00000100:00100000:0.0:1777051456.044975:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051456.045099:0:46494:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426078464 00000100:00100000:2.0:1777051456.045110:0:46494:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426078464 00000100:00100000:2.0:1777051456.045189:0:46494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112344 00000100:00100000:2.0:1777051456.045253:0:46494:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d951fa3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c11b6966-0775-44d2-bdc6-c74c26eb2226+14:138819:x1863365426078464:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1777051456.045282:0:46494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051456.045308:0:46494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d950710a00/0x85f51a6b967174a6 lrc: 2/0,0 mode: --/CR res: [0x240000bd2:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b698a expref: -99 pid: 46494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051456.045373:0:46494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d950710a00/0x85f51a6b967174a6 lrc: 3/0,0 mode: CR/CR res: [0x240000bd2:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b698a expref: 15 pid: 46494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051456.045429:0:46494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99d950710a00/0x85f51a6b967174a6 lrc: 3/0,0 mode: CR/CR res: [0x240000bd2:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b698a expref: 15 pid: 46494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051456.045447:0:46494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x7:0x0].0x0 (ffff99d94e629800) 00010000:00010000:2.0:1777051456.045453:0:46494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1777051456.045460:0:46494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d950710a00, rc 0) 00000100:00100000:2.0:1777051456.045574:0:46494:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d951fa3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c11b6966-0775-44d2-bdc6-c74c26eb2226+15:138819:x1863365426078464:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 Request processed in 328us (602us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051456.045590:0:46494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112344 00000100:00100000:0.0:1777051456.049279:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051456.049404:0:24269:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426078592 00000100:00100000:2.0:1777051456.049418:0:24269:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426078592 00000100:00100000:2.0:1777051456.049547:0:24269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3420 00000100:00100000:2.0:1777051456.049565:0:24269:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d951fa2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+15:138819:x1863365426078592:12345-192.168.201.46@tcp:49:lhsmtool_posix.0 00000100:00100000:2.0:1777051456.049707:0:24269:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d951fa2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+15:138819:x1863365426078592:12345-192.168.201.46@tcp:49:lhsmtool_posix.0 Request processed in 146us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051456.049718:0:24269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3420 00000100:00100000:1.0:1777051456.055134:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051456.055282:0:46501:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426078848 00000100:00100000:0.0:1777051456.055292:0:46501:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426078848 00000100:00100000:0.0:1777051456.055349:0:46501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3421 00000100:00100000:0.0:1777051456.055401:0:46501:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f97ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+15:138819:x1863365426078848:12345-192.168.201.46@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1777051456.055723:0:46501:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f97ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+16:138819:x1863365426078848:12345-192.168.201.46@tcp:35:lhsmtool_posix.0 Request processed in 325us (590us total) trans 8589934746 rc 0/0 00000100:00100000:0.0:1777051456.055739:0:46501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3421 00000100:00100000:1.0:1777051456.058671:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051456.058765:0:27882:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426079104 00000100:00100000:0.0:1777051456.058776:0:27882:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426079104 00000100:00100000:0.0:1777051456.058845:0:27882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112345 00000100:00100000:0.0:1777051456.058866:0:27882:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d944d2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+16:138819:x1863365426079104:12345-192.168.201.46@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1777051456.059012:0:27882:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d944d2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+16:138819:x1863365426079104:12345-192.168.201.46@tcp:57:lhsmtool_posix.0 Request processed in 150us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051456.059026:0:27882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112345 00000100:00100000:0.0:1777051456.062671:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051456.062765:0:27885:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426079360 00000100:00100000:3.0:1777051456.062776:0:27885:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426079360 00000100:00100000:3.0:1777051456.062874:0:27885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112346 00000100:00100000:3.0:1777051456.062896:0:27885:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d951fa0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c11b6966-0775-44d2-bdc6-c74c26eb2226+16:138819:x1863365426079360:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1777051456.062918:0:27885:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777051456.062948:0:27885:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e6e7a00/0x85f51a6b967174ad lrc: 2/0,0 mode: --/CR res: [0x240000bd2:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6991 expref: -99 pid: 27885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051456.063122:0:27885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e6e6200/0x85f51a6b967174b4 lrc: 3/0,1 mode: --/EX res: [0x240000bd2:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051456.063149:0:27885:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff99d950710a00/0x85f51a6b967174a6 lrc: 2/0,0 mode: CR/CR res: [0x240000bd2:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b698a expref: 17 pid: 46494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051456.063163:0:27885:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e6e6200/0x85f51a6b967174b4 lrc: 4/0,1 mode: --/EX res: [0x240000bd2:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27885 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051456.063214:0:27885:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff99d950710a00/0x85f51a6b967174a6 lrc: 3/0,0 mode: CR/CR res: [0x240000bd2:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b698a expref: 17 pid: 46494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051456.063242:0:27885:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff99d950710a00/0x85f51a6b967174a6 lrc: 4/0,0 mode: CR/CR res: [0x240000bd2:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b698a expref: 17 pid: 46494 timeout: 8185 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051456.063298:0:27885:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94c12b800 pname:cluuid:pid:xid:nid:opc:job mdt00_007:lustre-MDT0001_UUID:27885:1863365452680192:192.168.201.46@tcp:104: 00000100:00100000:3.0:1777051456.063438:0:27885:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d958f6de40 going to sleep for 11 seconds 00000100:00100000:0.0:1777051456.067322:0:27885:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94c12b800 pname:cluuid:pid:xid:nid:opc:job mdt00_007:lustre-MDT0001_UUID:27885:1863365452680192:192.168.201.46@tcp:104: 00010000:00010000:0.0:1777051456.067357:0:27885:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e6e6200/0x85f51a6b967174b4 lrc: 3/0,1 mode: --/EX res: [0x240000bd2:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27885 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051456.069100:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051456.069315:0:47827:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426079488 00000100:00100000:3.0:1777051456.069327:0:47827:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426079488 00010000:00010000:3.0:1777051456.069379:0:47827:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d950710a00/0x85f51a6b967174a6 lrc: 4/0,0 mode: CR/CR res: [0x240000bd2:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b698a expref: 18 pid: 46494 timeout: 8185 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051456.069535:0:6566:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3962 00000100:00100000:0.0:1777051456.069556:0:6566:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d951fa2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+18:2437:x1863365426079488:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1777051456.069579:0:6566:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777051456.069591:0:6566:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff99d950710a00/0x85f51a6b967174a6 lrc: 4/0,0 mode: CR/CR res: [0x240000bd2:0x7:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b698a expref: 18 pid: 46494 timeout: 8185 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051456.069646:0:6566:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff99d950710a00/0x85f51a6b967174a6 lrc: 3/0,0 mode: CR/CR res: [0x240000bd2:0x7:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b698a expref: 18 pid: 46494 timeout: 8185 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051456.069683:0:6566:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d950710a00/0x85f51a6b967174a6 lrc: 0/0,0 mode: --/CR res: [0x240000bd2:0x7:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b698a expref: 18 pid: 46494 timeout: 8185 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051456.069708:0:6566:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x7:0x0].0x0 (ffff99d94e629800) 00010000:00010000:0.0:1777051456.069717:0:6566:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e6e6200/0x85f51a6b967174b4 lrc: 3/0,1 mode: --/EX res: [0x240000bd2:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27885 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051456.069741:0:6566:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e6e6200/0x85f51a6b967174b4 lrc: 3/0,1 mode: EX/EX res: [0x240000bd2:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 27885 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051456.069754:0:6566:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e6e6200/0x85f51a6b967174b4 lrc: 4/0,1 mode: EX/EX res: [0x240000bd2:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 27885 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051456.069802:0:6566:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1777051456.069841:0:27885:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e6e6200/0x85f51a6b967174b4 lrc: 3/0,1 mode: EX/EX res: [0x240000bd2:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 27885 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051456.069856:0:27885:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e6e6200/0x85f51a6b967174b4 lrc: 3/0,1 mode: EX/EX res: [0x240000bd2:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 27885 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051456.069877:0:6566:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d951fa2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+17:2437:x1863365426079488:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 325us (778us total) trans 0 rc 0/0 00000004:00200000:3.0:1777051456.069877:0:27885:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000bd2:0x7:0x0]: returning size 0 00000100:00100000:0.0:1777051456.069897:0:6566:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3962 00000004:00080000:3.0:1777051456.070113:0:27885:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x106:0x0], index 0: 0 00010000:00010000:3.0:1777051456.070678:0:27885:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e6e6200/0x85f51a6b967174b4 lrc: 3/0,1 mode: EX/EX res: [0x240000bd2:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 27885 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051456.070968:0:27885:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e6e6200/0x85f51a6b967174b4 lrc: 2/0,0 mode: EX/EX res: [0x240000bd2:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 27885 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051456.070979:0:27885:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e6e6200/0x85f51a6b967174b4 lrc: 3/0,0 mode: EX/EX res: [0x240000bd2:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 27885 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051456.070990:0:27885:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94e6e6200 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:3.0:1777051456.070997:0:27885:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e6e6200/0x85f51a6b967174b4 lrc: 3/0,0 mode: EX/EX res: [0x240000bd2:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 27885 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051456.071010:0:27885:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e6e6200/0x85f51a6b967174b4 lrc: 4/0,0 mode: EX/EX res: [0x240000bd2:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 27885 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051456.071028:0:27885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x7:0x0].0x0 (ffff99d94e629800) 00010000:00010000:3.0:1777051456.071034:0:27885:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1777051456.071040:0:27885:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e6e6200/0x85f51a6b967174b4 lrc: 2/0,0 mode: --/EX res: [0x240000bd2:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 27885 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051456.071053:0:27885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e6e6200/0x85f51a6b967174b4 lrc: 0/0,0 mode: --/EX res: [0x240000bd2:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 27885 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051456.071122:0:27885:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e6e7a00/0x85f51a6b967174ad lrc: 1/0,0 mode: --/CR res: [0x240000bd2:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6991 expref: 17 pid: 27885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051456.071148:0:27885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x7:0x0].0x0 (ffff99d94e629800) 00010000:00010000:3.0:1777051456.071153:0:27885:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1777051456.071161:0:27885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e6e7a00/0x85f51a6b967174ad lrc: 0/0,0 mode: --/CR res: [0x240000bd2:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6991 expref: 17 pid: 27885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051456.071179:0:27885:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d94e6e7a00, rc 0) 00000100:00100000:3.0:1777051456.071265:0:27885:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d951fa0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c11b6966-0775-44d2-bdc6-c74c26eb2226+16:138819:x1863365426079360:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 Request processed in 8377us (8600us total) trans 8589934747 rc 301/301 00000100:00100000:3.0:1777051456.071278:0:27885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112346 00000100:00100000:3.0:1777051456.076564:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051456.076834:0:24269:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426079744 00000100:00100000:2.0:1777051456.076846:0:24269:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426079744 00000100:00100000:2.0:1777051456.076954:0:24269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3422 00000100:00100000:2.0:1777051456.076972:0:24269:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94c12b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+16:138819:x1863365426079744:12345-192.168.201.46@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1777051456.077340:0:24269:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94c12b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+17:138819:x1863365426079744:12345-192.168.201.46@tcp:35:lhsmtool_posix.0 Request processed in 370us (785us total) trans 8589934748 rc 0/0 00000100:00100000:2.0:1777051456.077366:0:24269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3422 00000100:00100000:0.0:1777051456.083592:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051456.084654:0:6581:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426079872 00000100:00100000:2.0:1777051456.084668:0:6581:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426079872 00000100:00100000:2.0:1777051456.084764:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112347 00000100:00100000:2.0:1777051456.084782:0:6581:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d951fa0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+17:138819:x1863365426079872:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1777051456.084814:0:6581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051456.084843:0:6581:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d950711400/0x85f51a6b967174c2 lrc: 2/0,0 mode: --/CR res: [0x240000bd2:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6998 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051456.084952:0:6581:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d950710e00/0x85f51a6b967174c9 lrc: 3/1,0 mode: --/PR res: [0x240000bd2:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051456.084976:0:6581:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d950710e00/0x85f51a6b967174c9 lrc: 3/1,0 mode: PR/PR res: [0x240000bd2:0x7:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6581 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051456.084994:0:6581:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d950710e00/0x85f51a6b967174c9 lrc: 3/1,0 mode: PR/PR res: [0x240000bd2:0x7:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6581 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1777051456.085048:0:6581:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000bd2:0x7:0x0]: returning size 0 00000004:00200000:2.0:1777051456.085055:0:6581:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1777051456.085082:0:6581:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff99d950710e00/0x85f51a6b967174c9 lrc: 3/1,0 mode: PR/PR res: [0x240000bd2:0x7:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6581 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051456.085120:0:6581:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d950711400/0x85f51a6b967174c2 lrc: 0/0,0 mode: --/CR res: [0x240000bd2:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6998 expref: 19 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051456.085480:0:6581:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99d950710e00/0x85f51a6b967174c9 lrc: 3/0,0 mode: PR/PR res: [0x240000bd2:0x7:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6998 expref: 18 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051456.085496:0:6581:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x7:0x0].0x0 (ffff99d94e629800) 00010000:00010000:2.0:1777051456.085536:0:6581:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1777051456.085541:0:6581:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d950710e00, rc 0) 00000100:00100000:2.0:1777051456.085619:0:6581:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d951fa0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+18:138819:x1863365426079872:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 Request processed in 840us (2035us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051456.085632:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112347 00000100:00100000:3.0:1777051456.090761:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051456.090858:0:8628:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426080000 00000100:00100000:0.0:1777051456.090866:0:8628:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426080000 00000100:00080000:1.0:1777051456.090957:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1777051456.091068:0:8628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 8085 00000100:00100000:0.0:1777051456.091092:0:8628:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d943d92a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+51:2436:x1863365426080000:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1777051456.091111:0:8628:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051456.091140:0:8628:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003b773f6d/0x85f51a6b967174d0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x106:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b699f expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1777051456.091174:0:8628:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x106:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1777051456.091199:0:8628:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777051456.091202:0:8628:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777051456.091215:0:8628:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003b773f6d/0x85f51a6b967174d0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x106:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b699f expref: 52 pid: 8628 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051456.091244:0:8628:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003b773f6d/0x85f51a6b967174d0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x106:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b699f expref: 52 pid: 8628 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051456.091389:0:8628:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99da7d774800, rc 0) 00000100:00100000:0.0:1777051456.091475:0:8628:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d943d92a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+52:2436:x1863365426080000:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 Request processed in 392us (718us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051456.091489:0:8628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 8085 00000100:00100000:1.0:1777051456.097707:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051456.097979:0:6580:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426080256 00000100:00100000:0.0:1777051456.097992:0:6580:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426080256 00000100:00100000:0.0:1777051456.098069:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112348 00000100:00100000:0.0:1777051456.098090:0:6580:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d944d29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+18:138819:x1863365426080256:12345-192.168.201.46@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1777051456.098223:0:6580:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d944d29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+18:138819:x1863365426080256:12345-192.168.201.46@tcp:57:lhsmtool_posix.0 Request processed in 138us (520us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051456.098240:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112348 00000100:00100000:3.0:1777051456.103434:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051456.103615:0:55805:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426080384 00000100:00100000:1.0:1777051456.103623:0:55805:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426080384 00000100:00100000:1.0:1777051456.103681:0:55805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 8086 00000100:00100000:1.0:1777051456.103697:0:55805:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d943d90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c11b6966-0775-44d2-bdc6-c74c26eb2226+52:138819:x1863365426080384:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1777051456.103717:0:55805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777051456.103739:0:55805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008c405381/0x85f51a6b967174d7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x106:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b69a6 expref: -99 pid: 55805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051456.103774:0:55805:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003b773f6d/0x85f51a6b967174d0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x106:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b699f expref: 53 pid: 8628 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051456.103794:0:55805:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051456.103798:0:55805:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051456.103804:0:55805:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008c405381/0x85f51a6b967174d7 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x106:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b69a6 expref: 53 pid: 55805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051456.103850:0:55805:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003b773f6d/0x85f51a6b967174d0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x106:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b699f expref: 53 pid: 8628 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051456.103872:0:55805:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003b773f6d/0x85f51a6b967174d0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x106:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b699f expref: 53 pid: 8628 timeout: 8185 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051456.103893:0:55805:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da4384c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:55805:1863365452680320:192.168.201.46@tcp:104: 00000100:00100000:1.0:1777051456.104074:0:55805:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d95dc37000 going to sleep for 11 seconds 00000100:00100000:3.0:1777051456.107194:0:55805:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da4384c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:55805:1863365452680320:192.168.201.46@tcp:104: 00010000:00010000:3.0:1777051456.107236:0:55805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008c405381/0x85f51a6b967174d7 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x106:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b69a6 expref: 53 pid: 55805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051456.107262:0:55805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99da7d5cfa00, rc 0) 00000100:00100000:3.0:1777051456.107492:0:55805:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d943d90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c11b6966-0775-44d2-bdc6-c74c26eb2226+53:138819:x1863365426080384:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 Request processed in 3797us (4062us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051456.107537:0:55805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 8086 00000100:00100000:3.0:1777051456.108126:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051456.108393:0:6564:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426080512 00000100:00100000:2.0:1777051456.108402:0:6564:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426080512 00010000:00010000:2.0:1777051456.108436:0:6564:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003b773f6d/0x85f51a6b967174d0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x106:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b699f expref: 53 pid: 8628 timeout: 8185 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051456.108489:0:6564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3963 00000100:00100000:2.0:1777051456.108537:0:6564:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d943d91500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+53:2436:x1863365426080512:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1777051456.108557:0:6564:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777051456.108598:0:6564:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003b773f6d/0x85f51a6b967174d0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x106:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b699f expref: 53 pid: 8628 timeout: 8185 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051456.108623:0:6564:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003b773f6d/0x85f51a6b967174d0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x106:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b699f expref: 53 pid: 8628 timeout: 8185 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051456.108655:0:6564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003b773f6d/0x85f51a6b967174d0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x106:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b699f expref: 53 pid: 8628 timeout: 8185 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051456.108678:0:6564:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777051456.108683:0:6564:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777051456.108693:0:6564:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008c405381/0x85f51a6b967174d7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x106:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b69a6 expref: 52 pid: 55805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051456.108710:0:6564:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008c405381/0x85f51a6b967174d7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x106:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b69a6 expref: 52 pid: 55805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051456.108757:0:6564:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000008c405381/0x85f51a6b967174d7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x106:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b69a6 expref: 52 pid: 55805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051456.108780:0:6564:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f9b8380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6564:1863365452680448:192.168.201.46@tcp:105: 00000100:00100000:2.0:1777051456.108873:0:6564:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d956bda480 going to sleep for 11 seconds 00000100:00100000:1.0:1777051456.112615:0:6564:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f9b8380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6564:1863365452680448:192.168.201.46@tcp:105: 00010000:00010000:1.0:1777051456.112644:0:6564:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1777051456.112713:0:6564:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d943d91500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+52:2436:x1863365426080512:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 4209us (4585us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051456.112730:0:6564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3963 00000040:00080000:0.0:1777051456.199043:0:108205:0:(llog.c:801:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1777051456.199380:0:108205:0:(llog_cat.c:158:llog_cat_process_common()) processing log [0x1:0x12:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1777051456.199476:0:108205:0:(llog.c:858:llog_process_thread()) stop processing plain [0x1:0x12:0x0] index 11 count 9 00000040:00080000:0.0:1777051456.199488:0:108205:0:(llog.c:858:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1777051456.230166:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051456.230295:0:8474:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426080640 00000100:00100000:0.0:1777051456.230312:0:8474:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426080640 00002000:00100000:0.0:1777051456.230390:0:8474:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000400:0x106:0x0] (0->1048575) req@ffff99d943d90000 x1863365426080640/t0(0) o4->c11b6966-0775-44d2-bdc6-c74c26eb2226@192.168.201.46@tcp:417/0 lens 488/0 e 0 to 0 dl 1777051467 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1777051456.230411:0:8474:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99d943d90000 with x1863365426080640 ext(0->1048575) 00002000:00010000:0.0:1777051456.230421:0:8474:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99d943d90000 00000100:00100000:0.0:1777051456.230483:0:8474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 1790 00000100:00100000:0.0:1777051456.230535:0:8474:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d943d90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+52:2437:x1863365426080640:12345-192.168.201.46@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1777051456.257285:0:8474:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d943d90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+54:2437:x1863365426080640:12345-192.168.201.46@tcp:4:lhsmtool_posix.0 Request processed in 26770us (27112us total) trans 4294968370 rc 0/0 00000100:00100000:3.0:1777051456.257317:0:8474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 1790 00002000:00100000:3.0:1777051456.257340:0:8474:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000400:0x106:0x0] (0->1048575) req@ffff99d943d90000 x1863365426080640/t4294968370(0) o4->c11b6966-0775-44d2-bdc6-c74c26eb2226@192.168.201.46@tcp:417/0 lens 488/448 e 0 to 0 dl 1777051467 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1777051456.257359:0:8474:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99d943d90000 with x1863365426080640 ext(0->1048575) 00002000:00010000:3.0:1777051456.257368:0:8474:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99d943d90000 00000100:00100000:3.0:1777051456.278861:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051456.278956:0:6579:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426080768 00000100:00100000:0.0:1777051456.278974:0:6579:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426080768 00000100:00100000:0.0:1777051456.279080:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112349 00000100:00100000:0.0:1777051456.279097:0:6579:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d943d91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+18:138819:x1863365426080768:12345-192.168.201.46@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1777051456.284704:0:104205:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934748 is committed 00000001:00080000:2.0:1777051456.284753:0:104205:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934742 is committed 00000004:00080000:2.0:1777051456.284761:0:104205:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 5 committed 00010000:00010000:0.0:1777051456.284786:0:3663:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff99d950711600/0x85f51a6b9671749f lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd2:0x7:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1777051456.284801:0:104205:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff99d942ccd9c0 refcount 2 committed 0 result 0 batchid 4294970586 00010000:00010000:0.0:1777051456.284815:0:3663:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d950711600/0x85f51a6b9671749f lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd2:0x7:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1777051456.284821:0:104205:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff99d942aec900 obd lustre-OST0001-osc-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff99d942ccdb40 00000020:00080000:2.0:1777051456.284851:0:104205:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff99d942aec600 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff99d944824a00 00010000:00010000:0.0:1777051456.284855:0:3663:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99d950711600/0x85f51a6b9671749f lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd2:0x7:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051456.284869:0:3663:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d950711600 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:0.0:1777051456.284874:0:3663:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d950711600/0x85f51a6b9671749f lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd2:0x7:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051456.284885:0:3663:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d950711600/0x85f51a6b9671749f lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd2:0x7:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1777051456.284905:0:104205:0:(update_trans.c:1333:distribute_txn_batchid_cb()) lustre-MDT0001: 4294970585 batchid updated 00010000:00010000:0.0:1777051456.284909:0:3663:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x7:0x0].0x0 (ffff99d94e629800) 00010000:00010000:0.0:1777051456.284915:0:3663:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1777051456.284921:0:3663:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99d950711600/0x85f51a6b9671749f lrc: 2/0,0 mode: --/TXN res: [0x240000bd2:0x7:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051456.284928:0:3663:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d950711600/0x85f51a6b9671749f lrc: 0/0,0 mode: --/TXN res: [0x240000bd2:0x7:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1777051456.284946:0:104230:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 4294970586 committed batchid 4294970585 00000100:00100000:1.0:1777051456.285086:0:3677:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1777051456.285118:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da4384e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452680576:0@lo:6:osp-syn-1-1.0 00000004:00080000:2.0:1777051456.285167:0:104230:0:(osp_trans.c:1582:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff99d956bda240 with version 18 00000020:00080000:2.0:1777051456.285192:0:104230:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4294970585 cancel update log [0x2000032e1:0x1:0x0].6: rc = 0 00000100:00100000:1.0:1777051456.285236:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:2.0:1777051456.285333:0:104230:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4294970585 cancel update log [0x240000bd0:0x1:0x0].6: rc = 0 00000020:00080000:2.0:1777051456.285352:0:104230:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 4294970585 00000004:00080000:2.0:1777051456.285371:0:104211:0:(osp_trans.c:1330:osp_get_next_request()) ou ffff99d9596fa9c0 version 18 rpc_version 18 00000100:00100000:1.0:1777051456.285387:0:27887:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452680576 00000100:00100000:1.0:1777051456.285401:0:27887:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452680576 00000020:00100000:2.0:1777051456.285423:0:104211:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1777051456.285442:0:104211:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff99da5f9b9180 x1863365452680832/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1777051456.285483:0:104211:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f9b9180 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:104211:1863365452680832:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1777051456.285521:0:27887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8087 00000100:00100000:1.0:1777051456.285543:0:27887:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da4384e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3677:x1863365452680576:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:1.0:1777051456.285584:0:27887:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:485 count 1 00000100:00100000:2.0:1777051456.285613:0:104211:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:1.0:1777051456.285651:0:27887:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x1e5:0x0] initial LVB size: 1048576, mtime: 0x69eba738, atime: 0x69eba738, ctime: 0x69eba738, blocks: 0x800 00010000:00010000:1.0:1777051456.285669:0:27887:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a87371ea/0x85f51a6b967174de lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 27887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051456.285669:0:104211:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d956bda300 going to sleep for 11 seconds 00010000:00010000:1.0:1777051456.285699:0:27887:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051456.285701:0:27887:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1777051456.285703:0:46500:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452680832 00010000:00010000:1.0:1777051456.285709:0:27887:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a87371ea/0x85f51a6b967174de lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 27887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051456.285714:0:46500:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452680832 00010000:00010000:1.0:1777051456.285736:0:27887:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a87371ea/0x85f51a6b967174de lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 27887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051456.286062:0:27887:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a87371ea/0x85f51a6b967174de lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 27887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051456.286076:0:27887:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a87371ea/0x85f51a6b967174de lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 27887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051456.286109:0:46500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8299 00010000:00010000:1.0:1777051456.286117:0:27887:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1777051456.286129:0:46500:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+7:104211:x1863365452680832:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1777051456.286162:0:6579:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d943d91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+11:138819:x1863365426080768:12345-192.168.201.46@tcp:44:lhsmtool_posix.0 Request processed in 7064us (7309us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051456.286180:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112349 00000100:00100000:1.0:1777051456.286428:0:27887:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da4384e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+6:3677:x1863365452680576:12345-0@lo:6:osp-syn-1-1.0 Request processed in 889us (1196us total) trans 4294968376 rc 0/0 00000100:00100000:0.0:1777051456.286446:0:46500:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+8:104211:x1863365452680832:12345-0@lo:1000:osp_up0-1.0 Request processed in 319us (830us total) trans 30064771239 rc 0/0 00000100:00100000:1.0:1777051456.286448:0:27887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8087 00000100:00100000:0.0:1777051456.286472:0:46500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8299 00010000:00010000:1.0:1777051456.286537:0:6568:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777051456.286550:0:6568:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a87371ea/0x85f51a6b967174de lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 27887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051456.286575:0:6568:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da7d5cfc00 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:1.0:1777051456.286586:0:6568:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a87371ea/0x85f51a6b967174de lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 27887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051456.286602:0:6568:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a87371ea/0x85f51a6b967174de lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 27887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051456.286637:0:6568:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a87371ea/0x85f51a6b967174de lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 27887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051456.286649:0:104211:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f9b9180 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:104211:1863365452680832:0@lo:1000:osp_up0-1.0 00010000:00010000:1.0:1777051456.286674:0:6568:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a87371ea/0x85f51a6b967174de lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 27887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051456.286718:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051456.286721:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051456.286727:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1777051456.286769:0:3677:0:(client.c:3101:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294968375 gen 2 00000004:00080000:1.0:1777051456.286777:0:3677:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 4294968375 committed transno 4294968375 00000100:00100000:1.0:1777051456.286807:0:3677:0:(client.c:3145:ptlrpc_free_committed()) @@@ stopping search req@ffff99da4384e300 x1863365452680576/t4294968376(4294968376) o6->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 544/432 e 0 to 0 dl 1777051472 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-1.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1777051456.286824:0:3677:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99da4384e300/2, rc 0, transno 4294968376 00000100:00100000:1.0:1777051456.286832:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da4384e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452680576:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1777051456.291000:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051456.291116:0:24468:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426080896 00000100:00100000:3.0:1777051456.291132:0:24468:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426080896 00000100:00100000:3.0:1777051456.291263:0:24468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 8088 00000100:00100000:3.0:1777051456.291283:0:24468:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da4384c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+54:2436:x1863365426080896:12345-192.168.201.46@tcp:16:lhsmtool_posix.0 00000001:00080000:0.0:1777051456.295549:0:8464:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0000: transno 4294968370 is committed 00000100:00100000:3.0:1777051456.296053:0:24468:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da4384c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+52:2436:x1863365426080896:12345-192.168.201.46@tcp:16:lhsmtool_posix.0 Request processed in 4770us (5059us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051456.296095:0:24468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 8088 00000100:00100000:2.0:1777051456.301111:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051456.301634:0:21368:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426081152 00000100:00100000:0.0:1777051456.301650:0:21368:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426081152 00000100:00100000:0.0:1777051456.301757:0:21368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112350 00000100:00100000:0.0:1777051456.301782:0:21368:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+11:138819:x1863365426081152:12345-192.168.201.46@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1777051456.301860:0:21368:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777051456.301912:0:21368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d950710e00/0x85f51a6b967174c9 lrc: 0/0,0 mode: --/PR res: [0x240000bd2:0x7:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6998 expref: 11 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051456.301943:0:21368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x7:0x0].0x0 (ffff99d94e629800) 00010000:00010000:0.0:1777051456.301952:0:21368:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1777051456.301994:0:21368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d775c00/0x85f51a6b967174e5 lrc: 3/0,1 mode: --/PW res: [0x240000bd2:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051456.302018:0:21368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d775c00/0x85f51a6b967174e5 lrc: 3/0,1 mode: PW/PW res: [0x240000bd2:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21368 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051456.302039:0:21368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d775c00/0x85f51a6b967174e5 lrc: 3/0,1 mode: PW/PW res: [0x240000bd2:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21368 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1777051456.302306:0:21368:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000049fc8fc7 reply state 00000000e331b068 transno 8589934749 ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d775c00/0x85f51a6b967174e5 lrc: 3/0,1 mode: PW/PW res: [0x240000bd2:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21368 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051456.302331:0:21368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d775c00/0x85f51a6b967174e5 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd2:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21368 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051456.302361:0:21368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x7:0x0].0x0 (ffff99d94e629800) 00010000:00010000:0.0:1777051456.302367:0:21368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1777051456.302371:0:21368:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1777051456.302553:0:21368:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+12:138819:x1863365426081152:12345-192.168.201.46@tcp:36:lhsmtool_posix.0 Request processed in 779us (1442us total) trans 8589934749 rc 0/0 00000100:00100000:0.0:1777051456.302568:0:21368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112350 00000100:00100000:0.0:1777051456.305664:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051456.306051:0:10328:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426081280 00000100:00100000:3.0:1777051456.306061:0:10328:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426081280 00000100:00100000:3.0:1777051456.306149:0:10328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112351 00000100:00100000:3.0:1777051456.306167:0:10328:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d951fa1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+12:138819:x1863365426081280:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1777051456.306193:0:10328:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777051456.306218:0:10328:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e6e6400/0x85f51a6b967174ec lrc: 2/0,0 mode: --/CR res: [0x240000bd2:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b69ad expref: -99 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051456.306282:0:10328:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e6e6400/0x85f51a6b967174ec lrc: 3/0,0 mode: CR/CR res: [0x240000bd2:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b69ad expref: 13 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051456.306306:0:10328:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e6e6400/0x85f51a6b967174ec lrc: 3/0,0 mode: CR/CR res: [0x240000bd2:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b69ad expref: 13 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051456.306398:0:10328:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x7:0x0].0x0 (ffff99d94e629800) 00010000:00010000:3.0:1777051456.306403:0:10328:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1777051456.306409:0:10328:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d94e6e6400, rc 0) 00000100:00100000:3.0:1777051456.306481:0:10328:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d951fa1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+13:138819:x1863365426081280:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 Request processed in 318us (821us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051456.306528:0:10328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112351 00000100:00100000:2.0:1777051456.314976:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051456.315086:0:27884:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426081408 00000100:00100000:3.0:1777051456.315097:0:27884:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426081408 00000100:00100000:3.0:1777051456.315173:0:27884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 8089 00000100:00100000:3.0:1777051456.315190:0:27884:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+52:2436:x1863365426081408:12345-192.168.201.46@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1777051456.315441:0:27884:0:(ofd_lvb.c:305:ofd_lvbo_update()) res: [0x280000400:0x106:0x0] updating lvb size from disk: 0 -> 1048576 00002000:00010000:3.0:1777051456.315449:0:27884:0:(ofd_lvb.c:312:ofd_lvbo_update()) res: [0x280000400:0x106:0x0] updating lvb mtime from disk: 0 -> 1777051448 00002000:00010000:3.0:1777051456.315454:0:27884:0:(ofd_lvb.c:318:ofd_lvbo_update()) res: [0x280000400:0x106:0x0] updating lvb atime from disk: 0 -> 1777051448 00002000:00010000:3.0:1777051456.315460:0:27884:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x280000400:0x106:0x0] updating lvb ctime from disk: 0 -> 1777051448 00002000:00010000:3.0:1777051456.315465:0:27884:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000400:0x106:0x0] updating lvb blocks from disk: 0 -> 2048 00000100:00100000:3.0:1777051456.315578:0:27884:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+53:2436:x1863365426081408:12345-192.168.201.46@tcp:2:lhsmtool_posix.0 Request processed in 389us (606us total) trans 4294968371 rc 0/0 00000100:00100000:3.0:1777051456.315597:0:27884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 8089 00000100:00100000:2.0:1777051456.325311:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051456.326056:0:8492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426081664 00000100:00100000:3.0:1777051456.326070:0:8492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426081664 00000100:00100000:3.0:1777051456.326414:0:8492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112352 00000100:00100000:3.0:1777051456.326432:0:8492:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+13:138819:x1863365426081664:12345-192.168.201.46@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1777051456.326588:0:8492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e6e7a00/0x85f51a6b967174f3 lrc: 3/0,1 mode: --/PW res: [0x240000bd2:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051456.326653:0:8492:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d5cfe00/0x85f51a6b96717498 lrc: 2/0,0 mode: PR/PR res: [0x240000bd2:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6983 expref: 13 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051456.326672:0:8492:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e6e7a00/0x85f51a6b967174f3 lrc: 4/0,1 mode: --/PW res: [0x240000bd2:0x7:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8492 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051456.327049:0:8492:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d5cfe00/0x85f51a6b96717498 lrc: 3/0,0 mode: PR/PR res: [0x240000bd2:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6983 expref: 13 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051456.327077:0:8492:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d5cfe00/0x85f51a6b96717498 lrc: 4/0,0 mode: PR/PR res: [0x240000bd2:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6983 expref: 13 pid: 8492 timeout: 8185 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051456.327128:0:8492:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d943d93100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:8492:1863365452680960:192.168.201.46@tcp:104: 00000100:00100000:3.0:1777051456.327279:0:8492:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d958f6da80 going to sleep for 11 seconds 00000100:00100000:3.0:1777051456.332103:0:8492:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d943d93100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:8492:1863365452680960:192.168.201.46@tcp:104: 00010000:00010000:3.0:1777051456.332148:0:8492:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e6e7a00/0x85f51a6b967174f3 lrc: 3/0,1 mode: --/PW res: [0x240000bd2:0x7:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8492 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051456.332212:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051456.332283:0:24467:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426081792 00000100:00100000:3.0:1777051456.332293:0:24467:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426081792 00010000:00010000:3.0:1777051456.332335:0:24467:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d5cfe00/0x85f51a6b96717498 lrc: 4/0,0 mode: PR/PR res: [0x240000bd2:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6983 expref: 14 pid: 8492 timeout: 8185 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051456.332456:0:47597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3964 00000100:00100000:1.0:1777051456.332476:0:47597:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da48748850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+14:2437:x1863365426081792:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1777051456.332529:0:47597:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1777051456.332543:0:47597:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d5cfe00/0x85f51a6b96717498 lrc: 4/0,0 mode: PR/PR res: [0x240000bd2:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6983 expref: 14 pid: 8492 timeout: 8185 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051456.332568:0:47597:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d5cfe00/0x85f51a6b96717498 lrc: 3/0,0 mode: PR/PR res: [0x240000bd2:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6983 expref: 14 pid: 8492 timeout: 8185 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051456.332599:0:47597:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d5cfe00/0x85f51a6b96717498 lrc: 0/0,0 mode: --/PR res: [0x240000bd2:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6983 expref: 14 pid: 8492 timeout: 8185 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051456.332620:0:47597:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x7:0x0].0x0 (ffff99d94e629800) 00010000:00010000:1.0:1777051456.332628:0:47597:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e6e7a00/0x85f51a6b967174f3 lrc: 3/0,1 mode: --/PW res: [0x240000bd2:0x7:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8492 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051456.332646:0:47597:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e6e7a00/0x85f51a6b967174f3 lrc: 3/0,1 mode: PW/PW res: [0x240000bd2:0x7:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8492 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051456.332659:0:47597:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e6e7a00/0x85f51a6b967174f3 lrc: 4/0,1 mode: PW/PW res: [0x240000bd2:0x7:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8492 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051456.333019:0:47597:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1777051456.333092:0:8492:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e6e7a00/0x85f51a6b967174f3 lrc: 3/0,1 mode: PW/PW res: [0x240000bd2:0x7:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8492 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051456.333099:0:47597:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da48748850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+13:2437:x1863365426081792:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 625us (888us total) trans 0 rc 0/0 00010000:00010000:2.0:1777051456.333123:0:8492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e6e7a00/0x85f51a6b967174f3 lrc: 3/0,1 mode: PW/PW res: [0x240000bd2:0x7:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8492 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051456.333133:0:47597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3964 00010000:00010000:2.0:1777051456.333182:0:8492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e6e7a00/0x85f51a6b967174f3 lrc: 3/0,1 mode: PW/PW res: [0x240000bd2:0x7:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8492 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051456.333196:0:8492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e6e7a00/0x85f51a6b967174f3 lrc: 2/0,0 mode: PW/PW res: [0x240000bd2:0x7:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8492 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051456.333207:0:8492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e6e7a00/0x85f51a6b967174f3 lrc: 3/0,0 mode: PW/PW res: [0x240000bd2:0x7:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8492 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051456.333219:0:8492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94e6e7a00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:2.0:1777051456.333227:0:8492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e6e7a00/0x85f51a6b967174f3 lrc: 3/0,0 mode: PW/PW res: [0x240000bd2:0x7:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8492 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051456.333240:0:8492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e6e7a00/0x85f51a6b967174f3 lrc: 4/0,0 mode: PW/PW res: [0x240000bd2:0x7:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8492 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051456.333258:0:8492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x7:0x0].0x0 (ffff99d94e629800) 00010000:00010000:2.0:1777051456.333265:0:8492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1777051456.333272:0:8492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e6e7a00/0x85f51a6b967174f3 lrc: 2/0,0 mode: --/PW res: [0x240000bd2:0x7:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8492 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051456.333282:0:8492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e6e7a00/0x85f51a6b967174f3 lrc: 0/0,0 mode: --/PW res: [0x240000bd2:0x7:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8492 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051456.333382:0:8492:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+12:138819:x1863365426081664:12345-192.168.201.46@tcp:55:lhsmtool_posix.0 Request processed in 6952us (8078us total) trans 0 rc -22/-22 00000100:00100000:2.0:1777051456.333401:0:8492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112352 00000100:00100000:0.0:1777051456.336613:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051456.336696:0:8628:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426081920 00000100:00100000:1.0:1777051456.336705:0:8628:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426081920 00000100:00100000:1.0:1777051456.336769:0:8628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 8090 00000100:00100000:1.0:1777051456.336780:0:8628:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d951fa1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+53:2436:x1863365426081920:12345-192.168.201.46@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1777051456.336833:0:8628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005a90df20/0x85f51a6b967174fa lrc: 3/1,0 mode: --/PR res: [0x280000400:0x106:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051456.336863:0:8628:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008c405381/0x85f51a6b967174d7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x106:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b69a6 expref: 53 pid: 55805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051456.336873:0:8628:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1777051456.336876:0:8628:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1777051456.336880:0:8628:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005a90df20/0x85f51a6b967174fa lrc: 4/1,0 mode: --/PR res: [0x280000400:0x106:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051456.336928:0:8628:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008c405381/0x85f51a6b967174d7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x106:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b69a6 expref: 53 pid: 55805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051456.336953:0:8628:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008c405381/0x85f51a6b967174d7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x106:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b69a6 expref: 53 pid: 55805 timeout: 8185 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051456.336977:0:8628:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94e625500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8628:1863365452681088:192.168.201.46@tcp:104: 00000100:00100000:1.0:1777051456.337085:0:8628:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d95dc37cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1777051456.341608:0:8628:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94e625500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8628:1863365452681088:192.168.201.46@tcp:104: 00010000:00010000:0.0:1777051456.341654:0:8628:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005a90df20/0x85f51a6b967174fa lrc: 3/1,0 mode: --/PR res: [0x280000400:0x106:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051456.379959:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051456.380023:0:9550:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426082048 00000100:00100000:2.0:1777051456.380037:0:9550:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426082048 00010000:00010000:2.0:1777051456.380094:0:9550:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008c405381/0x85f51a6b967174d7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x106:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b69a6 expref: 54 pid: 55805 timeout: 8185 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051456.380158:0:9550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3965 00000100:00100000:2.0:1777051456.380176:0:9550:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9bb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+54:2436:x1863365426082048:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1777051456.380199:0:9550:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777051456.380229:0:9550:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008c405381/0x85f51a6b967174d7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x106:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b69a6 expref: 54 pid: 55805 timeout: 8185 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051456.380262:0:9550:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008c405381/0x85f51a6b967174d7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x106:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b69a6 expref: 54 pid: 55805 timeout: 8185 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051456.380303:0:9550:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008c405381/0x85f51a6b967174d7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x106:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b69a6 expref: 54 pid: 55805 timeout: 8185 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051456.380335:0:9550:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777051456.380340:0:9550:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777051456.380349:0:9550:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005a90df20/0x85f51a6b967174fa lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x106:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051456.380367:0:9550:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005a90df20/0x85f51a6b967174fa lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x106:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051456.380426:0:9550:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1777051456.380547:0:9550:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9bb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+53:2436:x1863365426082048:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 371us (597us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051456.380565:0:9550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3965 00010000:00010000:2.0:1777051456.380622:0:8628:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005a90df20/0x85f51a6b967174fa lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x106:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051456.380641:0:8628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005a90df20/0x85f51a6b967174fa lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x106:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051456.381063:0:8628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005a90df20/0x85f51a6b967174fa lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x106:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051456.381080:0:8628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005a90df20/0x85f51a6b967174fa lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x106:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051456.381097:0:8628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005a90df20/0x85f51a6b967174fa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x106:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051456.381111:0:8628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da7d5cec00 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:2.0:1777051456.381119:0:8628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005a90df20/0x85f51a6b967174fa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x106:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051456.381137:0:8628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005a90df20/0x85f51a6b967174fa lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x106:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051456.381171:0:8628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005a90df20/0x85f51a6b967174fa lrc: 2/0,0 mode: --/PR res: [0x280000400:0x106:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051456.381187:0:8628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005a90df20/0x85f51a6b967174fa lrc: 0/0,0 mode: --/PR res: [0x280000400:0x106:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051456.381315:0:8628:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d951fa1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+52:2436:x1863365426081920:12345-192.168.201.46@tcp:1:lhsmtool_posix.0 Request processed in 44532us (44705us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051456.381332:0:8628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 8090 00000100:00100000:2.0:1777051456.385394:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051456.385540:0:46497:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426082304 00000100:00100000:0.0:1777051456.385552:0:46497:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426082304 00000100:00100000:0.0:1777051456.385626:0:46497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112353 00000100:00100000:0.0:1777051456.385645:0:46497:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:c11b6966-0775-44d2-bdc6-c74c26eb2226+12:138819:x1863365426082304:12345-192.168.201.46@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1777051456.385747:0:46497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d774600/0x85f51a6b96717501 lrc: 3/0,1 mode: --/PW res: [0x240000bd3:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051456.385799:0:46497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d774600/0x85f51a6b96717501 lrc: 3/0,1 mode: PW/PW res: [0x240000bd3:0x7:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051456.385818:0:46497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d774600/0x85f51a6b96717501 lrc: 3/0,1 mode: PW/PW res: [0x240000bd3:0x7:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051456.386041:0:46497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d774400/0x85f51a6b96717508 lrc: 3/0,1 mode: --/EX res: [0x240000bd2:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051456.386065:0:46497:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e6e6400/0x85f51a6b967174ec lrc: 2/0,0 mode: CR/CR res: [0x240000bd2:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b69ad expref: 13 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051456.386103:0:46497:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d774400/0x85f51a6b96717508 lrc: 4/0,1 mode: --/EX res: [0x240000bd2:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051456.386152:0:46497:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e6e6400/0x85f51a6b967174ec lrc: 3/0,0 mode: CR/CR res: [0x240000bd2:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b69ad expref: 13 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051456.386178:0:46497:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e6e6400/0x85f51a6b967174ec lrc: 4/0,0 mode: CR/CR res: [0x240000bd2:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b69ad expref: 13 pid: 10328 timeout: 8185 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051456.386278:0:46497:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d951fa0700 pname:cluuid:pid:xid:nid:opc:job mdt00_009:lustre-MDT0001_UUID:46497:1863365452681216:192.168.201.46@tcp:104: 00000100:00100000:0.0:1777051456.386382:0:46497:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d942ccdf00 going to sleep for 11 seconds 00000100:00100000:0.0:1777051456.388720:0:46497:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d951fa0700 pname:cluuid:pid:xid:nid:opc:job mdt00_009:lustre-MDT0001_UUID:46497:1863365452681216:192.168.201.46@tcp:104: 00010000:00010000:0.0:1777051456.388757:0:46497:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d774400/0x85f51a6b96717508 lrc: 3/0,1 mode: --/EX res: [0x240000bd2:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051456.389793:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051456.390656:0:6566:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426082432 00000100:00100000:0.0:1777051456.390666:0:6566:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426082432 00010000:00010000:0.0:1777051456.390708:0:6566:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e6e6400/0x85f51a6b967174ec lrc: 4/0,0 mode: CR/CR res: [0x240000bd2:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b69ad expref: 14 pid: 10328 timeout: 8185 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051456.391083:0:6566:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3966 00000100:00100000:0.0:1777051456.391106:0:6566:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+14:2437:x1863365426082432:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1777051456.391129:0:6566:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777051456.391195:0:6566:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e6e6400/0x85f51a6b967174ec lrc: 4/0,0 mode: CR/CR res: [0x240000bd2:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b69ad expref: 14 pid: 10328 timeout: 8185 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051456.391284:0:6566:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e6e6400/0x85f51a6b967174ec lrc: 3/0,0 mode: CR/CR res: [0x240000bd2:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b69ad expref: 14 pid: 10328 timeout: 8185 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051456.391317:0:6566:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d94e6e6400/0x85f51a6b967174ec lrc: 0/0,0 mode: --/CR res: [0x240000bd2:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b69ad expref: 14 pid: 10328 timeout: 8185 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051456.391343:0:6566:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x7:0x0].0x0 (ffff99d94e629800) 00010000:00010000:0.0:1777051456.391353:0:6566:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d774400/0x85f51a6b96717508 lrc: 3/0,1 mode: --/EX res: [0x240000bd2:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051456.391368:0:6566:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d774400/0x85f51a6b96717508 lrc: 3/0,1 mode: EX/EX res: [0x240000bd2:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051456.391382:0:6566:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d774400/0x85f51a6b96717508 lrc: 4/0,1 mode: EX/EX res: [0x240000bd2:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051456.391429:0:6566:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1777051456.391488:0:46497:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d774400/0x85f51a6b96717508 lrc: 3/0,1 mode: EX/EX res: [0x240000bd2:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051456.391536:0:6566:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+13:2437:x1863365426082432:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 432us (1741us total) trans 0 rc 0/0 00010000:00010000:2.0:1777051456.391548:0:46497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d774400/0x85f51a6b96717508 lrc: 3/0,1 mode: EX/EX res: [0x240000bd2:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051456.391562:0:6566:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3966 00000001:00080000:2.0:1777051456.391672:0:46497:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 8589934750 00000001:00080000:2.0:1777051456.391894:0:46497:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 8589934751 00000100:00100000:2.0:1777051456.392086:0:46497:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f9b8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_009:lustre-MDT0001-mdtlov_UUID:46497:1863365452681344:0@lo:1000:mdt00_009.0 00000100:00100000:2.0:1777051456.392160:0:46497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051456.392254:0:46497:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d956bdae40 going to sleep for 11 seconds 00000100:00100000:0.0:1777051456.392339:0:6585:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452681344 00000100:00100000:0.0:1777051456.392349:0:6585:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452681344 00000100:00100000:0.0:1777051456.392435:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8300 00000100:00080000:2.0:1777051456.392441:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1777051456.392453:0:6585:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:46497:x1863365452681344:12345-0@lo:1000:mdt00_009.0 00000100:00100000:0.0:1777051456.392637:0:6585:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:46497:x1863365452681344:12345-0@lo:1000:mdt00_009.0 Request processed in 187us (475us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051456.392661:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8300 00000100:00100000:2.0:1777051456.392729:0:46497:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f9b8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_009:lustre-MDT0001-mdtlov_UUID:46497:1863365452681344:0@lo:1000:mdt00_009.0 00000001:00080000:2.0:1777051456.393304:0:46497:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 8589934752 00000100:00100000:2.0:1777051456.393448:0:46497:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f9b8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_009:lustre-MDT0001-mdtlov_UUID:46497:1863365452681472:0@lo:1000:mdt00_009.0 00000100:00100000:2.0:1777051456.393565:0:46497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051456.393624:0:46497:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d956bda180 going to sleep for 11 seconds 00000100:00100000:0.0:1777051456.394627:0:46498:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452681472 00000100:00100000:0.0:1777051456.394637:0:46498:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452681472 00000100:00100000:0.0:1777051456.394719:0:46498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8301 00000100:00100000:0.0:1777051456.394737:0:46498:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+5:46497:x1863365452681472:12345-0@lo:1000:mdt00_009.0 00000100:00100000:0.0:1777051456.394957:0:46498:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:46497:x1863365452681472:12345-0@lo:1000:mdt00_009.0 Request processed in 215us (1384us total) trans 4294968372 rc 0/0 00000100:00100000:0.0:1777051456.394974:0:46498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8301 00000100:00100000:2.0:1777051456.395038:0:46497:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f9b8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_009:lustre-MDT0001-mdtlov_UUID:46497:1863365452681472:0@lo:1000:mdt00_009.0 00000001:00080000:2.0:1777051456.395102:0:46497:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 8589934753 00000001:00080000:2.0:1777051456.395469:0:46497:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 8589934754 00010000:00010000:2.0:1777051456.395550:0:46497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d774400/0x85f51a6b96717508 lrc: 3/0,1 mode: EX/EX res: [0x240000bd2:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051456.395568:0:46497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d774400/0x85f51a6b96717508 lrc: 2/0,0 mode: EX/EX res: [0x240000bd2:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051456.395583:0:46497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d774400/0x85f51a6b96717508 lrc: 3/0,0 mode: EX/EX res: [0x240000bd2:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051456.395595:0:46497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da7d774400 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:2.0:1777051456.395605:0:46497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d774400/0x85f51a6b96717508 lrc: 3/0,0 mode: EX/EX res: [0x240000bd2:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051456.395619:0:46497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d774400/0x85f51a6b96717508 lrc: 4/0,0 mode: EX/EX res: [0x240000bd2:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051456.395642:0:46497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x7:0x0].0x0 (ffff99d94e629800) 00010000:00010000:2.0:1777051456.395648:0:46497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1777051456.395655:0:46497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d774400/0x85f51a6b96717508 lrc: 2/0,0 mode: --/EX res: [0x240000bd2:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051456.395668:0:46497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d774400/0x85f51a6b96717508 lrc: 0/0,0 mode: --/EX res: [0x240000bd2:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051456.395706:0:46497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d775000/0x85f51a6b967173f0 lrc: 3/0,1 mode: EX/EX res: [0x240000bd3:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21368 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051456.395721:0:46497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d775000/0x85f51a6b967173f0 lrc: 2/0,0 mode: EX/EX res: [0x240000bd3:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 21368 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051456.395729:0:46497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d775000/0x85f51a6b967173f0 lrc: 3/0,0 mode: EX/EX res: [0x240000bd3:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21368 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051456.395735:0:46497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da7d775000 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:2.0:1777051456.395739:0:46497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d775000/0x85f51a6b967173f0 lrc: 3/0,0 mode: EX/EX res: [0x240000bd3:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21368 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051456.395746:0:46497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d775000/0x85f51a6b967173f0 lrc: 4/0,0 mode: EX/EX res: [0x240000bd3:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 21368 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051456.395760:0:46497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd3:0x7:0x0].0x0 (ffff99da42881900) 00010000:00010000:2.0:1777051456.395763:0:46497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1777051456.395768:0:46497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d775000/0x85f51a6b967173f0 lrc: 2/0,0 mode: --/EX res: [0x240000bd3:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21368 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051456.395775:0:46497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d775000/0x85f51a6b967173f0 lrc: 0/0,0 mode: --/EX res: [0x240000bd3:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21368 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051456.395842:0:46497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff99d950711a00/0x85f51a6b9671750f lrc: 3/0,1 mode: --/EX res: [0x240000bd3:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051456.395855:0:46497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d950711a00/0x85f51a6b9671750f lrc: 3/0,1 mode: EX/EX res: [0x240000bd3:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051456.395867:0:46497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d950711a00/0x85f51a6b9671750f lrc: 3/0,1 mode: EX/EX res: [0x240000bd3:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051456.395876:0:46497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff99d950711a00/0x85f51a6b9671750f lrc: 3/0,1 mode: EX/EX res: [0x240000bd3:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051456.395884:0:46497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d950711a00/0x85f51a6b9671750f lrc: 2/0,0 mode: EX/EX res: [0x240000bd3:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051456.395894:0:46497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99d950711a00/0x85f51a6b9671750f lrc: 3/0,0 mode: EX/EX res: [0x240000bd3:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051456.395903:0:46497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d950711a00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:2.0:1777051456.395928:0:46497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d950711a00/0x85f51a6b9671750f lrc: 3/0,0 mode: EX/EX res: [0x240000bd3:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051456.395949:0:46497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d950711a00/0x85f51a6b9671750f lrc: 4/0,0 mode: EX/EX res: [0x240000bd3:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051456.395969:0:46497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd3:0x7:0x0].0x0 (ffff99da42881900) 00010000:00010000:2.0:1777051456.395974:0:46497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777051456.395980:0:46497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99d950711a00/0x85f51a6b9671750f lrc: 2/0,0 mode: --/EX res: [0x240000bd3:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051456.395991:0:46497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d950711a00/0x85f51a6b9671750f lrc: 0/0,0 mode: --/EX res: [0x240000bd3:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051456.396014:0:46497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d774600/0x85f51a6b96717501 lrc: 3/0,1 mode: PW/PW res: [0x240000bd3:0x7:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051456.396022:0:46497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d774600/0x85f51a6b96717501 lrc: 2/0,0 mode: PW/PW res: [0x240000bd3:0x7:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051456.396031:0:46497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d774600/0x85f51a6b96717501 lrc: 3/0,0 mode: PW/PW res: [0x240000bd3:0x7:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051456.396037:0:46497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da7d774600 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:2.0:1777051456.396041:0:46497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d774600/0x85f51a6b96717501 lrc: 3/0,0 mode: PW/PW res: [0x240000bd3:0x7:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051456.396053:0:46497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d774600/0x85f51a6b96717501 lrc: 4/0,0 mode: PW/PW res: [0x240000bd3:0x7:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051456.396069:0:46497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd3:0x7:0x0].0x0 (ffff99da42881900) 00010000:00010000:2.0:1777051456.396074:0:46497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1777051456.396080:0:46497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d774600/0x85f51a6b96717501 lrc: 2/0,0 mode: --/PW res: [0x240000bd3:0x7:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051456.396420:0:46497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d774600/0x85f51a6b96717501 lrc: 0/0,0 mode: --/PW res: [0x240000bd3:0x7:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 46497 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051456.396684:0:46497:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:c11b6966-0775-44d2-bdc6-c74c26eb2226+17:138819:x1863365426082304:12345-192.168.201.46@tcp:57:lhsmtool_posix.0 Request processed in 11042us (11296us total) trans 8589934755 rc 0/0 00000100:00100000:2.0:1777051456.396703:0:46497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112353 00000020:00080000:2.0:1777051456.396711:0:46497:0:(tgt_main.c:783:tgt_ses_key_exit()) total 6 transactions per RPC 00000040:00080000:0.0:1777051456.396947:0:104226:0:(llog.c:801:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1777051456.396958:0:104226:0:(llog_cat.c:158:llog_cat_process_common()) processing log [0x1:0x12:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1777051456.397906:0:104226:0:(llog.c:858:llog_process_thread()) stop processing plain [0x1:0x12:0x0] index 64768 count 9 00000040:00080000:0.0:1777051456.397924:0:104226:0:(llog.c:858:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1777051456.402015:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051456.402176:0:6582:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426082688 00000100:00100000:1.0:1777051456.402187:0:6582:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426082688 00000100:00100000:1.0:1777051456.402291:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3423 00000100:00100000:1.0:1777051456.402308:0:6582:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+17:138819:x1863365426082688:12345-192.168.201.46@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1777051456.402653:0:6582:0:(mdd_object.c:4010:mdd_close()) Object [0x240000bd2:0x7:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1777051456.402707:0:6582:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 8589934756 00010000:00010000:1.0:1777051456.402755:0:6582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d5cee00/0x85f51a6b96717516 lrc: 3/0,1 mode: --/PW res: [0x240000bd2:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051456.402779:0:6582:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d5cee00/0x85f51a6b96717516 lrc: 3/0,1 mode: PW/PW res: [0x240000bd2:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6582 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051456.402795:0:6582:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d5cee00/0x85f51a6b96717516 lrc: 3/0,1 mode: PW/PW res: [0x240000bd2:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6582 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051456.402809:0:6582:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d5cee00/0x85f51a6b96717516 lrc: 4/0,1 mode: PW/PW res: [0x240000bd2:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6582 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051456.402819:0:6582:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d5cee00/0x85f51a6b96717516 lrc: 4/0,1 mode: PW/PW res: [0x240000bd2:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6582 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051456.402830:0:6582:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d5cee00/0x85f51a6b96717516 lrc: 3/0,0 mode: PW/PW res: [0x240000bd2:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6582 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051456.403137:0:38719:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777051456.403151:0:38719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d5cee00/0x85f51a6b96717516 lrc: 4/0,0 mode: PW/PW res: [0x240000bd2:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6582 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051456.403168:0:38719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da7d5cee00 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:3.0:1777051456.403176:0:38719:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d5cee00/0x85f51a6b96717516 lrc: 4/0,0 mode: PW/PW res: [0x240000bd2:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6582 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051456.403190:0:38719:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d5cee00/0x85f51a6b96717516 lrc: 5/0,0 mode: PW/PW res: [0x240000bd2:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6582 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051456.403206:0:38719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x7:0x0].0x0 (ffff99d94e629800) 00010000:00010000:3.0:1777051456.403211:0:38719:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1777051456.403217:0:38719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d5cee00/0x85f51a6b96717516 lrc: 3/0,0 mode: --/PW res: [0x240000bd2:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6582 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051456.403228:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051456.403230:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051456.403232:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051456.403369:0:6582:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1777051456.403379:0:6582:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d5cee00/0x85f51a6b96717516 lrc: 0/0,0 mode: --/PW res: [0x240000bd2:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6582 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051456.403618:0:6582:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+19:138819:x1863365426082688:12345-192.168.201.46@tcp:35:lhsmtool_posix.0 Request processed in 1309us (1608us total) trans 8589934757 rc 0/0 00000100:00100000:1.0:1777051456.403634:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3423 00000020:00080000:1.0:1777051456.403643:0:6582:0:(tgt_main.c:783:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1777051456.598821:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1777051457.302595:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d950264000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452681600:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1777051457.302705:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051457.302804:0:46500:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452681600 00000100:00100000:3.0:1777051457.302814:0:46500:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452681600 00000100:00100000:3.0:1777051457.302874:0:46500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8302 00000100:00100000:3.0:1777051457.302883:0:46500:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da6ff7c850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+8:3679:x1863365452681600:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1777051457.302953:0:46500:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4194304 pending 0 free 1441501184 avail 1295261696 00000100:00100000:3.0:1777051457.303031:0:46500:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da6ff7c850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+8:3679:x1863365452681600:12345-0@lo:41:osp-pre-0-1.0 Request processed in 148us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051457.303040:0:46500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8302 00000100:00100000:0.0:1777051457.303148:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d950264000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452681600:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1777051457.445564:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051457.445627:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051457.445683:0:103165:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426082816 00000100:00100000:0.0:1777051457.446027:0:103165:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426082816 00000100:00100000:1.0:1777051457.446027:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051457.446093:0:46494:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426083072 00000100:00100000:2.0:1777051457.446106:0:46494:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426083072 00000100:00100000:1.0:1777051457.446107:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051457.446143:0:103165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 190 00000100:00100000:0.0:1777051457.446169:0:103165:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d941bf7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29c4352d-3260-4734-909d-9ea5de9e7fa4+12:2436:x1863365426082816:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:1.0:1777051457.446185:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051457.446248:0:46494:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426082944 00000100:00100000:2.0:1777051457.446257:0:46494:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426082944 00000100:00100000:1.0:1777051457.446306:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051457.446335:0:46494:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426083584 00000100:00100000:2.0:1777051457.446345:0:46494:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426083584 00000100:00100000:0.0:1777051457.446356:0:103165:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d941bf7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29c4352d-3260-4734-909d-9ea5de9e7fa4+12:2436:x1863365426082816:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 191us (796us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051457.446374:0:103165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 190 00000100:00100000:2.0:1777051457.446415:0:46494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13439 00000100:00100000:2.0:1777051457.446435:0:46494:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94e624a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c11b6966-0775-44d2-bdc6-c74c26eb2226+19:2436:x1863365426083072:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:0.0:1777051457.446457:0:13320:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426083328 00000100:00100000:0.0:1777051457.446467:0:13320:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426083328 00000100:00100000:0.0:1777051457.446574:0:13320:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426083200 00000100:00100000:2.0:1777051457.446577:0:46494:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94e624a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c11b6966-0775-44d2-bdc6-c74c26eb2226+19:2436:x1863365426083072:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 142us (945us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051457.446586:0:13320:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426083200 00000100:00100000:1.0:1777051457.446597:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051457.446622:0:46494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13439 00000100:00100000:0.0:1777051457.446651:0:13320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10477 00000100:00100000:2.0:1777051457.446666:0:46494:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426083456 00000100:00100000:0.0:1777051457.446675:0:13320:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94e627100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+48:2436:x1863365426083328:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:2.0:1777051457.446679:0:46494:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426083456 00000100:00100000:1.0:1777051457.447006:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051457.447048:0:13320:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94e627100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+48:2436:x1863365426083328:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 378us (940us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051457.447056:0:46494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13440 00000100:00100000:0.0:1777051457.447075:0:13320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10477 00000100:00100000:2.0:1777051457.447086:0:46494:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94e624e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c11b6966-0775-44d2-bdc6-c74c26eb2226+24:2437:x1863365426082944:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:0.0:1777051457.447459:0:13320:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426083840 00000100:00100000:0.0:1777051457.447469:0:13320:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426083840 00000100:00100000:2.0:1777051457.447527:0:46494:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94e624e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c11b6966-0775-44d2-bdc6-c74c26eb2226+24:2437:x1863365426082944:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 449us (1834us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051457.447546:0:46494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13440 00000100:00100000:1.0:1777051457.447559:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051457.447586:0:13320:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426083712 00000100:00100000:2.0:1777051457.447593:0:46494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13441 00000100:00100000:0.0:1777051457.447595:0:13320:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426083712 00000100:00100000:2.0:1777051457.447621:0:46494:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fd63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+53:2436:x1863365426083584:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:0.0:1777051457.447669:0:13320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10478 00000100:00100000:1.0:1777051457.447683:0:55805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10479 00000100:00100000:0.0:1777051457.447688:0:13320:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94e625500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+52:2437:x1863365426083200:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:2.0:1777051457.447708:0:46494:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fd63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+53:2436:x1863365426083584:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 95us (1401us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051457.447718:0:55805:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fd61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+50:2436:x1863365426083840:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:2.0:1777051457.447733:0:46494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13441 00000100:00100000:0.0:1777051457.447773:0:13320:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94e625500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+52:2437:x1863365426083200:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 82us (1586us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051457.447773:0:46494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13442 00000100:00100000:2.0:1777051457.447805:0:46494:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fd62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+33:2437:x1863365426083456:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:0.0:1777051457.447808:0:13320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10478 00000100:00100000:1.0:1777051457.447809:0:55805:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fd61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+50:2436:x1863365426083840:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 94us (793us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051457.447835:0:55805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10479 00000100:00100000:0.0:1777051457.447863:0:13320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10480 00000100:00100000:0.0:1777051457.447883:0:13320:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fd62680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+52:2437:x1863365426083712:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:2.0:1777051457.447896:0:46494:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fd62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+33:2437:x1863365426083456:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 98us (1304us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051457.447913:0:46494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13442 00000100:00100000:0.0:1777051457.447954:0:13320:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fd62680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+52:2437:x1863365426083712:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 74us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051457.447969:0:13320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10480 00000100:00080000:2.0:1777051457.447975:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1777051457.447987:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1777051457.447997:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1777051457.448004:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000040:00080000:1.0:1777051457.558507:0:103189:0:(llog.c:801:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:1.0:1777051457.558524:0:103189:0:(llog_cat.c:158:llog_cat_process_common()) processing log [0x1:0x2b:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1777051457.558562:0:103189:0:(llog.c:858:llog_process_thread()) stop processing plain [0x1:0x2b:0x0] index 10 count 8 00000040:00080000:1.0:1777051457.558573:0:103189:0:(llog.c:858:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00010000:00010000:3.0:1777051457.623020:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777051457.814464:0:3679:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1777051457.814523:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d943d93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452681728:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1777051457.814663:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051457.814749:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d950264700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3679:1863365452682112:0@lo:400:kworker.0 00000100:00100000:3.0:1777051457.814788:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051457.814820:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d950266d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452682624:0@lo:400:kworker.0 00000100:00100000:3.0:1777051457.814857:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051457.814882:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d950267b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452683136:0@lo:400:kworker.0 00000100:00100000:1.0:1777051457.814971:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d950264380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3677:1863365452681856:0@lo:400:kworker.0 00000100:00100000:3.0:1777051457.814971:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051457.815015:0:3679:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1777051457.815029:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d950265c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3678:1863365452681984:0@lo:400:kworker.0 00000100:00100000:3.0:1777051457.815035:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d950267800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3679:1863365452682240:0@lo:400:kworker.0 00000100:00100000:1.0:1777051457.815050:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051457.815131:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051457.815148:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d950265880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3677:1863365452682368:0@lo:400:kworker.0 00000100:00100000:3.0:1777051457.815184:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d950267100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452682752:0@lo:400:kworker.0 00000100:00100000:1.0:1777051457.815200:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051457.815238:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d950265500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3677:1863365452682880:0@lo:400:kworker.0 00000100:00100000:3.0:1777051457.815266:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051457.815295:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051457.815306:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d950265f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452683264:0@lo:400:kworker.0 00000100:00100000:3.0:1777051457.815343:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051457.815363:0:55805:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452682624 00000100:00100000:1.0:1777051457.815365:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d950267480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3677:1863365452683392:0@lo:400:kworker.0 00000100:00100000:2.0:1777051457.815377:0:55805:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452682624 00000100:00100000:1.0:1777051457.815422:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051457.815523:0:46497:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452682112 00000100:00100000:3.0:1777051457.815532:0:46497:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452682112 00000100:00100000:1.0:1777051457.815547:0:103169:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452681856 00000100:00100000:1.0:1777051457.815558:0:103169:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452681856 00000100:00100000:2.0:1777051457.815565:0:55805:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452683136 00000100:00100000:2.0:1777051457.815574:0:55805:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452683136 00000100:00100000:2.0:1777051457.815623:0:55805:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452682752 00000100:00100000:2.0:1777051457.815630:0:55805:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452682752 00000100:00100000:1.0:1777051457.815973:0:103169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1777051457.815992:0:55805:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452683264 00000100:00100000:1.0:1777051457.815993:0:103169:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f2a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f9351a01-5b0e-4470-97fd-58b9b4b312a2+23:3677:x1863365452681856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777051457.816003:0:55805:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452683264 00000100:00100000:2.0:1777051457.816061:0:55805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10481 00000100:00100000:1.0:1777051457.816084:0:103169:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f2a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f9351a01-5b0e-4470-97fd-58b9b4b312a2+23:3677:x1863365452681856:12345-0@lo:400:kworker.0 Request processed in 92us (1039us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051457.816084:0:55805:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d943d91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3679:x1863365452682624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777051457.816113:0:103169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:1.0:1777051457.816177:0:10328:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452682240 00000100:00100000:1.0:1777051457.816184:0:10328:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452682240 00000100:00100000:2.0:1777051457.816500:0:55805:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d943d91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3679:x1863365452682624:12345-0@lo:400:kworker.0 Request processed in 113us (1327us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051457.816518:0:55805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10481 00000100:00100000:1.0:1777051457.816541:0:10328:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452682368 00000100:00100000:1.0:1777051457.816550:0:10328:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452682368 00000100:00100000:2.0:1777051457.816555:0:55805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10482 00000100:00100000:2.0:1777051457.816571:0:55805:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d956128000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+6:3679:x1863365452683136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777051457.816596:0:10328:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452682880 00000100:00100000:1.0:1777051457.816602:0:10328:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452682880 00000100:00100000:1.0:1777051457.816644:0:10328:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452683392 00000100:00100000:2.0:1777051457.816650:0:55805:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d956128000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+6:3679:x1863365452683136:12345-0@lo:400:kworker.0 Request processed in 79us (1679us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051457.816653:0:10328:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452683392 00000100:00100000:2.0:1777051457.816668:0:55805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10482 00000100:00100000:2.0:1777051457.816700:0:55805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10483 00000100:00100000:1.0:1777051457.816709:0:10328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13443 00000100:00100000:2.0:1777051457.816721:0:55805:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d956128700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3679:x1863365452682752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777051457.817036:0:10328:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95612a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3679:x1863365452682240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777051457.817132:0:55805:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d956128700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3679:x1863365452682752:12345-0@lo:400:kworker.0 Request processed in 415us (1866us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051457.817143:0:10328:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95612a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3679:x1863365452682240:12345-0@lo:400:kworker.0 Request processed in 419us (2013us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051457.817152:0:55805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10483 00000100:00100000:1.0:1777051457.817166:0:10328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13443 00000100:00100000:1.0:1777051457.817530:0:10328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13444 00000100:00100000:1.0:1777051457.817544:0:10328:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fd61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3677:x1863365452682368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777051457.817593:0:10328:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fd61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3677:x1863365452682368:12345-0@lo:400:kworker.0 Request processed in 53us (2394us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051457.817603:0:10328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13444 00000100:00100000:1.0:1777051457.817621:0:10328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13445 00000100:00100000:1.0:1777051457.817629:0:10328:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fd62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3677:x1863365452682880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777051457.817670:0:10328:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fd62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3677:x1863365452682880:12345-0@lo:400:kworker.0 Request processed in 40us (2379us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051457.817681:0:10328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13445 00000100:00100000:1.0:1777051457.817699:0:10328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13446 00000100:00100000:1.0:1777051457.817711:0:10328:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fd60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3677:x1863365452683392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777051457.817757:0:10328:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fd60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3677:x1863365452683392:12345-0@lo:400:kworker.0 Request processed in 49us (2338us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051457.817766:0:10328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13446 00000100:00100000:1.0:1777051457.817806:0:27887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10484 00000100:00100000:1.0:1777051457.817818:0:27887:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95612b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+6:3679:x1863365452683264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777051457.817865:0:27887:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95612b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+6:3679:x1863365452683264:12345-0@lo:400:kworker.0 Request processed in 49us (2523us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051457.817876:0:27887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10484 00000100:00100000:3.0:1777051457.817976:0:46497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13447 00000100:00100000:3.0:1777051457.817988:0:46497:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d943d93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:lustre-MDT0001-lwp-OST0000_UUID+5:3679:x1863365452682112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777051457.817997:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d950264380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3677:1863365452681856:0@lo:400:kworker.0 00000100:00100000:1.0:1777051457.818027:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d950265880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3677:1863365452682368:0@lo:400:kworker.0 00000100:00100000:3.0:1777051457.818056:0:46497:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d943d93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:lustre-MDT0001-lwp-OST0000_UUID+5:3679:x1863365452682112:12345-0@lo:400:kworker.0 Request processed in 68us (3265us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051457.818057:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d950265500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3677:1863365452682880:0@lo:400:kworker.0 00000100:00100000:3.0:1777051457.818079:0:46497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13447 00000100:00100000:1.0:1777051457.818097:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d950267480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3677:1863365452683392:0@lo:400:kworker.0 00000100:00100000:3.0:1777051457.818153:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051457.818238:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d950266a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3678:1863365452682496:0@lo:400:kworker.0 00000100:00080000:1.0:1777051457.818260:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1777051457.818271:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1777051457.818278:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1777051457.818284:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1777051457.818298:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d950267800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3679:1863365452682240:0@lo:400:kworker.0 00000100:00100000:3.0:1777051457.818308:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051457.818311:0:6585:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452681728 00000100:00100000:1.0:1777051457.818320:0:6585:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452681728 00000100:00100000:2.0:1777051457.818334:0:3679:0:(client.c:3101:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968374 gen 2 00000100:00100000:3.0:1777051457.818358:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d950264a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452683008:0@lo:400:kworker.0 00000004:00080000:2.0:1777051457.818371:0:3679:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 4294968373 committed transno 4294968374 00000100:00100000:1.0:1777051457.818375:0:6585:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452682496 00000100:00100000:1.0:1777051457.818383:0:6585:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452682496 00000100:00100000:1.0:1777051457.818432:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8303 00000004:00080000:2.0:1777051457.818435:0:3679:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 4294968374 committed transno 4294968374 00000100:00100000:1.0:1777051457.818447:0:6585:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d943d93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:3679:x1863365452681728:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1777051457.818507:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d950267100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452682752:0@lo:400:kworker.0 00000100:00100000:2.0:1777051457.818538:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d950265f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452683264:0@lo:400:kworker.0 00000100:00100000:2.0:1777051457.818565:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d950264700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3679:1863365452682112:0@lo:400:kworker.0 00000100:00100000:3.0:1777051457.818578:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051457.818589:0:3679:0:(client.c:3101:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968369 gen 2 00000004:00080000:2.0:1777051457.818597:0:3679:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 4294968368 committed transno 4294968369 00000004:00080000:2.0:1777051457.818616:0:3679:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff99da7cd9c000, transno 4294968369 00000100:00100000:2.0:1777051457.818641:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d950266d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452682624:0@lo:400:kworker.0 00000100:00100000:2.0:1777051457.818670:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d950267b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452683136:0@lo:400:kworker.0 00000100:00100000:3.0:1777051457.818673:0:6584:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452683008 00000100:00100000:3.0:1777051457.818954:0:6584:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452683008 00000100:00100000:0.0:1777051457.819332:0:46498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8304 00000100:00100000:0.0:1777051457.819356:0:46498:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942a0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+7:3678:x1863365452682496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051457.819378:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8305 00000100:00100000:3.0:1777051457.819397:0:6584:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942a0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:3678:x1863365452683008:12345-0@lo:400:kworker.0 00000004:00000024:1.0:1777051457.819415:0:6585:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4194304 pending 0 free 1446105088 avail 1299865600 00000100:00100000:0.0:1777051457.819454:0:46498:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942a0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+7:3678:x1863365452682496:12345-0@lo:400:kworker.0 Request processed in 105us (1151us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051457.819502:0:46498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8304 00000100:00100000:3.0:1777051457.819523:0:6584:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942a0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:3678:x1863365452683008:12345-0@lo:400:kworker.0 Request processed in 130us (950us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051457.819539:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8305 00000100:00100000:1.0:1777051457.819566:0:6585:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d943d93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3679:x1863365452681728:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1104us (4890us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051457.819573:0:3678:0:(client.c:3101:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 8589934726 gen 2 00000004:00080000:0.0:1777051457.819585:0:3678:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 8589934726 committed transno 8589934726 00000100:00100000:1.0:1777051457.819593:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8303 00000020:00080000:0.0:1777051457.819594:0:3678:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff99d95c67b180 refcount 2 committed 0 result 0 batchid 25769803782 00000020:00080000:0.0:1777051457.819604:0:3678:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff99d942aec200 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff99d95c67bd80 00000020:00080000:0.0:1777051457.819611:0:3678:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff99d942aece00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff99d95c67b3c0 00000020:00080000:0.0:1777051457.819618:0:3678:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x240000bd1:0x2:0x0].2 00000020:00080000:0.0:1777051457.819623:0:3678:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff99d942aec300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff99d944824e00 00000020:00080000:0.0:1777051457.819629:0:3678:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x2000032e0:0x2:0x0].2 00000100:00100000:1.0:1777051457.819643:0:6580:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452681984 00000100:00100000:1.0:1777051457.819653:0:6580:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452681984 00000100:00100000:0.0:1777051457.819699:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d950266a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3678:1863365452682496:0@lo:400:kworker.0 00000100:00100000:0.0:1777051457.819734:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d950264a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452683008:0@lo:400:kworker.0 00000100:00100000:1.0:1777051457.820034:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13448 00000100:00100000:3.0:1777051457.820056:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d943d93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452681728:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1777051457.820059:0:6580:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95612a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3678:x1863365452681984:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1777051457.820123:0:103195:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 25769803782 committed batchid 25769803781 00000100:00100000:1.0:1777051457.820151:0:6580:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95612a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3678:x1863365452681984:12345-0@lo:400:kworker.0 Request processed in 100us (2004us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051457.820162:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13448 00000100:00080000:1.0:1777051457.820192:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00080000:3.0:1777051457.820255:0:103195:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 25769803781 00000100:00100000:0.0:1777051457.820321:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d950265c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3678:1863365452681984:0@lo:400:kworker.0 00000040:00080000:0.0:1777051457.936139:0:108257:0:(llog.c:801:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1777051457.936150:0:108257:0:(llog_cat.c:158:llog_cat_process_common()) processing log [0x1:0x12:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1777051457.936265:0:108257:0:(llog.c:858:llog_process_thread()) stop processing plain [0x1:0x12:0x0] index 11 count 9 00000040:00080000:0.0:1777051457.936277:0:108257:0:(llog.c:858:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1777051457.980619:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051457.980685:0:21368:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426084096 00000100:00100000:0.0:1777051457.980700:0:21368:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426084096 00000100:00100000:0.0:1777051457.980785:0:21368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112354 00000100:00100000:0.0:1777051457.980801:0:21368:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fd63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+53:138828:x1863365426084096:12345-192.168.201.46@tcp:101:cat.0 00010000:00010000:0.0:1777051457.980829:0:21368:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051457.980861:0:21368:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d775a00/0x85f51a6b9671751d lrc: 2/0,0 mode: --/CR res: [0x240000bd0:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b69b4 expref: -99 pid: 21368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051457.980963:0:21368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d775600/0x85f51a6b96717524 lrc: 3/1,0 mode: --/CR res: [0x240000bd0:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051457.980992:0:21368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d775600/0x85f51a6b96717524 lrc: 3/1,0 mode: CR/CR res: [0x240000bd0:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21368 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051457.981013:0:21368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d775600/0x85f51a6b96717524 lrc: 3/1,0 mode: CR/CR res: [0x240000bd0:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21368 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051457.981033:0:21368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d775200/0x85f51a6b9671752b lrc: 3/1,0 mode: --/PR res: [0x240000bd0:0x3:0x0].0x15f59727 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051457.981045:0:21368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d775200/0x85f51a6b9671752b lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x3:0x0].0x15f59727 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21368 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051457.981056:0:21368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d775200/0x85f51a6b9671752b lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x3:0x0].0x15f59727 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21368 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051457.981242:0:21368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d775800/0x85f51a6b96717532 lrc: 3/1,0 mode: --/PR res: [0x240000bd3:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051457.981256:0:21368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d775800/0x85f51a6b96717532 lrc: 3/1,0 mode: PR/PR res: [0x240000bd3:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21368 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051457.981270:0:21368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d775800/0x85f51a6b96717532 lrc: 3/1,0 mode: PR/PR res: [0x240000bd3:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21368 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1777051457.981286:0:21368:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000bd3:0x7:0x0]: returning size 1048576 00010000:00010000:0.0:1777051457.981445:0:21368:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d775600/0x85f51a6b96717524 lrc: 3/1,0 mode: CR/CR res: [0x240000bd0:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21368 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051457.981458:0:21368:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d775600/0x85f51a6b96717524 lrc: 2/0,0 mode: CR/CR res: [0x240000bd0:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 21368 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051457.981497:0:21368:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d775600/0x85f51a6b96717524 lrc: 3/0,0 mode: CR/CR res: [0x240000bd0:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21368 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051457.981508:0:21368:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da7d775600 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:0.0:1777051457.981515:0:21368:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d775600/0x85f51a6b96717524 lrc: 3/0,0 mode: CR/CR res: [0x240000bd0:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21368 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051457.981526:0:21368:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d775600/0x85f51a6b96717524 lrc: 4/0,0 mode: CR/CR res: [0x240000bd0:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 21368 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051457.981544:0:21368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x3:0x0].0x0 (ffff99d941e2e200) 00010000:00010000:0.0:1777051457.981548:0:21368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777051457.981554:0:21368:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d775600/0x85f51a6b96717524 lrc: 2/0,0 mode: --/CR res: [0x240000bd0:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21368 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051457.981565:0:21368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d775600/0x85f51a6b96717524 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21368 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051457.981582:0:21368:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d775200/0x85f51a6b9671752b lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x3:0x0].0x15f59727 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21368 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051457.981590:0:21368:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d775200/0x85f51a6b9671752b lrc: 2/0,0 mode: PR/PR res: [0x240000bd0:0x3:0x0].0x15f59727 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 21368 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051457.981600:0:21368:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d775200/0x85f51a6b9671752b lrc: 3/0,0 mode: PR/PR res: [0x240000bd0:0x3:0x0].0x15f59727 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21368 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051457.981609:0:21368:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da7d775200 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:0.0:1777051457.981614:0:21368:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d775200/0x85f51a6b9671752b lrc: 3/0,0 mode: PR/PR res: [0x240000bd0:0x3:0x0].0x15f59727 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21368 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051457.981625:0:21368:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d775200/0x85f51a6b9671752b lrc: 4/0,0 mode: PR/PR res: [0x240000bd0:0x3:0x0].0x15f59727 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 21368 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051457.981645:0:21368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x3:0x0].0x15f59727 (ffff99d941e2ee00) 00010000:00010000:0.0:1777051457.981649:0:21368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777051457.981654:0:21368:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d775200/0x85f51a6b9671752b lrc: 2/0,0 mode: --/PR res: [0x240000bd0:0x3:0x0].0x15f59727 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21368 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051457.981663:0:21368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d775200/0x85f51a6b9671752b lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x3:0x0].0x15f59727 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21368 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051457.981714:0:21368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d775a00/0x85f51a6b9671751d lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b69b4 expref: 56 pid: 21368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051457.981736:0:21368:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d775800/0x85f51a6b96717532 lrc: 3/0,0 mode: PR/PR res: [0x240000bd3:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b69b4 expref: 55 pid: 21368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051457.981748:0:21368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd3:0x7:0x0].0x0 (ffff99da5fb45f00) 00010000:00010000:0.0:1777051457.981751:0:21368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1777051457.981755:0:21368:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99da7d775800, rc 0) 00000100:00100000:0.0:1777051457.981845:0:21368:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fd63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+55:138828:x1863365426084096:12345-192.168.201.46@tcp:101:cat.0 Request processed in 1047us (1256us total) trans 8589934758 rc 0/0 00000100:00100000:0.0:1777051457.981857:0:21368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112354 00000100:00100000:1.0:1777051457.993517:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051457.993584:0:8471:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426084224 00000100:00100000:0.0:1777051457.993598:0:8471:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426084224 00000100:00100000:0.0:1777051457.993676:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 8091 00000100:00100000:0.0:1777051457.993692:0:8471:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da44494000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+52:2437:x1863365426084224:12345-192.168.201.46@tcp:101:cat.0 00010000:00010000:0.0:1777051457.993716:0:8471:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051457.993751:0:8471:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000073b1c9d0/0x85f51a6b96717540 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x106:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b69bb expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1777051457.993793:0:8471:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x106:0x0] initial LVB size: 1048576, mtime: 0x69eba738, atime: 0x69eba738, ctime: 0x69eba738, blocks: 0x800 00010000:00010000:0.0:1777051457.993818:0:8471:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777051457.993821:0:8471:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777051457.993832:0:8471:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000073b1c9d0/0x85f51a6b96717540 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x106:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b69bb expref: 53 pid: 8471 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051457.993858:0:8471:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000073b1c9d0/0x85f51a6b96717540 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x106:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b69bb expref: 53 pid: 8471 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051457.993877:0:8471:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99da7d775a00, rc 0) 00000100:00100000:0.0:1777051457.993961:0:8471:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da44494000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+53:2437:x1863365426084224:12345-192.168.201.46@tcp:101:cat.0 Request processed in 272us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051457.993972:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 8091 00000100:00100000:1.0:1777051458.059269:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051458.059501:0:8475:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426084352 00000100:00100000:3.0:1777051458.059516:0:8475:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426084352 00002000:00100000:3.0:1777051458.059870:0:8475:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000400:0x106:0x0] (0->1048575) req@ffff99da44496300 x1863365426084352/t0(0) o3->2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp:419/0 lens 488/0 e 0 to 0 dl 1777051469 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1777051458.059888:0:8475:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99da44496300 with x1863365426084352 ext(0->1048575) 00002000:00010000:3.0:1777051458.059898:0:8475:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99da44496300 00000100:00100000:3.0:1777051458.059942:0:8475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 1791 00000100:00100000:3.0:1777051458.059958:0:8475:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da44496300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+53:2436:x1863365426084352:12345-192.168.201.46@tcp:3:cat.0 00000100:00100000:2.0:1777051458.077869:0:8475:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da44496300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+53:2436:x1863365426084352:12345-192.168.201.46@tcp:3:cat.0 Request processed in 17903us (18599us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1777051458.077891:0:8475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 1791 00002000:00100000:2.0:1777051458.077910:0:8475:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000400:0x106:0x0] (0->1048575) req@ffff99da44496300 x1863365426084352/t0(0) o3->2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp:419/0 lens 488/440 e 0 to 0 dl 1777051469 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1777051458.077928:0:8475:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99da44496300 with x1863365426084352 ext(0->1048575) 00002000:00010000:2.0:1777051458.077937:0:8475:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99da44496300 00000100:00100000:0.0:1777051458.145594:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051458.145939:0:43492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426084480 00000100:00100000:1.0:1777051458.145958:0:43492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426084480 00002000:00100000:1.0:1777051458.146052:0:43492:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000400:0x106:0x0] (1048576->1052671) req@ffff99d951fa0700 x1863365426084480/t0(0) o3->2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp:419/0 lens 488/0 e 0 to 0 dl 1777051469 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1777051458.146075:0:43492:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99d951fa0700 with x1863365426084480 ext(1048576->1052671) 00002000:00010000:1.0:1777051458.146085:0:43492:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99d951fa0700 00000100:00100000:0.0:1777051458.146606:0:46203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 1792 00000100:00100000:0.0:1777051458.146629:0:46203:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d951fa0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+53:2438:x1863365426084480:12345-192.168.201.46@tcp:3:cat.0 00000100:00100000:0.0:1777051458.148418:0:46203:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d951fa0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+53:2438:x1863365426084480:12345-192.168.201.46@tcp:3:cat.0 Request processed in 1791us (2830us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051458.148443:0:46203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 1792 00002000:00100000:0.0:1777051458.148458:0:46203:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000400:0x106:0x0] (1048576->1052671) req@ffff99d951fa0700 x1863365426084480/t0(0) o3->2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp:419/0 lens 488/440 e 0 to 0 dl 1777051469 ref 1 fl Complete:/600/0 rc 0/0 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1777051458.148513:0:46203:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99d951fa0700 with x1863365426084480 ext(1048576->1052671) 00002000:00010000:0.0:1777051458.148526:0:46203:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99d951fa0700 00000100:00100000:0.0:1777051458.166523:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051458.166675:0:6583:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426084736 00000100:00100000:3.0:1777051458.167089:0:6583:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426084736 00000100:00100000:3.0:1777051458.167629:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3424 00000100:00100000:3.0:1777051458.167653:0:6583:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d951fa1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+55:138828:x1863365426084736:12345-192.168.201.46@tcp:35:cat.0 00000100:00100000:3.0:1777051458.168807:0:6583:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d951fa1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+56:138828:x1863365426084736:12345-192.168.201.46@tcp:35:cat.0 Request processed in 1158us (2337us total) trans 8589934759 rc 0/0 00000100:00100000:3.0:1777051458.168825:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3424 00000100:00100000:0.0:1777051458.326609:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d943d93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452683520:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1777051458.326624:0:3680:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1777051458.326654:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da44494a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3680:1863365452683648:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1777051458.327410:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051458.327534:0:8473:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452683648 00000100:00100000:2.0:1777051458.327548:0:8473:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452683648 00000100:00100000:0.0:1777051458.327583:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051458.327641:0:8473:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452683520 00000100:00100000:2.0:1777051458.327648:0:8473:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452683520 00000100:00080000:1.0:1777051458.327727:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1777051458.327814:0:8473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5682 00000100:00100000:2.0:1777051458.327837:0:8473:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da44495c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3680:x1863365452683648:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1777051458.327881:0:8473:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 499269184 pending 0 free 3860574208 avail 3629051904 00000100:00100000:0.0:1777051458.327900:0:8472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5683 00000100:00100000:2.0:1777051458.327967:0:8473:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da44495c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3680:x1863365452683648:12345-0@lo:13:osp-pre-0-1.0 Request processed in 135us (557us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051458.327983:0:8473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5682 00000100:00100000:1.0:1777051458.328029:0:8472:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d951fa0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3678:x1863365452683520:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1777051458.328032:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da44494a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3680:1863365452683648:0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1777051458.328091:0:8472:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 489209408 pending 0 free 3642707968 avail 3411185664 00000100:00100000:1.0:1777051458.328179:0:8472:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d951fa0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3678:x1863365452683520:12345-0@lo:13:osp-pre-1-1.0 Request processed in 266us (597us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051458.328246:0:8472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5683 00000100:00100000:0.0:1777051458.328306:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d943d93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452683520:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1777051458.646545:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051459.670961:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1777051459.862631:0:3679:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1777051459.862635:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da44497b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3677:1863365452683904:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1777051459.862663:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d950267b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452683776:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1777051459.862757:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051459.862888:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051459.862918:0:10113:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452683776 00000100:00100000:0.0:1777051459.862931:0:10113:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452683776 00000100:00100000:2.0:1777051459.862982:0:8473:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452683904 00000100:00100000:2.0:1777051459.862994:0:8473:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452683904 00000100:00080000:1.0:1777051459.863027:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1777051459.863037:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1777051459.863067:0:10113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5684 00000100:00100000:0.0:1777051459.863088:0:10113:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d950266d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3679:x1863365452683776:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1777051459.863133:0:10113:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 489209408 pending 0 free 3642707968 avail 3411185664 00000100:00100000:0.0:1777051459.863273:0:10113:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d950266d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3679:x1863365452683776:12345-0@lo:13:osp-pre-1-0.0 Request processed in 189us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051459.863288:0:10113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5684 00000100:00100000:0.0:1777051459.863320:0:10113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5685 00000100:00100000:0.0:1777051459.863334:0:10113:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da44495f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3677:x1863365452683904:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1777051459.863362:0:10113:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 499269184 pending 0 free 3860574208 avail 3629051904 00000100:00100000:0.0:1777051459.863417:0:10113:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da44495f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3677:x1863365452683904:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (537us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051459.863425:0:10113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5685 00000100:00100000:1.0:1777051459.863630:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d950267b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452683776:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1777051459.863699:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da44497b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3677:1863365452683904:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1777051460.694628:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1777051460.892087:0:103159:0:(update_trans.c:1333:distribute_txn_batchid_cb()) lustre-MDT0000: 25769803782 batchid updated 00000020:00080000:0.0:1777051460.892184:0:103195:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 25769803782 00000004:00080000:0.0:1777051460.892286:0:103195:0:(osp_trans.c:1582:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff99d944aeb600 with version 6 00000020:00080000:0.0:1777051460.892323:0:103195:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 25769803782 cancel update log [0x240000bd1:0x2:0x0].2: rc = 0 00000004:00080000:2.0:1777051460.892417:0:103175:0:(osp_trans.c:1330:osp_get_next_request()) ou ffff99d9594cf180 version 6 rpc_version 6 00000020:00100000:2.0:1777051460.892501:0:103175:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000020:00080000:0.0:1777051460.892513:0:103195:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 25769803782 cancel update log [0x2000032e0:0x2:0x0].2: rc = 0 00000100:00100000:2.0:1777051460.892520:0:103175:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff99d950264700 x1863365452684160/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000020:00080000:0.0:1777051460.892537:0:103195:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 25769803782 00000001:00080000:3.0:1777051460.892798:0:103159:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771239 is committed 00000100:00100000:2.0:1777051460.892836:0:103175:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d950264700 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:103175:1863365452684160:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1777051460.892997:0:103175:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051460.893091:0:103175:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d9591d5840 going to sleep for 11 seconds 00000100:00100000:0.0:1777051460.893109:0:46498:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452684160 00000100:00100000:0.0:1777051460.893124:0:46498:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452684160 00000100:00100000:0.0:1777051460.893233:0:46498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8306 00000100:00100000:0.0:1777051460.893256:0:46498:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d950265f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+6:103175:x1863365452684160:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1777051460.893544:0:46498:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d950265f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+7:103175:x1863365452684160:12345-0@lo:1000:osp_up1-0.0 Request processed in 293us (578us total) trans 8589934760 rc 0/0 00000100:00100000:0.0:1777051460.893562:0:46498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8306 00000100:00100000:2.0:1777051460.894764:0:103175:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d950264700 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:103175:1863365452684160:0@lo:1000:osp_up1-0.0 00000040:00080000:0.0:1777051461.526511:0:104226:0:(llog.c:801:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1777051461.526523:0:104226:0:(llog_cat.c:158:llog_cat_process_common()) processing log [0x1:0x12:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1777051461.526552:0:104226:0:(llog.c:858:llog_process_thread()) stop processing plain [0x1:0x12:0x0] index 11 count 9 00000040:00080000:0.0:1777051461.526566:0:104226:0:(llog.c:858:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:2.0:1777051461.718383:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1777051461.913521:0:104205:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934760 is committed 00000001:00080000:1.0:1777051461.913539:0:104205:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934759 is committed 00000001:00080000:1.0:1777051461.913580:0:104205:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934757 is committed 00000020:00080000:1.0:1777051461.913600:0:104205:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff99d956bdae40 refcount 2 committed 0 result 0 batchid 4294970587 00000020:00080000:1.0:1777051461.913609:0:104205:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff99da6ff5b900 obd lustre-OST0000-osc-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff99d956bda600 00000020:00080000:1.0:1777051461.913615:0:104205:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff99da6ff5bd00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff99da57b2ac00 00000020:00080000:1.0:1777051461.913649:0:104205:0:(update_trans.c:1333:distribute_txn_batchid_cb()) lustre-MDT0001: 4294970586 batchid updated 00000001:00080000:1.0:1777051461.913746:0:8464:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0000: transno 4294968372 is committed 00000001:00080000:1.0:1777051461.913757:0:8464:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0000: transno 4294968371 is committed 00010000:00010000:2.0:1777051461.913890:0:3664:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d775c00/0x85f51a6b967174e5 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd2:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21368 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051461.913909:0:3664:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d775c00/0x85f51a6b967174e5 lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd2:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 21368 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051461.913921:0:3664:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d775c00/0x85f51a6b967174e5 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd2:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21368 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051461.913933:0:3664:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da7d775c00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:2.0:1777051461.913940:0:3664:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d775c00/0x85f51a6b967174e5 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd2:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21368 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051461.913953:0:3664:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d775c00/0x85f51a6b967174e5 lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd2:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 21368 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051461.913988:0:3664:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x7:0x0].0x0 (ffff99d94e629800) 00010000:00010000:2.0:1777051461.913995:0:3664:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777051461.914003:0:3664:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d775c00/0x85f51a6b967174e5 lrc: 2/0,0 mode: --/TXN res: [0x240000bd2:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21368 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051461.914015:0:3664:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99da7d775c00/0x85f51a6b967174e5 lrc: 0/0,0 mode: --/TXN res: [0x240000bd2:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21368 initiator: MDT1 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1777051461.914070:0:104230:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 4294970587 committed batchid 4294970586 00000001:00080000:0.0:1777051461.914452:0:9540:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0001: transno 4294968376 is committed 00000020:00080000:2.0:1777051461.914574:0:104230:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 4294970586 00000100:00100000:1.0:1777051462.422724:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d951fa2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452684288:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1777051462.422831:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051462.423158:0:11727:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452684288 00000100:00100000:0.0:1777051462.423172:0:11727:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452684288 00000100:00100000:0.0:1777051462.423276:0:11727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8307 00000100:00100000:0.0:1777051462.423565:0:11727:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da44497b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3678:x1863365452684288:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1777051462.423617:0:11727:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4194304 pending 0 free 1441501184 avail 1295261696 00000100:00100000:0.0:1777051462.423711:0:11727:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da44497b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3678:x1863365452684288:12345-0@lo:41:osp-pre-0-1.0 Request processed in 420us (882us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051462.423727:0:11727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8307 00000100:00100000:1.0:1777051462.423833:0:3678:0:(client.c:3101:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 30064771239 gen 2 00000004:00080000:1.0:1777051462.423845:0:3678:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 30064771238 committed transno 30064771239 00000004:00080000:1.0:1777051462.423877:0:3678:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 30064771239 committed transno 30064771239 00000100:00100000:1.0:1777051462.423908:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d951fa2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452684288:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1777051462.564487:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051462.564565:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051462.564604:0:103166:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426084864 00000100:00100000:0.0:1777051462.564620:0:103166:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426084864 00000100:00100000:2.0:1777051462.564648:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051462.564728:0:103166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 192 00000100:00100000:0.0:1777051462.564748:0:103166:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94a771050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29c4352d-3260-4734-909d-9ea5de9e7fa4+12:2437:x1863365426084864:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:1.0:1777051462.564795:0:6579:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426085120 00000100:00100000:1.0:1777051462.564806:0:6579:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426085120 00000100:00100000:0.0:1777051462.564881:0:103166:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94a771050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29c4352d-3260-4734-909d-9ea5de9e7fa4+12:2437:x1863365426084864:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 134us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051462.564900:0:103166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 192 00000100:00100000:1.0:1777051462.564914:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13449 00000100:00100000:1.0:1777051462.564935:0:6579:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d950267100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+9:2437:x1863365426085120:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:1.0:1777051462.565005:0:6579:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d950267100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+9:2437:x1863365426085120:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 75us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051462.565021:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13449 00000100:00100000:1.0:1777051462.565072:0:8468:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426085376 00000100:00100000:1.0:1777051462.565080:0:8468:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426085376 00000100:00100000:1.0:1777051462.565144:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10485 00000100:00100000:1.0:1777051462.565162:0:8468:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d950267800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+48:2437:x1863365426085376:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:1.0:1777051462.565236:0:8468:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d950267800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+48:2437:x1863365426085376:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 76us (587us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051462.565271:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10485 00000100:00080000:2.0:1777051462.565286:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1777051462.565299:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1777051462.565965:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051462.566056:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051462.566108:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051462.566433:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051462.566463:0:8492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426085632 00000100:00100000:1.0:1777051462.566474:0:8492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426085632 00000100:00100000:2.0:1777051462.566496:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051462.566549:0:27884:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426085888 00000100:00100000:1.0:1777051462.566553:0:8492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426084992 00000100:00100000:2.0:1777051462.566559:0:27884:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426085888 00000100:00100000:2.0:1777051462.566617:0:27884:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426085248 00000100:00100000:2.0:1777051462.566625:0:27884:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426085248 00000100:00100000:2.0:1777051462.566677:0:27884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10486 00000100:00100000:2.0:1777051462.567052:0:27884:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d950267b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+50:2437:x1863365426085888:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:2.0:1777051462.567465:0:27884:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d950267b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+50:2437:x1863365426085888:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 771us (1427us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051462.567469:0:8492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426084992 00000100:00100000:2.0:1777051462.567491:0:27884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10486 00000100:00100000:2.0:1777051462.567527:0:27884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10487 00000100:00100000:1.0:1777051462.567533:0:8492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426085504 00000100:00100000:1.0:1777051462.567541:0:8492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426085504 00000100:00100000:2.0:1777051462.567548:0:27884:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d950264a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+51:2437:x1863365426085248:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:1.0:1777051462.567601:0:8492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13450 00000100:00100000:2.0:1777051462.567608:0:27884:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d950264a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+51:2437:x1863365426085248:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 65us (1444us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051462.567624:0:27884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10487 00000100:00100000:1.0:1777051462.567630:0:8492:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d950266680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+54:2437:x1863365426085632:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:2.0:1777051462.567675:0:46497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13451 00000100:00100000:2.0:1777051462.567692:0:46497:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d950265c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:c11b6966-0775-44d2-bdc6-c74c26eb2226+24:2437:x1863365426084992:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:1.0:1777051462.567705:0:8492:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d950266680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+54:2437:x1863365426085632:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 82us (1739us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051462.567718:0:8492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13450 00000100:00100000:1.0:1777051462.567750:0:8492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13452 00000100:00100000:2.0:1777051462.567766:0:46497:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d950265c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:c11b6966-0775-44d2-bdc6-c74c26eb2226+24:2437:x1863365426084992:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 75us (1655us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051462.567770:0:8492:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d950266a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+33:2437:x1863365426085504:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:2.0:1777051462.567794:0:46497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13451 00000100:00100000:1.0:1777051462.567847:0:8492:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d950266a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+33:2437:x1863365426085504:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 80us (1349us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051462.567861:0:8492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13452 00000100:00080000:1.0:1777051462.567925:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1777051462.567934:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1777051462.567940:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1777051462.567945:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1777051462.568783:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051462.569150:0:8628:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426085760 00000100:00100000:1.0:1777051462.569158:0:8628:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426085760 00000100:00100000:1.0:1777051462.569258:0:8628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10488 00000100:00100000:1.0:1777051462.569274:0:8628:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da44495180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+53:2437:x1863365426085760:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:1.0:1777051462.569345:0:8628:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da44495180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+53:2437:x1863365426085760:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 72us (562us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051462.569358:0:8628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10488 00000100:00080000:1.0:1777051462.569434:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1777051462.644680:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051462.644856:0:46494:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426086016 00000100:00100000:1.0:1777051462.644873:0:46494:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426086016 00000100:00100000:1.0:1777051462.644979:0:46494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112355 00000100:00100000:1.0:1777051462.644999:0:46494:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d950267480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c11b6966-0775-44d2-bdc6-c74c26eb2226+24:138736:x1863365426086016:12345-192.168.201.46@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1777051462.645640:0:46494:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d950267480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c11b6966-0775-44d2-bdc6-c74c26eb2226+24:138736:x1863365426086016:12345-192.168.201.46@tcp:60:lhsmtool_posix.0 Request processed in 642us (980us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051462.645658:0:46494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112355 00000100:00100000:1.0:1777051462.651607:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051462.651727:0:6579:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426086144 00000100:00100000:2.0:1777051462.651737:0:6579:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426086144 00000100:00100000:2.0:1777051462.652174:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112356 00000100:00100000:2.0:1777051462.652192:0:6579:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da44496680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+9:138736:x1863365426086144:12345-192.168.201.46@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1777051462.652618:0:6579:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da44496680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+9:138736:x1863365426086144:12345-192.168.201.46@tcp:60:lhsmtool_posix.0 Request processed in 429us (1014us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051462.652644:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112356 00000100:00100000:2.0:1777051462.660140:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051462.660270:0:46501:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426086400 00000100:00100000:0.0:1777051462.660283:0:46501:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426086400 00000100:00100000:0.0:1777051462.660360:0:46501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3425 00000100:00100000:0.0:1777051462.660376:0:46501:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da6ff01850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+24:138736:x1863365426086400:12345-192.168.201.46@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1777051462.660753:0:46501:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da6ff01850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+25:138736:x1863365426086400:12345-192.168.201.46@tcp:35:lhsmtool_posix.0 Request processed in 376us (620us total) trans 30064771240 rc 0/0 00000100:00100000:0.0:1777051462.660766:0:46501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3425 00010000:00010000:2.0:1777051462.742697:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777051462.934964:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d950265880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3677:1863365452684672:0@lo:400:kworker.0 00000100:00100000:0.0:1777051462.934993:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d950265500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3680:1863365452684544:0@lo:400:kworker.0 00000100:00100000:2.0:1777051462.935077:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d950264380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3678:1863365452684800:0@lo:400:kworker.0 00000100:00100000:0.0:1777051462.935081:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051462.935081:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051462.935088:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d943d93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452684416:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1777051462.935466:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95f864380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3680:1863365452685056:0@lo:400:kworker.0 00000100:00100000:0.0:1777051462.935507:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051462.935570:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95f865f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3680:1863365452685568:0@lo:400:kworker.0 00000100:00100000:0.0:1777051462.935607:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051462.935636:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95f864000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3680:1863365452686080:0@lo:400:kworker.0 00000100:00100000:0.0:1777051462.935672:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051462.935724:0:103168:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452684544 00000100:00100000:0.0:1777051462.935734:0:103168:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452684544 00000100:00100000:0.0:1777051462.936060:0:103168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:3.0:1777051462.936074:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95f864e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3677:1863365452685184:0@lo:400:kworker.0 00000100:00100000:0.0:1777051462.936079:0:103168:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94a773050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f9351a01-5b0e-4470-97fd-58b9b4b312a2+23:3680:x1863365452684544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051462.936135:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051462.936175:0:6585:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452685184 00000100:00100000:1.0:1777051462.936184:0:6585:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452685184 00000100:00100000:3.0:1777051462.936194:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95f867100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452685696:0@lo:400:kworker.0 00000100:00100000:0.0:1777051462.936240:0:103168:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94a773050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f9351a01-5b0e-4470-97fd-58b9b4b312a2+23:3680:x1863365452684544:12345-0@lo:400:kworker.0 Request processed in 165us (1163us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051462.936243:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051462.936254:0:103168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:3.0:1777051462.936265:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051462.936307:0:6585:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452685696 00000100:00100000:1.0:1777051462.936315:0:6585:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452685696 00000100:00100000:0.0:1777051462.936324:0:10328:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452684672 00000100:00100000:0.0:1777051462.936334:0:10328:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452684672 00000100:00100000:1.0:1777051462.936358:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8308 00000100:00100000:3.0:1777051462.936365:0:47208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8309 00000100:00100000:1.0:1777051462.936373:0:6585:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7cd9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3677:x1863365452685184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051462.936380:0:47208:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7cd9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+6:3677:x1863365452685696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777051462.936433:0:10328:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452685056 00000100:00100000:0.0:1777051462.936443:0:10328:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452685056 00000100:00100000:1.0:1777051462.936484:0:6585:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7cd9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3677:x1863365452685184:12345-0@lo:400:kworker.0 Request processed in 113us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051462.936484:0:47208:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7cd9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+6:3677:x1863365452685696:12345-0@lo:400:kworker.0 Request processed in 107us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051462.936488:0:10328:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452685568 00000100:00100000:0.0:1777051462.936496:0:10328:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452685568 00000100:00100000:1.0:1777051462.936503:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8308 00000100:00100000:3.0:1777051462.936523:0:47208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8309 00000100:00100000:0.0:1777051462.936537:0:10328:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452686080 00000100:00100000:0.0:1777051462.936543:0:10328:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452686080 00000100:00080000:1.0:1777051462.936543:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1777051462.936553:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1777051462.936572:0:27885:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452684800 00000100:00100000:1.0:1777051462.936580:0:27885:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452684800 00000100:00100000:3.0:1777051462.936582:0:3677:0:(client.c:3101:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 8589934760 gen 2 00000004:00080000:3.0:1777051462.936590:0:3677:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 8589934760 committed transno 8589934760 00000100:00100000:2.0:1777051462.936595:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95f867480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3678:1863365452685312:0@lo:400:kworker.0 00000100:00100000:0.0:1777051462.936599:0:10328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13453 00000100:00100000:0.0:1777051462.936618:0:10328:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7cd9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3677:x1863365452684672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051462.936635:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95f864e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3677:1863365452685184:0@lo:400:kworker.0 00000100:00100000:1.0:1777051462.936645:0:27885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13454 00000100:00100000:2.0:1777051462.936655:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051462.936664:0:27885:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d951fa2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:lustre-MDT0001-lwp-OST0001_UUID+5:3680:x1863365452685056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051462.936664:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95f867100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452685696:0@lo:400:kworker.0 00000100:00100000:0.0:1777051462.936691:0:10328:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7cd9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3677:x1863365452684672:12345-0@lo:400:kworker.0 Request processed in 77us (1615us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051462.936699:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d950265880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3677:1863365452684672:0@lo:400:kworker.0 00000100:00100000:0.0:1777051462.936710:0:10328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13453 00000100:00100000:2.0:1777051462.936710:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95f867800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452685824:0@lo:400:kworker.0 00000100:00100000:1.0:1777051462.936742:0:27885:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d951fa2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:lustre-MDT0001-lwp-OST0001_UUID+5:3680:x1863365452685056:12345-0@lo:400:kworker.0 Request processed in 82us (1230us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051462.936751:0:10328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13455 00000100:00100000:3.0:1777051462.936766:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051462.936768:0:27885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13454 00000100:00100000:0.0:1777051462.936769:0:10328:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d951fa1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3680:x1863365452685568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777051462.936769:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051462.936808:0:27885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13456 00000100:00100000:1.0:1777051462.936825:0:27885:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d951fa2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000-lwp-MDT0001_UUID+5:3680:x1863365452686080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777051462.936841:0:10328:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d951fa1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3680:x1863365452685568:12345-0@lo:400:kworker.0 Request processed in 73us (1230us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051462.936848:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13457 00000100:00100000:3.0:1777051462.936852:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d950264000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3679:1863365452684928:0@lo:400:kworker.0 00000100:00100000:0.0:1777051462.936862:0:10328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13455 00000100:00100000:2.0:1777051462.936867:0:6580:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f867b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3678:x1863365452684800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777051462.936897:0:27885:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d951fa2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000-lwp-MDT0001_UUID+5:3680:x1863365452686080:12345-0@lo:400:kworker.0 Request processed in 75us (1221us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051462.936904:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051462.936907:0:46498:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452684416 00000100:00100000:1.0:1777051462.936909:0:27885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13456 00000100:00100000:0.0:1777051462.936917:0:46498:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452684416 00000100:00100000:1.0:1777051462.936944:0:27885:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452684928 00000100:00100000:3.0:1777051462.936946:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95f864a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452685440:0@lo:400:kworker.0 00000100:00100000:1.0:1777051462.936951:0:27885:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452684928 00000100:00100000:2.0:1777051462.936958:0:6580:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f867b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3678:x1863365452684800:12345-0@lo:400:kworker.0 Request processed in 93us (711us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051462.936969:0:46498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8310 00000100:00100000:2.0:1777051462.936971:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13457 00000100:00100000:0.0:1777051462.936985:0:46498:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7cd9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+6:3679:x1863365452684416:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1777051462.936998:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051462.937007:0:27885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13458 00000004:00000024:0.0:1777051462.937023:0:46498:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4194304 pending 0 free 1446105088 avail 1299865600 00000100:00100000:1.0:1777051462.937026:0:27885:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d950265880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000-lwp-OST0001_UUID+5:3679:x1863365452684928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051462.937038:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95f866a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452685952:0@lo:400:kworker.0 00000100:00100000:2.0:1777051462.937042:0:8471:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452685312 00000100:00100000:3.0:1777051462.937564:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051462.937574:0:46498:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7cd9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+6:3679:x1863365452684416:12345-0@lo:41:osp-pre-1-0.0 Request processed in 589us (808us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051462.937575:0:27885:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d950265880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000-lwp-OST0001_UUID+5:3679:x1863365452684928:12345-0@lo:400:kworker.0 Request processed in 553us (668us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051462.937589:0:46498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8310 00000100:00100000:1.0:1777051462.937614:0:27885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13458 00000100:00100000:3.0:1777051462.937635:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d943d93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452684416:0@lo:41:osp-pre-1-0.0 00000100:00080000:1.0:1777051462.937656:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1777051462.937662:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1777051462.937669:0:8471:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452685312 00000100:00100000:0.0:1777051462.937673:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95f865f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3680:1863365452685568:0@lo:400:kworker.0 00000100:00100000:3.0:1777051462.937674:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d950264000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3679:1863365452684928:0@lo:400:kworker.0 00000100:00100000:1.0:1777051462.937979:0:8468:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452685824 00000100:00100000:1.0:1777051462.937987:0:8468:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452685824 00000100:00100000:0.0:1777051462.938002:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95f864000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3680:1863365452686080:0@lo:400:kworker.0 00000100:00100000:0.0:1777051462.938026:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d950265500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3680:1863365452684544:0@lo:400:kworker.0 00000100:00100000:2.0:1777051462.938030:0:8471:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452685440 00000100:00100000:2.0:1777051462.938036:0:8471:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452685440 00000100:00100000:0.0:1777051462.938052:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95f864380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3680:1863365452685056:0@lo:400:kworker.0 00000100:00100000:1.0:1777051462.938054:0:8468:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452685952 00000100:00100000:1.0:1777051462.938065:0:8468:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452685952 00000100:00100000:2.0:1777051462.938098:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10489 00000100:00100000:3.0:1777051462.938111:0:24468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10490 00000100:00100000:2.0:1777051462.938116:0:8471:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f865500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3678:x1863365452685312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051462.938133:0:24468:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f866d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3678:x1863365452685824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777051462.938151:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10491 00000100:00100000:1.0:1777051462.938164:0:8468:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d950264700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3679:x1863365452685440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777051462.938188:0:8470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10492 00000100:00100000:2.0:1777051462.938193:0:8471:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f865500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3678:x1863365452685312:12345-0@lo:400:kworker.0 Request processed in 85us (1542us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051462.938252:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10489 00000100:00100000:0.0:1777051462.938253:0:8470:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f65aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3679:x1863365452685952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051462.938254:0:24468:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f866d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3678:x1863365452685824:12345-0@lo:400:kworker.0 Request processed in 121us (1483us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051462.938269:0:8468:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d950264700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3679:x1863365452685440:12345-0@lo:400:kworker.0 Request processed in 106us (1271us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051462.938275:0:24468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10490 00000100:00100000:1.0:1777051462.938281:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10491 00000100:00100000:0.0:1777051462.938330:0:8470:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f65aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3679:x1863365452685952:12345-0@lo:400:kworker.0 Request processed in 83us (764us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051462.938343:0:8470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10492 00000100:00100000:1.0:1777051462.938359:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95f864a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452685440:0@lo:400:kworker.0 00000100:00100000:2.0:1777051462.938370:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d950264380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3678:1863365452684800:0@lo:400:kworker.0 00000100:00080000:3.0:1777051462.938406:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1777051462.938409:0:3679:0:(client.c:3101:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294968376 gen 2 00000100:00080000:3.0:1777051462.938415:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:1.0:1777051462.938417:0:3679:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff99da4384e300, transno 4294968376 00000100:00100000:2.0:1777051462.938431:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95f867480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3678:1863365452685312:0@lo:400:kworker.0 00000100:00100000:1.0:1777051462.938439:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95f866a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452685952:0@lo:400:kworker.0 00000100:00100000:2.0:1777051462.938452:0:3678:0:(client.c:3101:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294968372 gen 2 00000004:00080000:2.0:1777051462.938460:0:3678:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 4294968372 committed transno 4294968372 00000100:00100000:2.0:1777051462.938488:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95f867800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452685824:0@lo:400:kworker.0 00000100:00100000:0.0:1777051463.446680:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da44495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452686208:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1777051463.446707:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95f658a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452686336:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1777051463.447037:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051463.447113:0:10113:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452686336 00000100:00100000:0.0:1777051463.447124:0:10113:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452686336 00000100:00100000:1.0:1777051463.447168:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051463.447602:0:8473:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452686208 00000100:00100000:2.0:1777051463.447613:0:8473:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452686208 00000100:00100000:0.0:1777051463.447628:0:10113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5686 00000100:00100000:0.0:1777051463.447651:0:10113:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f867800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3678:x1863365452686336:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1777051463.447695:0:47388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5687 00002000:00000024:0.0:1777051463.447696:0:10113:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 489209408 pending 0 free 3642707968 avail 3411185664 00000100:00100000:3.0:1777051463.447720:0:47388:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da44497800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3677:x1863365452686208:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1777051463.447762:0:47388:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 499269184 pending 0 free 3860574208 avail 3629051904 00000100:00100000:0.0:1777051463.447784:0:10113:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f867800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3678:x1863365452686336:12345-0@lo:13:osp-pre-1-1.0 Request processed in 140us (747us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051463.447796:0:10113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5686 00000100:00100000:2.0:1777051463.447851:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95f658a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452686336:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1777051463.447860:0:47388:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da44497800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3677:x1863365452686208:12345-0@lo:13:osp-pre-0-1.0 Request processed in 144us (693us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051463.447877:0:47388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5687 00000100:00100000:1.0:1777051463.447969:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da44495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452686208:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1777051463.767222:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1777051464.188142:0:108453:0:(debug.c:645:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-hsm test 407: Check for double RESTORE records in llog ========================================================== 13:24:22 (1777051462) 00000100:00100000:2.0:1777051464.275602:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051464.275684:0:6580:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426086528 00000100:00100000:2.0:1777051464.275709:0:6580:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426086528 00000100:00100000:2.0:1777051464.275876:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112357 00000100:00100000:2.0:1777051464.275897:0:6580:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f867480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+33:139407:x1863365426086528:12345-192.168.201.46@tcp:101:lfs.0 00010000:00010000:2.0:1777051464.275940:0:6580:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051464.275995:0:6580:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710e00/0x85f51a6b96717547 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b69c2 expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051464.276576:0:6580:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d774400/0x85f51a6b9671754e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051464.276618:0:6580:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d774400/0x85f51a6b9671754e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051464.276654:0:6580:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d774400/0x85f51a6b9671754e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051464.277558:0:6580:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d775000/0x85f51a6b96717555 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x844c7c05 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051464.277581:0:6580:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d775000/0x85f51a6b96717555 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x844c7c05 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051464.277609:0:6580:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d775000/0x85f51a6b96717555 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x844c7c05 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051464.277709:0:6580:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d774400/0x85f51a6b9671754e lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051464.277735:0:6580:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d774400/0x85f51a6b9671754e lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051464.277750:0:6580:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d774400/0x85f51a6b9671754e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051464.277773:0:6580:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d774400/0x85f51a6b9671754e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051464.277787:0:6580:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da7d774400 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:0.0:1777051464.277794:0:6580:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d774400/0x85f51a6b9671754e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051464.278226:0:6580:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d774400/0x85f51a6b9671754e lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051464.278264:0:6580:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d9533ab000) 00010000:00010000:0.0:1777051464.278271:0:6580:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777051464.278280:0:6580:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d774400/0x85f51a6b9671754e lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051464.278294:0:6580:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d774400/0x85f51a6b9671754e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051464.278327:0:6580:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d775000/0x85f51a6b96717555 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x844c7c05 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051464.278351:0:6580:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d775000/0x85f51a6b96717555 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x844c7c05 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051464.278406:0:6580:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d775000/0x85f51a6b96717555 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x844c7c05 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051464.278430:0:6580:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da7d775000 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:0.0:1777051464.278437:0:6580:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d775000/0x85f51a6b96717555 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x844c7c05 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051464.278451:0:6580:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d775000/0x85f51a6b96717555 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x844c7c05 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051464.278476:0:6580:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x844c7c05 (ffff99da61538600) 00010000:00010000:0.0:1777051464.278482:0:6580:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777051464.278487:0:6580:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d775000/0x85f51a6b96717555 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x844c7c05 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051464.278499:0:6580:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d775000/0x85f51a6b96717555 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x844c7c05 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051464.278580:0:6580:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710e00/0x85f51a6b96717547 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b69c2 expref: 34 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051464.278613:0:6580:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d9533ab000) 00010000:00010000:0.0:1777051464.278619:0:6580:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777051464.278637:0:6580:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710e00/0x85f51a6b96717547 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b69c2 expref: 34 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051464.278659:0:6580:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d950710e00, rc 0) 00000100:00080000:2.0:1777051464.279879:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1777051464.280683:0:6580:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f867480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+33:139407:x1863365426086528:12345-192.168.201.46@tcp:101:lfs.0 Request processed in 4779us (5080us total) trans 0 rc 301/301 00000100:00100000:0.0:1777051464.280701:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112357 00000100:00100000:0.0:1777051464.307577:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051464.308333:0:27885:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426086784 00000100:00100000:2.0:1777051464.308354:0:27885:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426086784 00000100:00100000:2.0:1777051464.308524:0:27885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112358 00000100:00100000:2.0:1777051464.308546:0:27885:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95a582300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+33:139407:x1863365426086784:12345-192.168.201.46@tcp:36:lfs.0 00010000:00010000:2.0:1777051464.308643:0:27885:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777051464.309249:0:27885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d950711800/0x85f51a6b96717302 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6905 expref: 33 pid: 46494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051464.309294:0:27885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d9533ab000) 00010000:00010000:2.0:1777051464.309309:0:27885:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1777051464.309504:0:27885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950711600/0x85f51a6b9671755c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051464.309546:0:27885:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99d950711e00/0x85f51a6b9671742f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6960 expref: 24 pid: 27885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051464.309569:0:27885:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d950711600/0x85f51a6b9671755c lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051464.309661:0:27885:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99d950711e00/0x85f51a6b9671742f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6960 expref: 24 pid: 27885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051464.309703:0:27885:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950711e00/0x85f51a6b9671742f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6960 expref: 24 pid: 27885 timeout: 8193 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051464.309735:0:27885:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95f865180 pname:cluuid:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000_UUID:27885:1863365452686464:192.168.201.46@tcp:104: 00000100:00100000:2.0:1777051464.309905:0:27885:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d9591d5600 going to sleep for 11 seconds 00000100:00100000:3.0:1777051464.329898:0:27885:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95f865180 pname:cluuid:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000_UUID:27885:1863365452686464:192.168.201.46@tcp:104: 00010000:00010000:3.0:1777051464.329951:0:27885:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99d950711600/0x85f51a6b9671755c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051464.330032:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051464.330255:0:24467:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426086912 00000100:00100000:3.0:1777051464.330268:0:24467:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426086912 00010000:00010000:3.0:1777051464.330563:0:24467:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d950711e00/0x85f51a6b9671742f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6960 expref: 25 pid: 27885 timeout: 8193 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1777051464.330645:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1777051464.330648:0:24467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3967 00000100:00100000:3.0:1777051464.330675:0:24467:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da445ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+25:2436:x1863365426086912:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1777051464.330710:0:24467:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777051464.330722:0:24467:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99d950711e00/0x85f51a6b9671742f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6960 expref: 25 pid: 27885 timeout: 8193 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051464.330752:0:24467:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99d950711e00/0x85f51a6b9671742f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6960 expref: 25 pid: 27885 timeout: 8193 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051464.331341:0:24467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d950711e00/0x85f51a6b9671742f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6960 expref: 25 pid: 27885 timeout: 8193 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051464.331447:0:24467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d9533ab000) 00010000:00010000:3.0:1777051464.331461:0:24467:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff99d950711600/0x85f51a6b9671755c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051464.331479:0:24467:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99d950711600/0x85f51a6b9671755c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051464.331498:0:24467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d950711600/0x85f51a6b9671755c lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051464.331566:0:24467:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1777051464.331647:0:24467:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da445ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+24:2436:x1863365426086912:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 981us (1623us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051464.331668:0:24467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3967 00010000:00010000:3.0:1777051464.331758:0:27885:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99d950711600/0x85f51a6b9671755c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051464.331774:0:27885:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d950711600/0x85f51a6b9671755c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051464.331833:0:27885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e6e7800/0x85f51a6b96717563 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x844c7c05 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051464.331853:0:27885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e6e7800/0x85f51a6b96717563 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x844c7c05 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051464.331877:0:27885:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e6e7800/0x85f51a6b96717563 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x844c7c05 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051464.333221:0:27885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710a00/0x85f51a6b9671756a lrc: 3/0,1 mode: --/PW res: [0x2000032e2:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051464.333247:0:27885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710a00/0x85f51a6b9671756a lrc: 3/0,1 mode: PW/PW res: [0x2000032e2:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051464.333265:0:27885:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710a00/0x85f51a6b9671756a lrc: 3/0,1 mode: PW/PW res: [0x2000032e2:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1777051464.333298:0:27885:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000025ced19b reply state 00000000b055aeb9 transno 30064771241 ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710a00/0x85f51a6b9671756a lrc: 3/0,1 mode: PW/PW res: [0x2000032e2:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051464.333417:0:27885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710a00/0x85f51a6b9671756a lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e2:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051464.333448:0:27885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0xa:0x0].0x0 (ffff99da45fd2700) 00010000:00010000:2.0:1777051464.333454:0:27885:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1777051464.333460:0:27885:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1777051464.333471:0:27885:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000032e2:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1777051464.333490:0:27885:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950711600/0x85f51a6b9671755c lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051464.333504:0:27885:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950711600/0x85f51a6b9671755c lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051464.333515:0:27885:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d950711600/0x85f51a6b9671755c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051464.333532:0:27885:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d950711600/0x85f51a6b9671755c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051464.333543:0:27885:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d950711600 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:2.0:1777051464.333551:0:27885:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d950711600/0x85f51a6b9671755c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051464.333566:0:27885:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d950711600/0x85f51a6b9671755c lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051464.333588:0:27885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d9533ab000) 00010000:00010000:2.0:1777051464.333593:0:27885:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777051464.333600:0:27885:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d950711600/0x85f51a6b9671755c lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051464.333618:0:27885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d950711600/0x85f51a6b9671755c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1777051464.333640:0:27885:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000025ced19b reply state 00000000b055aeb9 transno 30064771241 ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e6e7800/0x85f51a6b96717563 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x844c7c05 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051464.333663:0:27885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e6e7800/0x85f51a6b96717563 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x844c7c05 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051464.333675:0:27885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x844c7c05 (ffff99d9413d2800) 00010000:00010000:2.0:1777051464.333680:0:27885:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1777051464.333684:0:27885:0:(service.c:177:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1777051464.333823:0:27885:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95a582300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+34:139407:x1863365426086784:12345-192.168.201.46@tcp:36:lfs.0 Request processed in 25275us (26249us total) trans 30064771241 rc 0/0 00000100:00100000:2.0:1777051464.333840:0:27885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112358 00000100:00100000:0.0:1777051464.401913:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051464.402078:0:27882:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426087040 00000100:00100000:1.0:1777051464.402095:0:27882:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426087040 00000100:00100000:1.0:1777051464.404649:0:27882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112359 00000100:00100000:1.0:1777051464.404672:0:27882:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da445dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+24:139416:x1863365426087040:12345-192.168.201.46@tcp:101:mkdir.0 00010000:00010000:1.0:1777051464.404711:0:27882:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777051464.404767:0:27882:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d953284e00/0x85f51a6b96717571 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b69c9 expref: -99 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051464.404875:0:27882:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d953285e00/0x85f51a6b96717578 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051464.404898:0:27882:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d953285e00/0x85f51a6b96717578 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051464.404918:0:27882:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d953285e00/0x85f51a6b96717578 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1777051464.404984:0:27882:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 12288 00000004:00200000:1.0:1777051464.404992:0:27882:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1777051464.405024:0:27882:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99d953285e00/0x85f51a6b96717578 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051464.405065:0:27882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d953284e00/0x85f51a6b96717571 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b69c9 expref: 26 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051464.405096:0:27882:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d953285e00/0x85f51a6b96717578 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b69c9 expref: 25 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051464.405112:0:27882:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d9533ab000) 00010000:00010000:1.0:1777051464.405117:0:27882:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1777051464.405123:0:27882:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d953285e00, rc 0) 00000100:00100000:1.0:1777051464.405265:0:27882:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da445dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+25:139416:x1863365426087040:12345-192.168.201.46@tcp:101:mkdir.0 Request processed in 599us (3361us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051464.405281:0:27882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112359 00000100:00100000:1.0:1777051464.412522:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051464.412595:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051464.412610:0:46494:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426087168 00000100:00100000:0.0:1777051464.412623:0:46494:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426087168 00000100:00080000:1.0:1777051464.412682:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1777051464.412704:0:46494:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426087424 00000100:00100000:0.0:1777051464.412712:0:46494:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426087424 00000100:00100000:0.0:1777051464.412764:0:46494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112360 00000100:00100000:0.0:1777051464.412778:0:46494:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da44495500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c11b6966-0775-44d2-bdc6-c74c26eb2226+10:2437:x1863365426087168:12345-192.168.201.46@tcp:41:mkdir.0 00000100:00100000:1.0:1777051464.412813:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112361 00000100:00100000:1.0:1777051464.412835:0:6579:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da44495880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+10:139416:x1863365426087424:12345-192.168.201.46@tcp:36:mkdir.0 00000004:00000024:0.0:1777051464.412847:0:46494:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4194304 pending 0 free 1446105088 avail 1299865600 00000100:00100000:0.0:1777051464.412955:0:46494:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da44495500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c11b6966-0775-44d2-bdc6-c74c26eb2226+10:2437:x1863365426087168:12345-192.168.201.46@tcp:41:mkdir.0 Request processed in 176us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051464.412974:0:46494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112360 00000100:00100000:1.0:1777051464.412979:0:6579:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da44494700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6579:1863365452686592:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1777051464.413065:0:6579:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051464.413131:0:6579:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d944aebe40 going to sleep for 11 seconds 00000100:00100000:0.0:1777051464.413168:0:6585:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452686592 00000100:00100000:0.0:1777051464.413187:0:6585:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452686592 00000100:00100000:0.0:1777051464.413269:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8311 00000100:00100000:0.0:1777051464.413326:0:6585:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da44494380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:6579:x1863365452686592:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1777051464.413830:0:6585:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da44494380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:6579:x1863365452686592:12345-0@lo:1000:mdt00_000.0 Request processed in 545us (762us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051464.413838:0:6579:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da44494700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6579:1863365452686592:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1777051464.413854:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8311 00000100:00100000:1.0:1777051464.413925:0:6579:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da44494700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6579:1863365452686720:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1777051464.413974:0:6579:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051464.414013:0:6579:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d944aebe40 going to sleep for 11 seconds 00000100:00100000:3.0:1777051464.414071:0:6584:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452686720 00000100:00100000:3.0:1777051464.414081:0:6584:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452686720 00000100:00100000:3.0:1777051464.414148:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8312 00000100:00100000:3.0:1777051464.414162:0:6584:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da44496a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:6579:x1863365452686720:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1777051464.414505:0:6584:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da44496a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:6579:x1863365452686720:12345-0@lo:1000:mdt00_000.0 Request processed in 344us (529us total) trans 0 rc 1/1 00000100:00100000:3.0:1777051464.414518:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8312 00000100:00100000:1.0:1777051464.414577:0:6579:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da44494700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6579:1863365452686720:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1777051464.414697:0:6579:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da44495880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+9:139416:x1863365426087424:12345-192.168.201.46@tcp:36:mkdir.0 Request processed in 1868us (2110us total) trans 0 rc -17/-17 00000100:00100000:1.0:1777051464.414709:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112361 00000100:00100000:3.0:1777051464.427669:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051464.427775:0:21368:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426087552 00000100:00100000:2.0:1777051464.428063:0:21368:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426087552 00000100:00100000:2.0:1777051464.428155:0:21368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112362 00000100:00100000:2.0:1777051464.428175:0:21368:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f658a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+25:139416:x1863365426087552:12345-192.168.201.46@tcp:101:mkdir.0 00010000:00010000:2.0:1777051464.428452:0:21368:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051464.428483:0:21368:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d950711600/0x85f51a6b9671757f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b69d0 expref: -99 pid: 21368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051464.428572:0:21368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950711a00/0x85f51a6b96717586 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051464.428595:0:21368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d950711a00/0x85f51a6b96717586 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051464.428615:0:21368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d950711a00/0x85f51a6b96717586 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051464.428633:0:21368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710200/0x85f51a6b9671758d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x844c7c05 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051464.428654:0:21368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710200/0x85f51a6b9671758d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x844c7c05 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051464.428666:0:21368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710200/0x85f51a6b9671758d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x844c7c05 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051464.428779:0:21368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950711800/0x85f51a6b96717594 lrc: 3/1,0 mode: --/PR res: [0x2000032e2:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051464.428793:0:21368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d950711800/0x85f51a6b96717594 lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051464.428807:0:21368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d950711800/0x85f51a6b96717594 lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1777051464.428855:0:21368:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000032e2:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1777051464.428861:0:21368:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1777051464.428890:0:21368:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99d950711800/0x85f51a6b96717594 lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051464.428908:0:21368:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950711a00/0x85f51a6b96717586 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051464.428920:0:21368:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d950711a00/0x85f51a6b96717586 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051464.428931:0:21368:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d950711a00/0x85f51a6b96717586 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051464.428941:0:21368:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d950711a00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:2.0:1777051464.428948:0:21368:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d950711a00/0x85f51a6b96717586 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051464.428961:0:21368:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d950711a00/0x85f51a6b96717586 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051464.428978:0:21368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d9533ab000) 00010000:00010000:2.0:1777051464.428983:0:21368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777051464.428991:0:21368:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d950711a00/0x85f51a6b96717586 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051464.429001:0:21368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d950711a00/0x85f51a6b96717586 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051464.429019:0:21368:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710200/0x85f51a6b9671758d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x844c7c05 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051464.429031:0:21368:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710200/0x85f51a6b9671758d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x844c7c05 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051464.429041:0:21368:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710200/0x85f51a6b9671758d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x844c7c05 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051464.429052:0:21368:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d950710200 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:2.0:1777051464.429057:0:21368:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710200/0x85f51a6b9671758d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x844c7c05 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051464.429067:0:21368:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710200/0x85f51a6b9671758d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x844c7c05 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051464.429080:0:21368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x844c7c05 (ffff99d9413d2800) 00010000:00010000:2.0:1777051464.429085:0:21368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777051464.429090:0:21368:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710200/0x85f51a6b9671758d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x844c7c05 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051464.429109:0:21368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710200/0x85f51a6b9671758d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x844c7c05 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051464.429150:0:21368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d950711600/0x85f51a6b9671757f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b69d0 expref: 27 pid: 21368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051464.429174:0:21368:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950711800/0x85f51a6b96717594 lrc: 3/0,0 mode: PR/PR res: [0x2000032e2:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b69d0 expref: 26 pid: 21368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051464.429186:0:21368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0xa:0x0].0x0 (ffff99da45fd2700) 00010000:00010000:2.0:1777051464.429190:0:21368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1777051464.429194:0:21368:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d950711800, rc 0) 00000100:00100000:2.0:1777051464.429426:0:21368:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f658a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+26:139416:x1863365426087552:12345-192.168.201.46@tcp:101:mkdir.0 Request processed in 1255us (2574us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051464.429441:0:21368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112362 00000100:00100000:3.0:1777051464.446140:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051464.446242:0:10328:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426087680 00000100:00100000:0.0:1777051464.446258:0:10328:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426087680 00000100:00100000:0.0:1777051464.446411:0:10328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112363 00000100:00100000:0.0:1777051464.446436:0:10328:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d950264380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+26:139420:x1863365426087680:12345-192.168.201.46@tcp:101:rm.0 00010000:00010000:0.0:1777051464.446465:0:10328:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051464.446496:0:10328:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d774400/0x85f51a6b9671759b lrc: 2/0,0 mode: --/CR res: [0x2000032e2:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b69d7 expref: -99 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051464.446699:0:10328:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d774200/0x85f51a6b967175a2 lrc: 3/1,0 mode: --/CR res: [0x2000032e2:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051464.446723:0:10328:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d774200/0x85f51a6b967175a2 lrc: 3/1,0 mode: CR/CR res: [0x2000032e2:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051464.446768:0:10328:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d774200/0x85f51a6b967175a2 lrc: 3/1,0 mode: CR/CR res: [0x2000032e2:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051464.446794:0:10328:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d774600/0x85f51a6b967175a9 lrc: 3/1,0 mode: --/PR res: [0x2000032e2:0xa:0x0].0x25e40ed5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051464.446804:0:10328:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d774600/0x85f51a6b967175a9 lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0xa:0x0].0x25e40ed5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051464.446813:0:10328:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d774600/0x85f51a6b967175a9 lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0xa:0x0].0x25e40ed5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051464.446858:0:10328:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d774200/0x85f51a6b967175a2 lrc: 4/1,0 mode: CR/CR res: [0x2000032e2:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051464.446867:0:10328:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d774200/0x85f51a6b967175a2 lrc: 4/1,0 mode: CR/CR res: [0x2000032e2:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051464.446873:0:10328:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d774200/0x85f51a6b967175a2 lrc: 3/0,0 mode: CR/CR res: [0x2000032e2:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051464.446880:0:10328:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d774200/0x85f51a6b967175a2 lrc: 4/0,0 mode: CR/CR res: [0x2000032e2:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051464.446888:0:10328:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da7d774200 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:0.0:1777051464.446893:0:10328:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d774200/0x85f51a6b967175a2 lrc: 4/0,0 mode: CR/CR res: [0x2000032e2:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051464.446902:0:10328:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d774200/0x85f51a6b967175a2 lrc: 5/0,0 mode: CR/CR res: [0x2000032e2:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051464.446918:0:10328:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0xa:0x0].0x0 (ffff99da45fd2700) 00010000:00010000:0.0:1777051464.446924:0:10328:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777051464.446931:0:10328:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d774200/0x85f51a6b967175a2 lrc: 3/0,0 mode: --/CR res: [0x2000032e2:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051464.446942:0:10328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d774200/0x85f51a6b967175a2 lrc: 0/0,0 mode: --/CR res: [0x2000032e2:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051464.446963:0:10328:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d774600/0x85f51a6b967175a9 lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0xa:0x0].0x25e40ed5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051464.446974:0:10328:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d774600/0x85f51a6b967175a9 lrc: 2/0,0 mode: PR/PR res: [0x2000032e2:0xa:0x0].0x25e40ed5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051464.446985:0:10328:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d774600/0x85f51a6b967175a9 lrc: 3/0,0 mode: PR/PR res: [0x2000032e2:0xa:0x0].0x25e40ed5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051464.446994:0:10328:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da7d774600 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:0.0:1777051464.446999:0:10328:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d774600/0x85f51a6b967175a9 lrc: 3/0,0 mode: PR/PR res: [0x2000032e2:0xa:0x0].0x25e40ed5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051464.447010:0:10328:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d774600/0x85f51a6b967175a9 lrc: 4/0,0 mode: PR/PR res: [0x2000032e2:0xa:0x0].0x25e40ed5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051464.447032:0:10328:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0xa:0x0].0x25e40ed5 (ffff99da61538600) 00010000:00010000:0.0:1777051464.447037:0:10328:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777051464.447042:0:10328:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d774600/0x85f51a6b967175a9 lrc: 2/0,0 mode: --/PR res: [0x2000032e2:0xa:0x0].0x25e40ed5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051464.447053:0:10328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d774600/0x85f51a6b967175a9 lrc: 0/0,0 mode: --/PR res: [0x2000032e2:0xa:0x0].0x25e40ed5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051464.447468:0:10328:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d774400/0x85f51a6b9671759b lrc: 1/0,0 mode: --/CR res: [0x2000032e2:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b69d7 expref: 27 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051464.447491:0:10328:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0xa:0x0].0x0 (ffff99da45fd2700) 00010000:00010000:0.0:1777051464.447496:0:10328:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777051464.447506:0:10328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d774400/0x85f51a6b9671759b lrc: 0/0,0 mode: --/CR res: [0x2000032e2:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b69d7 expref: 27 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051464.447531:0:10328:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99da7d774400, rc 0) 00000100:00100000:0.0:1777051464.447622:0:10328:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d950264380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+26:139420:x1863365426087680:12345-192.168.201.46@tcp:101:rm.0 Request processed in 1194us (1489us total) trans 0 rc 301/301 00000100:00100000:0.0:1777051464.447638:0:10328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112363 00000100:00100000:3.0:1777051464.467887:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051464.467970:0:8492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426087936 00000100:00100000:0.0:1777051464.467987:0:8492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426087936 00000100:00100000:0.0:1777051464.468084:0:8492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112364 00000100:00100000:0.0:1777051464.468103:0:8492:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d950265500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+26:139421:x1863365426087936:12345-192.168.201.46@tcp:101:dd.0 00010000:00010000:0.0:1777051464.468144:0:8492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051464.468150:0:8492:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1777051464.468191:0:8492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d950711800/0x85f51a6b96717594 lrc: 0/0,0 mode: --/PR res: [0x2000032e2:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b69d0 expref: 26 pid: 21368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051464.468223:0:8492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0xa:0x0].0x0 (ffff99da45fd2700) 00010000:00010000:0.0:1777051464.468233:0:8492:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1777051464.468272:0:8492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d774400/0x85f51a6b967175b0 lrc: 2/0,0 mode: --/CW res: [0x2000032e2:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b69de expref: -99 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051464.468446:0:8492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d774600/0x85f51a6b967175b7 lrc: 3/0,1 mode: --/CW res: [0x2000032e2:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051464.468470:0:8492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d774600/0x85f51a6b967175b7 lrc: 3/0,1 mode: CW/CW res: [0x2000032e2:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051464.468488:0:8492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d774600/0x85f51a6b967175b7 lrc: 3/0,1 mode: CW/CW res: [0x2000032e2:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051464.468511:0:8492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d774200/0x85f51a6b967175be lrc: 3/0,1 mode: --/PW res: [0x2000032e2:0xa:0x0].0x25e40ed5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051464.468525:0:8492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d774200/0x85f51a6b967175be lrc: 3/0,1 mode: PW/PW res: [0x2000032e2:0xa:0x0].0x25e40ed5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051464.468537:0:8492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d774200/0x85f51a6b967175be lrc: 3/0,1 mode: PW/PW res: [0x2000032e2:0xa:0x0].0x25e40ed5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1777051464.469417:0:8492:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x1e6:0x0], index 0: 0 00010000:00010000:0.0:1777051464.469703:0:8492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d774a00/0x85f51a6b967175c5 lrc: 3/1,0 mode: --/PR res: [0x2000032e3:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051464.469721:0:8492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d774a00/0x85f51a6b967175c5 lrc: 3/1,0 mode: PR/PR res: [0x2000032e3:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051464.469747:0:8492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d774a00/0x85f51a6b967175c5 lrc: 3/1,0 mode: PR/PR res: [0x2000032e3:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051464.469802:0:8492:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d774600/0x85f51a6b967175b7 lrc: 4/0,1 mode: CW/CW res: [0x2000032e2:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051464.469816:0:8492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d774600/0x85f51a6b967175b7 lrc: 4/0,1 mode: CW/CW res: [0x2000032e2:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051464.469828:0:8492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d774600/0x85f51a6b967175b7 lrc: 3/0,0 mode: CW/CW res: [0x2000032e2:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051464.469840:0:8492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d774600/0x85f51a6b967175b7 lrc: 4/0,0 mode: CW/CW res: [0x2000032e2:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051464.469851:0:8492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da7d774600 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:0.0:1777051464.469858:0:8492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d774600/0x85f51a6b967175b7 lrc: 4/0,0 mode: CW/CW res: [0x2000032e2:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051464.469871:0:8492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d774600/0x85f51a6b967175b7 lrc: 5/0,0 mode: CW/CW res: [0x2000032e2:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051464.469886:0:8492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0xa:0x0].0x0 (ffff99da45fd2700) 00010000:00010000:0.0:1777051464.469891:0:8492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777051464.469897:0:8492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d774600/0x85f51a6b967175b7 lrc: 3/0,0 mode: --/CW res: [0x2000032e2:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051464.469908:0:8492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d774600/0x85f51a6b967175b7 lrc: 0/0,0 mode: --/CW res: [0x2000032e2:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1777051464.469927:0:8492:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000083e37d1c reply state 00000000cdab33c1 transno 30064771242 ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d774200/0x85f51a6b967175be lrc: 3/0,1 mode: PW/PW res: [0x2000032e2:0xa:0x0].0x25e40ed5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051464.469946:0:8492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d774200/0x85f51a6b967175be lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e2:0xa:0x0].0x25e40ed5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051464.469957:0:8492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0xa:0x0].0x25e40ed5 (ffff99da61538600) 00010000:00010000:0.0:1777051464.469962:0:8492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1777051464.469966:0:8492:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1777051464.470006:0:8492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d774400/0x85f51a6b967175b0 lrc: 0/0,0 mode: --/CW res: [0x2000032e2:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b69de expref: 28 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051464.470030:0:8492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d774a00/0x85f51a6b967175c5 lrc: 3/0,0 mode: PR/PR res: [0x2000032e3:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b69de expref: 27 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051464.470042:0:8492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e3:0xb:0x0].0x0 (ffff99da61538f00) 00010000:00010000:0.0:1777051464.470047:0:8492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1777051464.470051:0:8492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99da7d774a00, rc 0) 00000100:00100000:0.0:1777051464.470666:0:8492:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d950265500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+28:139421:x1863365426087936:12345-192.168.201.46@tcp:101:dd.0 Request processed in 2564us (2783us total) trans 30064771242 rc 0/0 00000100:00100000:0.0:1777051464.470683:0:8492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112364 00000100:00100000:1.0:1777051464.475731:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051464.476099:0:6583:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426088192 00000100:00100000:3.0:1777051464.476111:0:6583:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426088192 00000100:00100000:3.0:1777051464.476234:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3426 00000100:00100000:3.0:1777051464.476253:0:6583:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da44494700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+28:139421:x1863365426088192:12345-192.168.201.46@tcp:35:dd.0 00000100:00100000:3.0:1777051464.476573:0:6583:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da44494700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+29:139421:x1863365426088192:12345-192.168.201.46@tcp:35:dd.0 Request processed in 325us (846us total) trans 30064771243 rc 0/0 00000100:00100000:3.0:1777051464.476587:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3426 00000100:00100000:3.0:1777051464.499511:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051464.499620:0:6581:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426088320 00000100:00100000:2.0:1777051464.499635:0:6581:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426088320 00000100:00100000:2.0:1777051464.499719:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112365 00000100:00100000:2.0:1777051464.499737:0:6581:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d950264000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+29:139422:x1863365426088320:12345-192.168.201.46@tcp:101:lfs.0 00010000:00010000:2.0:1777051464.499772:0:6581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051464.499812:0:6581:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d950711600/0x85f51a6b967175d3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b69e5 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051464.499909:0:6581:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710200/0x85f51a6b967175da lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051464.499933:0:6581:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710200/0x85f51a6b967175da lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051464.499954:0:6581:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710200/0x85f51a6b967175da lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051464.499974:0:6581:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950711a00/0x85f51a6b967175e1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x844c7c05 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051464.499989:0:6581:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d950711a00/0x85f51a6b967175e1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x844c7c05 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051464.500002:0:6581:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d950711a00/0x85f51a6b967175e1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x844c7c05 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051464.500118:0:6581:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950711e00/0x85f51a6b967175e8 lrc: 3/1,0 mode: --/PR res: [0x2000032e2:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051464.500137:0:6581:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d950711e00/0x85f51a6b967175e8 lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051464.500149:0:6581:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d950711e00/0x85f51a6b967175e8 lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1777051464.500252:0:6581:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000032e2:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1777051464.500260:0:6581:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1777051464.500291:0:6581:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99d950711e00/0x85f51a6b967175e8 lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051464.500311:0:6581:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710200/0x85f51a6b967175da lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051464.500323:0:6581:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710200/0x85f51a6b967175da lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051464.500344:0:6581:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710200/0x85f51a6b967175da lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051464.500355:0:6581:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d950710200 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:2.0:1777051464.500393:0:6581:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710200/0x85f51a6b967175da lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051464.500406:0:6581:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710200/0x85f51a6b967175da lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051464.500424:0:6581:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d9533ab000) 00010000:00010000:2.0:1777051464.500429:0:6581:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777051464.500436:0:6581:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710200/0x85f51a6b967175da lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051464.500448:0:6581:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710200/0x85f51a6b967175da lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051464.500465:0:6581:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950711a00/0x85f51a6b967175e1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x844c7c05 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051464.500476:0:6581:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d950711a00/0x85f51a6b967175e1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x844c7c05 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051464.500485:0:6581:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d950711a00/0x85f51a6b967175e1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x844c7c05 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051464.500494:0:6581:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d950711a00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:2.0:1777051464.500498:0:6581:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d950711a00/0x85f51a6b967175e1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x844c7c05 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051464.500515:0:6581:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d950711a00/0x85f51a6b967175e1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x844c7c05 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051464.500528:0:6581:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x844c7c05 (ffff99d9413d2800) 00010000:00010000:2.0:1777051464.500532:0:6581:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777051464.500536:0:6581:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d950711a00/0x85f51a6b967175e1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x844c7c05 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051464.500546:0:6581:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d950711a00/0x85f51a6b967175e1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x844c7c05 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051464.500580:0:6581:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d950711600/0x85f51a6b967175d3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b69e5 expref: 31 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051464.500595:0:6581:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950711e00/0x85f51a6b967175e8 lrc: 3/0,0 mode: PR/PR res: [0x2000032e2:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b69e5 expref: 30 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051464.500603:0:6581:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0xa:0x0].0x0 (ffff99da45fd2700) 00010000:00010000:2.0:1777051464.500606:0:6581:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1777051464.500608:0:6581:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d950711e00, rc 0) 00000100:00100000:2.0:1777051464.500684:0:6581:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d950264000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+30:139422:x1863365426088320:12345-192.168.201.46@tcp:101:lfs.0 Request processed in 951us (1185us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051464.500697:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112365 00000100:00100000:0.0:1777051464.692531:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051464.692667:0:46494:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426088576 00000100:00100000:1.0:1777051464.692680:0:46494:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426088576 00000100:00100000:1.0:1777051464.692746:0:46494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112366 00000100:00100000:1.0:1777051464.692757:0:46494:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da445df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c11b6966-0775-44d2-bdc6-c74c26eb2226+30:139448:x1863365426088576:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1777051464.692796:0:46494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777051464.692825:0:46494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d953285c00/0x85f51a6b967175ef lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b69ec expref: -99 pid: 46494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051464.692922:0:46494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d953284c00/0x85f51a6b967175f6 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051464.692952:0:46494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d953284c00/0x85f51a6b967175f6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051464.692968:0:46494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d953284c00/0x85f51a6b967175f6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051464.692990:0:46494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d953285800/0x85f51a6b967175fd lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051464.693001:0:46494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d953285800/0x85f51a6b967175fd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051464.693013:0:46494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d953285800/0x85f51a6b967175fd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051464.693118:0:46494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d953285000/0x85f51a6b96717604 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051464.693453:0:46494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d953285000/0x85f51a6b96717604 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051464.693467:0:46494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d953285000/0x85f51a6b96717604 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1777051464.693484:0:46494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:1.0:1777051464.693586:0:46494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d953284c00/0x85f51a6b967175f6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051464.693599:0:46494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d953284c00/0x85f51a6b967175f6 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051464.693609:0:46494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d953284c00/0x85f51a6b967175f6 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051464.693619:0:46494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d953284c00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:1.0:1777051464.693625:0:46494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d953284c00/0x85f51a6b967175f6 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051464.693637:0:46494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d953284c00/0x85f51a6b967175f6 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051464.693655:0:46494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff99d94e5e2500) 00010000:00010000:1.0:1777051464.693660:0:46494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777051464.693667:0:46494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d953284c00/0x85f51a6b967175f6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051464.693677:0:46494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d953284c00/0x85f51a6b967175f6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051464.693696:0:46494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d953285800/0x85f51a6b967175fd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051464.693704:0:46494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d953285800/0x85f51a6b967175fd lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051464.693710:0:46494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d953285800/0x85f51a6b967175fd lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051464.693716:0:46494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d953285800 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:1.0:1777051464.693719:0:46494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d953285800/0x85f51a6b967175fd lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051464.693724:0:46494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d953285800/0x85f51a6b967175fd lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051464.693738:0:46494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff99d94e52a100) 00010000:00010000:1.0:1777051464.693742:0:46494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777051464.693746:0:46494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d953285800/0x85f51a6b967175fd lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051464.693756:0:46494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d953285800/0x85f51a6b967175fd lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051464.694124:0:46494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d953285c00/0x85f51a6b967175ef lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b69ec expref: 33 pid: 46494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051464.694148:0:46494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d953285000/0x85f51a6b96717604 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b69ec expref: 32 pid: 46494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051464.694160:0:46494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99d941e2ea00) 00010000:00010000:1.0:1777051464.694163:0:46494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777051464.694167:0:46494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d953285000, rc 0) 00000100:00100000:1.0:1777051464.694312:0:46494:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da445df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c11b6966-0775-44d2-bdc6-c74c26eb2226+32:139448:x1863365426088576:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 Request processed in 1552us (1790us total) trans 30064771244 rc 0/0 00000100:00100000:1.0:1777051464.694327:0:46494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112366 00000100:00100000:1.0:1777051464.700261:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051464.700402:0:9550:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426088704 00000100:00100000:1.0:1777051464.700407:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051464.700416:0:9550:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426088704 00000100:00100000:2.0:1777051464.700550:0:9550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13740 00000100:00100000:2.0:1777051464.700568:0:9550:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da44494e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+32:2436:x1863365426088704:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1777051464.700595:0:9550:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777051464.700625:0:9550:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d953285000/0x85f51a6b96717604 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b69ec expref: 32 pid: 46494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051464.700649:0:9550:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99d941e2ea00) 00010000:00010000:2.0:1777051464.700656:0:9550:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1777051464.700739:0:9550:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da44494e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+31:2436:x1863365426088704:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 175us (488us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051464.700753:0:9550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13740 00000100:00100000:3.0:1777051464.701500:0:6580:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426088832 00000100:00100000:3.0:1777051464.701508:0:6580:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426088832 00000100:00100000:3.0:1777051464.701563:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112367 00000100:00100000:3.0:1777051464.701577:0:6580:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da44494a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+31:139448:x1863365426088832:12345-192.168.201.46@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1777051464.701695:0:6580:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da44494a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+31:139448:x1863365426088832:12345-192.168.201.46@tcp:59:lhsmtool_posix.0 Request processed in 119us (1291us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051464.701708:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112367 00000100:00100000:1.0:1777051464.705055:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051464.705242:0:27885:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426088960 00000100:00100000:2.0:1777051464.705253:0:27885:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426088960 00000100:00100000:2.0:1777051464.705320:0:27885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112368 00000100:00100000:2.0:1777051464.705334:0:27885:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d960408700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c11b6966-0775-44d2-bdc6-c74c26eb2226+9:139448:x1863365426088960:12345-192.168.201.46@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1777051464.705481:0:27885:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d960408700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c11b6966-0775-44d2-bdc6-c74c26eb2226+9:139448:x1863365426088960:12345-192.168.201.46@tcp:59:lhsmtool_posix.0 Request processed in 148us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051464.705494:0:27885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112368 00000100:00100000:0.0:1777051464.715320:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051464.715454:0:27882:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426089088 00000100:00100000:1.0:1777051464.715468:0:27882:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426089088 00000100:00100000:1.0:1777051464.715560:0:27882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112369 00000100:00100000:1.0:1777051464.715576:0:27882:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da444a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+34:139449:x1863365426089088:12345-192.168.201.46@tcp:101:lfs.0 00010000:00010000:1.0:1777051464.715609:0:27882:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777051464.715637:0:27882:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d953284c00/0x85f51a6b96717612 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b69f3 expref: -99 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051464.715724:0:27882:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d953284400/0x85f51a6b96717619 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051464.715745:0:27882:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d953284400/0x85f51a6b96717619 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051464.715762:0:27882:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d953284400/0x85f51a6b96717619 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1777051464.715816:0:27882:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 12288 00000004:00200000:1.0:1777051464.715822:0:27882:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1777051464.715849:0:27882:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99d953284400/0x85f51a6b96717619 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051464.715883:0:27882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d953284c00/0x85f51a6b96717612 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b69f3 expref: 36 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051464.715910:0:27882:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d953284400/0x85f51a6b96717619 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b69f3 expref: 35 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051464.715923:0:27882:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d9533ab000) 00010000:00010000:1.0:1777051464.715928:0:27882:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1777051464.715935:0:27882:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d953284400, rc 0) 00000100:00100000:1.0:1777051464.716040:0:27882:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da444a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+35:139449:x1863365426089088:12345-192.168.201.46@tcp:101:lfs.0 Request processed in 466us (729us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051464.716053:0:27882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112369 00000100:00100000:1.0:1777051464.722524:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051464.722629:0:46497:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426089216 00000100:00100000:3.0:1777051464.722641:0:46497:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426089216 00000100:00100000:3.0:1777051464.722708:0:46497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112370 00000100:00100000:3.0:1777051464.722722:0:46497:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d960409500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+35:139449:x1863365426089216:12345-192.168.201.46@tcp:101:lfs.0 00010000:00010000:3.0:1777051464.722743:0:46497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777051464.722766:0:46497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e6e6600/0x85f51a6b96717620 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b69fa expref: -99 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051464.722853:0:46497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e6e7200/0x85f51a6b96717627 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051464.722872:0:46497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e6e7200/0x85f51a6b96717627 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051464.722889:0:46497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e6e7200/0x85f51a6b96717627 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051464.722905:0:46497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e6e6000/0x85f51a6b9671762e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x844c7c05 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051464.722917:0:46497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e6e6000/0x85f51a6b9671762e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x844c7c05 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051464.722935:0:46497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e6e6000/0x85f51a6b9671762e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x844c7c05 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051464.723039:0:46497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e6e6400/0x85f51a6b96717635 lrc: 3/1,0 mode: --/PR res: [0x2000032e2:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051464.723054:0:46497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e6e6400/0x85f51a6b96717635 lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0xa:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051464.723066:0:46497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e6e6400/0x85f51a6b96717635 lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0xa:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1777051464.723102:0:46497:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000032e2:0xa:0x0]: returning size 4096 00000004:00200000:3.0:1777051464.723107:0:46497:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1777051464.723131:0:46497:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e6e6400/0x85f51a6b96717635 lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0xa:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051464.723149:0:46497:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e6e7200/0x85f51a6b96717627 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051464.723159:0:46497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e6e7200/0x85f51a6b96717627 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051464.723171:0:46497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e6e7200/0x85f51a6b96717627 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051464.723182:0:46497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e6e7200/0x85f51a6b96717627 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051464.723192:0:46497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94e6e7200 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:3.0:1777051464.723238:0:46497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e6e7200/0x85f51a6b96717627 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051464.723251:0:46497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e6e7200/0x85f51a6b96717627 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051464.723268:0:46497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d9533ab000) 00010000:00010000:3.0:1777051464.723272:0:46497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777051464.723279:0:46497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e6e7200/0x85f51a6b96717627 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051464.723288:0:46497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e6e7200/0x85f51a6b96717627 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051464.723307:0:46497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e6e6000/0x85f51a6b9671762e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x844c7c05 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051464.723317:0:46497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e6e6000/0x85f51a6b9671762e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x844c7c05 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051464.723326:0:46497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e6e6000/0x85f51a6b9671762e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x844c7c05 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051464.723335:0:46497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94e6e6000 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:3.0:1777051464.723339:0:46497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e6e6000/0x85f51a6b9671762e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x844c7c05 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051464.723350:0:46497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e6e6000/0x85f51a6b9671762e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x844c7c05 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051464.723394:0:46497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x844c7c05 (ffff99d9413d2800) 00010000:00010000:3.0:1777051464.723399:0:46497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777051464.723404:0:46497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e6e6000/0x85f51a6b9671762e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x844c7c05 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051464.723420:0:46497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e6e6000/0x85f51a6b9671762e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x844c7c05 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051464.723457:0:46497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e6e6600/0x85f51a6b96717620 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b69fa expref: 37 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051464.723476:0:46497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e6e6400/0x85f51a6b96717635 lrc: 3/0,0 mode: PR/PR res: [0x2000032e2:0xa:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b69fa expref: 36 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051464.723488:0:46497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0xa:0x0].0x0 (ffff99da45fd2700) 00010000:00010000:3.0:1777051464.723492:0:46497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1777051464.723496:0:46497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d94e6e6400, rc 0) 00000100:00100000:3.0:1777051464.723569:0:46497:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d960409500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+36:139449:x1863365426089216:12345-192.168.201.46@tcp:101:lfs.0 Request processed in 849us (1048us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051464.723581:0:46497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112370 00000040:00080000:3.0:1777051464.728779:0:103189:0:(llog.c:801:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:3.0:1777051464.728789:0:103189:0:(llog_cat.c:158:llog_cat_process_common()) processing log [0x1:0x2b:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000100:00100000:1.0:1777051464.728830:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051464.729497:0:6579:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426089344 00000100:00100000:0.0:1777051464.729509:0:6579:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426089344 00000100:00100000:0.0:1777051464.729599:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112371 00000100:00100000:0.0:1777051464.729616:0:6579:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d96040bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+36:139449:x1863365426089344:12345-192.168.201.46@tcp:101:lfs.0 00010000:00010000:0.0:1777051464.729639:0:6579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051464.729661:0:6579:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d775200/0x85f51a6b9671763c lrc: 2/0,0 mode: --/CR res: [0x2000032e2:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6a01 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051464.729741:0:6579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d775600/0x85f51a6b96717643 lrc: 3/1,0 mode: --/CR res: [0x2000032e2:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051464.729764:0:6579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d775600/0x85f51a6b96717643 lrc: 3/1,0 mode: CR/CR res: [0x2000032e2:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051464.729803:0:6579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d775600/0x85f51a6b96717643 lrc: 3/1,0 mode: CR/CR res: [0x2000032e2:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051464.729823:0:6579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d774000/0x85f51a6b9671764a lrc: 3/1,0 mode: --/PR res: [0x2000032e2:0xa:0x0].0x25e40ed5 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051464.729838:0:6579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d774000/0x85f51a6b9671764a lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0xa:0x0].0x25e40ed5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051464.729852:0:6579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d774000/0x85f51a6b9671764a lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0xa:0x0].0x25e40ed5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051464.729921:0:6579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d775c00/0x85f51a6b96717651 lrc: 3/1,0 mode: --/PR res: [0x2000032e3:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051464.729936:0:6579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d775c00/0x85f51a6b96717651 lrc: 3/1,0 mode: PR/PR res: [0x2000032e3:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051464.729949:0:6579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d775c00/0x85f51a6b96717651 lrc: 3/1,0 mode: PR/PR res: [0x2000032e3:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1777051464.729994:0:6579:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000032e3:0xb:0x0]: returning size 0 00000004:00200000:0.0:1777051464.730000:0:6579:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1777051464.730024:0:6579:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d775c00/0x85f51a6b96717651 lrc: 3/1,0 mode: PR/PR res: [0x2000032e3:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051464.730051:0:6579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d775c00/0x85f51a6b96717651 lrc: 3/1,0 mode: PR/PR res: [0x2000032e3:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051464.730432:0:6579:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d775600/0x85f51a6b96717643 lrc: 4/1,0 mode: CR/CR res: [0x2000032e2:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051464.730447:0:6579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d775600/0x85f51a6b96717643 lrc: 4/1,0 mode: CR/CR res: [0x2000032e2:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1777051464.730460:0:103189:0:(llog.c:858:llog_process_thread()) stop processing plain [0x1:0x2b:0x0] index 64768 count 8 00010000:00010000:0.0:1777051464.730462:0:6579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d775600/0x85f51a6b96717643 lrc: 3/0,0 mode: CR/CR res: [0x2000032e2:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051464.730473:0:6579:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d775600/0x85f51a6b96717643 lrc: 4/0,0 mode: CR/CR res: [0x2000032e2:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1777051464.730474:0:103189:0:(llog.c:858:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00010000:00010000:0.0:1777051464.730484:0:6579:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da7d775600 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:0.0:1777051464.730491:0:6579:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d775600/0x85f51a6b96717643 lrc: 4/0,0 mode: CR/CR res: [0x2000032e2:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051464.730502:0:6579:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d775600/0x85f51a6b96717643 lrc: 5/0,0 mode: CR/CR res: [0x2000032e2:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051464.730520:0:6579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0xa:0x0].0x0 (ffff99da45fd2700) 00010000:00010000:0.0:1777051464.730525:0:6579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777051464.730532:0:6579:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d775600/0x85f51a6b96717643 lrc: 3/0,0 mode: --/CR res: [0x2000032e2:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051464.730543:0:6579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d775600/0x85f51a6b96717643 lrc: 0/0,0 mode: --/CR res: [0x2000032e2:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051464.730562:0:6579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d774000/0x85f51a6b9671764a lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0xa:0x0].0x25e40ed5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051464.730575:0:6579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d774000/0x85f51a6b9671764a lrc: 2/0,0 mode: PR/PR res: [0x2000032e2:0xa:0x0].0x25e40ed5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051464.730587:0:6579:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d774000/0x85f51a6b9671764a lrc: 3/0,0 mode: PR/PR res: [0x2000032e2:0xa:0x0].0x25e40ed5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051464.730597:0:6579:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da7d774000 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:0.0:1777051464.730602:0:6579:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d774000/0x85f51a6b9671764a lrc: 3/0,0 mode: PR/PR res: [0x2000032e2:0xa:0x0].0x25e40ed5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051464.730614:0:6579:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d774000/0x85f51a6b9671764a lrc: 4/0,0 mode: PR/PR res: [0x2000032e2:0xa:0x0].0x25e40ed5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051464.730628:0:6579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0xa:0x0].0x25e40ed5 (ffff99da61538600) 00010000:00010000:0.0:1777051464.730633:0:6579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777051464.730638:0:6579:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d774000/0x85f51a6b9671764a lrc: 2/0,0 mode: --/PR res: [0x2000032e2:0xa:0x0].0x25e40ed5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051464.730650:0:6579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d774000/0x85f51a6b9671764a lrc: 0/0,0 mode: --/PR res: [0x2000032e2:0xa:0x0].0x25e40ed5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051464.730695:0:6579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d775200/0x85f51a6b9671763c lrc: 0/0,0 mode: --/CR res: [0x2000032e2:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6a01 expref: 38 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051464.730719:0:6579:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d775c00/0x85f51a6b96717651 lrc: 3/0,0 mode: PR/PR res: [0x2000032e3:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6a01 expref: 37 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051464.730733:0:6579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e3:0xb:0x0].0x0 (ffff99da61538f00) 00010000:00010000:0.0:1777051464.730737:0:6579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1777051464.730743:0:6579:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99da7d775c00, rc 0) 00000100:00100000:0.0:1777051464.730828:0:6579:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d96040bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+37:139449:x1863365426089344:12345-192.168.201.46@tcp:101:lfs.0 Request processed in 1213us (2002us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051464.730843:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112371 00000100:00100000:0.0:1777051464.736427:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051464.736542:0:27887:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426089472 00000100:00100000:1.0:1777051464.736554:0:27887:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426089472 00000100:00100000:1.0:1777051464.736659:0:27887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 8092 00000100:00100000:1.0:1777051464.736678:0:27887:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+53:2438:x1863365426089472:12345-192.168.201.46@tcp:101:lfs.0 00010000:00010000:1.0:1777051464.736699:0:27887:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777051464.736726:0:27887:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002603dab2/0x85f51a6b96717658 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x1e6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6a08 expref: -99 pid: 27887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1777051464.736766:0:27887:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x1e6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777051464.736792:0:27887:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051464.736796:0:27887:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051464.736811:0:27887:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002603dab2/0x85f51a6b96717658 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x1e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6a08 expref: 54 pid: 27887 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051464.736842:0:27887:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002603dab2/0x85f51a6b96717658 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x1e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6a08 expref: 54 pid: 27887 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051464.736867:0:27887:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d953284800, rc 0) 00000100:00080000:0.0:1777051464.736879:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1777051464.736939:0:27887:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+54:2438:x1863365426089472:12345-192.168.201.46@tcp:101:lfs.0 Request processed in 266us (519us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051464.736948:0:27887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 8092 00000100:00100000:1.0:1777051464.746013:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051464.746568:0:6580:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426089600 00000100:00100000:3.0:1777051464.746580:0:6580:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426089600 00000100:00100000:3.0:1777051464.746664:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112372 00000100:00100000:3.0:1777051464.746681:0:6580:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d960409880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+37:139449:x1863365426089600:12345-192.168.201.46@tcp:101:lfs.0 00010000:00010000:3.0:1777051464.746707:0:6580:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777051464.747035:0:6580:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e6e6200/0x85f51a6b9671765f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6a0f expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051464.747148:0:6580:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e6e6600/0x85f51a6b96717666 lrc: 3/1,0 mode: --/PR res: [0x2000032e2:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051464.747171:0:6580:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e6e6600/0x85f51a6b96717666 lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051464.747189:0:6580:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e6e6600/0x85f51a6b96717666 lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1777051464.747326:0:6580:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000032e2:0xa:0x0]: returning size 4096 00000004:00200000:3.0:1777051464.747333:0:6580:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1777051464.747388:0:6580:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e6e6600/0x85f51a6b96717666 lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051464.747433:0:6580:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e6e6200/0x85f51a6b9671765f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6a0f expref: 39 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051464.747464:0:6580:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e6e6600/0x85f51a6b96717666 lrc: 3/0,0 mode: PR/PR res: [0x2000032e2:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6a0f expref: 38 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051464.747479:0:6580:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0xa:0x0].0x0 (ffff99da45fd2700) 00010000:00010000:3.0:1777051464.747485:0:6580:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1777051464.747490:0:6580:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d94e6e6600, rc 0) 00000100:00100000:3.0:1777051464.747571:0:6580:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d960409880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+38:139449:x1863365426089600:12345-192.168.201.46@tcp:101:lfs.0 Request processed in 891us (1563us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051464.747585:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112372 00000100:00100000:3.0:1777051464.757875:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051464.758039:0:10328:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426089856 00000100:00100000:0.0:1777051464.758456:0:10328:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426089856 00000100:00100000:0.0:1777051464.758565:0:10328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112373 00000100:00100000:0.0:1777051464.758584:0:10328:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d943d93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+38:139449:x1863365426089856:12345-192.168.201.46@tcp:58:lfs.0 00000040:00080000:0.0:1777051464.758829:0:10328:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2b:0x0].10, 136 off9552 00000100:00100000:0.0:1777051464.758959:0:10328:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d943d93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+38:139449:x1863365426089856:12345-192.168.201.46@tcp:58:lfs.0 Request processed in 376us (1092us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051464.758975:0:10328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112373 00010000:00010000:2.0:1777051464.790651:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1777051464.984431:0:3680:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1777051464.984534:0:3679:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1777051464.984581:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d960408e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452686976:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1777051464.984763:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051464.985425:0:8473:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452686976 00000100:00100000:1.0:1777051464.985440:0:8473:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452686976 00000100:00100000:1.0:1777051464.985578:0:8473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5688 00000100:00100000:1.0:1777051464.985594:0:8473:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d960408a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3679:x1863365452686976:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1777051464.985662:0:8473:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 489209408 pending 0 free 3642707968 avail 3411185664 00000100:00100000:1.0:1777051464.985758:0:8473:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d960408a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3679:x1863365452686976:12345-0@lo:13:osp-pre-1-0.0 Request processed in 167us (996us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051464.985772:0:8473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5688 00000100:00100000:0.0:1777051464.986530:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f9fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3680:1863365452686848:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1777051464.986645:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051464.986732:0:10113:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452686848 00000100:00100000:0.0:1777051464.986740:0:10113:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452686848 00000100:00100000:0.0:1777051464.987561:0:10113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5689 00000100:00100000:0.0:1777051464.987592:0:10113:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d944e10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3680:x1863365452686848:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1777051464.987635:0:10113:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 499269184 pending 0 free 3860574208 avail 3629051904 00000100:00100000:0.0:1777051464.987725:0:10113:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d944e10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3680:x1863365452686848:12345-0@lo:13:osp-pre-0-0.0 Request processed in 149us (1079us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051464.987738:0:10113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5689 00000100:00080000:0.0:1777051464.987802:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1777051464.987809:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1777051464.987879:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f9fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3680:1863365452686848:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1777051464.989471:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d960408e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452686976:0@lo:13:osp-pre-1-0.0 00000040:00080000:1.0:1777051465.626702:0:104226:0:(llog.c:801:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1777051465.626714:0:104226:0:(llog_cat.c:158:llog_cat_process_common()) processing log [0x1:0x12:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1777051465.627878:0:104226:0:(llog.c:858:llog_process_thread()) stop processing plain [0x1:0x12:0x0] index 64768 count 9 00000040:00080000:1.0:1777051465.627893:0:104226:0:(llog.c:858:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000040:00080000:1.0:1777051465.641097:0:108503:0:(llog.c:801:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:1.0:1777051465.641108:0:108503:0:(llog_cat.c:158:llog_cat_process_common()) processing log [0x1:0x2b:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1777051465.641188:0:108503:0:(llog.c:858:llog_process_thread()) stop processing plain [0x1:0x2b:0x0] index 11 count 9 00000040:00080000:1.0:1777051465.641339:0:108503:0:(llog.c:858:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00000040:00080000:3.0:1777051465.750531:0:103189:0:(llog.c:801:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:3.0:1777051465.750544:0:103189:0:(llog_cat.c:158:llog_cat_process_common()) processing log [0x1:0x2b:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1777051465.750596:0:103189:0:(llog.c:858:llog_process_thread()) stop processing plain [0x1:0x2b:0x0] index 11 count 9 00000040:00080000:3.0:1777051465.750611:0:103189:0:(llog.c:858:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00000100:00100000:3.0:1777051465.751651:0:103189:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7fd67100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:103189:1863365452687104:192.168.201.46@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1777051465.752472:0:103189:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d95875d0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1777051465.760338:0:103189:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7fd67100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:103189:1863365452687104:192.168.201.46@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1777051465.761318:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051465.761876:0:27882:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426089984 00000100:00100000:0.0:1777051465.761891:0:27882:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426089984 00000100:00100000:0.0:1777051465.762016:0:27882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112374 00000100:00100000:0.0:1777051465.762036:0:27882:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d960408e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+31:139461:x1863365426089984:12345-192.168.201.46@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1777051465.762076:0:27882:0:(mdt_handler.c:7958:mdt_fid2path()) path get [0x2000032e3:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1777051465.763117:0:27882:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d960408e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+31:139461:x1863365426089984:12345-192.168.201.46@tcp:53:lhsmtool_posix.0 Request processed in 1060us (1785us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051465.763138:0:27882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112374 00000100:00100000:3.0:1777051465.772598:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051465.773071:0:6581:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426090240 00000100:00100000:2.0:1777051465.773087:0:6581:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426090240 00000100:00100000:2.0:1777051465.773187:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112375 00000100:00100000:2.0:1777051465.773209:0:6581:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fd67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+31:139461:x1863365426090240:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1777051465.773241:0:6581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051465.773331:0:6581:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d950711400/0x85f51a6b9671766d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6a16 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051465.773861:0:6581:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710200/0x85f51a6b96717674 lrc: 3/1,0 mode: --/PR res: [0x2000032e3:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051465.773889:0:6581:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710200/0x85f51a6b96717674 lrc: 3/1,0 mode: PR/PR res: [0x2000032e3:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051465.773913:0:6581:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710200/0x85f51a6b96717674 lrc: 3/1,0 mode: PR/PR res: [0x2000032e3:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1777051465.773933:0:6581:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000032e3:0xb:0x0]: returning size 0 00010000:00010000:2.0:1777051465.774107:0:6581:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d950711400/0x85f51a6b9671766d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6a16 expref: 34 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051465.774146:0:6581:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710200/0x85f51a6b96717674 lrc: 3/0,0 mode: PR/PR res: [0x2000032e3:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6a16 expref: 33 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051465.774164:0:6581:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e3:0xb:0x0].0x0 (ffff99da61538f00) 00010000:00010000:2.0:1777051465.774170:0:6581:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1777051465.774177:0:6581:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d950710200, rc 0) 00000100:00100000:2.0:1777051465.774659:0:6581:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fd67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+33:139461:x1863365426090240:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 Request processed in 1454us (2068us total) trans 30064771245 rc 0/0 00000100:00100000:2.0:1777051465.774677:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112375 00000100:00100000:2.0:1777051465.784081:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051465.784172:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051465.784241:0:8468:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426090368 00000100:00100000:3.0:1777051465.784254:0:8468:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426090368 00000100:00100000:2.0:1777051465.784270:0:6565:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426090496 00000100:00100000:2.0:1777051465.784282:0:6565:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426090496 00000100:00100000:3.0:1777051465.784408:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 8093 00000100:00100000:2.0:1777051465.784410:0:6565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13741 00000100:00100000:3.0:1777051465.784436:0:8468:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f865180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+51:2437:x1863365426090368:12345-192.168.201.46@tcp:1:lhsmtool_posix.0 00000100:00100000:2.0:1777051465.784440:0:6565:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f866a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+33:2438:x1863365426090496:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1777051465.784472:0:6565:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777051465.784500:0:8468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000afddbb8b/0x85f51a6b96717682 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x1e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051465.784510:0:6565:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710200/0x85f51a6b96717674 lrc: 0/0,0 mode: --/PR res: [0x2000032e3:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6a16 expref: 33 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051465.784547:0:8468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051465.784553:0:8468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777051465.784556:0:6565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e3:0xb:0x0].0x0 (ffff99da61538f00) 00010000:00010000:3.0:1777051465.784562:0:8468:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000afddbb8b/0x85f51a6b96717682 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x1e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051465.784567:0:6565:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1777051465.784596:0:8468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afddbb8b/0x85f51a6b96717682 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x1e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051465.784634:0:8468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000afddbb8b/0x85f51a6b96717682 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x1e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051465.784650:0:8468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000afddbb8b/0x85f51a6b96717682 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x1e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051465.784663:0:6565:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f866a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+32:2438:x1863365426090496:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 231us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051465.784684:0:6565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13741 00010000:00010000:3.0:1777051465.784739:0:8468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000afddbb8b/0x85f51a6b96717682 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x1e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051465.784752:0:8468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94e6e6000 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:3.0:1777051465.784760:0:8468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000afddbb8b/0x85f51a6b96717682 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x1e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1777051465.784886:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1777051465.784983:0:8468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000afddbb8b/0x85f51a6b96717682 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x1e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051465.785010:0:8468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000afddbb8b/0x85f51a6b96717682 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x1e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051465.785026:0:8468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afddbb8b/0x85f51a6b96717682 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x1e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051465.785101:0:8468:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f865180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+51:2437:x1863365426090368:12345-192.168.201.46@tcp:1:lhsmtool_posix.0 Request processed in 673us (1030us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051465.785116:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 8093 00000100:00100000:1.0:1777051465.790888:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051465.791006:0:6579:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426090752 00000100:00100000:0.0:1777051465.791017:0:6579:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426090752 00000100:00100000:0.0:1777051465.791422:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112376 00000100:00100000:0.0:1777051465.791464:0:6579:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d96040a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+32:139461:x1863365426090752:12345-192.168.201.46@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1777051465.791661:0:6579:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d96040a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+32:139461:x1863365426090752:12345-192.168.201.46@tcp:57:lhsmtool_posix.0 Request processed in 223us (776us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051465.791675:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112376 00000100:00100000:3.0:1777051465.798561:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051465.798670:0:13320:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426090880 00000100:00100000:0.0:1777051465.798683:0:13320:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426090880 00000100:00100000:0.0:1777051465.798765:0:13320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 8094 00000100:00100000:0.0:1777051465.798782:0:13320:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fd64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+51:2436:x1863365426090880:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1777051465.799174:0:13320:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051465.799202:0:13320:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000033174453/0x85f51a6b96717689 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x1e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6a1d expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051465.799244:0:13320:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777051465.799250:0:13320:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777051465.799266:0:13320:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000033174453/0x85f51a6b96717689 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x1e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6a1d expref: 52 pid: 13320 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051465.799296:0:13320:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000033174453/0x85f51a6b96717689 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x1e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6a1d expref: 52 pid: 13320 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051465.799322:0:13320:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99da7d774c00, rc 0) 00000100:00100000:0.0:1777051465.799458:0:13320:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fd64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+52:2436:x1863365426090880:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 Request processed in 677us (901us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051465.799474:0:13320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 8094 00000100:00100000:1.0:1777051465.810530:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051465.810649:0:21368:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426091136 00000100:00100000:0.0:1777051465.810666:0:21368:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426091136 00000100:00100000:3.0:1777051465.811911:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112377 00000100:00100000:3.0:1777051465.811956:0:6580:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d96040b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+32:139461:x1863365426091136:12345-192.168.201.46@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1777051465.812594:0:6580:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d96040b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+32:139461:x1863365426091136:12345-192.168.201.46@tcp:57:lhsmtool_posix.0 Request processed in 660us (2071us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051465.812621:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112377 00010000:00010000:1.0:1777051465.816550:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1777051465.824853:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051465.824950:0:27885:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426091264 00000100:00100000:3.0:1777051465.824966:0:27885:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426091264 00000100:00100000:3.0:1777051465.825078:0:27885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112378 00000100:00100000:3.0:1777051465.825102:0:27885:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d96040ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c11b6966-0775-44d2-bdc6-c74c26eb2226+32:139461:x1863365426091264:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1777051465.825133:0:27885:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777051465.825555:0:27885:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e6e6200/0x85f51a6b96717690 lrc: 2/0,0 mode: --/PR res: [0x2000032e3:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6a24 expref: -99 pid: 27885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051465.825623:0:27885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e6e7200/0x85f51a6b96717697 lrc: 3/1,0 mode: --/PR res: [0x2000032e3:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051465.825648:0:27885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e6e7200/0x85f51a6b96717697 lrc: 3/1,0 mode: PR/PR res: [0x2000032e3:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051465.825670:0:27885:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e6e7200/0x85f51a6b96717697 lrc: 3/1,0 mode: PR/PR res: [0x2000032e3:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051465.825849:0:27885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e6e6200/0x85f51a6b96717690 lrc: 0/0,0 mode: --/PR res: [0x2000032e3:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6a24 expref: 34 pid: 27885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051465.825882:0:27885:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e6e7200/0x85f51a6b96717697 lrc: 3/0,0 mode: PR/PR res: [0x2000032e3:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6a24 expref: 33 pid: 27885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051465.825900:0:27885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e3:0xb:0x0].0x0 (ffff99da61538f00) 00010000:00010000:3.0:1777051465.825906:0:27885:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1777051465.825912:0:27885:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d94e6e7200, rc 0) 00000100:00100000:3.0:1777051465.826398:0:27885:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d96040ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c11b6966-0775-44d2-bdc6-c74c26eb2226+33:139461:x1863365426091264:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 Request processed in 1298us (1545us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051465.827669:0:27885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112378 00000100:00100000:0.0:1777051465.838191:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051465.838316:0:8492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426091392 00000100:00100000:1.0:1777051465.838331:0:8492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426091392 00000100:00100000:1.0:1777051465.838451:0:8492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112379 00000100:00100000:1.0:1777051465.838470:0:8492:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d944e10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+33:139461:x1863365426091392:12345-192.168.201.46@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1777051465.838570:0:8492:0:(mdt_handler.c:7958:mdt_fid2path()) path get [0x2000032e3:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1777051465.838750:0:8492:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d944e10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+33:139461:x1863365426091392:12345-192.168.201.46@tcp:53:lhsmtool_posix.0 Request processed in 282us (567us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051465.838766:0:8492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112379 00000100:00100000:1.0:1777051465.853010:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051465.853141:0:55805:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426091520 00000100:00100000:3.0:1777051465.853156:0:55805:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426091520 00000100:00100000:3.0:1777051465.853937:0:55805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 8095 00000100:00100000:3.0:1777051465.853957:0:55805:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da57c82c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c11b6966-0775-44d2-bdc6-c74c26eb2226+52:2437:x1863365426091520:12345-192.168.201.46@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1777051465.854021:0:55805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000376b45d6/0x85f51a6b9671769e lrc: 3/1,0 mode: --/PR res: [0x280000401:0x1e6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051465.854052:0:55805:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051465.854057:0:55805:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051465.854066:0:55805:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000376b45d6/0x85f51a6b9671769e lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x1e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 55805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051465.854092:0:55805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000376b45d6/0x85f51a6b9671769e lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x1e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 55805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051465.854132:0:55805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000376b45d6/0x85f51a6b9671769e lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x1e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 55805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051465.854165:0:55805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000376b45d6/0x85f51a6b9671769e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x1e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 55805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051465.854183:0:55805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000376b45d6/0x85f51a6b9671769e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x1e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 55805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051465.854230:0:55805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94e6e6200 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:3.0:1777051465.854241:0:55805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000376b45d6/0x85f51a6b9671769e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x1e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 55805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051465.854259:0:55805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000376b45d6/0x85f51a6b9671769e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x1e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 55805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051465.854285:0:55805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000376b45d6/0x85f51a6b9671769e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x1e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 55805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051465.854302:0:55805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000376b45d6/0x85f51a6b9671769e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x1e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 55805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051465.854448:0:55805:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da57c82c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c11b6966-0775-44d2-bdc6-c74c26eb2226+52:2437:x1863365426091520:12345-192.168.201.46@tcp:1:lhsmtool_posix.0 Request processed in 493us (1444us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051465.854487:0:55805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 8095 00000100:00100000:1.0:1777051465.862983:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051465.863769:0:46497:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426091776 00000100:00100000:3.0:1777051465.863783:0:46497:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426091776 00000100:00100000:3.0:1777051465.863932:0:46497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112380 00000100:00100000:3.0:1777051465.863951:0:46497:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d96040b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:c11b6966-0775-44d2-bdc6-c74c26eb2226+33:139461:x1863365426091776:12345-192.168.201.46@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1777051465.864053:0:46497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e6e6000/0x85f51a6b967176a5 lrc: 3/0,1 mode: --/PW res: [0x2000032e3:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051465.864082:0:46497:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e6e7200/0x85f51a6b96717697 lrc: 2/0,0 mode: PR/PR res: [0x2000032e3:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6a24 expref: 33 pid: 27885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051465.864099:0:46497:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e6e6000/0x85f51a6b967176a5 lrc: 4/0,1 mode: --/PW res: [0x2000032e3:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051465.864162:0:46497:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e6e7200/0x85f51a6b96717697 lrc: 3/0,0 mode: PR/PR res: [0x2000032e3:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6a24 expref: 33 pid: 27885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051465.864190:0:46497:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e6e7200/0x85f51a6b96717697 lrc: 4/0,0 mode: PR/PR res: [0x2000032e3:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6a24 expref: 33 pid: 27885 timeout: 8195 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051465.864634:0:46497:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7fd64000 pname:cluuid:pid:xid:nid:opc:job mdt00_009:lustre-MDT0000_UUID:46497:1863365452687232:192.168.201.46@tcp:104: 00000100:00100000:2.0:1777051465.864866:0:46497:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d95875d0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1777051465.870187:0:46497:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7fd64000 pname:cluuid:pid:xid:nid:opc:job mdt00_009:lustre-MDT0000_UUID:46497:1863365452687232:192.168.201.46@tcp:104: 00010000:00010000:2.0:1777051465.870261:0:46497:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e6e6000/0x85f51a6b967176a5 lrc: 3/0,1 mode: --/PW res: [0x2000032e3:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051465.872166:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051465.872422:0:6564:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426091904 00000100:00100000:0.0:1777051465.872441:0:6564:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426091904 00010000:00010000:0.0:1777051465.872487:0:6564:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e6e7200/0x85f51a6b96717697 lrc: 4/0,0 mode: PR/PR res: [0x2000032e3:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6a24 expref: 34 pid: 27885 timeout: 8195 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051465.872550:0:6564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3968 00000100:00100000:0.0:1777051465.872566:0:6564:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d960409f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+34:2436:x1863365426091904:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1777051465.872589:0:6564:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777051465.872602:0:6564:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e6e7200/0x85f51a6b96717697 lrc: 4/0,0 mode: PR/PR res: [0x2000032e3:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6a24 expref: 34 pid: 27885 timeout: 8195 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051465.872628:0:6564:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e6e7200/0x85f51a6b96717697 lrc: 3/0,0 mode: PR/PR res: [0x2000032e3:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6a24 expref: 34 pid: 27885 timeout: 8195 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051465.872670:0:6564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e6e7200/0x85f51a6b96717697 lrc: 0/0,0 mode: --/PR res: [0x2000032e3:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6a24 expref: 34 pid: 27885 timeout: 8195 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051465.872694:0:6564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e3:0xb:0x0].0x0 (ffff99da61538f00) 00010000:00010000:0.0:1777051465.872701:0:6564:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e6e6000/0x85f51a6b967176a5 lrc: 3/0,1 mode: --/PW res: [0x2000032e3:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051465.872717:0:6564:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e6e6000/0x85f51a6b967176a5 lrc: 3/0,1 mode: PW/PW res: [0x2000032e3:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051465.872730:0:6564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e6e6000/0x85f51a6b967176a5 lrc: 4/0,1 mode: PW/PW res: [0x2000032e3:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051465.872780:0:6564:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1777051465.872867:0:46497:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e6e6000/0x85f51a6b967176a5 lrc: 3/0,1 mode: PW/PW res: [0x2000032e3:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051465.872887:0:46497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e6e6000/0x85f51a6b967176a5 lrc: 3/0,1 mode: PW/PW res: [0x2000032e3:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051465.873123:0:46497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e6e6000/0x85f51a6b967176a5 lrc: 3/0,1 mode: PW/PW res: [0x2000032e3:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051465.873141:0:6564:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d960409f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+34:2436:x1863365426091904:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 571us (972us total) trans 0 rc 0/0 00010000:00010000:2.0:1777051465.873146:0:46497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e6e6000/0x85f51a6b967176a5 lrc: 2/0,0 mode: PW/PW res: [0x2000032e3:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051465.873172:0:6564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3968 00010000:00010000:2.0:1777051465.873177:0:46497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e6e6000/0x85f51a6b967176a5 lrc: 3/0,0 mode: PW/PW res: [0x2000032e3:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051465.873191:0:46497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94e6e6000 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:2.0:1777051465.873241:0:46497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e6e6000/0x85f51a6b967176a5 lrc: 3/0,0 mode: PW/PW res: [0x2000032e3:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051465.873266:0:46497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e6e6000/0x85f51a6b967176a5 lrc: 4/0,0 mode: PW/PW res: [0x2000032e3:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051465.873290:0:46497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e3:0xb:0x0].0x0 (ffff99da61538f00) 00010000:00010000:2.0:1777051465.873297:0:46497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1777051465.873305:0:46497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e6e6000/0x85f51a6b967176a5 lrc: 2/0,0 mode: --/PW res: [0x2000032e3:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051465.873317:0:46497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e6e6000/0x85f51a6b967176a5 lrc: 0/0,0 mode: --/PW res: [0x2000032e3:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051465.873553:0:46497:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d96040b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:c11b6966-0775-44d2-bdc6-c74c26eb2226+33:139461:x1863365426091776:12345-192.168.201.46@tcp:57:lhsmtool_posix.0 Request processed in 9603us (10576us total) trans 30064771246 rc 0/0 00000100:00100000:2.0:1777051465.873570:0:46497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112380 00000040:00080000:3.0:1777051465.873643:0:103189:0:(llog.c:801:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:3.0:1777051465.873653:0:103189:0:(llog_cat.c:158:llog_cat_process_common()) processing log [0x1:0x2b:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1777051465.875698:0:103189:0:(llog.c:858:llog_process_thread()) stop processing plain [0x1:0x2b:0x0] index 64768 count 9 00000040:00080000:3.0:1777051465.875716:0:103189:0:(llog.c:858:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00000100:00100000:3.0:1777051465.880664:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051465.881159:0:6582:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426092160 00000100:00100000:1.0:1777051465.881170:0:6582:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426092160 00000100:00100000:1.0:1777051465.881283:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3427 00000100:00100000:1.0:1777051465.881297:0:6582:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fd64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+33:139461:x1863365426092160:12345-192.168.201.46@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1777051465.881668:0:6582:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fd64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+34:139461:x1863365426092160:12345-192.168.201.46@tcp:35:lhsmtool_posix.0 Request processed in 371us (1010us total) trans 30064771247 rc 0/0 00000100:00100000:1.0:1777051465.881684:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3427 00000001:00080000:1.0:1777051466.523506:0:103159:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771247 is committed 00000001:00080000:1.0:1777051466.523560:0:103159:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771241 is committed 00010000:00010000:0.0:1777051466.523968:0:3663:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d774200/0x85f51a6b967175be lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e2:0xa:0x0].0x25e40ed5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051466.523990:0:3663:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d774200/0x85f51a6b967175be lrc: 2/0,0 mode: TXN/TXN res: [0x2000032e2:0xa:0x0].0x25e40ed5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051466.524002:0:3663:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d774200/0x85f51a6b967175be lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e2:0xa:0x0].0x25e40ed5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051466.524012:0:3663:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da7d774200 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:0.0:1777051466.524019:0:3663:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d774200/0x85f51a6b967175be lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e2:0xa:0x0].0x25e40ed5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051466.524039:0:3663:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d774200/0x85f51a6b967175be lrc: 4/0,0 mode: TXN/TXN res: [0x2000032e2:0xa:0x0].0x25e40ed5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051466.524060:0:3663:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0xa:0x0].0x25e40ed5 (ffff99da61538600) 00010000:00010000:0.0:1777051466.524065:0:3663:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777051466.524073:0:3663:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d774200/0x85f51a6b967175be lrc: 2/0,0 mode: --/TXN res: [0x2000032e2:0xa:0x0].0x25e40ed5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051466.524083:0:3663:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d774200/0x85f51a6b967175be lrc: 0/0,0 mode: --/TXN res: [0x2000032e2:0xa:0x0].0x25e40ed5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051466.524252:0:3664:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e6e7800/0x85f51a6b96717563 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x844c7c05 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051466.524267:0:3664:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e6e7800/0x85f51a6b96717563 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x844c7c05 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051466.524277:0:3664:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e6e7800/0x85f51a6b96717563 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x844c7c05 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051466.524286:0:3664:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94e6e7800 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:2.0:1777051466.524291:0:3664:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e6e7800/0x85f51a6b96717563 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x844c7c05 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051466.524301:0:3664:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e6e7800/0x85f51a6b96717563 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x844c7c05 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051466.524323:0:3664:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x844c7c05 (ffff99d9413d2800) 00010000:00010000:2.0:1777051466.524351:0:3664:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777051466.524357:0:3664:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e6e7800/0x85f51a6b96717563 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x844c7c05 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051466.524367:0:3664:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e6e7800/0x85f51a6b96717563 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x844c7c05 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051466.524392:0:3664:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710a00/0x85f51a6b9671756a lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e2:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051466.524403:0:3664:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710a00/0x85f51a6b9671756a lrc: 2/0,0 mode: TXN/TXN res: [0x2000032e2:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051466.524413:0:3664:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710a00/0x85f51a6b9671756a lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e2:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051466.524422:0:3664:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d950710a00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:2.0:1777051466.524427:0:3664:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710a00/0x85f51a6b9671756a lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e2:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051466.524437:0:3664:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710a00/0x85f51a6b9671756a lrc: 4/0,0 mode: TXN/TXN res: [0x2000032e2:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051466.524449:0:3664:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0xa:0x0].0x0 (ffff99da45fd2700) 00010000:00010000:2.0:1777051466.524453:0:3664:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777051466.524458:0:3664:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710a00/0x85f51a6b9671756a lrc: 2/0,0 mode: --/TXN res: [0x2000032e2:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051466.524467:0:3664:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710a00/0x85f51a6b9671756a lrc: 0/0,0 mode: --/TXN res: [0x2000032e2:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051466.838399:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1777051467.406183:0:108554:0:(llog.c:801:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:2.0:1777051467.406243:0:108554:0:(llog_cat.c:158:llog_cat_process_common()) processing log [0x1:0x2b:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1777051467.406359:0:108554:0:(llog.c:858:llog_process_thread()) stop processing plain [0x1:0x2b:0x0] index 11 count 9 00000040:00080000:2.0:1777051467.406373:0:108554:0:(llog.c:858:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00000100:00100000:1.0:1777051467.457757:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051467.457852:0:46494:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426092416 00000100:00100000:2.0:1777051467.457868:0:46494:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426092416 00000100:00080000:1.0:1777051467.457994:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1777051467.458032:0:46494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112381 00000100:00100000:2.0:1777051467.458051:0:46494:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d96040a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+36:139469:x1863365426092416:12345-192.168.201.46@tcp:101:lfs.0 00010000:00010000:2.0:1777051467.458079:0:46494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051467.458109:0:46494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710a00/0x85f51a6b967176ac lrc: 2/0,0 mode: --/CR res: [0x2000032e3:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6a2b expref: -99 pid: 46494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051467.458262:0:46494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950711a00/0x85f51a6b967176b3 lrc: 3/0,1 mode: --/PW res: [0x2000032e3:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051467.458287:0:46494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d950711a00/0x85f51a6b967176b3 lrc: 3/0,1 mode: PW/PW res: [0x2000032e3:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051467.458308:0:46494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d950711a00/0x85f51a6b967176b3 lrc: 3/0,1 mode: PW/PW res: [0x2000032e3:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1777051467.458364:0:46494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000032e3:0xb:0x0]: returning size 0 00010000:00010000:2.0:1777051467.458547:0:46494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710a00/0x85f51a6b967176ac lrc: 0/0,0 mode: --/CR res: [0x2000032e3:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6a2b expref: 39 pid: 46494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051467.458576:0:46494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950711a00/0x85f51a6b967176b3 lrc: 3/0,0 mode: PW/PW res: [0x2000032e3:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6a2b expref: 38 pid: 46494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051467.458636:0:46494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e3:0xb:0x0].0x0 (ffff99da61538f00) 00010000:00010000:2.0:1777051467.458642:0:46494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1777051467.458649:0:46494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d950711a00, rc 0) 00000100:00100000:2.0:1777051467.458741:0:46494:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d96040a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+38:139469:x1863365426092416:12345-192.168.201.46@tcp:101:lfs.0 Request processed in 695us (995us total) trans 30064771248 rc 0/0 00000100:00100000:2.0:1777051467.458750:0:46494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112381 00000100:00100000:0.0:1777051467.464434:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051467.464512:0:8470:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426092544 00000100:00100000:2.0:1777051467.464525:0:8470:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426092544 00000100:00080000:0.0:1777051467.464660:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1777051467.464663:0:8470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 8096 00000100:00100000:2.0:1777051467.464687:0:8470:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+54:2437:x1863365426092544:12345-192.168.201.46@tcp:1:lfs.0 00010000:00010000:2.0:1777051467.464744:0:8470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f4c15b18/0x85f51a6b967176c1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1e6:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051467.465088:0:8470:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002603dab2/0x85f51a6b96717658 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x1e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6a08 expref: 54 pid: 27887 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051467.465108:0:8470:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000033174453/0x85f51a6b96717689 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x1e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6a1d expref: 51 pid: 13320 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051467.465123:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777051467.465127:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777051467.465134:0:8470:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f4c15b18/0x85f51a6b967176c1 lrc: 5/0,1 mode: --/PW res: [0x280000401:0x1e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051467.465191:0:8470:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000033174453/0x85f51a6b96717689 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x1e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6a1d expref: 51 pid: 13320 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051467.465404:0:8470:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000033174453/0x85f51a6b96717689 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x1e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6a1d expref: 51 pid: 13320 timeout: 8196 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051467.465432:0:8470:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95f864a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8470:1863365452687360:192.168.201.46@tcp:104: 00010000:00010000:2.0:1777051467.465578:0:8470:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002603dab2/0x85f51a6b96717658 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x1e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6a08 expref: 54 pid: 27887 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051467.465598:0:8470:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002603dab2/0x85f51a6b96717658 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x1e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6a08 expref: 54 pid: 27887 timeout: 8196 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051467.465619:0:8470:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95f864380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8470:1863365452687488:192.168.201.46@tcp:104: 00000100:00100000:2.0:1777051467.465670:0:8470:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d9591d5000 going to sleep for 11 seconds 00000100:00100000:2.0:1777051467.469976:0:8470:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95f864a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8470:1863365452687360:192.168.201.46@tcp:104: 00000100:00100000:2.0:1777051467.470003:0:8470:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95f864380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8470:1863365452687488:192.168.201.46@tcp:104: 00010000:00010000:2.0:1777051467.470049:0:8470:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f4c15b18/0x85f51a6b967176c1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051467.471230:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051467.471362:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051467.471466:0:9550:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426092800 00000100:00100000:2.0:1777051467.471477:0:9550:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426092800 00000100:00100000:3.0:1777051467.471522:0:24467:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426092672 00010000:00010000:2.0:1777051467.471530:0:9550:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002603dab2/0x85f51a6b96717658 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x1e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6a08 expref: 55 pid: 27887 timeout: 8196 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051467.471535:0:24467:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426092672 00000100:00100000:2.0:1777051467.471597:0:9550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3969 00000100:00100000:2.0:1777051467.471617:0:9550:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da58813850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+55:2437:x1863365426092800:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1777051467.471628:0:24467:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000033174453/0x85f51a6b96717689 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x1e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6a1d expref: 52 pid: 13320 timeout: 8196 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051467.471640:0:9550:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777051467.471675:0:9550:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002603dab2/0x85f51a6b96717658 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x1e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6a08 expref: 55 pid: 27887 timeout: 8196 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051467.471700:0:24467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3970 00010000:00010000:2.0:1777051467.471724:0:9550:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002603dab2/0x85f51a6b96717658 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x1e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6a08 expref: 55 pid: 27887 timeout: 8196 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051467.471726:0:24467:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d96040aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+52:2436:x1863365426092672:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1777051467.471754:0:24467:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777051467.471776:0:9550:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002603dab2/0x85f51a6b96717658 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x1e6:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6a08 expref: 55 pid: 27887 timeout: 8196 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051467.471780:0:24467:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000033174453/0x85f51a6b96717689 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x1e6:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6a1d expref: 52 pid: 13320 timeout: 8196 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1777051467.471913:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1777051467.471972:0:24467:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000033174453/0x85f51a6b96717689 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x1e6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6a1d expref: 52 pid: 13320 timeout: 8196 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051467.472022:0:9550:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1777051467.472042:0:24467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000033174453/0x85f51a6b96717689 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x1e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6a1d expref: 52 pid: 13320 timeout: 8196 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051467.472065:0:24467:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051467.472070:0:24467:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051467.472077:0:24467:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f4c15b18/0x85f51a6b967176c1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051467.472095:0:24467:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f4c15b18/0x85f51a6b967176c1 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051467.472104:0:9550:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da58813850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+54:2437:x1863365426092800:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 488us (880us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051467.472132:0:9550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3969 00010000:00010000:3.0:1777051467.472173:0:24467:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1777051467.472245:0:24467:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d96040aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+51:2436:x1863365426092672:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 525us (885us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051467.472262:0:24467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3970 00010000:00010000:1.0:1777051467.472274:0:8470:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f4c15b18/0x85f51a6b967176c1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051467.472298:0:8470:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f4c15b18/0x85f51a6b967176c1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051467.472369:0:8470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f4c15b18/0x85f51a6b967176c1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051467.472389:0:8470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f4c15b18/0x85f51a6b967176c1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051467.472407:0:8470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f4c15b18/0x85f51a6b967176c1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051467.472424:0:8470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d950711400 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:1.0:1777051467.472433:0:8470:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4c15b18/0x85f51a6b967176c1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051467.472490:0:8470:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4c15b18/0x85f51a6b967176c1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051467.472519:0:8470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f4c15b18/0x85f51a6b967176c1 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051467.472536:0:8470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f4c15b18/0x85f51a6b967176c1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051467.472642:0:8470:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+53:2437:x1863365426092544:12345-192.168.201.46@tcp:1:lfs.0 Request processed in 7960us (8215us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051467.472656:0:8470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 8096 00000100:00100000:0.0:1777051467.479657:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051467.479740:0:24269:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426093056 00000100:00100000:2.0:1777051467.479753:0:24269:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426093056 00000100:00100000:2.0:1777051467.479836:0:24269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3428 00000100:00100000:2.0:1777051467.479857:0:24269:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+38:139469:x1863365426093056:12345-192.168.201.46@tcp:35:lfs.0 00000004:00010000:2.0:1777051467.479938:0:24269:0:(mdt_open.c:1994:mdt_hsm_release()) ### [0x2000032e3:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99d950711a00/0x85f51a6b967176b3 lrc: 3/0,0 mode: PW/PW res: [0x2000032e3:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6a2b expref: 38 pid: 46494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1777051467.480238:0:24269:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 30064771249 00000001:00080000:2.0:1777051467.480793:0:24269:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 30064771250 00010000:00010000:2.0:1777051467.480861:0:24269:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710e00/0x85f51a6b967176c8 lrc: 3/0,1 mode: --/EX res: [0x2000032e3:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051467.480888:0:24269:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d774a00/0x85f51a6b967175c5 lrc: 2/0,0 mode: PR/PR res: [0x2000032e3:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b69de expref: 25 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051467.480901:0:24269:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d775c00/0x85f51a6b96717651 lrc: 2/0,0 mode: PR/PR res: [0x2000032e3:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6a01 expref: 41 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051467.480915:0:24269:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710e00/0x85f51a6b967176c8 lrc: 5/0,1 mode: --/EX res: [0x2000032e3:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051467.480968:0:24269:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d775c00/0x85f51a6b96717651 lrc: 3/0,0 mode: PR/PR res: [0x2000032e3:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6a01 expref: 41 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051467.480994:0:24269:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d775c00/0x85f51a6b96717651 lrc: 4/0,0 mode: PR/PR res: [0x2000032e3:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6a01 expref: 41 pid: 6579 timeout: 8196 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051467.481018:0:24269:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95f866a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:24269:1863365452687616:192.168.201.46@tcp:104: 00010000:00010000:2.0:1777051467.481150:0:24269:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d774a00/0x85f51a6b967175c5 lrc: 3/0,0 mode: PR/PR res: [0x2000032e3:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b69de expref: 25 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051467.481169:0:24269:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d774a00/0x85f51a6b967175c5 lrc: 4/0,0 mode: PR/PR res: [0x2000032e3:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b69de expref: 25 pid: 8492 timeout: 8196 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051467.481189:0:24269:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95f864380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:24269:1863365452687744:192.168.201.46@tcp:104: 00000100:00100000:2.0:1777051467.481300:0:24269:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d9591d5b40 going to sleep for 11 seconds 00000100:00100000:3.0:1777051467.485845:0:24269:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95f866a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:24269:1863365452687616:192.168.201.46@tcp:104: 00000100:00100000:3.0:1777051467.485874:0:24269:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95f864380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:24269:1863365452687744:192.168.201.46@tcp:104: 00010000:00010000:3.0:1777051467.485911:0:24269:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710e00/0x85f51a6b967176c8 lrc: 3/0,1 mode: --/EX res: [0x2000032e3:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24269 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051467.487505:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051467.487725:0:6566:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426093184 00000100:00100000:2.0:1777051467.487736:0:6566:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426093184 00010000:00010000:2.0:1777051467.488096:0:6566:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d775c00/0x85f51a6b96717651 lrc: 4/0,0 mode: PR/PR res: [0x2000032e3:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6a01 expref: 42 pid: 6579 timeout: 8196 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051467.488235:0:6566:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3971 00000100:00100000:2.0:1777051467.488296:0:6566:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95fae8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+42:2437:x1863365426093184:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1777051467.488372:0:6566:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777051467.488386:0:6566:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d775c00/0x85f51a6b96717651 lrc: 4/0,0 mode: PR/PR res: [0x2000032e3:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6a01 expref: 42 pid: 6579 timeout: 8196 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051467.488412:0:6566:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d775c00/0x85f51a6b96717651 lrc: 3/0,0 mode: PR/PR res: [0x2000032e3:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6a01 expref: 42 pid: 6579 timeout: 8196 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051467.488448:0:6566:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d775c00/0x85f51a6b96717651 lrc: 0/0,0 mode: --/PR res: [0x2000032e3:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6a01 expref: 42 pid: 6579 timeout: 8196 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051467.488474:0:6566:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e3:0xb:0x0].0x0 (ffff99da61538f00) 00010000:00010000:2.0:1777051467.488484:0:6566:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710e00/0x85f51a6b967176c8 lrc: 3/0,1 mode: --/EX res: [0x2000032e3:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051467.488498:0:6566:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710e00/0x85f51a6b967176c8 lrc: 3/0,1 mode: --/EX res: [0x2000032e3:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051467.488511:0:6566:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1777051467.488610:0:6566:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95fae8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+41:2437:x1863365426093184:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 358us (1107us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051467.488628:0:6566:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3971 00000100:00100000:2.0:1777051467.489676:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051467.489753:0:6564:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426093312 00000100:00100000:0.0:1777051467.489761:0:6564:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426093312 00010000:00010000:0.0:1777051467.490151:0:6564:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d774a00/0x85f51a6b967175c5 lrc: 4/0,0 mode: PR/PR res: [0x2000032e3:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b69de expref: 26 pid: 8492 timeout: 8196 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051467.490236:0:6564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3972 00000100:00100000:0.0:1777051467.490253:0:6564:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f864a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+26:2436:x1863365426093312:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1777051467.490271:0:6564:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777051467.490280:0:6564:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d774a00/0x85f51a6b967175c5 lrc: 4/0,0 mode: PR/PR res: [0x2000032e3:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b69de expref: 26 pid: 8492 timeout: 8196 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051467.490302:0:6564:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d774a00/0x85f51a6b967175c5 lrc: 3/0,0 mode: PR/PR res: [0x2000032e3:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b69de expref: 26 pid: 8492 timeout: 8196 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051467.490358:0:6564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d774a00/0x85f51a6b967175c5 lrc: 0/0,0 mode: --/PR res: [0x2000032e3:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b69de expref: 26 pid: 8492 timeout: 8196 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1777051467.490383:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1777051467.490426:0:6564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e3:0xb:0x0].0x0 (ffff99da61538f00) 00010000:00010000:0.0:1777051467.490435:0:6564:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710e00/0x85f51a6b967176c8 lrc: 3/0,1 mode: --/EX res: [0x2000032e3:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051467.490451:0:6564:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710e00/0x85f51a6b967176c8 lrc: 3/0,1 mode: EX/EX res: [0x2000032e3:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 24269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051467.490465:0:6564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710e00/0x85f51a6b967176c8 lrc: 4/0,1 mode: EX/EX res: [0x2000032e3:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 24269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051467.490516:0:6564:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1777051467.490572:0:6564:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f864a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+25:2436:x1863365426093312:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 321us (895us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051467.490587:0:6564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3972 00010000:00010000:2.0:1777051467.490607:0:24269:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710e00/0x85f51a6b967176c8 lrc: 3/0,1 mode: EX/EX res: [0x2000032e3:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051467.490627:0:24269:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710e00/0x85f51a6b967176c8 lrc: 3/0,1 mode: EX/EX res: [0x2000032e3:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24269 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1777051467.491103:0:24269:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 30064771251 00000001:00080000:2.0:1777051467.491302:0:24269:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 30064771252 00000001:00080000:2.0:1777051467.491465:0:24269:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 30064771253 00000100:00100000:2.0:1777051467.491593:0:24269:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95f864000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:24269:1863365452687872:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:2.0:1777051467.491717:0:24269:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051467.491769:0:24269:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d9591d5900 going to sleep for 11 seconds 00000100:00100000:0.0:1777051467.491822:0:11727:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452687872 00000100:00100000:0.0:1777051467.491832:0:11727:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452687872 00000100:00100000:0.0:1777051467.491928:0:11727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8313 00000100:00100000:0.0:1777051467.491943:0:11727:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f865f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:24269:x1863365452687872:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:0.0:1777051467.492100:0:11727:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f865f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:24269:x1863365452687872:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 158us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051467.492115:0:11727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8313 00000100:00080000:2.0:1777051467.492379:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1777051467.492396:0:24269:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95f864000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:24269:1863365452687872:0@lo:1000:mdt_rdpg00_002.0 00000001:00080000:3.0:1777051467.492472:0:24269:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 30064771254 00010000:00010000:3.0:1777051467.492522:0:24269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710e00/0x85f51a6b967176c8 lrc: 3/0,1 mode: EX/EX res: [0x2000032e3:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051467.492550:0:24269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710e00/0x85f51a6b967176c8 lrc: 2/0,0 mode: EX/EX res: [0x2000032e3:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051467.492564:0:24269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710e00/0x85f51a6b967176c8 lrc: 3/0,0 mode: EX/EX res: [0x2000032e3:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051467.492574:0:24269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d950710e00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:3.0:1777051467.492582:0:24269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710e00/0x85f51a6b967176c8 lrc: 3/0,0 mode: EX/EX res: [0x2000032e3:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051467.492596:0:24269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710e00/0x85f51a6b967176c8 lrc: 4/0,0 mode: EX/EX res: [0x2000032e3:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051467.492616:0:24269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e3:0xb:0x0].0x0 (ffff99da61538f00) 00010000:00010000:3.0:1777051467.492622:0:24269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1777051467.492629:0:24269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710e00/0x85f51a6b967176c8 lrc: 2/0,0 mode: --/EX res: [0x2000032e3:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051467.492641:0:24269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710e00/0x85f51a6b967176c8 lrc: 0/0,0 mode: --/EX res: [0x2000032e3:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24269 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1777051467.494888:0:24269:0:(mdd_object.c:4010:mdd_close()) Object [0x2000032e2:0xb:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1777051467.494996:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x27:0x0].5, 64 off8512 00000004:00080000:2.0:1777051467.495017:0:24269:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 8096687818070ns, next at 8097687814803ns, rc = 0 00000001:00080000:2.0:1777051467.495029:0:24269:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 30064771255 00010000:00010000:2.0:1777051467.495079:0:24269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e3:0xb:0x0].0x0 (ffff99da61538f00) 00010000:00010000:2.0:1777051467.495086:0:24269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1777051467.495098:0:24269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d950711a00/0x85f51a6b967176b3 lrc: 0/0,0 mode: --/PW res: [0x2000032e3:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6a2b expref: 45 pid: 46494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051467.495238:0:24269:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+44:139469:x1863365426093056:12345-192.168.201.46@tcp:35:lfs.0 Request processed in 15387us (15584us total) trans 30064771256 rc 0/0 00000100:00100000:2.0:1777051467.495259:0:24269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3428 00000020:00080000:2.0:1777051467.495270:0:24269:0:(tgt_main.c:783:tgt_ses_key_exit()) total 8 transactions per RPC 00000100:00100000:2.0:1777051467.542435:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7e24c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452688000:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1777051467.542530:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051467.542630:0:47208:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452688000 00000100:00100000:0.0:1777051467.542641:0:47208:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452688000 00000100:00100000:0.0:1777051467.542729:0:47208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8314 00000100:00100000:0.0:1777051467.542745:0:47208:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f867100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+6:3677:x1863365452688000:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1777051467.542812:0:47208:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4194304 pending 0 free 1441497088 avail 1295257600 00000100:00100000:0.0:1777051467.542899:0:47208:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f867100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0001-mdtlov_UUID+6:3677:x1863365452688000:12345-0@lo:41:osp-pre-0-1.0 Request processed in 157us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051467.542914:0:47208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8314 00000100:00100000:2.0:1777051467.542988:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7e24c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452688000:0@lo:41:osp-pre-0-1.0 00000020:00080000:3.0:1777051467.548761:0:104205:0:(update_trans.c:1333:distribute_txn_batchid_cb()) lustre-MDT0001: 4294970587 batchid updated 00000020:00080000:2.0:1777051467.548863:0:104230:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 4294970587 00000020:00080000:2.0:1777051467.548883:0:104230:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 4294970587 00000100:00100000:2.0:1777051467.684280:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051467.684379:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051467.684426:0:103163:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426093440 00000100:00100000:2.0:1777051467.684440:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051467.684441:0:103163:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426093440 00000100:00100000:0.0:1777051467.684491:0:27887:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426093696 00000100:00100000:2.0:1777051467.684501:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051467.684504:0:27887:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426093696 00000100:00100000:1.0:1777051467.684541:0:103163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 194 00000100:00100000:1.0:1777051467.684565:0:103163:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94a771450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29c4352d-3260-4734-909d-9ea5de9e7fa4+12:2436:x1863365426093440:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:2.0:1777051467.684580:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051467.684590:0:27887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10493 00000100:00100000:0.0:1777051467.684612:0:27887:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f864e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c11b6966-0775-44d2-bdc6-c74c26eb2226+48:2436:x1863365426093696:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:2.0:1777051467.684638:0:24468:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426093952 00000100:00100000:2.0:1777051467.684647:0:24468:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426093952 00000100:00100000:1.0:1777051467.684970:0:103163:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94a771450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29c4352d-3260-4734-909d-9ea5de9e7fa4+12:2436:x1863365426093440:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 127us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051467.684986:0:103163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 194 00000100:00100000:2.0:1777051467.685037:0:24468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10494 00000100:00100000:2.0:1777051467.685058:0:24468:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f864000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+50:2436:x1863365426093952:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:2.0:1777051467.685127:0:24468:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f864000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+50:2436:x1863365426093952:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 74us (685us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051467.685144:0:24468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10494 00000100:00100000:3.0:1777051467.685161:0:21368:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426093568 00000100:00100000:3.0:1777051467.685171:0:21368:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426093568 00000100:00100000:2.0:1777051467.685190:0:6580:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426093824 00000100:00100000:2.0:1777051467.685236:0:6580:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426093824 00000100:00100000:0.0:1777051467.685262:0:27887:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f864e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c11b6966-0775-44d2-bdc6-c74c26eb2226+48:2436:x1863365426093696:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 88us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051467.685286:0:27887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10493 00000100:00100000:2.0:1777051467.685304:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13459 00000100:00100000:2.0:1777051467.685350:0:6580:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f866a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+54:2436:x1863365426093824:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:2.0:1777051467.685425:0:6580:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f866a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+54:2436:x1863365426093824:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 78us (855us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051467.685437:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13459 00000100:00080000:2.0:1777051467.685503:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1777051467.685511:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1777051467.685681:0:21368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13460 00000100:00100000:3.0:1777051467.685697:0:21368:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f864380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+9:2436:x1863365426093568:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:3.0:1777051467.685766:0:21368:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f864380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+9:2436:x1863365426093568:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 73us (1270us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051467.685778:0:21368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13460 00010000:00010000:2.0:1777051467.863365:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1777051467.927687:0:103189:0:(llog.c:801:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:2.0:1777051467.927697:0:103189:0:(llog_cat.c:158:llog_cat_process_common()) processing log [0x1:0x2b:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1777051467.928144:0:103189:0:(llog.c:858:llog_process_thread()) stop processing plain [0x1:0x2b:0x0] index 11 count 8 00000040:00080000:2.0:1777051467.928157:0:103189:0:(llog.c:858:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00000100:00100000:1.0:1777051468.054491:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7c9a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3679:1863365452688128:0@lo:400:kworker.0 00000100:00100000:2.0:1777051468.054596:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d960408000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3678:1863365452688256:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1777051468.054606:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051468.054661:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051468.054672:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5fbef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3679:1863365452688768:0@lo:400:kworker.0 00000100:00100000:1.0:1777051468.054716:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051468.054721:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5fbeca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3678:1863365452688640:0@lo:400:kworker.0 00000100:00100000:1.0:1777051468.054744:0:3679:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1777051468.054753:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7cd9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3679:1863365452688384:0@lo:400:kworker.0 00000100:00100000:2.0:1777051468.054769:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051468.054794:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f9bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3677:1863365452688512:0@lo:400:kworker.0 00000100:00100000:1.0:1777051468.054820:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051468.054846:0:46498:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452688256 00000100:00100000:2.0:1777051468.054856:0:46498:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452688256 00000100:00100000:1.0:1777051468.054867:0:103165:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452688128 00000100:00100000:1.0:1777051468.054875:0:103165:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452688128 00000100:00100000:2.0:1777051468.054922:0:46498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8315 00000100:00100000:1.0:1777051468.054931:0:103165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1777051468.054938:0:46498:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f865500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+6:3678:x1863365452688256:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1777051468.054951:0:103165:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7d9cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9351a01-5b0e-4470-97fd-58b9b4b312a2+23:3679:x1863365452688128:12345-0@lo:400:kworker.0 00000004:00000024:2.0:1777051468.055005:0:46498:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4194304 pending 0 free 1446105088 avail 1299865600 00000100:00100000:1.0:1777051468.055014:0:103165:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7d9cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9351a01-5b0e-4470-97fd-58b9b4b312a2+23:3679:x1863365452688128:12345-0@lo:400:kworker.0 Request processed in 71us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051468.055022:0:103165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1777051468.055063:0:27882:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452688768 00000100:00100000:1.0:1777051468.055069:0:27882:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452688768 00000100:00100000:2.0:1777051468.055118:0:46498:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f865500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+6:3678:x1863365452688256:12345-0@lo:41:osp-pre-1-0.0 Request processed in 183us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051468.055129:0:27882:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452688640 00000100:00100000:2.0:1777051468.055130:0:46498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8315 00000100:00100000:1.0:1777051468.055138:0:27882:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452688640 00000100:00100000:1.0:1777051468.055172:0:27882:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452688512 00000100:00100000:1.0:1777051468.055176:0:27882:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452688512 00000100:00100000:2.0:1777051468.055200:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d960408000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3678:1863365452688256:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1777051468.055242:0:27882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13461 00000100:00100000:1.0:1777051468.055258:0:27882:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d960408380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0001_UUID+5:3679:x1863365452688768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777051468.055285:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13462 00000100:00100000:2.0:1777051468.055300:0:6579:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f866d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3678:x1863365452688640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777051468.055336:0:27882:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d960408380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0001_UUID+5:3679:x1863365452688768:12345-0@lo:400:kworker.0 Request processed in 81us (616us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051468.055347:0:27882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13461 00000100:00100000:1.0:1777051468.055369:0:27882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13463 00000100:00100000:1.0:1777051468.055382:0:27882:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d96040b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0000_UUID+5:3677:x1863365452688512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777051468.055396:0:6579:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f866d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3678:x1863365452688640:12345-0@lo:400:kworker.0 Request processed in 99us (628us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051468.055407:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13462 00000100:00100000:1.0:1777051468.055437:0:27882:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d96040b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0000_UUID+5:3677:x1863365452688512:12345-0@lo:400:kworker.0 Request processed in 58us (616us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051468.055445:0:27882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13463 00000100:00080000:1.0:1777051468.055485:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1777051468.055490:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1777051468.055496:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5fbeca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3678:1863365452688640:0@lo:400:kworker.0 00000100:00100000:1.0:1777051468.055531:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f9bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3677:1863365452688512:0@lo:400:kworker.0 00000100:00100000:1.0:1777051468.055574:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051468.055630:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5fbef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3679:1863365452688768:0@lo:400:kworker.0 00000100:00100000:1.0:1777051468.055652:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7c9a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3679:1863365452688128:0@lo:400:kworker.0 00000100:00100000:1.0:1777051468.055688:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5fbed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3679:1863365452689280:0@lo:400:kworker.0 00000100:00100000:3.0:1777051468.055728:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5fbee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3680:1863365452688896:0@lo:400:kworker.0 00000100:00100000:1.0:1777051468.055729:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051468.055769:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da45f76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3679:1863365452689792:0@lo:400:kworker.0 00000100:00100000:3.0:1777051468.055795:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051468.055810:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051468.055833:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5fbedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3680:1863365452689408:0@lo:400:kworker.0 00000100:00100000:1.0:1777051468.055863:0:6580:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452688384 00000100:00100000:1.0:1777051468.055870:0:6580:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452688384 00000100:00100000:3.0:1777051468.055877:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051468.055928:0:6580:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452689280 00000100:00100000:1.0:1777051468.055934:0:6580:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452689280 00000100:00100000:3.0:1777051468.055941:0:46500:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452688896 00000100:00100000:3.0:1777051468.055949:0:46500:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452688896 00000100:00100000:1.0:1777051468.055964:0:6580:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452689792 00000100:00100000:1.0:1777051468.055970:0:6580:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452689792 00000100:00100000:3.0:1777051468.056001:0:46500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8316 00000100:00100000:0.0:1777051468.056009:0:11727:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452689408 00000100:00100000:1.0:1777051468.056015:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13464 00000100:00100000:0.0:1777051468.056020:0:11727:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452689408 00000100:00100000:3.0:1777051468.056025:0:46500:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da45f75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+6:3680:x1863365452688896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777051468.056036:0:6580:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d960409c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3679:x1863365452688384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777051468.056074:0:11727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8317 00000100:00100000:0.0:1777051468.056089:0:11727:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da45f74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3680:x1863365452689408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777051468.056326:0:6580:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d960409c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3679:x1863365452688384:12345-0@lo:400:kworker.0 Request processed in 295us (750us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051468.056336:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13464 00000100:00100000:1.0:1777051468.056355:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13465 00000100:00100000:1.0:1777051468.056364:0:6580:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d960409180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3679:x1863365452689280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777051468.056432:0:6580:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d960409180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3679:x1863365452689280:12345-0@lo:400:kworker.0 Request processed in 69us (705us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051468.056441:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13465 00000100:00100000:1.0:1777051468.056457:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13466 00000100:00100000:1.0:1777051468.056465:0:6580:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d960408000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3679:x1863365452689792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777051468.056493:0:6580:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d960408000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3679:x1863365452689792:12345-0@lo:400:kworker.0 Request processed in 30us (687us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051468.056499:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13466 00000100:00080000:1.0:1777051468.056518:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1777051468.056526:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5fbee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3677:1863365452689024:0@lo:400:kworker.0 00000100:00100000:1.0:1777051468.056548:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051468.056587:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5fbeca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452689536:0@lo:400:kworker.0 00000100:00100000:1.0:1777051468.056616:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051468.056642:0:3677:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1777051468.056651:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5fbece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3677:1863365452689152:0@lo:400:kworker.0 00000100:00100000:1.0:1777051468.056673:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051468.056693:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5fbef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452689664:0@lo:400:kworker.0 00000100:00100000:1.0:1777051468.056720:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051468.056753:0:13320:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452689024 00000100:00100000:1.0:1777051468.056759:0:13320:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452689024 00000100:00100000:1.0:1777051468.056790:0:13320:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452689536 00000100:00100000:1.0:1777051468.056794:0:13320:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452689536 00000100:00100000:1.0:1777051468.056821:0:13320:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452689152 00000100:00100000:1.0:1777051468.056824:0:13320:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452689152 00000100:00100000:1.0:1777051468.056845:0:13320:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452689664 00000100:00100000:1.0:1777051468.056848:0:13320:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452689664 00000100:00100000:1.0:1777051468.056874:0:13320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10495 00000100:00100000:1.0:1777051468.056882:0:13320:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d960409f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3677:x1863365452689024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777051468.056925:0:13320:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d960409f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3677:x1863365452689024:12345-0@lo:400:kworker.0 Request processed in 44us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051468.056935:0:13320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10495 00000100:00100000:1.0:1777051468.056953:0:13320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10496 00000100:00100000:1.0:1777051468.056962:0:13320:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7c9a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3677:x1863365452689536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777051468.056998:0:13320:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7c9a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3677:x1863365452689536:12345-0@lo:400:kworker.0 Request processed in 38us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051468.057007:0:13320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10496 00000100:00100000:1.0:1777051468.057023:0:13320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10497 00000100:00100000:1.0:1777051468.057031:0:13320:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3677:x1863365452689152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777051468.057067:0:13320:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3677:x1863365452689152:12345-0@lo:400:kworker.0 Request processed in 37us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051468.057075:0:13320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10497 00000100:00100000:1.0:1777051468.057092:0:13320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10498 00000100:00100000:1.0:1777051468.057101:0:13320:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d9418f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3677:x1863365452689664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777051468.057131:0:13320:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d9418f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3677:x1863365452689664:12345-0@lo:400:kworker.0 Request processed in 33us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051468.057136:0:13320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10498 00000100:00080000:1.0:1777051468.057175:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1777051468.057180:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1777051468.057235:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5fbece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3677:1863365452689152:0@lo:400:kworker.0 00000100:00100000:1.0:1777051468.057253:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5fbef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452689664:0@lo:400:kworker.0 00000100:00100000:1.0:1777051468.057272:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5fbee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3677:1863365452689024:0@lo:400:kworker.0 00000100:00100000:1.0:1777051468.057283:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5fbeca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452689536:0@lo:400:kworker.0 00000100:00100000:2.0:1777051468.057357:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5fbee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3680:1863365452688896:0@lo:400:kworker.0 00000100:00100000:1.0:1777051468.057369:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da45f76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3679:1863365452689792:0@lo:400:kworker.0 00000100:00100000:1.0:1777051468.057386:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5fbed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3679:1863365452689280:0@lo:400:kworker.0 00000100:00100000:1.0:1777051468.057396:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7cd9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3679:1863365452688384:0@lo:400:kworker.0 00000100:00100000:3.0:1777051468.057754:0:46500:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da45f75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+6:3680:x1863365452688896:12345-0@lo:400:kworker.0 Request processed in 1740us (1968us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051468.057767:0:46500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8316 00000100:00100000:0.0:1777051468.057800:0:11727:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da45f74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3680:x1863365452689408:12345-0@lo:400:kworker.0 Request processed in 1711us (1922us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051468.057814:0:11727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8317 00000100:00100000:2.0:1777051468.057881:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5fbedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3680:1863365452689408:0@lo:400:kworker.0 00000100:00100000:0.0:1777051468.299908:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051468.299995:0:8492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426094208 00000100:00100000:1.0:1777051468.300010:0:8492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426094208 00000100:00100000:1.0:1777051468.300121:0:8492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112382 00000100:00100000:1.0:1777051468.300140:0:8492:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7e24f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+25:139487:x1863365426094208:12345-192.168.201.46@tcp:101:md5sum.0 00010000:00010000:1.0:1777051468.300176:0:8492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777051468.300548:0:8492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d953284a00/0x85f51a6b967176cf lrc: 2/0,0 mode: --/CR res: [0x2000032e2:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6a32 expref: -99 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051468.300651:0:8492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d953284200/0x85f51a6b967176d6 lrc: 3/1,0 mode: --/CR res: [0x2000032e2:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051468.300674:0:8492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d953284200/0x85f51a6b967176d6 lrc: 3/1,0 mode: CR/CR res: [0x2000032e2:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051468.300693:0:8492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d953284200/0x85f51a6b967176d6 lrc: 3/1,0 mode: CR/CR res: [0x2000032e2:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051468.300723:0:8492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d953285a00/0x85f51a6b967176dd lrc: 3/1,0 mode: --/PR res: [0x2000032e2:0xa:0x0].0x25e40ed5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051468.300735:0:8492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d953285a00/0x85f51a6b967176dd lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0xa:0x0].0x25e40ed5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051468.300746:0:8492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d953285a00/0x85f51a6b967176dd lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0xa:0x0].0x25e40ed5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051468.300893:0:8492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d953284c00/0x85f51a6b967176e4 lrc: 3/1,0 mode: --/PR res: [0x2000032e3:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051468.300908:0:8492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d953284c00/0x85f51a6b967176e4 lrc: 3/1,0 mode: PR/PR res: [0x2000032e3:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051468.300921:0:8492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d953284c00/0x85f51a6b967176e4 lrc: 3/1,0 mode: PR/PR res: [0x2000032e3:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1777051468.300936:0:8492:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000032e3:0xb:0x0]: returning size 0 00010000:00010000:1.0:1777051468.301030:0:8492:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d953284200/0x85f51a6b967176d6 lrc: 4/1,0 mode: CR/CR res: [0x2000032e2:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051468.301070:0:8492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d953284200/0x85f51a6b967176d6 lrc: 4/1,0 mode: CR/CR res: [0x2000032e2:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051468.301081:0:8492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d953284200/0x85f51a6b967176d6 lrc: 3/0,0 mode: CR/CR res: [0x2000032e2:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051468.301093:0:8492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d953284200/0x85f51a6b967176d6 lrc: 4/0,0 mode: CR/CR res: [0x2000032e2:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051468.301103:0:8492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d953284200 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:1.0:1777051468.301111:0:8492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d953284200/0x85f51a6b967176d6 lrc: 4/0,0 mode: CR/CR res: [0x2000032e2:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051468.301123:0:8492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d953284200/0x85f51a6b967176d6 lrc: 5/0,0 mode: CR/CR res: [0x2000032e2:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051468.301141:0:8492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0xa:0x0].0x0 (ffff99da45fd2700) 00010000:00010000:1.0:1777051468.301146:0:8492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777051468.301153:0:8492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d953284200/0x85f51a6b967176d6 lrc: 3/0,0 mode: --/CR res: [0x2000032e2:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051468.301165:0:8492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d953284200/0x85f51a6b967176d6 lrc: 0/0,0 mode: --/CR res: [0x2000032e2:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051468.301191:0:8492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d953285a00/0x85f51a6b967176dd lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0xa:0x0].0x25e40ed5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051468.301237:0:8492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d953285a00/0x85f51a6b967176dd lrc: 2/0,0 mode: PR/PR res: [0x2000032e2:0xa:0x0].0x25e40ed5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051468.301249:0:8492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d953285a00/0x85f51a6b967176dd lrc: 3/0,0 mode: PR/PR res: [0x2000032e2:0xa:0x0].0x25e40ed5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051468.301258:0:8492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d953285a00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:1.0:1777051468.301263:0:8492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d953285a00/0x85f51a6b967176dd lrc: 3/0,0 mode: PR/PR res: [0x2000032e2:0xa:0x0].0x25e40ed5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051468.301274:0:8492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d953285a00/0x85f51a6b967176dd lrc: 4/0,0 mode: PR/PR res: [0x2000032e2:0xa:0x0].0x25e40ed5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051468.301287:0:8492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0xa:0x0].0x25e40ed5 (ffff99d94e52a100) 00010000:00010000:1.0:1777051468.301291:0:8492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777051468.301297:0:8492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d953285a00/0x85f51a6b967176dd lrc: 2/0,0 mode: --/PR res: [0x2000032e2:0xa:0x0].0x25e40ed5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051468.301330:0:8492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d953285a00/0x85f51a6b967176dd lrc: 0/0,0 mode: --/PR res: [0x2000032e2:0xa:0x0].0x25e40ed5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051468.301413:0:8492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d953284a00/0x85f51a6b967176cf lrc: 0/0,0 mode: --/CR res: [0x2000032e2:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6a32 expref: 28 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051468.301437:0:8492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d953284c00/0x85f51a6b967176e4 lrc: 3/0,0 mode: PR/PR res: [0x2000032e3:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6a32 expref: 27 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051468.301450:0:8492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e3:0xb:0x0].0x0 (ffff99d94e52a900) 00010000:00010000:1.0:1777051468.301455:0:8492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1777051468.301459:0:8492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d953284c00, rc 0) 00000100:00100000:1.0:1777051468.301537:0:8492:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7e24f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+27:139487:x1863365426094208:12345-192.168.201.46@tcp:101:md5sum.0 Request processed in 1401us (1638us total) trans 30064771257 rc 0/0 00000100:00100000:1.0:1777051468.301551:0:8492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112382 00000100:00100000:1.0:1777051468.304518:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051468.304689:0:46497:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426094464 00000100:00100000:1.0:1777051468.304699:0:46497:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426094464 00000100:00100000:1.0:1777051468.304764:0:46497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112383 00000100:00100000:1.0:1777051468.304780:0:46497:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d9418f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+44:139486:x1863365426094464:12345-192.168.201.46@tcp:101:md5sum.0 00010000:00010000:1.0:1777051468.304806:0:46497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777051468.304827:0:46497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d953285000/0x85f51a6b967176f2 lrc: 2/0,0 mode: --/CR res: [0x2000032e2:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6a39 expref: -99 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051468.304907:0:46497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d953285c00/0x85f51a6b967176f9 lrc: 3/1,0 mode: --/CR res: [0x2000032e2:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051468.304926:0:46497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d953285c00/0x85f51a6b967176f9 lrc: 3/1,0 mode: CR/CR res: [0x2000032e2:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051468.304942:0:46497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d953285c00/0x85f51a6b967176f9 lrc: 3/1,0 mode: CR/CR res: [0x2000032e2:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051468.304967:0:46497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d953284e00/0x85f51a6b96717700 lrc: 3/1,0 mode: --/PR res: [0x2000032e2:0xa:0x0].0x25e40ed5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051468.304982:0:46497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d953284e00/0x85f51a6b96717700 lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0xa:0x0].0x25e40ed5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051468.304994:0:46497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d953284e00/0x85f51a6b96717700 lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0xa:0x0].0x25e40ed5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051468.305108:0:46497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d953285600/0x85f51a6b96717707 lrc: 3/1,0 mode: --/PR res: [0x2000032e3:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051468.305124:0:46497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d953285600/0x85f51a6b96717707 lrc: 3/1,0 mode: PR/PR res: [0x2000032e3:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051468.305138:0:46497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d953285600/0x85f51a6b96717707 lrc: 3/1,0 mode: PR/PR res: [0x2000032e3:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1777051468.305152:0:46497:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000032e3:0xb:0x0]: returning size 0 00010000:00010000:1.0:1777051468.305293:0:46497:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d953285c00/0x85f51a6b967176f9 lrc: 4/1,0 mode: CR/CR res: [0x2000032e2:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051468.308670:0:46497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d953285c00/0x85f51a6b967176f9 lrc: 4/1,0 mode: CR/CR res: [0x2000032e2:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051468.308682:0:46497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d953285c00/0x85f51a6b967176f9 lrc: 3/0,0 mode: CR/CR res: [0x2000032e2:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051468.308694:0:46497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d953285c00/0x85f51a6b967176f9 lrc: 4/0,0 mode: CR/CR res: [0x2000032e2:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051468.308704:0:46497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d953285c00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:1.0:1777051468.308711:0:46497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d953285c00/0x85f51a6b967176f9 lrc: 4/0,0 mode: CR/CR res: [0x2000032e2:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051468.308732:0:46497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d953285c00/0x85f51a6b967176f9 lrc: 5/0,0 mode: CR/CR res: [0x2000032e2:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051468.308751:0:46497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0xa:0x0].0x0 (ffff99da45fd2700) 00010000:00010000:1.0:1777051468.308757:0:46497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777051468.308765:0:46497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d953285c00/0x85f51a6b967176f9 lrc: 3/0,0 mode: --/CR res: [0x2000032e2:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051468.308776:0:46497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d953285c00/0x85f51a6b967176f9 lrc: 0/0,0 mode: --/CR res: [0x2000032e2:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051468.308796:0:46497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d953284e00/0x85f51a6b96717700 lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0xa:0x0].0x25e40ed5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051468.308807:0:46497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d953284e00/0x85f51a6b96717700 lrc: 2/0,0 mode: PR/PR res: [0x2000032e2:0xa:0x0].0x25e40ed5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051468.308817:0:46497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d953284e00/0x85f51a6b96717700 lrc: 3/0,0 mode: PR/PR res: [0x2000032e2:0xa:0x0].0x25e40ed5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051468.308826:0:46497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d953284e00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:1.0:1777051468.308831:0:46497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d953284e00/0x85f51a6b96717700 lrc: 3/0,0 mode: PR/PR res: [0x2000032e2:0xa:0x0].0x25e40ed5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051468.308849:0:46497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d953284e00/0x85f51a6b96717700 lrc: 4/0,0 mode: PR/PR res: [0x2000032e2:0xa:0x0].0x25e40ed5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051468.308864:0:46497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0xa:0x0].0x25e40ed5 (ffff99d94e52aa00) 00010000:00010000:1.0:1777051468.308869:0:46497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777051468.308873:0:46497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d953284e00/0x85f51a6b96717700 lrc: 2/0,0 mode: --/PR res: [0x2000032e2:0xa:0x0].0x25e40ed5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051468.308883:0:46497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d953284e00/0x85f51a6b96717700 lrc: 0/0,0 mode: --/PR res: [0x2000032e2:0xa:0x0].0x25e40ed5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051468.308961:0:46497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d953285000/0x85f51a6b967176f2 lrc: 0/0,0 mode: --/CR res: [0x2000032e2:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6a39 expref: 47 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051468.308987:0:46497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d953285600/0x85f51a6b96717707 lrc: 3/0,0 mode: PR/PR res: [0x2000032e3:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6a39 expref: 46 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051468.309000:0:46497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e3:0xb:0x0].0x0 (ffff99d94e52a900) 00010000:00010000:1.0:1777051468.309005:0:46497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1777051468.309010:0:46497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d953285600, rc 0) 00000100:00100000:1.0:1777051468.309084:0:46497:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d9418f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+46:139486:x1863365426094464:12345-192.168.201.46@tcp:101:md5sum.0 Request processed in 4307us (4568us total) trans 30064771258 rc 0/0 00000100:00100000:1.0:1777051468.309098:0:46497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112383 00000100:00100000:1.0:1777051468.315493:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051468.316757:0:9550:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426094720 00000100:00100000:2.0:1777051468.316769:0:9550:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426094720 00000100:00100000:2.0:1777051468.317779:0:9550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13742 00000100:00100000:2.0:1777051468.317797:0:9550:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d9418f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+27:139487:x1863365426094720:12345-192.168.201.46@tcp:103:md5sum.0 00010000:00010000:2.0:1777051468.317821:0:9550:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777051468.317853:0:9550:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d953284c00/0x85f51a6b967176e4 lrc: 0/0,0 mode: --/PR res: [0x2000032e3:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6a32 expref: 27 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051468.317876:0:9550:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e3:0xb:0x0].0x0 (ffff99d94e52a900) 00010000:00010000:2.0:1777051468.317884:0:9550:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1777051468.317953:0:9550:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d9418f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+26:139487:x1863365426094720:12345-192.168.201.46@tcp:103:md5sum.0 Request processed in 161us (2463us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051468.317966:0:9550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13742 00000100:00100000:3.0:1777051468.321735:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051468.321800:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051468.321881:0:6580:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426095104 00000100:00100000:1.0:1777051468.321891:0:6580:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426095104 00000100:00100000:1.0:1777051468.321957:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112384 00000100:00100000:1.0:1777051468.321974:0:6580:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da45f75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+26:139487:x1863365426095104:12345-192.168.201.46@tcp:58:md5sum.0 00000100:00100000:2.0:1777051468.321976:0:6565:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426094976 00000100:00100000:2.0:1777051468.321988:0:6565:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426094976 00000100:00100000:0.0:1777051468.322420:0:47597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13743 00000100:00100000:0.0:1777051468.322440:0:47597:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da45f76a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+46:139486:x1863365426094976:12345-192.168.201.46@tcp:103:md5sum.0 00010000:00010000:0.0:1777051468.322457:0:47597:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777051468.322481:0:47597:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d953285600/0x85f51a6b96717707 lrc: 0/0,0 mode: --/PR res: [0x2000032e3:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6a39 expref: 46 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051468.322513:0:47597:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e3:0xb:0x0].0x0 (ffff99d94e52a900) 00010000:00010000:0.0:1777051468.322528:0:47597:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1777051468.322585:0:47597:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da45f76a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+45:139486:x1863365426094976:12345-192.168.201.46@tcp:103:md5sum.0 Request processed in 153us (854us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051468.322596:0:47597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13743 00010000:00010000:1.0:1777051468.323044:0:6580:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99d953285000/0x85f51a6b96717715 lrc: 3/0,1 mode: --/EX res: [0x2000032e3:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051468.323063:0:6580:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d953285000/0x85f51a6b96717715 lrc: 3/0,1 mode: EX/EX res: [0x2000032e3:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051468.323077:0:6580:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d953285000/0x85f51a6b96717715 lrc: 3/0,1 mode: EX/EX res: [0x2000032e3:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00020000:1.0:1777051468.323091:0:6580:0:(mdt_hsm_cdt_client.c:366:mdt_hsm_register_hal()) cfs_fail_timeout id 164 sleeping for 5000ms 00000100:00100000:3.0:1777051468.326650:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051468.326735:0:21368:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426095232 00000100:00100000:2.0:1777051468.326744:0:21368:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426095232 00000100:00100000:2.0:1777051468.327072:0:21368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112385 00000100:00100000:2.0:1777051468.327088:0:21368:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da45f76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+45:139486:x1863365426095232:12345-192.168.201.46@tcp:58:md5sum.0 00000100:00100000:2.0:1777051468.327469:0:21368:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da45f76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+45:139486:x1863365426095232:12345-192.168.201.46@tcp:58:md5sum.0 Request processed in 383us (820us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051468.327549:0:21368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112385 00000100:00100000:2.0:1777051468.337117:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051468.337487:0:10328:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426095360 00000100:00100000:3.0:1777051468.337501:0:10328:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426095360 00000100:00100000:2.0:1777051468.337778:0:10328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112386 00000100:00100000:2.0:1777051468.337800:0:10328:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f865180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+45:139486:x1863365426095360:12345-192.168.201.46@tcp:101:md5sum.0 00010000:00010000:2.0:1777051468.337825:0:10328:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051468.337851:0:10328:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710e00/0x85f51a6b9671771c lrc: 2/0,0 mode: --/CR res: [0x2000032e3:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6a40 expref: -99 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051468.337915:0:10328:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99d953285000/0x85f51a6b96717715 lrc: 2/0,1 mode: EX/EX res: [0x2000032e3:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051468.337932:0:10328:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710e00/0x85f51a6b9671771c lrc: 4/0,0 mode: --/CR res: [0x2000032e3:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6a40 expref: 46 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051468.337956:0:10328:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff99d953285000/0x85f51a6b96717715 lrc: 3/0,1 mode: EX/EX res: [0x2000032e3:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051468.337974:0:10328:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710e00/0x85f51a6b9671771c lrc: 3/0,0 mode: --/CR res: [0x2000032e3:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6a40 expref: 46 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051468.337993:0:10328:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e3:0xb:0x0].0x0 (ffff99d94e52aa00) 00010000:00010000:2.0:1777051468.337998:0:10328:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1777051468.338003:0:10328:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710e00/0x85f51a6b9671771c lrc: 3/0,0 mode: --/CR res: [0x2000032e3:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6a40 expref: 46 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051468.338015:0:10328:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d950710e00, rc 0) 00000100:00100000:2.0:1777051468.338087:0:10328:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f865180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+46:139486:x1863365426095360:12345-192.168.201.46@tcp:101:md5sum.0 Request processed in 296us (979us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051468.338098:0:10328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112386 00000100:00100000:2.0:1777051468.566746:0:3678:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1777051468.566783:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d9418f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452690048:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1777051468.566783:0:3679:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1777051468.566820:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da445ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452689920:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1777051468.566926:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051468.567595:0:8473:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452690048 00000100:00100000:1.0:1777051468.567608:0:8473:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452690048 00000100:00100000:1.0:1777051468.567705:0:8473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5690 00000100:00100000:1.0:1777051468.567722:0:8473:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95fbaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3678:x1863365452690048:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1777051468.567771:0:8473:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 499269184 pending 0 free 3860574208 avail 3629051904 00000100:00100000:1.0:1777051468.567870:0:8473:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95fbaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3678:x1863365452690048:12345-0@lo:13:osp-pre-0-1.0 Request processed in 149us (946us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051468.567885:0:8473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5690 00000100:00100000:2.0:1777051468.568008:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d9418f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452690048:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1777051468.568456:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051468.568563:0:10113:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452689920 00000100:00100000:0.0:1777051468.568573:0:10113:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452689920 00000100:00100000:0.0:1777051468.568642:0:10113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5691 00000100:00100000:0.0:1777051468.568657:0:10113:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da45f76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3679:x1863365452689920:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1777051468.568692:0:10113:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 489209408 pending 0 free 3642707968 avail 3411185664 00000100:00100000:0.0:1777051468.568774:0:10113:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da45f76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3679:x1863365452689920:12345-0@lo:13:osp-pre-1-1.0 Request processed in 120us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051468.568784:0:10113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5691 00000100:00100000:3.0:1777051468.569088:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da445ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452689920:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1777051468.886456:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1777051468.950534:0:103189:0:(llog.c:801:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:2.0:1777051468.950544:0:103189:0:(llog_cat.c:158:llog_cat_process_common()) processing log [0x1:0x2b:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1777051468.952799:0:103189:0:(llog.c:858:llog_process_thread()) stop processing plain [0x1:0x2b:0x0] index 64768 count 8 00000040:00080000:2.0:1777051468.952818:0:103189:0:(llog.c:858:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00010000:00010000:1.0:1777051469.910739:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1777051470.102512:0:3680:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000004:00080000:0.0:1777051470.102523:0:103178:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 8099295322687ns, next at 8100295316692ns, rc = 0 00000100:00100000:1.0:1777051470.102548:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d9418f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3680:1863365452690176:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1777051470.102580:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7e24ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3678:1863365452690304:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1777051470.102652:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051470.102705:0:8472:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452690176 00000100:00100000:2.0:1777051470.102718:0:8472:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452690176 00000100:00100000:3.0:1777051470.102772:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051470.102828:0:8473:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452690304 00000100:00080000:0.0:1777051470.102830:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1777051470.102841:0:8473:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452690304 00000100:00100000:2.0:1777051470.102841:0:8472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5692 00000100:00100000:2.0:1777051470.102866:0:8472:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d9418f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3680:x1863365452690176:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1777051470.102912:0:8472:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 489209408 pending 0 free 3642707968 avail 3411185664 00000100:00100000:1.0:1777051470.102931:0:8473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5693 00000100:00080000:0.0:1777051470.102949:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1777051470.102957:0:8473:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da445ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3678:x1863365452690304:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1777051470.102992:0:8472:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d9418f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3680:x1863365452690176:12345-0@lo:13:osp-pre-1-0.0 Request processed in 132us (342us total) trans 0 rc 0/0 00002000:00000024:1.0:1777051470.102996:0:8473:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 499269184 pending 0 free 3860574208 avail 3629051904 00000100:00100000:2.0:1777051470.103014:0:8472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5692 00000100:00100000:0.0:1777051470.103068:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d9418f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3680:1863365452690176:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1777051470.103105:0:8473:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da445ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3678:x1863365452690304:12345-0@lo:13:osp-pre-0-0.0 Request processed in 155us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051470.103120:0:8473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5693 00000100:00100000:3.0:1777051470.103334:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7e24ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3678:1863365452690304:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1777051470.763191:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051470.764952:0:46498:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426095488 00000100:00100000:2.0:1777051470.764980:0:46498:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426095488 00000100:00080000:0.0:1777051470.765098:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1777051470.765152:0:46498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 8318 00000100:00100000:2.0:1777051470.765186:0:46498:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fdf2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+54:2437:x1863365426095488:12345-192.168.201.46@tcp:63:ll_sa.0 00010000:00010000:2.0:1777051470.765352:0:46498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051470.765398:0:46498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d950711400/0x85f51a6b96717723 lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6a47 expref: -99 pid: 46498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051470.765523:0:46498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d950710a00/0x85f51a6b9671772a lrc: 3/1,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 46498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051470.765559:0:46498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d950710a00/0x85f51a6b9671772a lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 46498 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051470.765591:0:46498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d950710a00/0x85f51a6b9671772a lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 46498 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051470.765635:0:46498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d950710200/0x85f51a6b96717731 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x2e2db9bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 46498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051470.765652:0:46498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff99d950710200/0x85f51a6b96717731 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x2e2db9bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46498 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051470.765676:0:46498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff99d950710200/0x85f51a6b96717731 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x2e2db9bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 46498 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051470.765746:0:46498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d950710a00/0x85f51a6b9671772a lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 46498 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051470.765771:0:46498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d950710a00/0x85f51a6b9671772a lrc: 2/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 46498 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051470.765786:0:46498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99d950710a00/0x85f51a6b9671772a lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 46498 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051470.765809:0:46498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d950710a00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:2.0:1777051470.765817:0:46498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d950710a00/0x85f51a6b9671772a lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 46498 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051470.765842:0:46498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d950710a00/0x85f51a6b9671772a lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 46498 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051470.765866:0:46498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff99d9413d0300) 00010000:00010000:2.0:1777051470.765883:0:46498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777051470.765892:0:46498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99d950710a00/0x85f51a6b9671772a lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 46498 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051470.765906:0:46498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d950710a00/0x85f51a6b9671772a lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 46498 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051470.765941:0:46498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff99d950710200/0x85f51a6b96717731 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x2e2db9bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46498 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051470.765966:0:46498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff99d950710200/0x85f51a6b96717731 lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x2e2db9bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 46498 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051470.765979:0:46498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff99d950710200/0x85f51a6b96717731 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x2e2db9bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 46498 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051470.765991:0:46498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d950710200 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:2.0:1777051470.766007:0:46498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d950710200/0x85f51a6b96717731 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x2e2db9bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 46498 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051470.766021:0:46498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff99d950710200/0x85f51a6b96717731 lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x1:0x0].0x2e2db9bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 46498 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051470.766048:0:46498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x2e2db9bb (ffff99da45fd2500) 00010000:00010000:2.0:1777051470.766054:0:46498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777051470.766060:0:46498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff99d950710200/0x85f51a6b96717731 lrc: 2/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x2e2db9bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 46498 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051470.766074:0:46498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d950710200/0x85f51a6b96717731 lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x1:0x0].0x2e2db9bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 46498 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051470.766152:0:46498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0001_UUID lock: ffff99d950711400/0x85f51a6b96717723 lrc: 1/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6a47 expref: 55 pid: 46498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051470.766185:0:46498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x1:0x0].0x0 (ffff99d9413d0300) 00010000:00010000:2.0:1777051470.766189:0:46498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1777051470.766198:0:46498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff99d950711400/0x85f51a6b96717723 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6a47 expref: 55 pid: 46498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051470.766229:0:46498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d950711400, rc -2) 00000100:00100000:2.0:1777051470.766469:0:46498:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fdf2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+54:2437:x1863365426095488:12345-192.168.201.46@tcp:63:ll_sa.0 Request processed in 1287us (3285us total) trans 0 rc -2/-2 00000100:00100000:2.0:1777051470.766487:0:46498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 8318 00010000:00010000:2.0:1777051470.934506:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1777051471.097162:0:108652:0:(llog.c:801:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:1.0:1777051471.097172:0:108652:0:(llog_cat.c:158:llog_cat_process_common()) processing log [0x1:0x2b:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1777051471.097302:0:108652:0:(llog.c:858:llog_process_thread()) stop processing plain [0x1:0x2b:0x0] index 11 count 8 00000040:00080000:1.0:1777051471.097312:0:108652:0:(llog.c:858:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00000040:00080000:2.0:1777051471.767643:0:104226:0:(llog.c:801:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1777051471.767654:0:104226:0:(llog_cat.c:158:llog_cat_process_common()) processing log [0x1:0x12:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1777051471.768134:0:104226:0:(llog.c:858:llog_process_thread()) stop processing plain [0x1:0x12:0x0] index 11 count 9 00000040:00080000:2.0:1777051471.768152:0:104226:0:(llog.c:858:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:3.0:1777051471.959541:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1777051472.617784:0:108750:0:(tgt_mount.c:2015:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:2.0:1777051472.617874:0:108750:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.146@tcp lock: ffff99d955a98a00/0x85f51a6b96714bf6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b96714bfd expref: -99 pid: 103158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051472.617897:0:108750:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff99d955a98a00/0x85f51a6b96714bf6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x85f51a6b96714bfd expref: -99 pid: 103158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051472.617912:0:108750:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff99d955a98a00/0x85f51a6b96714bf6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x85f51a6b96714bfd expref: -99 pid: 103158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051472.617926:0:108750:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.146@tcp lock: ffff99d955a98a00/0x85f51a6b96714bf6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x85f51a6b96714bfd expref: -99 pid: 103158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051472.617955:0:108750:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1777051472.617964:0:108750:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:2.0:1777051472.618008:0:13753:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777051472.618019:0:13753:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.146@tcp lock: ffff99d955a98a00/0x85f51a6b96714bf6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x85f51a6b96714bfd expref: -99 pid: 103158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051472.618043:0:13753:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d955a98a00 already unused, calling callback (ffffffffc1208c20) 10000000:00010000:2.0:1777051472.618049:0:13753:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.146@tcp lock: ffff99d955a98a00/0x85f51a6b96714bf6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x85f51a6b96714bfd expref: -99 pid: 103158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051472.618066:0:13753:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.146@tcp lock: ffff99d955a98a00/0x85f51a6b96714bf6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x85f51a6b96714bfd expref: -99 pid: 103158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1777051472.618081:0:13753:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.146@tcp lock: ffff99d955a98a00/0x85f51a6b96714bf6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x85f51a6b96714bfd expref: -99 pid: 103158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1777051472.618094:0:13753:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1777051472.618099:0:13753:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1777051472.618103:0:13753:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1777051472.618151:0:13753:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.146@tcp lock: ffff99d955a98a00/0x85f51a6b96714bf6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x85f51a6b96714bfd expref: -99 pid: 103158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051472.618164:0:13753:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1777051472.618261:0:3679:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:2.0:1777051472.618288:0:13753:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.146@tcp lock: ffff99d955a98a00/0x85f51a6b96714bf6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x85f51a6b96714bfd expref: -99 pid: 103158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051472.618292:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955504000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3679:1863365452690432:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1777051472.618317:0:13753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.146@tcp lock: ffff99d955a98a00/0x85f51a6b96714bf6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x85f51a6b96714bfd expref: -99 pid: 103158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051472.618339:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777051472.618343:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777051472.618347:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1777051472.618373:0:108750:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1777051472.618381:0:108750:0:(client.c:3101:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1777051472.618391:0:108750:0:(pinger.c:396:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1777051472.618401:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1777051472.618416:0:108750:0:(import.c:65:import_set_state_nolock()) ffff99da7b5fd000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1777051472.618478:0:3676:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955505500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3676:1863365452690560:0@lo:39:umount.0 00000100:00100000:1.0:1777051472.618551:0:3676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051472.618551:0:6566:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452690432 00000100:00100000:3.0:1777051472.618565:0:6566:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452690432 00000100:00100000:1.0:1777051472.618628:0:6581:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452690560 00000100:00100000:1.0:1777051472.618639:0:6581:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452690560 00000100:00100000:3.0:1777051472.618656:0:6566:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13744 00000100:00100000:3.0:1777051472.618681:0:6566:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fdf2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f9351a01-5b0e-4470-97fd-58b9b4b312a2+23:3679:x1863365452690432:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1777051472.618705:0:6566:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1777051472.618708:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112387 00000100:00100000:1.0:1777051472.618728:0:6581:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d9418f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3676:x1863365452690560:12345-0@lo:39:umount.0 00010000:00010000:3.0:1777051472.618735:0:6566:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d9442ea400/0x85f51a6b96714bfd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x85f51a6b96714bf6 expref: 23 pid: 103163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051472.618762:0:6566:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000020:00000080:1.0:1777051472.618765:0:6581:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x85f51a6b96714cf2 00000100:00080000:1.0:1777051472.619072:0:6581:0:(import.c:65:import_set_state_nolock()) ffff99da7b5fb000 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1777051472.619147:0:6566:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fdf2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f9351a01-5b0e-4470-97fd-58b9b4b312a2+22:3679:x1863365452690432:12345-0@lo:103:ldlm_bl.0 Request processed in 474us (744us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051472.619165:0:6566:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13744 00000100:00100000:1.0:1777051472.619183:0:6581:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d9418f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+1:3676:x1863365452690560:12345-0@lo:39:umount.0 Request processed in 456us (632us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051472.619322:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955504000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3679:1863365452690432:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1777051472.619371:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112387 00000020:00000080:1.0:1777051472.619387:0:6581:0:(genops.c:906:class_export_put()) final put ffff99da7b5f8000/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:1.0:1777051472.619427:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1777051472.619459:0:3676:0:(import.c:65:import_set_state_nolock()) ffff99da7b5fd000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1777051472.619476:0:3676:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955505500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3676:1863365452690560:0@lo:39:umount.0 00000020:00000080:0.0:1777051472.619568:0:107953:0:(genops.c:865:class_export_destroy()) destroying export ffff99da7b5f8000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1777051472.619656:0:107953:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99da7b5fb000 for lustre-MDT0000 00000100:00080000:1.0:1777051472.620216:0:108750:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1777051472.620223:0:108750:0:(client.c:3101:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1777051472.620442:0:108750:0:(import.c:321:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1777051472.622368:0:108750:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.146@tcp lock: ffff99d955a98200/0x85f51a6b96714b0f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b96714b16 expref: -99 pid: 103158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051472.622386:0:108750:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff99d955a98200/0x85f51a6b96714b0f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x85f51a6b96714b16 expref: -99 pid: 103158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051472.622398:0:108750:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff99d955a98200/0x85f51a6b96714b0f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x85f51a6b96714b16 expref: -99 pid: 103158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051472.622411:0:108750:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.146@tcp lock: ffff99d955a98200/0x85f51a6b96714b0f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x85f51a6b96714b16 expref: -99 pid: 103158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051472.622448:0:108750:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1777051472.622460:0:108750:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.146@tcp lock: ffff99d94ffbd400/0x85f51a6b9671509c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b967150a3 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051472.622462:0:6568:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777051472.622472:0:6568:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.146@tcp lock: ffff99d955a98200/0x85f51a6b96714b0f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x85f51a6b96714b16 expref: -99 pid: 103158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051472.622473:0:108750:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff99d94ffbd400/0x85f51a6b9671509c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x85f51a6b967150a3 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051472.622486:0:108750:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff99d94ffbd400/0x85f51a6b9671509c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x85f51a6b967150a3 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051472.622486:0:6568:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d955a98200 already unused, calling callback (ffffffffc1208c20) 10000000:00010000:2.0:1777051472.622492:0:6568:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.146@tcp lock: ffff99d955a98200/0x85f51a6b96714b0f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x85f51a6b96714b16 expref: -99 pid: 103158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051472.622499:0:108750:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.146@tcp lock: ffff99d94ffbd400/0x85f51a6b9671509c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x85f51a6b967150a3 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051472.622506:0:6568:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.146@tcp lock: ffff99d955a98200/0x85f51a6b96714b0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x85f51a6b96714b16 expref: -99 pid: 103158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1777051472.622518:0:6568:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.146@tcp lock: ffff99d955a98200/0x85f51a6b96714b0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x85f51a6b96714b16 expref: -99 pid: 103158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051472.622519:0:108750:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1777051472.622528:0:108750:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.146@tcp lock: ffff99d954ea7600/0x85f51a6b967153ac lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b967153b3 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1777051472.622528:0:6568:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1777051472.622533:0:6568:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:1.0:1777051472.622539:0:108750:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff99d954ea7600/0x85f51a6b967153ac lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x85f51a6b967153b3 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051472.622550:0:108750:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff99d954ea7600/0x85f51a6b967153ac lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x85f51a6b967153b3 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051472.622557:0:6568:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.146@tcp lock: ffff99d955a98200/0x85f51a6b96714b0f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x85f51a6b96714b16 expref: -99 pid: 103158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051472.622569:0:6568:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1777051472.622572:0:108750:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.146@tcp lock: ffff99d954ea7600/0x85f51a6b967153ac lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x85f51a6b967153b3 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051472.622604:0:108750:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1777051472.622611:0:6568:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.146@tcp lock: ffff99d955a98200/0x85f51a6b96714b0f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x85f51a6b96714b16 expref: -99 pid: 103158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051472.622613:0:108750:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.146@tcp lock: ffff99d955a99e00/0x85f51a6b96714b01 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b96714b08 expref: -99 pid: 103158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051472.622626:0:6568:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.146@tcp lock: ffff99d955a98200/0x85f51a6b96714b0f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x85f51a6b96714b16 expref: -99 pid: 103158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051472.622627:0:108750:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff99d955a99e00/0x85f51a6b96714b01 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x85f51a6b96714b08 expref: -99 pid: 103158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051472.622639:0:108750:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff99d955a99e00/0x85f51a6b96714b01 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x85f51a6b96714b08 expref: -99 pid: 103158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051472.622647:0:6568:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1777051472.622651:0:108750:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.146@tcp lock: ffff99d955a99e00/0x85f51a6b96714b01 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x85f51a6b96714b08 expref: -99 pid: 103158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051472.622652:0:6568:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.146@tcp lock: ffff99d94ffbd400/0x85f51a6b9671509c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x85f51a6b967150a3 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051472.622673:0:6568:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94ffbd400 already unused, calling callback (ffffffffc1208c20) 00010000:00010000:1.0:1777051472.622676:0:108750:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:00010000:2.0:1777051472.622678:0:6568:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.146@tcp lock: ffff99d94ffbd400/0x85f51a6b9671509c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x85f51a6b967150a3 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1777051472.622681:0:108750:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:1.0:1777051472.622687:0:108750:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00010000:00010000:2.0:1777051472.622690:0:6568:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.146@tcp lock: ffff99d94ffbd400/0x85f51a6b9671509c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x85f51a6b967150a3 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1777051472.622700:0:6568:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.146@tcp lock: ffff99d94ffbd400/0x85f51a6b9671509c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x85f51a6b967150a3 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1777051472.622710:0:6568:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1777051472.622713:0:6568:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:2.0:1777051472.622717:0:6568:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1777051472.622722:0:6567:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1777051472.622730:0:6567:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.146@tcp lock: ffff99d954ea7600/0x85f51a6b967153ac lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x85f51a6b967153b3 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051472.622740:0:6568:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.146@tcp lock: ffff99d94ffbd400/0x85f51a6b9671509c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x85f51a6b967150a3 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051472.622742:0:6567:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d954ea7600 already unused, calling callback (ffffffffc1208c20) 10000000:00010000:1.0:1777051472.622748:0:6567:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.146@tcp lock: ffff99d954ea7600/0x85f51a6b967153ac lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x85f51a6b967153b3 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051472.622752:0:6568:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1777051472.622761:0:6567:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.146@tcp lock: ffff99d954ea7600/0x85f51a6b967153ac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x85f51a6b967153b3 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051472.622766:0:6568:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.146@tcp lock: ffff99d94ffbd400/0x85f51a6b9671509c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x85f51a6b967150a3 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1777051472.622776:0:6567:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.146@tcp lock: ffff99d954ea7600/0x85f51a6b967153ac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x85f51a6b967153b3 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051472.622778:0:6568:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.146@tcp lock: ffff99d94ffbd400/0x85f51a6b9671509c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x85f51a6b967150a3 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1777051472.622788:0:6567:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1777051472.622792:0:6567:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1777051472.622795:0:6567:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1777051472.622795:0:6568:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777051472.622800:0:6568:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.146@tcp lock: ffff99d955a99e00/0x85f51a6b96714b01 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x85f51a6b96714b08 expref: -99 pid: 103158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051472.622810:0:6568:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d955a99e00 already unused, calling callback (ffffffffc1208c20) 00010000:00010000:1.0:1777051472.622815:0:6567:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.146@tcp lock: ffff99d954ea7600/0x85f51a6b967153ac lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x85f51a6b967153b3 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1777051472.622815:0:6568:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.146@tcp lock: ffff99d955a99e00/0x85f51a6b96714b01 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x85f51a6b96714b08 expref: -99 pid: 103158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051472.622826:0:6567:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1777051472.622829:0:6568:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.146@tcp lock: ffff99d955a99e00/0x85f51a6b96714b01 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x85f51a6b96714b08 expref: -99 pid: 103158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1777051472.622841:0:6568:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.146@tcp lock: ffff99d955a99e00/0x85f51a6b96714b01 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x85f51a6b96714b08 expref: -99 pid: 103158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1777051472.622851:0:6568:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1777051472.622855:0:6568:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 00010000:00010000:1.0:1777051472.622857:0:6567:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.146@tcp lock: ffff99d954ea7600/0x85f51a6b967153ac lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x85f51a6b967153b3 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1777051472.622859:0:6568:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:1.0:1777051472.622869:0:6567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.146@tcp lock: ffff99d954ea7600/0x85f51a6b967153ac lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x85f51a6b967153b3 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051472.622872:0:3680:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:2.0:1777051472.622884:0:6568:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.146@tcp lock: ffff99d955a99e00/0x85f51a6b96714b01 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x85f51a6b96714b08 expref: -99 pid: 103158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051472.622893:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1777051472.622897:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d9418f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3680:1863365452690944:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1777051472.622898:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777051472.622898:0:6568:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1777051472.622903:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777051472.622914:0:6568:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.146@tcp lock: ffff99d955a99e00/0x85f51a6b96714b01 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x85f51a6b96714b08 expref: -99 pid: 103158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051472.622927:0:6568:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.146@tcp lock: ffff99d955a99e00/0x85f51a6b96714b01 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x85f51a6b96714b08 expref: -99 pid: 103158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1777051472.622930:0:108750:0:(tgt_mount.c:2065:server_put_super()) stopping lustre-MDT0000 00000020:01000000:1.0:1777051472.622937:0:108750:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='FA') 00010000:00010000:2.0:1777051472.622943:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1777051472.622945:0:108750:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00010000:00010000:2.0:1777051472.622946:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777051472.622950:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:02000400:1.0:1777051472.622953:0:108750:0:(obd_config.c:932:class_cleanup()) Failing over lustre-MDT0000 00000100:00100000:2.0:1777051472.622973:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955504700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3677:1863365452690688:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1777051472.622977:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051472.623044:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051472.623052:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955505f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3680:1863365452691072:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1777051472.623097:0:3677:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1777051472.623106:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051472.623118:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955505180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3677:1863365452690816:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1777051472.623168:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051472.623190:0:47827:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452690944 00000100:00100000:0.0:1777051472.623261:0:47827:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452690944 00010000:00010000:2.0:1777051472.623302:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1777051472.623334:0:47827:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452690688 00000100:00100000:2.0:1777051472.623339:0:24467:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452691072 00000100:00100000:0.0:1777051472.623342:0:47827:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452690688 00000100:00100000:2.0:1777051472.623351:0:24467:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452691072 00000100:00100000:2.0:1777051472.623406:0:24467:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452690816 00000100:00100000:2.0:1777051472.623413:0:24467:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452690816 00000100:00100000:2.0:1777051472.623455:0:24467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13745 00000100:00100000:2.0:1777051472.623468:0:24467:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da58812050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f9351a01-5b0e-4470-97fd-58b9b4b312a2+25:3680:x1863365452690944:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1777051472.623484:0:24467:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777051472.623502:0:24467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d941ad7000/0x85f51a6b967153b3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x85f51a6b967153ac expref: 25 pid: 103163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051472.623524:0:24467:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1777051472.623579:0:24467:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da58812050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f9351a01-5b0e-4470-97fd-58b9b4b312a2+24:3680:x1863365452690944:12345-0@lo:103:ldlm_bl.0 Request processed in 112us (609us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051472.623592:0:24467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13745 00000100:00100000:0.0:1777051472.623643:0:47827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13746 00000100:00100000:0.0:1777051472.623663:0:47827:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7e24f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:f9351a01-5b0e-4470-97fd-58b9b4b312a2+23:3680:x1863365452691072:12345-0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1777051472.623682:0:24467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13747 00010000:00010000:0.0:1777051472.623683:0:47827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1777051472.623704:0:24467:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955507b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f9351a01-5b0e-4470-97fd-58b9b4b312a2+23:3677:x1863365452690816:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1777051472.623710:0:47827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d9442eac00/0x85f51a6b96714b08 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x85f51a6b96714b01 expref: 23 pid: 103165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051472.623723:0:24467:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777051472.623735:0:47827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1777051472.624039:0:24467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d954ea6c00/0x85f51a6b967150a3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x85f51a6b9671509c expref: 22 pid: 103166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051472.624064:0:24467:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1777051472.624077:0:47827:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7e24f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:f9351a01-5b0e-4470-97fd-58b9b4b312a2+21:3680:x1863365452691072:12345-0@lo:103:ldlm_bl.0 Request processed in 419us (971us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051472.624091:0:47827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13746 00000100:00100000:0.0:1777051472.624130:0:47827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13748 00000100:00100000:2.0:1777051472.624143:0:24467:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955507b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f9351a01-5b0e-4470-97fd-58b9b4b312a2+20:3677:x1863365452690816:12345-0@lo:103:ldlm_bl.0 Request processed in 445us (971us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051472.624148:0:47827:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955505c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:f9351a01-5b0e-4470-97fd-58b9b4b312a2+20:3677:x1863365452690688:12345-0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1777051472.624168:0:24467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13747 00010000:00010000:0.0:1777051472.624171:0:47827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777051472.624195:0:47827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99da713e3800/0x85f51a6b96714b16 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x85f51a6b96714b0f expref: 19 pid: 103163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051472.624216:0:47827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1777051472.624299:0:47827:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955505c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:f9351a01-5b0e-4470-97fd-58b9b4b312a2+18:3677:x1863365452690688:12345-0@lo:103:ldlm_bl.0 Request processed in 157us (1256us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051472.624314:0:47827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13748 00000100:00100000:2.0:1777051472.624345:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955505f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3680:1863365452691072:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1777051472.624365:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d9418f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3680:1863365452690944:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1777051472.624408:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955505180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3677:1863365452690816:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1777051472.624421:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955504700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3677:1863365452690688:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1777051472.624828:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00000080:1.0:1777051472.628719:0:108750:0:(mdt_handler.c:8165:mdt_iocontrol()) lustre-MDT0000: cmd=40086672 len=0 karg=0000000000000000 uarg=0000000000000000 00000004:00080000:3.0:1777051472.632049:0:103159:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000001:00080000:3.0:1777051472.632083:0:103159:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771258 is committed 00000001:00080000:3.0:1777051472.632092:0:103159:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771257 is committed 00000004:00080000:3.0:1777051472.632101:0:103159:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000020:00000080:1.0:1777051472.632536:0:108750:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 6/13 00000020:00080000:1.0:1777051472.632550:0:108750:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff99d950ade000 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1777051472.632564:0:108750:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff99d9410ca800 lustre-MDT0001-mdtlov_UUID 0@lo 5 (0 0 1) 0 0 0 0: 0000000000000000 30064771239 stale:0 00000100:00100000:0.0:1777051472.632574:0:3678:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000020:00080000:1.0:1777051472.632577:0:108750:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff99d942e00000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1777051472.632593:0:108750:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff99da7b5f9800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000100:00100000:0.0:1777051472.632605:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955504700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3678:1863365452691200:0@lo:6:osp-syn-0-0.0 00000020:00080000:1.0:1777051472.632608:0:108750:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff99d941c41000 c11b6966-0775-44d2-bdc6-c74c26eb2226 192.168.201.46@tcp 25 (1 0 19) 0 0 0 0: 0000000000000000 30064771257 stale:0 00000020:00080000:1.0:1777051472.632629:0:108750:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff99d941c41800 2dd4696c-edce-4cd1-86d2-dbd2ff957fa1 192.168.201.46@tcp 35 (0 0 30) 0 0 0 0: 0000000000000000 30064771258 stale:0 00000020:00080000:1.0:1777051472.632640:0:108750:0:(genops.c:1574:class_disconnect_exports()) OBD device 5 (ffff99da46203380) has exports, disconnecting them 00000020:00080000:1.0:1777051472.632650:0:108750:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff99d950ade000), last request at 1777051329 00000020:00000080:1.0:1777051472.632670:0:108750:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x85f51a6b96715080 00000100:00080000:1.0:1777051472.632686:0:108750:0:(import.c:65:import_set_state_nolock()) ffff99d950add000 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1777051472.632697:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:1.0:1777051472.632741:0:108750:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff99d950ade000): rc 0 00000020:00000080:1.0:1777051472.632747:0:108750:0:(genops.c:906:class_export_put()) final put ffff99d950ade000/lustre-MDT0000-lwp-MDT0001_UUID 00010000:00010000:3.0:1777051472.632786:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1777051472.632787:0:108750:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff99d9410ca800), last request at 1777051329 00000100:00100000:0.0:1777051472.632789:0:8628:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452691200 00000100:00100000:0.0:1777051472.632801:0:8628:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452691200 00000020:00000080:1.0:1777051472.632802:0:108750:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x85f51a6b96715009 00000020:00010000:1.0:1777051472.632816:0:108750:0:(genops.c:1942:obd_stale_export_put()) Put export ffff99d9410ca800: total 1 00000100:00080000:1.0:1777051472.632823:0:108750:0:(import.c:65:import_set_state_nolock()) ffff99d9410cc800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1777051472.632856:0:108750:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff99d9410ca800): rc 0 00000020:00080000:1.0:1777051472.632866:0:108750:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff99d942e00000), last request at 1777051468 00000020:00000080:1.0:1777051472.632875:0:108750:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x85f51a6b96714ceb 00000020:00010000:3.0:1777051472.632881:0:6568:0:(genops.c:1928:obd_stale_export_get()) Get export ffff99d9410ca800: total 1 00000100:00080000:1.0:1777051472.632903:0:108750:0:(import.c:65:import_set_state_nolock()) ffff99d942e02800 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1777051472.632916:0:8628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8097 00000100:00100000:0.0:1777051472.632939:0:8628:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7e24ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3678:x1863365452691200:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1777051472.632973:0:6568:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff99d9410ca800, canceled 0 locks, left on hash table 1. 00002000:00080000:0.0:1777051472.632976:0:8628:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:486 count 1 00000020:00080000:1.0:1777051472.632993:0:108750:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff99d942e00000): rc 0 00000020:00000080:1.0:1777051472.632998:0:108750:0:(genops.c:906:class_export_put()) final put ffff99d942e00000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:1.0:1777051472.633012:0:108750:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff99da7b5f9800), last request at 1777051468 00002000:00010000:0.0:1777051472.633019:0:8628:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x1e6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1777051472.633031:0:8628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003b773f6d/0x85f51a6b96717738 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1e6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051472.633047:0:6568:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da40031600/0x85f51a6b9671565a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x85f51a6b96715653 expref: 2 pid: 47208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051472.633056:0:8628:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777051472.633064:0:8628:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777051472.633075:0:8628:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003b773f6d/0x85f51a6b96717738 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1777051472.633085:0:108750:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x85f51a6b96714ce4 00010000:00010000:3.0:1777051472.633090:0:6568:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff99d9410ca800, canceled 1 locks, left on hash table 0. 00000100:00080000:1.0:1777051472.633106:0:108750:0:(import.c:65:import_set_state_nolock()) ffff99da7b5fa800 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1777051472.633107:0:8628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003b773f6d/0x85f51a6b96717738 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051472.633511:0:8628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003b773f6d/0x85f51a6b96717738 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051472.633530:0:8628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003b773f6d/0x85f51a6b96717738 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1777051472.633567:0:108750:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff99da7b5f9800): rc 0 00010000:00010000:0.0:1777051472.633568:0:8628:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000020:00000080:1.0:1777051472.633574:0:108750:0:(genops.c:906:class_export_put()) final put ffff99da7b5f9800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:1.0:1777051472.633592:0:108750:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 192.168.201.46@tcp (ffff99d941c41000), last request at 1777051468 00000020:00000080:1.0:1777051472.633620:0:108750:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x85f51a6b96714b6a 00000020:00010000:1.0:1777051472.633636:0:108750:0:(genops.c:1942:obd_stale_export_put()) Put export ffff99d941c41000: total 3 00000100:00080000:1.0:1777051472.633645:0:108750:0:(import.c:65:import_set_state_nolock()) ffff99d944c1a000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1777051472.633714:0:108750:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.201.46@tcp (ffff99d941c41000): rc 0 00000020:00080000:1.0:1777051472.633726:0:108750:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 192.168.201.46@tcp (ffff99d941c41800), last request at 1777051468 00000020:00000080:1.0:1777051472.633734:0:108750:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x85f51a6b96714b63 00000020:00010000:1.0:1777051472.633750:0:108750:0:(genops.c:1942:obd_stale_export_put()) Put export ffff99d941c41800: total 3 00000100:00080000:1.0:1777051472.633756:0:108750:0:(import.c:65:import_set_state_nolock()) ffff99da7b5fd800 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1777051472.633811:0:8628:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7e24ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3678:x1863365452691200:12345-0@lo:6:osp-syn-0-0.0 Request processed in 876us (1115us total) trans 4294968373 rc 0/0 00000020:00080000:1.0:1777051472.633821:0:108750:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.201.46@tcp (ffff99d941c41800): rc 0 00000004:00000080:1.0:1777051472.633835:0:108750:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffb08941acfae0 00000100:00100000:0.0:1777051472.633842:0:8628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8097 00000100:00080000:1.0:1777051472.633869:0:108750:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1777051472.633876:0:108750:0:(client.c:3101:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 8589934760 gen 3 00000020:00010000:2.0:1777051472.633893:0:13753:0:(genops.c:1928:obd_stale_export_get()) Get export ffff99d941c41000: total 3 00000020:00000080:0.0:1777051472.633896:0:48457:0:(genops.c:865:class_export_destroy()) destroying export ffff99d950ade000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00010000:00010000:2.0:1777051472.633982:0:13753:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff99d941c41000, canceled 0 locks, left on hash table 19. 00000020:00000080:0.0:1777051472.633984:0:48457:0:(genops.c:865:class_export_destroy()) destroying export ffff99d942e00000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00010000:00010000:2.0:1777051472.634040:0:13753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48ae00/0x85f51a6b96715eb8 lrc: 0/0,0 mode: --/PR res: [0x2000032e2:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b62bb expref: 21 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1777051472.634041:0:48457:0:(genops.c:865:class_export_destroy()) destroying export ffff99da7b5f9800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1777051472.634097:0:48457:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99d950add000 for lustre-MDT0000 00010000:00010000:2.0:1777051472.634098:0:13753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2aa00/0x85f51a6b96716071 lrc: 0/0,0 mode: --/PR res: [0x2000032e2:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6339 expref: 20 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1777051472.634109:0:48457:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99d942e02800 for lustre-MDT0000 00000020:00000080:0.0:1777051472.634116:0:48457:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99da7b5fa800 for lustre-MDT0000 00000100:00080000:0.0:1777051472.634134:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00010000:0.0:1777051472.634152:0:38719:0:(genops.c:1928:obd_stale_export_get()) Get export ffff99d941c41800: total 0 00010000:00010000:2.0:1777051472.634153:0:13753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da40030000/0x85f51a6b967155ab lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5f9d expref: 19 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051472.634273:0:38719:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff99d941c41800, canceled 0 locks, left on hash table 30. 00010000:00010000:0.0:1777051472.634323:0:38719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da713e2c00/0x85f51a6b96714d00 lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0x9d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b50a1 expref: 31 pid: 103199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051472.634330:0:13753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e9d7600/0x85f51a6b96714d54 lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0xb0:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b555c expref: 18 pid: 103199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051472.634393:0:13753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3600/0x85f51a6b96715a6d lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b612c expref: 17 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051472.634403:0:38719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d941ad6200/0x85f51a6b96715fa6 lrc: 0/0,0 mode: --/PR res: [0x2000032e2:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b62fa expref: 30 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051472.634455:0:13753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b000/0x85f51a6b96715dae lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6267 expref: 16 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051472.634457:0:38719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2bc00/0x85f51a6b967165cd lrc: 0/0,0 mode: --/PR res: [0x2000032e2:0x6:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b64f9 expref: 29 pid: 46494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051472.634547:0:13753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e9d6c00/0x85f51a6b96714d4d lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b0fbe expref: 15 pid: 103199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051472.634549:0:38719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710e00/0x85f51a6b9671771c lrc: 0/0,0 mode: --/CR res: [0x2000032e3:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6a40 expref: 28 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051472.634619:0:13753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2a200/0x85f51a6b967162fc lrc: 0/0,0 mode: --/PR res: [0x2000032e2:0x6:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b63f6 expref: 14 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051472.634626:0:38719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263400/0x85f51a6b96715e33 lrc: 0/0,0 mode: --/PR res: [0x2000032e2:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b628a expref: 27 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051472.634688:0:13753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d95d338e00/0x85f51a6b967153f9 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5f26 expref: 13 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051472.634986:0:38719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da713e3c00/0x85f51a6b96714cf9 lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0x9f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b50af expref: 26 pid: 103199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051472.635031:0:13753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e9d6600/0x85f51a6b96714d46 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x96:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b244e expref: 12 pid: 103199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051472.635060:0:38719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da713e2600/0x85f51a6b96714d15 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x96:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b41c1 expref: 25 pid: 103199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051472.635074:0:13753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d953285e00/0x85f51a6b96717578 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b69c9 expref: 11 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051472.635111:0:38719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e6e6600/0x85f51a6b96717666 lrc: 0/0,0 mode: --/PR res: [0x2000032e2:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6a0f expref: 24 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051472.635122:0:13753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e9d6800/0x85f51a6b96714d3f lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xc2:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b4882 expref: 10 pid: 103199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051472.635166:0:38719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da429d7e00/0x85f51a6b96714d77 lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0xb0:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5707 expref: 23 pid: 103199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051472.635182:0:13753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e9d7200/0x85f51a6b96714d38 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xc4:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b4e9b expref: 9 pid: 103199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051472.635302:0:38719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e9d7400/0x85f51a6b96714d2a lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0xb2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5715 expref: 22 pid: 103199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051472.635339:0:38719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cea00/0x85f51a6b96716b92 lrc: 0/0,0 mode: --/CR res: [0x2000032e3:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b66ff expref: 21 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051472.635384:0:13753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e9d7e00/0x85f51a6b96714d31 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xc6:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b54f3 expref: 8 pid: 103199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051472.635390:0:38719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da429d7c00/0x85f51a6b96714d70 lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0x51:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b445a expref: 20 pid: 103199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051472.635450:0:38719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a2400/0x85f51a6b96715939 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b60d8 expref: 19 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051472.635480:0:13753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263a00/0x85f51a6b96716334 lrc: 0/0,0 mode: --/PR res: [0x2000032e2:0x5:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b640b expref: 7 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051472.635486:0:38719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eb2b800/0x85f51a6b967165bf lrc: 0/0,0 mode: --/PR res: [0x2000032e2:0x5:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b64f2 expref: 18 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051472.635518:0:38719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d95595a200/0x85f51a6b967159e8 lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0xd5:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6117 expref: 17 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051472.635554:0:13753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e6e6c00/0x85f51a6b9671744b lrc: 0/0,0 mode: --/PR res: [0x240000bd3:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6967 expref: 6 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051472.635564:0:38719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263200/0x85f51a6b96715e64 lrc: 0/0,0 mode: --/CR res: [0x2000032e2:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6298 expref: 16 pid: 46494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051472.635594:0:13753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d950711e00/0x85f51a6b967175e8 lrc: 0/0,0 mode: --/PR res: [0x2000032e2:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b69e5 expref: 5 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051472.635601:0:38719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da713e2200/0x85f51a6b96714d0e lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0xb5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5731 expref: 15 pid: 103199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051472.635636:0:13753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da429d6600/0x85f51a6b96714d5b lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0x9e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b4ee8 expref: 4 pid: 103199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051472.635661:0:38719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da713e3400/0x85f51a6b96714d07 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x57:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b0bdc expref: 14 pid: 103199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051472.635689:0:13753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48a400/0x85f51a6b96715dca lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b626e expref: 3 pid: 27885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051472.635715:0:38719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e6e6400/0x85f51a6b96717635 lrc: 0/0,0 mode: --/PR res: [0x2000032e2:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b69fa expref: 13 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051472.635752:0:38719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d9559a3a00/0x85f51a6b9671731e lrc: 0/0,0 mode: --/PR res: [0x240000bd3:0x4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b690c expref: 12 pid: 21368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051472.636132:0:38719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94eccde00/0x85f51a6b967164fb lrc: 0/0,0 mode: --/CR res: [0x2000032e2:0x6:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b64ac expref: 11 pid: 21368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051472.636157:0:38719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d953284400/0x85f51a6b96717619 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b69f3 expref: 10 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051472.636768:0:13753:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff99d941c41000, canceled 19 locks, left on hash table 0. 00010000:00010000:0.0:1777051472.636963:0:38719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d950263800/0x85f51a6b96716238 lrc: 0/0,0 mode: --/PR res: [0x2000032e2:0x5:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b63be expref: 9 pid: 46494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051472.637010:0:38719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48be00/0x85f51a6b96716476 lrc: 0/0,0 mode: --/PR res: [0x2000032e2:0x6:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b647b expref: 8 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051472.637045:0:38719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e9d7000/0x85f51a6b96714d1c lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x96:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b245c expref: 7 pid: 103199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051472.637071:0:38719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e48b600/0x85f51a6b96715e80 lrc: 0/0,0 mode: --/PR res: [0x2000032e2:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b629f expref: 6 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051472.637093:0:38719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da429d6800/0x85f51a6b96714d69 lrc: 0/0,0 mode: --/PR res: [0x200000bd3:0xb1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b570e expref: 5 pid: 103199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051472.637116:0:38719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d943ebba00/0x85f51a6b96715470 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5f42 expref: 4 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051472.637140:0:38719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d943ebae00/0x85f51a6b9671551f lrc: 0/0,0 mode: --/CR res: [0x200000bd2:0xd3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5f81 expref: 3 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051472.637162:0:38719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d950262c00/0x85f51a6b96715e95 lrc: 0/0,0 mode: --/PR res: [0x2000032e2:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b62ad expref: 2 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051472.637775:0:38719:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff99d941c41800, canceled 30 locks, left on hash table 0. 00000100:00080000:1.0:1777051472.676442:0:108750:0:(pinger.c:396:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1777051472.676494:0:108750:0:(import.c:65:import_set_state_nolock()) ffff99da42f4c800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1777051472.676563:0:3676:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d9418f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3676:1863365452691328:0@lo:39:umount.0 00000100:00100000:1.0:1777051472.676660:0:3676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1777051472.677145:0:6567:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000004:00080000:1.0:1777051472.677340:0:3678:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99d955504700/2, rc 0, transno 4294968373 00000100:00100000:1.0:1777051472.677354:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955504700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3678:1863365452691200:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1777051472.805331:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051472.805416:0:103168:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426095616 00000100:00100000:1.0:1777051472.805431:0:103168:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426095616 00000100:00100000:1.0:1777051472.805515:0:103168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 196 00000100:00100000:1.0:1777051472.805534:0:103168:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7d9cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:29c4352d-3260-4734-909d-9ea5de9e7fa4+12:2436:x1863365426095616:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:1.0:1777051472.805645:0:103168:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7d9cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:29c4352d-3260-4734-909d-9ea5de9e7fa4+12:2436:x1863365426095616:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 112us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051472.805661:0:103168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 196 00000100:00080000:1.0:1777051472.815788:0:108750:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1777051472.815798:0:108750:0:(client.c:3101:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968369 gen 3 00000100:00100000:1.0:1777051472.815849:0:108750:0:(client.c:3139:ptlrpc_free_committed()) @@@ free request with old gen req@ffff99d955504700 x1863365452691200/t4294968373(4294968373) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1777051488 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1777051472.815869:0:108750:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff99d955504700, transno 4294968373 00000004:00080000:1.0:1777051472.815904:0:108750:0:(osp_dev.c:1629:osp_import_event()) got inactive 00000100:00080000:1.0:1777051472.818037:0:108750:0:(pinger.c:396:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1777051472.818077:0:108750:0:(import.c:65:import_set_state_nolock()) ffff99d942fb3800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1777051472.818102:0:108750:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1777051472.818107:0:108750:0:(client.c:3101:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968374 gen 3 00000004:00080000:1.0:1777051472.818126:0:108750:0:(osp_dev.c:1629:osp_import_event()) got inactive 00000100:00080000:1.0:1777051472.822024:0:108750:0:(pinger.c:396:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1777051472.822494:0:108750:0:(import.c:65:import_set_state_nolock()) ffff99d944d12800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:1.0:1777051472.822609:0:108750:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff99da46203380) has no exports 00000100:00100000:1.0:1777051472.822705:0:3676:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d9418f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3676:1863365452691456:0@lo:9:umount.0 00000100:00100000:1.0:1777051472.823599:0:3676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051472.823656:0:3676:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d9418f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3676:1863365452691584:0@lo:9:umount.0 00000100:00100000:1.0:1777051472.823703:0:3676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051472.824611:0:55805:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452691456 00000100:00100000:1.0:1777051472.824624:0:55805:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452691456 00000100:00100000:1.0:1777051472.824698:0:55805:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452691584 00000100:00100000:1.0:1777051472.824703:0:55805:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452691584 00000100:00100000:1.0:1777051472.824764:0:55805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8098 00000100:00100000:1.0:1777051472.824780:0:55805:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d9418f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:3676:x1863365452691456:12345-0@lo:9:umount.0 00000020:00000080:1.0:1777051472.824821:0:55805:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x85f51a6b96714bc5 00000100:00080000:1.0:1777051472.824834:0:55805:0:(import.c:65:import_set_state_nolock()) ffff99da44f19000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1777051472.824904:0:55805:0:(tgt_lastrcvd.c:732:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294968373 00000100:00100000:1.0:1777051472.825545:0:55805:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d9418f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+3:3676:x1863365452691456:12345-0@lo:9:umount.0 Request processed in 379us (1563us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051472.825568:0:55805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8098 00000100:00100000:1.0:1777051472.825606:0:55805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8099 00000100:00100000:1.0:1777051472.825619:0:55805:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d9418f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3676:x1863365452691584:12345-0@lo:9:umount.0 00000020:00000080:1.0:1777051472.825649:0:55805:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x85f51a6b96714bd3 00000100:00080000:1.0:1777051472.825661:0:55805:0:(import.c:65:import_set_state_nolock()) ffff99d942e06000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1777051472.825699:0:55805:0:(tgt_lastrcvd.c:732:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294968376 00000100:00100000:1.0:1777051472.825869:0:55805:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d9418f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+2:3676:x1863365452691584:12345-0@lo:9:umount.0 Request processed in 251us (2164us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051472.825887:0:55805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8099 00000100:00080000:1.0:1777051472.825978:0:3676:0:(import.c:65:import_set_state_nolock()) ffff99d942fb3800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1777051472.825998:0:3676:0:(osp_dev.c:1613:osp_import_event()) got disconnected 00000004:00080000:1.0:1777051472.826002:0:3676:0:(osp_dev.c:1629:osp_import_event()) got inactive 00000100:00100000:1.0:1777051472.826014:0:3676:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d9418f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3676:1863365452691456:0@lo:9:umount.0 00000100:00080000:1.0:1777051472.826037:0:3676:0:(import.c:65:import_set_state_nolock()) ffff99d944d12800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1777051472.826053:0:3676:0:(osp_dev.c:1613:osp_import_event()) got disconnected 00000004:00080000:1.0:1777051472.826057:0:3676:0:(osp_dev.c:1629:osp_import_event()) got inactive 00000100:00100000:1.0:1777051472.826062:0:3676:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d9418f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3676:1863365452691584:0@lo:9:umount.0 00000100:00080000:1.0:1777051472.826344:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000040:00080000:1.0:1777051472.826859:0:108750:0:(llog_cat.c:391:llog_cat_set_first_idx()) catlog [0x240000401:0x1:0x0] first idx 2, last_idx 4 00000040:00080000:1.0:1777051472.826941:0:108750:0:(llog_cat.c:391:llog_cat_set_first_idx()) catlog [0x240000401:0x1:0x0] first idx 3, last_idx 4 00000100:00100000:1.0:1777051472.850542:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051472.850762:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051472.850803:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051472.850837:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051472.850872:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051472.850910:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051472.850956:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051472.851005:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051472.851118:0:46497:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426095872 00000100:00100000:1.0:1777051472.851131:0:46497:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426095872 00000100:00100000:1.0:1777051472.851322:0:46497:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426095744 00000100:00100000:1.0:1777051472.851330:0:46497:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426095744 00000100:00100000:1.0:1777051472.851374:0:46497:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426096384 00000100:00100000:1.0:1777051472.851380:0:46497:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426096384 00000100:00100000:1.0:1777051472.851434:0:46497:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426096256 00000100:00100000:1.0:1777051472.851440:0:46497:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426096256 00000100:00100000:1.0:1777051472.851482:0:46497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13467 00000100:00100000:1.0:1777051472.851506:0:46497:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d9418f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:c11b6966-0775-44d2-bdc6-c74c26eb2226+9:2436:x1863365426095872:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:1.0:1777051472.851631:0:46497:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d9418f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:c11b6966-0775-44d2-bdc6-c74c26eb2226+9:2436:x1863365426095872:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 128us (1106us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051472.851647:0:46497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13467 00000100:00100000:1.0:1777051472.851686:0:46497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13468 00000100:00100000:1.0:1777051472.851706:0:46497:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7cd9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+54:2436:x1863365426096384:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:1.0:1777051472.851766:0:46497:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7cd9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+54:2436:x1863365426096384:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 62us (891us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051472.851784:0:46497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13468 00000100:00100000:1.0:1777051472.851812:0:46497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112388 00000100:00100000:1.0:1777051472.851825:0:46497:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d9418f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:0+-99:2437:x1863365426095744:12345-192.168.201.46@tcp:400:kworker.0 00000020:00080000:1.0:1777051472.851835:0:46497:0:(tgt_handler.c:795:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.201.46@tcp 00000100:00100000:1.0:1777051472.851875:0:46497:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d9418f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:0+-99:2437:x1863365426095744:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 48us (1116us total) trans 0 rc -107/-107 00000100:00100000:1.0:1777051472.851883:0:46497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112388 00000100:00100000:1.0:1777051472.851906:0:46497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112389 00000100:00100000:1.0:1777051472.851914:0:46497:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5fbedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:0+-99:2437:x1863365426096256:12345-192.168.201.46@tcp:400:kworker.0 00000020:00080000:1.0:1777051472.851925:0:46497:0:(tgt_handler.c:795:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.201.46@tcp 00000100:00100000:1.0:1777051472.851965:0:46497:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5fbedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:0+-99:2437:x1863365426096256:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 48us (1059us total) trans 0 rc -107/-107 00000100:00100000:1.0:1777051472.851979:0:46497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112389 00000100:00100000:1.0:1777051472.852037:0:24468:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426096128 00000100:00100000:1.0:1777051472.852045:0:24468:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426096128 00000100:00100000:1.0:1777051472.852099:0:24468:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426096000 00000100:00100000:1.0:1777051472.852106:0:24468:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426096000 00000100:00100000:1.0:1777051472.852146:0:24468:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426096640 00000100:00100000:1.0:1777051472.852158:0:24468:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426096640 00000100:00100000:1.0:1777051472.852620:0:24468:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426096512 00000100:00100000:1.0:1777051472.852628:0:24468:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426096512 00000100:00100000:1.0:1777051472.852672:0:24468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10499 00000100:00100000:1.0:1777051472.852685:0:24468:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d9418f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+48:2436:x1863365426096128:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:1.0:1777051472.852754:0:24468:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d9418f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+48:2436:x1863365426096128:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 70us (1949us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051472.852768:0:24468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10499 00000100:00100000:1.0:1777051472.852797:0:24468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10500 00000100:00100000:1.0:1777051472.852808:0:24468:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d9418f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+51:2437:x1863365426096000:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:1.0:1777051472.852868:0:24468:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d9418f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+51:2437:x1863365426096000:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 55us (2023us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051472.852881:0:24468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10500 00000100:00100000:1.0:1777051472.852910:0:24468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10501 00000100:00100000:1.0:1777051472.852924:0:24468:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5fbed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+50:2436:x1863365426096640:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:1.0:1777051472.852981:0:24468:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5fbed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+50:2436:x1863365426096640:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 58us (2024us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051472.852999:0:24468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10501 00000100:00100000:1.0:1777051472.853025:0:24468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10502 00000100:00100000:1.0:1777051472.853044:0:24468:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5fbee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+53:2437:x1863365426096512:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:1.0:1777051472.853097:0:24468:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5fbee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+53:2437:x1863365426096512:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 55us (2091us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051472.853116:0:24468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10502 00000100:00080000:1.0:1777051472.857967:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1777051472.857976:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1777051472.857987:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1777051472.871677:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051472.871741:0:8492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426096768 00000100:00100000:1.0:1777051472.871753:0:8492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426096768 00000100:00100000:1.0:1777051472.871822:0:8492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112390 00000100:00100000:1.0:1777051472.871834:0:8492:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5fbeca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2435:x1863365426096768:12345-192.168.201.46@tcp:38:ptlrpcd_00_01.0 00010000:02000000:1.0:1777051472.871868:0:8492:0:(ldlm_lib.c:1193:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.201.46@tcp (stopping) 00000100:00100000:1.0:1777051472.905460:0:8492:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5fbeca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2435:x1863365426096768:12345-192.168.201.46@tcp:38:ptlrpcd_00_01.0 Request processed in 33610us (33777us total) trans 0 rc -19/-19 00000100:00100000:1.0:1777051472.905479:0:8492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112390 00000100:00100000:1.0:1777051472.905596:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051472.906108:0:46494:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426096896 00000100:00100000:1.0:1777051472.906122:0:46494:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426096896 00000100:00100000:1.0:1777051472.906180:0:46494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112391 00000100:00100000:1.0:1777051472.906195:0:46494:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5fbee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:0+-99:2435:x1863365426096896:12345-192.168.201.46@tcp:38:ptlrpcd_00_01.0 00010000:02000000:1.0:1777051472.906315:0:46494:0:(ldlm_lib.c:1193:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.201.46@tcp (stopping) 00000100:00100000:1.0:1777051472.906379:0:46494:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5fbee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:0+-99:2435:x1863365426096896:12345-192.168.201.46@tcp:38:ptlrpcd_00_01.0 Request processed in 182us (783us total) trans 0 rc -19/-19 00000100:00100000:1.0:1777051472.906395:0:46494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112391 00000100:00100000:1.0:1777051472.949431:0:6585:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452691328 00000100:00100000:1.0:1777051472.949468:0:6585:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452691328 00000100:00100000:1.0:1777051472.949555:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8319 00000100:00100000:1.0:1777051472.949573:0:6585:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d9418f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3676:x1863365452691328:12345-0@lo:39:umount.0 00000020:00000080:1.0:1777051472.949623:0:6585:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x85f51a6b96714fdf 00000100:00080000:1.0:1777051472.949651:0:6585:0:(import.c:65:import_set_state_nolock()) ffff99da71c6d000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1777051472.949672:0:6585:0:(tgt_lastrcvd.c:732:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934760 00000100:00100000:1.0:1777051472.950325:0:6585:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d9418f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+3:3676:x1863365452691328:12345-0@lo:39:umount.0 Request processed in 753us (273662us total) trans 8589934761 rc 0/0 00000100:00100000:1.0:1777051472.950341:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8319 00000100:00080000:1.0:1777051472.950453:0:3676:0:(import.c:65:import_set_state_nolock()) ffff99da42f4c800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1777051472.950468:0:3676:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d9418f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3676:1863365452691328:0@lo:39:umount.0 00010000:00010000:1.0:1777051472.979428:0:108751:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051472.979436:0:108751:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051472.979439:0:108751:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051472.979456:0:6567:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003b773f6d/0x85f51a6b96717738 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051472.979480:0:6567:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da7d774800 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:1.0:1777051472.979489:0:6567:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003b773f6d/0x85f51a6b96717738 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051472.979507:0:6567:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003b773f6d/0x85f51a6b96717738 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051472.979541:0:6567:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003b773f6d/0x85f51a6b96717738 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051472.979565:0:6567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003b773f6d/0x85f51a6b96717738 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051472.979599:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051472.979602:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051472.979605:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1777051473.026869:0:6568:0:(genops.c:906:class_export_put()) final put ffff99d9410ca800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1777051473.026977:0:48457:0:(genops.c:865:class_export_destroy()) destroying export ffff99d9410ca800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:1.0:1777051473.027072:0:48457:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99d9410cc800 for lustre-MDT0000 00010000:00010000:3.0:1777051473.027130:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051473.027136:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051473.027140:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777051473.027425:0:3677:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1777051473.027454:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7fdf0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452691712:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1777051473.027539:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051473.027592:0:46500:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452691712 00000100:00100000:3.0:1777051473.027603:0:46500:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452691712 00000100:00100000:3.0:1777051473.027995:0:46500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8320 00000100:00100000:3.0:1777051473.028008:0:46500:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fdf0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:0+-99:3677:x1863365452691712:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:3.0:1777051473.028021:0:46500:0:(tgt_handler.c:795:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1777051473.028088:0:46500:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fdf0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:0+-99:3677:x1863365452691712:12345-0@lo:41:osp-pre-0-1.0 Request processed in 78us (547us total) trans 0 rc -107/-107 00000100:00100000:3.0:1777051473.028101:0:46500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8320 00000100:02020000:3.0:1777051473.028155:0:3677:0:(client.c:1490:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00010000:00010000:0.0:1777051473.033110:0:108751:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777051473.036980:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777051473.036987:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777051473.036991:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1777051473.041630:0:3677:0:(recover.c:203:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1777051473.041639:0:3677:0:(import.c:65:import_set_state_nolock()) ffff99da5f3d6000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1777051473.041646:0:3677:0:(import.c:181:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000020:00000080:0.0:1777051473.043057:0:38719:0:(genops.c:906:class_export_put()) final put ffff99d941c41800/2dd4696c-edce-4cd1-86d2-dbd2ff957fa1 00010000:00010000:0.0:1777051473.043087:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777051473.043091:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777051473.043095:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1777051473.043822:0:84827:0:(genops.c:865:class_export_destroy()) destroying export ffff99d941c41800/2dd4696c-edce-4cd1-86d2-dbd2ff957fa1 for lustre-MDT0000 00000020:00000080:2.0:1777051473.043894:0:84827:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99da7b5fd800 for lustre-MDT0000 00000100:00080000:3.0:1777051473.065947:0:3677:0:(import.c:65:import_set_state_nolock()) ffff99da5f3d6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1777051473.065965:0:3677:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 7958 00000100:00080000:3.0:1777051473.065978:0:3677:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff99da5f3d6000 using connection 192.168.201.146@tcp/0@lo 00000100:00100000:2.0:1777051473.066406:0:3677:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d955505180 x1863365452691840/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1777051473.066493:0:3676:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955505180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3676:1863365452691840:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:2.0:1777051473.066667:0:3676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051473.067040:0:6584:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452691840 00000100:00100000:3.0:1777051473.067053:0:6584:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452691840 00000100:00100000:3.0:1777051473.067131:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8321 00000100:00100000:3.0:1777051473.067143:0:6584:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955505f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3676:x1863365452691840:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:3.0:1777051473.067168:0:6584:0:(ldlm_lib.c:1193:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1777051473.067308:0:6584:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955505f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3676:x1863365452691840:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 163us (640us total) trans 0 rc -19/-19 00000100:00100000:3.0:1777051473.067322:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8321 00000100:00080000:1.0:1777051473.067347:0:3676:0:(import.c:65:import_set_state_nolock()) ffff99da5f3d6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1777051473.067358:0:3676:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1777051473.067368:0:3676:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955505180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3676:1863365452691840:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:3.0:1777051473.175077:0:3680:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1777051473.175340:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955505180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3680:1863365452692096:0@lo:400:kworker.0 00000100:00100000:3.0:1777051473.175477:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051473.175542:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955507100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3680:1863365452691968:0@lo:400:kworker.0 00000100:00100000:3.0:1777051473.175599:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051473.175611:0:6579:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452692096 00000100:00100000:1.0:1777051473.175627:0:6579:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452692096 00000100:00100000:1.0:1777051473.175754:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112392 00000100:00100000:0.0:1777051473.176088:0:103166:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452691968 00000100:00100000:0.0:1777051473.176100:0:103166:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452691968 00000100:00100000:1.0:1777051473.176118:0:6579:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fdf1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3680:x1863365452692096:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1777051473.176136:0:6579:0:(tgt_handler.c:795:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1777051473.176170:0:103166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1777051473.176190:0:103166:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7d9cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9351a01-5b0e-4470-97fd-58b9b4b312a2+18:3680:x1863365452691968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777051473.176307:0:6579:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fdf1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3680:x1863365452692096:12345-0@lo:400:kworker.0 Request processed in 197us (828us total) trans 0 rc -107/-107 00000100:00100000:1.0:1777051473.176323:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112392 00000100:00100000:0.0:1777051473.176355:0:103166:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7d9cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9351a01-5b0e-4470-97fd-58b9b4b312a2+18:3680:x1863365452691968:12345-0@lo:400:kworker.0 Request processed in 168us (752us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051473.176372:0:103166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00080000:1.0:1777051473.176417:0:3680:0:(recover.c:203:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1777051473.176427:0:3680:0:(import.c:65:import_set_state_nolock()) ffff99d94183b000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1777051473.176439:0:3680:0:(import.c:181:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1777051473.176454:0:3680:0:(import.c:65:import_set_state_nolock()) ffff99d94183b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1777051473.176467:0:3680:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 7929 00000100:00080000:1.0:1777051473.176479:0:3680:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff99d94183b000 using connection 192.168.201.146@tcp/0@lo 00000100:00100000:0.0:1777051473.176487:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955505500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3679:1863365452692480:0@lo:400:kworker.0 00000100:00100000:2.0:1777051473.176526:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955504000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3678:1863365452692352:0@lo:400:kworker.0 00000100:00100000:0.0:1777051473.176540:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051473.176584:0:3679:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1777051473.176587:0:3680:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99da5fbef100 x1863365452692992/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1777051473.176587:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051473.176596:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d96040aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452692608:0@lo:400:kworker.0 00000100:00100000:2.0:1777051473.176621:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95f864a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3678:1863365452692864:0@lo:400:kworker.0 00000100:00100000:1.0:1777051473.176653:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955505180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3680:1863365452692096:0@lo:400:kworker.0 00000100:00100000:0.0:1777051473.176672:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051473.176672:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051473.176689:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955507100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3680:1863365452691968:0@lo:400:kworker.0 00000100:00100000:2.0:1777051473.177517:0:3678:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1777051473.177522:0:6581:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452692480 00000100:00100000:2.0:1777051473.177532:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955504700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3678:1863365452692224:0@lo:400:kworker.0 00000100:00100000:3.0:1777051473.177532:0:6581:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452692480 00000100:00100000:2.0:1777051473.177576:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051473.177593:0:6581:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452692352 00000100:00100000:3.0:1777051473.177599:0:6581:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452692352 00000100:00100000:2.0:1777051473.177608:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95fae8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452692736:0@lo:400:kworker.0 00000100:00100000:3.0:1777051473.177624:0:6581:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452692864 00000100:00100000:3.0:1777051473.177629:0:6581:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452692864 00000100:00100000:2.0:1777051473.177644:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051473.177650:0:6581:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452692224 00000100:00100000:3.0:1777051473.177654:0:6581:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452692224 00000100:00100000:2.0:1777051473.177689:0:24468:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452692608 00000100:00100000:3.0:1777051473.177692:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13469 00000100:00100000:2.0:1777051473.177696:0:24468:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452692608 00000100:00100000:3.0:1777051473.177705:0:6581:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7e24c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3679:x1863365452692480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777051473.177741:0:24468:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452692736 00000100:00100000:2.0:1777051473.177747:0:24468:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452692736 00000100:00100000:3.0:1777051473.177783:0:6581:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7e24c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3679:x1863365452692480:12345-0@lo:400:kworker.0 Request processed in 79us (1242us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051473.177787:0:24468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10503 00000100:00100000:3.0:1777051473.177796:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13469 00000100:00100000:2.0:1777051473.177799:0:24468:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f42dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3679:x1863365452692608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051473.177819:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13470 00000100:00100000:3.0:1777051473.177829:0:6581:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955611c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3678:x1863365452692224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777051473.177857:0:24468:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f42dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3679:x1863365452692608:12345-0@lo:400:kworker.0 Request processed in 60us (1189us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051473.177870:0:24468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10503 00000100:00100000:3.0:1777051473.177880:0:6581:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955611c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3678:x1863365452692224:12345-0@lo:400:kworker.0 Request processed in 52us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051473.177891:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13470 00000100:00100000:2.0:1777051473.177893:0:24468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10504 00000100:00100000:2.0:1777051473.177904:0:24468:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955610700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3678:x1863365452692736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051473.177911:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112393 00000100:00100000:3.0:1777051473.177918:0:6581:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da45f76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3678:x1863365452692352:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1777051473.177927:0:6581:0:(tgt_handler.c:795:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1777051473.177952:0:24468:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955610700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3678:x1863365452692736:12345-0@lo:400:kworker.0 Request processed in 49us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051473.177960:0:6581:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da45f76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3678:x1863365452692352:12345-0@lo:400:kworker.0 Request processed in 41us (1380us total) trans 0 rc -107/-107 00000100:00100000:2.0:1777051473.177963:0:24468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10504 00000100:00100000:3.0:1777051473.177972:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112393 00000100:00100000:3.0:1777051473.177992:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112394 00000100:00100000:3.0:1777051473.177999:0:6581:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955612680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3678:x1863365452692864:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1777051473.178009:0:6581:0:(tgt_handler.c:795:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1777051473.178057:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955504700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3678:1863365452692224:0@lo:400:kworker.0 00000100:00100000:3.0:1777051473.178059:0:6581:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955612680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3678:x1863365452692864:12345-0@lo:400:kworker.0 Request processed in 58us (1394us total) trans 0 rc -107/-107 00000100:00100000:3.0:1777051473.178070:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112394 00000100:00100000:2.0:1777051473.178075:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95fae8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452692736:0@lo:400:kworker.0 00000100:00080000:2.0:1777051473.178090:0:3678:0:(recover.c:203:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1777051473.178096:0:3678:0:(import.c:65:import_set_state_nolock()) ffff99da5f282000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1777051473.178103:0:3678:0:(import.c:181:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1777051473.178110:0:3678:0:(import.c:65:import_set_state_nolock()) ffff99da5f282000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1777051473.178115:0:3678:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 7929 00000100:00080000:2.0:1777051473.178123:0:3678:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff99da5f282000 using connection 192.168.201.146@tcp/0@lo 00000100:00100000:2.0:1777051473.178151:0:3678:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d955613800 x1863365452693120/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1777051473.178166:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1777051473.178177:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1777051473.178180:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955504000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3678:1863365452692352:0@lo:400:kworker.0 00000100:00080000:1.0:1777051473.178183:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1777051473.178267:0:3676:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5fbef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3676:1863365452692992:0@lo:38:ptlrpcd_00_03.0 00000100:00080000:2.0:1777051473.178276:0:3678:0:(recover.c:203:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1777051473.178283:0:3678:0:(import.c:65:import_set_state_nolock()) ffff99da7dbe9000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1777051473.178291:0:3678:0:(import.c:181:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1777051473.178297:0:3678:0:(import.c:65:import_set_state_nolock()) ffff99da7dbe9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1777051473.178303:0:3678:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 7958 00000100:00080000:2.0:1777051473.178309:0:3678:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff99da7dbe9000 using connection 192.168.201.146@tcp/0@lo 00000100:00100000:3.0:1777051473.178315:0:3676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051473.178333:0:3678:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d955611f80 x1863365452693248/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1777051473.178356:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95f864a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3678:1863365452692864:0@lo:400:kworker.0 00000100:00100000:3.0:1777051473.178356:0:3676:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955613800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3676:1863365452693120:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:3.0:1777051473.178405:0:3676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051473.178441:0:6581:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452692992 00000100:00100000:1.0:1777051473.178453:0:6581:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452692992 00000100:00100000:3.0:1777051473.178462:0:3676:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955611f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3676:1863365452693248:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:2.0:1777051473.178464:0:27885:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452693120 00000100:00100000:2.0:1777051473.178473:0:27885:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452693120 00000100:00100000:1.0:1777051473.178520:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112395 00000100:00100000:3.0:1777051473.178522:0:3676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051473.178540:0:6581:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fdf2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3676:x1863365452692992:12345-0@lo:38:ptlrpcd_00_03.0 00000100:00100000:2.0:1777051473.178542:0:27885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112396 00000100:00100000:2.0:1777051473.178564:0:27885:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da4384f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:0+-99:3676:x1863365452693120:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:1.0:1777051473.178575:0:6581:0:(ldlm_lib.c:1193:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1777051473.178577:0:46494:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452693248 00010000:02000000:2.0:1777051473.178586:0:27885:0:(ldlm_lib.c:1193:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1777051473.178586:0:46494:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452693248 00000100:00100000:3.0:1777051473.178632:0:46494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112397 00000100:00100000:3.0:1777051473.178643:0:46494:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da4384e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:0+-99:3676:x1863365452693248:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:3.0:1777051473.178661:0:46494:0:(ldlm_lib.c:1193:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1777051473.178680:0:6581:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fdf2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3676:x1863365452692992:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 139us (359us total) trans 0 rc -19/-19 00000100:00100000:2.0:1777051473.178684:0:27885:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da4384f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:0+-99:3676:x1863365452693120:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 117us (277us total) trans 0 rc -19/-19 00000100:00100000:3.0:1777051473.178705:0:46494:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da4384e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:0+-99:3676:x1863365452693248:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 62us (191us total) trans 0 rc -19/-19 00000100:00100000:1.0:1777051473.178714:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112395 00000100:00080000:1.0:1777051473.179099:0:3676:0:(import.c:65:import_set_state_nolock()) ffff99da7dbe9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1777051473.179109:0:3676:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1777051473.179117:0:3676:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955611f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3676:1863365452693248:0@lo:38:ptlrpcd_00_01.0 00000100:00080000:1.0:1777051473.179136:0:3676:0:(import.c:65:import_set_state_nolock()) ffff99d94183b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1777051473.179145:0:3676:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1777051473.179152:0:3676:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5fbef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3676:1863365452692992:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:0.0:1777051473.179531:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d96040aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452692608:0@lo:400:kworker.0 00000100:00080000:1.0:1777051473.179549:0:3676:0:(import.c:65:import_set_state_nolock()) ffff99da5f282000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1777051473.179558:0:3676:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1777051473.179570:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955505500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3679:1863365452692480:0@lo:400:kworker.0 00000100:00100000:1.0:1777051473.179571:0:3676:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955613800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3676:1863365452693120:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:2.0:1777051473.179824:0:27885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112396 00000100:00100000:3.0:1777051473.179833:0:46494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112397 00000001:00020000:1.0:1777051473.326388:0:6580:0:(mdt_hsm_cdt_client.c:366:mdt_hsm_register_hal()) cfs_fail_timeout id 164 awake 00000040:00080000:1.0:1777051473.343620:0:6580:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2b:0x0].11, 136 off9688 00010000:00000080:1.0:1777051473.344133:0:6580:0:(ldlm_lib.c:3285:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff99da45f75f80 x1863365426095104/t0(0) o58->c11b6966-0775-44d2-bdc6-c74c26eb2226@192.168.201.46@tcp:429/0 lens 512/224 e 0 to 0 dl 1777051479 ref 1 fl Interpret:/200/0 rc 0/0 job:'md5sum.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1777051473.344153:0:6580:0:(niobuf.c:745:ptlrpc_send_reply()) sending ENODEV from failed obd 5 00000100:00100000:1.0:1777051473.344280:0:6580:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da45f75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+1:139487:x1863365426095104:12345-192.168.201.46@tcp:58:md5sum.0 Request processed in 5022307us (5022476us total) trans 0 rc -19/-19 00000100:00100000:1.0:1777051473.344298:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112384 00000020:00000080:1.0:1777051473.344319:0:6580:0:(genops.c:906:class_export_put()) final put ffff99d941c41000/c11b6966-0775-44d2-bdc6-c74c26eb2226 00000020:00000080:3.0:1777051473.344424:0:107953:0:(genops.c:865:class_export_destroy()) destroying export ffff99d941c41000/c11b6966-0775-44d2-bdc6-c74c26eb2226 for lustre-MDT0000 00000020:00000080:3.0:1777051473.344514:0:107953:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99d944c1a000 for lustre-MDT0000 00010000:00010000:0.0:1777051473.346965:0:103189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99d953285000/0x85f51a6b96717715 lrc: 3/0,1 mode: EX/EX res: [0x2000032e3:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000020 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051473.346986:0:103189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d953285000/0x85f51a6b96717715 lrc: 2/0,0 mode: EX/EX res: [0x2000032e3:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000020 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051473.346999:0:103189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d953285000/0x85f51a6b96717715 lrc: 3/0,0 mode: EX/EX res: [0x2000032e3:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000020 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051473.347010:0:103189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d953285000 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:0.0:1777051473.347017:0:103189:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d953285000/0x85f51a6b96717715 lrc: 3/0,0 mode: EX/EX res: [0x2000032e3:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000020 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051473.347029:0:103189:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d953285000/0x85f51a6b96717715 lrc: 4/0,0 mode: EX/EX res: [0x2000032e3:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000020 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051473.347054:0:103189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e3:0xb:0x0].0x0 (ffff99d94e52aa00) 00010000:00010000:0.0:1777051473.347060:0:103189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1777051473.347068:0:103189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d953285000/0x85f51a6b96717715 lrc: 2/0,0 mode: --/EX res: [0x2000032e3:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000020 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051473.347077:0:103189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d953285000/0x85f51a6b96717715 lrc: 0/0,0 mode: --/EX res: [0x2000032e3:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000020 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1777051473.356544:0:108750:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff99da46203380) has no exports 00000020:00000080:1.0:1777051473.415686:0:108750:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x85f51a6b96714b7f 00000020:00000080:1.0:1777051473.415707:0:108750:0:(genops.c:906:class_export_put()) final put ffff99d94419d000/lustre-QMT0000_UUID 00000020:01000000:1.0:1777051473.415747:0:108750:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:0.0:1777051473.416127:0:108750:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1777051473.416144:0:108750:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1777051473.416151:0:108750:0:(genops.c:1579:class_disconnect_exports()) OBD device 7 (ffff99da7f994d40) has no exports 00000020:00000080:2.0:1777051473.416159:0:84827:0:(genops.c:865:class_export_destroy()) destroying export ffff99d94419d000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:0.0:1777051473.417363:0:108750:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x85f51a6b96714b78 00000020:00000080:0.0:1777051473.417375:0:108750:0:(genops.c:906:class_export_put()) final put ffff99da44f1d800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1777051473.417514:0:84827:0:(genops.c:865:class_export_destroy()) destroying export ffff99da44f1d800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1777051473.417637:0:108750:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1777051473.417658:0:108750:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1777051473.417663:0:108750:0:(genops.c:906:class_export_put()) final put ffff99da44f1e000/lustre-QMT0000_UUID 00000020:00000080:0.0:1777051473.417667:0:108750:0:(genops.c:865:class_export_destroy()) destroying export ffff99da44f1e000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:0.0:1777051473.417677:0:108750:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:01000000:0.0:1777051473.417878:0:108750:0:(lprocfs_status_server.c:298:lprocfs_free_client_stats()) stat ffff99d9441c2c60 - data ffff99d94a3a3870/ffff99d9434fa400 00000020:01000000:0.0:1777051473.418046:0:108750:0:(lprocfs_status_server.c:298:lprocfs_free_client_stats()) stat ffff99d959fcf720 - data ffff99d94a27e6c0/ffff99da5fa39c00 00000100:00080000:1.0:1777051473.464877:0:108750:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1777051473.464887:0:108750:0:(client.c:3101:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 8589934760 gen 4 00000100:00100000:1.0:1777051473.464910:0:108750:0:(client.c:3139:ptlrpc_free_committed()) @@@ free request with old gen req@ffff99d9418f4380 x1863365452691328/t8589934761(8589934761) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1777051482 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1777051473.464945:0:108750:0:(import.c:321:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:1.0:1777051473.467643:0:108750:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1777051473.467650:0:108750:0:(client.c:3101:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968369 gen 4 00000004:00080000:1.0:1777051473.467689:0:108750:0:(osp_dev.c:1629:osp_import_event()) got inactive 00000100:00100000:1.0:1777051473.467693:0:108750:0:(import.c:321:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1777051473.468391:0:103177:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1777051473.468400:0:103177:0:(llog.c:858:llog_process_thread()) stop processing plain [0x1:0x27:0x0] index 5 count 2 00000040:00080000:2.0:1777051473.468416:0:103177:0:(llog.c:858:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 7 count 2 00000100:00080000:1.0:1777051473.469391:0:108750:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1777051473.469397:0:108750:0:(client.c:3101:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968374 gen 4 00000004:00080000:1.0:1777051473.469410:0:108750:0:(osp_dev.c:1629:osp_import_event()) got inactive 00000100:00100000:1.0:1777051473.469509:0:108750:0:(import.c:321:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1777051473.469864:0:103179:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1777051473.469871:0:103179:0:(llog.c:858:llog_process_thread()) stop processing plain [0x1:0x29:0x0] index 3 count 1 00000040:00080000:3.0:1777051473.469887:0:103179:0:(llog.c:858:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 7 count 2 00000020:00000080:2.0:1777051473.471538:0:108750:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x85f51a6b96714b2b 00000020:00000080:2.0:1777051473.471549:0:108750:0:(genops.c:906:class_export_put()) final put ffff99d941c45000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1777051473.471633:0:84827:0:(genops.c:865:class_export_destroy()) destroying export ffff99d941c45000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1777051473.474429:0:108750:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x85f51a6b96714b40 00000020:00000080:2.0:1777051473.474468:0:108750:0:(genops.c:906:class_export_put()) final put ffff99d942fdc000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1777051473.474490:0:108750:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:2.0:1777051473.474497:0:108750:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1777051473.474508:0:108750:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1777051473.474514:0:108750:0:(genops.c:1579:class_disconnect_exports()) OBD device 4 (ffff99da7f9919c0) has no exports 00000020:00000080:3.0:1777051473.474551:0:84827:0:(genops.c:865:class_export_destroy()) destroying export ffff99d942fdc000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000004:01000000:2.0:1777051473.474819:0:108750:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1777051473.474830:0:108750:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x85f51a6b96714bcc 00000020:00000080:2.0:1777051473.474835:0:108750:0:(genops.c:906:class_export_put()) final put ffff99d958727800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1777051473.474854:0:108750:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:2.0:1777051473.474861:0:108750:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1777051473.474872:0:108750:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1777051473.474877:0:108750:0:(genops.c:1579:class_disconnect_exports()) OBD device 22 (ffff99da7f993380) has no exports 00000020:00000080:2.0:1777051473.474885:0:108750:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x85f51a6b96714bbe 00000020:00000080:2.0:1777051473.474890:0:108750:0:(genops.c:906:class_export_put()) final put ffff99d944d11000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1777051473.474905:0:84827:0:(genops.c:865:class_export_destroy()) destroying export ffff99d958727800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1777051473.474920:0:84827:0:(genops.c:865:class_export_destroy()) destroying export ffff99d944d11000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1777051473.475587:0:108750:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:2.0:1777051473.475594:0:108750:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1777051473.475599:0:108750:0:(client.c:3101:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968374 gen 5 00000004:00080000:2.0:1777051473.475606:0:108750:0:(osp_dev.c:1629:osp_import_event()) got inactive 00000100:00100000:2.0:1777051473.475610:0:108750:0:(import.c:321:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1777051473.475670:0:84827:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99d944d12800 for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1777051473.475682:0:108750:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1777051473.475695:0:108750:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1777051473.475701:0:108750:0:(genops.c:906:class_export_put()) final put ffff99d958e3e000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1777051473.475705:0:108750:0:(genops.c:865:class_export_destroy()) destroying export ffff99d958e3e000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:2.0:1777051473.475713:0:108750:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1777051473.476073:0:108750:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x85f51a6b96714bb0 00000020:00000080:2.0:1777051473.476082:0:108750:0:(genops.c:906:class_export_put()) final put ffff99d958e3a800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1777051473.476109:0:108750:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:2.0:1777051473.476115:0:108750:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1777051473.476122:0:108750:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1777051473.476127:0:108750:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff99da7f990000) has no exports 00000020:00000080:2.0:1777051473.476134:0:108750:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x85f51a6b96714ba2 00000020:00000080:2.0:1777051473.476141:0:108750:0:(genops.c:906:class_export_put()) final put ffff99d942fb4000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1777051473.476304:0:84827:0:(genops.c:865:class_export_destroy()) destroying export ffff99d958e3a800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1777051473.476323:0:84827:0:(genops.c:865:class_export_destroy()) destroying export ffff99d942fb4000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1777051473.476822:0:108750:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:2.0:1777051473.476828:0:108750:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1777051473.476831:0:108750:0:(client.c:3101:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968369 gen 5 00000004:00080000:2.0:1777051473.476837:0:108750:0:(osp_dev.c:1629:osp_import_event()) got inactive 00000100:00100000:2.0:1777051473.476840:0:108750:0:(import.c:321:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1777051473.476880:0:84827:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99d942fb3800 for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1777051473.476884:0:108750:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1777051473.476896:0:108750:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1777051473.476902:0:108750:0:(genops.c:906:class_export_put()) final put ffff99da7d8c4000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1777051473.476907:0:108750:0:(genops.c:865:class_export_destroy()) destroying export ffff99da7d8c4000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:2.0:1777051473.476915:0:108750:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000004:01000000:2.0:1777051473.476985:0:108750:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:2.0:1777051473.476994:0:108750:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x85f51a6b96714b94 00000020:00000080:2.0:1777051473.477001:0:108750:0:(genops.c:906:class_export_put()) final put ffff99da7d8c7800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1777051473.477024:0:108750:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:2.0:1777051473.477029:0:108750:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1777051473.477035:0:108750:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1777051473.477040:0:108750:0:(genops.c:1579:class_disconnect_exports()) OBD device 8 (ffff99d941e68000) has no exports 00000020:00000080:2.0:1777051473.477045:0:108750:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x85f51a6b96714b8d 00000020:00000080:2.0:1777051473.477051:0:108750:0:(genops.c:906:class_export_put()) final put ffff99da42f4f800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1777051473.477062:0:84827:0:(genops.c:865:class_export_destroy()) destroying export ffff99da7d8c7800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:3.0:1777051473.477076:0:84827:0:(genops.c:865:class_export_destroy()) destroying export ffff99da42f4f800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:3.0:1777051473.481282:0:108750:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:3.0:1777051473.481287:0:108750:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1777051473.481292:0:108750:0:(client.c:3101:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 8589934760 gen 5 00000100:00100000:3.0:1777051473.481301:0:108750:0:(import.c:321:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1777051473.481399:0:108750:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1777051473.481400:0:84827:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99da42f4c800 for lustre-MDT0001-osp-MDT0000 00000020:00000080:3.0:1777051473.481415:0:108750:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1777051473.481424:0:108750:0:(genops.c:906:class_export_put()) final put ffff99da7d8c6000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1777051473.481428:0:108750:0:(genops.c:865:class_export_destroy()) destroying export ffff99da7d8c6000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:3.0:1777051473.481439:0:108750:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1777051473.481623:0:108750:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1777051473.481633:0:108750:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1777051473.481638:0:108750:0:(genops.c:906:class_export_put()) final put ffff99da5f282800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1777051473.481642:0:108750:0:(genops.c:865:class_export_destroy()) destroying export ffff99da5f282800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:3.0:1777051473.481650:0:108750:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1777051473.481752:0:108750:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x85f51a6b96714b47 00000020:00000080:3.0:1777051473.481759:0:108750:0:(genops.c:906:class_export_put()) final put ffff99d942fdf800/lustre-MDD0000_UUID 00000020:01000000:3.0:1777051473.481775:0:108750:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:3.0:1777051473.481780:0:108750:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1777051473.481786:0:108750:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1777051473.481791:0:108750:0:(genops.c:1579:class_disconnect_exports()) OBD device 6 (ffff99da46200000) has no exports 00000020:00000080:1.0:1777051473.481800:0:84827:0:(genops.c:865:class_export_destroy()) destroying export ffff99d942fdf800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:3.0:1777051473.481834:0:108750:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1777051473.481839:0:108750:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:3.0:1777051473.481843:0:108750:0:(genops.c:906:class_export_put()) final put ffff99da48b2d000/lustre-MDD0000_UUID 00000020:00000080:3.0:1777051473.481845:0:108750:0:(genops.c:865:class_export_destroy()) destroying export ffff99da48b2d000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:3.0:1777051473.481851:0:108750:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:3.0:1777051473.481946:0:108750:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x85f51a6b96714b4e 00000020:00000080:3.0:1777051473.481955:0:108750:0:(genops.c:906:class_export_put()) final put ffff99d942fdc800/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1777051473.481978:0:108750:0:(tgt_mount.c:185:server_put_mount()) put mount ffff99da5f2be000 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1777051473.481984:0:84827:0:(genops.c:865:class_export_destroy()) destroying export ffff99d942fdc800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000004:3.0:1777051473.481984:0:108750:0:(obd_mount.c:701:lustre_put_lsi()) put ffff99da5f2be000 3 00000020:01000004:3.0:1777051473.481992:0:108750:0:(tgt_mount.c:118:server_deregister_mount()) deregister mount ffff99da5f2be000 from lustre-MDT0000 00000020:00000080:3.0:1777051473.482034:0:108750:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1777051473.482051:0:108750:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:3.0:1777051473.482055:0:108750:0:(genops.c:906:class_export_put()) final put ffff99da48b2f000/lustre-MDT0000_UUID 00000020:00000080:3.0:1777051473.482059:0:108750:0:(genops.c:865:class_export_destroy()) destroying export ffff99da48b2f000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:3.0:1777051473.482069:0:108750:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:3.0:1777051473.482151:0:108750:0:(obd_mount.c:569:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:3.0:1777051473.482157:0:108750:0:(tgt_mount.c:253:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:3.0:1777051473.482163:0:108750:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:3.0:1777051473.482168:0:108750:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1777051473.482173:0:108750:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 2/5 00000020:00080000:3.0:1777051473.482184:0:108750:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff99d958725000 29c4352d-3260-4734-909d-9ea5de9e7fa4 192.168.201.46@tcp 11 (0 0 7) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1777051473.482254:0:108750:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff99d958e39800 f9351a01-5b0e-4470-97fd-58b9b4b312a2 0@lo 17 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1777051473.482264:0:108750:0:(genops.c:1574:class_disconnect_exports()) OBD device 1 (ffff99d941ce3380) has exports, disconnecting them 00000020:00080000:3.0:1777051473.482273:0:108750:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 192.168.201.46@tcp (ffff99d958725000), last request at 1777051302 00000020:00000080:3.0:1777051473.482301:0:108750:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x85f51a6b96714f3e 00000020:00010000:3.0:1777051473.482317:0:108750:0:(genops.c:1942:obd_stale_export_put()) Put export ffff99d958725000: total 0 00000100:00080000:3.0:1777051473.482325:0:108750:0:(import.c:65:import_set_state_nolock()) ffff99d958725800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1777051473.482348:0:108750:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.201.46@tcp (ffff99d958725000): rc 0 00000020:00080000:3.0:1777051473.482356:0:108750:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff99d958e39800), last request at 1777051294 00000020:00010000:1.0:1777051473.482366:0:6567:0:(genops.c:1928:obd_stale_export_get()) Get export ffff99d958725000: total 0 00010000:00010000:1.0:1777051473.482465:0:6567:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff99d958725000, canceled 0 locks, left on hash table 7. 00000020:00000080:3.0:1777051473.482485:0:108750:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x85f51a6b96714af3 00000020:00010000:3.0:1777051473.482494:0:108750:0:(genops.c:1942:obd_stale_export_put()) Put export ffff99d958e39800: total 0 00000100:00080000:3.0:1777051473.482500:0:108750:0:(import.c:65:import_set_state_nolock()) ffff99d958e3f800 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1777051473.482524:0:6567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d954ea7a00/0x85f51a6b96714f5a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5ee0 expref: 8 pid: 103165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1777051473.482529:0:108750:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff99d958e39800): rc 0 00000020:00080000:3.0:1777051473.482540:0:108750:0:(genops.c:1579:class_disconnect_exports()) OBD device 1 (ffff99d941ce3380) has no exports 00000020:00010000:3.0:1777051473.482554:0:6568:0:(genops.c:1928:obd_stale_export_get()) Get export ffff99d958e39800: total 0 00010000:00010000:3.0:1777051473.482559:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051473.482567:0:6567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d943ebb600/0x85f51a6b967153dd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5f1f expref: 7 pid: 103163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051473.482595:0:6567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d95071ba00/0x85f51a6b967150aa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5f0a expref: 6 pid: 103165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051473.482626:0:6568:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff99d958e39800, canceled 0 locks, left on hash table 13. 00010000:00010000:1.0:1777051473.482632:0:6567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d954ea6a00/0x85f51a6b96714f6f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5ef5 expref: 5 pid: 103169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051473.482658:0:6567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99da713e3a00/0x85f51a6b967153d6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5f18 expref: 4 pid: 103163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051473.482668:0:6568:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d953298a00/0x85f51a6b9671506b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x85f51a6b96715064 expref: 14 pid: 103166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051473.482691:0:6567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d95071a600/0x85f51a6b967150b1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5f11 expref: 3 pid: 103169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051473.482704:0:6568:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d941ad6600/0x85f51a6b967153a5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x85f51a6b9671539e expref: 13 pid: 103163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051473.482722:0:6567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d954ea6e00/0x85f51a6b96714f7d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5f03 expref: 2 pid: 103169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051473.482738:0:6568:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d94ffbdc00/0x85f51a6b96715095 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x85f51a6b9671508e expref: 12 pid: 103169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051473.482753:0:6567:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff99d958725000, canceled 7 locks, left on hash table 0. 00010000:00010000:3.0:1777051473.482776:0:6568:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99da7d785000/0x85f51a6b96714cba lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x85f51a6b96714cb3 expref: 11 pid: 103165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051473.482805:0:6568:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d953298800/0x85f51a6b96714fa7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x85f51a6b96714fa0 expref: 10 pid: 103168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1777051473.482819:0:6567:0:(genops.c:906:class_export_put()) final put ffff99d958725000/29c4352d-3260-4734-909d-9ea5de9e7fa4 00010000:00010000:3.0:1777051473.482831:0:6568:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d941ad6a00/0x85f51a6b967153c1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x85f51a6b967153ba expref: 9 pid: 103163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051473.482856:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051473.482863:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051473.482868:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051473.482870:0:6568:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99da713e3000/0x85f51a6b96714c2e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x85f51a6b96714c27 expref: 8 pid: 103163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1777051473.482883:0:84827:0:(genops.c:865:class_export_destroy()) destroying export ffff99d958725000/29c4352d-3260-4734-909d-9ea5de9e7fa4 for MGS 00010000:00010000:3.0:1777051473.482899:0:6568:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d94ffbc600/0x85f51a6b96714f99 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x85f51a6b96714f92 expref: 7 pid: 103166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1777051473.482959:0:84827:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99d958725800 for MGS 00010000:00010000:3.0:1777051473.482960:0:6568:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d9442eb400/0x85f51a6b96714c3c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x85f51a6b96714c35 expref: 6 pid: 103163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051473.482993:0:6568:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d954ea6200/0x85f51a6b967153cf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x85f51a6b967153c8 expref: 5 pid: 103163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051473.483023:0:6568:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99da7d784200/0x85f51a6b96714c58 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x85f51a6b96714c51 expref: 4 pid: 103168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051473.483044:0:6568:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d9442ea600/0x85f51a6b96714cd6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x85f51a6b96714ccf expref: 3 pid: 103163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051473.483057:0:6568:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99da7d785c00/0x85f51a6b96714c66 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x85f51a6b96714c5f expref: 2 pid: 103165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051473.483070:0:6568:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff99d958e39800, canceled 13 locks, left on hash table 0. 00000020:00000080:3.0:1777051473.483104:0:6568:0:(genops.c:906:class_export_put()) final put ffff99d958e39800/f9351a01-5b0e-4470-97fd-58b9b4b312a2 00010000:00010000:3.0:1777051473.483128:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051473.483133:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1777051473.483138:0:107953:0:(genops.c:865:class_export_destroy()) destroying export ffff99d958e39800/f9351a01-5b0e-4470-97fd-58b9b4b312a2 for MGS 00010000:00010000:3.0:1777051473.483138:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1777051473.483189:0:107953:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99d958e3f800 for MGS 00000100:00100000:0.0:1777051473.483310:0:103166:0:(service.c:3162:ptlrpc_main()) ll_mgs_0002: service thread [ffff99da7d92fc00:103166] 2 exiting: rc = 0 00000100:00100000:3.0:1777051473.483354:0:103165:0:(service.c:3162:ptlrpc_main()) ll_mgs_0001: service thread [ffff99d95688c400:103165] 1 exiting: rc = 0 00000100:00100000:3.0:1777051473.483489:0:103163:0:(service.c:3162:ptlrpc_main()) ll_mgs_0000: service thread [ffff99d95688d400:103163] 0 exiting: rc = 1 00000100:00100000:3.0:1777051473.483603:0:103168:0:(service.c:3162:ptlrpc_main()) ll_mgs_0003: service thread [ffff99da7ffc2e00:103168] 3 exiting: rc = 0 00000100:00100000:3.0:1777051473.483704:0:103169:0:(service.c:3162:ptlrpc_main()) ll_mgs_0004: service thread [ffff99d95b5c2c00:103169] 4 exiting: rc = 0 00000100:00100000:1.0:1777051473.483782:0:108750:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1777051473.483795:0:108750:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1777051473.483806:0:108750:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1777051473.483822:0:108750:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1777051473.483831:0:108750:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1777051473.483837:0:108750:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1777051473.483844:0:108750:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1777051473.483851:0:108750:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1777051473.483863:0:108750:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1777051473.483876:0:108750:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1777051473.483895:0:108750:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1777051473.483914:0:108750:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1777051473.483931:0:108750:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1777051473.483952:0:108750:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1777051473.483965:0:108750:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1777051473.483975:0:108750:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1777051473.483987:0:108750:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1777051473.483999:0:108750:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1777051473.484011:0:108750:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1777051473.484022:0:108750:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1777051473.484036:0:108750:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1777051473.484048:0:108750:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1777051473.484058:0:108750:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1777051473.484068:0:108750:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1777051473.484080:0:108750:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1777051473.484092:0:108750:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1777051473.484105:0:108750:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1777051473.484114:0:108750:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1777051473.484121:0:108750:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1777051473.484131:0:108750:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1777051473.484148:0:108750:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1777051473.484161:0:108750:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1777051473.484172:0:108750:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1777051473.484184:0:108750:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1777051473.484260:0:108750:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1777051473.484278:0:108750:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1777051473.484294:0:108750:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1777051473.484308:0:108750:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1777051473.484323:0:108750:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1777051473.484341:0:108750:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1777051473.484361:0:108750:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1777051473.484378:0:108750:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1777051473.484391:0:108750:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1777051473.484397:0:108750:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1777051473.484412:0:108750:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1777051473.484420:0:108750:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1777051473.484427:0:108750:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1777051473.484433:0:108750:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1777051473.484440:0:108750:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1777051473.484447:0:108750:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1777051473.484456:0:108750:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1777051473.484465:0:108750:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1777051473.484471:0:108750:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1777051473.484480:0:108750:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1777051473.484489:0:108750:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1777051473.484496:0:108750:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1777051473.484502:0:108750:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1777051473.484509:0:108750:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1777051473.484516:0:108750:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1777051473.484523:0:108750:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1777051473.484530:0:108750:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1777051473.484536:0:108750:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1777051473.484548:0:108750:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1777051473.484562:0:108750:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:1.0:1777051473.486886:0:108750:0:(lprocfs_status_server.c:298:lprocfs_free_client_stats()) stat ffff99d9434df420 - data ffff99da70c0a5e8/ffff99da7d83ac00 00000020:01000000:1.0:1777051473.487186:0:108750:0:(lprocfs_status_server.c:298:lprocfs_free_client_stats()) stat ffff99d943697a20 - data ffff99da5f43dca8/ffff99da6145f400 00000020:00000080:1.0:1777051473.488008:0:108750:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x85f51a6b96714aec 00000020:00000080:1.0:1777051473.488017:0:108750:0:(genops.c:906:class_export_put()) final put ffff99d944b1f800/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1777051473.488031:0:108750:0:(tgt_mount.c:185:server_put_mount()) put mount ffff99da5f2be000 from MGS, refs=2 00000020:01000004:1.0:1777051473.488036:0:108750:0:(obd_mount.c:701:lustre_put_lsi()) put ffff99da5f2be000 2 00000020:01000004:1.0:1777051473.488040:0:108750:0:(tgt_mount.c:118:server_deregister_mount()) deregister mount ffff99da5f2be000 from MGS 00000020:00000080:1.0:1777051473.488066:0:108750:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1777051473.488074:0:108750:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:1.0:1777051473.488078:0:108750:0:(genops.c:906:class_export_put()) final put ffff99d941e60800/MGS 00000020:00000080:1.0:1777051473.488081:0:108750:0:(genops.c:865:class_export_destroy()) destroying export ffff99d941e60800/MGS for MGS 00000020:01000000:1.0:1777051473.488090:0:108750:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:00000080:2.0:1777051473.488130:0:84827:0:(genops.c:865:class_export_destroy()) destroying export ffff99d944b1f800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1777051473.488168:0:108750:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:1.0:1777051473.488175:0:108750:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1777051473.488188:0:108750:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1777051473.488255:0:108750:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff99d958724000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1777051473.488264:0:108750:0:(genops.c:1574:class_disconnect_exports()) OBD device 28 (ffff99da44f6b380) has exports, disconnecting them 00000020:00080000:1.0:1777051473.488272:0:108750:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff99d958724000), last request at 1777051295 00000020:00000080:1.0:1777051473.488279:0:108750:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x85f51a6b96714c0b 00000020:00080000:1.0:1777051473.488296:0:108750:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff99d958724000): rc 0 00000020:00000080:1.0:1777051473.488305:0:108750:0:(genops.c:906:class_export_put()) final put ffff99d958724000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1777051473.488353:0:84827:0:(genops.c:865:class_export_destroy()) destroying export ffff99d958724000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:3.0:1777051473.490361:0:108750:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:3.0:1777051473.490368:0:108750:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1777051473.490374:0:108750:0:(client.c:3101:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1777051473.490382:0:108750:0:(import.c:321:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1777051473.490547:0:84827:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99da7b5fd000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1777051473.490599:0:108750:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1777051473.490615:0:108750:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:3.0:1777051473.490622:0:108750:0:(genops.c:906:class_export_put()) final put ffff99da7b5f4000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1777051473.490627:0:108750:0:(genops.c:865:class_export_destroy()) destroying export ffff99da7b5f4000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:3.0:1777051473.490655:0:108750:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:3.0:1777051473.490770:0:108750:0:(obd_mount.c:701:lustre_put_lsi()) put ffff99da5f2be000 1 00000020:00000080:3.0:1777051473.490777:0:108750:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x85f51a6b96714ade 00000020:00000080:3.0:1777051473.490783:0:108750:0:(genops.c:906:class_export_put()) final put ffff99da70a54000/lustre-MDT0000-osd_UUID 00000020:01000000:3.0:1777051473.490807:0:108750:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:3.0:1777051473.490813:0:108750:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1777051473.490819:0:108750:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1777051473.490825:0:108750:0:(genops.c:1579:class_disconnect_exports()) OBD device 0 (ffff99d941ce19c0) has no exports 00000020:00000080:2.0:1777051473.490850:0:84827:0:(genops.c:865:class_export_destroy()) destroying export ffff99da70a54000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1777051473.551715:0:108750:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1777051473.551732:0:108750:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:2.0:1777051473.551741:0:108750:0:(genops.c:906:class_export_put()) final put ffff99d941e63000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1777051473.551749:0:108750:0:(genops.c:865:class_export_destroy()) destroying export ffff99d941e63000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1777051473.551771:0:108750:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:2.0:1777051473.552046:0:108750:0:(obd_mount.c:659:lustre_free_lsi()) Freeing lsi ffff99da5f2bf800 00000020:02000400:2.0:1777051473.552156:0:108750:0:(tgt_mount.c:2134:server_put_super()) server umount lustre-MDT0000 complete 00000100:00100000:0.0:1777051473.686677:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da4384e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3680:1863365452693504:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1777051473.686772:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051473.687161:0:3680:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1777051473.687173:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da4384c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3680:1863365452693376:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1777051473.687309:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051473.687385:0:47388:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452693504 00000100:00100000:1.0:1777051473.687399:0:47388:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452693504 00000100:00100000:1.0:1777051473.687484:0:47388:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452693376 00000100:00100000:1.0:1777051473.687491:0:47388:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452693376 00000100:00100000:1.0:1777051473.687550:0:47388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5694 00000100:00100000:3.0:1777051473.687566:0:10113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5695 00000100:00100000:1.0:1777051473.687570:0:47388:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d96040aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3680:x1863365452693504:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1777051473.687598:0:10113:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94c12ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3680:x1863365452693376:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1777051473.687619:0:47388:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 489209408 pending 0 free 3642707968 avail 3411185664 00002000:00000024:3.0:1777051473.687655:0:10113:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 499269184 pending 0 free 3860574208 avail 3629051904 00000100:00100000:3.0:1777051473.688003:0:10113:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94c12ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3680:x1863365452693376:12345-0@lo:13:osp-pre-0-1.0 Request processed in 416us (695us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051473.688019:0:10113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5695 00000100:00100000:2.0:1777051473.688065:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da4384c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3680:1863365452693376:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1777051473.688113:0:47388:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d96040aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3680:x1863365452693504:12345-0@lo:13:osp-pre-1-1.0 Request processed in 546us (1337us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051473.688128:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da4384e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3680:1863365452693504:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1777051473.688130:0:47388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5694 00010000:00010000:1.0:1777051474.071333:0:108751:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051475.094604:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777051476.119164:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051477.142524:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:1.0:1777051477.924694:0:3672:0:(lib-move.c:4517:lnet_parse_put()) Dropping PUT from 12345-192.168.201.46@tcp portal 26 match 1863365426097024 offset 0 length 224: 4 00000100:00100000:1.0:1777051477.925093:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051477.925259:0:21368:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426097152 00000100:00100000:1.0:1777051477.925264:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051477.925274:0:21368:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426097152 00000100:00100000:1.0:1777051477.925342:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051477.925358:0:21368:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426097664 00000100:00100000:2.0:1777051477.925365:0:21368:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426097664 00000100:00100000:1.0:1777051477.925406:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051477.925411:0:21368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112398 00000100:00100000:2.0:1777051477.925427:0:21368:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7b5e9c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2435:x1863365426097152:12345-192.168.201.46@tcp:38:kworker.0 00000100:00100000:3.0:1777051477.925447:0:6579:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426097280 00000100:00100000:3.0:1777051477.925460:0:6579:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426097280 00000100:00100000:1.0:1777051477.925462:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00010000:00020000:2.0:1777051477.925470:0:21368:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.201.46@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1777051477.925516:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051477.925572:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13471 00000100:00100000:1.0:1777051477.925588:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051477.925601:0:6579:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d9418f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+9:2438:x1863365426097280:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:1.0:1777051477.925662:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051477.925725:0:6579:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d9418f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+9:2438:x1863365426097280:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 131us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051477.925743:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13471 00000100:00100000:3.0:1777051477.925777:0:6579:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426097792 00000100:00100000:0.0:1777051477.925796:0:13320:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426097408 00000100:00100000:0.0:1777051477.925807:0:13320:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426097408 00000100:00100000:3.0:1777051477.925808:0:6579:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426097792 00000100:00100000:3.0:1777051477.925882:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13472 00000100:00100000:0.0:1777051477.925902:0:13320:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426097536 00000100:00100000:3.0:1777051477.925904:0:6579:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955504700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+54:2439:x1863365426097792:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:0.0:1777051477.925914:0:13320:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426097536 00000100:00100000:0.0:1777051477.926291:0:13320:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426097920 00000100:00100000:0.0:1777051477.926301:0:13320:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426097920 00000100:00100000:0.0:1777051477.926393:0:13320:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426098048 00000100:00100000:0.0:1777051477.926401:0:13320:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426098048 00000100:00100000:0.0:1777051477.926887:0:13320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10505 00000100:00100000:0.0:1777051477.926916:0:13320:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5fbef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+51:2439:x1863365426097408:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:3.0:1777051477.927473:0:6579:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955504700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+54:2439:x1863365426097792:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 1571us (1889us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051477.927491:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13472 00000100:00100000:3.0:1777051477.927531:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112399 00000100:00100000:3.0:1777051477.927541:0:6579:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5fbece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2435:x1863365426097664:12345-192.168.201.46@tcp:38:kworker.0 00010000:00020000:3.0:1777051477.927567:0:6579:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.201.46@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1777051477.927621:0:6579:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5fbece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2435:x1863365426097664:12345-192.168.201.46@tcp:38:kworker.0 Request processed in 77us (2280us total) trans 0 rc -19/-19 00000100:00100000:3.0:1777051477.927636:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112399 00000100:00080000:3.0:1777051477.927682:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1777051477.927690:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1777051477.927697:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1777051477.927722:0:55805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10506 00000100:00100000:1.0:1777051477.927748:0:55805:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955505500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c11b6966-0775-44d2-bdc6-c74c26eb2226+48:2438:x1863365426097536:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:3.0:1777051477.927821:0:27884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10507 00000100:00100000:3.0:1777051477.927852:0:27884:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955504000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+53:2438:x1863365426097920:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:1.0:1777051477.927854:0:55805:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955505500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c11b6966-0775-44d2-bdc6-c74c26eb2226+48:2438:x1863365426097536:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 101us (2379us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051477.927883:0:55805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10506 00000100:00100000:1.0:1777051477.927979:0:55805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10508 00000100:00100000:1.0:1777051477.927998:0:55805:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955507100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+50:2439:x1863365426098048:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:1.0:1777051477.928056:0:55805:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955507100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+50:2439:x1863365426098048:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 63us (2397us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051477.928071:0:55805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10508 00000100:00100000:0.0:1777051477.928560:0:13320:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5fbef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+51:2439:x1863365426097408:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 1649us (3292us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051477.928578:0:27884:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955504000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+53:2438:x1863365426097920:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 735us (3052us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051477.928588:0:13320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10505 00000100:00100000:3.0:1777051477.928607:0:27884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10507 00000100:00100000:2.0:1777051477.987823:0:21368:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7b5e9c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2435:x1863365426097152:12345-192.168.201.46@tcp:38:kworker.0 Request processed in 62364us (62700us total) trans 0 rc -19/-19 00000100:00100000:2.0:1777051477.987846:0:21368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112398 00010000:00010000:3.0:1777051478.166547:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1777051478.294478:0:84827:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1777051478.294489:0:84827:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1777051478.294494:0:84827:0:(import.c:65:import_set_state_nolock()) ffff99d94183b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1777051478.294507:0:84827:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8102 00000100:00080000:3.0:1777051478.294516:0:84827:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1777051478.294526:0:84827:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff99d94183b000 using connection 192.168.201.146@tcp/0@lo 00000100:00100000:3.0:1777051478.294559:0:84827:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99da4384dc00 x1863365452693760/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1777051478.294609:0:84827:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1777051478.294615:0:84827:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1777051478.294619:0:84827:0:(import.c:65:import_set_state_nolock()) ffff99da5f282000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1777051478.294626:0:84827:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8102 00000100:00080000:3.0:1777051478.294631:0:84827:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1777051478.294638:0:84827:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff99da5f282000 using connection 192.168.201.146@tcp/0@lo 00000100:00100000:0.0:1777051478.294657:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da4384fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3678:1863365452693888:0@lo:400:kworker.0 00000100:00100000:3.0:1777051478.294661:0:84827:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99da4384df80 x1863365452694016/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1777051478.294682:0:3676:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da4384dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3676:1863365452693760:0@lo:38:kworker.0 00000100:00080000:3.0:1777051478.294986:0:84827:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1777051478.294993:0:84827:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1777051478.294998:0:84827:0:(import.c:65:import_set_state_nolock()) ffff99da5f3d6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1777051478.295005:0:84827:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8102 00000100:00080000:3.0:1777051478.295012:0:84827:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1777051478.295019:0:84827:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff99da5f3d6000 using connection 192.168.201.146@tcp/0@lo 00000100:00100000:3.0:1777051478.295047:0:84827:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99da4384c380 x1863365452694272/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1777051478.295056:0:3676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1777051478.295092:0:84827:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1777051478.295097:0:84827:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1777051478.295100:0:84827:0:(import.c:65:import_set_state_nolock()) ffff99da7dbe9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1777051478.295106:0:84827:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8102 00000100:00080000:3.0:1777051478.295110:0:84827:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1777051478.295117:0:84827:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff99da7dbe9000 using connection 192.168.201.146@tcp/0@lo 00000100:00100000:3.0:1777051478.295136:0:84827:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99da4384e300 x1863365452694656/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1777051478.295241:0:6580:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452693760 00000100:00100000:0.0:1777051478.295254:0:6580:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452693760 00000100:00100000:1.0:1777051478.295286:0:3676:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da4384df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3676:1863365452694016:0@lo:38:kworker.0 00000100:00100000:0.0:1777051478.295321:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112400 00000100:00100000:0.0:1777051478.295340:0:6580:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955505180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3676:x1863365452693760:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1777051478.295340:0:3676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00020000:0.0:1777051478.295375:0:6580:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1777051478.295389:0:3676:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da4384c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3676:1863365452694272:0@lo:38:kworker.0 00000100:00100000:2.0:1777051478.295416:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da4384ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3679:1863365452694144:0@lo:400:kworker.0 00000100:00100000:0.0:1777051478.295445:0:6580:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955505180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3676:x1863365452693760:12345-0@lo:38:kworker.0 Request processed in 108us (393us total) trans 0 rc -19/-19 00000100:00100000:0.0:1777051478.295498:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112400 00000100:00100000:3.0:1777051478.295522:0:10328:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452694016 00000100:00100000:3.0:1777051478.295531:0:10328:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452694016 00000100:00100000:0.0:1777051478.295544:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051478.295580:0:10328:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452693888 00000100:00100000:3.0:1777051478.295587:0:10328:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452693888 00000100:00100000:3.0:1777051478.295639:0:10328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13473 00000100:00100000:3.0:1777051478.295651:0:10328:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94c12b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3678:x1863365452693888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777051478.296535:0:3676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051478.296548:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051478.296578:0:3676:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da4384e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3676:1863365452694656:0@lo:38:kworker.0 00000100:00100000:2.0:1777051478.296602:0:3679:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1777051478.296618:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da4384f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452694400:0@lo:400:kworker.0 00000100:00100000:1.0:1777051478.296630:0:3676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1777051478.296686:0:3676:0:(import.c:65:import_set_state_nolock()) ffff99d94183b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:2.0:1777051478.296687:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1777051478.296702:0:3676:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1777051478.296710:0:3676:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da4384dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3676:1863365452693760:0@lo:38:kworker.0 00000100:00100000:0.0:1777051478.296754:0:3678:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1777051478.296770:0:6581:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452694144 00000100:00100000:0.0:1777051478.296772:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da4384d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3678:1863365452693632:0@lo:400:kworker.0 00000100:00100000:1.0:1777051478.296778:0:6581:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452694144 00000100:00100000:2.0:1777051478.296787:0:8470:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452694400 00000100:00100000:2.0:1777051478.296798:0:8470:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452694400 00000400:00000100:0.0:1777051478.296822:0:3678:0:(lib-move.c:4517:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1863365452693632 offset 0 length 224: 4 00000100:00100000:1.0:1777051478.296845:0:6581:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452694656 00000100:00100000:1.0:1777051478.296854:0:6581:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452694656 00000100:00100000:2.0:1777051478.296877:0:8470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10509 00000100:00100000:0.0:1777051478.296884:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da4384e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452694528:0@lo:400:kworker.0 00000100:00100000:2.0:1777051478.296895:0:8470:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955611880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3679:x1863365452694400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777051478.296905:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13474 00000100:00100000:1.0:1777051478.296924:0:6581:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955610a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3679:x1863365452694144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777051478.296960:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051478.296989:0:8470:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955611880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3679:x1863365452694400:12345-0@lo:400:kworker.0 Request processed in 98us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051478.297019:0:8470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10509 00000100:00100000:0.0:1777051478.297026:0:8628:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452694528 00000100:00100000:1.0:1777051478.297036:0:6581:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955610a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3679:x1863365452694144:12345-0@lo:400:kworker.0 Request processed in 114us (487us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051478.297037:0:8628:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452694528 00000100:00100000:1.0:1777051478.297052:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13474 00000100:00100000:2.0:1777051478.297426:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da4384f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452694400:0@lo:400:kworker.0 00000100:00100000:1.0:1777051478.297428:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112401 00000100:00100000:1.0:1777051478.297446:0:6581:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955507800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3676:x1863365452694016:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1777051478.297460:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da4384ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3679:1863365452694144:0@lo:400:kworker.0 00010000:00020000:1.0:1777051478.297469:0:6581:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1777051478.297523:0:8628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10510 00000100:00100000:1.0:1777051478.297540:0:6581:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955507800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3676:x1863365452694016:12345-0@lo:38:kworker.0 Request processed in 91us (2201us total) trans 0 rc -19/-19 00000100:00100000:0.0:1777051478.297548:0:8628:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94c12bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3678:x1863365452694528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777051478.297559:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112401 00000100:00100000:2.0:1777051478.297594:0:46494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112402 00000100:00100000:2.0:1777051478.297607:0:46494:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955506d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:0+-99:3676:x1863365452694656:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1777051478.297630:0:46494:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1777051478.297639:0:6585:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452694272 00000100:00100000:0.0:1777051478.297640:0:8628:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94c12bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3678:x1863365452694528:12345-0@lo:400:kworker.0 Request processed in 99us (703us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051478.297647:0:6585:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452694272 00000100:00100000:0.0:1777051478.297659:0:8628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10510 00000100:00100000:1.0:1777051478.297694:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8322 00000100:00100000:2.0:1777051478.297704:0:46494:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955506d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:0+-99:3676:x1863365452694656:12345-0@lo:38:kworker.0 Request processed in 94us (1073us total) trans 0 rc -19/-19 00000100:00100000:1.0:1777051478.297709:0:6585:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955507480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3676:x1863365452694272:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1777051478.297733:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da4384e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452694528:0@lo:400:kworker.0 00000100:00100000:2.0:1777051478.297734:0:46494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112402 00010000:00020000:1.0:1777051478.297740:0:6585:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:2.0:1777051478.297784:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1777051478.297794:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1777051478.297801:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1777051478.297805:0:6585:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955507480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3676:x1863365452694272:12345-0@lo:38:kworker.0 Request processed in 97us (1269us total) trans 0 rc -19/-19 00000100:00100000:1.0:1777051478.297819:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8322 00000100:00080000:0.0:1777051478.297874:0:3676:0:(import.c:65:import_set_state_nolock()) ffff99da5f282000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1777051478.297884:0:3676:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1777051478.297891:0:3676:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da4384df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3676:1863365452694016:0@lo:38:kworker.0 00000100:00080000:0.0:1777051478.297913:0:3676:0:(import.c:65:import_set_state_nolock()) ffff99da5f3d6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1777051478.297920:0:3676:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1777051478.297924:0:3676:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da4384c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3676:1863365452694272:0@lo:38:kworker.0 00000100:00080000:0.0:1777051478.297936:0:3676:0:(import.c:65:import_set_state_nolock()) ffff99da7dbe9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1777051478.297939:0:3676:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1777051478.297942:0:3676:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da4384e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3676:1863365452694656:0@lo:38:kworker.0 00000100:00100000:3.0:1777051478.298485:0:10328:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94c12b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3678:x1863365452693888:12345-0@lo:400:kworker.0 Request processed in 2833us (2937us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051478.298498:0:10328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13473 00000100:00100000:0.0:1777051478.298645:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da4384fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3678:1863365452693888:0@lo:400:kworker.0 00000100:00100000:3.0:1777051478.806575:0:3677:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1777051478.806597:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da4384c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452694912:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1777051478.806665:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051478.807152:0:8472:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452694912 00000100:00100000:0.0:1777051478.807164:0:8472:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452694912 00000100:00100000:2.0:1777051478.807462:0:3680:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1777051478.807478:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955610000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3680:1863365452694784:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1777051478.807528:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051478.807803:0:8473:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452694784 00000100:00100000:2.0:1777051478.807811:0:8473:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452694784 00000001:00100000:3.0:1777051478.809730:0:104205:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1777051478.809742:0:104205:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934761 is committed 00000020:00000080:3.0:1777051478.809747:0:104205:0:(genops.c:906:class_export_put()) final put ffff99da4622c800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1777051478.809784:0:84827:0:(genops.c:865:class_export_destroy()) destroying export ffff99da4622c800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:3.0:1777051478.809842:0:84827:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99da71c6d000 for lustre-MDT0001 00000100:00100000:0.0:1777051478.810282:0:8472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5696 00000100:00100000:0.0:1777051478.810300:0:8472:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da4384fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3677:x1863365452694912:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1777051478.810340:0:8472:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 489209408 pending 0 free 3642707968 avail 3411185664 00000100:00100000:0.0:1777051478.810411:0:8472:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da4384fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3677:x1863365452694912:12345-0@lo:13:osp-pre-1-1.0 Request processed in 117us (3744us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051478.810424:0:8472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5696 00000100:00100000:2.0:1777051478.810517:0:8473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5697 00000100:00100000:1.0:1777051478.810523:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da4384c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452694912:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1777051478.810534:0:8473:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955612a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3680:x1863365452694784:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1777051478.810561:0:8473:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 499269184 pending 0 free 3860574208 avail 3629051904 00000100:00100000:2.0:1777051478.810618:0:8473:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955612a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3680:x1863365452694784:12345-0@lo:13:osp-pre-0-1.0 Request processed in 90us (3090us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051478.810626:0:8473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5697 00000100:00100000:3.0:1777051478.810674:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955610000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3680:1863365452694784:0@lo:13:osp-pre-0-1.0 00000001:00100000:1.0:1777051478.812057:0:8464:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1777051478.812067:0:8464:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0000: transno 4294968373 is committed 00000020:00000080:1.0:1777051478.812071:0:8464:0:(genops.c:906:class_export_put()) final put ffff99da44f1e800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1777051478.812155:0:107953:0:(genops.c:865:class_export_destroy()) destroying export ffff99da44f1e800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1777051478.812275:0:107953:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99da44f19000 for lustre-OST0000 00000001:00100000:1.0:1777051478.812323:0:9540:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1777051478.812329:0:9540:0:(genops.c:906:class_export_put()) final put ffff99d942a24000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1777051478.812371:0:107953:0:(genops.c:865:class_export_destroy()) destroying export ffff99d942a24000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1777051478.812403:0:107953:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff99d942e06000 for lustre-OST0001 00010000:00010000:2.0:1777051479.190444:0:108751:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051480.217465:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777051481.238457:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1777051482.006473:0:104226:0:(llog.c:801:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1777051482.006486:0:104226:0:(llog_cat.c:158:llog_cat_process_common()) processing log [0x1:0x12:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1777051482.006525:0:104226:0:(llog.c:858:llog_process_thread()) stop processing plain [0x1:0x12:0x0] index 11 count 9 00000040:00080000:1.0:1777051482.006540:0:104226:0:(llog.c:858:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:1.0:1777051482.262443:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:3.0:1777051483.046311:0:3670:0:(lib-move.c:4517:lnet_parse_put()) Dropping PUT from 12345-192.168.201.46@tcp portal 26 match 1863365426098176 offset 0 length 224: 4 00000100:00100000:3.0:1777051483.046381:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051483.047152:0:6580:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426098432 00000100:00100000:0.0:1777051483.047169:0:6580:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426098432 00000100:00100000:3.0:1777051483.047239:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051483.047333:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051483.047364:0:6580:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426098304 00000100:00100000:0.0:1777051483.047374:0:6580:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426098304 00000100:00100000:3.0:1777051483.047408:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051483.047427:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13475 00000100:00100000:0.0:1777051483.047450:0:6580:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da4384e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+9:2436:x1863365426098432:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:3.0:1777051483.047505:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00080000:2.0:1777051483.047514:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1777051483.047553:0:46494:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426098816 00000100:00100000:2.0:1777051483.047566:0:46494:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426098816 00000100:00100000:1.0:1777051483.047586:0:8492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112403 00000100:00100000:0.0:1777051483.047587:0:6580:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da4384e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+9:2436:x1863365426098432:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 135us (1198us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051483.047613:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051483.047617:0:8492:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da4384c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2435:x1863365426098304:12345-192.168.201.46@tcp:38:kworker.0 00000100:00100000:0.0:1777051483.047626:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13475 00000100:00100000:2.0:1777051483.047643:0:46494:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426098944 00000100:00100000:2.0:1777051483.047653:0:46494:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426098944 00010000:00020000:1.0:1777051483.047666:0:8492:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.201.46@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1777051483.047683:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112404 00000100:00100000:0.0:1777051483.048010:0:6580:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da4384ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2435:x1863365426098816:12345-192.168.201.46@tcp:38:kworker.0 00010000:00020000:0.0:1777051483.048038:0:6580:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.201.46@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1777051483.048099:0:46494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13476 00000100:00100000:0.0:1777051483.048131:0:6580:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da4384ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2435:x1863365426098816:12345-192.168.201.46@tcp:38:kworker.0 Request processed in 111us (622us total) trans 0 rc -19/-19 00000100:00100000:2.0:1777051483.048133:0:46494:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da4384f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+54:2437:x1863365426098944:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:0.0:1777051483.048163:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112404 00000100:00100000:0.0:1777051483.048263:0:8471:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426098688 00000100:00100000:0.0:1777051483.048272:0:8471:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426098688 00000100:00100000:3.0:1777051483.048293:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051483.048328:0:46494:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da4384f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+54:2437:x1863365426098944:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 207us (723us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051483.048347:0:46494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13476 00000100:00100000:0.0:1777051483.048349:0:8471:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426098560 00000100:00100000:0.0:1777051483.048358:0:8471:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426098560 00000100:00100000:1.0:1777051483.048362:0:8492:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da4384c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2435:x1863365426098304:12345-192.168.201.46@tcp:38:kworker.0 Request processed in 750us (1126us total) trans 0 rc -19/-19 00000100:00100000:1.0:1777051483.048379:0:8492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112403 00000100:00100000:0.0:1777051483.048417:0:8471:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426099200 00000100:00080000:2.0:1777051483.048420:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1777051483.048426:0:8471:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426099200 00000100:00080000:2.0:1777051483.048432:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1777051483.048446:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1777051483.048500:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10511 00000100:00100000:2.0:1777051483.048523:0:13320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10512 00000100:00100000:0.0:1777051483.048525:0:8471:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da4384df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+48:2436:x1863365426098688:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:2.0:1777051483.048556:0:13320:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da4384e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+51:2436:x1863365426098560:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:1.0:1777051483.048569:0:27887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10513 00000100:00100000:1.0:1777051483.048588:0:27887:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da4384dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+50:2437:x1863365426099200:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:0.0:1777051483.048605:0:8471:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da4384df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+48:2436:x1863365426098688:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 85us (1271us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051483.048621:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10511 00000100:00100000:2.0:1777051483.048644:0:13320:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da4384e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+51:2436:x1863365426098560:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 95us (1233us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051483.048657:0:27887:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da4384dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+50:2437:x1863365426099200:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 71us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051483.048673:0:13320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10512 00000100:00100000:1.0:1777051483.048695:0:27887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10513 00000100:00100000:2.0:1777051483.048846:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051483.048984:0:55805:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426099072 00000100:00100000:1.0:1777051483.048992:0:55805:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426099072 00000100:00100000:1.0:1777051483.049097:0:55805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10514 00000100:00100000:1.0:1777051483.049112:0:55805:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955613100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+53:2437:x1863365426099072:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:1.0:1777051483.049193:0:55805:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955613100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+53:2437:x1863365426099072:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 80us (348us total) trans 0 rc 0/0 00000100:00080000:2.0:1777051483.049234:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1777051483.049290:0:55805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10514 00010000:00010000:3.0:1777051483.286714:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1777051483.414583:0:107953:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1777051483.414594:0:107953:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1777051483.414602:0:107953:0:(import.c:65:import_set_state_nolock()) ffff99d94183b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1777051483.414616:0:107953:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8107 00000100:00080000:0.0:1777051483.414627:0:107953:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1777051483.414640:0:107953:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff99d94183b000 using connection 192.168.201.146@tcp/0@lo 00000100:00100000:3.0:1777051483.414664:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94c128380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3680:1863365452695040:0@lo:400:kworker.0 00000100:00100000:0.0:1777051483.414684:0:107953:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d94c12b100 x1863365452695168/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000400:00000100:3.0:1777051483.414767:0:3680:0:(lib-move.c:4517:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1863365452695040 offset 0 length 224: 4 00000100:00080000:0.0:1777051483.414789:0:107953:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1777051483.414799:0:107953:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1777051483.414805:0:107953:0:(import.c:65:import_set_state_nolock()) ffff99da5f282000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1777051483.414815:0:107953:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8107 00000100:00080000:0.0:1777051483.414822:0:107953:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1777051483.414832:0:107953:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff99da5f282000 using connection 192.168.201.146@tcp/0@lo 00000100:00100000:1.0:1777051483.414851:0:3676:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94c12b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3676:1863365452695168:0@lo:38:kworker.0 00000100:00100000:0.0:1777051483.414867:0:107953:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d94c12a680 x1863365452695424/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1777051483.414886:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94c129500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3677:1863365452695296:0@lo:400:kworker.0 00000100:00100000:3.0:1777051483.414944:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94c129c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3678:1863365452695552:0@lo:400:kworker.0 00000100:00080000:0.0:1777051483.414945:0:107953:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:1.0:1777051483.414956:0:3676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1777051483.414968:0:107953:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1777051483.414974:0:107953:0:(import.c:65:import_set_state_nolock()) ffff99da5f3d6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1777051483.414984:0:107953:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8107 00000100:00080000:0.0:1777051483.414991:0:107953:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1777051483.415000:0:107953:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff99da5f3d6000 using connection 192.168.201.146@tcp/0@lo 00000100:00100000:0.0:1777051483.415032:0:107953:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d94c129f80 x1863365452695680/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1777051483.415051:0:3676:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94c12a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3676:1863365452695424:0@lo:38:kworker.0 00000100:00100000:2.0:1777051483.415088:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051483.415478:0:10328:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452695168 00000100:00080000:0.0:1777051483.415490:0:107953:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:3.0:1777051483.415495:0:10328:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452695168 00000100:00080000:0.0:1777051483.415506:0:107953:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1777051483.415512:0:107953:0:(import.c:65:import_set_state_nolock()) ffff99da7dbe9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1777051483.415520:0:107953:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8107 00000100:00080000:0.0:1777051483.415529:0:107953:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 10s 00000100:00100000:1.0:1777051483.415540:0:3676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1777051483.415544:0:107953:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff99da7dbe9000 using connection 192.168.201.146@tcp/0@lo 00000100:00100000:2.0:1777051483.415575:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94c129180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452695808:0@lo:400:kworker.0 00000100:00100000:3.0:1777051483.415576:0:10328:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452695296 00000100:00100000:0.0:1777051483.415578:0:107953:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d94c12a300 x1863365452696064/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1777051483.415589:0:10328:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452695296 00000100:00100000:1.0:1777051483.415622:0:3676:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94c129f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3676:1863365452695680:0@lo:38:kworker.0 00000100:00100000:0.0:1777051483.415657:0:6580:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452695424 00000100:00100000:0.0:1777051483.415666:0:6580:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452695424 00000100:00100000:2.0:1777051483.415678:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051483.415710:0:10328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13477 00000100:00100000:1.0:1777051483.415717:0:3676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051483.415743:0:10328:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955610e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3677:x1863365452695296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777051483.415745:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112405 00000100:00100000:2.0:1777051483.415746:0:3679:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1777051483.416084:0:6580:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955504a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3676:x1863365452695168:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1777051483.416110:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94c128a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452695936:0@lo:400:kworker.0 00010000:00020000:0.0:1777051483.416126:0:6580:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1777051483.416128:0:3676:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94c12a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3676:1863365452696064:0@lo:38:kworker.0 00000100:00100000:2.0:1777051483.416180:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051483.416650:0:3676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1777051483.416660:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1777051483.416670:0:6580:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955504a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3676:x1863365452695168:12345-0@lo:38:kworker.0 Request processed in 604us (1717us total) trans 0 rc -19/-19 00000100:00100000:0.0:1777051483.416691:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112405 00000100:00100000:2.0:1777051483.416704:0:8468:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452695808 00000100:00100000:2.0:1777051483.416716:0:8468:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452695808 00000100:00100000:3.0:1777051483.416734:0:10328:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955610e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3677:x1863365452695296:12345-0@lo:400:kworker.0 Request processed in 998us (1679us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051483.416739:0:6580:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452696064 00000100:00100000:0.0:1777051483.416751:0:6580:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452696064 00000100:00100000:3.0:1777051483.416793:0:10328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13477 00000100:00100000:0.0:1777051483.416824:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112406 00000100:00100000:2.0:1777051483.416825:0:8468:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452695936 00000100:00100000:2.0:1777051483.416837:0:8468:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452695936 00000100:00100000:0.0:1777051483.416843:0:6580:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955505880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3676:x1863365452695424:12345-0@lo:38:kworker.0 00000100:00080000:1.0:1777051483.416852:0:3676:0:(import.c:65:import_set_state_nolock()) ffff99d94183b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:3.0:1777051483.416854:0:10328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112407 00000100:00080000:1.0:1777051483.416873:0:3676:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00010000:00020000:0.0:1777051483.416881:0:6580:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1777051483.416883:0:10328:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955ebd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3676:x1863365452696064:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1777051483.416890:0:3676:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94c12b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3676:1863365452695168:0@lo:38:kworker.0 00010000:00020000:3.0:1777051483.416921:0:10328:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1777051483.416926:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10515 00000100:00100000:0.0:1777051483.416944:0:27884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10516 00000100:00100000:2.0:1777051483.416956:0:8468:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955613480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3679:x1863365452695808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777051483.416975:0:27884:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955612300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3679:x1863365452695936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777051483.417107:0:8468:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955613480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3679:x1863365452695808:12345-0@lo:400:kworker.0 Request processed in 161us (1433us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051483.417123:0:27884:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955612300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3679:x1863365452695936:12345-0@lo:400:kworker.0 Request processed in 154us (939us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051483.417137:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10515 00000100:00100000:0.0:1777051483.417154:0:27884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10516 00000100:00080000:2.0:1777051483.417184:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1777051483.417193:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1777051483.417263:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051483.417402:0:10328:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955ebd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3676:x1863365452696064:12345-0@lo:38:kworker.0 Request processed in 523us (753us total) trans 0 rc -19/-19 00000100:00100000:0.0:1777051483.417407:0:6580:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955505880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3676:x1863365452695424:12345-0@lo:38:kworker.0 Request processed in 564us (1872us total) trans 0 rc -19/-19 00000100:00100000:3.0:1777051483.417436:0:10328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112407 00000100:00100000:0.0:1777051483.417459:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112406 00000100:00100000:3.0:1777051483.417762:0:10328:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452695552 00000100:00100000:3.0:1777051483.417774:0:10328:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452695552 00000100:00100000:1.0:1777051483.417810:0:11727:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452695680 00000100:00100000:1.0:1777051483.417824:0:11727:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452695680 00000100:00100000:2.0:1777051483.417851:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94c128a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452695936:0@lo:400:kworker.0 00000100:00100000:3.0:1777051483.417880:0:10328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13478 00000100:00100000:2.0:1777051483.417892:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94c129180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452695808:0@lo:400:kworker.0 00000100:00100000:1.0:1777051483.417908:0:11727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8323 00000100:00100000:3.0:1777051483.417910:0:10328:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955610380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3678:x1863365452695552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777051483.417925:0:11727:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955506300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3676:x1863365452695680:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1777051483.417947:0:11727:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:2.0:1777051483.417947:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1777051483.418040:0:10328:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955610380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3678:x1863365452695552:12345-0@lo:400:kworker.0 Request processed in 139us (775us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051483.418045:0:11727:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955506300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3676:x1863365452695680:12345-0@lo:38:kworker.0 Request processed in 117us (2339us total) trans 0 rc -19/-19 00000100:00100000:3.0:1777051483.418099:0:10328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13478 00000100:00100000:0.0:1777051483.418105:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94c129500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3677:1863365452695296:0@lo:400:kworker.0 00000100:00100000:2.0:1777051483.418147:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94c129c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3678:1863365452695552:0@lo:400:kworker.0 00000100:00080000:3.0:1777051483.418191:0:3676:0:(import.c:65:import_set_state_nolock()) ffff99da7dbe9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1777051483.418252:0:3676:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1777051483.418260:0:3676:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94c12a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3676:1863365452696064:0@lo:38:kworker.0 00000100:00080000:3.0:1777051483.418285:0:3676:0:(import.c:65:import_set_state_nolock()) ffff99da5f3d6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1777051483.418295:0:3676:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1777051483.418305:0:3676:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94c129f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3676:1863365452695680:0@lo:38:kworker.0 00000100:00080000:3.0:1777051483.418326:0:3676:0:(import.c:65:import_set_state_nolock()) ffff99da5f282000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1777051483.418333:0:3676:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1777051483.418339:0:3676:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94c12a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3676:1863365452695424:0@lo:38:kworker.0 00000100:00100000:1.0:1777051483.418751:0:11727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8323 00000100:00100000:0.0:1777051483.926672:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955611c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452696192:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1777051483.926777:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051483.927485:0:10113:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452696192 00000100:00100000:1.0:1777051483.927498:0:10113:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452696192 00000100:00100000:1.0:1777051483.927575:0:10113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5698 00000100:00100000:1.0:1777051483.927592:0:10113:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94c129500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3677:x1863365452696192:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1777051483.927633:0:10113:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 499269184 pending 0 free 3860574208 avail 3629051904 00000100:00100000:1.0:1777051483.927719:0:10113:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94c129500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3677:x1863365452696192:12345-0@lo:13:osp-pre-0-1.0 Request processed in 130us (941us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051483.928009:0:10113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5698 00000100:00100000:1.0:1777051483.928832:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da4384c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452696320:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1777051483.929240:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051483.929407:0:8473:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452696320 00000100:00100000:2.0:1777051483.929416:0:8473:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452696320 00000100:00100000:2.0:1777051483.929689:0:8473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5699 00000100:00100000:2.0:1777051483.929702:0:8473:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955ebca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3678:x1863365452696320:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1777051483.930389:0:8473:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 489209408 pending 0 free 3642707968 avail 3411185664 00000100:00100000:0.0:1777051483.930467:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955611c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452696192:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1777051483.930596:0:8473:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955ebca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3678:x1863365452696320:12345-0@lo:13:osp-pre-1-1.0 Request processed in 895us (1355us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051483.930607:0:8473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5699 00000100:00100000:3.0:1777051483.930710:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da4384c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452696320:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1777051484.316015:0:108751:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777051485.336521:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777051486.359389:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051487.382592:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777051488.165802:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051488.165939:0:46497:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426099456 00000100:00100000:0.0:1777051488.165962:0:46497:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426099456 00000100:00100000:0.0:1777051488.166082:0:46497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112408 00000100:00100000:0.0:1777051488.166097:0:46497:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da4384c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:0+-99:2435:x1863365426099456:12345-192.168.201.46@tcp:38:kworker.0 00010000:00020000:0.0:1777051488.166141:0:46497:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.201.46@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1777051488.166611:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051488.166700:0:6580:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426099968 00000100:00100000:1.0:1777051488.166711:0:6580:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426099968 00000100:00100000:1.0:1777051488.166775:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112409 00000100:00100000:1.0:1777051488.166807:0:6580:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d9533bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2435:x1863365426099968:12345-192.168.201.46@tcp:38:kworker.0 00010000:00020000:1.0:1777051488.166837:0:6580:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.201.46@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000400:00000100:2.0:1777051488.166888:0:3671:0:(lib-move.c:4517:lnet_parse_put()) Dropping PUT from 12345-192.168.201.46@tcp portal 26 match 1863365426099328 offset 0 length 224: 4 00000100:00100000:1.0:1777051488.166920:0:6580:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d9533bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2435:x1863365426099968:12345-192.168.201.46@tcp:38:kworker.0 Request processed in 129us (309us total) trans 0 rc -19/-19 00000100:00100000:1.0:1777051488.166933:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112409 00000100:00100000:2.0:1777051488.167004:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051488.167059:0:13320:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426099712 00000100:00100000:2.0:1777051488.167062:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051488.167069:0:13320:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426099712 00000100:00100000:2.0:1777051488.167156:0:21368:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426100096 00000100:00100000:1.0:1777051488.167164:0:13320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10517 00000100:00100000:2.0:1777051488.167166:0:21368:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426100096 00000100:00100000:1.0:1777051488.167560:0:13320:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955612680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+51:2438:x1863365426099712:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:2.0:1777051488.167587:0:21368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13479 00000100:00100000:2.0:1777051488.167609:0:21368:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955611c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+54:2438:x1863365426100096:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:1.0:1777051488.167708:0:13320:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955612680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+51:2438:x1863365426099712:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 526us (700us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051488.167735:0:13320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10517 00000100:00100000:0.0:1777051488.167738:0:46497:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da4384c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:0+-99:2435:x1863365426099456:12345-192.168.201.46@tcp:38:kworker.0 Request processed in 1632us (1950us total) trans 0 rc -19/-19 00000100:00100000:0.0:1777051488.167764:0:46497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112408 00000100:00080000:1.0:1777051488.167771:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1777051488.167780:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1777051488.167923:0:21368:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955611c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+54:2438:x1863365426100096:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 318us (858us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051488.167939:0:21368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13479 00000100:00100000:0.0:1777051488.168177:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051488.168278:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051488.168312:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051488.168343:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051488.168468:0:27885:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426099584 00000100:00100000:2.0:1777051488.168474:0:27885:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426099584 00000100:00100000:3.0:1777051488.168477:0:8628:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426100352 00000100:00100000:3.0:1777051488.168496:0:8628:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426100352 00000100:00100000:1.0:1777051488.168558:0:27887:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426099840 00000100:00100000:2.0:1777051488.168566:0:27885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13480 00000100:00100000:1.0:1777051488.168571:0:27887:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426099840 00000100:00100000:2.0:1777051488.168583:0:27885:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94c129f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c11b6966-0775-44d2-bdc6-c74c26eb2226+9:2438:x1863365426099584:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:3.0:1777051488.168602:0:8628:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426100224 00000100:00100000:3.0:1777051488.168614:0:8628:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426100224 00000100:00100000:1.0:1777051488.168655:0:27887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10518 00000100:00100000:1.0:1777051488.168674:0:27887:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94c12a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+50:2438:x1863365426100352:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:3.0:1777051488.168735:0:8628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10519 00000100:00100000:1.0:1777051488.168737:0:27887:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94c12a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+50:2438:x1863365426100352:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 64us (556us total) trans 0 rc 0/0 00000100:00080000:0.0:1777051488.168751:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1777051488.168762:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1777051488.168763:0:27887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10518 00000100:00080000:0.0:1777051488.168773:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1777051488.168781:0:8628:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94c12a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+48:2438:x1863365426099840:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:1.0:1777051488.168810:0:27887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10520 00000100:00100000:1.0:1777051488.168827:0:27887:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94c129c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+53:2438:x1863365426100224:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:1.0:1777051488.168905:0:27887:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94c129c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+53:2438:x1863365426100224:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 71us (546us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051488.168905:0:8628:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94c12a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+48:2438:x1863365426099840:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 133us (577us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051488.168909:0:27885:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94c129f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c11b6966-0775-44d2-bdc6-c74c26eb2226+9:2438:x1863365426099584:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 88us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051488.168965:0:27887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10520 00000100:00100000:2.0:1777051488.168972:0:27885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13480 00000100:00100000:3.0:1777051488.169028:0:8628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10519 00010000:00010000:3.0:1777051488.407757:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1777051488.534623:0:84827:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1777051488.534636:0:84827:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1777051488.534644:0:84827:0:(import.c:65:import_set_state_nolock()) ffff99d94183b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1777051488.534660:0:84827:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8112 00000100:00080000:2.0:1777051488.534674:0:84827:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 15s 00000100:00100000:3.0:1777051488.534675:0:3680:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00080000:2.0:1777051488.534689:0:84827:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff99d94183b000 using connection 192.168.201.146@tcp/0@lo 00000100:00100000:3.0:1777051488.534713:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955610000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3680:1863365452696448:0@lo:400:kworker.0 00000100:00100000:2.0:1777051488.534730:0:84827:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d955613800 x1863365452696576/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1777051488.534798:0:84827:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1777051488.534806:0:84827:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1777051488.534810:0:84827:0:(import.c:65:import_set_state_nolock()) ffff99da5f282000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:1.0:1777051488.534818:0:3676:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955613800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3676:1863365452696576:0@lo:38:kworker.0 00000100:00080000:2.0:1777051488.534821:0:84827:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8112 00000100:00080000:2.0:1777051488.534845:0:84827:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1777051488.534853:0:84827:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff99da5f282000 using connection 192.168.201.146@tcp/0@lo 00000100:00100000:0.0:1777051488.534870:0:3679:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1777051488.534885:0:84827:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99da5f9ff800 x1863365452696832/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1777051488.534897:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955611f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3679:1863365452696704:0@lo:400:kworker.0 00000100:00100000:1.0:1777051488.534944:0:3676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000400:00000100:3.0:1777051488.534955:0:3680:0:(lib-move.c:4517:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1863365452696448 offset 0 length 224: 4 00000100:00080000:2.0:1777051488.534960:0:84827:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1777051488.534971:0:84827:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1777051488.535003:0:84827:0:(import.c:65:import_set_state_nolock()) ffff99da5f3d6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1777051488.535012:0:84827:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8112 00000100:00080000:2.0:1777051488.535019:0:84827:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1777051488.535033:0:84827:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff99da5f3d6000 using connection 192.168.201.146@tcp/0@lo 00000100:00100000:0.0:1777051488.535034:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051488.535068:0:84827:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99da5f9fd880 x1863365452697088/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1777051488.535104:0:3676:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f9ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3676:1863365452696832:0@lo:38:kworker.0 00000100:00100000:3.0:1777051488.535126:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f9fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452697216:0@lo:400:kworker.0 00000100:00100000:0.0:1777051488.535156:0:6579:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452696576 00000100:00080000:2.0:1777051488.535160:0:84827:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:0.0:1777051488.535171:0:6579:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452696576 00000100:00080000:2.0:1777051488.535172:0:84827:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00100000:1.0:1777051488.535179:0:3676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1777051488.535180:0:84827:0:(import.c:65:import_set_state_nolock()) ffff99da7dbe9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1777051488.535192:0:84827:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8112 00000100:00100000:3.0:1777051488.535203:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051488.535257:0:3678:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00080000:2.0:1777051488.535271:0:84827:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 15s 00000100:00100000:3.0:1777051488.535271:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f9fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3678:1863365452696960:0@lo:400:kworker.0 00000100:00080000:2.0:1777051488.535285:0:84827:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff99da7dbe9000 using connection 192.168.201.146@tcp/0@lo 00000100:00100000:0.0:1777051488.535290:0:6579:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452696704 00000100:00100000:1.0:1777051488.535299:0:3676:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f9fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3676:1863365452697088:0@lo:38:kworker.0 00000100:00100000:0.0:1777051488.535300:0:6579:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452696704 00000100:00100000:2.0:1777051488.535366:0:84827:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99da5f9ffb80 x1863365452697472/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1777051488.535374:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051488.535382:0:3676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051488.535446:0:10328:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452696832 00000100:00100000:3.0:1777051488.535455:0:10328:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452696832 00000100:00100000:1.0:1777051488.535458:0:3676:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f9ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3676:1863365452697472:0@lo:38:kworker.0 00000100:00100000:2.0:1777051488.535476:0:3680:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1777051488.535496:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f9fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3680:1863365452697344:0@lo:400:kworker.0 00000100:00100000:3.0:1777051488.535508:0:10328:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452696960 00000100:00100000:1.0:1777051488.535515:0:3676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051488.535518:0:10328:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452696960 00000100:00100000:0.0:1777051488.535570:0:6579:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452697472 00000100:00100000:2.0:1777051488.535580:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051488.535581:0:6579:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452697472 00000100:00100000:3.0:1777051488.535601:0:10328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13481 00000100:00100000:1.0:1777051488.535621:0:46494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13482 00000100:00100000:3.0:1777051488.535627:0:10328:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94c129180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3679:x1863365452696704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777051488.535650:0:46494:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d9533bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0001-lwp-OST0001_UUID+5:3678:x1863365452696960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777051488.535652:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112410 00000100:00100000:0.0:1777051488.535671:0:6579:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955ebf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3676:x1863365452696576:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1777051488.535705:0:6579:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1777051488.535735:0:27882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112411 00000100:00100000:2.0:1777051488.535749:0:27882:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955ebdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0+-99:3676:x1863365452696832:12345-0@lo:38:kworker.0 00000100:00080000:3.0:1777051488.535755:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1777051488.535759:0:46494:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d9533bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0001-lwp-OST0001_UUID+5:3678:x1863365452696960:12345-0@lo:400:kworker.0 Request processed in 115us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051488.535775:0:46494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13482 00010000:00020000:2.0:1777051488.535781:0:27882:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1777051488.535794:0:6579:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955ebf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3676:x1863365452696576:12345-0@lo:38:kworker.0 Request processed in 122us (850us total) trans 0 rc -19/-19 00000100:00100000:3.0:1777051488.535799:0:46497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112412 00000100:00100000:0.0:1777051488.535824:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112410 00000100:00100000:3.0:1777051488.535824:0:46497:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955ebfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:0+-99:3676:x1863365452697472:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1777051488.535852:0:46497:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1777051488.535861:0:27882:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955ebdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:0+-99:3676:x1863365452696832:12345-0@lo:38:kworker.0 Request processed in 105us (684us total) trans 0 rc -19/-19 00000100:00100000:1.0:1777051488.535869:0:46498:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452697088 00000100:00100000:2.0:1777051488.535878:0:27882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112411 00000100:00100000:1.0:1777051488.535879:0:46498:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452697088 00000100:00080000:0.0:1777051488.535932:0:3676:0:(import.c:65:import_set_state_nolock()) ffff99da5f282000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:1.0:1777051488.535932:0:46498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8324 00000100:00100000:3.0:1777051488.535932:0:46497:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955ebfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:0+-99:3676:x1863365452697472:12345-0@lo:38:kworker.0 Request processed in 108us (416us total) trans 0 rc -19/-19 00000100:00100000:2.0:1777051488.535943:0:8471:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452697216 00000100:00100000:1.0:1777051488.535947:0:46498:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955ebc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:0+-99:3676:x1863365452697088:12345-0@lo:38:kworker.0 00000100:00080000:0.0:1777051488.535952:0:3676:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1777051488.535955:0:8471:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452697216 00000100:00100000:3.0:1777051488.535965:0:46497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112412 00000100:00100000:0.0:1777051488.535970:0:3676:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f9ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3676:1863365452696832:0@lo:38:kworker.0 00010000:00020000:1.0:1777051488.536003:0:46498:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:0.0:1777051488.536038:0:3676:0:(import.c:65:import_set_state_nolock()) ffff99d94183b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1777051488.536048:0:3676:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00080000:3.0:1777051488.536055:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1777051488.536059:0:3676:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955613800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3676:1863365452696576:0@lo:38:kworker.0 00000100:00100000:2.0:1777051488.536072:0:8471:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452697344 00000100:00100000:1.0:1777051488.536077:0:46498:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955ebc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:0+-99:3676:x1863365452697088:12345-0@lo:38:kworker.0 Request processed in 127us (700us total) trans 0 rc -19/-19 00000100:00100000:2.0:1777051488.536081:0:8471:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452697344 00000100:00100000:1.0:1777051488.536096:0:46498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8324 00000100:00080000:0.0:1777051488.536478:0:3676:0:(import.c:65:import_set_state_nolock()) ffff99da7dbe9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1777051488.536488:0:3676:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1777051488.536496:0:3676:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f9ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3676:1863365452697472:0@lo:38:kworker.0 00000100:00100000:2.0:1777051488.536519:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10521 00000100:00080000:0.0:1777051488.536522:0:3676:0:(import.c:65:import_set_state_nolock()) ffff99da5f3d6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:1.0:1777051488.536532:0:13320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10522 00000100:00080000:0.0:1777051488.536534:0:3676:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1777051488.536542:0:8471:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d9533bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3678:x1863365452697216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777051488.536549:0:3676:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f9fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3676:1863365452697088:0@lo:38:kworker.0 00000100:00100000:1.0:1777051488.536562:0:13320:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3680:x1863365452697344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777051488.536633:0:8471:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d9533bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3678:x1863365452697216:12345-0@lo:400:kworker.0 Request processed in 98us (1429us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051488.536647:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10521 00000100:00100000:0.0:1777051488.536663:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f9fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3678:1863365452696960:0@lo:400:kworker.0 00000100:00100000:1.0:1777051488.536673:0:13320:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3680:x1863365452697344:12345-0@lo:400:kworker.0 Request processed in 116us (1094us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051488.536692:0:13320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10522 00000100:00100000:0.0:1777051488.536708:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f9fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452697216:0@lo:400:kworker.0 00000100:00080000:2.0:1777051488.536708:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1777051488.536781:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f9fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3680:1863365452697344:0@lo:400:kworker.0 00000100:00100000:3.0:1777051488.536858:0:10328:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94c129180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3679:x1863365452696704:12345-0@lo:400:kworker.0 Request processed in 1239us (1833us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051488.536876:0:10328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13481 00000100:00100000:0.0:1777051488.536939:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955611f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3679:1863365452696704:0@lo:400:kworker.0 00000100:00100000:3.0:1777051489.046502:0:3679:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1777051489.046520:0:3678:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1777051489.046541:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d9533bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452697600:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1777051489.046548:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f9ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452697728:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1777051489.046668:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051489.046726:0:10113:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452697600 00000100:00100000:2.0:1777051489.046738:0:10113:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452697600 00000100:00100000:3.0:1777051489.046777:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051489.046836:0:10113:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452697728 00000100:00100000:2.0:1777051489.046845:0:10113:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452697728 00000100:00100000:3.0:1777051489.046852:0:47388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5700 00000100:00100000:3.0:1777051489.046875:0:47388:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d9533bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3679:x1863365452697600:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1777051489.046931:0:47388:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 489209408 pending 0 free 3642707968 avail 3411185664 00000100:00100000:2.0:1777051489.046936:0:10113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5701 00000100:00100000:2.0:1777051489.046958:0:10113:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d9533bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3678:x1863365452697728:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1777051489.047031:0:10113:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 499269184 pending 0 free 3860574208 avail 3629051904 00000100:00100000:3.0:1777051489.047060:0:47388:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d9533bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3679:x1863365452697600:12345-0@lo:13:osp-pre-1-1.0 Request processed in 189us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051489.047376:0:47388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5700 00000100:00100000:2.0:1777051489.047469:0:10113:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d9533bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3678:x1863365452697728:12345-0@lo:13:osp-pre-0-1.0 Request processed in 511us (689us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051489.047482:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d9533bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452697600:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1777051489.047494:0:10113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5701 00000100:00100000:0.0:1777051489.047519:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f9ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452697728:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1777051489.431522:0:108751:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051490.454990:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1777051491.002645:0:109174:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:0.0:1777051491.002650:0:109174:0:(obd_mount.c:917:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:0.0:1777051491.002653:0:109174:0:(obd_mount.c:920:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1777051491.002789:0:109174:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff99da7b5f9800 00000020:01000004:0.0:1777051491.002808:0:109174:0:(tgt_mount.c:2453:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:0.0:1777051491.002827:0:109174:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1777051491.002845:0:109174:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff99d941ce0000) 00000020:00000080:0.0:1777051491.002868:0:109174:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1777051491.091572:0:109174:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1777051491.093977:0:109174:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:3.0:1777051491.097109:0:109174:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1777051491.097927:0:109174:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:3.0:1777051491.098333:0:109174:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:3.0:1777051491.099232:0:109174:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:3.0:1777051491.099617:0:109174:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:3.0:1777051491.100030:0:109174:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:3.0:1777051491.100515:0:109174:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1777051491.101224:0:109174:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:3.0:1777051491.101588:0:109174:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1777051491.102282:0:109174:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:3.0:1777051491.102878:0:109174:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:3.0:1777051491.103523:0:109174:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:3.0:1777051491.107017:0:109174:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:3.0:1777051491.107510:0:109174:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:3.0:1777051491.107886:0:109174:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:3.0:1777051491.108294:0:109174:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:3.0:1777051491.108657:0:109174:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:3.0:1777051491.109310:0:109174:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:3.0:1777051491.109688:0:109174:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:3.0:1777051491.110362:0:109174:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:3.0:1777051491.110924:0:109174:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:3.0:1777051491.111607:0:109174:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:3.0:1777051491.112002:0:109174:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:3.0:1777051491.112652:0:109174:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:3.0:1777051491.116141:0:109174:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:3.0:1777051491.117647:0:109174:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:3.0:1777051491.118257:0:109174:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:3.0:1777051491.118623:0:109174:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:3.0:1777051491.119068:0:109174:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:3.0:1777051491.119867:0:109174:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:3.0:1777051491.120384:0:109174:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:3.0:1777051491.120786:0:109174:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:3.0:1777051491.121692:0:109174:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:3.0:1777051491.122526:0:109174:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:3.0:1777051491.123424:0:109174:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:3.0:1777051491.123821:0:109174:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:3.0:1777051491.124223:0:109174:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:3.0:1777051491.124616:0:109174:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:3.0:1777051491.125033:0:109174:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:3.0:1777051491.126692:0:109174:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:3.0:1777051491.128034:0:109174:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:3.0:1777051491.128924:0:109174:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:3.0:1777051491.129416:0:109174:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:3.0:1777051491.129778:0:109174:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:3.0:1777051491.132486:0:109174:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:3.0:1777051491.140585:0:109174:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:3.0:1777051491.142596:0:109174:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:3.0:1777051491.142991:0:109174:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:3.0:1777051491.144357:0:109174:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:3.0:1777051491.144768:0:109174:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:3.0:1777051491.145465:0:109174:0:(osd_scrub.c:1783:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:01000000:3.0:1777051491.146755:0:109174:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1777051491.147477:0:109174:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1777051491.147487:0:109174:0:(osd_handler.c:8912:osd_obd_connect()) connect #0 00000020:00000080:2.0:1777051491.147501:0:109174:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x85f51a6b96717746 00000020:01000004:2.0:1777051491.147510:0:109174:0:(tgt_mount.c:2538:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:2.0:1777051491.147523:0:109174:0:(tgt_mount.c:217:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1777051491.147529:0:109174:0:(tgt_mount.c:99:server_register_mount()) register mount ffff99da7b5f9800 from MGS 00000020:01000004:2.0:1777051491.147533:0:109174:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1777051491.147544:0:109174:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff99da462019c0) 00000020:00000080:2.0:1777051491.147574:0:109174:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1777051491.147664:0:109174:0:(tgt_mount.c:151:server_get_mount()) get mount ffff99da7b5f9800 from MGS, refs=2 00080000:01000000:2.0:1777051491.147671:0:109174:0:(osd_handler.c:8912:osd_obd_connect()) connect #1 00000020:00000080:2.0:1777051491.147679:0:109174:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x85f51a6b96717754 00010000:00010000:2.0:1777051491.147842:0:109174:0:(ldlm_pool.c:924:ldlm_pool_init()) Lock pool ldlm-pool-MGS-3 is initialized 00000040:01000000:2.0:1777051491.156491:0:109174:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:1.0:1777051491.157657:0:109178:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1777051491.157715:0:109174:0:(mgs_nids.c:664:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1777051491.157780:0:109174:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1777051491.161324:0:109174:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1777051491.161803:0:109174:0:(service.c:153:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1777051491.162118:0:109174:0:(service.c:3441:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1777051491.162129:0:109174:0:(service.c:3500:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1777051491.163095:0:109174:0:(service.c:3441:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1777051491.163108:0:109174:0:(service.c:3500:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1777051491.163747:0:109174:0:(service.c:3441:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1777051491.163759:0:109174:0:(service.c:3500:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1777051491.165025:0:109174:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1777051491.165056:0:109174:0:(obd_mount.c:383:lustre_start_mgc()) New MGS with live MGC 00000020:01000004:2.0:1777051491.165059:0:109174:0:(obd_mount.c:394:lustre_start_mgc()) MGC192.168.201.146@tcp:Set MGC reconnect 2 10000000:01000000:2.0:1777051491.165064:0:109174:0:(mgc_request.c:1069:mgc_set_info_async()) InitRecov MGC192.168.201.146@tcp 2/d0:i0:r0:or0:FULL 00000100:00080000:2.0:1777051491.165073:0:109174:0:(import.c:65:import_set_state_nolock()) ffff99da48759800 MGS: changing import state from FULL to DISCONN 00000100:02020000:2.0:1777051491.165082:0:109174:0:(import.c:185:ptlrpc_set_import_discon()) MGC192.168.201.146@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:2.0:1777051491.182883:0:109174:0:(import.c:191:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.201.146@tcp not replayable, auto-deactivating 00000100:00080000:2.0:1777051491.182890:0:109174:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1777051491.182903:0:109174:0:(client.c:3579:ptlrpc_abort_inflight()) @@@ inflight req@ffff99da4384d880 x1863365452693632/t0(0) o400->MGC192.168.201.146@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1777051494 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1777051491.182965:0:109174:0:(client.c:3579:ptlrpc_abort_inflight()) @@@ inflight req@ffff99d94c128380 x1863365452695040/t0(0) o400->MGC192.168.201.146@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1777051499 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1777051491.182988:0:109174:0:(client.c:3579:ptlrpc_abort_inflight()) @@@ inflight req@ffff99d955610000 x1863365452696448/t0(0) o400->MGC192.168.201.146@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1777051504 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1777051491.183005:0:109174:0:(mgc_request.c:1166:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1777051491.183021:0:109174:0:(pinger.c:192:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1777051491.183024:0:109174:0:(mgc_request.c:1166:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1777051491.183029:0:109174:0:(import.c:321:ptlrpc_invalidate_import()) Sleeping 17s for inflight to error out 00000100:00100000:0.0:1777051491.183059:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da4384d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3678:1863365452693632:0@lo:400:kworker.0 00000100:00100000:1.0:1777051491.183124:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955610000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3680:1863365452696448:0@lo:400:kworker.0 00000100:00100000:1.0:1777051491.183155:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94c128380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3680:1863365452695040:0@lo:400:kworker.0 10000000:01000000:2.0:1777051491.183173:0:109174:0:(mgc_request.c:1166:mgc_import_event()) import event 0x808003 00010000:00010000:2.0:1777051491.183250:0:109174:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.146@tcp lock: ffff99d955a98c00/0x85f51a6b96714cb3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x85f51a6b96714cba expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1777051491.183269:0:109174:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.146@tcp lock: ffff99d955a98c00/0x85f51a6b96714cb3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x85f51a6b96714cba expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1777051491.183282:0:109174:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1777051491.183309:0:109174:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1777051491.183323:0:109174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.146@tcp lock: ffff99d955a98c00/0x85f51a6b96714cb3 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x85f51a6b96714cba expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051491.183352:0:109174:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.146@tcp lock: ffff99da713e2400/0x85f51a6b96714c27 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110e400000000 nid: local remote: 0x85f51a6b96714c2e expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1777051491.183366:0:109174:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.146@tcp lock: ffff99da713e2400/0x85f51a6b96714c27 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110f400000000 nid: local remote: 0x85f51a6b96714c2e expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1777051491.183376:0:109174:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1777051491.183396:0:109174:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1777051491.183403:0:109174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.146@tcp lock: ffff99da713e2400/0x85f51a6b96714c27 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x590f400000000 nid: local remote: 0x85f51a6b96714c2e expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051491.183424:0:109174:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.146@tcp lock: ffff99d9442eaa00/0x85f51a6b96714c35 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110e400000000 nid: local remote: 0x85f51a6b96714c3c expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1777051491.183437:0:109174:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.146@tcp lock: ffff99d9442eaa00/0x85f51a6b96714c35 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110f400000000 nid: local remote: 0x85f51a6b96714c3c expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1777051491.183448:0:109174:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1777051491.183463:0:109174:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1777051491.183470:0:109174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.146@tcp lock: ffff99d9442eaa00/0x85f51a6b96714c35 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x590f400000000 nid: local remote: 0x85f51a6b96714c3c expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051491.183489:0:109174:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.146@tcp lock: ffff99da713e2000/0x85f51a6b96714c51 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110e400000000 nid: local remote: 0x85f51a6b96714c58 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1777051491.183499:0:109174:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.146@tcp lock: ffff99da713e2000/0x85f51a6b96714c51 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110f400000000 nid: local remote: 0x85f51a6b96714c58 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1777051491.183509:0:109174:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1777051491.183525:0:109174:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1777051491.183531:0:109174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.146@tcp lock: ffff99da713e2000/0x85f51a6b96714c51 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x590f400000000 nid: local remote: 0x85f51a6b96714c58 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051491.183545:0:109174:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.146@tcp lock: ffff99d955a98e00/0x85f51a6b96714c5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110e400000000 nid: local remote: 0x85f51a6b96714c66 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1777051491.183557:0:109174:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.146@tcp lock: ffff99d955a98e00/0x85f51a6b96714c5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110f400000000 nid: local remote: 0x85f51a6b96714c66 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1777051491.183566:0:109174:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1777051491.183584:0:109174:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1777051491.183593:0:109174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.146@tcp lock: ffff99d955a98e00/0x85f51a6b96714c5f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x590f400000000 nid: local remote: 0x85f51a6b96714c66 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051491.183610:0:109174:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.146@tcp lock: ffff99d955a99800/0x85f51a6b96714ccf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0x85f51a6b96714cd6 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1777051491.183622:0:109174:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.146@tcp lock: ffff99d955a99800/0x85f51a6b96714ccf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0x85f51a6b96714cd6 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1777051491.183638:0:109174:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1777051491.183653:0:109174:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1777051491.183660:0:109174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.146@tcp lock: ffff99d955a99800/0x85f51a6b96714ccf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0x85f51a6b96714cd6 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051491.183680:0:109174:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.146@tcp lock: ffff99d954ea6600/0x85f51a6b96714fa0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0x85f51a6b96714fa7 expref: -99 pid: 104204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1777051491.183980:0:109174:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.146@tcp lock: ffff99d954ea6600/0x85f51a6b96714fa0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0x85f51a6b96714fa7 expref: -99 pid: 104204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1777051491.183993:0:109174:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1777051491.184013:0:109174:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1777051491.184023:0:109174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.146@tcp lock: ffff99d954ea6600/0x85f51a6b96714fa0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0x85f51a6b96714fa7 expref: -99 pid: 104204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051491.184047:0:109174:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.146@tcp lock: ffff99d954ea6400/0x85f51a6b96715064 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x85f51a6b9671506b expref: -99 pid: 104204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1777051491.184059:0:109174:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.146@tcp lock: ffff99d954ea6400/0x85f51a6b96715064 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x85f51a6b9671506b expref: -99 pid: 104204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1777051491.184069:0:109174:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1777051491.184086:0:109174:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1777051491.184093:0:109174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.146@tcp lock: ffff99d954ea6400/0x85f51a6b96715064 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x85f51a6b9671506b expref: -99 pid: 104204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051491.184117:0:109174:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.146@tcp lock: ffff99d95071b600/0x85f51a6b9671508e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x85f51a6b96715095 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1777051491.184137:0:109174:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.146@tcp lock: ffff99d95071b600/0x85f51a6b9671508e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x85f51a6b96715095 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1777051491.184147:0:109174:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1777051491.184163:0:109174:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1777051491.184170:0:109174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.146@tcp lock: ffff99d95071b600/0x85f51a6b9671508e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x85f51a6b96715095 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051491.184260:0:109174:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.146@tcp lock: ffff99d95071b000/0x85f51a6b96714f92 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x85f51a6b96714f99 expref: -99 pid: 104204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1777051491.184275:0:109174:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.146@tcp lock: ffff99d95071b000/0x85f51a6b96714f92 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x85f51a6b96714f99 expref: -99 pid: 104204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1777051491.184285:0:109174:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 00010000:00010000:2.0:1777051491.184303:0:109174:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1777051491.184310:0:109174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.146@tcp lock: ffff99d95071b000/0x85f51a6b96714f92 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x85f51a6b96714f99 expref: -99 pid: 104204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051491.184344:0:109174:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.146@tcp lock: ffff99da713e3200/0x85f51a6b9671539e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0x85f51a6b967153a5 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1777051491.184353:0:109174:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.146@tcp lock: ffff99da713e3200/0x85f51a6b9671539e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0x85f51a6b967153a5 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1777051491.184359:0:109174:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1777051491.184371:0:109174:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1777051491.184376:0:109174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.146@tcp lock: ffff99da713e3200/0x85f51a6b9671539e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0x85f51a6b967153a5 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051491.184399:0:109174:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.146@tcp lock: ffff99d954ea7c00/0x85f51a6b967153ba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0x85f51a6b967153c1 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1777051491.184408:0:109174:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.146@tcp lock: ffff99d954ea7c00/0x85f51a6b967153ba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0x85f51a6b967153c1 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1777051491.184413:0:109174:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1777051491.184424:0:109174:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1777051491.184428:0:109174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.146@tcp lock: ffff99d954ea7c00/0x85f51a6b967153ba lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0x85f51a6b967153c1 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051491.184444:0:109174:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.146@tcp lock: ffff99d943ebb200/0x85f51a6b967153c8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x85f51a6b967153cf expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1777051491.184452:0:109174:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.146@tcp lock: ffff99d943ebb200/0x85f51a6b967153c8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x85f51a6b967153cf expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1777051491.184459:0:109174:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1777051491.184469:0:109174:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1777051491.184476:0:109174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.146@tcp lock: ffff99d943ebb200/0x85f51a6b967153c8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x85f51a6b967153cf expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1777051491.184514:0:109174:0:(import.c:213:ptlrpc_set_import_discon()) mgc: import ffff99da48759800 already not connected (conn 12, was 0): DISCONN 00000100:00080000:2.0:1777051491.184524:0:109174:0:(import.c:65:import_set_state_nolock()) ffff99da48759800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1777051491.184532:0:109174:0:(import.c:509:import_select_connection()) MGC192.168.201.146@tcp: connect to NID 0@lo last attempt 7924 00000100:00080000:2.0:1777051491.184543:0:109174:0:(import.c:623:import_select_connection()) MGC192.168.201.146@tcp: import ffff99da48759800 using connection 192.168.201.146@tcp/0@lo 00000100:00100000:2.0:1777051491.184581:0:109174:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99da5f9fed80 x1863365452697856/t0(0) o250->MGC192.168.201.146@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1777051491.184630:0:109174:0:(recover.c:338:ptlrpc_recover_import()) MGS: recovery started, waiting 20 seconds 00000100:00100000:0.0:1777051491.184701:0:3676:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f9fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3676:1863365452697856:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1777051491.185114:0:3676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051491.185253:0:109180:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452697856 00000100:00100000:1.0:1777051491.185273:0:109180:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452697856 00000100:00100000:1.0:1777051491.185356:0:109180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1777051491.185371:0:109180:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942d2ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3676:x1863365452697856:12345-0@lo:250:mount.lustre.0 00010000:00080000:1.0:1777051491.185402:0:109180:0:(ldlm_lib.c:1431:target_handle_connect()) MGS: connection from f9351a01-5b0e-4470-97fd-58b9b4b312a2@0@lo t0 exp 0000000000000000 cur 8120 last 0 00000020:00000080:1.0:1777051491.185441:0:109180:0:(genops.c:1406:class_connect()) connect: client f9351a01-5b0e-4470-97fd-58b9b4b312a2, cookie 0x85f51a6b9671775b 00000100:00080000:1.0:1777051491.185631:0:109180:0:(import.c:65:import_set_state_nolock()) ffff99da48d35000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1777051491.185724:0:109180:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942d2ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9351a01-5b0e-4470-97fd-58b9b4b312a2+4:3676:x1863365452697856:12345-0@lo:250:mount.lustre.0 Request processed in 352us (609us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051491.185737:0:109180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1777051491.185805:0:3676:0:(client.c:3101:ptlrpc_free_committed()) MGC192.168.201.146@tcp: committing for last_committed 0 gen 8 00000100:00080000:2.0:1777051491.185818:0:3676:0:(import.c:1130:ptlrpc_connect_interpret()) MGC192.168.201.146@tcp: connect to target with instance 0 00000100:00080000:2.0:1777051491.185828:0:3676:0:(import.c:958:ptlrpc_connect_set_flags()) MGC192.168.201.146@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1777051491.185833:0:3676:0:(mgc_request.c:1166:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1777051491.185837:0:3676:0:(import.c:65:import_set_state_nolock()) ffff99da48759800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1777051491.185841:0:3676:0:(mgc_request.c:1166:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1777051491.185882:0:3676:0:(pinger.c:185:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1777051491.185908:0:3676:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f9fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3676:1863365452697856:0@lo:250:mount.lustre.0 00000100:00080000:0.0:1777051491.185987:0:109174:0:(recover.c:349:ptlrpc_recover_import()) MGS: recovery finished FULL, rc = 0 00000020:01000004:0.0:1777051491.186003:0:109174:0:(tgt_mount.c:1762:server_start_targets()) starting target lustre-MDT0000 00000020:01000000:3.0:1777051491.186030:0:84827:0:(tgt_mount.c:1579:tgt_import_update()) NID #0: 192.168.201.146@tcp 00000020:01000004:0.0:1777051491.186054:0:109174:0:(tgt_mount.c:278:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:0.0:1777051491.186061:0:109174:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.146@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 10000000:01000000:3.0:1777051491.186077:0:84827:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0000 about 1 new NIDs 00000020:01000004:3.0:1777051491.186085:0:84827:0:(tgt_mount.c:1144:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:3.0:1777051491.186088:0:84827:0:(tgt_mount.c:1145:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1777051491.186090:0:84827:0:(tgt_mount.c:1146:server_mti_print()) fs: lustre 00000020:01000004:3.0:1777051491.186093:0:84827:0:(tgt_mount.c:1147:server_mti_print()) uuid: 00000020:01000004:3.0:1777051491.186096:0:84827:0:(tgt_mount.c:1148:server_mti_print()) ver: 0 00000020:01000004:3.0:1777051491.186098:0:84827:0:(tgt_mount.c:1149:server_mti_print()) flags: 00000020:01000004:3.0:1777051491.186100:0:84827:0:(tgt_mount.c:1153:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1777051491.186105:0:84827:0:(tgt_mount.c:1183:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1777051491.186108:0:84827:0:(tgt_mount.c:1189:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:3.0:1777051491.186173:0:84827:0:(tgt_mount.c:1590:tgt_import_update()) lustre-OST0000: notify about 1 NIDs, rc = 0 00000040:01000000:0.0:1777051491.186186:0:109174:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.146@tcp ctxt 0 is initialized 10000000:01000000:3.0:1777051491.186187:0:84827:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0001 about 1 new NIDs 00000020:01000004:3.0:1777051491.186204:0:84827:0:(tgt_mount.c:1144:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:3.0:1777051491.186208:0:84827:0:(tgt_mount.c:1145:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1777051491.186211:0:84827:0:(tgt_mount.c:1146:server_mti_print()) fs: lustre 00000020:01000004:3.0:1777051491.186213:0:84827:0:(tgt_mount.c:1147:server_mti_print()) uuid: 00000020:01000004:3.0:1777051491.186219:0:84827:0:(tgt_mount.c:1148:server_mti_print()) ver: 0 00000020:01000004:3.0:1777051491.186223:0:84827:0:(tgt_mount.c:1149:server_mti_print()) flags: 00000100:00100000:1.0:1777051491.186229:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d9533bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3678:1863365452697984:0@lo:253:kworker.0 00000020:01000004:3.0:1777051491.186229:0:84827:0:(tgt_mount.c:1153:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1777051491.186232:0:109174:0:(tgt_mount.c:1387:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.201.146@tcp, index=0000, flags=0x20005 00000020:01000004:3.0:1777051491.186235:0:84827:0:(tgt_mount.c:1183:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1777051491.186242:0:84827:0:(tgt_mount.c:1189:server_mti_print()) LDD_F_OPC_READY 00000020:01000004:0.0:1777051491.186245:0:109174:0:(tgt_mount.c:1144:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1777051491.186249:0:109174:0:(tgt_mount.c:1145:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1777051491.186252:0:109174:0:(tgt_mount.c:1146:server_mti_print()) fs: lustre 00000020:01000004:0.0:1777051491.186255:0:109174:0:(tgt_mount.c:1147:server_mti_print()) uuid: 00000020:01000004:0.0:1777051491.186257:0:109174:0:(tgt_mount.c:1148:server_mti_print()) ver: 0 00000020:01000004:0.0:1777051491.186259:0:109174:0:(tgt_mount.c:1149:server_mti_print()) flags: 00000020:01000004:0.0:1777051491.186262:0:109174:0:(tgt_mount.c:1151:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1777051491.186264:0:109174:0:(tgt_mount.c:1155:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1777051491.186268:0:109174:0:(tgt_mount.c:1183:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1777051491.186273:0:109174:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1777051491.186278:0:109174:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:0.0:1777051491.186283:0:109174:0:(tgt_mount.c:1144:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1777051491.186286:0:109174:0:(tgt_mount.c:1145:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1777051491.186289:0:109174:0:(tgt_mount.c:1146:server_mti_print()) fs: lustre 00000020:01000004:0.0:1777051491.186292:0:109174:0:(tgt_mount.c:1147:server_mti_print()) uuid: 00000020:01000004:0.0:1777051491.186296:0:109174:0:(tgt_mount.c:1148:server_mti_print()) ver: 0 00000020:01000000:3.0:1777051491.186297:0:84827:0:(tgt_mount.c:1590:tgt_import_update()) lustre-OST0001: notify about 1 NIDs, rc = 0 00000020:01000004:0.0:1777051491.186299:0:109174:0:(tgt_mount.c:1149:server_mti_print()) flags: 00000020:01000004:0.0:1777051491.186304:0:109174:0:(tgt_mount.c:1151:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1777051491.186310:0:109174:0:(tgt_mount.c:1155:server_mti_print()) LDD_F_SV_TYPE_MGS 10000000:01000000:3.0:1777051491.186311:0:84827:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-MDT0001 about 1 new NIDs 00000020:01000004:0.0:1777051491.186314:0:109174:0:(tgt_mount.c:1183:server_mti_print()) LDD_F_LARGE_NID 00000100:00100000:1.0:1777051491.186318:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000004:0.0:1777051491.186319:0:109174:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1777051491.186321:0:84827:0:(tgt_mount.c:1144:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:3.0:1777051491.186328:0:84827:0:(tgt_mount.c:1145:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1777051491.186331:0:84827:0:(tgt_mount.c:1146:server_mti_print()) fs: lustre 00000020:01000004:3.0:1777051491.186335:0:84827:0:(tgt_mount.c:1147:server_mti_print()) uuid: 00000020:01000004:3.0:1777051491.186338:0:84827:0:(tgt_mount.c:1148:server_mti_print()) ver: 0 00000020:01000004:3.0:1777051491.186342:0:84827:0:(tgt_mount.c:1149:server_mti_print()) flags: 00000020:01000004:3.0:1777051491.186345:0:84827:0:(tgt_mount.c:1151:server_mti_print()) LDD_F_SV_TYPE_MDT 10000000:01000000:0.0:1777051491.186346:0:109174:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000020:01000004:3.0:1777051491.186348:0:84827:0:(tgt_mount.c:1183:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1777051491.186354:0:84827:0:(tgt_mount.c:1189:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:0.0:1777051491.186369:0:109174:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94c128a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9351a01-5b0e-4470-97fd-58b9b4b312a2:109174:1863365452698240:0@lo:253:mount.lustre.0 00000020:01000000:3.0:1777051491.186388:0:84827:0:(tgt_mount.c:1590:tgt_import_update()) lustre-MDT0001: notify about 1 NIDs, rc = 0 00000100:00100000:1.0:1777051491.186394:0:109182:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452697984 00000100:00100000:1.0:1777051491.186403:0:109182:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452697984 00000100:00100000:3.0:1777051491.186442:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d9533bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3679:1863365452698112:0@lo:253:kworker.0 00000100:00100000:1.0:1777051491.186479:0:109182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1777051491.186497:0:109182:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942d29450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9351a01-5b0e-4470-97fd-58b9b4b312a2+4:3678:x1863365452697984:12345-0@lo:253:kworker.0 00000100:00100000:3.0:1777051491.186514:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 20000000:01000000:1.0:1777051491.186531:0:109182:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 00000100:00100000:2.0:1777051491.186553:0:109181:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452698112 00000100:00100000:2.0:1777051491.186562:0:109181:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452698112 00000100:00100000:3.0:1777051491.186563:0:3679:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1777051491.186580:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d9533bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3679:1863365452698368:0@lo:253:kworker.0 00000100:00100000:0.0:1777051491.186605:0:109174:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051491.186613:0:109181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1777051491.186633:0:109181:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da6145ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9351a01-5b0e-4470-97fd-58b9b4b312a2+5:3679:x1863365452698112:12345-0@lo:253:kworker.0 00000100:00100000:0.0:1777051491.186636:0:109174:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d95c3e23c0 going to sleep for 11 seconds 00000100:00100000:3.0:1777051491.186656:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 20000000:01000000:2.0:1777051491.186666:0:109181:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 10000000:01000000:0.0:1777051491.186897:0:109183:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00000100:00100000:3.0:1777051491.187149:0:109180:0:(service.c:3441:ptlrpc_start_thread()) mgs[-1] started 3 min 3 max 32 00000100:00100000:3.0:1777051491.187162:0:109180:0:(service.c:3500:ptlrpc_start_thread()) starting thread 'll_mgs_0003' 20000000:01000000:1.0:1777051491.187457:0:109182:0:(mgs_nids.c:664:mgs_nidtbl_init_fs()) IR: current version is 31 00000100:00100000:1.0:1777051491.188179:0:109180:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452698240 00000100:00100000:1.0:1777051491.188187:0:109180:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452698240 00000100:00100000:1.0:1777051491.188221:0:109180:0:(service.c:3441:ptlrpc_start_thread()) mgs[-1] started 3 min 3 max 32 00000100:00100000:1.0:1777051491.188232:0:109180:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452698368 00000100:00100000:1.0:1777051491.188237:0:109180:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452698368 00000100:00100000:3.0:1777051491.188697:0:109184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1777051491.188714:0:109184:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da6145c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f9351a01-5b0e-4470-97fd-58b9b4b312a2+7:109174:x1863365452698240:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1777051491.191340:0:109185:0:(mgs_llog.c:341:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:3.0:1777051491.191348:0:109185:0:(mgs_llog.c:341:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:3.0:1777051491.191353:0:109185:0:(mgs_llog.c:325:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:3.0:1777051491.191358:0:109185:0:(mgs_llog.c:325:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:3.0:1777051491.191674:0:109185:0:(llog.c:858:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64 count 63 20000000:01000000:0.0:1777051491.191903:0:109182:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1777051491.191975:0:109182:0:(mgs_nids.c:461:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1777051491.192103:0:109184:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1777051491.192110:0:109184:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1777051491.192117:0:109184:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 20000000:01000000:3.0:1777051491.192127:0:109184:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1777051491.195754:0:109182:0:(mgs_nids.c:813:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1777051491.195787:0:109182:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1777051491.195790:0:109184:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da6145c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f9351a01-5b0e-4470-97fd-58b9b4b312a2+7:109174:x1863365452698240:12345-0@lo:253:mount.lustre.0 Request processed in 7077us (9185us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051491.195811:0:109184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 20000000:01000000:2.0:1777051491.195834:0:109181:0:(mgs_nids.c:461:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1777051491.195889:0:109184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1777051491.195903:0:109174:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94c128a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9351a01-5b0e-4470-97fd-58b9b4b312a2:109174:1863365452698240:0@lo:253:mount.lustre.0 20000000:01000000:0.0:1777051491.195918:0:109183:0:(mgs_nids.c:710:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1777051491.195926:0:109183:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1777051491.195961:0:109174:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1777051491.195967:0:109174:0:(tgt_mount.c:1144:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1777051491.195970:0:109174:0:(tgt_mount.c:1145:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1777051491.195974:0:109174:0:(tgt_mount.c:1146:server_mti_print()) fs: lustre 00000020:01000004:1.0:1777051491.195976:0:109174:0:(tgt_mount.c:1147:server_mti_print()) uuid: 00000020:01000004:1.0:1777051491.195978:0:109174:0:(tgt_mount.c:1148:server_mti_print()) ver: 0 00000020:01000004:1.0:1777051491.195980:0:109174:0:(tgt_mount.c:1149:server_mti_print()) flags: 00000020:01000004:1.0:1777051491.195983:0:109174:0:(tgt_mount.c:1151:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1777051491.195985:0:109174:0:(tgt_mount.c:1155:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1777051491.195988:0:109174:0:(tgt_mount.c:1183:server_mti_print()) LDD_F_LARGE_NID 00010000:00010000:0.0:1777051491.195990:0:109183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99da7d774600/0x85f51a6b96717762 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 109183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1777051491.195990:0:109174:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_OPC_REG 00010000:00010000:0.0:1777051491.196013:0:109183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99da7d774600/0x85f51a6b96717762 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 109183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1777051491.196018:0:109174:0:(tgt_mount.c:99:server_register_mount()) register mount ffff99da7b5f9800 from lustre-MDT0000 20000000:01000000:0.0:1777051491.196027:0:109183:0:(mgs_nids.c:686:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000103200s 10000000:01000000:1.0:1777051491.196055:0:109174:0:(mgc_request.c:1941:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1777051491.196060:0:109174:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1777051491.196071:0:109174:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff99da7b5f9800 10000000:01000000:1.0:1777051491.196077:0:109174:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1777051491.196083:0:109174:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff99da7b5f9800 10000000:01000000:1.0:1777051491.196087:0:109174:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1777051491.196092:0:109174:0:(mgc_request.c:1799:mgc_process_log()) Process log lustre-barrier-ffff99da7b5f9800 from 1 10000000:01000000:1.0:1777051491.196096:0:109174:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1777051491.196131:0:109174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.146@tcp lock: ffff99d953284800/0x85f51a6b96717769 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 109174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051491.196144:0:109174:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.146@tcp lock: ffff99d953284800/0x85f51a6b96717769 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 109174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051491.196158:0:109174:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.146@tcp lock: ffff99d953284800/0x85f51a6b96717769 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 109174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051491.196185:0:109174:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955ebd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9351a01-5b0e-4470-97fd-58b9b4b312a2:109174:1863365452698496:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1777051491.196215:0:109184:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da6145f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f9351a01-5b0e-4470-97fd-58b9b4b312a2+6:3679:x1863365452698368:12345-0@lo:253:kworker.0 20000000:01000000:3.0:1777051491.196258:0:109184:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 00000100:00100000:1.0:1777051491.196286:0:109174:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051491.196339:0:109174:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d9567aaa80 going to sleep for 11 seconds 00000100:00100000:3.0:1777051491.196369:0:109180:0:(service.c:3441:ptlrpc_start_thread()) mgs[-1] started 4 min 3 max 32 00000100:00100000:3.0:1777051491.196382:0:109180:0:(service.c:3500:ptlrpc_start_thread()) starting thread 'll_mgs_0004' 00000100:00100000:1.0:1777051491.196705:0:109180:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452698496 00000100:00100000:1.0:1777051491.196713:0:109180:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452698496 00000100:00100000:3.0:1777051491.196828:0:109186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1777051491.196843:0:109186:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da6145e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f9351a01-5b0e-4470-97fd-58b9b4b312a2+7:109174:x1863365452698496:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1777051491.196857:0:109186:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777051491.196877:0:109186:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d94e6e7a00/0x85f51a6b96717770 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x85f51a6b96717769 expref: -99 pid: 109186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051491.196903:0:109186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d94e6e7a00/0x85f51a6b96717770 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x85f51a6b96717769 expref: 8 pid: 109186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051491.196919:0:109186:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d94e6e7a00/0x85f51a6b96717770 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b96717769 expref: 8 pid: 109186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051491.196966:0:109186:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d94e6e7a00, rc 0) 00000100:00100000:3.0:1777051491.197032:0:109186:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da6145e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f9351a01-5b0e-4470-97fd-58b9b4b312a2+8:109174:x1863365452698496:12345-0@lo:101:mount.lustre.0 Request processed in 192us (747us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051491.197044:0:109186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:0.0:1777051491.197061:0:109183:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99da7d774600/0x85f51a6b96717762 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 109183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051491.197077:0:109183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99da7d774600/0x85f51a6b96717762 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 109183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051491.197097:0:109183:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99da7d774600/0x85f51a6b96717762 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 109183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051491.197111:0:109183:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99da7d774600/0x85f51a6b96717762 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 109183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051491.197122:0:109183:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da7d774600 already unused, calling callback (ffffffffc0bed2d0) 00000100:00100000:1.0:1777051491.197129:0:109174:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955ebd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9351a01-5b0e-4470-97fd-58b9b4b312a2:109174:1863365452698496:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1777051491.197132:0:109183:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99da7d774600/0x85f51a6b96717762 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 109183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051491.197158:0:109174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.146@tcp lock: ffff99d953284800/0x85f51a6b96717769 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b96717770 expref: -99 pid: 109174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051491.197177:0:109174:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.146@tcp lock: ffff99d953284800/0x85f51a6b96717769 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x85f51a6b96717770 expref: -99 pid: 109174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051491.197230:0:109183:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99da7d774600/0x85f51a6b96717762 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 109183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051491.197230:0:109182:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942d29450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9351a01-5b0e-4470-97fd-58b9b4b312a2+8:3678:x1863365452697984:12345-0@lo:253:kworker.0 Request processed in 10698us (10883us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051491.197265:0:109182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:0.0:1777051491.197276:0:109183:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99da7d774600/0x85f51a6b96717762 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 109183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1777051491.197286:0:109174:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.201.146@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1777051491.197291:0:109183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99da7d774600/0x85f51a6b96717762 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 109183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051491.197306:0:109183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99da7d774600/0x85f51a6b96717762 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 109183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051491.197307:0:109174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff99d953284800/0x85f51a6b96717769 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b96717770 expref: -99 pid: 109174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051491.197338:0:109174:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.146@tcp lock: ffff99d953284800/0x85f51a6b96717769 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b96717770 expref: -99 pid: 109174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1777051491.197354:0:3678:0:(tgt_mount.c:1144:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:2.0:1777051491.197359:0:3678:0:(tgt_mount.c:1145:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1777051491.197363:0:3678:0:(tgt_mount.c:1146:server_mti_print()) fs: lustre 00000020:01000004:2.0:1777051491.197366:0:3678:0:(tgt_mount.c:1147:server_mti_print()) uuid: 00000020:01000004:2.0:1777051491.197369:0:3678:0:(tgt_mount.c:1148:server_mti_print()) ver: 0 00000020:01000004:2.0:1777051491.197372:0:3678:0:(tgt_mount.c:1149:server_mti_print()) flags: 10000000:01000000:1.0:1777051491.197375:0:109174:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 00000020:01000004:2.0:1777051491.197376:0:3678:0:(tgt_mount.c:1153:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1777051491.197381:0:3678:0:(tgt_mount.c:1183:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1777051491.197385:0:3678:0:(tgt_mount.c:1189:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1777051491.197386:0:109174:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 00000100:00100000:2.0:1777051491.197393:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d9533bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3678:1863365452697984:0@lo:253:kworker.0 10000000:01000000:1.0:1777051491.197399:0:109174:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff99da7b5f9800 10000000:01000000:1.0:1777051491.197408:0:109174:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1777051491.197417:0:109174:0:(mgc_request.c:1799:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1777051491.197421:0:109174:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1777051491.197451:0:109174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.146@tcp lock: ffff99d953284400/0x85f51a6b96717777 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 109174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051491.197464:0:109174:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.146@tcp lock: ffff99d953284400/0x85f51a6b96717777 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 109174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051491.197477:0:109174:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.146@tcp lock: ffff99d953284400/0x85f51a6b96717777 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 109174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051491.197500:0:109174:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955ebd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9351a01-5b0e-4470-97fd-58b9b4b312a2:109174:1863365452698624:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1777051491.197543:0:109174:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051491.197584:0:109174:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d9567aaa80 going to sleep for 11 seconds 00000100:00100000:3.0:1777051491.197615:0:109180:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452698624 00000100:00100000:3.0:1777051491.197624:0:109180:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452698624 00000100:00100000:3.0:1777051491.197682:0:109180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1777051491.197693:0:109180:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942b84850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9351a01-5b0e-4470-97fd-58b9b4b312a2+7:109174:x1863365452698624:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1777051491.197704:0:109180:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777051491.197717:0:109180:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d94e6e7400/0x85f51a6b9671777e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x85f51a6b96717777 expref: -99 pid: 109180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051491.197740:0:109180:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d94e6e7400/0x85f51a6b9671777e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x85f51a6b96717777 expref: 8 pid: 109180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051491.197755:0:109180:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d94e6e7400/0x85f51a6b9671777e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b96717777 expref: 8 pid: 109180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051491.197766:0:109180:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d94e6e7400, rc 0) 00000100:00100000:3.0:1777051491.197819:0:109180:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942b84850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9351a01-5b0e-4470-97fd-58b9b4b312a2+8:109174:x1863365452698624:12345-0@lo:101:mount.lustre.0 Request processed in 127us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051491.197829:0:109180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1777051491.197916:0:109174:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955ebd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9351a01-5b0e-4470-97fd-58b9b4b312a2:109174:1863365452698624:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1777051491.197963:0:109174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.146@tcp lock: ffff99d953284400/0x85f51a6b96717777 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b9671777e expref: -99 pid: 109174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051491.197979:0:109174:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.146@tcp lock: ffff99d953284400/0x85f51a6b96717777 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x85f51a6b9671777e expref: -99 pid: 109174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051491.198095:0:109174:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94c12b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9351a01-5b0e-4470-97fd-58b9b4b312a2:109174:1863365452698752:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1777051491.198142:0:109174:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051491.198173:0:109174:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d95c3e23c0 going to sleep for 11 seconds 00000100:00100000:2.0:1777051491.198406:0:109182:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452698752 00000100:00100000:2.0:1777051491.198415:0:109182:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452698752 00000100:00100000:2.0:1777051491.198468:0:109182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1777051491.198480:0:109182:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942b84450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9351a01-5b0e-4470-97fd-58b9b4b312a2+8:109174:x1863365452698752:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1777051491.198660:0:109182:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942b84450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9351a01-5b0e-4470-97fd-58b9b4b312a2+9:109174:x1863365452698752:12345-0@lo:501:mount.lustre.0 Request processed in 180us (517us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051491.198673:0:109182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1777051491.198732:0:109174:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94c12b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9351a01-5b0e-4470-97fd-58b9b4b312a2:109174:1863365452698752:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1777051491.198777:0:109174:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94c12b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9351a01-5b0e-4470-97fd-58b9b4b312a2:109174:1863365452698880:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1777051491.198849:0:109174:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051491.198898:0:109174:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d95c3e23c0 going to sleep for 11 seconds 00000100:00100000:1.0:1777051491.198988:0:109186:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452698880 00000100:00100000:1.0:1777051491.198998:0:109186:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452698880 00000100:00100000:1.0:1777051491.199083:0:109186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1777051491.199099:0:109186:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942b85050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f9351a01-5b0e-4470-97fd-58b9b4b312a2+9:109174:x1863365452698880:12345-0@lo:503:mount.lustre.0 20000000:01000000:2.0:1777051491.201826:0:109181:0:(mgs_nids.c:813:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1777051491.201870:0:109181:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1777051491.201880:0:109184:0:(mgs_nids.c:461:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1777051491.201889:0:109183:0:(mgs_nids.c:710:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1777051491.201896:0:109183:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1777051491.201923:0:109183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99da7d774c00/0x85f51a6b96717785 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 109183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051491.201976:0:109183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99da7d774c00/0x85f51a6b96717785 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 109183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1777051491.201990:0:109183:0:(mgs_nids.c:686:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000103200s 00010000:00010000:0.0:1777051491.201997:0:109183:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99da7d774c00/0x85f51a6b96717785 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 109183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051491.202032:0:109183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99da7d774c00/0x85f51a6b96717785 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 109183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051491.202049:0:109183:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99da7d774c00/0x85f51a6b96717785 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 109183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051491.202060:0:109183:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99da7d774c00/0x85f51a6b96717785 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 109183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051491.202062:0:109186:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942b85050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f9351a01-5b0e-4470-97fd-58b9b4b312a2+9:109174:x1863365452698880:12345-0@lo:503:mount.lustre.0 Request processed in 2941us (3189us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051491.202099:0:109186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:0.0:1777051491.202103:0:109183:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da7d774c00 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:0.0:1777051491.202110:0:109183:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99da7d774c00/0x85f51a6b96717785 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 109183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051491.202120:0:109183:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99da7d774c00/0x85f51a6b96717785 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 109183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051491.202137:0:109183:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99da7d774c00/0x85f51a6b96717785 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 109183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051491.202145:0:109183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99da7d774c00/0x85f51a6b96717785 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 109183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051491.202152:0:109183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99da7d774c00/0x85f51a6b96717785 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 109183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051491.202206:0:109174:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94c12b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9351a01-5b0e-4470-97fd-58b9b4b312a2:109174:1863365452698880:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1777051491.202624:0:109181:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da6145ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9351a01-5b0e-4470-97fd-58b9b4b312a2+8:3679:x1863365452698112:12345-0@lo:253:kworker.0 Request processed in 15995us (16110us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051491.202640:0:109181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000020:01000004:3.0:1777051491.202680:0:3679:0:(tgt_mount.c:1144:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:3.0:1777051491.202686:0:3679:0:(tgt_mount.c:1145:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1777051491.202690:0:3679:0:(tgt_mount.c:1146:server_mti_print()) fs: lustre 00000020:01000004:3.0:1777051491.202693:0:3679:0:(tgt_mount.c:1147:server_mti_print()) uuid: 00000020:01000004:3.0:1777051491.202697:0:3679:0:(tgt_mount.c:1148:server_mti_print()) ver: 0 00000020:01000004:3.0:1777051491.202701:0:3679:0:(tgt_mount.c:1149:server_mti_print()) flags: 00000020:01000004:3.0:1777051491.202704:0:3679:0:(tgt_mount.c:1153:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1777051491.202707:0:3679:0:(tgt_mount.c:1183:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1777051491.202711:0:3679:0:(tgt_mount.c:1189:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:3.0:1777051491.202718:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d9533bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3679:1863365452698112:0@lo:253:kworker.0 00000100:00100000:0.0:1777051491.203147:0:109187:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94c12b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f9351a01-5b0e-4470-97fd-58b9b4b312a2:109187:1863365452699008:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1777051491.203208:0:109187:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051491.203250:0:109187:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d95c3e2f00 going to sleep for 11 seconds 00000100:00100000:3.0:1777051491.203445:0:109180:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452699008 00000100:00100000:3.0:1777051491.203455:0:109180:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452699008 00000100:00100000:3.0:1777051491.203508:0:109180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1777051491.203521:0:109180:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942b85850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9351a01-5b0e-4470-97fd-58b9b4b312a2+8:109187:x1863365452699008:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1777051491.205616:0:109180:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942b85850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9351a01-5b0e-4470-97fd-58b9b4b312a2+8:109187:x1863365452699008:12345-0@lo:502:llog_process_th.0 Request processed in 2088us (2400us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051491.205631:0:109180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1777051491.206176:0:109187:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94c12b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f9351a01-5b0e-4470-97fd-58b9b4b312a2:109187:1863365452699008:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1777051491.206251:0:109187:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1777051491.206269:0:109187:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1777051491.206274:0:109187:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1777051491.206283:0:109187:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1777051491.206288:0:109187:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1777051491.206308:0:109187:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff99da46204d40) 00000020:00000080:2.0:1777051491.206370:0:109187:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1777051491.206382:0:109187:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1777051491.206487:0:109187:0:(osd_handler.c:8912:osd_obd_connect()) connect #2 00000020:00000080:2.0:1777051491.206501:0:109187:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x85f51a6b96717793 00000020:00000080:2.0:1777051491.207473:0:109187:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1777051491.207482:0:109187:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1777051491.207490:0:109187:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1777051491.207492:0:109187:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1777051491.207497:0:109187:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1777051491.207504:0:109187:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1777051491.207506:0:109187:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1777051491.207512:0:109187:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1777051491.207526:0:109187:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff99da46203380) 00000020:00000080:2.0:1777051491.207549:0:109187:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1777051491.207558:0:109187:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1777051491.207562:0:109187:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1777051491.207567:0:109187:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1777051491.207577:0:109187:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1777051491.207651:0:109187:0:(tgt_mount.c:151:server_get_mount()) get mount ffff99da7b5f9800 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1777051491.207670:0:109187:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff99da46200000) 00000020:00000080:2.0:1777051491.207978:0:109187:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1777051491.208066:0:109187:0:(lod_dev.c:2288:lod_obd_connect()) connect #0 00000020:00000080:2.0:1777051491.208077:0:109187:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x85f51a6b967177a8 00000020:00000080:2.0:1777051491.208517:0:109187:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1777051491.208732:0:109187:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1777051491.208744:0:109187:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x85f51a6b967177af 00080000:01000000:3.0:1777051491.208754:0:109187:0:(osd_handler.c:8912:osd_obd_connect()) connect #3 00000020:00000080:3.0:1777051491.208763:0:109187:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x85f51a6b967177b6 20000000:01000000:2.0:1777051491.212738:0:109184:0:(mgs_nids.c:813:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1777051491.212769:0:109184:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:0.0:1777051491.212808:0:109183:0:(mgs_nids.c:710:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1777051491.212818:0:109183:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1777051491.212848:0:109183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99da7d774c00/0x85f51a6b967177bd lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 109183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051491.212873:0:109183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99da7d774c00/0x85f51a6b967177bd lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 109183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1777051491.212889:0:109183:0:(mgs_nids.c:686:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000103200s 00010000:00010000:0.0:1777051491.212900:0:109183:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99da7d774c00/0x85f51a6b967177bd lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 109183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051491.212913:0:109183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99da7d774c00/0x85f51a6b967177bd lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 109183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051491.212926:0:109183:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99da7d774c00/0x85f51a6b967177bd lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 109183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051491.212966:0:109183:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99da7d774c00/0x85f51a6b967177bd lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 109183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051491.212978:0:109183:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da7d774c00 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:0.0:1777051491.212987:0:109183:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99da7d774c00/0x85f51a6b967177bd lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 109183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051491.213001:0:109183:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99da7d774c00/0x85f51a6b967177bd lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 109183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051491.213019:0:109183:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99da7d774c00/0x85f51a6b967177bd lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 109183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051491.213032:0:109183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99da7d774c00/0x85f51a6b967177bd lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 109183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051491.213044:0:109183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99da7d774c00/0x85f51a6b967177bd lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 109183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051491.215401:0:109184:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da6145f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f9351a01-5b0e-4470-97fd-58b9b4b312a2+7:3679:x1863365452698368:12345-0@lo:253:kworker.0 Request processed in 19225us (28473us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051491.215424:0:109184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000020:01000004:1.0:1777051491.215473:0:3679:0:(tgt_mount.c:1144:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:1.0:1777051491.215479:0:3679:0:(tgt_mount.c:1145:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1777051491.215483:0:3679:0:(tgt_mount.c:1146:server_mti_print()) fs: lustre 00000020:01000004:1.0:1777051491.215486:0:3679:0:(tgt_mount.c:1147:server_mti_print()) uuid: 00000020:01000004:1.0:1777051491.215489:0:3679:0:(tgt_mount.c:1148:server_mti_print()) ver: 0 00000020:01000004:1.0:1777051491.215491:0:3679:0:(tgt_mount.c:1149:server_mti_print()) flags: 00000020:01000004:1.0:1777051491.215493:0:3679:0:(tgt_mount.c:1151:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1777051491.215496:0:3679:0:(tgt_mount.c:1183:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1777051491.215498:0:3679:0:(tgt_mount.c:1189:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:1.0:1777051491.215504:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d9533bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3679:1863365452698368:0@lo:253:kworker.0 00010000:00010000:3.0:1777051491.297478:0:109187:0:(ldlm_pool.c:924:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-4 is initialized 00000001:00080000:3.0:1777051491.298461:0:109187:0:(tgt_lastrcvd.c:1758:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0001-mdtlov_UUID idx: 0 lr: 0 srv lr: 30064771072 lx: 0 gen 11 00000001:00080000:3.0:1777051491.298518:0:109187:0:(tgt_lastrcvd.c:1758:tgt_clients_data_init()) RCVRNG CLIENT uuid: 2dd4696c-edce-4cd1-86d2-dbd2ff957fa1 idx: 1 lr: 12884904249 srv lr: 30064771072 lx: 0 gen 9 00000001:00080000:3.0:1777051491.298541:0:109187:0:(tgt_lastrcvd.c:1758:tgt_clients_data_init()) RCVRNG CLIENT uuid: c11b6966-0775-44d2-bdc6-c74c26eb2226 idx: 3 lr: 12884904250 srv lr: 30064771072 lx: 0 gen 10 00000001:00000004:3.0:1777051491.298563:0:109187:0:(tgt_lastrcvd.c:732:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 8, last_transno is 30064771072 00000001:00080000:3.0:1777051491.299415:0:109187:0:(tgt_lastrcvd.c:223:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000001:00080000:3.0:1777051491.299493:0:109187:0:(tgt_lastrcvd.c:2296:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff99da708ec3c0: xid 1863365426094208, transno 30064771257, client gen 10, slot idx 0 00000001:00080000:3.0:1777051491.299505:0:109187:0:(tgt_lastrcvd.c:2296:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff99da708ec900: xid 1863365426092160, transno 30064771247, client gen 10, slot idx 1 00000001:00080000:3.0:1777051491.299512:0:109187:0:(tgt_lastrcvd.c:2296:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff99da708ece40: xid 1863365452680832, transno 30064771239, client gen 11, slot idx 2 00000001:00080000:3.0:1777051491.299522:0:109187:0:(tgt_lastrcvd.c:2296:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff99d94e77e900: xid 1863365426094464, transno 30064771258, client gen 9, slot idx 3 00000001:00080000:3.0:1777051491.299528:0:109187:0:(tgt_lastrcvd.c:2296:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff99d94e77ecc0: xid 1863365426093056, transno 30064771255, client gen 9, slot idx 4 00000001:00080000:3.0:1777051491.299534:0:109187:0:(tgt_lastrcvd.c:2296:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff99d94e77ef00: xid 1863365426093056, transno 30064771256, client gen 9, slot idx 5 00000001:00080000:3.0:1777051491.299540:0:109187:0:(tgt_lastrcvd.c:2296:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff99d94e77e240: xid 1863365425539328, transno 12884903901, client gen 10, slot idx 6 00000001:00080000:3.0:1777051491.299546:0:109187:0:(tgt_lastrcvd.c:2296:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff99d94e77e840: xid 1863365425435392, transno 12884903784, client gen 10, slot idx 7 00000001:00080000:3.0:1777051491.299551:0:109187:0:(tgt_lastrcvd.c:2296:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff99d94e77e300: xid 1863365425436032, transno 12884903788, client gen 10, slot idx 8 00000001:00080000:3.0:1777051491.299556:0:109187:0:(tgt_lastrcvd.c:2296:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff99d94e77e6c0: xid 1863365425435136, transno 12884903781, client gen 10, slot idx 9 00000001:00080000:3.0:1777051491.299564:0:109187:0:(tgt_lastrcvd.c:2296:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff99d94e77e0c0: xid 1863365425430144, transno 12884903754, client gen 10, slot idx 10 00000001:00080000:3.0:1777051491.299570:0:109187:0:(tgt_lastrcvd.c:2296:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff99d94e77e000: xid 1863365425155200, transno 12884903075, client gen 9, slot idx 11 00000001:00080000:3.0:1777051491.299575:0:109187:0:(tgt_lastrcvd.c:2296:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff99d94e77e540: xid 1863365425418240, transno 12884903704, client gen 10, slot idx 12 00000020:00000080:3.0:1777051491.301004:0:109187:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff99da44f6b380) 00000020:00000080:3.0:1777051491.301033:0:109187:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1777051491.301120:0:109187:0:(osd_handler.c:8912:osd_obd_connect()) connect #4 00000020:00000080:3.0:1777051491.301127:0:109187:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x85f51a6b967177e0 00000020:00000080:1.0:1777051491.302733:0:109187:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1777051491.312189:0:109187:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x85f51a6b967177e7 00000020:00000080:1.0:1777051491.313462:0:109187:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1777051491.313478:0:109187:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1777051491.313487:0:109187:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1777051491.313491:0:109187:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1777051491.313496:0:109187:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1777051491.313499:0:109187:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #9 00000020:01000000:1.0:1777051491.313502:0:109187:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1777051491.313504:0:109187:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1777051491.313506:0:109187:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1777051491.313510:0:109187:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1777051491.313513:0:109187:0:(obd_config.c:1561:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:1.0:1777051491.313516:0:109187:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1777051491.313524:0:109187:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1777051491.313526:0:109187:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1777051491.313531:0:109187:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1777051491.313581:0:109187:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1777051491.313606:0:109187:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1777051491.313611:0:109187:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1777051491.313613:0:109187:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1777051491.313615:0:109187:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1777051491.313619:0:109187:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1777051491.313620:0:109187:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:1.0:1777051491.313623:0:109187:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1777051491.313628:0:109187:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.201.146@tcp to nid 0x20000c0a8c992 (192.168.201.146@tcp) 00000020:00000080:1.0:1777051491.313651:0:109187:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1777051491.313664:0:109187:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff99da7ffccd40) 00000020:00000080:1.0:1777051491.313683:0:109187:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:1.0:1777051491.313688:0:109187:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1777051491.313747:0:109187:0:(osp_dev.c:1199:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:1.0:1777051491.313754:0:109187:0:(osd_handler.c:8912:osd_obd_connect()) connect #5 00000020:00000080:1.0:1777051491.313762:0:109187:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x85f51a6b967177f5 00010000:00080000:1.0:1777051491.313812:0:109187:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99da71c64800@lustre-MDT0001-osp-MDT0000: add connection 192.168.201.146@tcp at head 00010000:00010000:1.0:1777051491.318015:0:109187:0:(ldlm_pool.c:924:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-9 is initialized 00000020:00000080:3.0:1777051491.320270:0:109187:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1777051491.320288:0:109187:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1777051491.320340:0:109187:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:3.0:1777051491.320369:0:109187:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x85f51a6b967177fc 00000100:00080000:3.0:1777051491.320381:0:109187:0:(import.c:509:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1777051491.320389:0:109187:0:(import.c:623:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff99da71c64800 using connection 192.168.201.146@tcp/0@lo 00000100:00100000:3.0:1777051491.320432:0:109187:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d9533bd180 x1863365452699136/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1777051491.320461:0:109187:0:(pinger.c:371:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1777051491.320530:0:84827:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:01000000:3.0:1777051491.320537:0:109187:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000100:00080000:0.0:1777051491.320539:0:84827:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00100000:2.0:1777051491.320542:0:3676:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d9533bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3676:1863365452699136:0@lo:38:llog_process_th.0 00000020:00000080:3.0:1777051491.320544:0:109187:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000100:00080000:0.0:1777051491.320546:0:84827:0:(import.c:65:import_set_state_nolock()) ffff99d94183b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000020:00000080:3.0:1777051491.320549:0:109187:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000100:00080000:0.0:1777051491.320555:0:84827:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 8117 00000020:01000000:3.0:1777051491.320556:0:109187:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1777051491.320562:0:109187:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #20 00000100:00080000:0.0:1777051491.320564:0:84827:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000020:01000000:3.0:1777051491.320565:0:109187:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1777051491.320571:0:109187:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1777051491.320573:0:109187:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000100:00080000:0.0:1777051491.320577:0:84827:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff99d94183b000 using connection 192.168.201.146@tcp/0@lo 00000020:00000080:3.0:1777051491.320579:0:109187:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1777051491.320584:0:109187:0:(obd_config.c:1561:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:3.0:1777051491.320588:0:109187:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1777051491.320598:0:109187:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1777051491.320604:0:109187:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000100:00100000:0.0:1777051491.320608:0:84827:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d94c12b100 x1863365452699264/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000020:00000080:3.0:1777051491.320608:0:109187:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1777051491.320614:0:109187:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1777051491.320623:0:109187:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.201.146@tcp to nid 0x20000c0a8c992 (192.168.201.146@tcp) 00000100:00100000:2.0:1777051491.320633:0:3676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:3.0:1777051491.320651:0:109187:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1777051491.320657:0:109187:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000100:00080000:0.0:1777051491.320669:0:84827:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1777051491.320675:0:84827:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000020:00000080:3.0:1777051491.320675:0:109187:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff99d941e68000) 00000100:00080000:0.0:1777051491.320681:0:84827:0:(import.c:65:import_set_state_nolock()) ffff99da5f282000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1777051491.320689:0:84827:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 8117 00000100:00080000:0.0:1777051491.320693:0:84827:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1777051491.320699:0:84827:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff99da5f282000 using connection 192.168.201.146@tcp/0@lo 00000020:00000080:3.0:1777051491.320702:0:109187:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osp with refcount 2 00000100:00100000:2.0:1777051491.320709:0:3676:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94c12b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3676:1863365452699264:0@lo:38:kworker.0 00000020:00000080:3.0:1777051491.320712:0:109187:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000100:00100000:1.0:1777051491.320714:0:47208:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452699136 00000100:00100000:0.0:1777051491.320722:0:84827:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d94c128380 x1863365452699520/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1777051491.320727:0:47208:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452699136 00000100:00100000:2.0:1777051491.320770:0:3676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1777051491.320781:0:84827:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1777051491.320786:0:84827:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1777051491.320789:0:84827:0:(import.c:65:import_set_state_nolock()) ffff99da5f3d6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1777051491.320795:0:84827:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 8117 00000100:00080000:0.0:1777051491.320799:0:84827:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1777051491.320805:0:84827:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff99da5f3d6000 using connection 192.168.201.146@tcp/0@lo 00000004:00080000:3.0:1777051491.320806:0:109187:0:(osp_dev.c:1199:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00000100:00100000:1.0:1777051491.320811:0:47208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8325 00000100:00100000:2.0:1777051491.320812:0:3676:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94c128380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3676:1863365452699520:0@lo:38:kworker.0 00080000:01000000:3.0:1777051491.320820:0:109187:0:(osd_handler.c:8912:osd_obd_connect()) connect #6 00000100:00100000:1.0:1777051491.320830:0:47208:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:0+-99:3676:x1863365452699136:12345-0@lo:38:llog_process_th.0 00000100:00100000:0.0:1777051491.320834:0:84827:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d955610000 x1863365452699776/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000020:00000080:3.0:1777051491.320834:0:109187:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x85f51a6b9671780a 00000100:00100000:2.0:1777051491.320852:0:3676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1777051491.320871:0:47208:0:(ldlm_lib.c:1431:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 8120 last 0 00000100:00100000:2.0:1777051491.320889:0:3676:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955610000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3676:1863365452699776:0@lo:38:kworker.0 00010000:00080000:3.0:1777051491.320889:0:109187:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99d950adc000@lustre-OST0000-osc-MDT0000: add connection 192.168.201.146@tcp at head 00000100:00080000:0.0:1777051491.320900:0:84827:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1777051491.320906:0:84827:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1777051491.320909:0:84827:0:(import.c:65:import_set_state_nolock()) ffff99da7dbe9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1777051491.320915:0:84827:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 8117 00000100:00080000:0.0:1777051491.320919:0:84827:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1777051491.320924:0:84827:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff99da7dbe9000 using connection 192.168.201.146@tcp/0@lo 00000100:00100000:2.0:1777051491.320960:0:3676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:1.0:1777051491.320966:0:47208:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x85f51a6b96717811 00000100:00100000:0.0:1777051491.320975:0:84827:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d95aece300 x1863365452700160/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000004:00100000:1.0:1777051491.320988:0:47208:0:(mdt_handler.c:7285:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:2.0:1777051491.320998:0:3676:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95aece300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3676:1863365452700160:0@lo:38:kworker.0 00000100:00100000:0.0:1777051491.321018:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955611f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452699904:0@lo:400:kworker.0 00000100:00100000:2.0:1777051491.321042:0:3676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051491.321064:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051491.321097:0:3679:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00080000:1.0:1777051491.321105:0:47208:0:(import.c:65:import_set_state_nolock()) ffff99d942fb6000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1777051491.321107:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94c128a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3677:1863365452699392:0@lo:400:kworker.0 00000100:00100000:0.0:1777051491.321109:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955613800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452700032:0@lo:400:kworker.0 00000100:00100000:0.0:1777051491.321159:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051491.321159:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051491.321199:0:3677:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1777051491.321211:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da4384d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3677:1863365452699648:0@lo:400:kworker.0 00000100:00100000:1.0:1777051491.321216:0:47208:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+6:3676:x1863365452699136:12345-0@lo:38:llog_process_th.0 Request processed in 383us (579us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051491.321220:0:27884:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452699904 00000100:00100000:0.0:1777051491.321229:0:27884:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452699904 00000100:00100000:1.0:1777051491.321242:0:47208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8325 00000100:00100000:2.0:1777051491.321258:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051491.321274:0:47208:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452699776 00000100:00100000:1.0:1777051491.321282:0:47208:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452699776 00000100:00100000:0.0:1777051491.321295:0:27884:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452700032 00000100:00100000:0.0:1777051491.321304:0:27884:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452700032 00000100:00100000:2.0:1777051491.321325:0:46494:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452699264 00000100:00100000:2.0:1777051491.321331:0:46494:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452699264 00000100:00100000:1.0:1777051491.321364:0:47208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8326 00000100:00100000:2.0:1777051491.321365:0:46494:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452699520 00000100:00100000:0.0:1777051491.321371:0:27884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10523 00000100:00100000:2.0:1777051491.321371:0:46494:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452699520 00000100:00100000:1.0:1777051491.321380:0:47208:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:0+-99:3676:x1863365452699776:12345-0@lo:38:kworker.0 00010000:00010000:3.0:1777051491.321388:0:109187:0:(ldlm_pool.c:924:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-10 is initialized 00000100:00100000:2.0:1777051491.321425:0:46494:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452700160 00000100:00100000:2.0:1777051491.321431:0:46494:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452700160 00000100:00100000:1.0:1777051491.321449:0:47208:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:0+-99:3676:x1863365452699776:12345-0@lo:38:kworker.0 Request processed in 68us (486us total) trans 0 rc -11/-11 00000100:00100000:0.0:1777051491.321451:0:27884:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95aecea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3679:x1863365452699904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777051491.321462:0:46494:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452699392 00000100:00100000:2.0:1777051491.321468:0:46494:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452699392 00000100:00100000:1.0:1777051491.321474:0:47208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8326 00000100:00100000:2.0:1777051491.321512:0:46494:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452699648 00000100:00100000:2.0:1777051491.321519:0:46494:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452699648 00000100:00100000:0.0:1777051491.321530:0:27884:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95aecea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3679:x1863365452699904:12345-0@lo:400:kworker.0 Request processed in 147us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051491.321540:0:27884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10523 00000100:00100000:2.0:1777051491.321557:0:46494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13483 00000100:00100000:0.0:1777051491.321560:0:27884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10524 00000100:00100000:2.0:1777051491.321569:0:46494:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0001-lwp-OST0000_UUID+5:3677:x1863365452699392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777051491.321570:0:27884:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95aeced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3679:x1863365452700032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777051491.321616:0:27884:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95aeced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3679:x1863365452700032:12345-0@lo:400:kworker.0 Request processed in 46us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051491.321618:0:46494:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0001-lwp-OST0000_UUID+5:3677:x1863365452699392:12345-0@lo:400:kworker.0 Request processed in 53us (462us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051491.321626:0:27884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10524 00000100:00100000:2.0:1777051491.321626:0:46494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13483 00000100:00100000:2.0:1777051491.321645:0:46494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13484 00000100:00100000:2.0:1777051491.321654:0:46494:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0001-lwp-OST0001_UUID+5:3677:x1863365452699648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777051491.321697:0:46494:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0001-lwp-OST0001_UUID+5:3677:x1863365452699648:12345-0@lo:400:kworker.0 Request processed in 44us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051491.321700:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955613800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452700032:0@lo:400:kworker.0 00000100:00100000:2.0:1777051491.321707:0:46494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13484 00000100:00100000:0.0:1777051491.322008:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955611f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452699904:0@lo:400:kworker.0 00000100:00100000:2.0:1777051491.322015:0:46494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112413 00000100:00100000:2.0:1777051491.322021:0:46494:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:0+-99:3676:x1863365452699264:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1777051491.322067:0:46494:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:0+-99:3676:x1863365452699264:12345-0@lo:38:kworker.0 Request processed in 43us (1297us total) trans 0 rc -11/-11 00000100:00080000:0.0:1777051491.322070:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1777051491.322075:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1777051491.322076:0:46494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112413 00000100:00080000:0.0:1777051491.322078:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1777051491.322092:0:46494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112414 00000100:00100000:0.0:1777051491.322098:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112415 00000100:00100000:2.0:1777051491.322098:0:46494:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:0+-99:3676:x1863365452699520:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1777051491.322419:0:46494:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:0+-99:3676:x1863365452699520:12345-0@lo:38:kworker.0 Request processed in 317us (1565us total) trans 0 rc -11/-11 00000100:00100000:2.0:1777051491.322430:0:46494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112414 00000100:00100000:0.0:1777051491.322443:0:6579:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3676:x1863365452700160:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1777051491.322496:0:6579:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3676:x1863365452700160:12345-0@lo:38:kworker.0 Request processed in 388us (1452us total) trans 0 rc -11/-11 00000100:00100000:0.0:1777051491.322506:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112415 00000100:00080000:1.0:1777051491.322515:0:3676:0:(import.c:65:import_set_state_nolock()) ffff99da7dbe9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1777051491.322527:0:3676:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1777051491.322527:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da4384d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3677:1863365452699648:0@lo:400:kworker.0 00000100:00100000:1.0:1777051491.322538:0:3676:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95aece300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3676:1863365452700160:0@lo:38:kworker.0 00000100:00100000:2.0:1777051491.322551:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94c128a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3677:1863365452699392:0@lo:400:kworker.0 00000100:00080000:1.0:1777051491.322564:0:3676:0:(import.c:65:import_set_state_nolock()) ffff99da5f3d6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1777051491.322571:0:3676:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1777051491.322577:0:3676:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955610000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3676:1863365452699776:0@lo:38:kworker.0 00000100:00080000:1.0:1777051491.322590:0:3676:0:(import.c:65:import_set_state_nolock()) ffff99da5f282000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1777051491.322594:0:3676:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1777051491.322598:0:3676:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94c128380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3676:1863365452699520:0@lo:38:kworker.0 00000100:00080000:1.0:1777051491.322610:0:3676:0:(import.c:65:import_set_state_nolock()) ffff99d94183b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1777051491.322614:0:3676:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1777051491.322618:0:3676:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94c12b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3676:1863365452699264:0@lo:38:kworker.0 00000100:00100000:1.0:1777051491.322635:0:3676:0:(client.c:3101:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1777051491.322640:0:3676:0:(import.c:1130:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1777051491.322647:0:3676:0:(import.c:958:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:1.0:1777051491.322651:0:3676:0:(import.c:1211:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1777051491.322654:0:3676:0:(import.c:65:import_set_state_nolock()) ffff99da71c64800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1777051491.322670:0:3676:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d9533bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3676:1863365452699136:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1777051491.322813:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f9fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3677:1863365452700288:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1777051491.322845:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051491.323019:0:46498:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452700288 00000100:00100000:1.0:1777051491.323027:0:46498:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452700288 00000100:00100000:1.0:1777051491.323071:0:46498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8327 00000100:00100000:1.0:1777051491.323081:0:46498:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95aecca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+6:3677:x1863365452700288:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1777051491.323108:0:46498:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4194304 pending 0 free 1446105088 avail 1299865600 00000100:00100000:1.0:1777051491.323161:0:46498:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95aecca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+6:3677:x1863365452700288:12345-0@lo:41:osp-pre-1-0.0 Request processed in 80us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051491.323172:0:46498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8327 00000100:00100000:0.0:1777051491.323224:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f9fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3677:1863365452700288:0@lo:41:osp-pre-1-0.0 00000040:01000000:2.0:1777051491.323428:0:109187:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1777051491.323727:0:109187:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1777051491.325243:0:109187:0:(llog_cat.c:391:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 6, last_idx 7 00000040:00080000:2.0:1777051491.327403:0:109187:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1777051491.328097:0:109187:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].8, 64 off8704 00000040:00080000:2.0:1777051491.334701:0:109187:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2d:0x0].1, 64 off8256 00000040:00080000:2.0:1777051491.335574:0:109193:0:(llog.c:801:llog_process_thread()) index: 7, lh_last_idx: 8 synced_idx: 0 lgh_last_idx: 8 00000040:00080000:2.0:1777051491.335582:0:109193:0:(llog_cat.c:158:llog_cat_process_common()) processing log [0x1:0x27:0x0] at index 7 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1777051491.336775:0:109187:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1777051491.336794:0:109187:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1777051491.336842:0:109187:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1777051491.336869:0:109187:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x85f51a6b96717818 00000100:00080000:3.0:1777051491.336882:0:109187:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1777051491.336891:0:109187:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff99d950adc000 using connection 192.168.201.146@tcp/0@lo 00000100:00100000:3.0:1777051491.336969:0:109187:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d9533bd180 x1863365452700416/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1777051491.337006:0:109187:0:(pinger.c:371:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:1.0:1777051491.337086:0:3676:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d9533bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3676:1863365452700416:0@lo:8:llog_process_th.0 00000020:01000000:3.0:1777051491.337103:0:109187:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1777051491.337112:0:109187:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1777051491.337115:0:109187:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1777051491.337121:0:109187:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1777051491.337126:0:109187:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #28 00000020:01000000:3.0:1777051491.337129:0:109187:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1777051491.337132:0:109187:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1777051491.337135:0:109187:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1777051491.337140:0:109187:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1777051491.337159:0:109187:0:(obd_config.c:1561:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:3.0:1777051491.337164:0:109187:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1777051491.337171:0:109187:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1777051491.337178:0:109187:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000100:00100000:1.0:1777051491.337183:0:3676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:3.0:1777051491.337185:0:109187:0:(obd_config.c:1561:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1777051491.337227:0:109187:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1777051491.337235:0:109187:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.201.146@tcp to nid 0x20000c0a8c992 (192.168.201.146@tcp) 00000020:01000000:3.0:1777051491.337277:0:109187:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1777051491.337282:0:109187:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1777051491.337299:0:109187:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff99da5807b380) 00000100:00100000:0.0:1777051491.337321:0:27887:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452700416 00000020:00000080:3.0:1777051491.337329:0:109187:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000100:00100000:0.0:1777051491.337333:0:27887:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452700416 00000020:00000080:3.0:1777051491.337341:0:109187:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000100:00100000:0.0:1777051491.337393:0:27887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8100 00000100:00100000:0.0:1777051491.337404:0:27887:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955ebe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:0+-99:3676:x1863365452700416:12345-0@lo:8:llog_process_th.0 00000004:00080000:3.0:1777051491.337427:0:109187:0:(osp_dev.c:1199:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00010000:00080000:0.0:1777051491.337454:0:27887:0:(ldlm_lib.c:1431:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 8120 last 0 00000020:00000080:0.0:1777051491.337486:0:27887:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x85f51a6b96717826 00002000:00100000:0.0:1777051491.337503:0:27887:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff99da454e0000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113436 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1777051491.337509:0:27887:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1777051491.337513:0:27887:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00080000:01000000:3.0:1777051491.337545:0:109187:0:(osd_handler.c:8912:osd_obd_connect()) connect #7 00000020:00000080:3.0:1777051491.337564:0:109187:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x85f51a6b9671782d 00002000:00080000:0.0:1777051491.337598:0:27887:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00010000:00080000:3.0:1777051491.337616:0:109187:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99d94183a800@lustre-OST0001-osc-MDT0000: add connection 192.168.201.146@tcp at head 00000100:00080000:0.0:1777051491.337635:0:27887:0:(import.c:65:import_set_state_nolock()) ffff99da454e4800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1777051491.338000:0:27887:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955ebe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+6:3676:x1863365452700416:12345-0@lo:8:llog_process_th.0 Request processed in 594us (820us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051491.338013:0:27887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8100 00000100:00100000:2.0:1777051491.338363:0:3676:0:(client.c:3101:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1777051491.338375:0:3676:0:(import.c:1130:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1777051491.338385:0:3676:0:(import.c:958:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1777051491.338393:0:3676:0:(import.c:1211:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1777051491.338397:0:3676:0:(import.c:65:import_set_state_nolock()) ffff99d950adc000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1777051491.338411:0:3676:0:(osp_dev.c:1643:osp_import_event()) got connected 00000100:00100000:2.0:1777051491.338420:0:3676:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d9533bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3676:1863365452700416:0@lo:8:llog_process_th.0 00010000:00010000:3.0:1777051491.338439:0:109187:0:(ldlm_pool.c:924:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-11 is initialized 00000040:01000000:3.0:1777051491.338523:0:109187:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1777051491.338544:0:109187:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:0.0:1777051491.338565:0:3677:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1777051491.338579:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95aecf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3677:1863365452700544:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1777051491.338634:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051491.338679:0:8473:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452700544 00000100:00100000:0.0:1777051491.338686:0:8473:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452700544 00000100:00100000:0.0:1777051491.338736:0:8473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5702 00000100:00100000:0.0:1777051491.338747:0:8473:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95aecc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3677:x1863365452700544:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1777051491.338770:0:8473:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 499269184 pending 0 free 3860574208 avail 3629051904 00000100:00100000:0.0:1777051491.338817:0:8473:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95aecc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3677:x1863365452700544:12345-0@lo:13:osp-pre-0-0.0 Request processed in 72us (183us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051491.338828:0:8473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5702 00000100:00080000:0.0:1777051491.338849:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1777051491.338885:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95aecf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3677:1863365452700544:0@lo:13:osp-pre-0-0.0 00000040:00080000:0.0:1777051491.343085:0:109193:0:(llog.c:858:llog_process_thread()) stop processing plain [0x1:0x27:0x0] index 6 count 2 00000100:00100000:1.0:1777051491.343376:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95aecf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452700672:0@lo:6:osp-syn-0-0.0 00000040:00080000:0.0:1777051491.343378:0:109193:0:(llog.c:801:llog_process_thread()) index: 8, lh_last_idx: 8 synced_idx: 8 lgh_last_idx: 8 00000040:00080000:0.0:1777051491.343390:0:109193:0:(llog_cat.c:158:llog_cat_process_common()) processing log [0x1:0x2d:0x0] at index 8 of catalog [0x1:0x2:0x0] 00000004:00080000:0.0:1777051491.343422:0:109193:0:(osp_sync.c:1044:osp_sync_process_record()) processed all old entries 00000100:00100000:1.0:1777051491.343448:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1777051491.343484:0:109193:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 8120536285045ns, next at 0ns, rc = 0 00080000:00080000:0.0:1777051491.343496:0:109193:0:(osd_handler.c:2852:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:2.0:1777051491.343539:0:8471:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452700672 00000100:00100000:2.0:1777051491.343551:0:8471:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452700672 00000100:00100000:2.0:1777051491.343623:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8101 00000100:00100000:2.0:1777051491.343635:0:8471:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955ebce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3679:x1863365452700672:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1777051491.343662:0:8471:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:486 count 1 00000100:00100000:2.0:1777051491.343774:0:8471:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955ebce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3679:x1863365452700672:12345-0@lo:6:osp-syn-0-0.0 Request processed in 140us (326us total) trans 0 rc -2/-2 00000100:00100000:2.0:1777051491.343787:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8101 00000004:00080000:0.0:1777051491.343847:0:3679:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff99d95aecf800, transno 0 00000004:00080000:0.0:1777051491.343858:0:3679:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99d95aecf800/1, rc -2, transno 0 00000100:00100000:0.0:1777051491.343890:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95aecf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452700672:0@lo:6:osp-syn-0-0.0 00000040:00080000:2.0:1777051491.344664:0:109193:0:(llog_cat.c:391:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 7, last_idx 8 00000040:00080000:2.0:1777051491.344702:0:109193:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x27:0x0] at index 7 of catalog [0x1:0x2:0x0] 00000040:00080000:3.0:1777051491.344714:0:109187:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1777051491.345453:0:109187:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].8, 64 off8704 00000040:00080000:3.0:1777051491.345614:0:109187:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2f:0x0].1, 64 off8256 00000040:00080000:3.0:1777051491.347349:0:109195:0:(llog.c:801:llog_process_thread()) index: 8, lh_last_idx: 8 synced_idx: 8 lgh_last_idx: 8 00000040:00080000:3.0:1777051491.347356:0:109195:0:(llog_cat.c:158:llog_cat_process_common()) processing log [0x1:0x2f:0x0] at index 8 of catalog [0x1:0x5:0x0] 00000004:00080000:0.0:1777051491.347645:0:109175:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000020:00000080:1.0:1777051491.350581:0:109187:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1777051491.350596:0:109187:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1777051491.350647:0:109187:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1777051491.350677:0:109187:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x85f51a6b96717834 00000100:00080000:1.0:1777051491.350990:0:109187:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1777051491.350997:0:109187:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff99d94183a800 using connection 192.168.201.146@tcp/0@lo 00000100:00100000:1.0:1777051491.351035:0:109187:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d955ebdf80 x1863365452700800/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1777051491.351087:0:109187:0:(pinger.c:371:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:2.0:1777051491.351159:0:3676:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955ebdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3676:1863365452700800:0@lo:8:llog_process_th.0 00000020:01000000:1.0:1777051491.351187:0:109187:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1777051491.351226:0:109187:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1777051491.351230:0:109187:0:(obd_config.c:1561:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1777051491.351237:0:109187:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1777051491.351246:0:109187:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1777051491.351249:0:109187:0:(obd_config.c:1561:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:1.0:1777051491.351254:0:109187:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1777051491.351258:0:109187:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1777051491.351262:0:109187:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1777051491.351270:0:109187:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000100:00100000:2.0:1777051491.351271:0:3676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:1.0:1777051491.351273:0:109187:0:(obd_config.c:1561:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:1.0:1777051491.351280:0:109187:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1777051491.351284:0:109187:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1777051491.351286:0:109187:0:(obd_config.c:1561:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000100:00100000:1.0:1777051491.351317:0:8470:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452700800 00000100:00100000:1.0:1777051491.351325:0:8470:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452700800 00000100:00100000:1.0:1777051491.351371:0:8470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8102 00000100:00100000:1.0:1777051491.351380:0:8470:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3676:x1863365452700800:12345-0@lo:8:llog_process_th.0 00010000:00080000:1.0:1777051491.351413:0:8470:0:(ldlm_lib.c:1431:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 8120 last 0 00000020:00000080:1.0:1777051491.351445:0:8470:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x85f51a6b9671783b 00002000:00100000:1.0:1777051491.351462:0:8470:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff99d94183b800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113436 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1777051491.351469:0:8470:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:1.0:1777051491.351473:0:8470:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1777051491.351533:0:8470:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1777051491.351563:0:8470:0:(import.c:65:import_set_state_nolock()) ffff99d942a20800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1777051491.351649:0:8470:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3676:x1863365452700800:12345-0@lo:8:llog_process_th.0 Request processed in 266us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051491.351662:0:8470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8102 00000020:00000080:1.0:1777051491.351693:0:109187:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1777051491.351702:0:109187:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1777051491.351706:0:109187:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1777051491.351707:0:109187:0:(obd_config.c:1561:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000020:01000000:1.0:1777051491.351710:0:109187:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1777051491.351714:0:109187:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #44 00000020:01000000:1.0:1777051491.351716:0:109187:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1777051491.351717:0:109187:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000100:00100000:1.0:1777051491.351744:0:109187:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955ebf100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f9351a01-5b0e-4470-97fd-58b9b4b312a2:109187:1863365452700928:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1777051491.351816:0:3676:0:(client.c:3101:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00100000:1.0:1777051491.351824:0:109187:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1777051491.351832:0:3676:0:(import.c:1130:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1777051491.351843:0:3676:0:(import.c:958:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1777051491.351849:0:3676:0:(import.c:1211:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1777051491.351855:0:3676:0:(import.c:65:import_set_state_nolock()) ffff99d94183a800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1777051491.351875:0:109187:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d94e77e3c0 going to sleep for 11 seconds 00000004:00080000:2.0:1777051491.351882:0:3676:0:(osp_dev.c:1643:osp_import_event()) got connected 00000004:00080000:3.0:1777051491.351895:0:109195:0:(osp_sync.c:1044:osp_sync_process_record()) processed all old entries 00000100:00100000:2.0:1777051491.351896:0:3676:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955ebdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3676:1863365452700800:0@lo:8:llog_process_th.0 00000100:00100000:0.0:1777051491.351919:0:109186:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452700928 00000100:00100000:0.0:1777051491.351959:0:109186:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452700928 00000004:00080000:3.0:1777051491.351988:0:109195:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 8120544789612ns, next at 0ns, rc = 0 00080000:00080000:3.0:1777051491.351998:0:109195:0:(osd_handler.c:2852:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:0.0:1777051491.352113:0:109186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1777051491.352128:0:109186:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942b87050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f9351a01-5b0e-4470-97fd-58b9b4b312a2+7:109187:x1863365452700928:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1777051491.352138:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d9533bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3680:1863365452701056:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1777051491.352180:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051491.352402:0:47388:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452701056 00000100:00100000:3.0:1777051491.352410:0:47388:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452701056 00000100:00100000:3.0:1777051491.352489:0:47388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5703 00000100:00080000:0.0:1777051491.352491:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1777051491.352506:0:47388:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3680:x1863365452701056:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1777051491.352537:0:47388:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 489209408 pending 0 free 3642707968 avail 3411185664 00000100:00100000:3.0:1777051491.352604:0:47388:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3680:x1863365452701056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 104us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051491.352614:0:47388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5703 00000100:00100000:0.0:1777051491.352914:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d9533bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3680:1863365452701056:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1777051491.353024:0:109186:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942b87050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f9351a01-5b0e-4470-97fd-58b9b4b312a2+7:109187:x1863365452700928:12345-0@lo:502:llog_process_th.0 Request processed in 896us (1200us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051491.353037:0:109186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1777051491.353253:0:109187:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955ebf100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f9351a01-5b0e-4470-97fd-58b9b4b312a2:109187:1863365452700928:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1777051491.353290:0:109187:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1777051491.353300:0:109187:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1777051491.353303:0:109187:0:(obd_config.c:1561:class_process_config()) marker 44 (0x6) lustre-MDT0000-m new lustre.test_11c 00000020:01000000:0.0:1777051491.353309:0:109187:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1777051491.353314:0:109187:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #47 00000020:01000000:0.0:1777051491.353317:0:109187:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1777051491.353320:0:109187:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1777051491.353323:0:109187:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1777051491.353328:0:109187:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1777051491.353331:0:109187:0:(obd_config.c:1561:class_process_config()) marker 47 (0x6) lustre-MDT0000-m add lustre.test_11c.lustre-OST0001_UUID 00000020:01000000:0.0:1777051491.353336:0:109187:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1777051491.353365:0:109187:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1777051491.353369:0:109187:0:(obd_config.c:1561:class_process_config()) marker 50 (0x1) lustre-MDT0000-m rem lustre.test_11c.lustre-OST0001_UUID 00000020:00000080:0.0:1777051491.353377:0:109187:0:(obd_config.c:1470:class_process_config()) processing cmd: ce022 00000020:01000000:0.0:1777051491.353388:0:109187:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1777051491.353393:0:109187:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1777051491.353396:0:109187:0:(obd_config.c:1561:class_process_config()) marker 50 (0x2) lustre-MDT0000-m rem lustre.test_11c.lustre-OST0001_UUID 00000020:01000000:0.0:1777051491.353401:0:109187:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1777051491.353407:0:109187:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1777051491.353410:0:109187:0:(obd_config.c:1561:class_process_config()) marker 53 (0x1) lustre-MDT0000-m del lustre.test_11c 00000020:00000080:0.0:1777051491.353415:0:109187:0:(obd_config.c:1470:class_process_config()) processing cmd: ce023 00000100:00100000:0.0:1777051491.353451:0:109187:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95aecd500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f9351a01-5b0e-4470-97fd-58b9b4b312a2:109187:1863365452701184:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1777051491.353531:0:109187:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051491.353564:0:109187:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d95cf03a80 going to sleep for 11 seconds 00000100:00100000:2.0:1777051491.353612:0:109182:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452701184 00000100:00100000:2.0:1777051491.353619:0:109182:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452701184 00000100:00100000:2.0:1777051491.353657:0:109182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1777051491.353668:0:109182:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942b84050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9351a01-5b0e-4470-97fd-58b9b4b312a2+7:109187:x1863365452701184:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1777051491.353818:0:109182:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942b84050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9351a01-5b0e-4470-97fd-58b9b4b312a2+7:109187:x1863365452701184:12345-0@lo:502:llog_process_th.0 Request processed in 150us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051491.353829:0:109182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1777051491.354007:0:109187:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95aecd500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f9351a01-5b0e-4470-97fd-58b9b4b312a2:109187:1863365452701184:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1777051491.354039:0:109187:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1777051491.354045:0:109187:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1777051491.354048:0:109187:0:(obd_config.c:1561:class_process_config()) marker 53 (0x2) lustre-MDT0000-m del lustre.test_11c 00000040:00080000:0.0:1777051491.354053:0:109187:0:(llog.c:858:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 59 count 58 00000020:01000000:2.0:1777051491.354240:0:109174:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-58 (rc=0) 10000000:01000000:2.0:1777051491.354272:0:109174:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.201.146@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1777051491.354290:0:109174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff99d953284400/0x85f51a6b96717777 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b9671777e expref: -99 pid: 109174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051491.354310:0:109174:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.146@tcp lock: ffff99d953284400/0x85f51a6b96717777 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b9671777e expref: -99 pid: 109174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1777051491.354324:0:109174:0:(mgc_request.c:1799:mgc_process_log()) Process log lustre-mdtir-ffff99da7b5f9800 from 1 10000000:01000000:2.0:1777051491.354329:0:109174:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1777051491.354364:0:109174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.146@tcp lock: ffff99d950711600/0x85f51a6b96717842 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 109174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051491.354377:0:109174:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.146@tcp lock: ffff99d950711600/0x85f51a6b96717842 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 109174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051491.354392:0:109174:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.146@tcp lock: ffff99d950711600/0x85f51a6b96717842 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 109174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051491.354415:0:109174:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f9fd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9351a01-5b0e-4470-97fd-58b9b4b312a2:109174:1863365452701312:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1777051491.354459:0:109174:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051491.354517:0:109174:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d9591d5f00 going to sleep for 11 seconds 00000100:00100000:3.0:1777051491.354554:0:109184:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452701312 00000100:00100000:3.0:1777051491.354582:0:109184:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452701312 00000100:00100000:3.0:1777051491.354627:0:109184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1777051491.354641:0:109184:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942b85450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f9351a01-5b0e-4470-97fd-58b9b4b312a2+7:109174:x1863365452701312:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1777051491.354654:0:109184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777051491.354673:0:109184:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d94e6e6200/0x85f51a6b96717849 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x85f51a6b96717842 expref: -99 pid: 109184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051491.354701:0:109184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d94e6e6200/0x85f51a6b96717849 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x85f51a6b96717842 expref: 8 pid: 109184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051491.354717:0:109184:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d94e6e6200/0x85f51a6b96717849 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b96717842 expref: 8 pid: 109184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051491.354729:0:109184:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d94e6e6200, rc 0) 00000100:00100000:3.0:1777051491.354787:0:109184:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942b85450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f9351a01-5b0e-4470-97fd-58b9b4b312a2+8:109174:x1863365452701312:12345-0@lo:101:mount.lustre.0 Request processed in 149us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051491.354797:0:109184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1777051491.354924:0:109174:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f9fd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9351a01-5b0e-4470-97fd-58b9b4b312a2:109174:1863365452701312:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1777051491.354973:0:109174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.146@tcp lock: ffff99d950711600/0x85f51a6b96717842 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b96717849 expref: -99 pid: 109174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051491.354989:0:109174:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.146@tcp lock: ffff99d950711600/0x85f51a6b96717842 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x85f51a6b96717849 expref: -99 pid: 109174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1777051491.355890:0:109175:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:2.0:1777051491.356101:0:109174:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f9fd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9351a01-5b0e-4470-97fd-58b9b4b312a2:109174:1863365452701440:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1777051491.356167:0:109174:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051491.356237:0:109174:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d9591d5f00 going to sleep for 11 seconds 00000100:00100000:0.0:1777051491.356352:0:109186:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452701440 00000100:00100000:0.0:1777051491.356360:0:109186:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452701440 00000100:00100000:0.0:1777051491.356406:0:109186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1777051491.356419:0:109186:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942b87850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f9351a01-5b0e-4470-97fd-58b9b4b312a2+8:109174:x1863365452701440:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1777051491.356442:0:109186:0:(mgs_nids.c:912:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1777051491.356467:0:109186:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1777051491.356473:0:109186:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1777051491.356478:0:109186:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1777051491.356481:0:109186:0:(mgs_nids.c:316:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 34 00000100:00100000:0.0:1777051491.356628:0:109186:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942b87850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f9351a01-5b0e-4470-97fd-58b9b4b312a2+8:109174:x1863365452701440:12345-0@lo:256:mount.lustre.0 Request processed in 209us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051491.356641:0:109186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1777051491.356661:0:109174:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f9fd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9351a01-5b0e-4470-97fd-58b9b4b312a2:109174:1863365452701440:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1777051491.357684:0:109174:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.201.146@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1777051491.357721:0:109174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff99d950711600/0x85f51a6b96717842 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b96717849 expref: -99 pid: 109174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051491.357737:0:109174:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.146@tcp lock: ffff99d950711600/0x85f51a6b96717842 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b96717849 expref: -99 pid: 109174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1777051491.357749:0:109174:0:(mgc_request.c:1799:mgc_process_log()) Process log params-ffff99da7b5f9800 from 1 10000000:01000000:2.0:1777051491.357753:0:109174:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1777051491.357782:0:109174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.146@tcp lock: ffff99d950710200/0x85f51a6b96717850 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 109174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051491.357794:0:109174:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.146@tcp lock: ffff99d950710200/0x85f51a6b96717850 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 109174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051491.357809:0:109174:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.146@tcp lock: ffff99d950710200/0x85f51a6b96717850 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 109174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051491.357831:0:109174:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f9fd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9351a01-5b0e-4470-97fd-58b9b4b312a2:109174:1863365452701568:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1777051491.357870:0:109174:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051491.357918:0:109174:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d9591d5f00 going to sleep for 11 seconds 00000100:00100000:0.0:1777051491.358108:0:109182:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452701568 00000100:00100000:0.0:1777051491.358116:0:109182:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452701568 00000100:00100000:0.0:1777051491.358166:0:109182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1777051491.358177:0:109182:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f3bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9351a01-5b0e-4470-97fd-58b9b4b312a2+8:109174:x1863365452701568:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1777051491.358190:0:109182:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051491.358217:0:109182:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99da7d774c00/0x85f51a6b96717857 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x85f51a6b96717850 expref: -99 pid: 109182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051491.358243:0:109182:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99da7d774c00/0x85f51a6b96717857 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x85f51a6b96717850 expref: 9 pid: 109182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051491.358258:0:109182:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99da7d774c00/0x85f51a6b96717857 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b96717850 expref: 9 pid: 109182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051491.358281:0:109182:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99da7d774c00, rc 0) 00000100:00100000:0.0:1777051491.358346:0:109182:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f3bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9351a01-5b0e-4470-97fd-58b9b4b312a2+9:109174:x1863365452701568:12345-0@lo:101:mount.lustre.0 Request processed in 162us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051491.358357:0:109182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1777051491.358431:0:109174:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f9fd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9351a01-5b0e-4470-97fd-58b9b4b312a2:109174:1863365452701568:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1777051491.358451:0:109174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.146@tcp lock: ffff99d950710200/0x85f51a6b96717850 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b96717857 expref: -99 pid: 109174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051491.358466:0:109174:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.146@tcp lock: ffff99d950710200/0x85f51a6b96717850 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x85f51a6b96717857 expref: -99 pid: 109174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051491.358540:0:109174:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955ebf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9351a01-5b0e-4470-97fd-58b9b4b312a2:109174:1863365452701696:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1777051491.358579:0:109174:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051491.358624:0:109174:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da432060c0 going to sleep for 11 seconds 00000100:00100000:3.0:1777051491.358700:0:109184:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452701696 00000100:00100000:3.0:1777051491.358709:0:109184:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452701696 00000100:00100000:3.0:1777051491.358770:0:109184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1777051491.358783:0:109184:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f3bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f9351a01-5b0e-4470-97fd-58b9b4b312a2+9:109174:x1863365452701696:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1777051491.358984:0:109184:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f3bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f9351a01-5b0e-4470-97fd-58b9b4b312a2+9:109174:x1863365452701696:12345-0@lo:501:mount.lustre.0 Request processed in 201us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051491.358998:0:109184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1777051491.359049:0:109174:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955ebf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9351a01-5b0e-4470-97fd-58b9b4b312a2:109174:1863365452701696:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1777051491.359099:0:109174:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955ebf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9351a01-5b0e-4470-97fd-58b9b4b312a2:109174:1863365452701824:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1777051491.359447:0:109174:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051491.359473:0:109174:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da432060c0 going to sleep for 11 seconds 00000100:00100000:0.0:1777051491.359643:0:109186:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452701824 00000100:00100000:0.0:1777051491.359650:0:109186:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452701824 00000100:00100000:0.0:1777051491.359701:0:109186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1777051491.359712:0:109186:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f3bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f9351a01-5b0e-4470-97fd-58b9b4b312a2+9:109174:x1863365452701824:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1777051491.359831:0:109186:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f3bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f9351a01-5b0e-4470-97fd-58b9b4b312a2+9:109174:x1863365452701824:12345-0@lo:503:mount.lustre.0 Request processed in 121us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051491.359839:0:109186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1777051491.359908:0:109174:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955ebf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9351a01-5b0e-4470-97fd-58b9b4b312a2:109174:1863365452701824:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1777051491.360802:0:109197:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955ebf100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f9351a01-5b0e-4470-97fd-58b9b4b312a2:109197:1863365452701952:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1777051491.360865:0:109197:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051491.360912:0:109197:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da43206c00 going to sleep for 11 seconds 00000100:00100000:2.0:1777051491.364066:0:109181:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452701952 00000100:00100000:2.0:1777051491.364075:0:109181:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452701952 00000100:00100000:2.0:1777051491.364150:0:109181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1777051491.364164:0:109181:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f3bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9351a01-5b0e-4470-97fd-58b9b4b312a2+9:109197:x1863365452701952:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1777051491.365749:0:109181:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f3bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9351a01-5b0e-4470-97fd-58b9b4b312a2+9:109197:x1863365452701952:12345-0@lo:502:llog_process_th.0 Request processed in 1585us (4882us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051491.365763:0:109181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1777051491.365836:0:109197:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955ebf100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f9351a01-5b0e-4470-97fd-58b9b4b312a2:109197:1863365452701952:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1777051491.365881:0:109197:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1777051491.365896:0:109197:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1777051491.365899:0:109197:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1777051491.365908:0:109197:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff99da7b5f9800 00000020:00000080:1.0:1777051491.365911:0:109197:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1777051491.365920:0:109197:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1777051491.365922:0:109197:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1777051491.365924:0:109197:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1777051491.365956:0:109197:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1777051491.365961:0:109197:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1777051491.365964:0:109197:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1777051491.365970:0:109197:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff99da7b5f9800 00000020:00000080:1.0:1777051491.365972:0:109197:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1777051491.366032:0:109197:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1777051491.366036:0:109197:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1777051491.366037:0:109197:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1777051491.366040:0:109197:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1777051491.366042:0:109197:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #4 00000020:01000000:1.0:1777051491.366043:0:109197:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1777051491.366045:0:109197:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1777051491.366047:0:109197:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1777051491.366048:0:109197:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1777051491.366050:0:109197:0:(obd_config.c:1561:class_process_config()) marker 4 (0x6) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1777051491.366052:0:109197:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1777051491.366053:0:109197:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #5 00000020:01000000:1.0:1777051491.366055:0:109197:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1777051491.366057:0:109197:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1777051491.366059:0:109197:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1777051491.366061:0:109197:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1777051491.366062:0:109197:0:(obd_config.c:1561:class_process_config()) marker 5 (0x6) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1777051491.366065:0:109197:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1777051491.366066:0:109197:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #6 00000020:01000000:1.0:1777051491.366068:0:109197:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1777051491.366069:0:109197:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1777051491.366071:0:109197:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1777051491.366073:0:109197:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1777051491.366075:0:109197:0:(obd_config.c:1561:class_process_config()) marker 6 (0x6) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1777051491.366079:0:109197:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1777051491.366081:0:109197:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #7 00000020:01000000:1.0:1777051491.366082:0:109197:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1777051491.366084:0:109197:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1777051491.366085:0:109197:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1777051491.366087:0:109197:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1777051491.366089:0:109197:0:(obd_config.c:1561:class_process_config()) marker 7 (0x6) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1777051491.366091:0:109197:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1777051491.366092:0:109197:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #2 00000020:01000000:1.0:1777051491.366093:0:109197:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1777051491.366094:0:109197:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1777051491.366096:0:109197:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1777051491.366098:0:109197:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1777051491.366100:0:109197:0:(obd_config.c:1561:class_process_config()) marker 2 (0x6) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1777051491.366104:0:109197:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1777051491.366106:0:109197:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #3 00000020:01000000:1.0:1777051491.366108:0:109197:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1777051491.366110:0:109197:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1777051491.366112:0:109197:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1777051491.366117:0:109197:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1777051491.366119:0:109197:0:(obd_config.c:1561:class_process_config()) marker 3 (0x6) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1777051491.366123:0:109197:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1777051491.366126:0:109197:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1777051491.366129:0:109197:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1777051491.366134:0:109197:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff99da7b5f9800 00000020:00000080:1.0:1777051491.366137:0:109197:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1777051491.366169:0:109197:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1777051491.366175:0:109197:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1777051491.366178:0:109197:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1777051491.366183:0:109197:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1777051491.366188:0:109197:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1777051491.366191:0:109197:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1777051491.366231:0:109197:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff99da7b5f9800 00000020:00000080:1.0:1777051491.366235:0:109197:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1777051491.366270:0:109197:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1777051491.366277:0:109197:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1777051491.366281:0:109197:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1777051491.366286:0:109197:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1777051491.366289:0:109197:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #2 00000020:01000000:1.0:1777051491.366291:0:109197:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1777051491.366294:0:109197:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1777051491.366296:0:109197:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1777051491.366300:0:109197:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1777051491.366303:0:109197:0:(obd_config.c:1561:class_process_config()) marker 2 (0x6) lustre mdt.lustre-MDT0000.hsm.default_archive_id 00000020:01000000:1.0:1777051491.366308:0:109197:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1777051491.366310:0:109197:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #3 00000020:01000000:1.0:1777051491.366312:0:109197:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1777051491.366314:0:109197:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1777051491.366317:0:109197:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1777051491.366321:0:109197:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1777051491.366323:0:109197:0:(obd_config.c:1561:class_process_config()) marker 3 (0x6) lustre mdt.lustre-MDT0001.hsm.default_archive_id 00000020:01000000:1.0:1777051491.366327:0:109197:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1777051491.366329:0:109197:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #2 00000020:01000000:1.0:1777051491.366331:0:109197:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1777051491.366333:0:109197:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1777051491.366335:0:109197:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1777051491.366338:0:109197:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1777051491.366339:0:109197:0:(obd_config.c:1561:class_process_config()) marker 2 (0x6) lustre mdt.lustre-MDT0000.hsm.default_archive_id 00000020:01000000:1.0:1777051491.366342:0:109197:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1777051491.366343:0:109197:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #3 00000020:01000000:1.0:1777051491.366344:0:109197:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1777051491.366345:0:109197:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000100:00100000:1.0:1777051491.366373:0:109197:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955ebf100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f9351a01-5b0e-4470-97fd-58b9b4b312a2:109197:1863365452702080:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1777051491.366428:0:109197:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051491.366503:0:109197:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da43206c00 going to sleep for 11 seconds 00000100:00100000:3.0:1777051491.366543:0:109184:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452702080 00000100:00100000:3.0:1777051491.366554:0:109184:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452702080 00000100:00100000:3.0:1777051491.366609:0:109184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1777051491.366627:0:109184:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f3bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f9351a01-5b0e-4470-97fd-58b9b4b312a2+9:109197:x1863365452702080:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1777051491.366796:0:109184:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f3bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f9351a01-5b0e-4470-97fd-58b9b4b312a2+9:109197:x1863365452702080:12345-0@lo:502:llog_process_th.0 Request processed in 173us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051491.366811:0:109184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1777051491.366846:0:109197:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955ebf100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f9351a01-5b0e-4470-97fd-58b9b4b312a2:109197:1863365452702080:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1777051491.366880:0:109197:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1777051491.366886:0:109197:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1777051491.366888:0:109197:0:(obd_config.c:1561:class_process_config()) marker 3 (0x6) lustre mdt.lustre-MDT0001.hsm.default_archive_id 00000040:00080000:1.0:1777051491.366892:0:109197:0:(llog.c:858:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 43 count 43 00000020:01000000:2.0:1777051491.367037:0:109174:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-42 (rc=0) 10000000:01000000:2.0:1777051491.367083:0:109174:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.201.146@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1777051491.367108:0:109174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff99d950710200/0x85f51a6b96717850 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b96717857 expref: -99 pid: 109174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051491.367125:0:109174:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.146@tcp lock: ffff99d950710200/0x85f51a6b96717850 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b96717857 expref: -99 pid: 109174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1777051491.367208:0:109174:0:(mgc_request.c:1941:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1777051491.367214:0:109174:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff99da7b5f9800 10000000:01000000:2.0:1777051491.367219:0:109174:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff99da7b5f9800 10000000:01000000:2.0:1777051491.367226:0:109174:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1777051491.367234:0:109174:0:(mgc_request.c:1799:mgc_process_log()) Process log lustre-client-ffff99da7b5f9800 from 1 10000000:01000000:2.0:1777051491.367238:0:109174:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1777051491.367270:0:109174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.146@tcp lock: ffff99d950710e00/0x85f51a6b9671785e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 109174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051491.367279:0:109174:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.146@tcp lock: ffff99d950710e00/0x85f51a6b9671785e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 109174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051491.367289:0:109174:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.146@tcp lock: ffff99d950710e00/0x85f51a6b9671785e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 109174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051491.367305:0:109174:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f9fd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9351a01-5b0e-4470-97fd-58b9b4b312a2:109174:1863365452702208:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1777051491.367391:0:109174:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051491.367439:0:109174:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d9567aa540 going to sleep for 11 seconds 00000100:00100000:1.0:1777051491.367465:0:109186:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452702208 00000100:00100000:1.0:1777051491.367475:0:109186:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452702208 00000100:00100000:1.0:1777051491.367529:0:109186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1777051491.367541:0:109186:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f3bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f9351a01-5b0e-4470-97fd-58b9b4b312a2+9:109174:x1863365452702208:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1777051491.367553:0:109186:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777051491.367571:0:109186:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d953285000/0x85f51a6b96717865 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x85f51a6b9671785e expref: -99 pid: 109186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051491.367599:0:109186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d953285000/0x85f51a6b96717865 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x85f51a6b9671785e expref: 10 pid: 109186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051491.367618:0:109186:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d953285000/0x85f51a6b96717865 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b9671785e expref: 10 pid: 109186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051491.367631:0:109186:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d953285000, rc 0) 00000100:00100000:1.0:1777051491.367697:0:109186:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f3bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f9351a01-5b0e-4470-97fd-58b9b4b312a2+10:109174:x1863365452702208:12345-0@lo:101:mount.lustre.0 Request processed in 157us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051491.367709:0:109186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1777051491.367750:0:109174:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f9fd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9351a01-5b0e-4470-97fd-58b9b4b312a2:109174:1863365452702208:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1777051491.367772:0:109174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.146@tcp lock: ffff99d950710e00/0x85f51a6b9671785e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b96717865 expref: -99 pid: 109174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051491.367794:0:109174:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.146@tcp lock: ffff99d950710e00/0x85f51a6b9671785e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x85f51a6b96717865 expref: -99 pid: 109174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051491.367903:0:109174:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f9fd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9351a01-5b0e-4470-97fd-58b9b4b312a2:109174:1863365452702336:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1777051491.367986:0:109174:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051491.368025:0:109174:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d9567aa540 going to sleep for 11 seconds 00000100:00100000:3.0:1777051491.368094:0:109181:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452702336 00000100:00100000:3.0:1777051491.368103:0:109181:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452702336 00000100:00100000:3.0:1777051491.368151:0:109181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1777051491.368165:0:109181:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f3be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9351a01-5b0e-4470-97fd-58b9b4b312a2+10:109174:x1863365452702336:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1777051491.368390:0:109181:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f3be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9351a01-5b0e-4470-97fd-58b9b4b312a2+10:109174:x1863365452702336:12345-0@lo:501:mount.lustre.0 Request processed in 226us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051491.368404:0:109181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1777051491.368475:0:109174:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f9fd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9351a01-5b0e-4470-97fd-58b9b4b312a2:109174:1863365452702336:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1777051491.368529:0:109174:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f9fd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9351a01-5b0e-4470-97fd-58b9b4b312a2:109174:1863365452702464:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1777051491.368598:0:109174:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051491.368650:0:109174:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d9567aa540 going to sleep for 11 seconds 00000100:00100000:3.0:1777051491.369078:0:109184:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452702464 00000100:00100000:3.0:1777051491.369088:0:109184:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452702464 00000100:00100000:3.0:1777051491.369145:0:109184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1777051491.369158:0:109184:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f3be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f9351a01-5b0e-4470-97fd-58b9b4b312a2+10:109174:x1863365452702464:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1777051491.369336:0:109184:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f3be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f9351a01-5b0e-4470-97fd-58b9b4b312a2+10:109174:x1863365452702464:12345-0@lo:503:mount.lustre.0 Request processed in 176us (736us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051491.369351:0:109184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1777051491.369395:0:109174:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f9fd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9351a01-5b0e-4470-97fd-58b9b4b312a2:109174:1863365452702464:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1777051491.370877:0:109199:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d9533bc000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f9351a01-5b0e-4470-97fd-58b9b4b312a2:109199:1863365452702592:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1777051491.370971:0:109199:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051491.371021:0:109199:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d958800600 going to sleep for 11 seconds 00000100:00100000:2.0:1777051491.371063:0:109186:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452702592 00000100:00100000:2.0:1777051491.371074:0:109186:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452702592 00000100:00100000:2.0:1777051491.371134:0:109186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1777051491.371149:0:109186:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f3bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f9351a01-5b0e-4470-97fd-58b9b4b312a2+10:109199:x1863365452702592:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1777051491.371309:0:109186:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f3bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f9351a01-5b0e-4470-97fd-58b9b4b312a2+10:109199:x1863365452702592:12345-0@lo:502:llog_process_th.0 Request processed in 160us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051491.371323:0:109186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1777051491.371371:0:109199:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d9533bc000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f9351a01-5b0e-4470-97fd-58b9b4b312a2:109199:1863365452702592:0@lo:502:llog_process_th.0 00000020:01000004:3.0:1777051491.371483:0:109199:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1777051491.371501:0:109199:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff99da580799c0) 00000020:00000080:3.0:1777051491.371533:0:109199:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:3.0:1777051491.371723:0:109199:0:(tgt_mount.c:151:server_get_mount()) get mount ffff99da7b5f9800 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1777051491.371730:0:109199:0:(tgt_mount.c:185:server_put_mount()) put mount ffff99da7b5f9800 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1777051491.371734:0:109199:0:(obd_mount.c:701:lustre_put_lsi()) put ffff99da7b5f9800 4 00010000:00080000:3.0:1777051491.371777:0:109199:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99da70a54000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.201.146@tcp at head 00010000:00010000:3.0:1777051491.376535:0:109199:0:(ldlm_pool.c:924:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-12 is initialized 00000020:00000080:3.0:1777051491.376706:0:109199:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1777051491.376782:0:109199:0:(lwp_dev.c:496:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1777051491.376801:0:109199:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x85f51a6b96717873 00000100:00080000:3.0:1777051491.376814:0:109199:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1777051491.376822:0:109199:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff99da70a54000 using connection 192.168.201.146@tcp/0@lo 00000100:00100000:3.0:1777051491.376864:0:109199:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d9533bc000 x1863365452702720/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1777051491.376912:0:109199:0:(pinger.c:371:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1777051491.376965:0:3676:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d9533bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3676:1863365452702720:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1777051491.377043:0:3676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051491.377146:0:46494:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452702720 00000100:00100000:3.0:1777051491.377156:0:46494:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452702720 00000100:00100000:3.0:1777051491.377269:0:46494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112416 00000100:00100000:3.0:1777051491.377284:0:46494:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:0+-99:3676:x1863365452702720:12345-0@lo:38:llog_process_th.0 00000100:00100000:3.0:1777051491.377385:0:46494:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:0+-99:3676:x1863365452702720:12345-0@lo:38:llog_process_th.0 Request processed in 101us (338us total) trans 0 rc -11/-11 00000100:00100000:3.0:1777051491.377400:0:46494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112416 00000100:00100000:2.0:1777051491.377405:0:3676:0:(client.c:3101:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1777051491.377418:0:3676:0:(import.c:65:import_set_state_nolock()) ffff99da70a54000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1777051491.377428:0:3676:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1777051491.377438:0:3676:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d9533bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3676:1863365452702720:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1777051491.377568:0:109199:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d9533bc000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f9351a01-5b0e-4470-97fd-58b9b4b312a2:109199:1863365452702848:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1777051491.377642:0:109199:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051491.377681:0:109181:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452702848 00000100:00100000:3.0:1777051491.377689:0:109181:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452702848 00000100:00100000:3.0:1777051491.377763:0:109181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1777051491.377781:0:109181:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f3bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9351a01-5b0e-4470-97fd-58b9b4b312a2+10:109199:x1863365452702848:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1777051491.377978:0:109181:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f3bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9351a01-5b0e-4470-97fd-58b9b4b312a2+10:109199:x1863365452702848:12345-0@lo:502:llog_process_th.0 Request processed in 201us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051491.377992:0:109181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1777051491.378088:0:109199:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d958800780 going to sleep for 11 seconds 00000100:00100000:3.0:1777051491.378117:0:109199:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d9533bc000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f9351a01-5b0e-4470-97fd-58b9b4b312a2:109199:1863365452702848:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1777051491.378240:0:109199:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d9533bc000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f9351a01-5b0e-4470-97fd-58b9b4b312a2:109199:1863365452702976:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1777051491.378315:0:109199:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051491.378364:0:109184:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452702976 00000100:00100000:3.0:1777051491.378371:0:109184:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452702976 00000100:00100000:3.0:1777051491.378430:0:109184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1777051491.378445:0:109184:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f3bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f9351a01-5b0e-4470-97fd-58b9b4b312a2+10:109199:x1863365452702976:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1777051491.378576:0:109184:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f3bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f9351a01-5b0e-4470-97fd-58b9b4b312a2+10:109199:x1863365452702976:12345-0@lo:502:llog_process_th.0 Request processed in 132us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051491.378589:0:109184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1777051491.378684:0:109199:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d958800780 going to sleep for 11 seconds 00000100:00100000:3.0:1777051491.378710:0:109199:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d9533bc000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f9351a01-5b0e-4470-97fd-58b9b4b312a2:109199:1863365452702976:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1777051491.379042:0:109199:0:(llog.c:858:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64 count 63 00000020:01000000:2.0:1777051491.379158:0:109174:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-63 (rc=0) 10000000:01000000:2.0:1777051491.379248:0:109174:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.201.146@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1777051491.379278:0:109174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff99d950710e00/0x85f51a6b9671785e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b96717865 expref: -99 pid: 109174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051491.379298:0:109174:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.146@tcp lock: ffff99d950710e00/0x85f51a6b9671785e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b96717865 expref: -99 pid: 109174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1777051491.379390:0:109174:0:(tgt_mount.c:1144:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1777051491.379394:0:109174:0:(tgt_mount.c:1145:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1777051491.379397:0:109174:0:(tgt_mount.c:1146:server_mti_print()) fs: lustre 00000020:01000004:2.0:1777051491.379399:0:109174:0:(tgt_mount.c:1147:server_mti_print()) uuid: 00000020:01000004:2.0:1777051491.379402:0:109174:0:(tgt_mount.c:1148:server_mti_print()) ver: 0 00000020:01000004:2.0:1777051491.379404:0:109174:0:(tgt_mount.c:1149:server_mti_print()) flags: 00000020:01000004:2.0:1777051491.379408:0:109174:0:(tgt_mount.c:1151:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1777051491.379411:0:109174:0:(tgt_mount.c:1155:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1777051491.379414:0:109174:0:(tgt_mount.c:1183:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1777051491.379417:0:109174:0:(tgt_mount.c:1189:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1777051491.379423:0:109174:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:2.0:1777051491.379427:0:109174:0:(tgt_mount.c:1144:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1777051491.379430:0:109174:0:(tgt_mount.c:1145:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1777051491.379432:0:109174:0:(tgt_mount.c:1146:server_mti_print()) fs: lustre 00000020:01000004:2.0:1777051491.379435:0:109174:0:(tgt_mount.c:1147:server_mti_print()) uuid: 00000020:01000004:2.0:1777051491.379437:0:109174:0:(tgt_mount.c:1148:server_mti_print()) ver: 0 00000020:01000004:2.0:1777051491.379440:0:109174:0:(tgt_mount.c:1149:server_mti_print()) flags: 00000020:01000004:2.0:1777051491.379443:0:109174:0:(tgt_mount.c:1151:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1777051491.379445:0:109174:0:(tgt_mount.c:1155:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1777051491.379448:0:109174:0:(tgt_mount.c:1183:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1777051491.379450:0:109174:0:(tgt_mount.c:1189:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1777051491.379473:0:109174:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1777051491.379492:0:109174:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94c12b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9351a01-5b0e-4470-97fd-58b9b4b312a2:109174:1863365452703104:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1777051491.379555:0:109174:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051491.379605:0:109174:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d957e91f00 going to sleep for 11 seconds 00000100:00100000:3.0:1777051491.379636:0:109186:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452703104 00000100:00100000:3.0:1777051491.379646:0:109186:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452703104 00000100:00100000:3.0:1777051491.379704:0:109186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1777051491.379718:0:109186:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7d978850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f9351a01-5b0e-4470-97fd-58b9b4b312a2+10:109174:x1863365452703104:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1777051491.379751:0:109186:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1777051491.379773:0:109186:0:(mgs_nids.c:461:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1777051491.388741:0:109186:0:(mgs_nids.c:813:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1777051491.388764:0:109186:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1777051491.389106:0:109183:0:(mgs_nids.c:710:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1777051491.389116:0:109183:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1777051491.389143:0:109183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99da7d774600/0x85f51a6b9671787a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 109183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051491.389169:0:109183:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99d94e6e6200/0x85f51a6b96717849 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b96717842 expref: 10 pid: 109184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051491.389183:0:109183:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99da7d774600/0x85f51a6b9671787a lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 109183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051491.389230:0:109183:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99d94e6e6200/0x85f51a6b96717849 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x85f51a6b96717842 expref: 10 pid: 109184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051491.389254:0:109183:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99d94e6e6200/0x85f51a6b96717849 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x85f51a6b96717842 expref: 10 pid: 109184 timeout: 8220 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051491.389284:0:109183:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95aecd500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:109183:1863365452703232:0@lo:104: 00000100:00100000:0.0:1777051491.389394:0:109183:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051491.389463:0:109183:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d95ded6b40 going to sleep for 11 seconds 00000100:00100000:2.0:1777051491.389475:0:99220:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452703232 00000100:00100000:2.0:1777051491.389486:0:99220:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452703232 00000100:00100000:2.0:1777051491.389549:0:99220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1777051491.389564:0:99220:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95aecdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:f9351a01-5b0e-4470-97fd-58b9b4b312a2+3:109183:x1863365452703232:12345-0@lo:104: 00010000:00010000:2.0:1777051491.389584:0:99220:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.146@tcp lock: ffff99d950711600/0x85f51a6b96717842 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x85f51a6b96717849 expref: -99 pid: 109174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051491.389670:0:99220:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1777051491.389682:0:99220:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95aecdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:f9351a01-5b0e-4470-97fd-58b9b4b312a2+3:109183:x1863365452703232:12345-0@lo:104: Request processed in 121us (288us total) trans 0 rc 0/0 00010000:00010000:0.0:1777051491.389689:0:38719:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:2.0:1777051491.389696:0:99220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00010000:00010000:0.0:1777051491.389702:0:38719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.146@tcp lock: ffff99d950711600/0x85f51a6b96717842 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x85f51a6b96717849 expref: -99 pid: 109174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051491.389718:0:38719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d950711600 already unused, calling callback (ffffffffc1208c20) 10000000:00010000:0.0:1777051491.389724:0:38719:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.146@tcp lock: ffff99d950711600/0x85f51a6b96717842 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x85f51a6b96717849 expref: -99 pid: 109174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051491.389737:0:38719:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.146@tcp lock: ffff99d950711600/0x85f51a6b96717842 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x85f51a6b96717849 expref: -99 pid: 109174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1777051491.389749:0:38719:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.146@tcp lock: ffff99d950711600/0x85f51a6b96717842 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x85f51a6b96717849 expref: -99 pid: 109174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1777051491.389760:0:38719:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000100:00100000:2.0:1777051491.389806:0:109186:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7d978850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f9351a01-5b0e-4470-97fd-58b9b4b312a2+10:109174:x1863365452703104:12345-0@lo:253:mount.lustre.0 Request processed in 10089us (10248us total) trans 0 rc 0/0 00010000:00010000:0.0:1777051491.389809:0:38719:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.146@tcp lock: ffff99d950711600/0x85f51a6b96717842 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x85f51a6b96717849 expref: -99 pid: 109174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051491.389825:0:109186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00010000:0.0:1777051491.389827:0:38719:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1777051491.389864:0:38719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.146@tcp lock: ffff99d950711600/0x85f51a6b96717842 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x85f51a6b96717849 expref: -99 pid: 109174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051491.389878:0:38719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.146@tcp lock: ffff99d950711600/0x85f51a6b96717842 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x85f51a6b96717849 expref: -99 pid: 109174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051491.389905:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777051491.389910:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777051491.389913:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1777051491.389961:0:109174:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94c12b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9351a01-5b0e-4470-97fd-58b9b4b312a2:109174:1863365452703104:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1777051491.389969:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95aecf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3677:1863365452703360:0@lo:103:ldlm_bl.0 10000000:01000000:2.0:1777051491.389982:0:109174:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1777051491.389988:0:109174:0:(tgt_mount.c:1144:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1777051491.389991:0:109174:0:(tgt_mount.c:1145:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1777051491.389995:0:109174:0:(tgt_mount.c:1146:server_mti_print()) fs: lustre 00000020:01000004:2.0:1777051491.389997:0:109174:0:(tgt_mount.c:1147:server_mti_print()) uuid: 00000020:01000004:2.0:1777051491.390000:0:109174:0:(tgt_mount.c:1148:server_mti_print()) ver: 0 00000020:01000004:2.0:1777051491.390003:0:109174:0:(tgt_mount.c:1149:server_mti_print()) flags: 00000020:01000004:2.0:1777051491.390006:0:109174:0:(tgt_mount.c:1151:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1777051491.390010:0:109174:0:(tgt_mount.c:1155:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1777051491.390013:0:109174:0:(tgt_mount.c:1183:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1777051491.390015:0:109174:0:(tgt_mount.c:1189:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:0.0:1777051491.390021:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:02000000:2.0:1777051491.390039:0:109174:0:(tgt_mount.c:2642:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:0.0:1777051491.390089:0:9550:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452703360 00000100:00100000:0.0:1777051491.390097:0:9550:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452703360 00010000:00010000:0.0:1777051491.390406:0:9550:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99d94e6e6200/0x85f51a6b96717849 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x85f51a6b96717842 expref: 10 pid: 109184 timeout: 8220 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051491.390452:0:9550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3973 00000100:00100000:0.0:1777051491.390465:0:9550:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95aecc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f9351a01-5b0e-4470-97fd-58b9b4b312a2+10:3677:x1863365452703360:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1777051491.390481:0:9550:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777051491.390489:0:9550:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99d94e6e6200/0x85f51a6b96717849 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x85f51a6b96717842 expref: 10 pid: 109184 timeout: 8220 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051491.390508:0:9550:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99d94e6e6200/0x85f51a6b96717849 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x85f51a6b96717842 expref: 10 pid: 109184 timeout: 8220 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051491.390532:0:9550:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99da7d774600/0x85f51a6b9671787a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 109183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051491.390545:0:9550:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99da7d774600/0x85f51a6b9671787a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 109183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1777051491.390564:0:9550:0:(mgs_nids.c:686:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001449083s 00010000:00010000:0.0:1777051491.390570:0:9550:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99da7d774600/0x85f51a6b9671787a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 109183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051491.390581:0:9550:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99da7d774600/0x85f51a6b9671787a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 109183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051491.390600:0:9550:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99da7d774600/0x85f51a6b9671787a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 109183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051491.390610:0:9550:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99da7d774600/0x85f51a6b9671787a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 109183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051491.390621:0:9550:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da7d774600 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:0.0:1777051491.390627:0:9550:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99da7d774600/0x85f51a6b9671787a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 109183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051491.390639:0:9550:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99da7d774600/0x85f51a6b9671787a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 109183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051491.390654:0:9550:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99da7d774600/0x85f51a6b9671787a lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 109183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051491.390669:0:9550:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1777051491.390723:0:9550:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95aecc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f9351a01-5b0e-4470-97fd-58b9b4b312a2+10:3677:x1863365452703360:12345-0@lo:103:ldlm_bl.0 Request processed in 260us (702us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051491.390736:0:9550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3973 00000100:00100000:0.0:1777051491.390786:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95aecf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3677:1863365452703360:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1777051491.390831:0:109183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d94e6e6200/0x85f51a6b96717849 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x85f51a6b96717842 expref: 9 pid: 109184 timeout: 8220 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051491.390849:0:109183:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95aecd500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:109183:1863365452703232:0@lo:104: 00010000:00010000:0.0:1777051491.390871:0:109183:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99da7d774600/0x85f51a6b9671787a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 109183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051491.390892:0:109183:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99da7d774600/0x85f51a6b9671787a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 109183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051491.390902:0:109183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99da7d774600/0x85f51a6b9671787a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 109183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051491.390913:0:109183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99da7d774600/0x85f51a6b9671787a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 109183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1777051491.411426:0:109174:0:(update_trans.c:1477:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 25769803782 00000040:01000000:2.0:1777051491.411889:0:109174:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:1.0:1777051491.411917:0:109209:0:(update_trans.c:1520:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 25769803782 00000020:00080000:1.0:1777051491.411924:0:109209:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 25769803782 00000040:01000000:1.0:1777051491.413431:0:109210:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1777051491.413433:0:109174:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00100000:0.0:1777051491.414511:0:109211:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95aecd500 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:109211:1863365452703488:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1777051491.414603:0:109211:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051491.414658:0:109211:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d95c8e16c0 going to sleep for 11 seconds 00000100:00100000:2.0:1777051491.414989:0:47208:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452703488 00000100:00100000:2.0:1777051491.415001:0:47208:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452703488 00000100:00100000:2.0:1777051491.415073:0:47208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8328 00000100:00100000:2.0:1777051491.415090:0:47208:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95aecf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+6:109211:x1863365452703488:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1777051491.415288:0:47208:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95aecf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+6:109211:x1863365452703488:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 199us (681us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051491.415305:0:47208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8328 00000100:00100000:0.0:1777051491.415514:0:109211:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95aecd500 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:109211:1863365452703488:0@lo:1000:lod0000_rec0001.0 00000040:01000000:0.0:1777051491.415562:0:109211:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:0.0:1777051491.415614:0:109211:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95aecd500 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:109211:1863365452703616:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1777051491.415675:0:109211:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051491.415707:0:109211:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d95c8e16c0 going to sleep for 11 seconds 00000100:00100000:1.0:1777051491.415781:0:11727:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452703616 00000100:00100000:1.0:1777051491.415790:0:11727:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452703616 00000100:00100000:1.0:1777051491.415843:0:11727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8329 00000100:00100000:1.0:1777051491.415857:0:11727:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95aecce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:109211:x1863365452703616:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1777051491.416097:0:11727:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95aecce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:109211:x1863365452703616:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 242us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051491.416110:0:11727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8329 00000100:00100000:0.0:1777051491.416618:0:109211:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95aecd500 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:109211:1863365452703616:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1777051491.416726:0:109211:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95aecd500 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:109211:1863365452703744:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1777051491.416786:0:109211:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:01000000:1.0:1777051491.416797:0:109174:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000100:00100000:0.0:1777051491.416841:0:6585:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452703744 00000100:00100000:0.0:1777051491.416850:0:6585:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452703744 00000100:00100000:0.0:1777051491.416917:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8330 00000100:00100000:0.0:1777051491.416958:0:6585:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95aecf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:109211:x1863365452703744:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1777051491.417045:0:6585:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95aecf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:109211:x1863365452703744:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 117us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051491.417059:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8330 00000100:00100000:0.0:1777051491.417103:0:109211:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d95c8e16c0 going to sleep for 11 seconds 00000100:00100000:0.0:1777051491.417133:0:109211:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95aecd500 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:109211:1863365452703744:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1777051491.417572:0:109211:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95aecd500 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:109211:1863365452703872:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1777051491.417668:0:109211:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051491.417688:0:109211:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d95c8e1900 going to sleep for 11 seconds 00000100:00100000:2.0:1777051491.418133:0:47208:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452703872 00000100:00100000:2.0:1777051491.418140:0:47208:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452703872 00000100:00100000:2.0:1777051491.418180:0:47208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8331 00000100:00100000:2.0:1777051491.418190:0:47208:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95aece300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+6:109211:x1863365452703872:12345-0@lo:1000:lod0000_rec0001.0 00000004:00000080:1.0:1777051491.423235:0:109174:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1777051491.425588:0:109174:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000100:00100000:3.0:1777051491.426669:0:47208:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95aece300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+6:109211:x1863365452703872:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 8474us (8995us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051491.426688:0:47208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8331 00000100:00100000:0.0:1777051491.427451:0:109211:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95aecd500 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:109211:1863365452703872:0@lo:1000:lod0000_rec0001.0 00000040:00080000:0.0:1777051491.427540:0:109211:0:(llog_cat.c:391:llog_cat_set_first_idx()) catlog [0x240000401:0x1:0x0] first idx 2, last_idx 4 00000100:00100000:0.0:1777051491.427721:0:109211:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95aecd500 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:109211:1863365452704000:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1777051491.428252:0:109211:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051491.428311:0:6584:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452704000 00000100:00100000:0.0:1777051491.428320:0:6584:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452704000 00000100:00100000:0.0:1777051491.428391:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8332 00000100:00100000:0.0:1777051491.428409:0:6584:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955610000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:109211:x1863365452704000:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1777051491.428650:0:6584:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955610000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:109211:x1863365452704000:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 244us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051491.428664:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8332 00000100:00100000:0.0:1777051491.428705:0:109211:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d95c8e1900 going to sleep for 11 seconds 00000100:00100000:0.0:1777051491.428734:0:109211:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95aecd500 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:109211:1863365452704000:0@lo:1000:lod0000_rec0001.0 00000040:00080000:0.0:1777051491.428802:0:109211:0:(llog.c:801:llog_process_thread()) index: 3, lh_last_idx: 4 synced_idx: 0 lgh_last_idx: 4 00000040:00080000:0.0:1777051491.428810:0:109211:0:(llog_cat.c:158:llog_cat_process_common()) processing log [0x240000bd1:0x2:0x0] at index 3 of catalog [0x240000401:0x1:0x0] 00000100:00100000:0.0:1777051491.428887:0:109211:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955611f80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:109211:1863365452704128:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1777051491.428961:0:109211:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051491.429009:0:109211:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d95c8e16c0 going to sleep for 11 seconds 00000100:00100000:2.0:1777051491.429051:0:6585:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452704128 00000100:00100000:2.0:1777051491.429059:0:6585:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452704128 00000100:00100000:2.0:1777051491.429106:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8333 00000100:00100000:2.0:1777051491.429117:0:6585:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955613800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:109211:x1863365452704128:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1777051491.429220:0:6585:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955613800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:109211:x1863365452704128:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 102us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051491.429231:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8333 00000100:00100000:0.0:1777051491.429490:0:109211:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955611f80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:109211:1863365452704128:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1777051491.429620:0:109211:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955611f80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:109211:1863365452704256:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1777051491.429724:0:109211:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051491.429790:0:46500:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452704256 00000100:00100000:0.0:1777051491.429797:0:46500:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452704256 00000100:00100000:0.0:1777051491.430133:0:46500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8334 00000100:00100000:0.0:1777051491.430147:0:46500:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95aecd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+6:109211:x1863365452704256:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1777051491.430472:0:46500:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95aecd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+6:109211:x1863365452704256:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 326us (747us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051491.430486:0:46500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8334 00000100:00100000:0.0:1777051491.430520:0:109211:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d95c8e1900 going to sleep for 11 seconds 00000100:00100000:0.0:1777051491.430542:0:109211:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955611f80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:109211:1863365452704256:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1777051491.430645:0:109211:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955611f80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:109211:1863365452704384:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1777051491.430687:0:109211:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051491.430729:0:109211:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d95c8e1600 going to sleep for 11 seconds 00000100:00100000:3.0:1777051491.430785:0:11727:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452704384 00000100:00100000:3.0:1777051491.430794:0:11727:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452704384 00000100:00100000:3.0:1777051491.430846:0:11727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8335 00000100:00100000:3.0:1777051491.430858:0:11727:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94ed2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:109211:x1863365452704384:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1777051491.430997:0:11727:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94ed2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:109211:x1863365452704384:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 138us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051491.431009:0:11727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8335 00000100:00100000:0.0:1777051491.431217:0:109211:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955611f80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:109211:1863365452704384:0@lo:1000:lod0000_rec0001.0 00000004:00080000:0.0:1777051491.431284:0:109211:0:(osp_trans.c:1582:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff99d95c8e1e40 with version 1 00000040:00080000:0.0:1777051491.431321:0:109211:0:(llog_cat.c:391:llog_cat_set_first_idx()) catlog [0x240000401:0x1:0x0] first idx 3, last_idx 4 00000004:00080000:3.0:1777051491.431328:0:109191:0:(osp_trans.c:1330:osp_get_next_request()) ou ffff99d950723600 version 1 rpc_version 1 00000004:00080000:0.0:1777051491.431352:0:109211:0:(osp_trans.c:1582:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff99d95c8e1900 with version 2 00000040:00080000:0.0:1777051491.431361:0:109211:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x240000bd1:0x2:0x0] at index 3 of catalog [0x240000401:0x1:0x0] 00000020:00100000:3.0:1777051491.431363:0:109191:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1777051491.431380:0:109191:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff99d9533bc000 x1863365452704640/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 416/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1777051491.431406:0:109191:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d9533bc000 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:109191:1863365452704640:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1777051491.431468:0:109191:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051491.431503:0:109191:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d958800480 going to sleep for 11 seconds 00000100:00100000:0.0:1777051491.431509:0:6585:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452704640 00000100:00100000:0.0:1777051491.431519:0:6585:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452704640 00000100:00100000:0.0:1777051491.431572:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8336 00000100:00100000:0.0:1777051491.431586:0:6585:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d9533bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:109191:x1863365452704640:12345-0@lo:1000:osp_up1-0.0 00000001:00080000:3.0:1777051491.435633:0:104205:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934762 is committed 00000001:00100000:3.0:1777051491.435645:0:104205:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1777051491.435810:0:6585:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d9533bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:109191:x1863365452704640:12345-0@lo:1000:osp_up1-0.0 Request processed in 4223us (4340us total) trans 8589934762 rc 0/0 00000100:00100000:0.0:1777051491.435826:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8336 00000004:00080000:3.0:1777051491.435869:0:109191:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 8589934762 committed transno 8589934762 00000100:00100000:3.0:1777051491.435896:0:109191:0:(client.c:3101:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 8589934762 gen 2 00000100:00100000:3.0:1777051491.435919:0:109191:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d9533bc000 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:109191:1863365452704640:0@lo:1000:osp_up1-0.0 00000004:00080000:3.0:1777051491.435991:0:109191:0:(osp_trans.c:1330:osp_get_next_request()) ou ffff99d950723600 version 2 rpc_version 2 00000020:00100000:3.0:1777051491.436014:0:109191:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1777051491.436024:0:109191:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff99d9533bc000 x1863365452704896/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 744/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1777051491.436061:0:109191:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d9533bc000 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:109191:1863365452704896:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1777051491.436106:0:109191:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051491.436764:0:47208:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452704896 00000100:00100000:0.0:1777051491.436775:0:47208:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452704896 00000100:00100000:3.0:1777051491.436776:0:109191:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d958800480 going to sleep for 11 seconds 00000040:00080000:1.0:1777051491.437119:0:109210:0:(llog.c:858:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000100:00100000:0.0:1777051491.437147:0:47208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8337 00000100:00100000:0.0:1777051491.437166:0:47208:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d9533bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+5:109191:x1863365452704896:12345-0@lo:1000:osp_up1-0.0 00000004:00080000:1.0:1777051491.437285:0:109210:0:(lod_dev.c:520:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000100:00100000:0.0:1777051491.437430:0:47208:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d9533bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+6:109191:x1863365452704896:12345-0@lo:1000:osp_up1-0.0 Request processed in 267us (1320us total) trans 8589934763 rc 0/0 00000100:00100000:0.0:1777051491.437444:0:47208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8337 00000100:00100000:2.0:1777051491.437522:0:109191:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d9533bc000 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:109191:1863365452704896:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1777051491.437615:0:109211:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955ebf100 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:109211:1863365452705024:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1777051491.437715:0:109211:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051491.437755:0:109211:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d941aec9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1777051491.437798:0:6584:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452705024 00000100:00100000:0.0:1777051491.437807:0:6584:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452705024 00000100:00100000:0.0:1777051491.437866:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8338 00000100:00100000:0.0:1777051491.437876:0:6584:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955ebdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:109211:x1863365452705024:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1777051491.438413:0:6584:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955ebdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:109211:x1863365452705024:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 536us (697us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051491.438424:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8338 00000100:00100000:1.0:1777051491.438710:0:109211:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955ebf100 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:109211:1863365452705024:0@lo:1000:lod0000_rec0001.0 00000040:00080000:1.0:1777051491.438778:0:109211:0:(llog.c:801:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:1.0:1777051491.438786:0:109211:0:(llog_cat.c:158:llog_cat_process_common()) processing log [0x240000bd1:0x3:0x0] at index 4 of catalog [0x240000401:0x1:0x0] 00000100:00100000:1.0:1777051491.438860:0:109211:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955ebf100 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:109211:1863365452705152:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1777051491.438913:0:109211:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051491.438980:0:109211:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d941aec840 going to sleep for 11 seconds 00000100:00100000:2.0:1777051491.439027:0:46498:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452705152 00000100:00100000:2.0:1777051491.439037:0:46498:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452705152 00000100:00100000:2.0:1777051491.439125:0:46498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8339 00000100:00100000:2.0:1777051491.439139:0:46498:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955ebd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+6:109211:x1863365452705152:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1777051491.439285:0:46498:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955ebd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+6:109211:x1863365452705152:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 146us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051491.439300:0:46498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8339 00000100:00100000:1.0:1777051491.439345:0:109211:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955ebf100 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:109211:1863365452705152:0@lo:1000:lod0000_rec0001.0 00000040:00080000:1.0:1777051491.439403:0:109211:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:1.0:1777051491.439441:0:109211:0:(osp_trans.c:1582:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff99d941aec9c0 with version 3 00000004:00080000:1.0:1777051491.439477:0:109211:0:(osp_trans.c:1582:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff99d941aecf00 with version 4 00000040:00080000:1.0:1777051491.439482:0:109211:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x240000bd1:0x3:0x0] at index 4 of catalog [0x240000401:0x1:0x0] 00000040:00080000:1.0:1777051491.439498:0:109211:0:(llog.c:858:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 4 count 1 00000004:00080000:1.0:1777051491.439558:0:109211:0:(lod_dev.c:520:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1777051491.439562:0:109211:0:(lod_dev.c:544:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000004:00080000:2.0:1777051491.439627:0:109191:0:(osp_trans.c:1330:osp_get_next_request()) ou ffff99d950723600 version 3 rpc_version 3 00000020:00100000:2.0:1777051491.439656:0:109191:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1777051491.439668:0:109191:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff99d94c12b100 x1863365452705408/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 416/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1777051491.439715:0:109191:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94c12b100 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:109191:1863365452705408:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1777051491.440043:0:109191:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:3.0:1777051491.440114:0:109174:0:(llog.c:858:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000100:00100000:2.0:1777051491.440298:0:109191:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d942ccd240 going to sleep for 11 seconds 00000100:00100000:0.0:1777051491.440302:0:47208:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452705408 00000100:00100000:0.0:1777051491.440323:0:47208:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452705408 00000100:00100000:0.0:1777051491.440379:0:47208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8340 00000100:00100000:0.0:1777051491.440390:0:47208:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94c128380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+6:109191:x1863365452705408:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1777051491.440585:0:47208:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94c128380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+7:109191:x1863365452705408:12345-0@lo:1000:osp_up1-0.0 Request processed in 194us (540us total) trans 8589934764 rc 0/0 00000100:00100000:0.0:1777051491.440597:0:47208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8340 00000100:00100000:2.0:1777051491.441710:0:109191:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94c12b100 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:109191:1863365452705408:0@lo:1000:osp_up1-0.0 00000004:00080000:2.0:1777051491.441724:0:109191:0:(osp_trans.c:1330:osp_get_next_request()) ou ffff99d950723600 version 4 rpc_version 4 00000020:00100000:2.0:1777051491.441743:0:109191:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1777051491.441752:0:109191:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff99d94c128a80 x1863365452705664/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 744/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1777051491.441773:0:109191:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94c128a80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:109191:1863365452705664:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1777051491.441816:0:109191:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:3.0:1777051491.441822:0:109174:0:(llog.c:858:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000100:00100000:2.0:1777051491.441870:0:109191:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d942ccd240 going to sleep for 11 seconds 00000040:01000000:3.0:1777051491.441890:0:109174:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000100:00100000:0.0:1777051491.441971:0:11727:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452705664 00000100:00100000:0.0:1777051491.441980:0:11727:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452705664 00000100:00100000:0.0:1777051491.442049:0:11727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8341 00000100:00100000:0.0:1777051491.442064:0:11727:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da4384d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:109191:x1863365452705664:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1777051491.442214:0:11727:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da4384d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+8:109191:x1863365452705664:12345-0@lo:1000:osp_up1-0.0 Request processed in 153us (396us total) trans 8589934765 rc 0/0 00000100:00100000:0.0:1777051491.442226:0:11727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8341 00000100:00100000:2.0:1777051491.442320:0:109191:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94c128a80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:109191:1863365452705664:0@lo:1000:osp_up1-0.0 00000040:00080000:3.0:1777051491.444359:0:109174:0:(llog_cat.c:391:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 5, last_idx 6 00080000:10000000:3.0:1777051491.445254:0:109174:0:(osd_handler.c:5577:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3f:0x0] (8/32) registered 00010000:00080000:2.0:1777051491.449696:0:109174:0:(ldlm_lib.c:3036:target_recovery_init()) RECOVERY: service lustre-MDT0000, 3 recoverable clients, last_transno 30064771258 00010000:00080000:1.0:1777051491.454497:0:109212:0:(ldlm_lib.c:2839:target_recovery_thread()) lustre-MDT0000: started recovery thread pid 109212 00010000:02000000:1.0:1777051491.454514:0:109212:0:(ldlm_lib.c:2321:target_recovery_overseer()) lustre-MDT0000: in recovery but waiting for the first client to connect 00000020:01000004:2.0:1777051491.454649:0:109174:0:(tgt_mount.c:296:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1777051491.454672:0:109174:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.146@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1777051491.454697:0:109174:0:(tgt_mount.c:2411:server_fill_super_common()) Server sb, dev=47 00000080:00000004:2.0:1777051491.454725:0:109174:0:(super25.c:187:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:2.0:1777051491.456149:0:109174:0:(tgt_mount.c:2297:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1777051491.456542:0:109174:0:(tgt_mount.c:2312:is_cmd_supported()) ioctl cmd=81009431 00010000:00080000:1.0:1777051491.464568:0:109212:0:(ldlm_lib.c:2531:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 3 abort 0 expired 0 00010000:00080000:1.0:1777051491.464578:0:109212:0:(ldlm_lib.c:2531:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 3 abort 0 expired 0 00010000:00010000:3.0:1777051491.478350:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1777051492.248525:0:104226:0:(llog.c:801:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1777051492.248536:0:104226:0:(llog_cat.c:158:llog_cat_process_common()) processing log [0x1:0x12:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1777051492.248568:0:104226:0:(llog.c:858:llog_process_thread()) stop processing plain [0x1:0x12:0x0] index 11 count 9 00000040:00080000:1.0:1777051492.248578:0:104226:0:(llog.c:858:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000040:00080000:1.0:1777051492.440736:0:109205:0:(llog.c:801:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:1.0:1777051492.440746:0:109205:0:(llog_cat.c:158:llog_cat_process_common()) processing log [0x1:0x2b:0x0] at index 6 of catalog [0xa:0x7:0x0] 00010000:00010000:1.0:1777051492.446519:0:109205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99d953285a00/0x85f51a6b96717881 lrc: 3/0,1 mode: --/EX res: [0x2000032e3:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 109205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051492.446560:0:109205:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d953285a00/0x85f51a6b96717881 lrc: 3/0,1 mode: EX/EX res: [0x2000032e3:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 109205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051492.446587:0:109205:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d953285a00/0x85f51a6b96717881 lrc: 3/0,1 mode: EX/EX res: [0x2000032e3:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 109205 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1777051492.446610:0:109205:0:(llog.c:858:llog_process_thread()) stop processing plain [0x1:0x2b:0x0] index 12 count 9 00000040:00080000:1.0:1777051492.446626:0:109205:0:(llog.c:858:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00010000:00010000:3.0:1777051492.502653:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1777051492.886328:0:6577:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1777051492.886336:0:6577:0:(mgc_request.c:1799:mgc_process_log()) Process log lustre-mdtir-ffff99da7b5f9800 from 35 10000000:01000000:2.0:1777051492.886343:0:6577:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1777051492.886418:0:6577:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.146@tcp lock: ffff99d950711e00/0x85f51a6b96717888 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051492.886450:0:6577:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.146@tcp lock: ffff99d950711e00/0x85f51a6b96717888 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051492.886469:0:6577:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.146@tcp lock: ffff99d950711e00/0x85f51a6b96717888 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051492.886511:0:6577:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94f16a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452705792:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1777051492.886634:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051492.886732:0:6577:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d95cf03300 going to sleep for 11 seconds 00000100:00100000:0.0:1777051492.886748:0:109181:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452705792 00000100:00100000:0.0:1777051492.886760:0:109181:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452705792 00000100:00100000:0.0:1777051492.886859:0:109181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1777051492.886880:0:109181:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7d97bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9351a01-5b0e-4470-97fd-58b9b4b312a2+9:6577:x1863365452705792:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1777051492.886934:0:109181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051492.886959:0:109181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99da7d774200/0x85f51a6b9671788f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x85f51a6b96717888 expref: -99 pid: 109181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051492.887007:0:109181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99da7d774200/0x85f51a6b9671788f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x85f51a6b96717888 expref: 10 pid: 109181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051492.887034:0:109181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99da7d774200/0x85f51a6b9671788f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b96717888 expref: 10 pid: 109181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051492.887051:0:109181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99da7d774200, rc 0) 00000100:00100000:0.0:1777051492.887128:0:109181:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7d97bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9351a01-5b0e-4470-97fd-58b9b4b312a2+10:6577:x1863365452705792:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 253us (498us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051492.887137:0:109181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1777051492.887524:0:6577:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94f16a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452705792:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1777051492.887558:0:6577:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.146@tcp lock: ffff99d950711e00/0x85f51a6b96717888 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b9671788f expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051492.887581:0:6577:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.146@tcp lock: ffff99d950711e00/0x85f51a6b96717888 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x85f51a6b9671788f expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051492.887672:0:6577:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94f16a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452705920:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1777051492.887759:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051492.887816:0:6577:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d95cf03300 going to sleep for 11 seconds 00000100:00100000:0.0:1777051492.887886:0:109182:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452705920 00000100:00100000:0.0:1777051492.887896:0:109182:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452705920 00000100:00100000:0.0:1777051492.887995:0:109182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1777051492.888013:0:109182:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7d979450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9351a01-5b0e-4470-97fd-58b9b4b312a2+10:6577:x1863365452705920:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1777051492.888041:0:109182:0:(mgs_nids.c:912:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1777051492.888071:0:109182:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1777051492.888078:0:109182:0:(mgs_nids.c:316:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 35 00000100:00100000:0.0:1777051492.888358:0:109182:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7d979450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9351a01-5b0e-4470-97fd-58b9b4b312a2+10:6577:x1863365452705920:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 349us (597us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051492.888375:0:109182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1777051492.888393:0:6577:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94f16a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452705920:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1777051492.888478:0:6577:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.201.146@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1777051492.888510:0:6577:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff99d950711e00/0x85f51a6b96717888 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b9671788f expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051492.888529:0:6577:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.146@tcp lock: ffff99d950711e00/0x85f51a6b96717888 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b9671788f expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1777051492.888546:0:6577:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1777051492.888550:0:6577:0:(mgc_request.c:1799:mgc_process_log()) Process log lustre-client-ffff99da7dbcc000 from 64 10000000:01000000:1.0:1777051492.888556:0:6577:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1777051492.888590:0:6577:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.146@tcp lock: ffff99d953285c00/0x85f51a6b96717896 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051492.888605:0:6577:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.146@tcp lock: ffff99d953285c00/0x85f51a6b96717896 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051492.888621:0:6577:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.146@tcp lock: ffff99d953285c00/0x85f51a6b96717896 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051492.888650:0:6577:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955ebf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452706048:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1777051492.888721:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051492.889145:0:6577:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d941aec900 going to sleep for 11 seconds 00000100:00100000:0.0:1777051492.889313:0:109186:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452706048 00000100:00100000:0.0:1777051492.889322:0:109186:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452706048 00000100:00100000:0.0:1777051492.889380:0:109186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1777051492.889395:0:109186:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7d97b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f9351a01-5b0e-4470-97fd-58b9b4b312a2+10:6577:x1863365452706048:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1777051492.889410:0:109186:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051492.889427:0:109186:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99da7d775600/0x85f51a6b9671789d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x85f51a6b96717896 expref: -99 pid: 109186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051492.889458:0:109186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99da7d775600/0x85f51a6b9671789d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x85f51a6b96717896 expref: 11 pid: 109186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051492.889476:0:109186:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99da7d775600/0x85f51a6b9671789d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b96717896 expref: 11 pid: 109186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051492.889490:0:109186:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99da7d775600, rc 0) 00000100:00100000:0.0:1777051492.889557:0:109186:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7d97b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f9351a01-5b0e-4470-97fd-58b9b4b312a2+11:6577:x1863365452706048:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 165us (835us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051492.889571:0:109186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1777051492.889624:0:6577:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955ebf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452706048:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1777051492.889650:0:6577:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.146@tcp lock: ffff99d953285c00/0x85f51a6b96717896 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b9671789d expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051492.889668:0:6577:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.146@tcp lock: ffff99d953285c00/0x85f51a6b96717896 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x85f51a6b9671789d expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051492.889756:0:6577:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955ebf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452706176:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1777051492.889807:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051492.889860:0:6577:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d941aec900 going to sleep for 11 seconds 00000100:00100000:0.0:1777051492.889937:0:109181:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452706176 00000100:00100000:0.0:1777051492.889946:0:109181:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452706176 00000100:00100000:0.0:1777051492.890003:0:109181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1777051492.890017:0:109181:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7d979850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9351a01-5b0e-4470-97fd-58b9b4b312a2+11:6577:x1863365452706176:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1777051492.890232:0:109181:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7d979850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9351a01-5b0e-4470-97fd-58b9b4b312a2+11:6577:x1863365452706176:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 180us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051492.890258:0:6577:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955ebf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452706176:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1777051492.890259:0:109181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1777051492.890323:0:6577:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955ebf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452706304:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1777051492.890397:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051492.890451:0:6577:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d941aec900 going to sleep for 11 seconds 00000100:00100000:3.0:1777051492.890553:0:109182:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452706304 00000100:00100000:3.0:1777051492.890564:0:109182:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452706304 00000100:00100000:3.0:1777051492.890620:0:109182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1777051492.890637:0:109182:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7d97b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9351a01-5b0e-4470-97fd-58b9b4b312a2+11:6577:x1863365452706304:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1777051492.891708:0:109182:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7d97b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9351a01-5b0e-4470-97fd-58b9b4b312a2+11:6577:x1863365452706304:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1073us (1307us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051492.891726:0:109182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1777051492.891731:0:6577:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955ebf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452706304:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1777051492.893743:0:109284:0:(llog.c:858:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 63 00000020:01000000:1.0:1777051492.893895:0:6577:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 64-63 (rc=0) 10000000:01000000:1.0:1777051492.893966:0:6577:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.201.146@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1777051492.893979:0:6577:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff99d953285c00/0x85f51a6b96717896 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b9671789d expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051492.893995:0:6577:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.146@tcp lock: ffff99d953285c00/0x85f51a6b96717896 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b9671789d expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1777051492.894008:0:6577:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1777051492.894013:0:6577:0:(mgc_request.c:1799:mgc_process_log()) Process log lustre-mdtir-ffff99da7dbcc000 from 32 10000000:01000000:1.0:1777051492.894018:0:6577:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1777051492.894080:0:6577:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.146@tcp lock: ffff99d953284e00/0x85f51a6b967178a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051492.894104:0:6577:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.146@tcp lock: ffff99d953284e00/0x85f51a6b967178a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051492.894120:0:6577:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.146@tcp lock: ffff99d953284e00/0x85f51a6b967178a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051492.894150:0:6577:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955ebf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452706432:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1777051492.894254:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051492.894315:0:6577:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d941aeccc0 going to sleep for 11 seconds 00000100:00100000:0.0:1777051492.894356:0:109186:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452706432 00000100:00100000:0.0:1777051492.894370:0:109186:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452706432 00000100:00100000:0.0:1777051492.894435:0:109186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1777051492.894453:0:109186:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7d97b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f9351a01-5b0e-4470-97fd-58b9b4b312a2+11:6577:x1863365452706432:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1777051492.894469:0:109186:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051492.894489:0:109186:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99da7d775e00/0x85f51a6b967178ab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x85f51a6b967178a4 expref: -99 pid: 109186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051492.894533:0:109186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99da7d775e00/0x85f51a6b967178ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x85f51a6b967178a4 expref: 12 pid: 109186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051492.894568:0:109186:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99da7d775e00/0x85f51a6b967178ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b967178a4 expref: 12 pid: 109186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051492.894583:0:109186:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99da7d775e00, rc 0) 00000100:00100000:0.0:1777051492.894662:0:109186:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7d97b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f9351a01-5b0e-4470-97fd-58b9b4b312a2+12:6577:x1863365452706432:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 212us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051492.894674:0:109186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1777051492.894764:0:6577:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955ebf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452706432:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1777051492.894789:0:6577:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.146@tcp lock: ffff99d953284e00/0x85f51a6b967178a4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b967178ab expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051492.894804:0:6577:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.146@tcp lock: ffff99d953284e00/0x85f51a6b967178a4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x85f51a6b967178ab expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051492.894874:0:6577:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955ebf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452706560:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1777051492.894971:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051492.895018:0:6577:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d941aeccc0 going to sleep for 11 seconds 00000100:00100000:0.0:1777051492.895135:0:109181:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452706560 00000100:00100000:0.0:1777051492.895144:0:109181:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452706560 00000100:00100000:0.0:1777051492.895519:0:109181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1777051492.895536:0:109181:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7d97ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9351a01-5b0e-4470-97fd-58b9b4b312a2+12:6577:x1863365452706560:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1777051492.895562:0:109181:0:(mgs_nids.c:912:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1777051492.895588:0:109181:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1777051492.895596:0:109181:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:0.0:1777051492.895603:0:109181:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:0.0:1777051492.895608:0:109181:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:0.0:1777051492.895613:0:109181:0:(mgs_nids.c:316:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 35 00000100:00100000:0.0:1777051492.895792:0:109181:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7d97ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9351a01-5b0e-4470-97fd-58b9b4b312a2+12:6577:x1863365452706560:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 257us (817us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051492.896046:0:6577:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955ebf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452706560:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1777051492.896141:0:109181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 10000000:01000000:2.0:1777051492.896187:0:6577:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.201.146@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1777051492.896201:0:6577:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff99d953284e00/0x85f51a6b967178a4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b967178ab expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051492.896217:0:6577:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.146@tcp lock: ffff99d953284e00/0x85f51a6b967178a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b967178ab expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1777051492.896233:0:6577:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:2.0:1777051492.896235:0:6577:0:(mgc_request.c:1799:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 59 10000000:01000000:2.0:1777051492.896238:0:6577:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1777051492.896260:0:6577:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.146@tcp lock: ffff99d950710a00/0x85f51a6b967178b2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051492.896268:0:6577:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.146@tcp lock: ffff99d950710a00/0x85f51a6b967178b2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051492.896278:0:6577:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.146@tcp lock: ffff99d950710a00/0x85f51a6b967178b2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051492.896294:0:6577:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94f16ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452706688:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1777051492.896336:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051492.896397:0:6577:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d95cf03300 going to sleep for 11 seconds 00000100:00100000:0.0:1777051492.897098:0:109182:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452706688 00000100:00100000:0.0:1777051492.897107:0:109182:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452706688 00000100:00100000:0.0:1777051492.897182:0:109182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1777051492.897265:0:109182:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7d97a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9351a01-5b0e-4470-97fd-58b9b4b312a2+12:6577:x1863365452706688:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1777051492.897281:0:109182:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051492.897298:0:109182:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99da7d775400/0x85f51a6b967178b9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x85f51a6b967178b2 expref: -99 pid: 109182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051492.897325:0:109182:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99da7d775400/0x85f51a6b967178b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x85f51a6b967178b2 expref: 13 pid: 109182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051492.897341:0:109182:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99da7d775400/0x85f51a6b967178b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b967178b2 expref: 13 pid: 109182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051492.897355:0:109182:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99da7d775400, rc 0) 00000100:00100000:0.0:1777051492.897442:0:109182:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7d97a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9351a01-5b0e-4470-97fd-58b9b4b312a2+13:6577:x1863365452706688:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 247us (1104us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051492.897454:0:109182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1777051492.897526:0:6577:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94f16ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452706688:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1777051492.897550:0:6577:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.146@tcp lock: ffff99d950710a00/0x85f51a6b967178b2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b967178b9 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051492.897568:0:6577:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.146@tcp lock: ffff99d950710a00/0x85f51a6b967178b2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x85f51a6b967178b9 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051492.897636:0:6577:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955ebf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452706816:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1777051492.897670:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051492.897707:0:6577:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d941aec780 going to sleep for 11 seconds 00000100:00100000:2.0:1777051492.897747:0:109186:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452706816 00000100:00100000:2.0:1777051492.897757:0:109186:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452706816 00000100:00100000:2.0:1777051492.897808:0:109186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1777051492.897820:0:109186:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7d979c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f9351a01-5b0e-4470-97fd-58b9b4b312a2+13:6577:x1863365452706816:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1777051492.898030:0:109186:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7d979c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f9351a01-5b0e-4470-97fd-58b9b4b312a2+13:6577:x1863365452706816:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 209us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051492.898043:0:109186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1777051492.898103:0:6577:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955ebf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452706816:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1777051492.898151:0:6577:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955ebf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452706944:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1777051492.898290:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051492.898357:0:6577:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d941aec780 going to sleep for 11 seconds 00000100:00100000:3.0:1777051492.898361:0:109181:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452706944 00000100:00100000:3.0:1777051492.898370:0:109181:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452706944 00000100:00100000:3.0:1777051492.898427:0:109181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1777051492.898441:0:109181:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7d978050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9351a01-5b0e-4470-97fd-58b9b4b312a2+13:6577:x1863365452706944:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1777051492.903376:0:109181:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7d978050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9351a01-5b0e-4470-97fd-58b9b4b312a2+13:6577:x1863365452706944:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 4933us (5085us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051492.903393:0:109181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1777051492.903430:0:6577:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955ebf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452706944:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1777051492.906351:0:109285:0:(llog.c:858:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 64768 count 58 00000020:01000000:3.0:1777051492.906486:0:6577:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 59-58 (rc=0) 10000000:01000000:3.0:1777051492.906525:0:6577:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.201.146@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1777051492.906536:0:6577:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff99d950710a00/0x85f51a6b967178b2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b967178b9 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051492.906552:0:6577:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.146@tcp lock: ffff99d950710a00/0x85f51a6b967178b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b967178b9 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1777051492.906565:0:6577:0:(mgc_request.c:611:do_requeue()) updating log lustre-barrier 10000000:01000000:3.0:1777051492.906569:0:6577:0:(mgc_request.c:1799:mgc_process_log()) Process log lustre-barrier-ffff99da7dbcc000 from 1 10000000:01000000:3.0:1777051492.906573:0:6577:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1777051492.906607:0:6577:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.146@tcp lock: ffff99d94e6e6200/0x85f51a6b967178c0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051492.906621:0:6577:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.146@tcp lock: ffff99d94e6e6200/0x85f51a6b967178c0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051492.906646:0:6577:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.146@tcp lock: ffff99d94e6e6200/0x85f51a6b967178c0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051492.906674:0:6577:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d944071f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452707072:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1777051492.906727:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051492.906788:0:6577:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d941b0f540 going to sleep for 11 seconds 00000100:00100000:1.0:1777051492.906826:0:109182:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452707072 00000100:00100000:1.0:1777051492.906836:0:109182:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452707072 00000100:00100000:1.0:1777051492.906892:0:109182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1777051492.906934:0:109182:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7d97a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9351a01-5b0e-4470-97fd-58b9b4b312a2+13:6577:x1863365452707072:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1777051492.906950:0:109182:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777051492.906969:0:109182:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d953285600/0x85f51a6b967178c7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x85f51a6b967178c0 expref: -99 pid: 109182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051492.906999:0:109182:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d953285600/0x85f51a6b967178c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x85f51a6b967178c0 expref: 14 pid: 109182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051492.907016:0:109182:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d953285600/0x85f51a6b967178c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b967178c0 expref: 14 pid: 109182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051492.907029:0:109182:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d953285600, rc 0) 00000100:00100000:1.0:1777051492.907095:0:109182:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7d97a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9351a01-5b0e-4470-97fd-58b9b4b312a2+14:6577:x1863365452707072:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 192us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051492.907107:0:109182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1777051492.907170:0:6577:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d944071f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452707072:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1777051492.907192:0:6577:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.146@tcp lock: ffff99d94e6e6200/0x85f51a6b967178c0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b967178c7 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051492.907209:0:6577:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.146@tcp lock: ffff99d94e6e6200/0x85f51a6b967178c0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x85f51a6b967178c7 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1777051492.907230:0:6577:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.201.146@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1777051492.907239:0:6577:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff99d94e6e6200/0x85f51a6b967178c0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b967178c7 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051492.907251:0:6577:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.146@tcp lock: ffff99d94e6e6200/0x85f51a6b967178c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b967178c7 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1777051492.907262:0:6577:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1777051492.907267:0:6577:0:(mgc_request.c:1799:mgc_process_log()) Process log params-ffff99da7dbcc000 from 43 10000000:01000000:3.0:1777051492.907272:0:6577:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1777051492.907298:0:6577:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.146@tcp lock: ffff99d94e6e6c00/0x85f51a6b967178ce lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051492.907311:0:6577:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.146@tcp lock: ffff99d94e6e6c00/0x85f51a6b967178ce lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051492.907340:0:6577:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.146@tcp lock: ffff99d94e6e6c00/0x85f51a6b967178ce lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051492.907363:0:6577:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d944071f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452707200:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1777051492.907408:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051492.907445:0:6577:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d941b0f540 going to sleep for 11 seconds 00000100:00100000:2.0:1777051492.907501:0:109186:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452707200 00000100:00100000:2.0:1777051492.907512:0:109186:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452707200 00000100:00100000:2.0:1777051492.907571:0:109186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1777051492.907585:0:109186:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7d97a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f9351a01-5b0e-4470-97fd-58b9b4b312a2+14:6577:x1863365452707200:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1777051492.907605:0:109186:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051492.907624:0:109186:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d950711600/0x85f51a6b967178d5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x85f51a6b967178ce expref: -99 pid: 109186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051492.907679:0:109186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d950711600/0x85f51a6b967178d5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x85f51a6b967178ce expref: 15 pid: 109186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051492.907698:0:109186:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d950711600/0x85f51a6b967178d5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b967178ce expref: 15 pid: 109186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051492.907707:0:109186:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d950711600, rc 0) 00000100:00100000:2.0:1777051492.907760:0:109186:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7d97a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f9351a01-5b0e-4470-97fd-58b9b4b312a2+15:6577:x1863365452707200:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 179us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051492.907768:0:109186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1777051492.907832:0:6577:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d944071f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452707200:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1777051492.907854:0:6577:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.146@tcp lock: ffff99d94e6e6c00/0x85f51a6b967178ce lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b967178d5 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051492.907872:0:6577:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.146@tcp lock: ffff99d94e6e6c00/0x85f51a6b967178ce lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x85f51a6b967178d5 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051492.908001:0:6577:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d944071f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452707328:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1777051492.908053:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051492.908103:0:6577:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d941b0f540 going to sleep for 11 seconds 00000100:00100000:1.0:1777051492.908444:0:109181:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452707328 00000100:00100000:1.0:1777051492.908454:0:109181:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452707328 00000100:00100000:1.0:1777051492.908501:0:109181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1777051492.908513:0:109181:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7d978450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9351a01-5b0e-4470-97fd-58b9b4b312a2+15:6577:x1863365452707328:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1777051492.908649:0:109181:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7d978450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9351a01-5b0e-4470-97fd-58b9b4b312a2+15:6577:x1863365452707328:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 136us (594us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051492.908663:0:109181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1777051492.908749:0:6577:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d944071f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452707328:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1777051492.908801:0:6577:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d944071f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452707456:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1777051492.908871:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051492.908951:0:6577:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d941b0f540 going to sleep for 11 seconds 00000100:00100000:1.0:1777051492.908999:0:109182:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452707456 00000100:00100000:1.0:1777051492.909008:0:109182:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452707456 00000100:00100000:1.0:1777051492.909063:0:109182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1777051492.909369:0:109182:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fac5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9351a01-5b0e-4470-97fd-58b9b4b312a2+15:6577:x1863365452707456:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1777051492.909526:0:109182:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fac5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9351a01-5b0e-4470-97fd-58b9b4b312a2+15:6577:x1863365452707456:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 159us (650us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051492.909540:0:109182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1777051492.909878:0:6577:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d944071f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452707456:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1777051492.913139:0:109286:0:(llog.c:858:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 43 00000020:01000000:3.0:1777051492.913341:0:6577:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 43-42 (rc=0) 10000000:01000000:3.0:1777051492.913398:0:6577:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.201.146@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1777051492.913411:0:6577:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff99d94e6e6c00/0x85f51a6b967178ce lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b967178d5 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051492.913426:0:6577:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.146@tcp lock: ffff99d94e6e6c00/0x85f51a6b967178ce lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b967178d5 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1777051492.913437:0:6577:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1777051492.913440:0:6577:0:(mgc_request.c:1799:mgc_process_log()) Process log lustre-client-ffff99d941839800 from 64 10000000:01000000:3.0:1777051492.913444:0:6577:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1777051492.913474:0:6577:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.146@tcp lock: ffff99d94e6e6400/0x85f51a6b967178dc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051492.913483:0:6577:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.146@tcp lock: ffff99d94e6e6400/0x85f51a6b967178dc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051492.913493:0:6577:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.146@tcp lock: ffff99d94e6e6400/0x85f51a6b967178dc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051492.913514:0:6577:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d944070e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452707584:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1777051492.913569:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051492.913624:0:6577:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d941b0f600 going to sleep for 11 seconds 00000100:00100000:2.0:1777051492.914337:0:109186:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452707584 00000100:00100000:2.0:1777051492.914348:0:109186:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452707584 00000100:00100000:2.0:1777051492.914417:0:109186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1777051492.914438:0:109186:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fac4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f9351a01-5b0e-4470-97fd-58b9b4b312a2+15:6577:x1863365452707584:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1777051492.914455:0:109186:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051492.914474:0:109186:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d950711400/0x85f51a6b967178e3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x85f51a6b967178dc expref: -99 pid: 109186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051492.914508:0:109186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d950711400/0x85f51a6b967178e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x85f51a6b967178dc expref: 16 pid: 109186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051492.914527:0:109186:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d950711400/0x85f51a6b967178e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b967178dc expref: 16 pid: 109186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051492.914542:0:109186:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d950711400, rc 0) 00000100:00100000:2.0:1777051492.914624:0:109186:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fac4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f9351a01-5b0e-4470-97fd-58b9b4b312a2+16:6577:x1863365452707584:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 191us (1052us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051492.914638:0:109186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1777051492.914692:0:6577:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d944070e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452707584:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1777051492.914720:0:6577:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.146@tcp lock: ffff99d94e6e6400/0x85f51a6b967178dc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b967178e3 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051492.914739:0:6577:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.146@tcp lock: ffff99d94e6e6400/0x85f51a6b967178dc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x85f51a6b967178e3 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051492.915122:0:6577:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d944070e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452707712:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1777051492.915168:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051492.915237:0:6577:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d941b0f600 going to sleep for 11 seconds 00000100:00100000:1.0:1777051492.915430:0:109181:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452707712 00000100:00100000:1.0:1777051492.915439:0:109181:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452707712 00000100:00100000:1.0:1777051492.915496:0:109181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1777051492.915509:0:109181:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942db3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9351a01-5b0e-4470-97fd-58b9b4b312a2+16:6577:x1863365452707712:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1777051492.915645:0:109181:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942db3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9351a01-5b0e-4470-97fd-58b9b4b312a2+16:6577:x1863365452707712:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 136us (473us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051492.915660:0:109181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1777051492.915822:0:6577:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d944070e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452707712:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1777051492.915880:0:6577:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d944070e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452707840:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1777051492.915993:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051492.916065:0:6577:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d941b0f600 going to sleep for 11 seconds 00000100:00100000:1.0:1777051492.916097:0:109182:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452707840 00000100:00100000:1.0:1777051492.916105:0:109182:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452707840 00000100:00100000:1.0:1777051492.916148:0:109182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1777051492.916157:0:109182:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942db3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9351a01-5b0e-4470-97fd-58b9b4b312a2+16:6577:x1863365452707840:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1777051492.916302:0:109182:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942db3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9351a01-5b0e-4470-97fd-58b9b4b312a2+16:6577:x1863365452707840:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 121us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051492.916318:0:109182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1777051492.916517:0:6577:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d944070e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452707840:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1777051492.918301:0:109287:0:(llog.c:858:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 63 00000020:01000000:2.0:1777051492.918442:0:6577:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 64-63 (rc=0) 10000000:01000000:2.0:1777051492.918476:0:6577:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.201.146@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1777051492.918487:0:6577:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff99d94e6e6400/0x85f51a6b967178dc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b967178e3 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051492.918529:0:6577:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.146@tcp lock: ffff99d94e6e6400/0x85f51a6b967178dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b967178e3 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1777051492.918542:0:6577:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:2.0:1777051492.918545:0:6577:0:(mgc_request.c:1799:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:2.0:1777051492.918550:0:6577:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1777051492.918582:0:6577:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.146@tcp lock: ffff99d950711a00/0x85f51a6b967178ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051492.918591:0:6577:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.146@tcp lock: ffff99d950711a00/0x85f51a6b967178ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051492.918600:0:6577:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.146@tcp lock: ffff99d950711a00/0x85f51a6b967178ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051492.918618:0:6577:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94f16a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452707968:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1777051492.918655:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051492.918701:0:6577:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da70bd0600 going to sleep for 11 seconds 00000100:00100000:3.0:1777051492.918738:0:109184:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452707968 00000100:00100000:3.0:1777051492.918748:0:109184:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452707968 00000100:00100000:3.0:1777051492.918807:0:109184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1777051492.918819:0:109184:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942db0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f9351a01-5b0e-4470-97fd-58b9b4b312a2+16:6577:x1863365452707968:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1777051492.918832:0:109184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777051492.918846:0:109184:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d94e6e6600/0x85f51a6b967178f1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x85f51a6b967178ea expref: -99 pid: 109184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051492.918870:0:109184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d94e6e6600/0x85f51a6b967178f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x85f51a6b967178ea expref: 17 pid: 109184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051492.918886:0:109184:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d94e6e6600/0x85f51a6b967178f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b967178ea expref: 17 pid: 109184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051492.918899:0:109184:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d94e6e6600, rc 0) 00000100:00100000:3.0:1777051492.918973:0:109184:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942db0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f9351a01-5b0e-4470-97fd-58b9b4b312a2+17:6577:x1863365452707968:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 156us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051492.918981:0:109184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1777051492.919362:0:6577:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94f16a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452707968:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1777051492.919383:0:6577:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.146@tcp lock: ffff99d950711a00/0x85f51a6b967178ea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b967178f1 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051492.919397:0:6577:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.146@tcp lock: ffff99d950711a00/0x85f51a6b967178ea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x85f51a6b967178f1 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051492.919467:0:6577:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94f16a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452708096:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1777051492.919537:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051492.919581:0:6577:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da70bd0600 going to sleep for 11 seconds 00000100:00100000:3.0:1777051492.919813:0:109181:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452708096 00000100:00100000:3.0:1777051492.919823:0:109181:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452708096 00000100:00100000:3.0:1777051492.919896:0:109181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1777051492.919950:0:109181:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d941b74050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9351a01-5b0e-4470-97fd-58b9b4b312a2+17:6577:x1863365452708096:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1777051492.920128:0:109181:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d941b74050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9351a01-5b0e-4470-97fd-58b9b4b312a2+17:6577:x1863365452708096:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 184us (588us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051492.920144:0:109181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1777051492.920225:0:6577:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94f16a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452708096:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1777051492.920282:0:6577:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d944070e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452708224:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1777051492.920357:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051492.920397:0:6577:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d941b0f3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1777051492.920476:0:109182:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452708224 00000100:00100000:2.0:1777051492.920503:0:109182:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452708224 00000100:00100000:2.0:1777051492.920575:0:109182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1777051492.920590:0:109182:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d941b75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9351a01-5b0e-4470-97fd-58b9b4b312a2+17:6577:x1863365452708224:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1777051492.922143:0:109182:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d941b75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9351a01-5b0e-4470-97fd-58b9b4b312a2+17:6577:x1863365452708224:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1553us (1783us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051492.922158:0:109182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1777051492.922212:0:6577:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d944070e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452708224:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1777051492.923579:0:109288:0:(llog.c:858:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 11 00000020:01000000:3.0:1777051492.923678:0:6577:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:3.0:1777051492.923726:0:6577:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.201.146@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1777051492.923740:0:6577:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff99d950711a00/0x85f51a6b967178ea lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b967178f1 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051492.923766:0:6577:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.146@tcp lock: ffff99d950711a00/0x85f51a6b967178ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b967178f1 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1777051492.923781:0:6577:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1777051492.923784:0:6577:0:(mgc_request.c:1799:mgc_process_log()) Process log params-ffff99d941839800 from 43 10000000:01000000:3.0:1777051492.923788:0:6577:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1777051492.923821:0:6577:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.146@tcp lock: ffff99d94e6e7800/0x85f51a6b967178f8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051492.923835:0:6577:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.146@tcp lock: ffff99d94e6e7800/0x85f51a6b967178f8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051492.923849:0:6577:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.146@tcp lock: ffff99d94e6e7800/0x85f51a6b967178f8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051492.923875:0:6577:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d944070e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452708352:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1777051492.923966:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051492.924007:0:6577:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d941b0f540 going to sleep for 11 seconds 00000100:00100000:2.0:1777051492.924623:0:109180:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452708352 00000100:00100000:2.0:1777051492.924633:0:109180:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452708352 00000100:00100000:2.0:1777051492.925000:0:109180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1777051492.925019:0:109180:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d941b77050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9351a01-5b0e-4470-97fd-58b9b4b312a2+17:6577:x1863365452708352:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1777051492.925034:0:109180:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051492.925055:0:109180:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d94ffbc600/0x85f51a6b967178ff lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x85f51a6b967178f8 expref: -99 pid: 109180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051492.925088:0:109180:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d94ffbc600/0x85f51a6b967178ff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x85f51a6b967178f8 expref: 18 pid: 109180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051492.925107:0:109180:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d94ffbc600/0x85f51a6b967178ff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b967178f8 expref: 18 pid: 109180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051492.925123:0:109180:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d94ffbc600, rc 0) 00000100:00100000:3.0:1777051492.929419:0:6577:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d944070e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452708352:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1777051492.929445:0:6577:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.146@tcp lock: ffff99d94e6e7800/0x85f51a6b967178f8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b967178ff expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051492.929471:0:6577:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.146@tcp lock: ffff99d94e6e7800/0x85f51a6b967178f8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x85f51a6b967178ff expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051492.929571:0:6577:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d944070e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452708480:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1777051492.930082:0:109180:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d941b77050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9351a01-5b0e-4470-97fd-58b9b4b312a2+18:6577:x1863365452708352:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 5064us (6115us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051492.930098:0:109180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1777051492.930114:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051492.931339:0:109181:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452708480 00000100:00100000:3.0:1777051492.931349:0:109181:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452708480 00000100:00100000:3.0:1777051492.931424:0:109181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1777051492.931440:0:109181:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d941b77850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9351a01-5b0e-4470-97fd-58b9b4b312a2+18:6577:x1863365452708480:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1777051492.931487:0:6577:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d941b0f540 going to sleep for 11 seconds 00000100:00100000:3.0:1777051492.931586:0:109181:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d941b77850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9351a01-5b0e-4470-97fd-58b9b4b312a2+18:6577:x1863365452708480:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 149us (1475us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051492.931599:0:109181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1777051492.931654:0:6577:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d944070e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452708480:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1777051492.931707:0:6577:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94f169180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452708608:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1777051492.931775:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051492.931822:0:6577:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da70bd0780 going to sleep for 11 seconds 00000100:00100000:1.0:1777051492.931872:0:109182:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452708608 00000100:00100000:1.0:1777051492.931882:0:109182:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452708608 00000100:00100000:1.0:1777051492.931968:0:109182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1777051492.931982:0:109182:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d941b76c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9351a01-5b0e-4470-97fd-58b9b4b312a2+18:6577:x1863365452708608:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1777051492.933107:0:109182:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d941b76c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9351a01-5b0e-4470-97fd-58b9b4b312a2+18:6577:x1863365452708608:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1125us (1329us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051492.933122:0:109182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1777051492.933417:0:6577:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94f169180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452708608:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1777051492.935837:0:109289:0:(llog.c:858:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 43 00000020:01000000:3.0:1777051492.939110:0:6577:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 43-42 (rc=0) 10000000:01000000:3.0:1777051492.939143:0:6577:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.201.146@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1777051492.939156:0:6577:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff99d94e6e7800/0x85f51a6b967178f8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b967178ff expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051492.939175:0:6577:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.146@tcp lock: ffff99d94e6e7800/0x85f51a6b967178f8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b967178ff expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1777051492.939191:0:6577:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1777051492.939240:0:6577:0:(mgc_request.c:1799:mgc_process_log()) Process log lustre-client-ffff99da44f8d000 from 64 10000000:01000000:3.0:1777051492.939248:0:6577:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1777051492.939310:0:6577:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.146@tcp lock: ffff99d94e6e6000/0x85f51a6b96717906 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051492.939325:0:6577:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.146@tcp lock: ffff99d94e6e6000/0x85f51a6b96717906 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051492.939340:0:6577:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.146@tcp lock: ffff99d94e6e6000/0x85f51a6b96717906 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051492.939370:0:6577:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d944071500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452708736:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1777051492.939437:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051492.939506:0:109180:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452708736 00000100:00100000:3.0:1777051492.939511:0:6577:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d941b0f3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1777051492.939515:0:109180:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452708736 00000100:00100000:2.0:1777051492.939593:0:109180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1777051492.939608:0:109180:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d941b74c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9351a01-5b0e-4470-97fd-58b9b4b312a2+18:6577:x1863365452708736:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1777051492.939626:0:109180:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051492.939647:0:109180:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d94ffbdc00/0x85f51a6b9671790d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x85f51a6b96717906 expref: -99 pid: 109180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051492.939721:0:109180:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d94ffbdc00/0x85f51a6b9671790d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x85f51a6b96717906 expref: 19 pid: 109180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051492.939733:0:109180:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d94ffbdc00/0x85f51a6b9671790d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b96717906 expref: 19 pid: 109180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051492.939750:0:109180:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d94ffbdc00, rc 0) 00000100:00100000:2.0:1777051492.939815:0:109180:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d941b74c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9351a01-5b0e-4470-97fd-58b9b4b312a2+19:6577:x1863365452708736:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 209us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051492.939827:0:109180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1777051492.939888:0:6577:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d944071500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452708736:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1777051492.939944:0:6577:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.146@tcp lock: ffff99d94e6e6000/0x85f51a6b96717906 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b9671790d expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051492.939964:0:6577:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.146@tcp lock: ffff99d94e6e6000/0x85f51a6b96717906 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x85f51a6b9671790d expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051492.940076:0:6577:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d944071500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452708864:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1777051492.940128:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051492.940178:0:109181:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452708864 00000100:00100000:3.0:1777051492.940186:0:109181:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452708864 00000100:00100000:3.0:1777051492.940264:0:109181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1777051492.940280:0:109181:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d941b76050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9351a01-5b0e-4470-97fd-58b9b4b312a2+19:6577:x1863365452708864:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1777051492.940505:0:109181:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d941b76050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9351a01-5b0e-4470-97fd-58b9b4b312a2+19:6577:x1863365452708864:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 228us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051492.940519:0:109181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1777051492.940657:0:6577:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d941b0f3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1777051492.940683:0:6577:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d944071500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452708864:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1777051492.940743:0:6577:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d944071500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452708992:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1777051492.940812:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051492.940860:0:6577:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d941b0f3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1777051492.941069:0:109182:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452708992 00000100:00100000:1.0:1777051492.941079:0:109182:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452708992 00000100:00100000:1.0:1777051492.941138:0:109182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1777051492.941153:0:109182:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d941b75050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9351a01-5b0e-4470-97fd-58b9b4b312a2+19:6577:x1863365452708992:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1777051492.941306:0:109182:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d941b75050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9351a01-5b0e-4470-97fd-58b9b4b312a2+19:6577:x1863365452708992:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 153us (490us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051492.941327:0:109182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1777051492.941373:0:6577:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d944071500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452708992:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1777051492.947535:0:109291:0:(llog.c:858:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 63 00000020:01000000:2.0:1777051492.947640:0:6577:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 64-63 (rc=0) 10000000:01000000:2.0:1777051492.948039:0:6577:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.201.146@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1777051492.948053:0:6577:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff99d94e6e6000/0x85f51a6b96717906 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b9671790d expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051492.948072:0:6577:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.146@tcp lock: ffff99d94e6e6000/0x85f51a6b96717906 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b9671790d expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1777051492.948086:0:6577:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1777051492.948091:0:6577:0:(mgc_request.c:1799:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:2.0:1777051492.948097:0:6577:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1777051492.948132:0:6577:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.146@tcp lock: ffff99d94ffbd400/0x85f51a6b96717914 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051492.948148:0:6577:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.146@tcp lock: ffff99d94ffbd400/0x85f51a6b96717914 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051492.948164:0:6577:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.146@tcp lock: ffff99d94ffbd400/0x85f51a6b96717914 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051492.948221:0:6577:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94f169180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452709120:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1777051492.948294:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051492.948350:0:6577:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da70bd0780 going to sleep for 11 seconds 00000100:00100000:0.0:1777051492.949052:0:109180:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452709120 00000100:00100000:0.0:1777051492.949063:0:109180:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452709120 00000100:00100000:0.0:1777051492.949146:0:109180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1777051492.949162:0:109180:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d941b77c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9351a01-5b0e-4470-97fd-58b9b4b312a2+19:6577:x1863365452709120:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1777051492.949180:0:109180:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051492.949491:0:109180:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99da7d774000/0x85f51a6b9671791b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x85f51a6b96717914 expref: -99 pid: 109180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051492.949527:0:109180:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99da7d774000/0x85f51a6b9671791b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x85f51a6b96717914 expref: 20 pid: 109180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051492.949542:0:109180:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99da7d774000/0x85f51a6b9671791b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b96717914 expref: 20 pid: 109180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051492.949561:0:109180:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99da7d774000, rc 0) 00000100:00100000:0.0:1777051492.949632:0:109180:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d941b77c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9351a01-5b0e-4470-97fd-58b9b4b312a2+20:6577:x1863365452709120:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 474us (1342us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051492.949646:0:109180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1777051492.949718:0:6577:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94f169180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452709120:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1777051492.949748:0:6577:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.146@tcp lock: ffff99d94ffbd400/0x85f51a6b96717914 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b9671791b expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051492.949765:0:6577:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.146@tcp lock: ffff99d94ffbd400/0x85f51a6b96717914 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x85f51a6b9671791b expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051492.950181:0:6577:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d944071500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452709248:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1777051492.950225:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051492.950273:0:6577:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d941b0f3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1777051492.950424:0:109186:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452709248 00000100:00100000:0.0:1777051492.950431:0:109186:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452709248 00000100:00100000:0.0:1777051492.950487:0:109186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1777051492.950505:0:109186:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d941b76450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f9351a01-5b0e-4470-97fd-58b9b4b312a2+20:6577:x1863365452709248:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1777051492.950692:0:109186:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d941b76450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f9351a01-5b0e-4470-97fd-58b9b4b312a2+20:6577:x1863365452709248:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 192us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051492.950706:0:109186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1777051492.950775:0:6577:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d944071500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452709248:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1777051492.950873:0:6577:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d944071500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452709376:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1777051492.950988:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051492.951035:0:6577:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d941b0f3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1777051492.951078:0:109182:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452709376 00000100:00100000:1.0:1777051492.951086:0:109182:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452709376 00000100:00100000:1.0:1777051492.951138:0:109182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1777051492.951154:0:109182:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5cdbc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9351a01-5b0e-4470-97fd-58b9b4b312a2+20:6577:x1863365452709376:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1777051492.952604:0:109182:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5cdbc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9351a01-5b0e-4470-97fd-58b9b4b312a2+20:6577:x1863365452709376:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1451us (1615us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051492.952617:0:109182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1777051492.952683:0:6577:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d944071500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452709376:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1777051492.955642:0:109293:0:(llog.c:858:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 14 00000020:01000000:0.0:1777051492.955751:0:6577:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:0.0:1777051492.955815:0:6577:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.201.146@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1777051492.955829:0:6577:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff99d94ffbd400/0x85f51a6b96717914 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b9671791b expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051492.955848:0:6577:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.146@tcp lock: ffff99d94ffbd400/0x85f51a6b96717914 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b9671791b expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1777051492.955863:0:6577:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1777051492.955868:0:6577:0:(mgc_request.c:1799:mgc_process_log()) Process log params-ffff99da44f8d000 from 43 10000000:01000000:0.0:1777051492.955874:0:6577:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1777051492.955944:0:6577:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.146@tcp lock: ffff99da7d775200/0x85f51a6b96717922 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051492.955959:0:6577:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.146@tcp lock: ffff99da7d775200/0x85f51a6b96717922 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051492.955975:0:6577:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.146@tcp lock: ffff99da7d775200/0x85f51a6b96717922 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051492.956005:0:6577:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94ed2ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452709504:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1777051492.956069:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051492.956129:0:6577:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d95c8e10c0 going to sleep for 11 seconds 00000100:00100000:1.0:1777051492.956175:0:109180:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452709504 00000100:00100000:1.0:1777051492.956185:0:109180:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452709504 00000100:00100000:1.0:1777051492.956248:0:109180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1777051492.956268:0:109180:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5cdbd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9351a01-5b0e-4470-97fd-58b9b4b312a2+20:6577:x1863365452709504:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1777051492.956572:0:109180:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777051492.956596:0:109180:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d953284c00/0x85f51a6b96717929 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x85f51a6b96717922 expref: -99 pid: 109180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051492.956634:0:109180:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d953284c00/0x85f51a6b96717929 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x85f51a6b96717922 expref: 21 pid: 109180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051492.956651:0:109180:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d953284c00/0x85f51a6b96717929 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b96717922 expref: 21 pid: 109180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051492.956663:0:109180:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d953284c00, rc 0) 00000100:00100000:1.0:1777051492.956739:0:109180:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5cdbd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9351a01-5b0e-4470-97fd-58b9b4b312a2+21:6577:x1863365452709504:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 477us (669us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051492.956758:0:109180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1777051492.957111:0:6577:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94ed2ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452709504:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1777051492.957139:0:6577:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.146@tcp lock: ffff99da7d775200/0x85f51a6b96717922 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b96717929 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051492.957501:0:6577:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.146@tcp lock: ffff99da7d775200/0x85f51a6b96717922 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x85f51a6b96717929 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051492.959088:0:6577:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955ebf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452709632:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1777051492.959146:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051492.959183:0:6577:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d95a09ad80 going to sleep for 11 seconds 00000100:00100000:0.0:1777051492.959351:0:109186:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452709632 00000100:00100000:0.0:1777051492.959369:0:109186:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452709632 00000100:00100000:0.0:1777051492.959429:0:109186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1777051492.959458:0:109186:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5cdbcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f9351a01-5b0e-4470-97fd-58b9b4b312a2+21:6577:x1863365452709632:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1777051492.959639:0:109186:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5cdbcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f9351a01-5b0e-4470-97fd-58b9b4b312a2+21:6577:x1863365452709632:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 195us (492us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051492.959652:0:109186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1777051492.960673:0:6577:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955ebf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452709632:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1777051492.960723:0:6577:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955ebf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452709760:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1777051492.960787:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051492.960865:0:6577:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d95a09ad80 going to sleep for 11 seconds 00000100:00100000:2.0:1777051492.960885:0:109182:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452709760 00000100:00100000:2.0:1777051492.960896:0:109182:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452709760 00000100:00100000:2.0:1777051492.960991:0:109182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1777051492.961007:0:109182:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5cdbf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9351a01-5b0e-4470-97fd-58b9b4b312a2+21:6577:x1863365452709760:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1777051492.961156:0:109182:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5cdbf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9351a01-5b0e-4470-97fd-58b9b4b312a2+21:6577:x1863365452709760:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 152us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051492.961169:0:109182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1777051492.961282:0:6577:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955ebf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452709760:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1777051492.962786:0:109295:0:(llog.c:858:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 43 00000020:01000000:1.0:1777051492.963046:0:6577:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 43-42 (rc=0) 10000000:01000000:1.0:1777051492.963500:0:6577:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.201.146@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1777051492.963513:0:6577:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff99da7d775200/0x85f51a6b96717922 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b96717929 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051492.963530:0:6577:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.146@tcp lock: ffff99da7d775200/0x85f51a6b96717922 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b96717929 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1777051492.963567:0:6577:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1777051492.963572:0:6577:0:(mgc_request.c:1799:mgc_process_log()) Process log nodemap-ffff99da70a599c0 from 1 10000000:01000000:1.0:1777051492.963578:0:6577:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1777051492.963617:0:6577:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.146@tcp lock: ffff99d953285800/0x85f51a6b96717930 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051492.963651:0:6577:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.146@tcp lock: ffff99d953285800/0x85f51a6b96717930 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051492.963667:0:6577:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.146@tcp lock: ffff99d953285800/0x85f51a6b96717930 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051492.963702:0:6577:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955ebf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452709888:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1777051492.963755:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051492.963815:0:6577:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d95a09af00 going to sleep for 11 seconds 00000100:00100000:0.0:1777051492.963876:0:109180:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452709888 00000100:00100000:0.0:1777051492.963887:0:109180:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452709888 00000100:00100000:0.0:1777051492.963999:0:109180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1777051492.964017:0:109180:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5cdbe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9351a01-5b0e-4470-97fd-58b9b4b312a2+21:6577:x1863365452709888:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1777051492.964034:0:109180:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051492.964055:0:109180:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99da7d774800/0x85f51a6b96717937 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x85f51a6b96717930 expref: -99 pid: 109180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051492.964089:0:109180:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99da7d774800/0x85f51a6b96717937 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x85f51a6b96717930 expref: 22 pid: 109180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051492.964110:0:109180:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99da7d774800/0x85f51a6b96717937 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b96717930 expref: 22 pid: 109180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051492.964144:0:109180:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99da7d774800, rc 0) 00000100:00100000:0.0:1777051492.964265:0:109180:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5cdbe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9351a01-5b0e-4470-97fd-58b9b4b312a2+22:6577:x1863365452709888:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 250us (506us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051492.964282:0:109180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1777051492.964324:0:6577:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955ebf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452709888:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1777051492.964353:0:6577:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.146@tcp lock: ffff99d953285800/0x85f51a6b96717930 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b96717937 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051492.964370:0:6577:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.146@tcp lock: ffff99d953285800/0x85f51a6b96717930 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x85f51a6b96717937 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1777051492.964395:0:6577:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.201.146@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1777051492.964404:0:6577:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff99d953285800/0x85f51a6b96717930 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b96717937 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051492.964417:0:6577:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.146@tcp lock: ffff99d953285800/0x85f51a6b96717930 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b96717937 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1777051492.964429:0:6577:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1777051492.964433:0:6577:0:(mgc_request.c:1799:mgc_process_log()) Process log lustre-sptlrpc-ffff99da70a599c0 from 1 10000000:01000000:1.0:1777051492.964437:0:6577:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1777051492.964469:0:6577:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.146@tcp lock: ffff99d953284a00/0x85f51a6b9671793e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051492.964482:0:6577:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.146@tcp lock: ffff99d953284a00/0x85f51a6b9671793e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051492.964496:0:6577:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.146@tcp lock: ffff99d953284a00/0x85f51a6b9671793e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051492.964532:0:6577:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955ebf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452710016:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1777051492.964585:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051492.964638:0:6577:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d95a09af00 going to sleep for 11 seconds 00000100:00100000:2.0:1777051492.964664:0:109181:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452710016 00000100:00100000:2.0:1777051492.964676:0:109181:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452710016 00000100:00100000:2.0:1777051492.964759:0:109181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1777051492.964776:0:109181:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5fcd7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9351a01-5b0e-4470-97fd-58b9b4b312a2+22:6577:x1863365452710016:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1777051492.964791:0:109181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051492.964814:0:109181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d955919400/0x85f51a6b96717945 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x85f51a6b9671793e expref: -99 pid: 109181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051492.964847:0:109181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d955919400/0x85f51a6b96717945 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x85f51a6b9671793e expref: 23 pid: 109181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051492.964866:0:109181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d955919400/0x85f51a6b96717945 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b9671793e expref: 23 pid: 109181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051492.964879:0:109181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d955919400, rc 0) 00000100:00100000:2.0:1777051492.964990:0:109181:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5fcd7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9351a01-5b0e-4470-97fd-58b9b4b312a2+23:6577:x1863365452710016:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 218us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051492.965004:0:109181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1777051492.965062:0:6577:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955ebf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452710016:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1777051492.965087:0:6577:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.146@tcp lock: ffff99d953284a00/0x85f51a6b9671793e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b96717945 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051492.965106:0:6577:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.146@tcp lock: ffff99d953284a00/0x85f51a6b9671793e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x85f51a6b96717945 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051492.965187:0:6577:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955ebf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452710144:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1777051492.965237:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051492.965291:0:6577:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d95a09af00 going to sleep for 11 seconds 00000100:00100000:2.0:1777051492.965511:0:109184:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452710144 00000100:00100000:2.0:1777051492.965520:0:109184:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452710144 00000100:00100000:2.0:1777051492.965565:0:109184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1777051492.965575:0:109184:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5fcd7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f9351a01-5b0e-4470-97fd-58b9b4b312a2+23:6577:x1863365452710144:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1777051492.966032:0:109184:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5fcd7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f9351a01-5b0e-4470-97fd-58b9b4b312a2+23:6577:x1863365452710144:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 455us (792us total) trans 0 rc -2/-2 00000100:00100000:2.0:1777051492.966046:0:109184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1777051492.966068:0:6577:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955ebf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452710144:0@lo:501:ll_cfg_requeue.0 10000000:01000000:1.0:1777051492.966127:0:6577:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.201.146@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1777051492.966422:0:6577:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff99d953284a00/0x85f51a6b9671793e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b96717945 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051492.966438:0:6577:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.146@tcp lock: ffff99d953284a00/0x85f51a6b9671793e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b96717945 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051493.082513:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051493.082579:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051493.082626:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051493.082658:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051493.082695:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051493.082733:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051493.082776:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051493.082777:0:109180:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426100480 00000100:00100000:0.0:1777051493.082791:0:109180:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426100480 00000100:00100000:1.0:1777051493.082830:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051493.082831:0:6581:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426100608 00000100:00100000:2.0:1777051493.082841:0:6581:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426100608 00000100:00100000:0.0:1777051493.082861:0:109180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 61 00000100:00100000:1.0:1777051493.082881:0:8628:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426100992 00000100:00100000:2.0:1777051493.082885:0:6581:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426100736 00000100:00100000:0.0:1777051493.082888:0:109180:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5fcd5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2435:x1863365426100480:12345-192.168.201.46@tcp:250:kworker.0 00000100:00100000:1.0:1777051493.082891:0:8628:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426100992 00000100:00100000:2.0:1777051493.082893:0:6581:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426100736 00010000:00080000:0.0:1777051493.082951:0:109180:0:(ldlm_lib.c:1431:target_handle_connect()) MGS: connection from 29c4352d-3260-4734-909d-9ea5de9e7fa4@192.168.201.46@tcp t0 exp 0000000000000000 cur 8122 last 0 00000100:00100000:2.0:1777051493.082993:0:6581:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426101120 00000020:00000080:0.0:1777051493.082995:0:109180:0:(genops.c:1406:class_connect()) connect: client 29c4352d-3260-4734-909d-9ea5de9e7fa4, cookie 0x85f51a6b9671794c 00000100:00100000:2.0:1777051493.083001:0:6581:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426101120 00000100:00100000:1.0:1777051493.083018:0:8628:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426100864 00000100:00100000:1.0:1777051493.083026:0:8628:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426100864 00000100:00100000:2.0:1777051493.083041:0:6581:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426101248 00000100:00100000:2.0:1777051493.083048:0:6581:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426101248 00000100:00100000:1.0:1777051493.083070:0:8628:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426101376 00000100:00100000:1.0:1777051493.083078:0:8628:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426101376 00000100:00100000:2.0:1777051493.083101:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13485 00000100:00100000:2.0:1777051493.083117:0:6581:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f97c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+9:2436:x1863365426100736:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:1.0:1777051493.083136:0:8628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10525 00000100:00100000:1.0:1777051493.083154:0:8628:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f97c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+48:2436:x1863365426100992:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:2.0:1777051493.083211:0:6581:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f97c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+9:2436:x1863365426100736:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 95us (581us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051493.083224:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13485 00000100:00100000:1.0:1777051493.083268:0:8628:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f97c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+48:2436:x1863365426100992:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 115us (568us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051493.083283:0:8628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10525 00000100:00100000:2.0:1777051493.083295:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13486 00000100:00100000:2.0:1777051493.083313:0:6581:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f97ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+54:2437:x1863365426101248:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:1.0:1777051493.083325:0:8628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10526 00000100:00100000:1.0:1777051493.083341:0:8628:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f97d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+51:2437:x1863365426100864:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:2.0:1777051493.083375:0:6581:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f97ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+54:2437:x1863365426101248:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 67us (544us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051493.083390:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13486 00000100:00100000:1.0:1777051493.083397:0:8628:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f97d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+51:2437:x1863365426100864:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 57us (660us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051493.083408:0:8628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10526 00000100:00100000:2.0:1777051493.083430:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112417 00000100:00100000:1.0:1777051493.083437:0:8628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10527 00000100:00100000:2.0:1777051493.083444:0:6581:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955ebf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2435:x1863365426100608:12345-192.168.201.46@tcp:38:kworker.0 00000100:00100000:1.0:1777051493.083452:0:8628:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f97f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+53:2436:x1863365426101376:12345-192.168.201.46@tcp:400:kworker.0 00010000:00080000:2.0:1777051493.083471:0:6581:0:(ldlm_lib.c:926:target_handle_reconnect()) connect export for UUID 'c11b6966-0775-44d2-bdc6-c74c26eb2226' at ffff99da7b3cd000, cookie 0x85f51a6b967177d2 00010000:00080000:2.0:1777051493.083484:0:6581:0:(ldlm_lib.c:1431:target_handle_connect()) lustre-MDT0000: connection from c11b6966-0775-44d2-bdc6-c74c26eb2226@192.168.201.46@tcp recovering/t30064771244 exp ffff99da7b3cd000 cur 8122 last 1777051491 00000100:00100000:1.0:1777051493.083485:0:8628:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f97f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+53:2436:x1863365426101376:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 35us (708us total) trans 0 rc 0/0 00000100:00080000:0.0:1777051493.083496:0:109180:0:(import.c:65:import_set_state_nolock()) ffff99d958e3f800 : changing import state from RECOVER to FULL 00010000:02000400:2.0:1777051493.083508:0:6581:0:(ldlm_lib.c:2022:target_start_recovery_timer()) lustre-MDT0000: Will be in recovery for at least 1:00, or until 3 clients reconnect 00000100:00100000:1.0:1777051493.083511:0:8628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10527 00000100:00100000:0.0:1777051493.083560:0:109180:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5fcd5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29c4352d-3260-4734-909d-9ea5de9e7fa4+4:2435:x1863365426100480:12345-192.168.201.46@tcp:250:kworker.0 Request processed in 673us (1056us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051493.083575:0:109180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 61 00000100:00100000:1.0:1777051493.083584:0:46497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112418 00000100:00100000:1.0:1777051493.083597:0:46497:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f97e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:0+-99:2435:x1863365426101120:12345-192.168.201.46@tcp:38:kworker.0 00010000:00080000:1.0:1777051493.083621:0:46497:0:(ldlm_lib.c:926:target_handle_reconnect()) connect export for UUID '2dd4696c-edce-4cd1-86d2-dbd2ff957fa1' at ffff99da7b35d000, cookie 0x85f51a6b967177cb 00010000:00080000:1.0:1777051493.083629:0:46497:0:(ldlm_lib.c:1431:target_handle_connect()) lustre-MDT0000: connection from 2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp recovering/t30064771161 exp ffff99da7b35d000 cur 8122 last 1777051491 00010000:00080000:1.0:1777051493.083641:0:46497:0:(ldlm_lib.c:2086:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 70 seconds 00000004:00100000:1.0:1777051493.083691:0:46497:0:(mdt_handler.c:7281:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type b7, return b7 00000100:00080000:1.0:1777051493.084033:0:46497:0:(import.c:65:import_set_state_nolock()) ffff99d94405d000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1777051493.084100:0:46497:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f97e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+6:2435:x1863365426101120:12345-192.168.201.46@tcp:38:kworker.0 Request processed in 500us (1438us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051493.084125:0:46497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112418 00000100:00080000:1.0:1777051493.084286:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1777051493.084293:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1777051493.084297:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1777051493.084399:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051493.084559:0:13320:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426101504 00000100:00100000:1.0:1777051493.084578:0:13320:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426101504 00000100:00100000:1.0:1777051493.084634:0:13320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10528 00000100:00100000:1.0:1777051493.084646:0:13320:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f97ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+50:2437:x1863365426101504:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:1.0:1777051493.084701:0:13320:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f97ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+50:2437:x1863365426101504:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 56us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051493.084713:0:13320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10528 00000100:00080000:1.0:1777051493.084743:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00100000:2.0:1777051493.096458:0:6581:0:(mdt_handler.c:7281:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type b7, return b7 00000100:00080000:2.0:1777051493.096521:0:6581:0:(import.c:65:import_set_state_nolock()) ffff99d941c45000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1777051493.096620:0:6581:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955ebf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+6:2435:x1863365426100608:12345-192.168.201.46@tcp:38:kworker.0 Request processed in 13176us (14039us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051493.096637:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112417 00000100:00100000:3.0:1777051493.108634:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051493.108711:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051493.108762:0:46494:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365425984512 00000100:00100000:2.0:1777051493.108763:0:27885:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426088576 00000100:00100000:3.0:1777051493.108775:0:46494:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365425984512 00000100:00100000:2.0:1777051493.108793:0:27885:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426088576 00000100:00100000:3.0:1777051493.108884:0:46494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112419 00000100:00100000:3.0:1777051493.108936:0:46494:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d944071500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+6:2435:x1863365425984512:12345-192.168.201.46@tcp:101:lfs.0 00000100:00100000:2.0:1777051493.108944:0:27885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112420 00000100:00100000:2.0:1777051493.108967:0:27885:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d944072d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c11b6966-0775-44d2-bdc6-c74c26eb2226+6:2435:x1863365426088576:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 00010000:00080000:3.0:1777051493.108969:0:46494:0:(ldlm_lib.c:3211:target_queue_recovery_request()) Next recovery transno: 30064771259, current: 30064771161, replaying 00010000:00010000:3.0:1777051493.108990:0:46494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00080000:2.0:1777051493.108999:0:27885:0:(ldlm_lib.c:3211:target_queue_recovery_request()) Next recovery transno: 30064771259, current: 30064771244, replaying 00010000:00010000:2.0:1777051493.109011:0:27885:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777051493.109031:0:46494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e6e7200/0x85f51a6b96717953 lrc: 2/0,0 mode: --/CR res: [0x2000032e2:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b64ac expref: -99 pid: 46494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051493.109041:0:27885:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d955918800/0x85f51a6b9671795a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b69ec expref: -99 pid: 27885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1777051493.110154:0:27885:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 1036us 00000004:00200000:2.0:1777051493.127786:0:27885:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00000004:00080000:2.0:1777051493.127828:0:27885:0:(mdt_open.c:504:mdt_mfd_open()) orphan mfd not found, fid = [0x200000002:0x2:0x0], cookie = 0x85f51a6b9671760b 00000004:00080000:2.0:1777051493.127833:0:27885:0:(mdt_open.c:508:mdt_mfd_open()) Store old cookie 0x85f51a6b9671760b in new mfd 00010000:00010000:2.0:1777051493.128056:0:27885:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d955918800/0x85f51a6b9671795a lrc: 1/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b69ec expref: 8 pid: 27885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051493.128085:0:27885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff99da617f5f00) 00010000:00010000:2.0:1777051493.128091:0:27885:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1777051493.128100:0:27885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d955918800/0x85f51a6b9671795a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b69ec expref: 8 pid: 27885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051493.128140:0:27885:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d955918800, rc 0) 00000100:00100000:2.0:1777051493.128523:0:27885:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d944072d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c11b6966-0775-44d2-bdc6-c74c26eb2226+7:2435:x1863365426088576:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 Request processed in 19558us (19811us total) trans 30064771244 rc 301/301 00000100:00100000:2.0:1777051493.128541:0:27885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112420 00000004:00200000:2.0:1777051493.130367:0:46494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000032e2:0x6:0x0]: returning size 4096 00000004:00080000:2.0:1777051493.130392:0:46494:0:(mdt_open.c:504:mdt_mfd_open()) orphan mfd not found, fid = [0x2000032e2:0x6:0x0], cookie = 0x85f51a6b96716502 00000004:00080000:2.0:1777051493.130397:0:46494:0:(mdt_open.c:508:mdt_mfd_open()) Store old cookie 0x85f51a6b96716502 in new mfd 00010000:00010000:2.0:1777051493.130524:0:46494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e6e7200/0x85f51a6b96717953 lrc: 1/0,0 mode: --/CR res: [0x2000032e2:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b64ac expref: 8 pid: 46494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051493.130547:0:46494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0x5:0x0].0x0 (ffff99d9533abd00) 00010000:00010000:2.0:1777051493.130552:0:46494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1777051493.130561:0:46494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94e6e7200/0x85f51a6b96717953 lrc: 0/0,0 mode: --/CR res: [0x2000032e2:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b64ac expref: 8 pid: 46494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051493.130597:0:46494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d94e6e7200, rc 0) 00000100:00100000:2.0:1777051493.130661:0:46494:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d944071500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+7:2435:x1863365425984512:12345-192.168.201.46@tcp:101:lfs.0 Request processed in 21761us (22034us total) trans 30064771161 rc 301/301 00000100:00100000:2.0:1777051493.130676:0:46494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112419 00000100:00100000:3.0:1777051493.180937:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051493.181026:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051493.181243:0:21368:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426094208 00000100:00100000:1.0:1777051493.181258:0:21368:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426094208 00000100:00100000:0.0:1777051493.181417:0:27882:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426094464 00000100:00100000:0.0:1777051493.181427:0:27882:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426094464 00000100:00100000:0.0:1777051493.181481:0:27882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112421 00000100:00100000:0.0:1777051493.181496:0:27882:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d944070000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+7:2435:x1863365426094208:12345-192.168.201.46@tcp:101:md5sum.0 00010000:00080000:0.0:1777051493.181525:0:27882:0:(ldlm_lib.c:3211:target_queue_recovery_request()) Next recovery transno: 30064771259, current: 30064771257, replaying 00010000:00010000:0.0:1777051493.181540:0:27882:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051493.181574:0:27882:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d774a00/0x85f51a6b9671796f lrc: 2/0,0 mode: --/CR res: [0x2000032e2:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6a32 expref: -99 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051493.181626:0:21368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112422 00000100:00100000:1.0:1777051493.181644:0:21368:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d944070380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+7:2435:x1863365426094464:12345-192.168.201.46@tcp:101:md5sum.0 00010000:00080000:1.0:1777051493.181665:0:21368:0:(ldlm_lib.c:3211:target_queue_recovery_request()) Next recovery transno: 30064771259, current: 30064771258, replaying 00010000:00010000:1.0:1777051493.181698:0:21368:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777051493.181718:0:21368:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d953284000/0x85f51a6b96717976 lrc: 2/0,0 mode: --/CR res: [0x2000032e2:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6a39 expref: -99 pid: 21368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1777051493.181740:0:27882:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000032e3:0xb:0x0]: returning size 0 00000004:00080000:0.0:1777051493.181777:0:27882:0:(mdt_open.c:504:mdt_mfd_open()) orphan mfd not found, fid = [0x2000032e3:0xb:0x0], cookie = 0x85f51a6b967176eb 00000004:00080000:0.0:1777051493.181783:0:27882:0:(mdt_open.c:508:mdt_mfd_open()) Store old cookie 0x85f51a6b967176eb in new mfd 00000004:00200000:1.0:1777051493.181795:0:21368:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000032e3:0xb:0x0]: returning size 0 00000004:00080000:1.0:1777051493.181820:0:21368:0:(mdt_open.c:504:mdt_mfd_open()) orphan mfd not found, fid = [0x2000032e3:0xb:0x0], cookie = 0x85f51a6b9671770e 00000004:00080000:1.0:1777051493.181824:0:21368:0:(mdt_open.c:508:mdt_mfd_open()) Store old cookie 0x85f51a6b9671770e in new mfd 00010000:00010000:0.0:1777051493.181971:0:27882:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d774a00/0x85f51a6b9671796f lrc: 1/0,0 mode: --/CR res: [0x2000032e2:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6a32 expref: 9 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051493.181978:0:21368:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d953284000/0x85f51a6b96717976 lrc: 1/0,0 mode: --/CR res: [0x2000032e2:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6a39 expref: 9 pid: 21368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051493.182025:0:27882:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0xa:0x0].0x0 (ffff99d941e2eb00) 00010000:00010000:0.0:1777051493.182036:0:27882:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1777051493.182046:0:27882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d774a00/0x85f51a6b9671796f lrc: 0/0,0 mode: --/CR res: [0x2000032e2:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6a32 expref: 9 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051493.182065:0:27882:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99da7d774a00, rc 0) 00000100:00100000:0.0:1777051493.182133:0:27882:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d944070000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+8:2435:x1863365426094208:12345-192.168.201.46@tcp:101:md5sum.0 Request processed in 640us (1239us total) trans 30064771257 rc 301/301 00000100:00100000:0.0:1777051493.182144:0:27882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112421 00010000:00010000:1.0:1777051493.183427:0:21368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0xa:0x0].0x0 (ffff99d941e2eb00) 00010000:00010000:1.0:1777051493.183434:0:21368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1777051493.183444:0:21368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d953284000/0x85f51a6b96717976 lrc: 0/0,0 mode: --/CR res: [0x2000032e2:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6a39 expref: 9 pid: 21368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051493.183472:0:21368:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d953284000, rc 0) 00000100:00100000:1.0:1777051493.183533:0:21368:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d944070380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+8:2435:x1863365426094464:12345-192.168.201.46@tcp:101:md5sum.0 Request processed in 1894us (2509us total) trans 30064771258 rc 301/301 00000100:00100000:1.0:1777051493.183543:0:21368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112422 00000100:00100000:1.0:1777051493.192768:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051493.193170:0:6579:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426101632 00000100:00100000:0.0:1777051493.193183:0:6579:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426101632 00000100:00100000:0.0:1777051493.193277:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112423 00000100:00100000:0.0:1777051493.193295:0:6579:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f97dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+8:2435:x1863365426101632:12345-192.168.201.46@tcp:101:ldlm_lock_repla.0 00010000:00080000:0.0:1777051493.193329:0:6579:0:(ldlm_lib.c:3170:target_queue_recovery_request()) @@@ queue lock replay req req@ffff99d95f97dc00 x1863365426101632/t0(0) o101->c11b6966-0775-44d2-bdc6-c74c26eb2226@192.168.201.46@tcp:454/0 lens 328/0 e 0 to 0 dl 1777051504 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1777051493.193367:0:6579:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f97dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+8:2435:x1863365426101632:12345-192.168.201.46@tcp:101:ldlm_lock_repla.0 Request processed in 77us (611us total) trans 0 rc 0/-999 00000100:00100000:0.0:1777051493.193379:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112423 00010000:00080000:1.0:1777051493.193450:0:109212:0:(ldlm_lib.c:2531:check_for_recovery_ready()) connected 2 stale 0 max_recoverable_clients 3 abort 0 expired 0 00000100:00100000:2.0:1777051493.194522:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051493.194571:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051493.194631:0:10328:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426101760 00000100:00100000:1.0:1777051493.194642:0:10328:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426101760 00000100:00100000:2.0:1777051493.194678:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051493.194711:0:10328:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426101888 00000100:00100000:1.0:1777051493.194719:0:10328:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426101888 00000100:00100000:2.0:1777051493.195050:0:46497:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426102016 00000100:00100000:2.0:1777051493.195062:0:46497:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426102016 00000100:00100000:0.0:1777051493.195095:0:27885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112424 00000100:00100000:1.0:1777051493.195113:0:10328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112425 00000100:00100000:0.0:1777051493.195124:0:27885:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f169500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+10:2435:x1863365426101760:12345-192.168.201.46@tcp:101:ldlm_lock_repla.0 00000100:00100000:1.0:1777051493.195146:0:10328:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f168380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+10:2435:x1863365426101888:12345-192.168.201.46@tcp:101:ldlm_lock_repla.0 00000100:00100000:2.0:1777051493.195159:0:46497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112426 00010000:00080000:0.0:1777051493.195163:0:27885:0:(ldlm_lib.c:3170:target_queue_recovery_request()) @@@ queue lock replay req req@ffff99d94f169500 x1863365426101760/t0(0) o101->2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp:454/0 lens 328/0 e 0 to 0 dl 1777051504 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00080000:1.0:1777051493.195178:0:10328:0:(ldlm_lib.c:3170:target_queue_recovery_request()) @@@ queue lock replay req req@ffff99d94f168380 x1863365426101888/t0(0) o101->2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp:454/0 lens 328/0 e 0 to 0 dl 1777051504 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1777051493.195190:0:46497:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f168a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+10:2435:x1863365426102016:12345-192.168.201.46@tcp:101:ldlm_lock_repla.0 00000100:00100000:0.0:1777051493.195213:0:27885:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f169500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+10:2435:x1863365426101760:12345-192.168.201.46@tcp:101:ldlm_lock_repla.0 Request processed in 100us (690us total) trans 0 rc 0/-999 00000100:00100000:0.0:1777051493.195231:0:27885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112424 00000100:00100000:1.0:1777051493.195260:0:10328:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f168380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+10:2435:x1863365426101888:12345-192.168.201.46@tcp:101:ldlm_lock_repla.0 Request processed in 126us (686us total) trans 0 rc 0/-999 00000100:00100000:1.0:1777051493.195287:0:10328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112425 00010000:00080000:2.0:1777051493.195319:0:46497:0:(ldlm_lib.c:3170:target_queue_recovery_request()) @@@ queue lock replay req req@ffff99d94f168a80 x1863365426102016/t0(0) o101->2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp:454/0 lens 328/0 e 0 to 0 dl 1777051504 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00080000:1.0:1777051493.195326:0:109212:0:(ldlm_lib.c:2531:check_for_recovery_ready()) connected 2 stale 0 max_recoverable_clients 3 abort 0 expired 0 00000100:00100000:2.0:1777051493.195367:0:46497:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f168a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+10:2435:x1863365426102016:12345-192.168.201.46@tcp:101:ldlm_lock_repla.0 Request processed in 192us (692us total) trans 0 rc 0/-999 00010000:00080000:1.0:1777051493.195380:0:109212:0:(ldlm_lib.c:2531:check_for_recovery_ready()) connected 2 stale 0 max_recoverable_clients 3 abort 0 expired 0 00000100:00100000:2.0:1777051493.195386:0:46497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112426 00000040:00080000:1.0:1777051493.467381:0:109205:0:(llog.c:801:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:1.0:1777051493.467393:0:109205:0:(llog_cat.c:158:llog_cat_process_common()) processing log [0x1:0x2b:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1777051493.467585:0:109205:0:(llog.c:858:llog_process_thread()) stop processing plain [0x1:0x2b:0x0] index 12 count 7 00000040:00080000:1.0:1777051493.467602:0:109205:0:(llog.c:858:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00010000:00010000:0.0:1777051493.526514:0:108751:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1777051494.166452:0:3677:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1777051494.166515:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94f168000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452710272:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1777051494.166648:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051494.167067:0:8473:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452710272 00000100:00100000:2.0:1777051494.167089:0:8473:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452710272 00000100:00080000:1.0:1777051494.167196:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1777051494.167232:0:8473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5704 00000100:00100000:2.0:1777051494.167254:0:8473:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f16b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3677:x1863365452710272:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1777051494.167302:0:8473:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 489209408 pending 0 free 3642707968 avail 3411185664 00000100:00100000:2.0:1777051494.167396:0:8473:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f16b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3677:x1863365452710272:12345-0@lo:13:osp-pre-1-1.0 Request processed in 148us (752us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051494.167411:0:8473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5704 00000100:00100000:1.0:1777051494.167489:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94f168000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452710272:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1777051494.168463:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95f97e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452710400:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1777051494.168531:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051494.171645:0:47388:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452710400 00000100:00100000:3.0:1777051494.171656:0:47388:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452710400 00000100:00100000:3.0:1777051494.171723:0:47388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5705 00000100:00100000:3.0:1777051494.171739:0:47388:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f97ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3679:x1863365452710400:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1777051494.171771:0:47388:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 499269184 pending 0 free 3860574208 avail 3629051904 00000100:00100000:3.0:1777051494.172219:0:47388:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f97ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3679:x1863365452710400:12345-0@lo:13:osp-pre-0-1.0 Request processed in 481us (3686us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051494.172234:0:47388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5705 00000100:00080000:3.0:1777051494.172301:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1777051494.172364:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95f97e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452710400:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1777051494.507465:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051494.510223:0:109181:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426102144 00000100:00100000:0.0:1777051494.510239:0:109181:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426102144 00000100:00100000:1.0:1777051494.510406:0:109181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 62 00000100:00100000:1.0:1777051494.510425:0:109181:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5fcd4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29c4352d-3260-4734-909d-9ea5de9e7fa4+4:6255:x1863365426102144:12345-192.168.201.46@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1777051494.510449:0:109181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777051494.510475:0:109181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d953284000/0x85f51a6b9671798b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6a4e expref: -99 pid: 109181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051494.510539:0:109181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d953284000/0x85f51a6b9671798b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6a4e expref: 5 pid: 109181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051494.510562:0:109181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d953284000/0x85f51a6b9671798b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6a4e expref: 5 pid: 109181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051494.510579:0:109181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d953284000, rc 0) 00000100:00100000:1.0:1777051494.510675:0:109181:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5fcd4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29c4352d-3260-4734-909d-9ea5de9e7fa4+5:6255:x1863365426102144:12345-192.168.201.46@tcp:101:ll_cfg_requeue.0 Request processed in 253us (3222us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051494.510689:0:109181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 62 00000100:00100000:3.0:1777051494.523567:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051494.523690:0:109184:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426102272 00000100:00100000:0.0:1777051494.523704:0:109184:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426102272 00000100:00100000:0.0:1777051494.523787:0:109184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 63 00000100:00100000:0.0:1777051494.523803:0:109184:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5fcd5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:29c4352d-3260-4734-909d-9ea5de9e7fa4+5:6255:x1863365426102272:12345-192.168.201.46@tcp:256:ll_cfg_requeue.0 20000000:01000000:0.0:1777051494.523839:0:109184:0:(mgs_nids.c:912:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 16384. 20000000:01000000:0.0:1777051494.523866:0:109184:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1777051494.523873:0:109184:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:0.0:1777051494.523905:0:109184:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:0.0:1777051494.523910:0:109184:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:0.0:1777051494.523914:0:109184:0:(mgs_nids.c:316:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 35 00000100:00100000:0.0:1777051494.526492:0:109184:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5fcd5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:29c4352d-3260-4734-909d-9ea5de9e7fa4+5:6255:x1863365426102272:12345-192.168.201.46@tcp:256:ll_cfg_requeue.0 Request processed in 2685us (2928us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051494.526511:0:109184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 63 00000100:00100000:2.0:1777051494.540416:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051494.540554:0:109180:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426102400 00000100:00100000:1.0:1777051494.540569:0:109180:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426102400 00000100:00100000:1.0:1777051494.540652:0:109180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 64 00000100:00100000:1.0:1777051494.540671:0:109180:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942d2ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29c4352d-3260-4734-909d-9ea5de9e7fa4+5:6255:x1863365426102400:12345-192.168.201.46@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1777051494.540696:0:109180:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777051494.540724:0:109180:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d953285400/0x85f51a6b96717992 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6a55 expref: -99 pid: 109180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051494.540767:0:109180:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d953285400/0x85f51a6b96717992 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6a55 expref: 6 pid: 109180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051494.540787:0:109180:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d953285400/0x85f51a6b96717992 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6a55 expref: 6 pid: 109180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051494.540802:0:109180:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d953285400, rc 0) 00000100:00100000:1.0:1777051494.540910:0:109180:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942d2ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29c4352d-3260-4734-909d-9ea5de9e7fa4+6:6255:x1863365426102400:12345-192.168.201.46@tcp:101:ll_cfg_requeue.0 Request processed in 243us (503us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051494.540923:0:109180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 64 00000100:00100000:2.0:1777051494.549171:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051494.549293:0:109181:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426102528 00000100:00100000:1.0:1777051494.549306:0:109181:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426102528 00000100:00100000:1.0:1777051494.549404:0:109181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 65 00000100:00100000:1.0:1777051494.549425:0:109181:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da6145c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29c4352d-3260-4734-909d-9ea5de9e7fa4+6:6255:x1863365426102528:12345-192.168.201.46@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1777051494.549632:0:109181:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da6145c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29c4352d-3260-4734-909d-9ea5de9e7fa4+7:6255:x1863365426102528:12345-192.168.201.46@tcp:501:ll_cfg_requeue.0 Request processed in 211us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051494.549654:0:109181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 65 00010000:00010000:1.0:1777051494.552994:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777051494.559860:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051494.559988:0:109184:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426102656 00000100:00100000:0.0:1777051494.560001:0:109184:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426102656 00000100:00100000:0.0:1777051494.560094:0:109184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 66 00000100:00100000:0.0:1777051494.560113:0:109184:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da6145e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:29c4352d-3260-4734-909d-9ea5de9e7fa4+7:6255:x1863365426102656:12345-192.168.201.46@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1777051494.560629:0:109184:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da6145e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:29c4352d-3260-4734-909d-9ea5de9e7fa4+7:6255:x1863365426102656:12345-192.168.201.46@tcp:503:ll_cfg_requeue.0 Request processed in 518us (774us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051494.560662:0:109184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 66 00000100:00100000:0.0:1777051494.569096:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051494.569232:0:109180:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426102784 00000100:00100000:3.0:1777051494.569248:0:109180:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426102784 00000100:00100000:3.0:1777051494.569368:0:109180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 67 00000100:00100000:3.0:1777051494.569387:0:109180:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942d29450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29c4352d-3260-4734-909d-9ea5de9e7fa4+7:6255:x1863365426102784:12345-192.168.201.46@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1777051494.569412:0:109180:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777051494.569443:0:109180:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d94e6e7200/0x85f51a6b96717999 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6a5c expref: -99 pid: 109180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051494.569488:0:109180:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d94e6e7200/0x85f51a6b96717999 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6a5c expref: 8 pid: 109180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051494.569509:0:109180:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d94e6e7200/0x85f51a6b96717999 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6a5c expref: 8 pid: 109180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051494.569526:0:109180:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d94e6e7200, rc 0) 00000100:00100000:3.0:1777051494.569616:0:109180:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942d29450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29c4352d-3260-4734-909d-9ea5de9e7fa4+8:6255:x1863365426102784:12345-192.168.201.46@tcp:101:ll_cfg_requeue.0 Request processed in 232us (528us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051494.569630:0:109180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 67 00000100:00100000:3.0:1777051494.577615:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051494.579671:0:109181:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426102912 00000100:00100000:1.0:1777051494.579685:0:109181:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426102912 00000100:00100000:1.0:1777051494.579768:0:109181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 68 00000100:00100000:1.0:1777051494.579789:0:109181:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942b84850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29c4352d-3260-4734-909d-9ea5de9e7fa4+8:6255:x1863365426102912:12345-192.168.201.46@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1777051494.580029:0:109181:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942b84850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29c4352d-3260-4734-909d-9ea5de9e7fa4+8:6255:x1863365426102912:12345-192.168.201.46@tcp:501:ll_cfg_requeue.0 Request processed in 243us (2420us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051494.580043:0:109181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 68 00000100:00100000:0.0:1777051494.587436:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051494.588377:0:109184:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426103040 00000100:00100000:3.0:1777051494.588390:0:109184:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426103040 00000100:00100000:3.0:1777051494.588744:0:109184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 69 00000100:00100000:3.0:1777051494.588771:0:109184:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942b84450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:29c4352d-3260-4734-909d-9ea5de9e7fa4+8:6255:x1863365426103040:12345-192.168.201.46@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1777051494.589014:0:109184:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942b84450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:29c4352d-3260-4734-909d-9ea5de9e7fa4+8:6255:x1863365426103040:12345-192.168.201.46@tcp:503:ll_cfg_requeue.0 Request processed in 252us (1585us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051494.589029:0:109184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 69 00000100:00100000:3.0:1777051494.605547:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051494.605666:0:109180:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426103168 00000100:00100000:1.0:1777051494.605682:0:109180:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426103168 00000100:00100000:1.0:1777051494.606102:0:109180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 70 00000100:00100000:1.0:1777051494.606123:0:109180:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942b85050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29c4352d-3260-4734-909d-9ea5de9e7fa4+8:6255:x1863365426103168:12345-192.168.201.46@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1777051494.606148:0:109180:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777051494.606172:0:109180:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d953284200/0x85f51a6b967179a0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6a63 expref: -99 pid: 109180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051494.606253:0:109180:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d953284200/0x85f51a6b967179a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6a63 expref: 9 pid: 109180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051494.606275:0:109180:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d953284200/0x85f51a6b967179a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6a63 expref: 9 pid: 109180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051494.606291:0:109180:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d953284200, rc 0) 00000100:00100000:1.0:1777051494.606377:0:109180:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942b85050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29c4352d-3260-4734-909d-9ea5de9e7fa4+9:6255:x1863365426103168:12345-192.168.201.46@tcp:101:ll_cfg_requeue.0 Request processed in 261us (839us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051494.606391:0:109180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 70 00000100:00100000:3.0:1777051494.610155:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051494.610272:0:109181:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426103296 00000100:00100000:1.0:1777051494.610283:0:109181:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426103296 00000100:00100000:1.0:1777051494.610361:0:109181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 71 00000100:00100000:1.0:1777051494.610382:0:109181:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da6145ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29c4352d-3260-4734-909d-9ea5de9e7fa4+9:6255:x1863365426103296:12345-192.168.201.46@tcp:256:ll_cfg_requeue.0 20000000:01000000:1.0:1777051494.610418:0:109181:0:(mgs_nids.c:912:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 16384. 20000000:01000000:1.0:1777051494.610448:0:109181:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1777051494.610456:0:109181:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:1.0:1777051494.610462:0:109181:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:1.0:1777051494.610467:0:109181:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:1.0:1777051494.610472:0:109181:0:(mgs_nids.c:316:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 35 00000100:00100000:2.0:1777051494.622074:0:109181:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da6145ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29c4352d-3260-4734-909d-9ea5de9e7fa4+9:6255:x1863365426103296:12345-192.168.201.46@tcp:256:ll_cfg_requeue.0 Request processed in 11691us (11915us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051494.622096:0:109181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 71 00000100:00100000:1.0:1777051494.630193:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051494.630365:0:109184:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426103424 00000100:00100000:2.0:1777051494.630379:0:109184:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426103424 00000100:00100000:2.0:1777051494.630460:0:109184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 72 00000100:00100000:2.0:1777051494.630478:0:109184:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942b85850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:29c4352d-3260-4734-909d-9ea5de9e7fa4+9:6255:x1863365426103424:12345-192.168.201.46@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1777051494.630503:0:109184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051494.630529:0:109184:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d955918600/0x85f51a6b967179a7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6a6a expref: -99 pid: 109184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051494.630573:0:109184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d955918600/0x85f51a6b967179a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6a6a expref: 10 pid: 109184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051494.630594:0:109184:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d955918600/0x85f51a6b967179a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6a6a expref: 10 pid: 109184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051494.630610:0:109184:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d955918600, rc 0) 00000100:00100000:2.0:1777051494.630703:0:109184:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942b85850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:29c4352d-3260-4734-909d-9ea5de9e7fa4+10:6255:x1863365426103424:12345-192.168.201.46@tcp:101:ll_cfg_requeue.0 Request processed in 227us (518us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051494.630718:0:109184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 72 00000100:00100000:0.0:1777051494.637314:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051494.637397:0:109180:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426103552 00000100:00100000:1.0:1777051494.637410:0:109180:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426103552 00000100:00100000:1.0:1777051494.637495:0:109180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 73 00000100:00100000:1.0:1777051494.637513:0:109180:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da6145f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29c4352d-3260-4734-909d-9ea5de9e7fa4+10:6255:x1863365426103552:12345-192.168.201.46@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1777051494.637712:0:109180:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da6145f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29c4352d-3260-4734-909d-9ea5de9e7fa4+10:6255:x1863365426103552:12345-192.168.201.46@tcp:501:ll_cfg_requeue.0 Request processed in 201us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051494.637727:0:109180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 73 00000100:00100000:1.0:1777051494.641371:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051494.641494:0:109181:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426103680 00000100:00100000:2.0:1777051494.641506:0:109181:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426103680 00000100:00100000:2.0:1777051494.641573:0:109181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 74 00000100:00100000:2.0:1777051494.641592:0:109181:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942b87050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29c4352d-3260-4734-909d-9ea5de9e7fa4+10:6255:x1863365426103680:12345-192.168.201.46@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1777051494.642501:0:109181:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942b87050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29c4352d-3260-4734-909d-9ea5de9e7fa4+10:6255:x1863365426103680:12345-192.168.201.46@tcp:503:ll_cfg_requeue.0 Request processed in 562us (782us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051494.642520:0:109181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 74 00000100:00100000:2.0:1777051494.655852:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051494.655998:0:109184:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426103808 00000100:00100000:1.0:1777051494.656012:0:109184:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426103808 00000100:00100000:1.0:1777051494.656106:0:109184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 75 00000100:00100000:1.0:1777051494.656126:0:109184:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942b84050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:29c4352d-3260-4734-909d-9ea5de9e7fa4+10:6255:x1863365426103808:12345-192.168.201.46@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1777051494.656151:0:109184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777051494.656177:0:109184:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99da5f900600/0x85f51a6b967179ae lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6a71 expref: -99 pid: 109184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051494.656253:0:109184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99da5f900600/0x85f51a6b967179ae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6a71 expref: 11 pid: 109184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051494.656276:0:109184:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99da5f900600/0x85f51a6b967179ae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6a71 expref: 11 pid: 109184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051494.656294:0:109184:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99da5f900600, rc 0) 00000100:00100000:1.0:1777051494.656385:0:109184:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942b84050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:29c4352d-3260-4734-909d-9ea5de9e7fa4+11:6255:x1863365426103808:12345-192.168.201.46@tcp:101:ll_cfg_requeue.0 Request processed in 265us (545us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051494.656411:0:109184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 75 00000100:00100000:0.0:1777051494.662074:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051494.662310:0:109180:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426103936 00000100:00100000:2.0:1777051494.662321:0:109180:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426103936 00000100:00100000:2.0:1777051494.662399:0:109180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 76 00000100:00100000:2.0:1777051494.662419:0:109180:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942b85450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29c4352d-3260-4734-909d-9ea5de9e7fa4+11:6255:x1863365426103936:12345-192.168.201.46@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1777051494.662622:0:109180:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942b85450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29c4352d-3260-4734-909d-9ea5de9e7fa4+11:6255:x1863365426103936:12345-192.168.201.46@tcp:501:ll_cfg_requeue.0 Request processed in 205us (553us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051494.662640:0:109180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 76 00000100:00100000:2.0:1777051494.668056:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051494.668547:0:109181:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426104064 00000100:00100000:0.0:1777051494.668562:0:109181:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426104064 00000100:00100000:0.0:1777051494.668645:0:109181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 77 00000100:00100000:0.0:1777051494.668666:0:109181:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942b87850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29c4352d-3260-4734-909d-9ea5de9e7fa4+11:6255:x1863365426104064:12345-192.168.201.46@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1777051494.669245:0:109181:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942b87850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29c4352d-3260-4734-909d-9ea5de9e7fa4+11:6255:x1863365426104064:12345-192.168.201.46@tcp:503:ll_cfg_requeue.0 Request processed in 538us (1149us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051494.669262:0:109181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 77 00000100:00100000:0.0:1777051494.682131:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051494.682289:0:109184:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426104192 00000100:00100000:2.0:1777051494.682302:0:109184:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426104192 00000100:00100000:2.0:1777051494.682383:0:109184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 78 00000100:00100000:2.0:1777051494.682401:0:109184:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f3bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:29c4352d-3260-4734-909d-9ea5de9e7fa4+11:6255:x1863365426104192:12345-192.168.201.46@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1777051494.682423:0:109184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051494.682448:0:109184:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d955918e00/0x85f51a6b967179b5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6a78 expref: -99 pid: 109184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051494.682491:0:109184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d955918e00/0x85f51a6b967179b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6a78 expref: 12 pid: 109184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051494.682513:0:109184:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d955918e00/0x85f51a6b967179b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6a78 expref: 12 pid: 109184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051494.682528:0:109184:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d955918e00, rc 0) 00000100:00100000:2.0:1777051494.682616:0:109184:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f3bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:29c4352d-3260-4734-909d-9ea5de9e7fa4+12:6255:x1863365426104192:12345-192.168.201.46@tcp:101:ll_cfg_requeue.0 Request processed in 219us (494us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051494.682630:0:109184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 78 00000100:00100000:0.0:1777051494.689931:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051494.690405:0:109180:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426104320 00000100:00100000:3.0:1777051494.690418:0:109180:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426104320 00000100:00100000:3.0:1777051494.690510:0:109180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 79 00000100:00100000:3.0:1777051494.690546:0:109180:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f3bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29c4352d-3260-4734-909d-9ea5de9e7fa4+12:6255:x1863365426104320:12345-192.168.201.46@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1777051494.690684:0:109180:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f3bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29c4352d-3260-4734-909d-9ea5de9e7fa4+12:6255:x1863365426104320:12345-192.168.201.46@tcp:501:ll_cfg_requeue.0 Request processed in 139us (760us total) trans 0 rc -2/-2 00000100:00100000:3.0:1777051494.690698:0:109180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 79 00000001:02000400:2.0:1777051495.445137:0:109447:0:(debug.c:645:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg146-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1777051495.580141:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1777051496.373818:0:109499:0:(tgt_mount.c:2297:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1777051496.374303:0:109499:0:(tgt_mount.c:2312:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1777051496.599941:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1777051496.726458:0:107953:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1777051496.726468:0:107953:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1777051496.726473:0:107953:0:(import.c:65:import_set_state_nolock()) ffff99d94183b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1777051496.726492:0:107953:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff99d94183b000 using connection 192.168.201.146@tcp/0@lo 00000100:00100000:2.0:1777051496.726525:0:107953:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d94f169880 x1863365452710656/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1777051496.726578:0:107953:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1777051496.726584:0:107953:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1777051496.726587:0:107953:0:(import.c:65:import_set_state_nolock()) ffff99da5f282000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1777051496.726594:0:107953:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff99da5f282000 using connection 192.168.201.146@tcp/0@lo 00000100:00100000:2.0:1777051496.726629:0:107953:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d94f169180 x1863365452710912/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1777051496.726658:0:107953:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1777051496.726664:0:107953:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1777051496.726667:0:107953:0:(import.c:65:import_set_state_nolock()) ffff99da5f3d6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1777051496.726675:0:107953:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff99da5f3d6000 using connection 192.168.201.146@tcp/0@lo 00000100:00100000:2.0:1777051496.726695:0:107953:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d94f16ad80 x1863365452711168/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1777051496.726731:0:107953:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1777051496.726738:0:107953:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1777051496.726740:0:107953:0:(import.c:65:import_set_state_nolock()) ffff99da7dbe9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1777051496.726746:0:107953:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff99da7dbe9000 using connection 192.168.201.146@tcp/0@lo 00000100:00100000:2.0:1777051496.726767:0:107953:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d95fbaf800 x1863365452711552/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1777051496.726813:0:107953:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1777051496.726818:0:107953:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1777051496.726821:0:107953:0:(import.c:65:import_set_state_nolock()) ffff99da70a54000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1777051496.726829:0:107953:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff99da70a54000 using connection 192.168.201.146@tcp/0@lo 00000100:00100000:2.0:1777051496.726883:0:107953:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99d95fbadc00 x1863365452712064/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1777051496.726948:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94f168700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3680:1863365452710528:0@lo:400:kworker.0 00000100:00100000:2.0:1777051496.727052:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051496.727124:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95fbaed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3680:1863365452711424:0@lo:400:kworker.0 00000100:00100000:2.0:1777051496.727167:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051496.727238:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95fbad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3680:1863365452712192:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1777051496.727285:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051496.727326:0:3680:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1777051496.727336:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94f16a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3680:1863365452711296:0@lo:400:kworker.0 00000100:00100000:2.0:1777051496.727374:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051496.727405:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95fbadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3680:1863365452711936:0@lo:400:kworker.0 00000100:00100000:2.0:1777051496.727446:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051496.727450:0:109181:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452710528 00000100:00100000:3.0:1777051496.727463:0:109181:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452710528 00000100:00100000:2.0:1777051496.727512:0:27884:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452711424 00000100:00100000:2.0:1777051496.727522:0:27884:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452711424 00000100:00100000:3.0:1777051496.727549:0:109181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1777051496.727566:0:109181:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f3bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9351a01-5b0e-4470-97fd-58b9b4b312a2+23:3680:x1863365452710528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777051496.727597:0:27884:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452711296 00000100:00100000:2.0:1777051496.727604:0:27884:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452711296 00000100:00100000:2.0:1777051496.727657:0:27884:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452711936 00000100:00100000:2.0:1777051496.727664:0:27884:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452711936 00000100:00080000:0.0:1777051496.727667:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1777051496.727679:0:109181:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f3bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9351a01-5b0e-4470-97fd-58b9b4b312a2+23:3680:x1863365452710528:12345-0@lo:400:kworker.0 Request processed in 114us (626us total) trans 0 rc 0/0 00000100:00080000:0.0:1777051496.727680:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1777051496.727702:0:109181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1777051496.727714:0:27884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10529 00000100:00100000:0.0:1777051496.727719:0:3676:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94f169880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3676:1863365452710656:0@lo:38:kworker.0 00000100:00100000:2.0:1777051496.727734:0:27884:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95fbafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3680:x1863365452711424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777051496.728082:0:27884:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95fbafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3680:x1863365452711424:12345-0@lo:400:kworker.0 Request processed in 353us (913us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051496.728095:0:27884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10529 00000100:00100000:2.0:1777051496.728130:0:27884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10530 00000100:00100000:3.0:1777051496.728146:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94f168700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3680:1863365452710528:0@lo:400:kworker.0 00000100:00100000:0.0:1777051496.728150:0:3676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051496.728151:0:27884:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95fbac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3680:x1863365452711296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051496.728188:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95fbaed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3680:1863365452711424:0@lo:400:kworker.0 00000100:00100000:0.0:1777051496.728239:0:3676:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94f169180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3676:1863365452710912:0@lo:38:kworker.0 00000100:00100000:2.0:1777051496.728508:0:27884:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95fbac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3680:x1863365452711296:12345-0@lo:400:kworker.0 Request processed in 363us (1129us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051496.728520:0:27884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10530 00000100:00100000:3.0:1777051496.728534:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94f16a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3680:1863365452711296:0@lo:400:kworker.0 00000100:00100000:2.0:1777051496.728556:0:27884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10531 00000100:00100000:0.0:1777051496.728560:0:3676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051496.728575:0:27884:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95fbace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+6:3680:x1863365452711936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777051496.728609:0:3676:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94f16ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3676:1863365452711168:0@lo:38:kworker.0 00000100:00100000:2.0:1777051496.728648:0:27884:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95fbace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+6:3680:x1863365452711936:12345-0@lo:400:kworker.0 Request processed in 78us (1203us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051496.728661:0:27884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10531 00000100:00100000:0.0:1777051496.728675:0:3676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051496.728715:0:6585:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452712192 00000100:00100000:0.0:1777051496.728716:0:3676:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95fbaf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3676:1863365452711552:0@lo:38:kworker.0 00000100:00100000:2.0:1777051496.728726:0:6585:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452712192 00000100:00100000:0.0:1777051496.728775:0:3676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051496.728784:0:6585:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452711168 00000100:00100000:2.0:1777051496.728793:0:6585:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452711168 00000100:00100000:0.0:1777051496.728813:0:3676:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95fbadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3676:1863365452712064:0@lo:38:kworker.0 00000100:00100000:2.0:1777051496.728836:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8342 00000100:00100000:2.0:1777051496.728880:0:6585:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95fbad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:3680:x1863365452712192:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1777051496.728906:0:3676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00000024:2.0:1777051496.728927:0:6585:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4194304 pending 0 free 1446141952 avail 1299902464 00000100:00100000:1.0:1777051496.728950:0:21368:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452710656 00000100:00100000:1.0:1777051496.728961:0:21368:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452710656 00000100:00100000:3.0:1777051496.728982:0:8492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452710912 00000100:00100000:0.0:1777051496.728985:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94f168000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3677:1863365452710784:0@lo:400:kworker.0 00000100:00100000:3.0:1777051496.728994:0:8492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452710912 00000100:00100000:2.0:1777051496.728998:0:6585:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95fbad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:3680:x1863365452712192:12345-0@lo:41:osp-pre-1-0.0 Request processed in 120us (1709us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051496.729011:0:21368:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452711552 00000100:00100000:2.0:1777051496.729012:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8342 00000100:00100000:1.0:1777051496.729022:0:21368:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452711552 00000100:00100000:3.0:1777051496.729050:0:8492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452712064 00000100:00100000:2.0:1777051496.729053:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8343 00000100:00100000:0.0:1777051496.729057:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051496.729061:0:8492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452712064 00000100:00100000:2.0:1777051496.729071:0:6585:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94ed2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3676:x1863365452711168:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1777051496.729082:0:21368:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452710784 00000100:00100000:1.0:1777051496.729090:0:21368:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452710784 00010000:00080000:2.0:1777051496.729104:0:6585:0:(ldlm_lib.c:926:target_handle_reconnect()) connect export for UUID 'lustre-MDT0001-mdtlov_UUID' at ffff99da7b359000, cookie 0x85f51a6b967177c4 00000100:00100000:0.0:1777051496.729107:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95fbac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3677:1863365452711680:0@lo:400:kworker.0 00000100:00100000:3.0:1777051496.729116:0:8492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112427 00010000:00080000:2.0:1777051496.729119:0:6585:0:(ldlm_lib.c:1431:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo recovering/t0 exp ffff99da7b359000 cur 8125 last 1777051491 00000100:00100000:3.0:1777051496.729134:0:8492:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94ed2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3676:x1863365452710656:12345-0@lo:38:kworker.0 00000004:00100000:2.0:1777051496.729152:0:6585:0:(mdt_handler.c:7285:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:1.0:1777051496.729161:0:21368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13487 00010000:00080000:3.0:1777051496.729167:0:8492:0:(ldlm_lib.c:1431:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 8125 last 0 00000100:00100000:0.0:1777051496.729176:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051496.729241:0:21368:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94ed2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3677:x1863365452710784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777051496.729280:0:3677:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1777051496.729296:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94f16a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3677:1863365452711040:0@lo:400:kworker.0 00000100:00100000:1.0:1777051496.729338:0:21368:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94ed2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3677:x1863365452710784:12345-0@lo:400:kworker.0 Request processed in 157us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051496.729354:0:21368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13487 00000100:00100000:0.0:1777051496.729366:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:3.0:1777051496.729394:0:8492:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x85f51a6b967179bc 00000100:00100000:1.0:1777051496.729400:0:21368:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452711040 00000100:00100000:0.0:1777051496.729403:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95fbac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3677:1863365452711808:0@lo:400:kworker.0 00000100:00100000:1.0:1777051496.729410:0:21368:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452711040 00000004:00100000:3.0:1777051496.729414:0:8492:0:(mdt_handler.c:7285:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1777051496.729464:0:8492:0:(import.c:65:import_set_state_nolock()) ffff99d958724800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1777051496.729475:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051496.729476:0:21368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13488 00000100:00100000:1.0:1777051496.729498:0:21368:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94ed2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3677:x1863365452711040:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1777051496.729518:0:6585:0:(import.c:65:import_set_state_nolock()) ffff99d941c40800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1777051496.729553:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94f168000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3677:1863365452710784:0@lo:400:kworker.0 00000100:00100000:3.0:1777051496.729565:0:8492:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94ed2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3676:x1863365452710656:12345-0@lo:38:kworker.0 Request processed in 426us (1419us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051496.729581:0:8492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112427 00000100:00100000:1.0:1777051496.729588:0:21368:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94ed2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3677:x1863365452711040:12345-0@lo:400:kworker.0 Request processed in 91us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051496.729604:0:21368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13488 00000100:00100000:0.0:1777051496.729615:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94f16a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3677:1863365452711040:0@lo:400:kworker.0 00000100:00100000:3.0:1777051496.729624:0:8492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112428 00000100:00100000:3.0:1777051496.729643:0:8492:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94ed2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3676:x1863365452710912:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1777051496.729644:0:6585:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94ed2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3676:x1863365452711168:12345-0@lo:38:kworker.0 Request processed in 568us (966us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051496.729651:0:21368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112429 00000100:00100000:1.0:1777051496.729669:0:21368:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94ed2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3676:x1863365452711552:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1777051496.729673:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8343 00000100:00100000:0.0:1777051496.729680:0:47208:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452711680 00010000:00080000:3.0:1777051496.729680:0:8492:0:(ldlm_lib.c:1431:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 8125 last 0 00000100:00100000:0.0:1777051496.729692:0:47208:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452711680 00000100:00100000:2.0:1777051496.729729:0:8628:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452711808 00000100:00100000:2.0:1777051496.729738:0:8628:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452711808 00010000:00080000:1.0:1777051496.729760:0:21368:0:(ldlm_lib.c:1431:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 8125 last 0 00000100:00100000:2.0:1777051496.729809:0:8628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10532 00000020:00000080:1.0:1777051496.729821:0:21368:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x85f51a6b967179ca 00000100:00100000:2.0:1777051496.729829:0:8628:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94ed2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3677:x1863365452711808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777051496.729865:0:47208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8344 00000100:00100000:0.0:1777051496.729882:0:47208:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94ed2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+8:3677:x1863365452711680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777051496.729948:0:47208:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94ed2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+8:3677:x1863365452711680:12345-0@lo:400:kworker.0 Request processed in 70us (783us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051496.729959:0:47208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8344 00000100:00100000:0.0:1777051496.729995:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112430 00000100:00100000:0.0:1777051496.730004:0:6579:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94ed2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3676:x1863365452712064:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1777051496.730026:0:6579:0:(ldlm_lib.c:1431:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 8125 last 0 00000020:00000080:0.0:1777051496.730064:0:6579:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x85f51a6b967179d1 00000004:00100000:0.0:1777051496.730077:0:6579:0:(mdt_handler.c:7285:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1777051496.730105:0:6579:0:(import.c:65:import_set_state_nolock()) ffff99d958e3c800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1777051496.730155:0:6579:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94ed2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3676:x1863365452712064:12345-0@lo:38:kworker.0 Request processed in 148us (1253us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051496.730166:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112430 00000100:00100000:0.0:1777051496.730397:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95fbac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3677:1863365452711680:0@lo:400:kworker.0 00000100:00080000:0.0:1777051496.730457:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1777051496.730463:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000020:00000080:3.0:1777051496.730676:0:8492:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x85f51a6b967179c3 00000004:00100000:3.0:1777051496.730691:0:8492:0:(mdt_handler.c:7285:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1777051496.730726:0:8492:0:(import.c:65:import_set_state_nolock()) ffff99da4a375800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1777051496.730786:0:8492:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94ed2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3676:x1863365452710912:12345-0@lo:38:kworker.0 Request processed in 1146us (2233us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051496.730817:0:8492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112428 00000004:00100000:1.0:1777051496.730895:0:21368:0:(mdt_handler.c:7285:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1777051496.730934:0:21368:0:(import.c:65:import_set_state_nolock()) ffff99da7fa93800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1777051496.730998:0:21368:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94ed2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3676:x1863365452711552:12345-0@lo:38:kworker.0 Request processed in 1328us (2224us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051496.731013:0:21368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112429 00000100:00080000:1.0:1777051496.731212:0:3676:0:(import.c:1130:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 8 00000100:00100000:0.0:1777051496.731281:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95fbadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3680:1863365452711936:0@lo:400:kworker.0 00000100:00100000:0.0:1777051496.731308:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95fbad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3680:1863365452712192:0@lo:41:osp-pre-1-0.0 00010000:00080000:0.0:1777051496.731366:0:109212:0:(ldlm_lib.c:2531:check_for_recovery_ready()) connected 3 stale 0 max_recoverable_clients 3 abort 0 expired 0 00010000:00080000:0.0:1777051496.731375:0:109212:0:(ldlm_lib.c:2669:replay_request_or_update()) Waiting for transno 30064771259 00000020:00080000:0.0:1777051496.731383:0:109212:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1777051496.731389:0:109212:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 30064771259 00000020:00080000:0.0:1777051496.731395:0:109212:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1777051496.731399:0:109212:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 30064771259 00000001:00100000:0.0:1777051496.732355:0:8464:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1777051496.732522:0:8628:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94ed2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3677:x1863365452711808:12345-0@lo:400:kworker.0 Request processed in 2698us (3054us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051496.732536:0:8628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10532 00000100:00100000:0.0:1777051496.732577:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95fbac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3677:1863365452711808:0@lo:400:kworker.0 00000001:00100000:0.0:1777051496.733550:0:9540:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1777051496.733828:0:104205:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934765 is committed 00000100:00080000:1.0:1777051496.733879:0:3676:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0000: lwp recover req@ffff99d94f169880 x1863365452710656/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1777051521 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1777051496.733899:0:3676:0:(import.c:65:import_set_state_nolock()) ffff99d94183b000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:1.0:1777051496.733907:0:3676:0:(import.c:65:import_set_state_nolock()) ffff99d94183b000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:1.0:1777051496.733914:0:3676:0:(import.c:1737:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0000: Connection restored to 0@lo (at 0@lo) 00000100:00100000:1.0:1777051496.760876:0:3676:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94f169880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3676:1863365452710656:0@lo:38:kworker.0 00000100:00080000:1.0:1777051496.761038:0:3676:0:(import.c:1130:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 8 00000100:00080000:1.0:1777051496.762802:0:3676:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0001: lwp recover req@ffff99d94f169180 x1863365452710912/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1777051521 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1777051496.762818:0:3676:0:(import.c:65:import_set_state_nolock()) ffff99da5f282000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:1.0:1777051496.762824:0:3676:0:(import.c:65:import_set_state_nolock()) ffff99da5f282000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:1.0:1777051496.762830:0:3676:0:(import.c:1737:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:1.0:1777051496.762878:0:3676:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94f169180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3676:1863365452710912:0@lo:38:kworker.0 00000100:00080000:0.0:1777051496.764056:0:3676:0:(import.c:1130:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 8 00000100:00080000:0.0:1777051496.764071:0:3676:0:(import.c:65:import_set_state_nolock()) ffff99da5f3d6000 lustre-MDT0000_UUID: changing import state from CONNECTING to REPLAY 00000100:00080000:0.0:1777051496.764078:0:3676:0:(import.c:1694:ptlrpc_import_recovery_state_machine()) replay requested by lustre-MDT0000_UUID 00000100:00100000:0.0:1777051496.764082:0:3676:0:(client.c:3101:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 30064771239 gen 2 00000100:00080000:0.0:1777051496.764088:0:3676:0:(recover.c:53:ptlrpc_replay_next()) import ffff99da5f3d6000 from lustre-MDT0000_UUID committed 30064771239 last 0 00000100:00080000:0.0:1777051496.764093:0:3676:0:(import.c:65:import_set_state_nolock()) ffff99da5f3d6000 lustre-MDT0000_UUID: changing import state from REPLAY to REPLAY_LOCKS 00000100:00100000:0.0:1777051496.764559:0:3676:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94f16ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3676:1863365452711168:0@lo:38:kworker.0 00010000:00080000:1.0:1777051496.764588:0:109520:0:(ldlm_request.c:2960:ldlm_lock_replay_thread()) lock replay thread lustre-MDT0000-osp-MDT0001 to lustre-MDT0000_UUID@0@lo 00000100:00080000:0.0:1777051496.764591:0:3676:0:(import.c:1130:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 8 00010000:00010000:1.0:1777051496.764593:0:109520:0:(ldlm_request.c:2876:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-MDT0000-osp-MDT0001 (0) 00010000:00010000:1.0:1777051496.764602:0:109520:0:(ldlm_request.c:2889:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-MDT0000-osp-MDT0001 00010000:00010000:1.0:1777051496.768664:0:109520:0:(ldlm_request.c:2848:replay_one_lock()) ### replaying lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff99da7d784400/0x85f51a6b96715653 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x85f51a6b9671565a expref: -99 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:1.0:1777051496.768694:0:109520:0:(ldlm_request.c:2898:lock_can_replay()) check lock replay limit, inflights = 1(512) 00000100:00080000:0.0:1777051496.770463:0:3676:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-MDT0001: lwp recover req@ffff99d95fbaf800 x1863365452711552/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1777051521 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1777051496.770479:0:3676:0:(import.c:65:import_set_state_nolock()) ffff99da7dbe9000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:0.0:1777051496.770486:0:3676:0:(import.c:65:import_set_state_nolock()) ffff99da7dbe9000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:0.0:1777051496.770504:0:3676:0:(import.c:1737:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:0.0:1777051496.770513:0:3676:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95fbaf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3676:1863365452711552:0@lo:38:kworker.0 00000100:00080000:0.0:1777051496.770562:0:3676:0:(import.c:1130:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 8 00000100:00080000:0.0:1777051496.770572:0:3676:0:(import.c:958:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1777051496.770578:0:3676:0:(import.c:1211:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1777051496.770581:0:3676:0:(import.c:65:import_set_state_nolock()) ffff99da70a54000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1777051496.770589:0:3676:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95fbadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3676:1863365452712064:0@lo:38:kworker.0 00000100:00100000:0.0:1777051496.770646:0:3676:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95f97ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3676:1863365452712320:0@lo:101:ldlm_lock_repla.0 00000100:00100000:0.0:1777051496.770713:0:3676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051496.771369:0:6585:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452712320 00000100:00100000:3.0:1777051496.771379:0:6585:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452712320 00000100:00100000:3.0:1777051496.771443:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8345 00000100:00100000:3.0:1777051496.771457:0:6585:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94ed2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3676:x1863365452712320:12345-0@lo:101:ldlm_lock_repla.0 00010000:00080000:3.0:1777051496.771481:0:6585:0:(ldlm_lib.c:3170:target_queue_recovery_request()) @@@ queue lock replay req req@ffff99d94ed2e300 x1863365452712320/t0(0) o101->lustre-MDT0001-mdtlov_UUID@0@lo:457/0 lens 328/0 e 0 to 0 dl 1777051507 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777051496.771510:0:6585:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94ed2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3676:x1863365452712320:12345-0@lo:101:ldlm_lock_repla.0 Request processed in 56us (796us total) trans 0 rc 0/-999 00000100:00100000:3.0:1777051496.771523:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8345 00000020:00080000:3.0:1777051496.771557:0:109212:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1777051496.771562:0:109212:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 3, connected: 3, completed: 3, queue_len: 0, req_transno: 0, next_transno: 30064771259 00010000:00080000:3.0:1777051496.771568:0:109212:0:(ldlm_lib.c:2248:check_for_next_transno()) waking for completed recovery 00000020:00080000:3.0:1777051496.771573:0:109212:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1777051496.771582:0:109212:0:(ldlm_lib.c:2438:target_next_replay_lock()) Waiting for lock 00010000:00080000:3.0:1777051496.771586:0:109212:0:(ldlm_lib.c:2268:check_for_next_lock()) waking for next lock 00010000:00080000:3.0:1777051496.771600:0:109212:0:(ldlm_lib.c:2871:target_recovery_thread()) @@@ processing lock from 192.168.201.46@tcp: req@ffff99d95f97dc00 x1863365426101632/t0(0) o101->c11b6966-0775-44d2-bdc6-c74c26eb2226@192.168.201.46@tcp:454/0 lens 328/0 e 0 to 0 dl 1777051504 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1777051496.771624:0:109212:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777051496.771660:0:109212:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cea00/0x85f51a6b967179d8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b69c9 expref: -99 pid: 109212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051496.771993:0:109212:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cea00/0x85f51a6b967179d8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b69c9 expref: 7 pid: 109212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051496.772019:0:109212:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cea00/0x85f51a6b967179d8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b69c9 expref: 7 pid: 109212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051496.772033:0:109212:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99da7d5cea00, rc 0) 00010000:00080000:3.0:1777051496.772115:0:109212:0:(ldlm_lib.c:2086:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 101 seconds 00010000:00080000:3.0:1777051496.772133:0:109212:0:(ldlm_lib.c:2438:target_next_replay_lock()) Waiting for lock 00010000:00080000:3.0:1777051496.772136:0:109212:0:(ldlm_lib.c:2268:check_for_next_lock()) waking for next lock 00010000:00080000:3.0:1777051496.772144:0:109212:0:(ldlm_lib.c:2871:target_recovery_thread()) @@@ processing lock from 192.168.201.46@tcp: req@ffff99d94f169500 x1863365426101760/t0(0) o101->2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp:454/0 lens 328/0 e 0 to 0 dl 1777051504 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1777051496.772164:0:109212:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777051496.772184:0:109212:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cee00/0x85f51a6b967179df lrc: 2/0,0 mode: --/CR res: [0x2000032e3:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6a40 expref: -99 pid: 109212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051496.772234:0:109212:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cee00/0x85f51a6b967179df lrc: 3/0,0 mode: --/CR res: [0x2000032e3:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6a40 expref: 9 pid: 109212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051496.772250:0:109212:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cee00/0x85f51a6b967179df lrc: 3/0,0 mode: --/CR res: [0x2000032e3:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6a40 expref: 9 pid: 109212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051496.772263:0:109212:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99da7d5cee00, rc 0) 00010000:00080000:3.0:1777051496.772299:0:109212:0:(ldlm_lib.c:2086:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00010000:00080000:3.0:1777051496.772315:0:109212:0:(ldlm_lib.c:2438:target_next_replay_lock()) Waiting for lock 00010000:00080000:3.0:1777051496.772320:0:109212:0:(ldlm_lib.c:2268:check_for_next_lock()) waking for next lock 00010000:00080000:3.0:1777051496.772334:0:109212:0:(ldlm_lib.c:2871:target_recovery_thread()) @@@ processing lock from 192.168.201.46@tcp: req@ffff99d94f168380 x1863365426101888/t0(0) o101->2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp:454/0 lens 328/0 e 0 to 0 dl 1777051504 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1777051496.772352:0:109212:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777051496.772372:0:109212:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cfe00/0x85f51a6b967179e6 lrc: 2/0,0 mode: --/CR res: [0x2000032e2:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b64ac expref: -99 pid: 109212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051496.772403:0:109212:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cfe00/0x85f51a6b967179e6 lrc: 3/0,0 mode: CR/CR res: [0x2000032e2:0x6:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b64ac expref: 9 pid: 109212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051496.772422:0:109212:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cfe00/0x85f51a6b967179e6 lrc: 3/0,0 mode: CR/CR res: [0x2000032e2:0x6:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b64ac expref: 9 pid: 109212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051496.772433:0:109212:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99da7d5cfe00, rc 0) 00010000:00080000:3.0:1777051496.772483:0:109212:0:(ldlm_lib.c:2086:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00010000:00080000:3.0:1777051496.772495:0:109212:0:(ldlm_lib.c:2438:target_next_replay_lock()) Waiting for lock 00010000:00080000:3.0:1777051496.772497:0:109212:0:(ldlm_lib.c:2268:check_for_next_lock()) waking for next lock 00010000:00080000:3.0:1777051496.772505:0:109212:0:(ldlm_lib.c:2871:target_recovery_thread()) @@@ processing lock from 192.168.201.46@tcp: req@ffff99d94f168a80 x1863365426102016/t0(0) o101->2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp:454/0 lens 328/0 e 0 to 0 dl 1777051504 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1777051496.772523:0:109212:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777051496.772536:0:109212:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cec00/0x85f51a6b967179ed lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b69f3 expref: -99 pid: 109212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051496.772557:0:109212:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cec00/0x85f51a6b967179ed lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b69f3 expref: 9 pid: 109212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051496.772574:0:109212:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cec00/0x85f51a6b967179ed lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b69f3 expref: 9 pid: 109212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051496.772585:0:109212:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99da7d5cec00, rc 0) 00010000:00080000:3.0:1777051496.772619:0:109212:0:(ldlm_lib.c:2086:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00010000:00080000:3.0:1777051496.772633:0:109212:0:(ldlm_lib.c:2438:target_next_replay_lock()) Waiting for lock 00010000:00080000:3.0:1777051496.772636:0:109212:0:(ldlm_lib.c:2268:check_for_next_lock()) waking for next lock 00010000:00080000:3.0:1777051496.772647:0:109212:0:(ldlm_lib.c:2871:target_recovery_thread()) @@@ processing lock from 0@lo: req@ffff99d94ed2e300 x1863365452712320/t0(0) o101->lustre-MDT0001-mdtlov_UUID@0@lo:457/0 lens 328/0 e 0 to 0 dl 1777051507 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1777051496.773042:0:109212:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777051496.773060:0:109212:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cfa00/0x85f51a6b967179f4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x85f51a6b96715653 expref: -99 pid: 109212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051496.773082:0:109212:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cfa00/0x85f51a6b967179f4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x85f51a6b96715653 expref: 7 pid: 109212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051496.773098:0:109212:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cfa00/0x85f51a6b967179f4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b96715653 expref: 7 pid: 109212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051496.773110:0:109212:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99da7d5cfa00, rc 0) 00010000:00080000:3.0:1777051496.773167:0:109212:0:(ldlm_lib.c:2086:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00010000:00010000:0.0:1777051496.773225:0:3676:0:(ldlm_request.c:2765:replay_lock_interpret()) ### replayed lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff99da7d784400/0x85f51a6b96715653 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x85f51a6b967179f4 expref: -99 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1777051496.773241:0:3676:0:(import.c:65:import_set_state_nolock()) ffff99da5f3d6000 lustre-MDT0000_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000100:00100000:0.0:1777051496.773280:0:3676:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95f97ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3676:1863365452712320:0@lo:101:ldlm_lock_repla.0 00000100:00100000:0.0:1777051496.773308:0:3676:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955611f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3676:1863365452712448:0@lo:400:ptlrpcd_rcv.0 00000100:00100000:0.0:1777051496.773358:0:3676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1777051496.773397:0:109212:0:(ldlm_lib.c:2438:target_next_replay_lock()) Waiting for lock 00000100:00100000:1.0:1777051496.774684:0:11727:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452712448 00000100:00100000:1.0:1777051496.774695:0:11727:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452712448 00000100:00100000:1.0:1777051496.775024:0:11727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8346 00000100:00100000:1.0:1777051496.775041:0:11727:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942d21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:3676:x1863365452712448:12345-0@lo:400:ptlrpcd_rcv.0 00010000:00080000:1.0:1777051496.775061:0:11727:0:(ldlm_lib.c:3120:target_queue_recovery_request()) @@@ queue final req req@ffff99d942d21c00 x1863365452712448/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:457/0 lens 224/0 e 0 to 0 dl 1777051507 ref 2 fl Interpret:/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1777051496.775399:0:11727:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942d21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:3676:x1863365452712448:12345-0@lo:400:ptlrpcd_rcv.0 Request processed in 363us (2041us total) trans 0 rc 0/-999 00000100:00100000:1.0:1777051496.775411:0:11727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8346 00000100:00100000:3.0:1777051496.779167:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051496.779501:0:6579:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426104448 00000100:00100000:0.0:1777051496.779510:0:6579:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426104448 00000100:00100000:0.0:1777051496.779588:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13489 00000100:00100000:0.0:1777051496.779604:0:6579:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d944073800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+7:2435:x1863365426104448:12345-192.168.201.46@tcp:400:ptlrpcd_rcv.0 00010000:00080000:0.0:1777051496.779628:0:6579:0:(ldlm_lib.c:3120:target_queue_recovery_request()) @@@ queue final req req@ffff99d944073800 x1863365426104448/t0(0) o400->c11b6966-0775-44d2-bdc6-c74c26eb2226@192.168.201.46@tcp:457/0 lens 224/0 e 0 to 0 dl 1777051507 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1777051496.779661:0:6579:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d944073800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+7:2435:x1863365426104448:12345-192.168.201.46@tcp:400:ptlrpcd_rcv.0 Request processed in 62us (514us total) trans 0 rc 0/-999 00000100:00100000:0.0:1777051496.779673:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13489 00000100:00100000:0.0:1777051496.783602:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051496.783695:0:27882:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426104576 00000100:00100000:1.0:1777051496.783705:0:27882:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426104576 00000100:00100000:0.0:1777051496.783779:0:27885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13490 00000100:00100000:0.0:1777051496.783796:0:27885:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942d22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+9:2435:x1863365426104576:12345-192.168.201.46@tcp:400:ptlrpcd_rcv.0 00010000:00080000:0.0:1777051496.783817:0:27885:0:(ldlm_lib.c:3120:target_queue_recovery_request()) @@@ queue final req req@ffff99d942d22300 x1863365426104576/t0(0) o400->2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp:457/0 lens 224/0 e 0 to 0 dl 1777051507 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1777051496.783889:0:27885:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942d22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+9:2435:x1863365426104576:12345-192.168.201.46@tcp:400:ptlrpcd_rcv.0 Request processed in 98us (294us total) trans 0 rc 0/-999 00000100:00100000:0.0:1777051496.783907:0:27885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13490 00010000:00080000:1.0:1777051496.784081:0:109212:0:(ldlm_lib.c:2271:check_for_next_lock()) waking for completed lock replay 00000001:00000004:0.0:1777051496.784688:0:109212:0:(tgt_lastrcvd.c:732:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 8, last_transno is 34359738368 00000001:00100000:2.0:1777051496.796635:0:109175:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 2dd4696c-edce-4cd1-86d2-dbd2ff957fa1 00000001:00100000:2.0:1777051496.796648:0:109175:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of c11b6966-0775-44d2-bdc6-c74c26eb2226 00000001:00100000:2.0:1777051496.796656:0:109175:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00080000:0.0:1777051496.797106:0:109212:0:(tgt_lastrcvd.c:223:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00010000:00080000:0.0:1777051496.797499:0:109212:0:(ldlm_lib.c:1982:target_cancel_recovery_timer()) lustre-MDT0000: cancel recovery timer 00010000:00080000:0.0:1777051496.797520:0:109212:0:(ldlm_lib.c:2923:target_recovery_thread()) @@@ processing final ping from 0@lo: req@ffff99d942d21c00 x1863365452712448/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:457/0 lens 224/0 e 0 to 0 dl 1777051507 ref 1 fl Complete:/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00010000:00080000:0.0:1777051496.797683:0:109212:0:(ldlm_lib.c:2923:target_recovery_thread()) @@@ processing final ping from 192.168.201.46@tcp: req@ffff99d944073800 x1863365426104448/t0(0) o400->c11b6966-0775-44d2-bdc6-c74c26eb2226@192.168.201.46@tcp:457/0 lens 224/0 e 0 to 0 dl 1777051507 ref 1 fl Complete:H/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1777051496.797730:0:3676:0:(import.c:65:import_set_state_nolock()) ffff99da5f3d6000 lustre-MDT0000_UUID: changing import state from REPLAY_WAIT to RECOVER 00000100:00080000:2.0:1777051496.797746:0:3676:0:(client.c:3223:ptlrpc_resend_req()) @@@ going to resend req@ffff99d955611f80 x1863365452712448/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1777051512 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1777051496.797765:0:3676:0:(client.c:3232:ptlrpc_resend_req()) @@@ it has reply, so skip it req@ffff99d955611f80 x1863365452712448/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1777051512 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1777051496.797778:0:3676:0:(import.c:65:import_set_state_nolock()) ffff99da5f3d6000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00010000:00080000:0.0:1777051496.797796:0:109212:0:(ldlm_lib.c:2923:target_recovery_thread()) @@@ processing final ping from 192.168.201.46@tcp: req@ffff99d942d22300 x1863365426104576/t0(0) o400->2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp:457/0 lens 224/0 e 0 to 0 dl 1777051507 ref 1 fl Complete:H/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:02000000:2.0:1777051496.797815:0:3676:0:(import.c:1737:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-osp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00080000:2.0:1777051496.797828:0:3676:0:(recover.c:189:ptlrpc_wake_delayed()) @@@ waking (set 00000000636ab25a): req@ffff99da7fdf0e00 x1863365452691712/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1777051489 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00010000:02000000:0.0:1777051496.797880:0:109212:0:(ldlm_lib.c:1854:target_finish_recovery()) lustre-MDT0000: Recovery over after 0:03, of 3 clients 3 recovered and 0 were evicted. 00000100:00100000:2.0:1777051496.797887:0:3676:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955611f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3676:1863365452712448:0@lo:400:ptlrpcd_rcv.0 00000100:00100000:1.0:1777051496.798490:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d944073480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452712576:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1777051496.798558:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051496.798630:0:6584:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452712576 00000100:00100000:2.0:1777051496.798642:0:6584:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452712576 00000100:00100000:1.0:1777051496.798650:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051496.798713:0:6584:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452691712 00000100:00100000:2.0:1777051496.798720:0:6584:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452691712 00000100:00100000:2.0:1777051496.799047:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8347 00000100:00100000:2.0:1777051496.799065:0:6584:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f97df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:3677:x1863365452712576:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1777051496.799106:0:6584:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4194304 pending 0 free 1441550336 avail 1295310848 00000100:00100000:1.0:1777051496.799151:0:46498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8348 00000100:00100000:1.0:1777051496.799169:0:46498:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f97fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+8:3677:x1863365452691712:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1777051496.799186:0:6584:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f97df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:3677:x1863365452712576:12345-0@lo:41:osp-pre-0-1.0 Request processed in 122us (624us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051496.799197:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8347 00000004:00000024:1.0:1777051496.799243:0:46498:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4194304 pending 0 free 1441550336 avail 1295310848 00000100:00100000:2.0:1777051496.799276:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d944073480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452712576:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1777051496.799305:0:46498:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f97fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+7:3677:x1863365452691712:12345-0@lo:41:osp-pre-0-1.0 Request processed in 139us (657us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051496.799317:0:46498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8348 00000100:00100000:2.0:1777051496.799351:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7fdf0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452691712:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1777051496.809956:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051496.810407:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051496.810579:0:8492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426095104 00000100:00100000:1.0:1777051496.810592:0:8492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426095104 00000100:00100000:1.0:1777051496.810658:0:8492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426104704 00000100:00100000:1.0:1777051496.810663:0:8492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426104704 00000100:00100000:1.0:1777051496.810698:0:8492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112431 00000100:00100000:1.0:1777051496.810714:0:8492:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d944071180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+8:139487:x1863365426095104:12345-192.168.201.46@tcp:58:md5sum.0 00000100:00100000:1.0:1777051496.810943:0:8492:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d944071180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+8:139487:x1863365426095104:12345-192.168.201.46@tcp:58:md5sum.0 Request processed in 229us (990us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051496.810957:0:8492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112431 00000100:00100000:1.0:1777051496.810991:0:8492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112432 00000100:00100000:1.0:1777051496.811004:0:8492:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d944073480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+7:139760:x1863365426104704:12345-192.168.201.46@tcp:59:kuc_reregister.0 00000100:00100000:1.0:1777051496.811067:0:8492:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d944073480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+7:139760:x1863365426104704:12345-192.168.201.46@tcp:59:kuc_reregister.0 Request processed in 65us (660us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051496.811078:0:8492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112432 00000100:00100000:1.0:1777051496.821057:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051496.821367:0:21368:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426104960 00000100:00100000:2.0:1777051496.821380:0:21368:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426104960 00000100:00100000:2.0:1777051496.821484:0:21368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112433 00000100:00100000:2.0:1777051496.821499:0:21368:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f97f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+7:139487:x1863365426104960:12345-192.168.201.46@tcp:101:md5sum.0 00010000:00010000:2.0:1777051496.821524:0:21368:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051496.821546:0:21368:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d955918000/0x85f51a6b967179fb lrc: 2/0,0 mode: --/CR res: [0x2000032e3:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6a7f expref: -99 pid: 21368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051496.821608:0:21368:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99d953285a00/0x85f51a6b96717881 lrc: 2/0,1 mode: EX/EX res: [0x2000032e3:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 109205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051496.821625:0:21368:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d955918000/0x85f51a6b967179fb lrc: 4/0,0 mode: --/CR res: [0x2000032e3:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6a7f expref: 8 pid: 21368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051496.821652:0:21368:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff99d953285a00/0x85f51a6b96717881 lrc: 3/0,1 mode: EX/EX res: [0x2000032e3:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 109205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051496.821673:0:21368:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d955918000/0x85f51a6b967179fb lrc: 3/0,0 mode: --/CR res: [0x2000032e3:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6a7f expref: 8 pid: 21368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051496.821694:0:21368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e3:0xb:0x0].0x0 (ffff99d94e5e2300) 00010000:00010000:2.0:1777051496.821698:0:21368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1777051496.821747:0:21368:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cee00/0x85f51a6b967179df lrc: 2/0,0 mode: --/CR res: [0x2000032e3:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6a40 expref: 8 pid: 109212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051496.821763:0:21368:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d955918000, rc 0) 00000100:00100000:2.0:1777051496.821871:0:21368:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f97f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+8:139487:x1863365426104960:12345-192.168.201.46@tcp:101:md5sum.0 Request processed in 374us (821us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051496.821893:0:21368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112433 00000004:00000080:0.0:1777051496.846104:0:109212:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb089471f3e10 00100000:10000000:0.0:1777051496.846120:0:109212:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000004:00080000:1.0:1777051496.847507:0:109194:0:(osp_precreate.c:877:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x1e6:0x0] 00000004:00080000:3.0:1777051496.847583:0:109196:0:(osp_precreate.c:877:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x1e5:0x0] 00000100:00100000:1.0:1777051496.847630:0:109194:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95f97d500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:109194:1863365452712704:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1777051496.847632:0:109196:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d944070e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:109196:1863365452712832:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1777051496.847763:0:109196:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051496.847829:0:109196:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d944863840 going to sleep for 11 seconds 00000100:00100000:1.0:1777051496.847832:0:8470:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452712832 00000100:00100000:1.0:1777051496.847865:0:8470:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452712832 00000100:00100000:3.0:1777051496.847893:0:109194:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051496.847936:0:109194:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d9591d5900 going to sleep for 11 seconds 00000100:00100000:1.0:1777051496.847972:0:8470:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452712704 00000100:00100000:1.0:1777051496.847980:0:8470:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452712704 00000100:00100000:1.0:1777051496.848037:0:8470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8103 00000100:00100000:1.0:1777051496.848057:0:8470:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d944071f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:109196:x1863365452712832:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1777051496.848098:0:8470:0:(ofd_dev.c:1637:ofd_create_hdl()) ofd_last_id() = 513 -> diff = -28 00002000:02000040:1.0:1777051496.848106:0:8470:0:(ofd_dev.c:1488:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:486 to 0x2c0000401:513) 00000100:00100000:0.0:1777051496.848669:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8104 00000100:00100000:0.0:1777051496.848691:0:8471:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f16ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:109194:x1863365452712704:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1777051496.848721:0:8471:0:(ofd_dev.c:1637:ofd_create_hdl()) ofd_last_id() = 513 -> diff = -27 00002000:02000040:0.0:1777051496.848728:0:8471:0:(ofd_dev.c:1488:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:487 to 0x280000401:513) 00002000:00010000:1.0:1777051496.873543:0:8470:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x201:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777051496.873560:0:8470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b706d3c5/0x85f51a6b96717a02 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x201:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.873587:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051496.873592:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051496.873601:0:8470:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b706d3c5/0x85f51a6b96717a02 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x201:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.873650:0:8470:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b706d3c5/0x85f51a6b96717a02 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x201:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.873686:0:8470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b706d3c5/0x85f51a6b96717a02 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x201:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.873703:0:8470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b706d3c5/0x85f51a6b96717a02 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x201:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.873738:0:8470:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1777051496.874046:0:8470:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x200:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777051496.874058:0:8470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f08ea014/0x85f51a6b96717a09 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x200:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.874075:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051496.874079:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051496.874085:0:8470:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f08ea014/0x85f51a6b96717a09 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x200:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.874432:0:8470:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f08ea014/0x85f51a6b96717a09 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x200:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.874449:0:8470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f08ea014/0x85f51a6b96717a09 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x200:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.874463:0:8470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f08ea014/0x85f51a6b96717a09 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x200:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.874493:0:8470:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1777051496.874629:0:8470:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x1ff:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777051496.874641:0:8470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e8f01ee1/0x85f51a6b96717a10 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1ff:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.874656:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051496.874659:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051496.874664:0:8470:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e8f01ee1/0x85f51a6b96717a10 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.874682:0:8470:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e8f01ee1/0x85f51a6b96717a10 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.874696:0:8470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e8f01ee1/0x85f51a6b96717a10 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.874720:0:8470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e8f01ee1/0x85f51a6b96717a10 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.874748:0:8470:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1777051496.874766:0:13753:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1777051496.874777:0:13753:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b706d3c5/0x85f51a6b96717a02 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x201:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.874792:0:13753:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da5f900000 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:1.0:1777051496.874800:0:13753:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b706d3c5/0x85f51a6b96717a02 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x201:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.874816:0:13753:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b706d3c5/0x85f51a6b96717a02 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x201:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.874876:0:13753:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b706d3c5/0x85f51a6b96717a02 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x201:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.874893:0:13753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b706d3c5/0x85f51a6b96717a02 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x201:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.874925:0:13753:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1777051496.874933:0:13753:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f08ea014/0x85f51a6b96717a09 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x200:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.874956:0:13753:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da5f900400 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:1.0:1777051496.874963:0:13753:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f08ea014/0x85f51a6b96717a09 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x200:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.874979:0:13753:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f08ea014/0x85f51a6b96717a09 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x200:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.874998:0:13753:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f08ea014/0x85f51a6b96717a09 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x200:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.875012:0:13753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f08ea014/0x85f51a6b96717a09 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x200:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.875033:0:13753:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777051496.875039:0:13753:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e8f01ee1/0x85f51a6b96717a10 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.875049:0:13753:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da5f901600 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:1.0:1777051496.875055:0:13753:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e8f01ee1/0x85f51a6b96717a10 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.875067:0:13753:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e8f01ee1/0x85f51a6b96717a10 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.875084:0:13753:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e8f01ee1/0x85f51a6b96717a10 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051496.875094:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051496.875103:0:13753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e8f01ee1/0x85f51a6b96717a10 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.875125:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051496.875128:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051496.875132:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1777051496.875242:0:8470:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x1fe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777051496.875254:0:8470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000013f3cb26/0x85f51a6b96717a17 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1fe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.875270:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051496.875274:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051496.875280:0:8470:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000013f3cb26/0x85f51a6b96717a17 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.875299:0:8470:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000013f3cb26/0x85f51a6b96717a17 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.875313:0:8470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000013f3cb26/0x85f51a6b96717a17 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.875327:0:8470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000013f3cb26/0x85f51a6b96717a17 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.875373:0:8470:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1777051496.875438:0:8470:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x1fd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777051496.875448:0:8470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000021a9fc50/0x85f51a6b96717a1e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1fd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.875462:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051496.875465:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051496.875470:0:8470:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000021a9fc50/0x85f51a6b96717a1e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.875485:0:8470:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000021a9fc50/0x85f51a6b96717a1e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.875498:0:8470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000021a9fc50/0x85f51a6b96717a1e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.875511:0:8470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000021a9fc50/0x85f51a6b96717a1e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.875547:0:8470:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1777051496.875558:0:6567:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1777051496.875572:0:6567:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000013f3cb26/0x85f51a6b96717a17 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051496.875600:0:6567:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da5f901c00 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:3.0:1777051496.875608:0:6567:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000013f3cb26/0x85f51a6b96717a17 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1777051496.875625:0:8470:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x1fc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777051496.875627:0:6567:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000013f3cb26/0x85f51a6b96717a17 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.875643:0:8470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000032e29fd6/0x85f51a6b96717a25 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1fc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.875662:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051496.875662:0:6567:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000013f3cb26/0x85f51a6b96717a17 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.875668:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051496.875675:0:8470:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000032e29fd6/0x85f51a6b96717a25 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051496.875693:0:6567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000013f3cb26/0x85f51a6b96717a17 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.875708:0:8470:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000032e29fd6/0x85f51a6b96717a25 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.875726:0:8470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000032e29fd6/0x85f51a6b96717a25 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051496.875729:0:6567:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777051496.875740:0:6567:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000021a9fc50/0x85f51a6b96717a1e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.875747:0:8470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000032e29fd6/0x85f51a6b96717a25 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051496.875774:0:6567:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da5f900a00 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:3.0:1777051496.875782:0:6567:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000021a9fc50/0x85f51a6b96717a1e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.875792:0:8470:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1777051496.875803:0:6567:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000021a9fc50/0x85f51a6b96717a1e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051496.875826:0:6567:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000021a9fc50/0x85f51a6b96717a1e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051496.876168:0:38719:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777051496.876179:0:38719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000032e29fd6/0x85f51a6b96717a25 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051496.876193:0:38719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da5f900e00 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:2.0:1777051496.876199:0:38719:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000032e29fd6/0x85f51a6b96717a25 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051496.876213:0:38719:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000032e29fd6/0x85f51a6b96717a25 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051496.876234:0:38719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000032e29fd6/0x85f51a6b96717a25 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051496.876247:0:38719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000032e29fd6/0x85f51a6b96717a25 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051496.876284:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777051496.876288:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777051496.876291:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051496.876379:0:6567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000021a9fc50/0x85f51a6b96717a1e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051496.876404:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051496.876408:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051496.876411:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051496.876422:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1777051496.878122:0:8470:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x1fb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777051496.878135:0:8470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000363a3cde/0x85f51a6b96717a2c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1fb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.878151:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051496.878153:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051496.878159:0:8470:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000363a3cde/0x85f51a6b96717a2c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.878177:0:8470:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000363a3cde/0x85f51a6b96717a2c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.878192:0:8470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000363a3cde/0x85f51a6b96717a2c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.878467:0:8470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000363a3cde/0x85f51a6b96717a2c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.878516:0:8470:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1777051496.878533:0:13753:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777051496.878542:0:13753:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000363a3cde/0x85f51a6b96717a2c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.878557:0:13753:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da5f901200 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:1.0:1777051496.878564:0:13753:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000363a3cde/0x85f51a6b96717a2c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.878579:0:13753:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000363a3cde/0x85f51a6b96717a2c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.878603:0:13753:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000363a3cde/0x85f51a6b96717a2c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.878617:0:13753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000363a3cde/0x85f51a6b96717a2c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.879315:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051496.879320:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051496.879323:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1777051496.879423:0:8470:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x1fa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777051496.879434:0:8470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e0e2f189/0x85f51a6b96717a33 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1fa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.879450:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051496.879453:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051496.879458:0:8470:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e0e2f189/0x85f51a6b96717a33 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.879485:0:8470:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e0e2f189/0x85f51a6b96717a33 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.879499:0:8470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e0e2f189/0x85f51a6b96717a33 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.879513:0:8470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e0e2f189/0x85f51a6b96717a33 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.879552:0:8470:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1777051496.879576:0:38719:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777051496.879588:0:38719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e0e2f189/0x85f51a6b96717a33 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051496.879605:0:38719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da5f900c00 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:2.0:1777051496.879611:0:38719:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e0e2f189/0x85f51a6b96717a33 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1777051496.879622:0:8470:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x1f9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1777051496.879628:0:38719:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e0e2f189/0x85f51a6b96717a33 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.879635:0:8470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006b5617dd/0x85f51a6b96717a3a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1f9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051496.879658:0:38719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e0e2f189/0x85f51a6b96717a33 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051496.879673:0:38719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e0e2f189/0x85f51a6b96717a33 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051496.879699:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777051496.879703:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777051496.879706:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051496.880596:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051496.880599:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051496.880605:0:8470:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006b5617dd/0x85f51a6b96717a3a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.880625:0:8470:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006b5617dd/0x85f51a6b96717a3a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.880640:0:8470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006b5617dd/0x85f51a6b96717a3a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.880671:0:8470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006b5617dd/0x85f51a6b96717a3a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.880701:0:8470:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1777051496.880773:0:8470:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x1f8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777051496.880783:0:8470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000335e6a76/0x85f51a6b96717a41 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1f8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.881124:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051496.881128:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051496.881135:0:8470:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000335e6a76/0x85f51a6b96717a41 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.881155:0:8470:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000335e6a76/0x85f51a6b96717a41 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.881170:0:8470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000335e6a76/0x85f51a6b96717a41 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.881182:0:8470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000335e6a76/0x85f51a6b96717a41 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.881508:0:8470:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1777051496.881583:0:8470:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x1f7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777051496.881593:0:8470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008e12edc1/0x85f51a6b96717a48 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1f7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.881608:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051496.881611:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051496.881617:0:8470:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008e12edc1/0x85f51a6b96717a48 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.881634:0:8470:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008e12edc1/0x85f51a6b96717a48 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.881648:0:8470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008e12edc1/0x85f51a6b96717a48 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051496.881655:0:6568:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1777051496.881670:0:8470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008e12edc1/0x85f51a6b96717a48 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051496.881671:0:6568:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006b5617dd/0x85f51a6b96717a3a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051496.881710:0:6568:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da5f900800 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:3.0:1777051496.881718:0:6568:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006b5617dd/0x85f51a6b96717a3a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.881721:0:8470:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1777051496.881741:0:13753:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1777051496.881741:0:6568:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006b5617dd/0x85f51a6b96717a3a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.881751:0:13753:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000335e6a76/0x85f51a6b96717a41 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.881775:0:13753:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da5f901000 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:3.0:1777051496.881780:0:6568:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006b5617dd/0x85f51a6b96717a3a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.881783:0:13753:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000335e6a76/0x85f51a6b96717a41 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.881824:0:13753:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000335e6a76/0x85f51a6b96717a41 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051496.881824:0:6568:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006b5617dd/0x85f51a6b96717a3a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.881902:0:13753:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000335e6a76/0x85f51a6b96717a41 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051496.881910:0:6568:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777051496.881923:0:6568:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008e12edc1/0x85f51a6b96717a48 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.881951:0:13753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000335e6a76/0x85f51a6b96717a41 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051496.881956:0:6568:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da5f901e00 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:3.0:1777051496.881967:0:6568:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008e12edc1/0x85f51a6b96717a48 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051496.881987:0:6568:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008e12edc1/0x85f51a6b96717a48 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.881989:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051496.881995:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051496.882000:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051496.882016:0:6568:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008e12edc1/0x85f51a6b96717a48 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051496.882032:0:6568:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008e12edc1/0x85f51a6b96717a48 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051496.882064:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051496.882068:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051496.882072:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1777051496.882085:0:8470:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x1f6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777051496.882086:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051496.882098:0:8470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000071f883b7/0x85f51a6b96717a4f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1f6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.882112:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051496.882115:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051496.882120:0:8470:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000071f883b7/0x85f51a6b96717a4f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.882135:0:8470:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000071f883b7/0x85f51a6b96717a4f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.882149:0:8470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000071f883b7/0x85f51a6b96717a4f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.882162:0:8470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000071f883b7/0x85f51a6b96717a4f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.882185:0:8470:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1777051496.882293:0:8470:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x1f5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777051496.882304:0:8470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ab7b2c45/0x85f51a6b96717a56 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1f5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.882319:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051496.882321:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051496.882326:0:8470:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ab7b2c45/0x85f51a6b96717a56 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.882341:0:8470:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ab7b2c45/0x85f51a6b96717a56 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.882356:0:8470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ab7b2c45/0x85f51a6b96717a56 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.882368:0:8470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ab7b2c45/0x85f51a6b96717a56 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.882391:0:8470:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1777051496.882404:0:13753:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1777051496.882410:0:13753:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000071f883b7/0x85f51a6b96717a4f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.882422:0:13753:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da5f901400 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:1.0:1777051496.882428:0:13753:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000071f883b7/0x85f51a6b96717a4f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.882442:0:13753:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000071f883b7/0x85f51a6b96717a4f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.882469:0:13753:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000071f883b7/0x85f51a6b96717a4f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.882483:0:13753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000071f883b7/0x85f51a6b96717a4f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.882505:0:13753:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777051496.882511:0:13753:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ab7b2c45/0x85f51a6b96717a56 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.882522:0:13753:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da5f900200 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:1.0:1777051496.882528:0:13753:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ab7b2c45/0x85f51a6b96717a56 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.882540:0:13753:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ab7b2c45/0x85f51a6b96717a56 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.882558:0:13753:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ab7b2c45/0x85f51a6b96717a56 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.882570:0:13753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ab7b2c45/0x85f51a6b96717a56 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.882588:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051496.882591:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051496.882595:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1777051496.882681:0:8470:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x1f4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777051496.882691:0:8470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a7391002/0x85f51a6b96717a5d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1f4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.882705:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051496.882708:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051496.882714:0:8470:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a7391002/0x85f51a6b96717a5d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.883043:0:8470:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a7391002/0x85f51a6b96717a5d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.883060:0:8470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a7391002/0x85f51a6b96717a5d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.883074:0:8470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a7391002/0x85f51a6b96717a5d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.883101:0:8470:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1777051496.883170:0:8470:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x1f3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777051496.883180:0:8470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b3a313e9/0x85f51a6b96717a64 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1f3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.883195:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051496.883234:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051496.883241:0:8470:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b3a313e9/0x85f51a6b96717a64 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.883268:0:8470:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b3a313e9/0x85f51a6b96717a64 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.883281:0:8470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b3a313e9/0x85f51a6b96717a64 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.883294:0:8470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b3a313e9/0x85f51a6b96717a64 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.883322:0:8470:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1777051496.883341:0:6568:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1777051496.883353:0:6568:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a7391002/0x85f51a6b96717a5d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051496.883369:0:6568:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94fde6e00 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:3.0:1777051496.883376:0:6568:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a7391002/0x85f51a6b96717a5d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1777051496.883396:0:8470:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x1f2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777051496.883402:0:6568:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a7391002/0x85f51a6b96717a5d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.883407:0:8470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000daba5a45/0x85f51a6b96717a6b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1f2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.883436:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051496.883441:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051496.883441:0:6568:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a7391002/0x85f51a6b96717a5d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.883450:0:8470:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000daba5a45/0x85f51a6b96717a6b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051496.883470:0:6568:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a7391002/0x85f51a6b96717a5d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.883483:0:8470:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000daba5a45/0x85f51a6b96717a6b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.883500:0:8470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000daba5a45/0x85f51a6b96717a6b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051496.883503:0:6568:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777051496.883516:0:6568:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b3a313e9/0x85f51a6b96717a64 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.883521:0:8470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000daba5a45/0x85f51a6b96717a6b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051496.883550:0:6568:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94fde7000 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:3.0:1777051496.883558:0:6568:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b3a313e9/0x85f51a6b96717a64 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.883566:0:8470:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1777051496.883581:0:6568:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b3a313e9/0x85f51a6b96717a64 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.883586:0:13753:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777051496.883598:0:13753:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000daba5a45/0x85f51a6b96717a6b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051496.883608:0:6568:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b3a313e9/0x85f51a6b96717a64 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.883617:0:13753:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94fde7600 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:1.0:1777051496.883628:0:13753:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000daba5a45/0x85f51a6b96717a6b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051496.883633:0:6568:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b3a313e9/0x85f51a6b96717a64 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.883667:0:13753:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000daba5a45/0x85f51a6b96717a6b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051496.883711:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051496.883712:0:13753:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000daba5a45/0x85f51a6b96717a6b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051496.883717:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051496.883723:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051496.884075:0:13753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000daba5a45/0x85f51a6b96717a6b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.884110:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051496.884114:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051496.884118:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777051496.884434:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1777051496.884489:0:8470:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x1f1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777051496.884500:0:8470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008f6ffb1c/0x85f51a6b96717a72 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1f1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.884515:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051496.884519:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051496.884525:0:8470:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008f6ffb1c/0x85f51a6b96717a72 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.884542:0:8470:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008f6ffb1c/0x85f51a6b96717a72 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.884555:0:8470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008f6ffb1c/0x85f51a6b96717a72 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.884567:0:8470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008f6ffb1c/0x85f51a6b96717a72 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.884584:0:8470:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1777051496.884653:0:8470:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x1f0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777051496.884664:0:8470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000309db130/0x85f51a6b96717a79 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1f0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.884680:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051496.884683:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051496.884688:0:8470:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000309db130/0x85f51a6b96717a79 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.884705:0:8470:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000309db130/0x85f51a6b96717a79 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.884719:0:8470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000309db130/0x85f51a6b96717a79 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.884740:0:8470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000309db130/0x85f51a6b96717a79 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.884781:0:8470:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1777051496.884828:0:6568:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00002000:00010000:1.0:1777051496.884876:0:8470:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x1ef:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1777051496.884884:0:13753:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777051496.884888:0:8470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000081458a10/0x85f51a6b96717a80 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1ef:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051496.884896:0:6568:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008f6ffb1c/0x85f51a6b96717a72 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051496.884900:0:13753:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000309db130/0x85f51a6b96717a79 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.884921:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051496.884928:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051496.884938:0:8470:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000081458a10/0x85f51a6b96717a80 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051496.884944:0:6568:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94fde6400 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:2.0:1777051496.884948:0:13753:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94fde7e00 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:3.0:1777051496.884958:0:6568:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008f6ffb1c/0x85f51a6b96717a72 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051496.884962:0:13753:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000309db130/0x85f51a6b96717a79 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.884976:0:8470:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000081458a10/0x85f51a6b96717a80 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051496.884987:0:6568:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008f6ffb1c/0x85f51a6b96717a72 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.885006:0:8470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000081458a10/0x85f51a6b96717a80 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051496.885022:0:6568:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008f6ffb1c/0x85f51a6b96717a72 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.885023:0:8470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000081458a10/0x85f51a6b96717a80 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051496.885062:0:6568:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008f6ffb1c/0x85f51a6b96717a72 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.885078:0:8470:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1777051496.885093:0:6568:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777051496.885101:0:6568:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000081458a10/0x85f51a6b96717a80 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051496.885116:0:6568:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94fde6800 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:3.0:1777051496.885124:0:6568:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000081458a10/0x85f51a6b96717a80 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051496.885138:0:6568:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000081458a10/0x85f51a6b96717a80 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1777051496.885152:0:8470:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x1ee:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777051496.885160:0:6568:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000081458a10/0x85f51a6b96717a80 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.885165:0:8470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000019740601/0x85f51a6b96717a87 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1ee:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051496.885499:0:6568:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000081458a10/0x85f51a6b96717a80 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.885550:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051496.885555:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051496.885557:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051496.885563:0:8470:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000019740601/0x85f51a6b96717a87 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051496.885563:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777051496.885567:0:13753:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000309db130/0x85f51a6b96717a79 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051496.885567:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051496.885584:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051496.885606:0:8470:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000019740601/0x85f51a6b96717a87 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051496.885615:0:13753:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000309db130/0x85f51a6b96717a79 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.885631:0:8470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000019740601/0x85f51a6b96717a87 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051496.885638:0:13753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000309db130/0x85f51a6b96717a79 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.885666:0:8470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000019740601/0x85f51a6b96717a87 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051496.885688:0:13753:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777051496.885697:0:13753:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000019740601/0x85f51a6b96717a87 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.885706:0:8470:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1777051496.885715:0:13753:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94fde6000 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:3.0:1777051496.885715:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777051496.885771:0:13753:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000019740601/0x85f51a6b96717a87 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1777051496.885786:0:8470:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x1ed:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1777051496.885791:0:13753:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000019740601/0x85f51a6b96717a87 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.885799:0:8470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c27f2c60/0x85f51a6b96717a8e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1ed:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.885824:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051496.885827:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777051496.885827:0:13753:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000019740601/0x85f51a6b96717a87 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.885860:0:8470:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c27f2c60/0x85f51a6b96717a8e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051496.885889:0:13753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000019740601/0x85f51a6b96717a87 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.885897:0:8470:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c27f2c60/0x85f51a6b96717a8e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.885933:0:8470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c27f2c60/0x85f51a6b96717a8e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051496.885933:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777051496.885941:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777051496.885948:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051496.885953:0:8470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c27f2c60/0x85f51a6b96717a8e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051496.885962:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051496.885989:0:8470:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1777051496.886012:0:6567:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777051496.886021:0:6567:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c27f2c60/0x85f51a6b96717a8e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051496.886037:0:6567:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94fde7400 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:2.0:1777051496.886044:0:6567:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c27f2c60/0x85f51a6b96717a8e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051496.886060:0:6567:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c27f2c60/0x85f51a6b96717a8e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1777051496.886063:0:8470:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x1ec:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777051496.886084:0:8470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a9ece0d0/0x85f51a6b96717a95 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1ec:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051496.886093:0:6567:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c27f2c60/0x85f51a6b96717a8e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.886111:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051496.886118:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777051496.886123:0:6567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c27f2c60/0x85f51a6b96717a8e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.886417:0:8470:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a9ece0d0/0x85f51a6b96717a95 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.886438:0:8470:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a9ece0d0/0x85f51a6b96717a95 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.886452:0:8470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a9ece0d0/0x85f51a6b96717a95 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.886465:0:8470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a9ece0d0/0x85f51a6b96717a95 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.886492:0:8470:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1777051496.886573:0:8470:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x1eb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777051496.886582:0:8470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fa965377/0x85f51a6b96717a9c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1eb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.886597:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051496.886600:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051496.886606:0:8470:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fa965377/0x85f51a6b96717a9c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.886622:0:8470:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fa965377/0x85f51a6b96717a9c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.886636:0:8470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fa965377/0x85f51a6b96717a9c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.886650:0:8470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fa965377/0x85f51a6b96717a9c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.886675:0:8470:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1777051496.886738:0:8470:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x1ea:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777051496.886749:0:8470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008eeb07ab/0x85f51a6b96717aa3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1ea:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.886763:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051496.886768:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051496.886776:0:8470:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008eeb07ab/0x85f51a6b96717aa3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.886807:0:8470:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008eeb07ab/0x85f51a6b96717aa3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051496.886818:0:6567:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1777051496.886822:0:8470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008eeb07ab/0x85f51a6b96717aa3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051496.886828:0:6567:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a9ece0d0/0x85f51a6b96717a95 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051496.886874:0:6567:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94fde6a00 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:2.0:1777051496.886880:0:6567:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a9ece0d0/0x85f51a6b96717a95 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051496.886894:0:6567:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a9ece0d0/0x85f51a6b96717a95 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051496.886919:0:6567:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a9ece0d0/0x85f51a6b96717a95 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.886920:0:8470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008eeb07ab/0x85f51a6b96717aa3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051496.886960:0:6567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a9ece0d0/0x85f51a6b96717a95 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.886974:0:8470:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1777051496.887008:0:6567:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1777051496.887017:0:6567:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fa965377/0x85f51a6b96717a9c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051496.887031:0:6567:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94fde7a00 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:2.0:1777051496.887039:0:6567:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fa965377/0x85f51a6b96717a9c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1777051496.887053:0:8470:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x1e9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1777051496.887055:0:6567:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fa965377/0x85f51a6b96717a9c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.887073:0:8470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000083131eb4/0x85f51a6b96717aaa lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1e9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051496.887089:0:6567:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fa965377/0x85f51a6b96717a9c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.887095:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051496.887101:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051496.887111:0:8470:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000083131eb4/0x85f51a6b96717aaa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051496.887114:0:6567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fa965377/0x85f51a6b96717a9c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.887155:0:8470:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000083131eb4/0x85f51a6b96717aaa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051496.887172:0:6567:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777051496.887173:0:8470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000083131eb4/0x85f51a6b96717aaa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051496.887184:0:6567:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008eeb07ab/0x85f51a6b96717aa3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.887196:0:8470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000083131eb4/0x85f51a6b96717aaa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.887217:0:8470:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1777051496.887243:0:6567:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94fde7c00 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:2.0:1777051496.887250:0:6567:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008eeb07ab/0x85f51a6b96717aa3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051496.887266:0:6567:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008eeb07ab/0x85f51a6b96717aa3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051496.887287:0:6567:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008eeb07ab/0x85f51a6b96717aa3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051496.887301:0:6567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008eeb07ab/0x85f51a6b96717aa3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051496.887335:0:6567:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00002000:00010000:1.0:1777051496.887337:0:8470:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x1e8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1777051496.887342:0:6567:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000083131eb4/0x85f51a6b96717aaa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.887353:0:8470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000089729f8f/0x85f51a6b96717ab1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1e8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051496.887357:0:6567:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94fde6c00 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:2.0:1777051496.887369:0:6567:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000083131eb4/0x85f51a6b96717aaa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.887376:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051496.887384:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777051496.887390:0:6567:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000083131eb4/0x85f51a6b96717aaa lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.887392:0:8470:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000089729f8f/0x85f51a6b96717ab1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.887437:0:8470:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000089729f8f/0x85f51a6b96717ab1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051496.887440:0:6567:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000083131eb4/0x85f51a6b96717aaa lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.887477:0:8470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000089729f8f/0x85f51a6b96717ab1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051496.887479:0:6567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000083131eb4/0x85f51a6b96717aaa lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.887518:0:8470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000089729f8f/0x85f51a6b96717ab1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.887539:0:8470:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1777051496.887545:0:6567:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777051496.887554:0:6567:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000089729f8f/0x85f51a6b96717ab1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051496.887569:0:6567:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d9502da600 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:2.0:1777051496.887577:0:6567:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000089729f8f/0x85f51a6b96717ab1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051496.887592:0:6567:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000089729f8f/0x85f51a6b96717ab1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1777051496.887616:0:8470:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x1e7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1777051496.887619:0:6567:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000089729f8f/0x85f51a6b96717ab1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.887631:0:8470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f5390e87/0x85f51a6b96717ab8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1e7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051496.887640:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777051496.887644:0:6567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000089729f8f/0x85f51a6b96717ab1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.887665:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051496.887670:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051496.887677:0:8470:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f5390e87/0x85f51a6b96717ab8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051496.887688:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051496.887697:0:8470:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f5390e87/0x85f51a6b96717ab8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051496.887697:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777051496.887702:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051496.887717:0:8470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f5390e87/0x85f51a6b96717ab8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051496.887722:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051496.887735:0:8470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f5390e87/0x85f51a6b96717ab8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051496.887735:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051496.887772:0:8470:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1777051496.887800:0:6568:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777051496.887810:0:6568:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f5390e87/0x85f51a6b96717ab8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051496.887826:0:6568:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d9502da800 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:2.0:1777051496.887834:0:6568:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f5390e87/0x85f51a6b96717ab8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1777051496.887868:0:8470:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x1e6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1777051496.887882:0:6568:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f5390e87/0x85f51a6b96717ab8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.887885:0:8470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005574648a/0x85f51a6b96717abf lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1e6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.887926:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051496.887930:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777051496.887934:0:6568:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f5390e87/0x85f51a6b96717ab8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.887936:0:8470:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005574648a/0x85f51a6b96717abf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051496.887974:0:6568:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f5390e87/0x85f51a6b96717ab8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.887981:0:8470:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005574648a/0x85f51a6b96717abf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.888010:0:8470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005574648a/0x85f51a6b96717abf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051496.888020:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051496.888024:0:8470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005574648a/0x85f51a6b96717abf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051496.888025:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777051496.888033:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051496.888065:0:8470:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1777051496.888082:0:6567:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777051496.888088:0:6567:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005574648a/0x85f51a6b96717abf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.888101:0:6567:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d9502db200 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:1.0:1777051496.888108:0:6567:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005574648a/0x85f51a6b96717abf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.888121:0:6567:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005574648a/0x85f51a6b96717abf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.888141:0:6567:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005574648a/0x85f51a6b96717abf lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.888154:0:6567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005574648a/0x85f51a6b96717abf lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.888180:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051496.888184:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051496.888188:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:1.0:1777051496.888283:0:8470:0:(ofd_dev.c:1515:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:485 00000100:00100000:1.0:1777051496.888401:0:8470:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d944071f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:109196:x1863365452712832:12345-0@lo:5:osp-pre-1-0.0 Request processed in 40348us (40641us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051496.888416:0:8470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8103 00000100:00100000:3.0:1777051496.888450:0:109196:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d944070e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:109196:1863365452712832:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1777051496.888477:0:109196:0:(osp_precreate.c:955:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x201:0x0] from OST, last_created [0x2c0000401:0x201:0x0]last_used is [0x2c0000401:0x1e5:0x0] 00000100:00100000:3.0:1777051496.888586:0:109196:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94f169880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:109196:1863365452713088:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1777051496.888618:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94f169180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3678:1863365452712960:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1777051496.888644:0:109196:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051496.888674:0:109196:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d944863840 going to sleep for 11 seconds 00000100:00100000:1.0:1777051496.888702:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051496.888710:0:55805:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452713088 00000100:00100000:3.0:1777051496.888719:0:55805:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452713088 00000100:00100000:3.0:1777051496.888784:0:55805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8105 00000100:00100000:3.0:1777051496.888800:0:55805:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f16a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:109196:x1863365452713088:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1777051496.888813:0:8472:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452712960 00000100:00100000:1.0:1777051496.888823:0:8472:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452712960 00002000:00080000:3.0:1777051496.888880:0:55805:0:(ofd_dev.c:1745:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 514 00000100:00100000:1.0:1777051496.889029:0:8472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5706 00000100:00100000:1.0:1777051496.889051:0:8472:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f97ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3678:x1863365452712960:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1777051496.889422:0:8472:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 489209408 pending 896 free 3642707968 avail 3411185664 00000100:00100000:1.0:1777051496.889506:0:8472:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f97ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3678:x1863365452712960:12345-0@lo:13:osp-pre-1-0.0 Request processed in 461us (806us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051496.889522:0:8472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5706 00000100:00100000:1.0:1777051496.889700:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94f169180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3678:1863365452712960:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1777051496.890669:0:108751:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777051496.892801:0:55805:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f16a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:109196:x1863365452713088:12345-0@lo:5:osp-pre-1-0.0 Request processed in 3999us (4153us total) trans 4294968377 rc 0/0 00000100:00100000:3.0:1777051496.892818:0:55805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8105 00000100:00100000:1.0:1777051496.894020:0:109196:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94f169880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:109196:1863365452713088:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1777051496.894041:0:109196:0:(osp_precreate.c:701:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x201:0x0]-[0x2c0000401:0x221:0x0] 00002000:00010000:0.0:1777051496.894184:0:8471:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x201:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1777051496.894518:0:8471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab63dcae/0x85f51a6b96717ac6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x201:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051496.894545:0:8471:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777051496.894548:0:8471:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777051496.894554:0:8471:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab63dcae/0x85f51a6b96717ac6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x201:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051496.894583:0:8471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ab63dcae/0x85f51a6b96717ac6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x201:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051496.894595:0:8471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab63dcae/0x85f51a6b96717ac6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x201:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051496.894605:0:8471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ab63dcae/0x85f51a6b96717ac6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x201:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051496.894635:0:8471:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1777051496.894684:0:38719:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777051496.894696:0:38719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ab63dcae/0x85f51a6b96717ac6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x201:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051496.894712:0:38719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da7d775c00 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:2.0:1777051496.895390:0:38719:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab63dcae/0x85f51a6b96717ac6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x201:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051496.895411:0:38719:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab63dcae/0x85f51a6b96717ac6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x201:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051496.895439:0:38719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ab63dcae/0x85f51a6b96717ac6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x201:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051496.895452:0:38719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ab63dcae/0x85f51a6b96717ac6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x201:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051496.895483:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777051496.895487:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777051496.895491:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1777051496.895678:0:8471:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x200:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1777051496.895691:0:8471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e2d37904/0x85f51a6b96717acd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x200:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051496.895707:0:8471:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777051496.895709:0:8471:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777051496.895715:0:8471:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e2d37904/0x85f51a6b96717acd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x200:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051496.895734:0:8471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e2d37904/0x85f51a6b96717acd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x200:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051496.895751:0:8471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e2d37904/0x85f51a6b96717acd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x200:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051496.895765:0:8471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e2d37904/0x85f51a6b96717acd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x200:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051496.895798:0:8471:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1777051496.895887:0:13753:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777051496.895898:0:13753:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e2d37904/0x85f51a6b96717acd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x200:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051496.895913:0:13753:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da7d774600 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:2.0:1777051496.895919:0:13753:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2d37904/0x85f51a6b96717acd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x200:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1777051496.895929:0:8471:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x1ff:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1777051496.895940:0:8471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd4b732e/0x85f51a6b96717ad4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1ff:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051496.895946:0:13753:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2d37904/0x85f51a6b96717acd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x200:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051496.895957:0:8471:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777051496.895960:0:8471:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777051496.895966:0:8471:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fd4b732e/0x85f51a6b96717ad4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051496.895968:0:13753:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e2d37904/0x85f51a6b96717acd lrc: 1/0,0 mode: --/PW res: [0x280000401:0x200:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051496.895985:0:13753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2d37904/0x85f51a6b96717acd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x200:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051496.895986:0:8471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fd4b732e/0x85f51a6b96717ad4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051496.896003:0:8471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd4b732e/0x85f51a6b96717ad4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051496.896019:0:8471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fd4b732e/0x85f51a6b96717ad4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051496.896019:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777051496.896022:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777051496.896026:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777051496.896041:0:8471:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1777051496.896050:0:6568:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777051496.896058:0:6568:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fd4b732e/0x85f51a6b96717ad4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051496.896394:0:6568:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da7d774a00 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:2.0:1777051496.896401:0:6568:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd4b732e/0x85f51a6b96717ad4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051496.896416:0:6568:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd4b732e/0x85f51a6b96717ad4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051496.896438:0:6568:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fd4b732e/0x85f51a6b96717ad4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051496.896461:0:6568:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fd4b732e/0x85f51a6b96717ad4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051496.896493:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777051496.896536:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777051496.896540:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1777051496.896721:0:8471:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x1fe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1777051496.896733:0:8471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000379b0f3d/0x85f51a6b96717adb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1fe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051496.896749:0:8471:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777051496.896753:0:8471:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777051496.896760:0:8471:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000379b0f3d/0x85f51a6b96717adb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051496.896778:0:8471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000379b0f3d/0x85f51a6b96717adb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051496.896795:0:8471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000379b0f3d/0x85f51a6b96717adb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051496.897124:0:8471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000379b0f3d/0x85f51a6b96717adb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051496.897723:0:8471:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1777051496.897803:0:8471:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x1fd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1777051496.897813:0:8471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006d234ba4/0x85f51a6b96717ae2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1fd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051496.897830:0:8471:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777051496.897834:0:8471:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777051496.897869:0:8471:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006d234ba4/0x85f51a6b96717ae2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051496.897888:0:8471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006d234ba4/0x85f51a6b96717ae2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051496.897904:0:8471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006d234ba4/0x85f51a6b96717ae2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.897924:0:6567:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1777051496.897947:0:8471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006d234ba4/0x85f51a6b96717ae2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.897957:0:6567:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000379b0f3d/0x85f51a6b96717adb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051496.897979:0:8471:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1777051496.897999:0:108751:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777051496.898000:0:6567:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da7d774400 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:0.0:1777051496.898009:0:108751:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006d234ba4/0x85f51a6b96717ae2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.898012:0:6567:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000379b0f3d/0x85f51a6b96717adb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051496.898037:0:108751:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da7d775000 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:0.0:1777051496.898048:0:108751:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006d234ba4/0x85f51a6b96717ae2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.898059:0:6567:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000379b0f3d/0x85f51a6b96717adb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051496.898069:0:108751:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006d234ba4/0x85f51a6b96717ae2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051496.898103:0:108751:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006d234ba4/0x85f51a6b96717ae2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.898114:0:6567:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000379b0f3d/0x85f51a6b96717adb lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051496.898119:0:108751:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006d234ba4/0x85f51a6b96717ae2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.898157:0:6567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000379b0f3d/0x85f51a6b96717adb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051496.898169:0:108751:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777051496.898174:0:108751:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051496.898501:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051496.898506:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051496.898510:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1777051496.899046:0:8471:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x1fc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777051496.899058:0:8471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f7d49422/0x85f51a6b96717ae9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1fc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.899077:0:8471:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051496.899082:0:8471:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051496.899088:0:8471:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f7d49422/0x85f51a6b96717ae9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.899107:0:8471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f7d49422/0x85f51a6b96717ae9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051496.899414:0:108751:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051496.899433:0:8471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f7d49422/0x85f51a6b96717ae9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.899454:0:8471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f7d49422/0x85f51a6b96717ae9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051496.899562:0:8471:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1777051496.899679:0:8471:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x1fb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1777051496.899690:0:8471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000085b07969/0x85f51a6b96717af0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1fb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051496.899707:0:8471:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777051496.899710:0:8471:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777051496.899717:0:8471:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000085b07969/0x85f51a6b96717af0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051496.899735:0:8471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000085b07969/0x85f51a6b96717af0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051496.900071:0:8471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000085b07969/0x85f51a6b96717af0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051496.900087:0:8471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000085b07969/0x85f51a6b96717af0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051496.900113:0:8471:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1777051496.900182:0:8471:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x1fa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1777051496.900192:0:8471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d67d566d/0x85f51a6b96717af7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1fa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051496.900206:0:8471:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777051496.900209:0:8471:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777051496.900215:0:8471:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d67d566d/0x85f51a6b96717af7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051496.900234:0:8471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d67d566d/0x85f51a6b96717af7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051496.900251:0:8471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d67d566d/0x85f51a6b96717af7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051496.900299:0:8471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d67d566d/0x85f51a6b96717af7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051496.900325:0:8471:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1777051496.900371:0:13753:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1777051496.900383:0:13753:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f7d49422/0x85f51a6b96717ae9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1777051496.900386:0:8471:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x1f9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1777051496.900404:0:8471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a7be716/0x85f51a6b96717afe lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1f9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051496.900412:0:13753:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d9502daa00 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:3.0:1777051496.900423:0:13753:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f7d49422/0x85f51a6b96717ae9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051496.900428:0:8471:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777051496.900434:0:8471:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777051496.900442:0:8471:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a7be716/0x85f51a6b96717afe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051496.900452:0:13753:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f7d49422/0x85f51a6b96717ae9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051496.900466:0:8471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a7be716/0x85f51a6b96717afe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051496.900488:0:8471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a7be716/0x85f51a6b96717afe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051496.900490:0:13753:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f7d49422/0x85f51a6b96717ae9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051496.900518:0:8471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002a7be716/0x85f51a6b96717afe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051496.900527:0:13753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f7d49422/0x85f51a6b96717ae9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051496.900554:0:8471:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1777051496.900569:0:13753:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1777051496.900571:0:6567:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1777051496.900578:0:13753:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000085b07969/0x85f51a6b96717af0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051496.900582:0:6567:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d67d566d/0x85f51a6b96717af7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051496.900619:0:13753:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da4162e800 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:0.0:1777051496.900621:0:6567:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da4162f200 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:3.0:1777051496.900632:0:13753:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000085b07969/0x85f51a6b96717af0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051496.900634:0:6567:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d67d566d/0x85f51a6b96717af7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051496.900674:0:6567:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d67d566d/0x85f51a6b96717af7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051496.900693:0:6567:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d67d566d/0x85f51a6b96717af7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051496.900707:0:6567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d67d566d/0x85f51a6b96717af7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051496.900736:0:6567:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1777051496.900743:0:6567:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002a7be716/0x85f51a6b96717afe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051496.900758:0:6567:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da4162e200 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:0.0:1777051496.900765:0:6567:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002a7be716/0x85f51a6b96717afe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051496.900780:0:6567:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002a7be716/0x85f51a6b96717afe lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.900781:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777051496.901151:0:6567:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002a7be716/0x85f51a6b96717afe lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051496.901166:0:6567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a7be716/0x85f51a6b96717afe lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051496.901521:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777051496.901526:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777051496.901531:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1777051496.901611:0:8471:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x1f8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1777051496.901622:0:8471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bec49032/0x85f51a6b96717b05 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1f8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051496.901638:0:8471:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777051496.901642:0:8471:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777051496.901648:0:8471:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bec49032/0x85f51a6b96717b05 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051496.901665:0:8471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bec49032/0x85f51a6b96717b05 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051496.901680:0:8471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bec49032/0x85f51a6b96717b05 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051496.901703:0:8471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bec49032/0x85f51a6b96717b05 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051496.901741:0:8471:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1777051496.901753:0:108751:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1777051496.901760:0:108751:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bec49032/0x85f51a6b96717b05 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051496.901774:0:108751:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da4162f000 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:0.0:1777051496.901780:0:108751:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bec49032/0x85f51a6b96717b05 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051496.901794:0:108751:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bec49032/0x85f51a6b96717b05 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051496.901812:0:108751:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bec49032/0x85f51a6b96717b05 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051496.901826:0:108751:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bec49032/0x85f51a6b96717b05 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051496.901875:0:108751:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777051496.901879:0:108751:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777051496.901882:0:108751:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1777051496.901953:0:8471:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x1f7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1777051496.901963:0:8471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000933c9af1/0x85f51a6b96717b0c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1f7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051496.901977:0:8471:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777051496.901981:0:8471:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777051496.901987:0:8471:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000933c9af1/0x85f51a6b96717b0c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051496.902005:0:8471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000933c9af1/0x85f51a6b96717b0c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051496.902019:0:8471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000933c9af1/0x85f51a6b96717b0c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051496.902033:0:8471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000933c9af1/0x85f51a6b96717b0c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051496.902058:0:8471:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1777051496.902072:0:6568:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1777051496.902079:0:6568:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000933c9af1/0x85f51a6b96717b0c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051496.902102:0:6568:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da4162fe00 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:0.0:1777051496.902109:0:6568:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000933c9af1/0x85f51a6b96717b0c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051496.902116:0:13753:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000085b07969/0x85f51a6b96717af0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051496.902132:0:6568:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000933c9af1/0x85f51a6b96717b0c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051496.902152:0:13753:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000085b07969/0x85f51a6b96717af0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051496.902163:0:6568:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000933c9af1/0x85f51a6b96717b0c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051496.902175:0:13753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000085b07969/0x85f51a6b96717af0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051496.902247:0:6568:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000933c9af1/0x85f51a6b96717b0c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051496.902253:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051496.902260:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051496.902265:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777051496.902294:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777051496.902301:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051496.902308:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777051496.902310:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1777051496.902390:0:8471:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x1f6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1777051496.902402:0:8471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bc6f84ac/0x85f51a6b96717b13 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1f6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051496.902419:0:8471:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777051496.902422:0:8471:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777051496.902429:0:8471:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bc6f84ac/0x85f51a6b96717b13 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051496.902447:0:8471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bc6f84ac/0x85f51a6b96717b13 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051496.902463:0:8471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bc6f84ac/0x85f51a6b96717b13 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051496.902478:0:8471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bc6f84ac/0x85f51a6b96717b13 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051496.902512:0:8471:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1777051496.902583:0:8471:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x1f5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1777051496.902594:0:8471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001770da8c/0x85f51a6b96717b1a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1f5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.902596:0:6567:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777051496.902613:0:6567:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bc6f84ac/0x85f51a6b96717b13 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051496.902616:0:8471:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777051496.902621:0:8471:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777051496.902629:0:8471:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001770da8c/0x85f51a6b96717b1a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051496.902673:0:8471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001770da8c/0x85f51a6b96717b1a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.902675:0:6567:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da4162f400 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:1.0:1777051496.902688:0:6567:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bc6f84ac/0x85f51a6b96717b13 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051496.902697:0:8471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001770da8c/0x85f51a6b96717b1a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.902720:0:6567:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bc6f84ac/0x85f51a6b96717b13 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051496.902724:0:8471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001770da8c/0x85f51a6b96717b1a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.902776:0:6567:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bc6f84ac/0x85f51a6b96717b13 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051496.902777:0:8471:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1777051496.902797:0:108751:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777051496.902797:0:6567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bc6f84ac/0x85f51a6b96717b13 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051496.902807:0:108751:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001770da8c/0x85f51a6b96717b1a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051496.902832:0:108751:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da4162f800 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:1.0:1777051496.902893:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051496.902901:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051496.902905:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777051496.903124:0:108751:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001770da8c/0x85f51a6b96717b1a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051496.903147:0:108751:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001770da8c/0x85f51a6b96717b1a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051496.903183:0:108751:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001770da8c/0x85f51a6b96717b1a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051496.903197:0:108751:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001770da8c/0x85f51a6b96717b1a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051496.903227:0:108751:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777051496.903232:0:108751:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777051496.903236:0:108751:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1777051496.904083:0:8471:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x1f4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1777051496.904095:0:8471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004512d8ba/0x85f51a6b96717b21 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1f4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051496.904112:0:8471:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777051496.904458:0:8471:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777051496.904470:0:8471:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004512d8ba/0x85f51a6b96717b21 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051496.904493:0:8471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004512d8ba/0x85f51a6b96717b21 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051496.904511:0:8471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004512d8ba/0x85f51a6b96717b21 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051496.904650:0:8471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004512d8ba/0x85f51a6b96717b21 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051496.904685:0:8471:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1777051496.905653:0:13753:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1777051496.905664:0:13753:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004512d8ba/0x85f51a6b96717b21 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051496.905681:0:13753:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d955918200 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:0.0:1777051496.905689:0:13753:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004512d8ba/0x85f51a6b96717b21 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051496.905707:0:13753:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004512d8ba/0x85f51a6b96717b21 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051496.905732:0:13753:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004512d8ba/0x85f51a6b96717b21 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051496.905747:0:13753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004512d8ba/0x85f51a6b96717b21 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051496.905785:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777051496.905789:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777051496.905792:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1777051496.908587:0:8471:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x1f3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1777051496.908603:0:8471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009232a4c4/0x85f51a6b96717b28 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1f3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051496.908657:0:8471:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777051496.908662:0:8471:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777051496.908669:0:8471:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009232a4c4/0x85f51a6b96717b28 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051496.908689:0:8471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009232a4c4/0x85f51a6b96717b28 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051496.908704:0:8471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009232a4c4/0x85f51a6b96717b28 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051496.908718:0:8471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009232a4c4/0x85f51a6b96717b28 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051496.909415:0:8471:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1777051496.909522:0:8471:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x1f2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1777051496.909533:0:8471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e3987741/0x85f51a6b96717b2f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1f2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051496.909550:0:8471:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777051496.909553:0:8471:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777051496.909559:0:8471:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e3987741/0x85f51a6b96717b2f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051496.909614:0:8471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e3987741/0x85f51a6b96717b2f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051496.909632:0:8471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e3987741/0x85f51a6b96717b2f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051496.909646:0:8471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e3987741/0x85f51a6b96717b2f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.915403:0:38719:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1777051496.915417:0:38719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009232a4c4/0x85f51a6b96717b28 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.915437:0:38719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d955918800 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:1.0:1777051496.915445:0:38719:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009232a4c4/0x85f51a6b96717b28 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.915463:0:38719:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009232a4c4/0x85f51a6b96717b28 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.915494:0:38719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009232a4c4/0x85f51a6b96717b28 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.915509:0:38719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009232a4c4/0x85f51a6b96717b28 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.915720:0:6568:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777051496.915733:0:6568:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e3987741/0x85f51a6b96717b2f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051496.915746:0:8471:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1777051496.915750:0:6568:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d955919e00 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:1.0:1777051496.915761:0:6568:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e3987741/0x85f51a6b96717b2f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.915777:0:6568:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e3987741/0x85f51a6b96717b2f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051496.915794:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777051496.915802:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051496.915804:0:6568:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e3987741/0x85f51a6b96717b2f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051496.915807:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051496.915824:0:6568:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e3987741/0x85f51a6b96717b2f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1777051496.915929:0:8471:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x1f1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1777051496.915944:0:8471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000093658e07/0x85f51a6b96717b36 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1f1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051496.915964:0:8471:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777051496.915968:0:8471:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777051496.915976:0:8471:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000093658e07/0x85f51a6b96717b36 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051496.915981:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777051496.915988:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777051496.915995:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777051496.916006:0:8471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000093658e07/0x85f51a6b96717b36 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051496.916025:0:8471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000093658e07/0x85f51a6b96717b36 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051496.916040:0:8471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000093658e07/0x85f51a6b96717b36 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051496.916650:0:8471:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1777051496.916750:0:8471:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x1f0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1777051496.916761:0:8471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004512d8ba/0x85f51a6b96717b3d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1f0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051496.916777:0:8471:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777051496.916780:0:8471:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777051496.916787:0:8471:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004512d8ba/0x85f51a6b96717b3d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051496.916806:0:8471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004512d8ba/0x85f51a6b96717b3d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051496.916821:0:8471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004512d8ba/0x85f51a6b96717b3d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051496.916835:0:8471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004512d8ba/0x85f51a6b96717b3d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051496.916907:0:8471:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1777051496.916993:0:8471:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x1ef:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1777051496.917004:0:8471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a4edc261/0x85f51a6b96717b44 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1ef:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051496.917021:0:8471:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777051496.917024:0:8471:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777051496.917029:0:8471:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a4edc261/0x85f51a6b96717b44 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051496.917049:0:8471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a4edc261/0x85f51a6b96717b44 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051496.917066:0:8471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a4edc261/0x85f51a6b96717b44 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051496.917074:0:108751:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1777051496.917083:0:8471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a4edc261/0x85f51a6b96717b44 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051496.917089:0:108751:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000093658e07/0x85f51a6b96717b36 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051496.917120:0:108751:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d955919000 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:0.0:1777051496.917445:0:108751:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000093658e07/0x85f51a6b96717b36 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051496.917466:0:108751:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000093658e07/0x85f51a6b96717b36 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051496.917490:0:108751:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000093658e07/0x85f51a6b96717b36 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051496.917505:0:108751:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000093658e07/0x85f51a6b96717b36 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051496.917580:0:108751:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1777051496.917586:0:108751:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004512d8ba/0x85f51a6b96717b3d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051496.917599:0:108751:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d955918200 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:0.0:1777051496.917605:0:108751:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004512d8ba/0x85f51a6b96717b3d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051496.917620:0:108751:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004512d8ba/0x85f51a6b96717b3d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051496.917641:0:108751:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004512d8ba/0x85f51a6b96717b3d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051496.917655:0:108751:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004512d8ba/0x85f51a6b96717b3d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051496.917682:0:108751:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777051496.917682:0:8471:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1777051496.917694:0:108751:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a4edc261/0x85f51a6b96717b44 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051496.917708:0:108751:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d955a83600 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:0.0:1777051496.917714:0:108751:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a4edc261/0x85f51a6b96717b44 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051496.917741:0:108751:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a4edc261/0x85f51a6b96717b44 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051496.917759:0:108751:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a4edc261/0x85f51a6b96717b44 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051496.917775:0:108751:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a4edc261/0x85f51a6b96717b44 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051496.917802:0:108751:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777051496.917807:0:108751:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777051496.917812:0:108751:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1777051496.917817:0:8471:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x1ee:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1777051496.917827:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777051496.917832:0:8471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006bb9efe2/0x85f51a6b96717b4b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1ee:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051496.917877:0:8471:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777051496.917880:0:8471:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777051496.917886:0:8471:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006bb9efe2/0x85f51a6b96717b4b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051496.917905:0:8471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006bb9efe2/0x85f51a6b96717b4b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051496.917921:0:8471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006bb9efe2/0x85f51a6b96717b4b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051496.917936:0:8471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006bb9efe2/0x85f51a6b96717b4b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051496.917973:0:8471:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1777051496.918045:0:8471:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x1ed:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1777051496.918055:0:8471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000061e01dae/0x85f51a6b96717b52 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1ed:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051496.918072:0:8471:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777051496.918075:0:8471:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777051496.918081:0:8471:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000061e01dae/0x85f51a6b96717b52 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051496.918097:0:8471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000061e01dae/0x85f51a6b96717b52 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051496.918112:0:8471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000061e01dae/0x85f51a6b96717b52 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051496.918303:0:38719:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1777051496.918314:0:38719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006bb9efe2/0x85f51a6b96717b4b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051496.918328:0:38719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d955a83800 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:0.0:1777051496.918334:0:38719:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006bb9efe2/0x85f51a6b96717b4b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051496.918350:0:38719:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006bb9efe2/0x85f51a6b96717b4b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051496.918373:0:38719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006bb9efe2/0x85f51a6b96717b4b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051496.918405:0:8471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000061e01dae/0x85f51a6b96717b52 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051496.918438:0:8471:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1777051496.918523:0:38719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006bb9efe2/0x85f51a6b96717b4b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1777051496.918555:0:8471:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x1ec:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1777051496.918560:0:38719:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1777051496.918571:0:38719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000061e01dae/0x85f51a6b96717b52 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051496.918571:0:8471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000093f20249/0x85f51a6b96717b59 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1ec:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051496.918618:0:38719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d955a82000 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:2.0:1777051496.918622:0:8471:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777051496.918627:0:38719:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000061e01dae/0x85f51a6b96717b52 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051496.918628:0:8471:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777051496.918638:0:8471:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000093f20249/0x85f51a6b96717b59 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051496.918661:0:38719:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000061e01dae/0x85f51a6b96717b52 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051496.918672:0:8471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000093f20249/0x85f51a6b96717b59 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051496.918694:0:38719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000061e01dae/0x85f51a6b96717b52 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051496.918695:0:8471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000093f20249/0x85f51a6b96717b59 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051496.918740:0:38719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000061e01dae/0x85f51a6b96717b52 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051496.918743:0:8471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000093f20249/0x85f51a6b96717b59 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051496.918798:0:38719:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777051496.918801:0:8471:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1777051496.918806:0:38719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000093f20249/0x85f51a6b96717b59 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051496.918825:0:38719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d955a82a00 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:0.0:1777051496.918833:0:38719:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000093f20249/0x85f51a6b96717b59 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1777051496.918920:0:8471:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x1eb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1777051496.918932:0:8471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a299f281/0x85f51a6b96717b60 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1eb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051496.918949:0:8471:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777051496.918952:0:8471:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777051496.918958:0:8471:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a299f281/0x85f51a6b96717b60 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051496.918979:0:8471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a299f281/0x85f51a6b96717b60 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051496.918993:0:8471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a299f281/0x85f51a6b96717b60 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051496.919008:0:8471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a299f281/0x85f51a6b96717b60 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051496.919035:0:8471:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1777051496.919479:0:6567:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777051496.919492:0:6567:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a299f281/0x85f51a6b96717b60 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051496.919523:0:38719:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000093f20249/0x85f51a6b96717b59 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.919556:0:6567:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d955a83400 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:1.0:1777051496.919566:0:6567:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a299f281/0x85f51a6b96717b60 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051496.919569:0:38719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000093f20249/0x85f51a6b96717b59 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.919606:0:6567:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a299f281/0x85f51a6b96717b60 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051496.919607:0:38719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000093f20249/0x85f51a6b96717b59 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.919671:0:6567:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a299f281/0x85f51a6b96717b60 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051496.919674:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777051496.919682:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1777051496.919682:0:8471:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x1ea:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1777051496.919690:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051496.919705:0:6567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a299f281/0x85f51a6b96717b60 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051496.919707:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777051496.919707:0:8471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000c277583/0x85f51a6b96717b67 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1ea:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051496.919719:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777051496.919730:0:108751:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777051496.919754:0:8471:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777051496.919758:0:8471:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777051496.919765:0:8471:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000c277583/0x85f51a6b96717b67 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051496.919771:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051496.919779:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051496.919785:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777051496.919790:0:8471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000c277583/0x85f51a6b96717b67 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051496.919807:0:8471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000c277583/0x85f51a6b96717b67 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051496.919822:0:8471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000c277583/0x85f51a6b96717b67 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051496.919885:0:8471:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1777051496.919965:0:8471:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x1e9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1777051496.919976:0:8471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000091a91ec7/0x85f51a6b96717b6e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1e9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051496.919992:0:8471:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777051496.919995:0:8471:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777051496.920001:0:8471:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000091a91ec7/0x85f51a6b96717b6e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051496.920019:0:8471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000091a91ec7/0x85f51a6b96717b6e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051496.920035:0:8471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000091a91ec7/0x85f51a6b96717b6e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051496.920049:0:8471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000091a91ec7/0x85f51a6b96717b6e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051496.920095:0:8471:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1777051496.920163:0:38719:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1777051496.920175:0:38719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000c277583/0x85f51a6b96717b67 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051496.920191:0:38719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d955a83a00 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:0.0:1777051496.920198:0:38719:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000c277583/0x85f51a6b96717b67 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051496.920215:0:38719:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000c277583/0x85f51a6b96717b67 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051496.920252:0:38719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000c277583/0x85f51a6b96717b67 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051496.920268:0:38719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000c277583/0x85f51a6b96717b67 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051496.920299:0:38719:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1777051496.920306:0:38719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000091a91ec7/0x85f51a6b96717b6e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051496.920319:0:38719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d955a82200 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:0.0:1777051496.920325:0:38719:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000091a91ec7/0x85f51a6b96717b6e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051496.920341:0:38719:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000091a91ec7/0x85f51a6b96717b6e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051496.920360:0:38719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000091a91ec7/0x85f51a6b96717b6e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051496.920372:0:38719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000091a91ec7/0x85f51a6b96717b6e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051496.920425:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777051496.920431:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777051496.920436:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1777051496.920492:0:8471:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x1e8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1777051496.920506:0:8471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b1b9f242/0x85f51a6b96717b75 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1e8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051496.920523:0:8471:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777051496.920527:0:8471:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777051496.920533:0:8471:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b1b9f242/0x85f51a6b96717b75 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051496.920552:0:8471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b1b9f242/0x85f51a6b96717b75 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051496.920568:0:8471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b1b9f242/0x85f51a6b96717b75 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051496.920583:0:8471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b1b9f242/0x85f51a6b96717b75 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051496.920623:0:8471:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1777051496.920709:0:8471:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x1e7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1777051496.920720:0:8471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6f45056/0x85f51a6b96717b7c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1e7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051496.920737:0:8471:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777051496.920740:0:8471:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777051496.920747:0:8471:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f6f45056/0x85f51a6b96717b7c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051496.920764:0:8471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f6f45056/0x85f51a6b96717b7c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051496.920778:0:8471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6f45056/0x85f51a6b96717b7c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051496.920792:0:8471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f6f45056/0x85f51a6b96717b7c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051496.920814:0:8471:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00080000:2.0:1777051496.920905:0:8471:0:(ofd_dev.c:1515:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:486 00000100:00100000:2.0:1777051496.921045:0:8471:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f16ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:109194:x1863365452712704:12345-0@lo:5:osp-pre-0-0.0 Request processed in 72356us (73147us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051496.921064:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8104 00000100:00100000:2.0:1777051496.921424:0:109194:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95f97d500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:109194:1863365452712704:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1777051496.921488:0:109194:0:(osp_precreate.c:955:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x201:0x0] from OST, last_created [0x280000401:0x201:0x0]last_used is [0x280000401:0x1e6:0x0] 00000100:00100000:2.0:1777051496.921605:0:109194:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95fbaf800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:109194:1863365452713344:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1777051496.921678:0:109194:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051496.921721:0:109194:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d958f6d6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1777051496.921757:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95fbadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452713216:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1777051496.921789:0:6568:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1777051496.921803:0:6568:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b1b9f242/0x85f51a6b96717b75 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051496.921819:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1777051496.921835:0:6568:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d955a82800 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:0.0:1777051496.921880:0:6568:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b1b9f242/0x85f51a6b96717b75 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051496.921918:0:6568:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b1b9f242/0x85f51a6b96717b75 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051496.921933:0:8468:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452713344 00000100:00100000:2.0:1777051496.921947:0:8468:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452713344 00010000:00010000:0.0:1777051496.921952:0:6568:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b1b9f242/0x85f51a6b96717b75 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051496.922002:0:6568:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b1b9f242/0x85f51a6b96717b75 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051496.922393:0:6568:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1777051496.922404:0:6568:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f6f45056/0x85f51a6b96717b7c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051496.922420:0:6568:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94f69b600 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:0.0:1777051496.922426:0:6568:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6f45056/0x85f51a6b96717b7c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051496.922443:0:6568:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6f45056/0x85f51a6b96717b7c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051496.922469:0:6568:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f6f45056/0x85f51a6b96717b7c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051496.922483:0:6568:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f6f45056/0x85f51a6b96717b7c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051496.922520:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777051496.922526:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777051496.922530:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777051496.922544:0:108751:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1777051496.922685:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8106 00000100:00100000:2.0:1777051496.922714:0:8468:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95fbac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:109194:x1863365452713344:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1777051496.922778:0:8468:0:(ofd_dev.c:1745:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 514 00010000:00010000:1.0:1777051496.924286:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777051496.924496:0:47388:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452713216 00000100:00100000:3.0:1777051496.924508:0:47388:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452713216 00000100:00100000:3.0:1777051496.924579:0:47388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5707 00000100:00100000:3.0:1777051496.924598:0:47388:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95fbad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3679:x1863365452713216:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1777051496.924629:0:47388:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 499269184 pending 896 free 3860574208 avail 3629051904 00000100:00100000:3.0:1777051496.925086:0:47388:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95fbad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3679:x1863365452713216:12345-0@lo:13:osp-pre-0-0.0 Request processed in 490us (3272us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051496.925106:0:47388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5707 00000100:00100000:3.0:1777051496.925618:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95fbadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452713216:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1777051496.929676:0:8468:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95fbac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:109194:x1863365452713344:12345-0@lo:5:osp-pre-0-0.0 Request processed in 6968us (7992us total) trans 4294968374 rc 0/0 00000100:00100000:2.0:1777051496.929694:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8106 00000100:00100000:3.0:1777051496.929955:0:109194:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95fbaf800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:109194:1863365452713344:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1777051496.929989:0:109194:0:(osp_precreate.c:701:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x201:0x0]-[0x280000401:0x221:0x0] 00000020:00000004:2.0:1777051497.242163:0:109551:0:(tgt_mount.c:2297:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1777051497.242509:0:109551:0:(tgt_mount.c:2312:is_cmd_supported()) ioctl cmd=81009431 00000040:00080000:1.0:1777051497.558748:0:109205:0:(llog.c:801:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:1.0:1777051497.558763:0:109205:0:(llog_cat.c:158:llog_cat_process_common()) processing log [0x1:0x2b:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1777051497.558816:0:109205:0:(llog.c:858:llog_process_thread()) stop processing plain [0x1:0x2b:0x0] index 12 count 7 00000040:00080000:1.0:1777051497.558939:0:109205:0:(llog.c:858:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00000100:00100000:1.0:1777051497.559168:0:109205:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95f97e680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:109205:1863365452713472:192.168.201.46@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1777051497.559644:0:109205:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d9591d5240 going to sleep for 11 seconds 00000100:00100000:0.0:1777051497.567428:0:109205:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95f97e680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:109205:1863365452713472:192.168.201.46@tcp:107:hsm_cdtr.0 00010000:00010000:1.0:1777051497.624009:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1777051498.405005:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051498.405067:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051498.405432:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051498.405460:0:109184:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426105088 00000100:00100000:2.0:1777051498.405476:0:109184:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426105088 00000100:00100000:1.0:1777051498.405485:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051498.405538:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051498.405558:0:109184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 81 00000100:00100000:2.0:1777051498.405578:0:109184:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f3bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:29c4352d-3260-4734-909d-9ea5de9e7fa4+12:2436:x1863365426105088:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:1.0:1777051498.405588:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051498.405624:0:6580:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426105216 00000100:00100000:3.0:1777051498.405634:0:6580:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426105216 00000100:00100000:1.0:1777051498.405646:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051498.405655:0:6579:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426105344 00000100:00100000:0.0:1777051498.405667:0:6579:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426105344 00000100:00100000:2.0:1777051498.406001:0:109184:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f3bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:29c4352d-3260-4734-909d-9ea5de9e7fa4+12:2436:x1863365426105088:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 117us (696us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051498.406016:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051498.406023:0:109184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 81 00000100:00100000:3.0:1777051498.406035:0:6580:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426105728 00000100:00100000:3.0:1777051498.406044:0:6580:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426105728 00000100:00100000:2.0:1777051498.406373:0:8628:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426105472 00000100:00100000:0.0:1777051498.406379:0:6579:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426105856 00000100:00100000:2.0:1777051498.406382:0:8628:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426105472 00000100:00100000:0.0:1777051498.406392:0:6579:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426105856 00000100:00100000:3.0:1777051498.406411:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13491 00000100:00100000:3.0:1777051498.406432:0:6580:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f97e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+8:2437:x1863365426105216:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:2.0:1777051498.406466:0:8628:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426105984 00000100:00100000:2.0:1777051498.406474:0:8628:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426105984 00000100:00100000:0.0:1777051498.406483:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13492 00000100:00100000:1.0:1777051498.406490:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051498.406511:0:6579:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f97d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+9:2436:x1863365426105344:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:3.0:1777051498.406517:0:6580:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f97e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+8:2437:x1863365426105216:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 89us (1445us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051498.406534:0:8628:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426105600 00000100:00100000:3.0:1777051498.406540:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13491 00000100:00100000:2.0:1777051498.406543:0:8628:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426105600 00000100:00100000:1.0:1777051498.406576:0:13320:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426106112 00000100:00100000:3.0:1777051498.406581:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13493 00000100:00100000:1.0:1777051498.406588:0:13320:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426106112 00000100:00100000:3.0:1777051498.406598:0:6580:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95088b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+9:2437:x1863365426105728:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:0.0:1777051498.406610:0:6579:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f97d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+9:2436:x1863365426105344:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 101us (1171us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051498.406610:0:8628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10533 00000100:00100000:0.0:1777051498.406632:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13492 00000100:00100000:2.0:1777051498.406641:0:8628:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95088b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+51:2437:x1863365426105472:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:3.0:1777051498.406660:0:6580:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95088b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+9:2437:x1863365426105728:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 63us (1119us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051498.406661:0:13320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10534 00000100:00100000:0.0:1777051498.406677:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13494 00000100:00100000:1.0:1777051498.406689:0:13320:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95088aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+53:2437:x1863365426105984:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:3.0:1777051498.406689:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13493 00000100:00100000:0.0:1777051498.406978:0:6579:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d950889c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+54:2437:x1863365426105856:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:2.0:1777051498.406997:0:8628:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95088b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+51:2437:x1863365426105472:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 360us (1506us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051498.407013:0:8628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10533 00000100:00100000:3.0:1777051498.407036:0:27884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10535 00000100:00100000:3.0:1777051498.407053:0:27884:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95088ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+48:2436:x1863365426105600:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:2.0:1777051498.407063:0:8628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10536 00000100:00100000:1.0:1777051498.407064:0:13320:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95088aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+53:2437:x1863365426105984:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 375us (1473us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051498.407074:0:6579:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d950889c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+54:2437:x1863365426105856:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 376us (1056us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051498.407092:0:8628:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d950889500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+50:2437:x1863365426106112:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:1.0:1777051498.407094:0:13320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10534 00000100:00100000:0.0:1777051498.407116:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13494 00000100:00100000:3.0:1777051498.407127:0:27884:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95088ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+48:2436:x1863365426105600:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 77us (1482us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051498.407141:0:27884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10535 00000100:00100000:2.0:1777051498.407170:0:8628:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d950889500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+50:2437:x1863365426106112:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 84us (689us total) trans 0 rc 0/0 00000100:00080000:0.0:1777051498.407174:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1777051498.407185:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1777051498.407193:0:8628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10536 00000100:00080000:0.0:1777051498.407229:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1777051498.407239:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1777051498.646629:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777051499.102665:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051499.102801:0:6581:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426106240 00000100:00100000:1.0:1777051499.102837:0:6581:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426106240 00000100:00100000:1.0:1777051499.103038:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112434 00000100:00100000:1.0:1777051499.103058:0:6581:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f168000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+9:139792:x1863365426106240:12345-192.168.201.46@tcp:41:lfs.0 00000004:00000024:1.0:1777051499.103113:0:6581:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4194304 pending 0 free 1441550336 avail 1295310848 00000100:00100000:1.0:1777051499.103231:0:6581:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f168000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+9:139792:x1863365426106240:12345-192.168.201.46@tcp:41:lfs.0 Request processed in 176us (574us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051499.103246:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112434 00000100:00100000:1.0:1777051499.107021:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051499.107147:0:6580:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426106368 00000100:00100000:3.0:1777051499.107156:0:6580:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426106368 00000100:00100000:3.0:1777051499.107277:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112435 00000100:00100000:3.0:1777051499.107294:0:6580:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d950889880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+54:139792:x1863365426106368:12345-192.168.201.46@tcp:41:lfs.0 00000004:00000024:3.0:1777051499.107358:0:6580:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4194304 pending 0 free 1446141952 avail 1299902464 00000100:00100000:3.0:1777051499.107457:0:6580:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d950889880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+54:139792:x1863365426106368:12345-192.168.201.46@tcp:41:lfs.0 Request processed in 152us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051499.107470:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112435 00000100:00100000:3.0:1777051499.115280:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051499.115384:0:8472:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426106496 00000100:00100000:1.0:1777051499.115397:0:8472:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426106496 00000100:00100000:1.0:1777051499.115487:0:8472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 5708 00000100:00100000:1.0:1777051499.115502:0:8472:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f16a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+53:139792:x1863365426106496:12345-192.168.201.46@tcp:13:lfs.0 00002000:00000024:1.0:1777051499.115542:0:8472:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 499268288 pending 0 free 3860574208 avail 3629051904 00000100:00100000:1.0:1777051499.115644:0:8472:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f16a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+53:139792:x1863365426106496:12345-192.168.201.46@tcp:13:lfs.0 Request processed in 143us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051499.115658:0:8472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 5708 00000100:00100000:0.0:1777051499.123560:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051499.123671:0:47388:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426106624 00000100:00100000:3.0:1777051499.123683:0:47388:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426106624 00000100:00100000:3.0:1777051499.123763:0:47388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 5709 00000100:00100000:3.0:1777051499.123781:0:47388:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942d21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+50:139792:x1863365426106624:12345-192.168.201.46@tcp:13:lfs.0 00002000:00000024:3.0:1777051499.123862:0:47388:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 489208512 pending 0 free 3642707968 avail 3411185664 00000100:00100000:3.0:1777051499.123969:0:47388:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942d21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+50:139792:x1863365426106624:12345-192.168.201.46@tcp:13:lfs.0 Request processed in 191us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051499.123985:0:47388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 5709 00000100:00100000:1.0:1777051499.286757:0:3679:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1777051499.286793:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94f168700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452713728:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1777051499.286794:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95fbadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452713600:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1777051499.286934:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051499.287019:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051499.287476:0:8472:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452713600 00000100:00100000:3.0:1777051499.287486:0:8473:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452713728 00000100:00100000:0.0:1777051499.287490:0:8472:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452713600 00000100:00100000:3.0:1777051499.287497:0:8473:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452713728 00000100:00100000:0.0:1777051499.287615:0:8472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5710 00000100:00100000:0.0:1777051499.287632:0:8472:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d950888380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3679:x1863365452713600:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1777051499.287662:0:8472:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 489208512 pending 0 free 3642707968 avail 3411185664 00000100:00100000:0.0:1777051499.287730:0:8472:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d950888380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3679:x1863365452713600:12345-0@lo:13:osp-pre-1-1.0 Request processed in 101us (798us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051499.287756:0:8472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5710 00000100:00100000:3.0:1777051499.287999:0:8473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5711 00000100:00100000:3.0:1777051499.288017:0:8473:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95fbac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3677:x1863365452713728:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1777051499.288042:0:8473:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 499268288 pending 0 free 3860574208 avail 3629051904 00000100:00100000:3.0:1777051499.288364:0:8473:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95fbac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3677:x1863365452713728:12345-0@lo:13:osp-pre-0-1.0 Request processed in 351us (1346us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051499.288378:0:8473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5711 00000100:00100000:3.0:1777051499.288467:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95fbadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452713600:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1777051499.288570:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1777051499.288576:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1777051499.288686:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94f168700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452713728:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1777051499.670530:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777051500.694532:0:108751:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051501.719935:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1777051501.848735:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d942d20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3678:1863365452713856:0@lo:400:kworker.0 00000100:00100000:0.0:1777051501.849129:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051501.849259:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d942d22680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3678:1863365452714368:0@lo:400:kworker.0 00000100:00100000:1.0:1777051501.849271:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d942d20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3680:1863365452714112:0@lo:400:kworker.0 00000100:00100000:0.0:1777051501.849328:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051501.849358:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d942d22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3677:1863365452714240:0@lo:400:kworker.0 00000100:00100000:0.0:1777051501.849385:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f9b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3678:1863365452714880:0@lo:400:kworker.0 00000100:00100000:1.0:1777051501.849412:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051501.849456:0:109182:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452713856 00000100:00100000:0.0:1777051501.849467:0:109182:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452713856 00000100:00100000:3.0:1777051501.849659:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d942d23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3679:1863365452713984:0@lo:400:kworker.0 00000100:00100000:1.0:1777051501.849697:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d942d20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452714752:0@lo:400:kworker.0 00000100:00100000:3.0:1777051501.849726:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051501.849796:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051501.849811:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d942d21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452714496:0@lo:400:kworker.0 00000100:00100000:1.0:1777051501.850167:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f9bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3677:1863365452715264:0@lo:400:kworker.0 00000100:00100000:3.0:1777051501.850182:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051501.850226:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051501.850276:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f9b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452715008:0@lo:400:kworker.0 00000100:00100000:1.0:1777051501.850311:0:8468:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452714752 00000100:00100000:1.0:1777051501.850320:0:8468:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452714752 00000100:00100000:3.0:1777051501.850334:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051501.850383:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d950888a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452715520:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1777051501.850437:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051501.850438:0:8468:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452715264 00000100:00100000:1.0:1777051501.850446:0:8468:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452715264 00000100:00100000:3.0:1777051501.850487:0:3679:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1777051501.850508:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94f168700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452715648:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1777051501.850526:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10537 00000100:00100000:0.0:1777051501.850535:0:109182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1777051501.850565:0:8468:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95088bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3677:x1863365452714752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777051501.850567:0:109182:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f3bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9351a01-5b0e-4470-97fd-58b9b4b312a2+23:3678:x1863365452713856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051501.850568:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051501.850696:0:109182:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f3bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9351a01-5b0e-4470-97fd-58b9b4b312a2+23:3678:x1863365452713856:12345-0@lo:400:kworker.0 Request processed in 140us (1565us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051501.850705:0:8468:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95088bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3677:x1863365452714752:12345-0@lo:400:kworker.0 Request processed in 148us (905us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051501.850725:0:109182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1777051501.850733:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10537 00000100:00100000:1.0:1777051501.850810:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10538 00000100:00100000:1.0:1777051501.850830:0:8468:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95088a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3677:x1863365452715264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777051501.850841:0:6579:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452714368 00000100:00100000:0.0:1777051501.850851:0:6579:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452714368 00000100:00100000:1.0:1777051501.850909:0:8468:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95088a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3677:x1863365452715264:12345-0@lo:400:kworker.0 Request processed in 83us (682us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051501.850910:0:46497:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452714240 00000100:00100000:3.0:1777051501.850923:0:46497:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452714240 00000100:00100000:0.0:1777051501.850926:0:6579:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452713984 00000100:00100000:1.0:1777051501.850933:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10538 00000100:00100000:0.0:1777051501.850938:0:6579:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452713984 00000100:00080000:1.0:1777051501.850989:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1777051501.851000:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1777051501.851009:0:46497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13495 00000100:00080000:1.0:1777051501.851010:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1777051501.851032:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13496 00000100:00100000:3.0:1777051501.851039:0:46497:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:lustre-MDT0001-lwp-OST0001_UUID+5:3678:x1863365452714368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777051501.851059:0:6579:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d950889180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3677:x1863365452714240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777051501.851080:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d942d20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452714752:0@lo:400:kworker.0 00000100:00100000:1.0:1777051501.851115:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f9bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3677:1863365452715264:0@lo:400:kworker.0 00000100:00100000:3.0:1777051501.851142:0:46497:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:lustre-MDT0001-lwp-OST0001_UUID+5:3678:x1863365452714368:12345-0@lo:400:kworker.0 Request processed in 110us (1810us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051501.851157:0:46497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13495 00000100:00100000:0.0:1777051501.851477:0:6579:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d950889180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3677:x1863365452714240:12345-0@lo:400:kworker.0 Request processed in 424us (2061us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051501.851484:0:46497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13497 00000100:00100000:1.0:1777051501.851502:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d942d22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3677:1863365452714240:0@lo:400:kworker.0 00000100:00100000:0.0:1777051501.851503:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13496 00000100:00100000:3.0:1777051501.851514:0:46497:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f169180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:lustre-MDT0000-lwp-OST0000_UUID+5:3679:x1863365452713984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051501.851611:0:46497:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f169180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:lustre-MDT0000-lwp-OST0000_UUID+5:3679:x1863365452713984:12345-0@lo:400:kworker.0 Request processed in 105us (1884us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051501.851626:0:46497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13497 00000100:00100000:1.0:1777051501.851643:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051501.851678:0:46497:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452714112 00000100:00100000:3.0:1777051501.851689:0:46497:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452714112 00000100:00100000:1.0:1777051501.851709:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d942d21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3680:1863365452714624:0@lo:400:kworker.0 00000100:00100000:0.0:1777051501.851717:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051501.851803:0:46497:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452714880 00000100:00100000:1.0:1777051501.851812:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051501.851814:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f9b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3678:1863365452715392:0@lo:400:kworker.0 00000100:00100000:3.0:1777051501.851816:0:46497:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452714880 00000100:00100000:3.0:1777051501.852460:0:46497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13498 00000100:00100000:3.0:1777051501.852479:0:46497:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942d22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:lustre-MDT0001-lwp-OST0000_UUID+5:3680:x1863365452714112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777051501.852489:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f9b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3680:1863365452715136:0@lo:400:kworker.0 00000100:00100000:0.0:1777051501.852535:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051501.852599:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051501.852599:0:46497:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942d22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:lustre-MDT0001-lwp-OST0000_UUID+5:3680:x1863365452714112:12345-0@lo:400:kworker.0 Request processed in 118us (952us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051501.852620:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d942d20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3678:1863365452713856:0@lo:400:kworker.0 00000100:00100000:3.0:1777051501.852621:0:46497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13498 00000100:00100000:0.0:1777051501.852664:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d942d22680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3678:1863365452714368:0@lo:400:kworker.0 00000100:00100000:3.0:1777051501.852667:0:46497:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452715392 00000100:00100000:3.0:1777051501.852678:0:46497:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452715392 00000100:00100000:1.0:1777051501.852687:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d942d20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3680:1863365452714112:0@lo:400:kworker.0 00000100:00100000:0.0:1777051501.853059:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13499 00000100:00100000:0.0:1777051501.853076:0:6581:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3678:x1863365452714880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777051501.853150:0:6581:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3678:x1863365452714880:12345-0@lo:400:kworker.0 Request processed in 77us (1442us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051501.853162:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13499 00000100:00100000:0.0:1777051501.853503:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f9b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3678:1863365452714880:0@lo:400:kworker.0 00000100:00100000:2.0:1777051501.855097:0:6585:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452714496 00000100:00100000:2.0:1777051501.855424:0:6585:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452714496 00000100:00100000:2.0:1777051501.855484:0:6585:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452715008 00000100:00100000:2.0:1777051501.855491:0:6585:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452715008 00000100:00100000:0.0:1777051501.855519:0:27887:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452714624 00000100:00100000:2.0:1777051501.855529:0:6585:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452715520 00000100:00100000:0.0:1777051501.855530:0:27887:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452714624 00000100:00100000:2.0:1777051501.855570:0:6585:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452715520 00000100:00100000:0.0:1777051501.855607:0:27887:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452715136 00000100:00100000:2.0:1777051501.855610:0:6585:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452715648 00000100:00100000:0.0:1777051501.855617:0:27887:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452715136 00000100:00100000:2.0:1777051501.855619:0:6585:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452715648 00000100:00100000:2.0:1777051501.855653:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8349 00000100:00100000:2.0:1777051501.855671:0:6585:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d944070e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:3679:x1863365452714496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777051501.855681:0:27887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10539 00000100:00100000:0.0:1777051501.855700:0:27887:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942d20a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3680:x1863365452714624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777051501.856098:0:27887:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942d20a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3680:x1863365452714624:12345-0@lo:400:kworker.0 Request processed in 127us (4017us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051501.856112:0:27887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10539 00000100:00100000:0.0:1777051501.856138:0:27887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10540 00000100:00100000:0.0:1777051501.856150:0:27887:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da57c82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+6:3680:x1863365452715136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777051501.856243:0:27887:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da57c82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+6:3680:x1863365452715136:12345-0@lo:400:kworker.0 Request processed in 94us (3653us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051501.856254:0:27887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10540 00000100:00100000:2.0:1777051501.856328:0:6585:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d944070e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:3679:x1863365452714496:12345-0@lo:400:kworker.0 Request processed in 91us (5577us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051501.856348:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8349 00000100:00100000:2.0:1777051501.856389:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8350 00000100:00100000:2.0:1777051501.856406:0:6585:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d951fa3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3679:x1863365452715008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777051501.856486:0:6585:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d951fa3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3679:x1863365452715008:12345-0@lo:400:kworker.0 Request processed in 82us (6152us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051501.856501:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8350 00000100:00100000:2.0:1777051501.856537:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8351 00000100:00100000:2.0:1777051501.856553:0:6585:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d951fa2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3679:x1863365452715520:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1777051501.856591:0:6585:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4194304 pending 0 free 1446141952 avail 1299902464 00000100:00100000:0.0:1777051501.856605:0:8492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13500 00000100:00100000:0.0:1777051501.856626:0:8492:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3678:x1863365452715392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777051501.856661:0:6585:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d951fa2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3679:x1863365452715520:12345-0@lo:41:osp-pre-1-0.0 Request processed in 108us (6224us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051501.856673:0:46500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8352 00000100:00100000:2.0:1777051501.856699:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8351 00000100:00100000:3.0:1777051501.856701:0:46500:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d951fa1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+7:3679:x1863365452715648:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1777051501.856716:0:8492:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3678:x1863365452715392:12345-0@lo:400:kworker.0 Request processed in 93us (4180us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051501.856730:0:8492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13500 00000004:00000024:3.0:1777051501.856750:0:46500:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4194304 pending 0 free 1441550336 avail 1295310848 00000100:00080000:0.0:1777051501.856820:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1777051501.856830:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1777051501.856875:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d942d23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3679:1863365452713984:0@lo:400:kworker.0 00000100:00100000:0.0:1777051501.856899:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d942d21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452714496:0@lo:400:kworker.0 00000100:00100000:0.0:1777051501.856916:0:3679:0:(client.c:3101:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 8589934765 gen 2 00000004:00080000:0.0:1777051501.856924:0:3679:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 8589934763 committed transno 8589934765 00000004:00080000:0.0:1777051501.856948:0:3679:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 8589934764 committed transno 8589934765 00000004:00080000:0.0:1777051501.856973:0:3679:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 8589934765 committed transno 8589934765 00000100:00100000:3.0:1777051501.856983:0:46500:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d951fa1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+7:3679:x1863365452715648:12345-0@lo:41:osp-pre-0-1.0 Request processed in 287us (6418us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051501.856994:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f9b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452715008:0@lo:400:kworker.0 00000100:00100000:3.0:1777051501.857005:0:46500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8352 00000100:00100000:0.0:1777051501.857036:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d950888a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452715520:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1777051501.857103:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94f168700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452715648:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1777051501.857175:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f9b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3678:1863365452715392:0@lo:400:kworker.0 00000100:00100000:0.0:1777051501.857189:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d942d21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3680:1863365452714624:0@lo:400:kworker.0 00000100:00100000:0.0:1777051501.857272:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f9b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3680:1863365452715136:0@lo:400:kworker.0 00000040:00080000:1.0:1777051502.176497:0:109648:0:(llog.c:801:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:1.0:1777051502.176568:0:109648:0:(llog_cat.c:158:llog_cat_process_common()) processing log [0x1:0x2b:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1777051502.176645:0:109648:0:(llog.c:858:llog_process_thread()) stop processing plain [0x1:0x2b:0x0] index 12 count 7 00000040:00080000:1.0:1777051502.176655:0:109648:0:(llog.c:858:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00000100:00100000:0.0:1777051502.359480:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d942d20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3677:1863365452715776:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1777051502.360034:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d951fa3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3678:1863365452715904:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1777051502.360066:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051502.360184:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051502.360329:0:10113:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452715776 00000100:00100000:1.0:1777051502.360343:0:10113:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452715776 00000100:00100000:0.0:1777051502.360362:0:8472:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452715904 00000100:00100000:0.0:1777051502.360373:0:8472:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452715904 00000100:00100000:1.0:1777051502.360440:0:10113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5712 00000100:00100000:0.0:1777051502.360459:0:8472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5713 00000100:00100000:1.0:1777051502.360466:0:10113:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942d21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3677:x1863365452715776:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1777051502.360483:0:8472:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942d21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3678:x1863365452715904:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1777051502.360516:0:10113:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 499268288 pending 0 free 3860574208 avail 3629051904 00002000:00000024:0.0:1777051502.360525:0:8472:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 489208512 pending 0 free 3642707968 avail 3411185664 00000100:00100000:1.0:1777051502.360604:0:10113:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942d21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3677:x1863365452715776:12345-0@lo:13:osp-pre-0-0.0 Request processed in 147us (540us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051502.360621:0:10113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5712 00000100:00100000:0.0:1777051502.360703:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d942d20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3677:1863365452715776:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1777051502.362640:0:8472:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942d21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3678:x1863365452715904:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2163us (2453us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051502.362660:0:8472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5713 00000100:00100000:1.0:1777051502.362722:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d951fa3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3678:1863365452715904:0@lo:13:osp-pre-1-0.0 00000040:00080000:2.0:1777051502.487573:0:104226:0:(llog.c:801:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1777051502.487586:0:104226:0:(llog_cat.c:158:llog_cat_process_common()) processing log [0x1:0x12:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1777051502.487795:0:104226:0:(llog.c:858:llog_process_thread()) stop processing plain [0x1:0x12:0x0] index 11 count 3 00000040:00080000:2.0:1777051502.487807:0:104226:0:(llog.c:858:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:2.0:1777051502.742821:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1777051502.880267:0:9540:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0001: transno 4294968377 is committed 00000001:00080000:1.0:1777051502.881156:0:8464:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0000: transno 4294968374 is committed 00000001:02000400:3.0:1777051503.134677:0:109696:0:(debug.c:645:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg146-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid 00000100:00100000:3.0:1777051503.523365:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051503.523453:0:109181:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426106752 00000100:00100000:0.0:1777051503.523471:0:109181:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426106752 00000100:00100000:0.0:1777051503.523589:0:109181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 83 00000100:00100000:0.0:1777051503.523641:0:109181:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f3bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29c4352d-3260-4734-909d-9ea5de9e7fa4+12:2437:x1863365426106752:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:3.0:1777051503.523700:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051503.523835:0:109181:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f3bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29c4352d-3260-4734-909d-9ea5de9e7fa4+12:2437:x1863365426106752:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 207us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051503.523842:0:27882:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426107008 00000100:00100000:1.0:1777051503.523856:0:27882:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426107008 00000100:00100000:0.0:1777051503.523858:0:109181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 83 00000100:00100000:3.0:1777051503.523962:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00080000:0.0:1777051503.524829:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1777051503.525020:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051503.525047:0:46494:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426106880 00000100:00100000:0.0:1777051503.525061:0:46494:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426106880 00000100:00100000:3.0:1777051503.525100:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051503.525102:0:27882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13501 00000100:00100000:1.0:1777051503.525125:0:27882:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d951fa1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+9:2437:x1863365426107008:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:3.0:1777051503.525512:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051503.525541:0:8628:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426107264 00000100:00100000:2.0:1777051503.525554:0:8628:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426107264 00000100:00100000:0.0:1777051503.525575:0:46494:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426107520 00000100:00100000:1.0:1777051503.525578:0:27882:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d951fa1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+9:2437:x1863365426107008:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 454us (1886us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051503.525588:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051503.525589:0:46494:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426107520 00000100:00100000:1.0:1777051503.525601:0:27882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13501 00000100:00100000:1.0:1777051503.525643:0:27882:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426107392 00000100:00100000:1.0:1777051503.525654:0:27882:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426107392 00000100:00100000:2.0:1777051503.525671:0:8628:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426107136 00000100:00100000:2.0:1777051503.525682:0:8628:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426107136 00000100:00100000:0.0:1777051503.525725:0:46494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13502 00000100:00100000:2.0:1777051503.526071:0:8628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10541 00000100:00100000:3.0:1777051503.526090:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051503.526101:0:8628:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d951fa3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+48:2437:x1863365426107264:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:2.0:1777051503.526194:0:8628:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d951fa3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+48:2437:x1863365426107264:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 106us (1176us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051503.526241:0:8628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10541 00000100:00100000:2.0:1777051503.526268:0:8628:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426107776 00000100:00100000:2.0:1777051503.526276:0:8628:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426107776 00000100:00100000:2.0:1777051503.526329:0:8628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10542 00000100:00100000:2.0:1777051503.526347:0:8628:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d951fa0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+51:2436:x1863365426107136:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:1.0:1777051503.526374:0:27882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13503 00000100:00100000:0.0:1777051503.526386:0:46494:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d951fa3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c11b6966-0775-44d2-bdc6-c74c26eb2226+8:2436:x1863365426106880:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:1.0:1777051503.526406:0:27882:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d951fa0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+54:2437:x1863365426107520:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:3.0:1777051503.527242:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051503.527386:0:8628:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d951fa0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+51:2436:x1863365426107136:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 1036us (2285us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051503.527409:0:46494:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d951fa3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c11b6966-0775-44d2-bdc6-c74c26eb2226+8:2436:x1863365426106880:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 1033us (3440us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051503.527410:0:8628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10542 00000100:00100000:1.0:1777051503.527425:0:27882:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d951fa0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+54:2437:x1863365426107520:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 1024us (1907us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051503.527450:0:46494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13502 00000100:00100000:2.0:1777051503.527461:0:8628:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426107648 00000100:00100000:1.0:1777051503.527469:0:27882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13503 00000100:00100000:2.0:1777051503.527475:0:8628:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426107648 00000100:00100000:0.0:1777051503.527504:0:46494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13504 00000100:00100000:0.0:1777051503.527526:0:46494:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d951fa1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+9:2436:x1863365426107392:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:2.0:1777051503.527565:0:8628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10543 00000100:00100000:1.0:1777051503.527582:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10544 00000100:00100000:2.0:1777051503.527593:0:8628:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d951fa2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+50:2437:x1863365426107776:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:1.0:1777051503.527616:0:8468:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d951fa1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+53:2436:x1863365426107648:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:1.0:1777051503.527687:0:8468:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d951fa1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+53:2436:x1863365426107648:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 83us (486us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051503.527702:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10544 00000100:00100000:0.0:1777051503.528240:0:46494:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d951fa1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+9:2436:x1863365426107392:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 78us (2010us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051503.528265:0:46494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13504 00000100:00080000:0.0:1777051503.528313:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1777051503.528320:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1777051503.528325:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1777051503.528329:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1777051503.528587:0:8628:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d951fa2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+50:2437:x1863365426107776:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 1004us (2501us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051503.528603:0:8628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10543 00000040:00080000:2.0:1777051503.703541:0:109205:0:(llog.c:801:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:2.0:1777051503.703556:0:109205:0:(llog_cat.c:158:llog_cat_process_common()) processing log [0x1:0x2b:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1777051503.704009:0:109205:0:(llog.c:858:llog_process_thread()) stop processing plain [0x1:0x2b:0x0] index 12 count 6 00000040:00080000:2.0:1777051503.704023:0:109205:0:(llog.c:858:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00010000:00010000:1.0:1777051503.766647:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1777051504.407712:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d951fa2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452716032:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1777051504.407859:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051504.407983:0:3679:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1777051504.408001:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95fbaed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452716160:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1777051504.408005:0:8473:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452716032 00000100:00100000:3.0:1777051504.408023:0:8473:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452716032 00000100:00100000:0.0:1777051504.408062:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051504.409134:0:8473:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452716160 00000100:00100000:3.0:1777051504.409145:0:8473:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452716160 00000100:00080000:0.0:1777051504.409183:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1777051504.409194:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1777051504.409223:0:8473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5714 00000100:00100000:3.0:1777051504.409247:0:8473:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3679:x1863365452716032:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1777051504.409275:0:47388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5715 00000100:00100000:0.0:1777051504.409301:0:47388:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3679:x1863365452716160:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1777051504.409303:0:8473:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 499268288 pending 0 free 3860574208 avail 3629051904 00002000:00000024:0.0:1777051504.409345:0:47388:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 489208512 pending 0 free 3642707968 avail 3411185664 00000100:00100000:3.0:1777051504.409421:0:8473:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3679:x1863365452716032:12345-0@lo:13:osp-pre-0-1.0 Request processed in 180us (1566us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051504.409436:0:47388:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3679:x1863365452716160:12345-0@lo:13:osp-pre-1-1.0 Request processed in 144us (1372us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051504.409452:0:47388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5715 00000100:00100000:3.0:1777051504.409479:0:8473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5714 00000100:00100000:0.0:1777051504.409574:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95fbaed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452716160:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1777051504.409617:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d951fa2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452716032:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1777051504.790514:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1777051504.883971:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051504.884521:0:47827:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426107904 00000100:00100000:0.0:1777051504.884536:0:47827:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426107904 00000100:00100000:0.0:1777051504.884631:0:47827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13749 00000100:00100000:0.0:1777051504.884648:0:47827:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95fbaed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+48:2436:x1863365426107904:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1777051504.884671:0:47827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 21 locks, starting at 0 00010000:00010000:0.0:1777051504.884752:0:47827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008ae8b149/0x85f51a6b9670e8d0 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x141:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b4135 expref: 48 pid: 27887 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051504.884795:0:47827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f3fbacf9/0x85f51a6b9670e898 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x140:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b4112 expref: 47 pid: 8628 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051504.884826:0:47827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003aa5848a/0x85f51a6b9670e80c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x13f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b40ef expref: 46 pid: 27887 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051504.884858:0:47827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e58747f/0x85f51a6b9670e72c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x13e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b40a9 expref: 45 pid: 8468 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051504.884893:0:47827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a2831766/0x85f51a6b9670e622 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x13d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b405c expref: 44 pid: 24468 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051504.884930:0:47827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000746e4af/0x85f51a6b9670e4b6 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x13c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b3ff3 expref: 43 pid: 8468 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051504.884970:0:47827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006a3e9d6b/0x85f51a6b9670e397 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x13b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b3f98 expref: 42 pid: 8628 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051504.884998:0:47827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b5547c07/0x85f51a6b9670e2da lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x13a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b3f60 expref: 41 pid: 27884 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051504.885024:0:47827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002cd1d4a7/0x85f51a6b9670e1b4 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x139:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b3ef7 expref: 40 pid: 24468 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051504.885051:0:47827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c8db3906/0x85f51a6b9670e13d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x138:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b3edb expref: 39 pid: 27887 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051504.885073:0:47827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f1f045db/0x85f51a6b9670e0aa lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x137:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b3e87 expref: 38 pid: 27884 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051504.885089:0:47827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008cd5344d/0x85f51a6b9670df14 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x136:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b3e02 expref: 37 pid: 24468 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051504.885120:0:47827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000a6b9521/0x85f51a6b9670de5e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x135:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b3dae expref: 36 pid: 8470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051504.885146:0:47827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cf21d8a4/0x85f51a6b9670db9b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x134:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b3bb6 expref: 35 pid: 8468 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051504.885177:0:47827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009bd9c27f/0x85f51a6b9670db01 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x133:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b3b62 expref: 34 pid: 24468 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051504.885246:0:47827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000066c5f479/0x85f51a6b9670d979 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x132:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b3a9e expref: 33 pid: 13320 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051504.885275:0:47827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000000f71e57/0x85f51a6b9670d757 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x131:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b3932 expref: 32 pid: 8470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051504.885303:0:47827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d27361d9/0x85f51a6b9670d615 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x130:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b386e expref: 31 pid: 24468 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051504.885330:0:47827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000468bb508/0x85f51a6b9670d463 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x12f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b3772 expref: 30 pid: 8470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051504.885353:0:47827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fcc2243c/0x85f51a6b9670d2b1 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x12e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b36ed expref: 29 pid: 8471 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051504.885386:0:47827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000094b534f0/0x85f51a6b9670d0f1 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x12d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b3684 expref: 28 pid: 8468 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051504.885399:0:47827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1777051504.885468:0:47827:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95fbaed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+27:2436:x1863365426107904:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 824us (1508us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051504.885480:0:47827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13749 00000001:02000400:2.0:1777051504.997092:0:109744:0:(debug.c:645:libcfs_debug_mark_buffer()) DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec 00010000:00010000:0.0:1777051505.814689:0:108751:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777051505.895315:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051505.895426:0:6566:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426108032 00000100:00100000:2.0:1777051505.895438:0:6566:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426108032 00000100:00100000:2.0:1777051505.895577:0:6566:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13750 00000100:00100000:2.0:1777051505.895593:0:6566:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da58810850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+51:2437:x1863365426108032:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1777051505.895614:0:6566:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 21 locks, starting at 0 00010000:00010000:2.0:1777051505.895680:0:6566:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dc466ad0/0x85f51a6b9670e924 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x141:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b4151 expref: 51 pid: 24468 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051505.896031:0:6566:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c1734d2c/0x85f51a6b9670e8b4 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x140:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b4127 expref: 50 pid: 24468 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051505.896056:0:6566:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a323274e/0x85f51a6b9670e828 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x13f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b40fd expref: 49 pid: 55805 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051505.896079:0:6566:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000015516f75/0x85f51a6b9670e7aa lrc: 0/0,0 mode: --/PR res: [0x280000401:0x13e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b40d3 expref: 48 pid: 8471 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051505.896099:0:6566:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bb8bd062/0x85f51a6b9670e661 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x13d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b406a expref: 47 pid: 27887 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051505.896119:0:6566:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f680b9f1/0x85f51a6b9670e5b2 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x13c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b4039 expref: 46 pid: 27887 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051505.896141:0:6566:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a3b15934/0x85f51a6b9670e485 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x13b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b3fe5 expref: 45 pid: 8471 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051505.896163:0:6566:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000005c1f62b/0x85f51a6b9670e2fd lrc: 0/0,0 mode: --/PR res: [0x280000401:0x13a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b3f6e expref: 44 pid: 24468 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051505.896182:0:6566:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fdbb4efe/0x85f51a6b9670e1e5 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x139:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b3f05 expref: 43 pid: 55805 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051505.896298:0:6566:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b3720d0/0x85f51a6b9670e121 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x138:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b3ec6 expref: 42 pid: 8470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051505.896325:0:6566:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bbe6a20e/0x85f51a6b9670e06b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x137:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b3e80 expref: 41 pid: 8628 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051505.896347:0:6566:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008004fafd/0x85f51a6b9670dfca lrc: 0/0,0 mode: --/PR res: [0x280000401:0x136:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b3e4f expref: 40 pid: 8470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051505.896369:0:6566:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002c5c32f1/0x85f51a6b9670deb2 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x135:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b3dd8 expref: 39 pid: 8628 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051505.896390:0:6566:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e9019504/0x85f51a6b9670ddb6 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x134:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b3d84 expref: 38 pid: 8468 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051505.896404:0:6566:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a9b123fb/0x85f51a6b9670dad0 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x133:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b3b4d expref: 37 pid: 8468 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051505.896418:0:6566:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006dbdac6c/0x85f51a6b9670d9cd lrc: 0/0,0 mode: --/PR res: [0x280000401:0x132:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b3aba expref: 36 pid: 8470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051505.896434:0:6566:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cb25ab46/0x85f51a6b9670d892 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x131:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b39f6 expref: 35 pid: 8471 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051505.896453:0:6566:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e37a3888/0x85f51a6b9670d6b6 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x130:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b38c9 expref: 34 pid: 8471 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051505.896464:0:6566:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e92acd60/0x85f51a6b9670d4fd lrc: 0/0,0 mode: --/PR res: [0x280000401:0x12f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b37db expref: 33 pid: 24468 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051505.896476:0:6566:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000032732646/0x85f51a6b9670d3c9 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x12e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b374f expref: 32 pid: 27884 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051505.896490:0:6566:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a912f3a3/0x85f51a6b9670d225 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x12d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b36b5 expref: 31 pid: 55805 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051505.896497:0:6566:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1777051505.896567:0:6566:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da58810850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+30:2437:x1863365426108032:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 977us (1262us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051505.896577:0:6566:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13750 00000100:00080000:0.0:1777051505.896742:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1777051506.709310:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051506.709533:0:8492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426108160 00000100:00100000:1.0:1777051506.709547:0:8492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426108160 00000100:00100000:1.0:1777051506.709652:0:8492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112436 00000100:00100000:1.0:1777051506.709669:0:8492:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+9:140246:x1863365426108160:12345-192.168.201.46@tcp:41:lfs.0 00000004:00000024:1.0:1777051506.710032:0:8492:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4194304 pending 0 free 1441550336 avail 1295310848 00000100:00100000:1.0:1777051506.710130:0:8492:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+9:140246:x1863365426108160:12345-192.168.201.46@tcp:41:lfs.0 Request processed in 464us (829us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051506.710142:0:8492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112436 00000100:00080000:0.0:1777051506.710269:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1777051506.712482:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051506.712584:0:21368:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426108288 00000100:00100000:2.0:1777051506.712593:0:21368:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426108288 00000100:00080000:0.0:1777051506.712944:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1777051506.712985:0:21368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112437 00000100:00100000:2.0:1777051506.713001:0:21368:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942d23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+54:140246:x1863365426108288:12345-192.168.201.46@tcp:41:lfs.0 00000004:00000024:2.0:1777051506.713034:0:21368:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4194304 pending 0 free 1446141952 avail 1299902464 00000100:00100000:2.0:1777051506.713398:0:21368:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942d23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+54:140246:x1863365426108288:12345-192.168.201.46@tcp:41:lfs.0 Request processed in 399us (915us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051506.713410:0:21368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112437 00000100:00100000:3.0:1777051506.720902:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051506.721015:0:47388:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426108416 00000100:00100000:0.0:1777051506.721027:0:47388:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426108416 00000100:00100000:0.0:1777051506.721140:0:47388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 5716 00000100:00080000:2.0:1777051506.721152:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1777051506.721160:0:47388:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d951fa1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+53:140246:x1863365426108416:12345-192.168.201.46@tcp:13:lfs.0 00002000:00000024:0.0:1777051506.721339:0:47388:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 499268288 pending 0 free 3860574208 avail 3629051904 00000100:00100000:0.0:1777051506.721426:0:47388:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d951fa1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+53:140246:x1863365426108416:12345-192.168.201.46@tcp:13:lfs.0 Request processed in 272us (531us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051506.721438:0:47388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 5716 00000100:00100000:0.0:1777051506.727489:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051506.727729:0:8472:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426108544 00000100:00100000:3.0:1777051506.727740:0:8472:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426108544 00000100:00080000:2.0:1777051506.727844:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1777051506.727850:0:8472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 5717 00000100:00100000:3.0:1777051506.727866:0:8472:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+50:140246:x1863365426108544:12345-192.168.201.46@tcp:13:lfs.0 00002000:00000024:3.0:1777051506.727910:0:8472:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 489208512 pending 0 free 3642707968 avail 3411185664 00000100:00100000:3.0:1777051506.728003:0:8472:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+50:140246:x1863365426108544:12345-192.168.201.46@tcp:13:lfs.0 Request processed in 140us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051506.728016:0:8472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 5717 00010000:00010000:1.0:1777051506.842239:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1777051506.966495:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f9bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452716288:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1777051506.966551:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95fbaed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3678:1863365452716416:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1777051506.966585:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051506.966632:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051506.966651:0:6585:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452716288 00000100:00100000:2.0:1777051506.966661:0:6585:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452716288 00000100:00100000:3.0:1777051506.966730:0:11727:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452716416 00000100:00100000:3.0:1777051506.966740:0:11727:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452716416 00000100:00100000:2.0:1777051506.966752:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8353 00000100:00100000:2.0:1777051506.966770:0:6585:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3677:x1863365452716288:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1777051506.966807:0:11727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8354 00000004:00000024:2.0:1777051506.966810:0:6585:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4194304 pending 0 free 1441550336 avail 1295310848 00000100:00100000:3.0:1777051506.966827:0:11727:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d951fa2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3678:x1863365452716416:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1777051506.966876:0:11727:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4194304 pending 0 free 1446141952 avail 1299902464 00000100:00100000:2.0:1777051506.966889:0:6585:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3677:x1863365452716288:12345-0@lo:41:osp-pre-0-1.0 Request processed in 124us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051506.966906:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8353 00000100:00100000:0.0:1777051506.966923:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f9b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3679:1863365452716544:0@lo:400:kworker.0 00000100:00100000:3.0:1777051506.966942:0:11727:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d951fa2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3678:x1863365452716416:12345-0@lo:41:osp-pre-1-0.0 Request processed in 119us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051506.966955:0:11727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8354 00000100:00100000:0.0:1777051506.966980:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051506.967000:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f9bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3678:1863365452716928:0@lo:400:kworker.0 00000100:00100000:3.0:1777051506.967029:0:109180:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452716544 00000100:00100000:3.0:1777051506.967037:0:109180:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452716544 00000100:00100000:2.0:1777051506.967053:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051506.967070:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955507b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3679:1863365452717056:0@lo:400:kworker.0 00000100:00100000:2.0:1777051506.967093:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955507100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3678:1863365452717440:0@lo:400:kworker.0 00000100:00100000:3.0:1777051506.967097:0:109180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1777051506.967118:0:109180:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f3be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9351a01-5b0e-4470-97fd-58b9b4b312a2+23:3679:x1863365452716544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777051506.967140:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051506.967601:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051506.967613:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955504000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452717568:0@lo:400:kworker.0 00000100:00100000:3.0:1777051506.967619:0:109180:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f3be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9351a01-5b0e-4470-97fd-58b9b4b312a2+23:3679:x1863365452716544:12345-0@lo:400:kworker.0 Request processed in 503us (636us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051506.967634:0:109180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1777051506.967673:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051506.967673:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95fbaed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3678:1863365452716416:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1777051506.967757:0:27884:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452717568 00000100:00100000:0.0:1777051506.967762:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f9b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3679:1863365452716544:0@lo:400:kworker.0 00000100:00100000:2.0:1777051506.967762:0:3678:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1777051506.967767:0:27884:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452717568 00000100:00100000:2.0:1777051506.967780:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f9b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3678:1863365452716800:0@lo:400:kworker.0 00000100:00100000:0.0:1777051506.967792:0:3679:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1777051506.967809:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f9b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3679:1863365452716672:0@lo:400:kworker.0 00000100:00100000:2.0:1777051506.967832:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051506.967845:0:27884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10545 00000100:00100000:3.0:1777051506.967867:0:27884:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94c128a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3679:x1863365452717568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777051506.967868:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051506.967874:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955505500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452717312:0@lo:400:kworker.0 00000100:00100000:0.0:1777051506.967917:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955505c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452717184:0@lo:400:kworker.0 00000100:00100000:2.0:1777051506.967928:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051506.967954:0:27884:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94c128a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3679:x1863365452717568:12345-0@lo:400:kworker.0 Request processed in 94us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051506.967964:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da4384e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3678:1863365452717824:0@lo:400:kworker.0 00000100:00100000:3.0:1777051506.967971:0:27884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10545 00000100:00100000:0.0:1777051506.967980:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051506.968040:0:27884:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452717312 00000100:00100000:2.0:1777051506.968042:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051506.968048:0:8470:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452717184 00000100:00100000:0.0:1777051506.968051:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da4384df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452717696:0@lo:400:kworker.0 00000100:00100000:3.0:1777051506.968051:0:27884:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452717312 00000100:00100000:1.0:1777051506.968062:0:8470:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452717184 00000100:00100000:0.0:1777051506.968112:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051506.968125:0:27884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10546 00000100:00100000:2.0:1777051506.968142:0:13320:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452717696 00000100:00100000:3.0:1777051506.968142:0:27884:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95fbace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3678:x1863365452717312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777051506.968152:0:13320:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452717696 00000100:00100000:1.0:1777051506.968154:0:8470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10547 00000100:00100000:0.0:1777051506.968176:0:3679:0:(client.c:3101:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968374 gen 2 00000100:00100000:1.0:1777051506.968176:0:8470:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94c12bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3679:x1863365452717184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777051506.968202:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955504000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452717568:0@lo:400:kworker.0 00000100:00100000:3.0:1777051506.968283:0:27884:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95fbace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3678:x1863365452717312:12345-0@lo:400:kworker.0 Request processed in 144us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051506.968297:0:27884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10546 00000100:00100000:0.0:1777051506.968306:0:46494:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452716928 00000100:00100000:1.0:1777051506.968306:0:8470:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94c12bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3679:x1863365452717184:12345-0@lo:400:kworker.0 Request processed in 133us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051506.968315:0:13320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10548 00000100:00100000:0.0:1777051506.968317:0:46494:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452716928 00000100:00100000:1.0:1777051506.968331:0:8470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10547 00000100:00100000:2.0:1777051506.968341:0:13320:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94c12a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3679:x1863365452717696:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1777051506.968349:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1777051506.968360:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1777051506.968366:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1777051506.968386:0:46494:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452717056 00000100:00100000:0.0:1777051506.968394:0:46494:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452717056 00000100:00100000:3.0:1777051506.968399:0:10328:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452717440 00000100:00100000:3.0:1777051506.968408:0:10328:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452717440 00000100:00100000:2.0:1777051506.968412:0:13320:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94c12a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3679:x1863365452717696:12345-0@lo:400:kworker.0 Request processed in 78us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051506.968425:0:13320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10548 00000100:00100000:0.0:1777051506.968458:0:46494:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452716800 00000100:00100000:0.0:1777051506.968466:0:46494:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452716800 00000100:00100000:3.0:1777051506.968472:0:10328:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452716672 00000100:00100000:3.0:1777051506.968480:0:10328:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452716672 00000100:00100000:2.0:1777051506.968497:0:6580:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452717824 00000100:00100000:2.0:1777051506.968506:0:6580:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452717824 00000100:00100000:0.0:1777051506.968524:0:46494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13505 00000100:00100000:3.0:1777051506.968536:0:10328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13506 00000100:00100000:0.0:1777051506.968544:0:46494:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95fbafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000-lwp-OST0001_UUID+5:3678:x1863365452716928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051506.968559:0:10328:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da4384dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3679:x1863365452717056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777051506.968570:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13507 00000100:00100000:2.0:1777051506.968585:0:6580:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95fbac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3678:x1863365452717440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777051506.968616:0:46494:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95fbafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000-lwp-OST0001_UUID+5:3678:x1863365452716928:12345-0@lo:400:kworker.0 Request processed in 79us (1562us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051506.968629:0:46494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13505 00000100:00100000:3.0:1777051506.968657:0:10328:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da4384dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3679:x1863365452717056:12345-0@lo:400:kworker.0 Request processed in 105us (1517us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051506.968669:0:46494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13508 00000100:00100000:2.0:1777051506.968672:0:6580:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95fbac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3678:x1863365452717440:12345-0@lo:400:kworker.0 Request processed in 86us (1067us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051506.968707:0:10328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13506 00000100:00100000:0.0:1777051506.968716:0:46494:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95fbaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0001-lwp-OST0000_UUID+5:3678:x1863365452716800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777051506.968724:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13507 00000100:00100000:3.0:1777051506.968750:0:10328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13509 00000100:00100000:2.0:1777051506.968764:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13510 00000100:00100000:3.0:1777051506.968770:0:10328:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94c12b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3679:x1863365452716672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777051506.969036:0:6580:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95fbac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3678:x1863365452717824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777051506.969039:0:46494:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95fbaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0001-lwp-OST0000_UUID+5:3678:x1863365452716800:12345-0@lo:400:kworker.0 Request processed in 356us (1206us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051506.969054:0:46494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13508 00000100:00100000:3.0:1777051506.969108:0:10328:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94c12b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3679:x1863365452716672:12345-0@lo:400:kworker.0 Request processed in 344us (1245us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051506.969120:0:6580:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95fbac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3678:x1863365452717824:12345-0@lo:400:kworker.0 Request processed in 343us (1080us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051506.969123:0:10328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13509 00000100:00100000:2.0:1777051506.969140:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13510 00000100:00080000:3.0:1777051506.969175:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1777051506.969177:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f9bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452716288:0@lo:41:osp-pre-0-1.0 00000100:00080000:3.0:1777051506.969183:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1777051506.969282:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f9b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3678:1863365452716800:0@lo:400:kworker.0 00000100:00100000:0.0:1777051506.969297:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f9b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3679:1863365452716672:0@lo:400:kworker.0 00000100:00100000:0.0:1777051506.969318:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955505c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452717184:0@lo:400:kworker.0 00000100:00100000:0.0:1777051506.969347:0:3679:0:(client.c:3101:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968377 gen 2 00000100:00100000:3.0:1777051506.969354:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955505500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452717312:0@lo:400:kworker.0 00000100:00100000:0.0:1777051506.969367:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da4384df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452717696:0@lo:400:kworker.0 00000100:00100000:3.0:1777051506.969388:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da4384e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3678:1863365452717824:0@lo:400:kworker.0 00000100:00100000:0.0:1777051506.969396:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955507b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3679:1863365452717056:0@lo:400:kworker.0 00000100:00100000:3.0:1777051506.969413:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f9bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3678:1863365452716928:0@lo:400:kworker.0 00000100:00100000:3.0:1777051506.969433:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955507100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3678:1863365452717440:0@lo:400:kworker.0 00000100:00100000:3.0:1777051507.479439:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d951fa3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3678:1863365452717952:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1777051507.479558:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051507.479649:0:47388:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452717952 00000100:00100000:3.0:1777051507.479661:0:47388:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452717952 00000100:00100000:3.0:1777051507.479793:0:47388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5718 00000100:00100000:3.0:1777051507.479823:0:47388:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94e626680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3678:x1863365452717952:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1777051507.479864:0:47388:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 489208512 pending 0 free 3642707968 avail 3411185664 00000100:00100000:3.0:1777051507.479989:0:47388:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94e626680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3678:x1863365452717952:12345-0@lo:13:osp-pre-1-0.0 Request processed in 181us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051507.480002:0:47388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5718 00000100:00100000:2.0:1777051507.480094:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d951fa3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3678:1863365452717952:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1777051507.480384:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95fbadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452718080:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1777051507.480446:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051507.480659:0:10113:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452718080 00000100:00100000:2.0:1777051507.480696:0:10113:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452718080 00000100:00100000:2.0:1777051507.480765:0:10113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5719 00000100:00100000:2.0:1777051507.480780:0:10113:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94c12a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3679:x1863365452718080:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1777051507.480804:0:10113:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 499268288 pending 0 free 3860574208 avail 3629051904 00000100:00100000:2.0:1777051507.480885:0:10113:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94c12a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3679:x1863365452718080:12345-0@lo:13:osp-pre-0-0.0 Request processed in 107us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051507.480899:0:10113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5719 00000100:00100000:0.0:1777051507.481086:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95fbadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452718080:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1777051507.862620:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1777051507.949754:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051507.949860:0:9550:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426108672 00000100:00100000:0.0:1777051507.949875:0:9550:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426108672 00000100:00100000:0.0:1777051507.949974:0:9550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13751 00000100:00100000:0.0:1777051507.949993:0:9550:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942d20a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+53:2436:x1863365426108672:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1777051507.950014:0:9550:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 21 locks, starting at 0 00010000:00010000:0.0:1777051507.950064:0:9550:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000780ea74a/0x85f51a6b9670f739 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x140:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b4587 expref: 53 pid: 8470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051507.950115:0:9550:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003dcd6b7e/0x85f51a6b9670f5b1 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x141:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b4509 expref: 52 pid: 27884 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051507.950151:0:9550:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f7d70b97/0x85f51a6b9670f5aa lrc: 0/0,0 mode: --/PR res: [0x280000401:0x134:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b4502 expref: 51 pid: 27884 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051507.950184:0:9550:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000016d2ce8/0x85f51a6b9670f414 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x13f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b4492 expref: 50 pid: 8471 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051507.950239:0:9550:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000491530e6/0x85f51a6b9670f406 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x13d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b448b expref: 49 pid: 8468 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051507.950317:0:9550:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c66b3d20/0x85f51a6b9670f3ff lrc: 0/0,0 mode: --/PR res: [0x280000401:0x12f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b447d expref: 48 pid: 27884 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051507.950360:0:9550:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a09b120/0x85f51a6b9670f3f8 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x132:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b4476 expref: 47 pid: 8471 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051507.950389:0:9550:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f24c345c/0x85f51a6b9670f246 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x12e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b43ff expref: 46 pid: 13320 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051507.950419:0:9550:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000036b156e1/0x85f51a6b9670f238 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x131:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b43ea expref: 45 pid: 8471 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051507.950452:0:9550:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f3fea67/0x85f51a6b9670f231 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x130:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b43e3 expref: 44 pid: 8470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051507.950481:0:9550:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005fd68d83/0x85f51a6b9670f21c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x13b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b43d5 expref: 43 pid: 27887 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051507.950510:0:9550:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000756487b4/0x85f51a6b9670eef0 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x139:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b42f5 expref: 42 pid: 8471 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051507.950547:0:9550:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b3406a6b/0x85f51a6b9670eee9 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x13c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b42ee expref: 41 pid: 8470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051507.950574:0:9550:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b2be07de/0x85f51a6b9670eee2 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x13a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b42e7 expref: 40 pid: 13320 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051507.950606:0:9550:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000096d69d4/0x85f51a6b9670ed68 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x137:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b427e expref: 39 pid: 8628 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051507.950633:0:9550:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dd211c13/0x85f51a6b9670ed5a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x13e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b4270 expref: 38 pid: 13320 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051507.950693:0:9550:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005bf346b4/0x85f51a6b9670ed53 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x138:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b4269 expref: 37 pid: 55805 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051507.950729:0:9550:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e1fa179b/0x85f51a6b9670eba8 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x136:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b41f2 expref: 36 pid: 27884 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051507.950759:0:9550:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005eed2f46/0x85f51a6b9670ebaf lrc: 0/0,0 mode: --/PR res: [0x280000401:0x12d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b41dd expref: 35 pid: 8468 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051507.950794:0:9550:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000002e600a4/0x85f51a6b9670eba1 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x133:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b41cf expref: 34 pid: 13320 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051507.950829:0:9550:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b8e88c0/0x85f51a6b9670eb8c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x135:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b41c8 expref: 33 pid: 24468 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051507.950846:0:9550:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1777051507.951019:0:9550:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942d20a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+32:2436:x1863365426108672:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 1028us (1272us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051507.951034:0:9550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13751 00000040:00080000:1.0:1777051508.256523:0:109842:0:(llog.c:801:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:1.0:1777051508.256536:0:109842:0:(llog_cat.c:158:llog_cat_process_common()) processing log [0x1:0x2b:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1777051508.256605:0:109842:0:(llog.c:858:llog_process_thread()) stop processing plain [0x1:0x2b:0x0] index 12 count 6 00000040:00080000:1.0:1777051508.256617:0:109842:0:(llog.c:858:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00000100:00100000:1.0:1777051508.443693:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051508.443777:0:46494:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426108800 00000100:00100000:2.0:1777051508.444153:0:46494:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426108800 00000100:00100000:2.0:1777051508.444638:0:46494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112438 00000100:00080000:3.0:1777051508.444673:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1777051508.444702:0:46494:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942d22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c11b6966-0775-44d2-bdc6-c74c26eb2226+8:140295:x1863365426108800:12345-192.168.201.46@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1777051508.445201:0:46494:0:(mdt_handler.c:7958:mdt_fid2path()) path get [0x2000032e3:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1777051508.446037:0:46494:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942d22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c11b6966-0775-44d2-bdc6-c74c26eb2226+8:140295:x1863365426108800:12345-192.168.201.46@tcp:53:lhsmtool_posix.0 Request processed in 1001us (2877us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051508.446059:0:46494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112438 00000100:00100000:2.0:1777051508.455090:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051508.456698:0:6579:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426108928 00000100:00100000:3.0:1777051508.456714:0:6579:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426108928 00000100:00100000:3.0:1777051508.457190:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112439 00000100:00100000:3.0:1777051508.457272:0:6579:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95fbadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+8:140295:x1863365426108928:12345-192.168.201.46@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1777051508.457389:0:6579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce800/0x85f51a6b96717b83 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051508.457425:0:6579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce800/0x85f51a6b96717b83 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051508.457453:0:6579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce800/0x85f51a6b96717b83 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051508.457478:0:6579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce400/0x85f51a6b96717b8a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x883c0416 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051508.457498:0:6579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce400/0x85f51a6b96717b8a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x883c0416 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051508.457525:0:6579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce400/0x85f51a6b96717b8a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x883c0416 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051508.457577:0:6579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cf000/0x85f51a6b96717b91 lrc: 3/1,0 mode: --/PR res: [0x2000032e3:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051508.457596:0:6579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cf000/0x85f51a6b96717b91 lrc: 3/1,0 mode: PR/PR res: [0x2000032e3:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051508.457617:0:6579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cf000/0x85f51a6b96717b91 lrc: 3/1,0 mode: PR/PR res: [0x2000032e3:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1777051508.457732:0:6579:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000032e3:0xb:0x0]: returning size 0 00000004:00200000:3.0:1777051508.457746:0:6579:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1777051508.457774:0:6579:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cf000/0x85f51a6b96717b91 lrc: 3/1,0 mode: PR/PR res: [0x2000032e3:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051508.457804:0:6579:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce800/0x85f51a6b96717b83 lrc: 4/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051508.457819:0:6579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce800/0x85f51a6b96717b83 lrc: 4/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051508.457839:0:6579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce800/0x85f51a6b96717b83 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051508.457853:0:6579:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce800/0x85f51a6b96717b83 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051508.457872:0:6579:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da7d5ce800 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:3.0:1777051508.457880:0:6579:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce800/0x85f51a6b96717b83 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051508.457895:0:6579:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce800/0x85f51a6b96717b83 lrc: 5/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051508.457923:0:6579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99d9413d2e00) 00010000:00010000:3.0:1777051508.457930:0:6579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777051508.457938:0:6579:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce800/0x85f51a6b96717b83 lrc: 3/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051508.457958:0:6579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce800/0x85f51a6b96717b83 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051508.457995:0:6579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce400/0x85f51a6b96717b8a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x883c0416 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051508.458010:0:6579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce400/0x85f51a6b96717b8a lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x883c0416 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051508.458023:0:6579:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce400/0x85f51a6b96717b8a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x883c0416 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051508.458041:0:6579:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da7d5ce400 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:3.0:1777051508.458049:0:6579:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce400/0x85f51a6b96717b8a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x883c0416 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051508.458064:0:6579:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce400/0x85f51a6b96717b8a lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x883c0416 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051508.458088:0:6579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x883c0416 (ffff99d9413d2000) 00010000:00010000:3.0:1777051508.458095:0:6579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777051508.458102:0:6579:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce400/0x85f51a6b96717b8a lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x883c0416 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051508.458122:0:6579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce400/0x85f51a6b96717b8a lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x883c0416 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051508.458161:0:6579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cf000/0x85f51a6b96717b91 lrc: 3/1,0 mode: PR/PR res: [0x2000032e3:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051508.458186:0:6579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cf000/0x85f51a6b96717b91 lrc: 2/0,0 mode: PR/PR res: [0x2000032e3:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051508.458203:0:6579:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cf000/0x85f51a6b96717b91 lrc: 3/0,0 mode: PR/PR res: [0x2000032e3:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051508.458213:0:6579:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da7d5cf000 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:3.0:1777051508.458219:0:6579:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cf000/0x85f51a6b96717b91 lrc: 3/0,0 mode: PR/PR res: [0x2000032e3:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051508.458232:0:6579:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cf000/0x85f51a6b96717b91 lrc: 4/0,0 mode: PR/PR res: [0x2000032e3:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051508.458304:0:6579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e3:0xb:0x0].0x0 (ffff99d94e5e2300) 00010000:00010000:3.0:1777051508.458312:0:6579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777051508.458326:0:6579:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cf000/0x85f51a6b96717b91 lrc: 2/0,0 mode: --/PR res: [0x2000032e3:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051508.458339:0:6579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cf000/0x85f51a6b96717b91 lrc: 0/0,0 mode: --/PR res: [0x2000032e3:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051508.458482:0:6579:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95fbadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+8:140295:x1863365426108928:12345-192.168.201.46@tcp:34:lhsmtool_posix.0 Request processed in 1276us (3398us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051508.458500:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112439 00000100:00100000:1.0:1777051508.466343:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051508.471013:0:46497:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426109184 00000100:00100000:3.0:1777051508.471030:0:46497:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426109184 00000100:00100000:3.0:1777051508.471160:0:46497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112440 00000100:00100000:3.0:1777051508.471184:0:46497:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942d20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:c11b6966-0775-44d2-bdc6-c74c26eb2226+8:140295:x1863365426109184:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1777051508.471257:0:46497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777051508.471293:0:46497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cf000/0x85f51a6b96717b98 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6a86 expref: -99 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051508.471473:0:46497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce400/0x85f51a6b96717b9f lrc: 3/1,0 mode: --/PR res: [0x2000032e3:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051508.471500:0:46497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce400/0x85f51a6b96717b9f lrc: 3/1,0 mode: PR/PR res: [0x2000032e3:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051508.471526:0:46497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce400/0x85f51a6b96717b9f lrc: 3/1,0 mode: PR/PR res: [0x2000032e3:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1777051508.471551:0:46497:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000032e3:0xb:0x0]: returning size 0 00010000:00010000:3.0:1777051508.472497:0:46497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce400/0x85f51a6b96717b9f lrc: 3/1,0 mode: PR/PR res: [0x2000032e3:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051508.472519:0:46497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce400/0x85f51a6b96717b9f lrc: 2/0,0 mode: PR/PR res: [0x2000032e3:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051508.472533:0:46497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce400/0x85f51a6b96717b9f lrc: 3/0,0 mode: PR/PR res: [0x2000032e3:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051508.472549:0:46497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da7d5ce400 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:3.0:1777051508.472557:0:46497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce400/0x85f51a6b96717b9f lrc: 3/0,0 mode: PR/PR res: [0x2000032e3:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051508.472569:0:46497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce400/0x85f51a6b96717b9f lrc: 4/0,0 mode: PR/PR res: [0x2000032e3:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051508.472593:0:46497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e3:0xb:0x0].0x0 (ffff99d94e5e2300) 00010000:00010000:3.0:1777051508.472598:0:46497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1777051508.472606:0:46497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce400/0x85f51a6b96717b9f lrc: 2/0,0 mode: --/PR res: [0x2000032e3:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051508.472626:0:46497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce400/0x85f51a6b96717b9f lrc: 0/0,0 mode: --/PR res: [0x2000032e3:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051508.472734:0:46497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cf000/0x85f51a6b96717b98 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6a86 expref: 10 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051508.472759:0:46497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99d9413d2000) 00010000:00010000:3.0:1777051508.472764:0:46497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1777051508.472771:0:46497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cf000/0x85f51a6b96717b98 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6a86 expref: 10 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051508.472803:0:46497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99da7d5cf000, rc 0) 00000100:00100000:3.0:1777051508.472907:0:46497:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942d20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:c11b6966-0775-44d2-bdc6-c74c26eb2226+9:140295:x1863365426109184:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 Request processed in 1733us (6580us total) trans 34359738369 rc 301/301 00000100:00100000:3.0:1777051508.472928:0:46497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112440 00000100:00100000:2.0:1777051508.484068:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051508.485105:0:6582:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426109440 00000100:00100000:2.0:1777051508.485119:0:6582:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426109440 00000100:00100000:2.0:1777051508.487339:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3429 00000100:00100000:2.0:1777051508.487370:0:6582:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95fbadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+9:140295:x1863365426109440:12345-192.168.201.46@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1777051508.487816:0:6582:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95fbadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+10:140295:x1863365426109440:12345-192.168.201.46@tcp:35:lhsmtool_posix.0 Request processed in 449us (3759us total) trans 34359738370 rc 0/0 00000100:00100000:2.0:1777051508.487834:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3429 00000100:00100000:2.0:1777051508.491793:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051508.492242:0:10328:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426109568 00000100:00100000:3.0:1777051508.492262:0:10328:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426109568 00000100:00100000:3.0:1777051508.492390:0:10328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112441 00000100:00100000:3.0:1777051508.492410:0:10328:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95fbaf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+10:140295:x1863365426109568:12345-192.168.201.46@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1777051508.492492:0:10328:0:(mdt_handler.c:7958:mdt_fid2path()) path get [0x2000032e3:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1777051508.492730:0:10328:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95fbaf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+10:140295:x1863365426109568:12345-192.168.201.46@tcp:53:lhsmtool_posix.0 Request processed in 323us (945us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051508.492748:0:10328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112441 00000100:00100000:3.0:1777051508.501241:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051508.501530:0:6580:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426109696 00000100:00100000:0.0:1777051508.501551:0:6580:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426109696 00000100:00100000:0.0:1777051508.501648:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112442 00000100:00100000:0.0:1777051508.502064:0:6580:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94e624380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+10:140295:x1863365426109696:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1777051508.502095:0:6580:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051508.502132:0:6580:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162f400/0x85f51a6b96717bad lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6a8d expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051508.502300:0:6580:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162e800/0x85f51a6b96717bb4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051508.502333:0:6580:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162e800/0x85f51a6b96717bb4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051508.502355:0:6580:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162e800/0x85f51a6b96717bb4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051508.502388:0:6580:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162f800/0x85f51a6b96717bbb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x844c7c05 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051508.502403:0:6580:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162f800/0x85f51a6b96717bbb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x844c7c05 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051508.502421:0:6580:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162f800/0x85f51a6b96717bbb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x844c7c05 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051508.504812:0:6580:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162fe00/0x85f51a6b96717bc2 lrc: 3/1,0 mode: --/PR res: [0x2000032e2:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051508.504839:0:6580:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162fe00/0x85f51a6b96717bc2 lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0xa:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051508.504855:0:6580:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162fe00/0x85f51a6b96717bc2 lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0xa:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1777051508.504925:0:6580:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000032e2:0xa:0x0]: returning size 4096 00000004:00200000:0.0:1777051508.504933:0:6580:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1777051508.504983:0:6580:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162fe00/0x85f51a6b96717bc2 lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0xa:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051508.505011:0:6580:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162e800/0x85f51a6b96717bb4 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051508.505026:0:6580:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162e800/0x85f51a6b96717bb4 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051508.505045:0:6580:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162e800/0x85f51a6b96717bb4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051508.505058:0:6580:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162e800/0x85f51a6b96717bb4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051508.505070:0:6580:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da4162e800 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:0.0:1777051508.505076:0:6580:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162e800/0x85f51a6b96717bb4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051508.505093:0:6580:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162e800/0x85f51a6b96717bb4 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051508.505116:0:6580:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d9413d0800) 00010000:00010000:0.0:1777051508.505127:0:6580:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777051508.505135:0:6580:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162e800/0x85f51a6b96717bb4 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051508.505149:0:6580:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162e800/0x85f51a6b96717bb4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051508.505185:0:6580:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162f800/0x85f51a6b96717bbb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x844c7c05 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051508.505198:0:6580:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162f800/0x85f51a6b96717bbb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x844c7c05 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051508.505218:0:6580:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162f800/0x85f51a6b96717bbb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x844c7c05 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051508.505231:0:6580:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da4162f800 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:0.0:1777051508.505238:0:6580:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162f800/0x85f51a6b96717bbb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x844c7c05 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051508.505256:0:6580:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162f800/0x85f51a6b96717bbb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x844c7c05 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051508.505274:0:6580:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x844c7c05 (ffff99da45738300) 00010000:00010000:0.0:1777051508.505280:0:6580:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777051508.505286:0:6580:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162f800/0x85f51a6b96717bbb lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x844c7c05 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051508.505303:0:6580:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162f800/0x85f51a6b96717bbb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x844c7c05 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051508.505381:0:6580:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162f400/0x85f51a6b96717bad lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6a8d expref: 12 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051508.505418:0:6580:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162fe00/0x85f51a6b96717bc2 lrc: 3/0,0 mode: PR/PR res: [0x2000032e2:0xa:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6a8d expref: 11 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051508.505435:0:6580:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0xa:0x0].0x0 (ffff99da45738d00) 00010000:00010000:0.0:1777051508.505510:0:6580:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1777051508.505516:0:6580:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99da4162fe00, rc 0) 00000100:00100000:0.0:1777051508.510204:0:6580:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94e624380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+11:140295:x1863365426109696:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 Request processed in 8145us (8971us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051508.510223:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112442 00000100:00100000:0.0:1777051508.527370:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051508.527887:0:6581:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426109952 00000100:00100000:1.0:1777051508.527906:0:6581:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426109952 00000100:00100000:1.0:1777051508.528017:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112443 00000100:00100000:1.0:1777051508.528044:0:6581:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94c129c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+11:140295:x1863365426109952:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1777051508.528076:0:6581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777051508.528088:0:6581:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1777051508.528569:0:6581:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162fe00/0x85f51a6b96717bc2 lrc: 0/0,0 mode: --/PR res: [0x2000032e2:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6a8d expref: 11 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051508.528608:0:6581:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0xa:0x0].0x0 (ffff99da45738d00) 00010000:00010000:1.0:1777051508.528945:0:6581:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1777051508.528990:0:6581:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502db200/0x85f51a6b96717bc9 lrc: 2/0,0 mode: --/CW res: [0x2000032e2:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6a94 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051508.533903:0:6581:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502da800/0x85f51a6b96717bd0 lrc: 3/1,0 mode: --/PR res: [0x2000032e3:0xc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051508.533991:0:6581:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502da800/0x85f51a6b96717bd0 lrc: 3/1,0 mode: PR/PR res: [0x2000032e3:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051508.534017:0:6581:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502da800/0x85f51a6b96717bd0 lrc: 3/1,0 mode: PR/PR res: [0x2000032e3:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1777051508.534036:0:6581:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000032e3:0xc:0x0]: returning size 0 00010000:00010000:1.0:1777051508.534130:0:6581:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502db200/0x85f51a6b96717bc9 lrc: 0/0,0 mode: --/CW res: [0x2000032e2:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6a94 expref: 13 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051508.534185:0:6581:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502da800/0x85f51a6b96717bd0 lrc: 3/0,0 mode: PR/PR res: [0x2000032e3:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6a94 expref: 12 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051508.534201:0:6581:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e3:0xc:0x0].0x0 (ffff99d94e592e00) 00010000:00010000:1.0:1777051508.534212:0:6581:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1777051508.534218:0:6581:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d9502da800, rc 0) 00000100:00100000:1.0:1777051508.534366:0:6581:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94c129c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+12:140295:x1863365426109952:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 Request processed in 6330us (7003us total) trans 34359738371 rc 0/0 00000100:00100000:1.0:1777051508.534388:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112443 00000100:00100000:2.0:1777051508.545358:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051508.545480:0:27885:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426110080 00000100:00100000:1.0:1777051508.545497:0:27885:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426110080 00000100:00100000:1.0:1777051508.545601:0:27885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112444 00000100:00100000:1.0:1777051508.545621:0:27885:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d951fa3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c11b6966-0775-44d2-bdc6-c74c26eb2226+12:140295:x1863365426110080:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1777051508.545694:0:27885:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777051508.545730:0:27885:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502db200/0x85f51a6b96717bde lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6a9b expref: -99 pid: 27885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051508.545838:0:27885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502da600/0x85f51a6b96717be5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051508.545863:0:27885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502da600/0x85f51a6b96717be5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051508.545889:0:27885:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502da600/0x85f51a6b96717be5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051508.545920:0:27885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502daa00/0x85f51a6b96717bec lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x844c7c05 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051508.545937:0:27885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502daa00/0x85f51a6b96717bec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x844c7c05 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051508.545951:0:27885:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502daa00/0x85f51a6b96717bec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x844c7c05 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051508.546101:0:27885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502db400/0x85f51a6b96717bf3 lrc: 3/1,0 mode: --/PR res: [0x2000032e2:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051508.546118:0:27885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502db400/0x85f51a6b96717bf3 lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0xa:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051508.546138:0:27885:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502db400/0x85f51a6b96717bf3 lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0xa:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1777051508.546192:0:27885:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000032e2:0xa:0x0]: returning size 4096 00000004:00200000:1.0:1777051508.546200:0:27885:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1777051508.546238:0:27885:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502db400/0x85f51a6b96717bf3 lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0xa:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051508.546309:0:27885:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502da600/0x85f51a6b96717be5 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051508.546325:0:27885:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502da600/0x85f51a6b96717be5 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051508.546342:0:27885:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502da600/0x85f51a6b96717be5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051508.546355:0:27885:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502da600/0x85f51a6b96717be5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051508.546379:0:27885:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d9502da600 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:1.0:1777051508.546387:0:27885:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502da600/0x85f51a6b96717be5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051508.546402:0:27885:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502da600/0x85f51a6b96717be5 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051508.546428:0:27885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d9413d0800) 00010000:00010000:1.0:1777051508.546434:0:27885:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777051508.546441:0:27885:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502da600/0x85f51a6b96717be5 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051508.546458:0:27885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502da600/0x85f51a6b96717be5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051508.546479:0:27885:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502daa00/0x85f51a6b96717bec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x844c7c05 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051508.546491:0:27885:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502daa00/0x85f51a6b96717bec lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x844c7c05 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051508.546509:0:27885:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502daa00/0x85f51a6b96717bec lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x844c7c05 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051508.546519:0:27885:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d9502daa00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:1.0:1777051508.546525:0:27885:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502daa00/0x85f51a6b96717bec lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x844c7c05 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051508.546536:0:27885:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502daa00/0x85f51a6b96717bec lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x844c7c05 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051508.546563:0:27885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x844c7c05 (ffff99d94e592100) 00010000:00010000:1.0:1777051508.546569:0:27885:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777051508.546574:0:27885:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502daa00/0x85f51a6b96717bec lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x844c7c05 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051508.546591:0:27885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502daa00/0x85f51a6b96717bec lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x844c7c05 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051508.546645:0:27885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502db200/0x85f51a6b96717bde lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6a9b expref: 14 pid: 27885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051508.547112:0:27885:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502db400/0x85f51a6b96717bf3 lrc: 3/0,0 mode: PR/PR res: [0x2000032e2:0xa:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6a9b expref: 13 pid: 27885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051508.547134:0:27885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0xa:0x0].0x0 (ffff99d94e592b00) 00010000:00010000:1.0:1777051508.547139:0:27885:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1777051508.547144:0:27885:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d9502db400, rc 0) 00000100:00100000:1.0:1777051508.547323:0:27885:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d951fa3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c11b6966-0775-44d2-bdc6-c74c26eb2226+13:140295:x1863365426110080:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 Request processed in 1705us (1976us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051508.547344:0:27885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112444 00000100:00100000:3.0:1777051508.561595:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051508.561758:0:27882:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426110336 00000100:00100000:2.0:1777051508.561774:0:27882:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426110336 00000100:00100000:2.0:1777051508.561867:0:27882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112445 00000100:00100000:2.0:1777051508.561885:0:27882:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94e624700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+13:140295:x1863365426110336:12345-192.168.201.46@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1777051508.561963:0:27882:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1777051508.562004:0:27882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502da800/0x85f51a6b96717bd0 lrc: 0/0,0 mode: --/PR res: [0x2000032e3:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6a94 expref: 13 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051508.562034:0:27882:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e3:0xc:0x0].0x0 (ffff99d94e592e00) 00010000:00010000:2.0:1777051508.562057:0:27882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502db400/0x85f51a6b96717bf3 lrc: 0/0,0 mode: --/PR res: [0x2000032e2:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6a9b expref: 12 pid: 27885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051508.562074:0:27882:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0xa:0x0].0x0 (ffff99d94e592b00) 00010000:00010000:2.0:1777051508.562085:0:27882:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1777051508.562122:0:27882:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69a000/0x85f51a6b96717bfa lrc: 3/0,1 mode: --/CW res: [0x2000032e2:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051508.562143:0:27882:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69a000/0x85f51a6b96717bfa lrc: 3/0,1 mode: CW/CW res: [0x2000032e2:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051508.562163:0:27882:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69a000/0x85f51a6b96717bfa lrc: 3/0,1 mode: CW/CW res: [0x2000032e2:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051508.562188:0:27882:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69aa00/0x85f51a6b96717c01 lrc: 3/0,1 mode: --/PW res: [0x2000032e2:0xa:0x0].0x9f6ef010 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051508.562289:0:27882:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69aa00/0x85f51a6b96717c01 lrc: 3/0,1 mode: PW/PW res: [0x2000032e2:0xa:0x0].0x9f6ef010 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051508.562305:0:27882:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69aa00/0x85f51a6b96717c01 lrc: 3/0,1 mode: PW/PW res: [0x2000032e2:0xa:0x0].0x9f6ef010 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051508.563060:0:27882:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69a000/0x85f51a6b96717bfa lrc: 4/0,1 mode: CW/CW res: [0x2000032e2:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051508.563083:0:27882:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69a000/0x85f51a6b96717bfa lrc: 4/0,1 mode: CW/CW res: [0x2000032e2:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051508.563098:0:27882:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69a000/0x85f51a6b96717bfa lrc: 3/0,0 mode: CW/CW res: [0x2000032e2:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051508.563113:0:27882:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69a000/0x85f51a6b96717bfa lrc: 4/0,0 mode: CW/CW res: [0x2000032e2:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051508.563127:0:27882:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94f69a000 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:3.0:1777051508.563612:0:27882:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69a000/0x85f51a6b96717bfa lrc: 4/0,0 mode: CW/CW res: [0x2000032e2:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051508.563635:0:27882:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69a000/0x85f51a6b96717bfa lrc: 5/0,0 mode: CW/CW res: [0x2000032e2:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051508.563679:0:27882:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0xa:0x0].0x0 (ffff99da45475b00) 00010000:00010000:3.0:1777051508.563687:0:27882:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777051508.563696:0:27882:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69a000/0x85f51a6b96717bfa lrc: 3/0,0 mode: --/CW res: [0x2000032e2:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051508.563711:0:27882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69a000/0x85f51a6b96717bfa lrc: 0/0,0 mode: --/CW res: [0x2000032e2:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051508.563742:0:27882:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69aa00/0x85f51a6b96717c01 lrc: 3/0,1 mode: PW/PW res: [0x2000032e2:0xa:0x0].0x9f6ef010 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051508.563756:0:27882:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69aa00/0x85f51a6b96717c01 lrc: 2/0,0 mode: PW/PW res: [0x2000032e2:0xa:0x0].0x9f6ef010 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051508.563769:0:27882:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69aa00/0x85f51a6b96717c01 lrc: 3/0,0 mode: PW/PW res: [0x2000032e2:0xa:0x0].0x9f6ef010 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051508.563782:0:27882:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94f69aa00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:3.0:1777051508.563788:0:27882:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69aa00/0x85f51a6b96717c01 lrc: 3/0,0 mode: PW/PW res: [0x2000032e2:0xa:0x0].0x9f6ef010 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051508.563801:0:27882:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69aa00/0x85f51a6b96717c01 lrc: 4/0,0 mode: PW/PW res: [0x2000032e2:0xa:0x0].0x9f6ef010 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051508.563816:0:27882:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0xa:0x0].0x9f6ef010 (ffff99da59dd4300) 00010000:00010000:3.0:1777051508.563822:0:27882:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777051508.563828:0:27882:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69aa00/0x85f51a6b96717c01 lrc: 2/0,0 mode: --/PW res: [0x2000032e2:0xa:0x0].0x9f6ef010 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051508.563841:0:27882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69aa00/0x85f51a6b96717c01 lrc: 0/0,0 mode: --/PW res: [0x2000032e2:0xa:0x0].0x9f6ef010 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051508.564095:0:27882:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94e624700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+11:140295:x1863365426110336:12345-192.168.201.46@tcp:36:lhsmtool_posix.0 Request processed in 2208us (2507us total) trans 0 rc -2/-2 00000100:00100000:2.0:1777051508.564113:0:27882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112445 00000100:00100000:0.0:1777051508.571787:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051508.572268:0:21368:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426110464 00000100:00100000:2.0:1777051508.572281:0:21368:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426110464 00000100:00100000:2.0:1777051508.572356:0:21368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112446 00000100:00100000:2.0:1777051508.572375:0:21368:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da4384e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+11:140295:x1863365426110464:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1777051508.572401:0:21368:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051508.572432:0:21368:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69a400/0x85f51a6b96717c08 lrc: 2/0,0 mode: --/PR res: [0x2000032e3:0xc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6aa2 expref: -99 pid: 21368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051508.572484:0:21368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69a600/0x85f51a6b96717c0f lrc: 3/1,0 mode: --/PR res: [0x2000032e3:0xc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051508.572508:0:21368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69a600/0x85f51a6b96717c0f lrc: 3/1,0 mode: PR/PR res: [0x2000032e3:0xc:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051508.572528:0:21368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69a600/0x85f51a6b96717c0f lrc: 3/1,0 mode: PR/PR res: [0x2000032e3:0xc:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051508.572730:0:21368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69a400/0x85f51a6b96717c08 lrc: 0/0,0 mode: --/PR res: [0x2000032e3:0xc:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6aa2 expref: 13 pid: 21368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051508.572763:0:21368:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69a600/0x85f51a6b96717c0f lrc: 3/0,0 mode: PR/PR res: [0x2000032e3:0xc:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6aa2 expref: 12 pid: 21368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051508.572779:0:21368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e3:0xc:0x0].0x0 (ffff99da59dd4900) 00010000:00010000:2.0:1777051508.572785:0:21368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1777051508.572790:0:21368:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d94f69a600, rc 0) 00000100:00100000:2.0:1777051508.572874:0:21368:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da4384e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+12:140295:x1863365426110464:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 Request processed in 503us (1090us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051508.572889:0:21368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112446 00000100:00100000:0.0:1777051508.583105:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051508.583244:0:8492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426110720 00000100:00100000:2.0:1777051508.583259:0:8492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426110720 00000100:00100000:2.0:1777051508.583349:0:8492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112447 00000100:00100000:2.0:1777051508.583368:0:8492:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da4384df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+12:140295:x1863365426110720:12345-192.168.201.46@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1777051508.583460:0:8492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69a400/0x85f51a6b96717c16 lrc: 3/0,1 mode: --/PW res: [0x2000032e3:0xc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051508.583487:0:8492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69a400/0x85f51a6b96717c16 lrc: 3/0,1 mode: PW/PW res: [0x2000032e3:0xc:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051508.583506:0:8492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69a400/0x85f51a6b96717c16 lrc: 3/0,1 mode: PW/PW res: [0x2000032e3:0xc:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1777051508.583730:0:8492:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000d11bf605 reply state 00000000b05809d8 transno 34359738372 ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69a400/0x85f51a6b96717c16 lrc: 3/0,1 mode: PW/PW res: [0x2000032e3:0xc:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051508.583776:0:8492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69a400/0x85f51a6b96717c16 lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e3:0xc:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051508.584128:0:8492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e3:0xc:0x0].0x0 (ffff99da59dd4900) 00010000:00010000:2.0:1777051508.584136:0:8492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1777051508.584143:0:8492:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1777051508.584338:0:8492:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da4384df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+14:140295:x1863365426110720:12345-192.168.201.46@tcp:36:lhsmtool_posix.0 Request processed in 972us (1239us total) trans 34359738372 rc 0/0 00000100:00100000:2.0:1777051508.584354:0:8492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112447 00000100:00100000:3.0:1777051508.590112:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051508.590686:0:46494:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426110848 00000100:00100000:2.0:1777051508.590697:0:46494:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426110848 00000100:00100000:2.0:1777051508.590778:0:46494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112448 00000100:00100000:2.0:1777051508.590793:0:46494:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94e627800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c11b6966-0775-44d2-bdc6-c74c26eb2226+14:140295:x1863365426110848:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1777051508.590815:0:46494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051508.590835:0:46494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69a200/0x85f51a6b96717c1d lrc: 2/0,0 mode: --/CR res: [0x2000032e3:0xc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6aa9 expref: -99 pid: 46494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051508.590893:0:46494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69a200/0x85f51a6b96717c1d lrc: 3/0,0 mode: CR/CR res: [0x2000032e3:0xc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6aa9 expref: 15 pid: 46494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051508.590910:0:46494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69a200/0x85f51a6b96717c1d lrc: 3/0,0 mode: CR/CR res: [0x2000032e3:0xc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6aa9 expref: 15 pid: 46494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051508.590923:0:46494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e3:0xc:0x0].0x0 (ffff99da59dd4900) 00010000:00010000:2.0:1777051508.590928:0:46494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1777051508.590935:0:46494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d94f69a200, rc 0) 00000100:00100000:2.0:1777051508.590993:0:46494:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94e627800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c11b6966-0775-44d2-bdc6-c74c26eb2226+15:140295:x1863365426110848:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 Request processed in 201us (888us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051508.591007:0:46494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112448 00000100:00100000:0.0:1777051508.595155:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051508.595596:0:24269:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426110976 00000100:00100000:2.0:1777051508.595607:0:24269:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426110976 00000100:00100000:2.0:1777051508.595702:0:24269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3430 00000100:00100000:2.0:1777051508.595718:0:24269:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da6ff00c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+15:140295:x1863365426110976:12345-192.168.201.46@tcp:49:lhsmtool_posix.0 00000100:00100000:2.0:1777051508.596238:0:24269:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da6ff00c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+15:140295:x1863365426110976:12345-192.168.201.46@tcp:49:lhsmtool_posix.0 Request processed in 474us (1040us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051508.596256:0:24269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3430 00000100:00100000:2.0:1777051508.600865:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051508.600978:0:6579:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426111232 00000100:00100000:3.0:1777051508.600989:0:6579:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426111232 00000100:00100000:3.0:1777051508.601064:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112449 00000100:00100000:3.0:1777051508.601079:0:6579:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95fbadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+15:140295:x1863365426111232:12345-192.168.201.46@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1777051508.601551:0:6579:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95fbadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+15:140295:x1863365426111232:12345-192.168.201.46@tcp:57:lhsmtool_posix.0 Request processed in 117us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051508.601569:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112449 00000100:00100000:3.0:1777051508.608124:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051508.608760:0:46497:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426111488 00000100:00100000:0.0:1777051508.609059:0:46497:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426111488 00000100:00100000:0.0:1777051508.609127:0:46497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112450 00000100:00100000:0.0:1777051508.609142:0:46497:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94e624a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:c11b6966-0775-44d2-bdc6-c74c26eb2226+15:140295:x1863365426111488:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1777051508.609165:0:46497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051508.609256:0:46497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162f200/0x85f51a6b96717c24 lrc: 2/0,0 mode: --/CR res: [0x2000032e2:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6ab0 expref: -99 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051508.609402:0:46497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162fa00/0x85f51a6b96717c2b lrc: 3/0,1 mode: --/EX res: [0x2000032e3:0xc:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051508.609435:0:46497:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69a200/0x85f51a6b96717c1d lrc: 2/0,0 mode: CR/CR res: [0x2000032e3:0xc:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6aa9 expref: 16 pid: 46494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051508.609451:0:46497:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162fa00/0x85f51a6b96717c2b lrc: 4/0,1 mode: --/EX res: [0x2000032e3:0xc:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051508.609499:0:46497:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69a200/0x85f51a6b96717c1d lrc: 3/0,0 mode: CR/CR res: [0x2000032e3:0xc:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6aa9 expref: 16 pid: 46494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051508.609522:0:46497:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69a200/0x85f51a6b96717c1d lrc: 4/0,0 mode: CR/CR res: [0x2000032e3:0xc:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6aa9 expref: 16 pid: 46494 timeout: 8237 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051508.609545:0:46497:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955507100 pname:cluuid:pid:xid:nid:opc:job mdt00_009:lustre-MDT0000_UUID:46497:1863365452718208:192.168.201.46@tcp:104: 00000100:00100000:0.0:1777051508.609649:0:46497:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d95ded6480 going to sleep for 11 seconds 00000100:00100000:3.0:1777051508.615619:0:46497:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955507100 pname:cluuid:pid:xid:nid:opc:job mdt00_009:lustre-MDT0000_UUID:46497:1863365452718208:192.168.201.46@tcp:104: 00010000:00010000:3.0:1777051508.615681:0:46497:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162fa00/0x85f51a6b96717c2b lrc: 3/0,1 mode: --/EX res: [0x2000032e3:0xc:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051508.616989:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051508.617236:0:6564:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426111616 00000100:00100000:2.0:1777051508.617247:0:6564:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426111616 00010000:00010000:2.0:1777051508.617292:0:6564:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69a200/0x85f51a6b96717c1d lrc: 4/0,0 mode: CR/CR res: [0x2000032e3:0xc:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6aa9 expref: 17 pid: 46494 timeout: 8237 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051508.617361:0:6564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3974 00000100:00100000:2.0:1777051508.617376:0:6564:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94e624e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+17:2437:x1863365426111616:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1777051508.617395:0:6564:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777051508.617407:0:6564:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69a200/0x85f51a6b96717c1d lrc: 4/0,0 mode: CR/CR res: [0x2000032e3:0xc:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6aa9 expref: 17 pid: 46494 timeout: 8237 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051508.617431:0:6564:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69a200/0x85f51a6b96717c1d lrc: 3/0,0 mode: CR/CR res: [0x2000032e3:0xc:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6aa9 expref: 17 pid: 46494 timeout: 8237 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051508.617461:0:6564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69a200/0x85f51a6b96717c1d lrc: 0/0,0 mode: --/CR res: [0x2000032e3:0xc:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6aa9 expref: 17 pid: 46494 timeout: 8237 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051508.617486:0:6564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e3:0xc:0x0].0x0 (ffff99da59dd4900) 00010000:00010000:2.0:1777051508.617494:0:6564:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162fa00/0x85f51a6b96717c2b lrc: 3/0,1 mode: --/EX res: [0x2000032e3:0xc:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051508.617509:0:6564:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162fa00/0x85f51a6b96717c2b lrc: 3/0,1 mode: EX/EX res: [0x2000032e3:0xc:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051508.617522:0:6564:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162fa00/0x85f51a6b96717c2b lrc: 4/0,1 mode: EX/EX res: [0x2000032e3:0xc:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051508.617561:0:6564:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1777051508.617634:0:6564:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94e624e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+16:2437:x1863365426111616:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 258us (645us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051508.617676:0:6564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3974 00010000:00010000:3.0:1777051508.617737:0:46497:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162fa00/0x85f51a6b96717c2b lrc: 3/0,1 mode: EX/EX res: [0x2000032e3:0xc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051508.617754:0:46497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162fa00/0x85f51a6b96717c2b lrc: 3/0,1 mode: EX/EX res: [0x2000032e3:0xc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1777051508.617782:0:46497:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000032e3:0xc:0x0]: returning size 0 00000004:00080000:3.0:1777051508.617964:0:46497:0:(osp_internal.h:570:osp_update_last_fid()) Gap in objids: start=[0x2c0000401:0x1e6:0x0], count =28 00000004:00080000:3.0:1777051508.617977:0:46497:0:(osp_object.c:1640:osp_create()) Writing gap [0x2c0000401:0x1e6:0x0]+28 in llog 00000004:00080000:3.0:1777051508.620817:0:46497:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x202:0x0], index 1: 0 00010000:00010000:3.0:1777051508.621046:0:46497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162fa00/0x85f51a6b96717c2b lrc: 3/0,1 mode: EX/EX res: [0x2000032e3:0xc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051508.621063:0:46497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162fa00/0x85f51a6b96717c2b lrc: 2/0,0 mode: EX/EX res: [0x2000032e3:0xc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051508.621075:0:46497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162fa00/0x85f51a6b96717c2b lrc: 3/0,0 mode: EX/EX res: [0x2000032e3:0xc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051508.621086:0:46497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da4162fa00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:3.0:1777051508.621103:0:46497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162fa00/0x85f51a6b96717c2b lrc: 3/0,0 mode: EX/EX res: [0x2000032e3:0xc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051508.621116:0:46497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162fa00/0x85f51a6b96717c2b lrc: 4/0,0 mode: EX/EX res: [0x2000032e3:0xc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051508.621134:0:46497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e3:0xc:0x0].0x0 (ffff99da59dd4900) 00010000:00010000:3.0:1777051508.621139:0:46497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1777051508.621145:0:46497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162fa00/0x85f51a6b96717c2b lrc: 2/0,0 mode: --/EX res: [0x2000032e3:0xc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051508.621157:0:46497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162fa00/0x85f51a6b96717c2b lrc: 0/0,0 mode: --/EX res: [0x2000032e3:0xc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051508.621256:0:46497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162f200/0x85f51a6b96717c24 lrc: 1/0,0 mode: --/CR res: [0x2000032e2:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6ab0 expref: 16 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051508.621276:0:46497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0xa:0x0].0x0 (ffff99da45738300) 00010000:00010000:3.0:1777051508.621281:0:46497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1777051508.621288:0:46497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162f200/0x85f51a6b96717c24 lrc: 0/0,0 mode: --/CR res: [0x2000032e2:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6ab0 expref: 16 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051508.621311:0:46497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99da4162f200, rc 0) 00000100:00100000:3.0:1777051508.621379:0:46497:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94e624a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:c11b6966-0775-44d2-bdc6-c74c26eb2226+15:140295:x1863365426111488:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 Request processed in 12239us (13262us total) trans 34359738373 rc 301/301 00000100:00100000:3.0:1777051508.621393:0:46497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112450 00000100:00100000:3.0:1777051508.628534:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051508.628639:0:6583:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426111872 00000100:00100000:0.0:1777051508.628682:0:6583:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426111872 00000100:00100000:0.0:1777051508.628759:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3431 00000100:00100000:0.0:1777051508.628777:0:6583:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94e627b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+15:140295:x1863365426111872:12345-192.168.201.46@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1777051508.629691:0:6583:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94e627b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+16:140295:x1863365426111872:12345-192.168.201.46@tcp:35:lhsmtool_posix.0 Request processed in 916us (1162us total) trans 34359738374 rc 0/0 00000100:00100000:0.0:1777051508.629707:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3431 00000100:00100000:0.0:1777051508.633533:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051508.633630:0:10328:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426112000 00000100:00100000:3.0:1777051508.633643:0:10328:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426112000 00000100:00100000:3.0:1777051508.633754:0:10328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112451 00000100:00100000:3.0:1777051508.633771:0:10328:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955505500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+16:140295:x1863365426112000:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1777051508.633798:0:10328:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777051508.634139:0:10328:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cf000/0x85f51a6b96717c39 lrc: 2/0,0 mode: --/CR res: [0x2000032e3:0xc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6ab7 expref: -99 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051508.634334:0:10328:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162f000/0x85f51a6b96717c40 lrc: 3/1,0 mode: --/PR res: [0x2000032e3:0xc:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051508.634361:0:10328:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162f000/0x85f51a6b96717c40 lrc: 3/1,0 mode: PR/PR res: [0x2000032e3:0xc:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051508.634382:0:10328:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162f000/0x85f51a6b96717c40 lrc: 3/1,0 mode: PR/PR res: [0x2000032e3:0xc:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1777051508.634438:0:10328:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000032e3:0xc:0x0]: returning size 0 00000004:00200000:0.0:1777051508.634444:0:10328:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1777051508.634470:0:10328:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162f000/0x85f51a6b96717c40 lrc: 3/1,0 mode: PR/PR res: [0x2000032e3:0xc:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051508.634513:0:10328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cf000/0x85f51a6b96717c39 lrc: 0/0,0 mode: --/CR res: [0x2000032e3:0xc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6ab7 expref: 18 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051508.634539:0:10328:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162f000/0x85f51a6b96717c40 lrc: 3/0,0 mode: PR/PR res: [0x2000032e3:0xc:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6ab7 expref: 17 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051508.634554:0:10328:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e3:0xc:0x0].0x0 (ffff99da59dd4900) 00010000:00010000:0.0:1777051508.634560:0:10328:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1777051508.634566:0:10328:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99da4162f000, rc 0) 00000100:00100000:0.0:1777051508.634637:0:10328:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955505500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+17:140295:x1863365426112000:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 Request processed in 869us (1110us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051508.634681:0:10328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112451 00000100:00100000:3.0:1777051508.642062:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051508.642330:0:8628:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426112128 00000100:00100000:2.0:1777051508.642344:0:8628:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426112128 00000100:00080000:3.0:1777051508.642407:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1777051508.642456:0:8628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 8107 00000100:00100000:2.0:1777051508.642473:0:8628:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94e625180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+27:2437:x1863365426112128:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1777051508.642498:0:8628:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051508.642540:0:8628:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000264f01d8/0x85f51a6b96717c47 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x202:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6abe expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1777051508.642581:0:8628:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x202:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1777051508.642605:0:8628:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777051508.642610:0:8628:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777051508.642622:0:8628:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000264f01d8/0x85f51a6b96717c47 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x202:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6abe expref: 28 pid: 8628 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051508.642990:0:8628:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000264f01d8/0x85f51a6b96717c47 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x202:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6abe expref: 28 pid: 8628 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051508.643014:0:8628:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d94f69a200, rc 0) 00000100:00100000:2.0:1777051508.643103:0:8628:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94e625180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+28:2437:x1863365426112128:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 Request processed in 632us (1050us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051508.643116:0:8628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 8107 00000100:00100000:0.0:1777051508.648823:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051508.648893:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051508.648958:0:109186:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426112256 00000100:00100000:0.0:1777051508.648969:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051508.648974:0:109186:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426112256 00000100:00100000:0.0:1777051508.649019:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051508.649055:0:109186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 85 00000100:00100000:2.0:1777051508.649070:0:109186:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f3be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:29c4352d-3260-4734-909d-9ea5de9e7fa4+12:2437:x1863365426112256:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:3.0:1777051508.649118:0:8470:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426112512 00000100:00100000:3.0:1777051508.649130:0:8470:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426112512 00000100:00100000:2.0:1777051508.649156:0:109186:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f3be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:29c4352d-3260-4734-909d-9ea5de9e7fa4+12:2437:x1863365426112256:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 86us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051508.649178:0:109186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 85 00000100:00100000:0.0:1777051508.649465:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051508.649510:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051508.649554:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051508.649597:0:6581:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426112384 00000100:00100000:0.0:1777051508.649606:0:6581:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426112384 00000100:00100000:0.0:1777051508.649689:0:6581:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426112768 00000100:00100000:0.0:1777051508.649696:0:6581:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426112768 00000100:00100000:0.0:1777051508.649745:0:6581:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426112640 00000100:00100000:0.0:1777051508.649750:0:6581:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426112640 00000100:00100000:2.0:1777051508.649775:0:13320:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426113024 00000100:00100000:2.0:1777051508.649787:0:13320:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426113024 00000100:00100000:0.0:1777051508.649794:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13511 00000100:00100000:0.0:1777051508.649813:0:6581:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955505c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+9:2436:x1863365426112384:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:2.0:1777051508.649852:0:13320:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426112896 00000100:00100000:2.0:1777051508.649860:0:13320:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426112896 00000100:00100000:0.0:1777051508.649894:0:6581:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955505c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+9:2436:x1863365426112384:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 85us (929us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051508.649920:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13511 00000100:00100000:2.0:1777051508.649920:0:13320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10549 00000100:00100000:2.0:1777051508.649949:0:13320:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955507b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+30:2437:x1863365426112512:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:0.0:1777051508.649964:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13512 00000100:00100000:0.0:1777051508.649979:0:6581:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955504000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+54:2437:x1863365426112768:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:2.0:1777051508.650020:0:13320:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955507b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+30:2437:x1863365426112512:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 77us (1123us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051508.650035:0:13320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10549 00000100:00100000:0.0:1777051508.650045:0:6581:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955504000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+54:2437:x1863365426112768:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 63us (1022us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051508.650061:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13512 00000100:00100000:2.0:1777051508.650079:0:13320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10550 00000100:00100000:0.0:1777051508.650100:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13513 00000100:00100000:2.0:1777051508.650104:0:13320:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+50:2437:x1863365426113024:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:0.0:1777051508.650120:0:6581:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955507100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+9:2436:x1863365426112640:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:2.0:1777051508.650175:0:13320:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+50:2437:x1863365426113024:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 79us (659us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051508.650191:0:6581:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955507100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+9:2436:x1863365426112640:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 74us (776us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051508.650240:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13513 00000100:00100000:2.0:1777051508.650241:0:13320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10550 00000100:00100000:0.0:1777051508.650284:0:55805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10551 00000100:00100000:0.0:1777051508.650301:0:55805:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+32:2436:x1863365426112896:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:0.0:1777051508.650351:0:55805:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+32:2436:x1863365426112896:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 54us (795us total) trans 0 rc 0/0 00000100:00080000:2.0:1777051508.650360:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1777051508.650368:0:55805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10551 00000100:00080000:2.0:1777051508.650372:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1777051508.650378:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1777051508.650383:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1777051508.650935:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051508.651095:0:27882:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426113280 00000100:00100000:2.0:1777051508.651105:0:27882:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426113280 00000100:00100000:2.0:1777051508.651485:0:27882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112452 00000100:00100000:2.0:1777051508.651499:0:27882:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+17:140295:x1863365426113280:12345-192.168.201.46@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1777051508.651608:0:27882:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+17:140295:x1863365426113280:12345-192.168.201.46@tcp:57:lhsmtool_posix.0 Request processed in 111us (684us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051508.651625:0:27882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112452 00000100:00100000:2.0:1777051508.659114:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051508.659753:0:21368:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426113408 00000100:00100000:3.0:1777051508.659764:0:21368:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426113408 00000100:00100000:3.0:1777051508.659842:0:21368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112453 00000100:00100000:3.0:1777051508.659868:0:21368:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955610700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+17:140295:x1863365426113408:12345-192.168.201.46@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1777051508.665990:0:109175:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 34359738374 is committed 00010000:00010000:3.0:1777051508.666068:0:3663:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69a400/0x85f51a6b96717c16 lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e3:0xc:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051508.666088:0:3663:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69a400/0x85f51a6b96717c16 lrc: 2/0,0 mode: TXN/TXN res: [0x2000032e3:0xc:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051508.666102:0:3663:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69a400/0x85f51a6b96717c16 lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e3:0xc:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051508.666113:0:3663:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94f69a400 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:3.0:1777051508.666120:0:3663:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69a400/0x85f51a6b96717c16 lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e3:0xc:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051508.666468:0:3663:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69a400/0x85f51a6b96717c16 lrc: 4/0,0 mode: TXN/TXN res: [0x2000032e3:0xc:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051508.666492:0:3663:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e3:0xc:0x0].0x0 (ffff99da59dd4900) 00010000:00010000:3.0:1777051508.666497:0:3663:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1777051508.666505:0:3663:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69a400/0x85f51a6b96717c16 lrc: 2/0,0 mode: --/TXN res: [0x2000032e3:0xc:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051508.666515:0:3663:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69a400/0x85f51a6b96717c16 lrc: 0/0,0 mode: --/TXN res: [0x2000032e3:0xc:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051508.666759:0:21368:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955610700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+10:140295:x1863365426113408:12345-192.168.201.46@tcp:44:lhsmtool_posix.0 Request processed in 6899us (7647us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051508.667069:0:21368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112453 00000100:00100000:0.0:1777051508.673527:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051508.673617:0:27887:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426113536 00000100:00100000:2.0:1777051508.673629:0:27887:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426113536 00000100:00100000:2.0:1777051508.674002:0:27887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 8108 00000100:00100000:2.0:1777051508.674022:0:27887:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c11b6966-0775-44d2-bdc6-c74c26eb2226+28:2438:x1863365426113536:12345-192.168.201.46@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1777051508.674158:0:27887:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c11b6966-0775-44d2-bdc6-c74c26eb2226+28:2438:x1863365426113536:12345-192.168.201.46@tcp:16:lhsmtool_posix.0 Request processed in 141us (636us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051508.674171:0:27887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 8108 00000100:00100000:3.0:1777051508.680039:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051508.680704:0:6581:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426113792 00000100:00100000:0.0:1777051508.680715:0:6581:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426113792 00000100:00100000:1.0:1777051508.681491:0:8492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112454 00000100:00100000:1.0:1777051508.681513:0:8492:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94e625880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+10:140295:x1863365426113792:12345-192.168.201.46@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1777051508.681576:0:8492:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1777051508.681612:0:8492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162f000/0x85f51a6b96717c40 lrc: 0/0,0 mode: --/PR res: [0x2000032e3:0xc:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6ab7 expref: 10 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051508.681678:0:8492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e3:0xc:0x0].0x0 (ffff99da59dd4900) 00010000:00010000:1.0:1777051508.681687:0:8492:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1777051508.681729:0:8492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502da600/0x85f51a6b96717c4e lrc: 3/0,1 mode: --/PW res: [0x2000032e3:0xc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051508.681752:0:8492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502da600/0x85f51a6b96717c4e lrc: 3/0,1 mode: PW/PW res: [0x2000032e3:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051508.681770:0:8492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502da600/0x85f51a6b96717c4e lrc: 3/0,1 mode: PW/PW res: [0x2000032e3:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1777051508.681931:0:8492:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000043c62bc8 reply state 00000000485ac2ed transno 34359738375 ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502da600/0x85f51a6b96717c4e lrc: 3/0,1 mode: PW/PW res: [0x2000032e3:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051508.681954:0:8492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502da600/0x85f51a6b96717c4e lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e3:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051508.681968:0:8492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e3:0xc:0x0].0x0 (ffff99da59dd4900) 00010000:00010000:1.0:1777051508.681974:0:8492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1777051508.681979:0:8492:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1777051508.682095:0:8492:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94e625880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+11:140295:x1863365426113792:12345-192.168.201.46@tcp:36:lhsmtool_posix.0 Request processed in 588us (2059us total) trans 34359738375 rc 0/0 00000100:00100000:1.0:1777051508.682108:0:8492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112454 00000100:00100000:3.0:1777051508.687088:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051508.687492:0:46494:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426113920 00000100:00100000:0.0:1777051508.687503:0:46494:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426113920 00000100:00100000:0.0:1777051508.687568:0:46494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112455 00000100:00100000:0.0:1777051508.687582:0:46494:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94e627100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c11b6966-0775-44d2-bdc6-c74c26eb2226+11:140295:x1863365426113920:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1777051508.687604:0:46494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051508.687625:0:46494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162f800/0x85f51a6b96717c55 lrc: 2/0,0 mode: --/CR res: [0x2000032e3:0xc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6ac5 expref: -99 pid: 46494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051508.687715:0:46494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162f800/0x85f51a6b96717c55 lrc: 3/0,0 mode: CR/CR res: [0x2000032e3:0xc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6ac5 expref: 12 pid: 46494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051508.688053:0:46494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162f800/0x85f51a6b96717c55 lrc: 3/0,0 mode: CR/CR res: [0x2000032e3:0xc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6ac5 expref: 12 pid: 46494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051508.688414:0:46494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e3:0xc:0x0].0x0 (ffff99da59dd4900) 00010000:00010000:0.0:1777051508.688419:0:46494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1777051508.688424:0:46494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99da4162f800, rc 0) 00000100:00100000:0.0:1777051508.688477:0:46494:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94e627100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c11b6966-0775-44d2-bdc6-c74c26eb2226+12:140295:x1863365426113920:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 Request processed in 897us (1393us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051508.688489:0:46494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112455 00000100:00100000:0.0:1777051508.696075:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051508.696191:0:8628:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426114048 00000100:00100000:1.0:1777051508.696249:0:8628:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426114048 00000100:00100000:1.0:1777051508.696337:0:8628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 8109 00000100:00100000:1.0:1777051508.696355:0:8628:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+28:2437:x1863365426114048:12345-192.168.201.46@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1777051508.696574:0:8628:0:(ofd_lvb.c:305:ofd_lvbo_update()) res: [0x2c0000401:0x202:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1777051508.696581:0:8628:0:(ofd_lvb.c:312:ofd_lvbo_update()) res: [0x2c0000401:0x202:0x0] updating lvb mtime from disk: 0 -> 1777051464 00002000:00010000:1.0:1777051508.696585:0:8628:0:(ofd_lvb.c:318:ofd_lvbo_update()) res: [0x2c0000401:0x202:0x0] updating lvb atime from disk: 0 -> 1777051464 00002000:00010000:1.0:1777051508.696590:0:8628:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x2c0000401:0x202:0x0] updating lvb ctime from disk: 0 -> 1777051464 00002000:00010000:1.0:1777051508.696594:0:8628:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x2c0000401:0x202:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1777051508.696703:0:8628:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+29:2437:x1863365426114048:12345-192.168.201.46@tcp:2:lhsmtool_posix.0 Request processed in 351us (632us total) trans 4294968378 rc 0/0 00000100:00100000:1.0:1777051508.696719:0:8628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 8109 00000100:00100000:3.0:1777051508.702547:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051508.702630:0:24468:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426114176 00000100:00100000:0.0:1777051508.702643:0:24468:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426114176 00000100:00100000:0.0:1777051508.702739:0:24468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 8110 00000100:00100000:0.0:1777051508.703026:0:24468:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94e625500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+29:2436:x1863365426114176:12345-192.168.201.46@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1777051508.703082:0:24468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000d67d566d/0x85f51a6b96717c5c lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x202:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051508.703109:0:24468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777051508.703114:0:24468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777051508.703122:0:24468:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d67d566d/0x85f51a6b96717c5c lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x202:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051508.703146:0:24468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d67d566d/0x85f51a6b96717c5c lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x202:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051508.703478:0:24468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000d67d566d/0x85f51a6b96717c5c lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x202:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051508.703496:0:24468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d67d566d/0x85f51a6b96717c5c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x202:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051508.703511:0:24468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d67d566d/0x85f51a6b96717c5c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x202:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051508.703524:0:24468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da4162f200 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:0.0:1777051508.703530:0:24468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d67d566d/0x85f51a6b96717c5c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x202:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051508.703545:0:24468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d67d566d/0x85f51a6b96717c5c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x202:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051508.703577:0:24468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d67d566d/0x85f51a6b96717c5c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x202:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051508.703591:0:24468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d67d566d/0x85f51a6b96717c5c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x202:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051508.704038:0:24468:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94e625500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+29:2436:x1863365426114176:12345-192.168.201.46@tcp:1:lhsmtool_posix.0 Request processed in 1280us (1490us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051508.704054:0:24468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 8110 00000100:00100000:0.0:1777051508.709255:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051508.709316:0:6580:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426114432 00000100:00100000:1.0:1777051508.709327:0:6580:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426114432 00000100:00100000:1.0:1777051508.709407:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112456 00000100:00100000:1.0:1777051508.709425:0:6580:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d9533bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+12:140295:x1863365426114432:12345-192.168.201.46@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1777051508.709511:0:6580:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502dbe00/0x85f51a6b96717c63 lrc: 3/0,1 mode: --/PW res: [0x2000032e3:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051508.709536:0:6580:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502dbe00/0x85f51a6b96717c63 lrc: 3/0,1 mode: PW/PW res: [0x2000032e3:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051508.709555:0:6580:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502dbe00/0x85f51a6b96717c63 lrc: 3/0,1 mode: PW/PW res: [0x2000032e3:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051508.709784:0:6580:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502db600/0x85f51a6b96717c6a lrc: 3/0,1 mode: --/EX res: [0x2000032e3:0xc:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051508.709807:0:6580:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162f800/0x85f51a6b96717c55 lrc: 2/0,0 mode: CR/CR res: [0x2000032e3:0xc:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6ac5 expref: 13 pid: 46494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051508.709822:0:6580:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502db600/0x85f51a6b96717c6a lrc: 4/0,1 mode: --/EX res: [0x2000032e3:0xc:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051508.709890:0:6580:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162f800/0x85f51a6b96717c55 lrc: 3/0,0 mode: CR/CR res: [0x2000032e3:0xc:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6ac5 expref: 13 pid: 46494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051508.709917:0:6580:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162f800/0x85f51a6b96717c55 lrc: 4/0,0 mode: CR/CR res: [0x2000032e3:0xc:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6ac5 expref: 13 pid: 46494 timeout: 8237 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051508.709941:0:6580:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d942d20700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6580:1863365452718336:192.168.201.46@tcp:104: 00000100:00100000:1.0:1777051508.710053:0:6580:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d959bbe300 going to sleep for 11 seconds 00000100:00100000:0.0:1777051508.713572:0:6580:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d942d20700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6580:1863365452718336:192.168.201.46@tcp:104: 00010000:00010000:0.0:1777051508.713607:0:6580:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502db600/0x85f51a6b96717c6a lrc: 3/0,1 mode: --/EX res: [0x2000032e3:0xc:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051508.714290:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051508.714494:0:47827:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426114560 00000100:00100000:3.0:1777051508.714506:0:47827:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426114560 00010000:00010000:3.0:1777051508.714551:0:47827:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162f800/0x85f51a6b96717c55 lrc: 4/0,0 mode: CR/CR res: [0x2000032e3:0xc:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6ac5 expref: 14 pid: 46494 timeout: 8237 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051508.714609:0:47827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3975 00000100:00100000:3.0:1777051508.714627:0:47827:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d9533bea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+14:2436:x1863365426114560:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1777051508.714646:0:47827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777051508.714690:0:47827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162f800/0x85f51a6b96717c55 lrc: 4/0,0 mode: CR/CR res: [0x2000032e3:0xc:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6ac5 expref: 14 pid: 46494 timeout: 8237 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051508.714718:0:47827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162f800/0x85f51a6b96717c55 lrc: 3/0,0 mode: CR/CR res: [0x2000032e3:0xc:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6ac5 expref: 14 pid: 46494 timeout: 8237 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051508.714750:0:47827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162f800/0x85f51a6b96717c55 lrc: 0/0,0 mode: --/CR res: [0x2000032e3:0xc:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6ac5 expref: 14 pid: 46494 timeout: 8237 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051508.714775:0:47827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e3:0xc:0x0].0x0 (ffff99da59dd4900) 00010000:00010000:3.0:1777051508.714785:0:47827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502db600/0x85f51a6b96717c6a lrc: 3/0,1 mode: --/EX res: [0x2000032e3:0xc:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051508.714801:0:47827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502db600/0x85f51a6b96717c6a lrc: 3/0,1 mode: EX/EX res: [0x2000032e3:0xc:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051508.714813:0:47827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502db600/0x85f51a6b96717c6a lrc: 4/0,1 mode: EX/EX res: [0x2000032e3:0xc:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051508.714862:0:47827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1777051508.714930:0:6580:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502db600/0x85f51a6b96717c6a lrc: 3/0,1 mode: EX/EX res: [0x2000032e3:0xc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051508.714943:0:47827:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d9533bea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+13:2436:x1863365426114560:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 317us (653us total) trans 0 rc 0/0 00010000:00010000:0.0:1777051508.714963:0:6580:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502db600/0x85f51a6b96717c6a lrc: 3/0,1 mode: EX/EX res: [0x2000032e3:0xc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051508.714974:0:47827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3975 00000001:00080000:0.0:1777051508.715093:0:6580:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 34359738376 00000001:00080000:0.0:1777051508.715273:0:6580:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 34359738377 00000001:00080000:0.0:1777051508.715322:0:6580:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 34359738378 00000100:00100000:0.0:1777051508.715407:0:6580:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95aecc700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6580:1863365452718464:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1777051508.715484:0:6580:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051508.715532:0:6580:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d95ded6480 going to sleep for 11 seconds 00000100:00100000:3.0:1777051508.715573:0:46500:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452718464 00000100:00100000:3.0:1777051508.715581:0:46500:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452718464 00000100:00080000:0.0:1777051508.715627:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1777051508.715766:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8355 00000100:00100000:1.0:1777051508.715787:0:6584:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95aecea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6580:x1863365452718464:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1777051508.715897:0:6584:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95aecea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6580:x1863365452718464:12345-0@lo:1000:mdt00_001.0 Request processed in 118us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051508.715906:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8355 00000100:00100000:0.0:1777051508.715971:0:6580:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95aecc700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6580:1863365452718464:0@lo:1000:mdt00_001.0 00000001:00080000:0.0:1777051508.716171:0:6580:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 34359738379 00000100:00100000:0.0:1777051508.716235:0:6580:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95aecc700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6580:1863365452718592:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1777051508.716282:0:6580:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051508.716324:0:6580:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d95ded6900 going to sleep for 11 seconds 00000100:00100000:3.0:1777051508.716344:0:6585:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452718592 00000100:00100000:3.0:1777051508.716352:0:6585:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452718592 00000100:00100000:3.0:1777051508.716408:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8356 00000100:00100000:3.0:1777051508.716419:0:6585:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95aeced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6580:x1863365452718592:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1777051508.716623:0:6585:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95aeced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6580:x1863365452718592:12345-0@lo:1000:mdt00_001.0 Request processed in 202us (338us total) trans 4294968379 rc 0/0 00000100:00100000:3.0:1777051508.716637:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8356 00000100:00100000:0.0:1777051508.716733:0:6580:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95aecc700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6580:1863365452718592:0@lo:1000:mdt00_001.0 00000001:00080000:0.0:1777051508.717145:0:6580:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 34359738380 00010000:00010000:0.0:1777051508.717189:0:6580:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502db600/0x85f51a6b96717c6a lrc: 3/0,1 mode: EX/EX res: [0x2000032e3:0xc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051508.717208:0:6580:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502db600/0x85f51a6b96717c6a lrc: 2/0,0 mode: EX/EX res: [0x2000032e3:0xc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051508.717223:0:6580:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502db600/0x85f51a6b96717c6a lrc: 3/0,0 mode: EX/EX res: [0x2000032e3:0xc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051508.717234:0:6580:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d9502db600 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:0.0:1777051508.717242:0:6580:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502db600/0x85f51a6b96717c6a lrc: 3/0,0 mode: EX/EX res: [0x2000032e3:0xc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051508.717256:0:6580:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502db600/0x85f51a6b96717c6a lrc: 4/0,0 mode: EX/EX res: [0x2000032e3:0xc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051508.717278:0:6580:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e3:0xc:0x0].0x0 (ffff99da59dd4900) 00010000:00010000:0.0:1777051508.717285:0:6580:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1777051508.717293:0:6580:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502db600/0x85f51a6b96717c6a lrc: 2/0,0 mode: --/EX res: [0x2000032e3:0xc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051508.717305:0:6580:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502db600/0x85f51a6b96717c6a lrc: 0/0,0 mode: --/EX res: [0x2000032e3:0xc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051508.717360:0:6580:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99d953285a00/0x85f51a6b96717881 lrc: 3/0,1 mode: EX/EX res: [0x2000032e3:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 109205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051508.717374:0:6580:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d953285a00/0x85f51a6b96717881 lrc: 2/0,0 mode: EX/EX res: [0x2000032e3:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 109205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051508.717387:0:6580:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d953285a00/0x85f51a6b96717881 lrc: 3/0,0 mode: EX/EX res: [0x2000032e3:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 109205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051508.717479:0:6580:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d953285a00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:0.0:1777051508.717485:0:6580:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d953285a00/0x85f51a6b96717881 lrc: 3/0,0 mode: EX/EX res: [0x2000032e3:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 109205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051508.717497:0:6580:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d953285a00/0x85f51a6b96717881 lrc: 4/0,0 mode: EX/EX res: [0x2000032e3:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 109205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051508.717512:0:6580:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e3:0xb:0x0].0x0 (ffff99d94e5e2300) 00010000:00010000:0.0:1777051508.717518:0:6580:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1777051508.717528:0:6580:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cee00/0x85f51a6b967179df lrc: 2/0,0 mode: --/CR res: [0x2000032e3:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6a40 expref: 8 pid: 109212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051508.717546:0:6580:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cee00/0x85f51a6b967179df lrc: 2/0,0 mode: CR/CR res: [0x2000032e3:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6a40 expref: 8 pid: 109212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051508.717563:0:6580:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cee00/0x85f51a6b967179df lrc: 3/0,0 mode: CR/CR res: [0x2000032e3:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6a40 expref: 8 pid: 109212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051508.717581:0:6580:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99d955918000/0x85f51a6b967179fb lrc: 2/0,0 mode: --/CR res: [0x2000032e3:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6a7f expref: 17 pid: 21368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051508.717608:0:6580:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99d955918000/0x85f51a6b967179fb lrc: 2/0,0 mode: CR/CR res: [0x2000032e3:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6a7f expref: 17 pid: 21368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051508.717624:0:6580:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d955918000/0x85f51a6b967179fb lrc: 3/0,0 mode: CR/CR res: [0x2000032e3:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6a7f expref: 17 pid: 21368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051508.717703:0:6580:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff99d955918000/0x85f51a6b967179fb lrc: 3/0,0 mode: CR/CR res: [0x2000032e3:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6a7f expref: 17 pid: 21368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051508.717726:0:6580:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955ebe680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6580:1863365452718720:192.168.201.46@tcp:105: 00010000:00010000:0.0:1777051508.718167:0:6580:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cee00/0x85f51a6b967179df lrc: 3/0,0 mode: CR/CR res: [0x2000032e3:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6a40 expref: 8 pid: 109212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051508.718189:0:6580:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955ebce00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6580:1863365452718848:192.168.201.46@tcp:105: 00000100:00100000:0.0:1777051508.718286:0:6580:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d95ded6540 going to sleep for 11 seconds 00000100:00100000:1.0:1777051508.727485:0:6580:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955ebe680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6580:1863365452718720:192.168.201.46@tcp:105: 00000100:00100000:1.0:1777051508.727517:0:6580:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955ebce00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6580:1863365452718848:192.168.201.46@tcp:105: 00010000:00010000:1.0:1777051508.727555:0:6580:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d953285a00/0x85f51a6b96717881 lrc: 2/0,0 mode: --/EX res: [0x2000032e3:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 109205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051508.727574:0:6580:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d953285a00/0x85f51a6b96717881 lrc: 0/0,0 mode: --/EX res: [0x2000032e3:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 109205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051508.727623:0:6580:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502dae00/0x85f51a6b96717c71 lrc: 3/0,1 mode: --/EX res: [0x2000032e3:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051508.727644:0:6580:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502dae00/0x85f51a6b96717c71 lrc: 3/0,1 mode: EX/EX res: [0x2000032e3:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051508.729625:0:6580:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502dae00/0x85f51a6b96717c71 lrc: 3/0,1 mode: EX/EX res: [0x2000032e3:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051508.729682:0:6580:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502dae00/0x85f51a6b96717c71 lrc: 3/0,1 mode: EX/EX res: [0x2000032e3:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051508.729695:0:6580:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502dae00/0x85f51a6b96717c71 lrc: 2/0,0 mode: EX/EX res: [0x2000032e3:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051508.729709:0:6580:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502dae00/0x85f51a6b96717c71 lrc: 3/0,0 mode: EX/EX res: [0x2000032e3:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051508.729720:0:6580:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d9502dae00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:1.0:1777051508.729727:0:6580:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502dae00/0x85f51a6b96717c71 lrc: 3/0,0 mode: EX/EX res: [0x2000032e3:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051508.729739:0:6580:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502dae00/0x85f51a6b96717c71 lrc: 4/0,0 mode: EX/EX res: [0x2000032e3:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051508.729758:0:6580:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e3:0xb:0x0].0x0 (ffff99d94e5e2300) 00010000:00010000:1.0:1777051508.729764:0:6580:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777051508.729770:0:6580:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502dae00/0x85f51a6b96717c71 lrc: 2/0,0 mode: --/EX res: [0x2000032e3:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051508.729783:0:6580:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502dae00/0x85f51a6b96717c71 lrc: 0/0,0 mode: --/EX res: [0x2000032e3:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051508.729802:0:6580:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502dbe00/0x85f51a6b96717c63 lrc: 3/0,1 mode: PW/PW res: [0x2000032e3:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051508.729814:0:6580:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502dbe00/0x85f51a6b96717c63 lrc: 2/0,0 mode: PW/PW res: [0x2000032e3:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051508.729825:0:6580:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502dbe00/0x85f51a6b96717c63 lrc: 3/0,0 mode: PW/PW res: [0x2000032e3:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051508.729836:0:6580:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d9502dbe00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:1.0:1777051508.729841:0:6580:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502dbe00/0x85f51a6b96717c63 lrc: 3/0,0 mode: PW/PW res: [0x2000032e3:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051508.729853:0:6580:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502dbe00/0x85f51a6b96717c63 lrc: 4/0,0 mode: PW/PW res: [0x2000032e3:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051508.730138:0:6580:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e3:0xb:0x0].0x0 (ffff99d94e5e2300) 00010000:00010000:1.0:1777051508.730144:0:6580:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1777051508.730150:0:6580:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502dbe00/0x85f51a6b96717c63 lrc: 2/0,0 mode: --/PW res: [0x2000032e3:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051508.730163:0:6580:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502dbe00/0x85f51a6b96717c63 lrc: 0/0,0 mode: --/PW res: [0x2000032e3:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051508.730425:0:6580:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d9533bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+17:140295:x1863365426114432:12345-192.168.201.46@tcp:57:lhsmtool_posix.0 Request processed in 21002us (21170us total) trans 34359738381 rc 0/0 00000100:00100000:1.0:1777051508.730446:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112456 00000020:00080000:1.0:1777051508.730457:0:6580:0:(tgt_main.c:783:tgt_ses_key_exit()) total 6 transactions per RPC 00000040:00080000:2.0:1777051508.730497:0:109205:0:(llog.c:801:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:2.0:1777051508.730508:0:109205:0:(llog_cat.c:158:llog_cat_process_common()) processing log [0x1:0x2b:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000100:00100000:1.0:1777051508.731621:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051508.732061:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000040:00080000:2.0:1777051508.732076:0:109205:0:(llog.c:858:llog_process_thread()) stop processing plain [0x1:0x2b:0x0] index 64768 count 6 00000040:00080000:2.0:1777051508.732098:0:109205:0:(llog.c:858:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00000100:00100000:1.0:1777051508.732127:0:24269:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426114688 00000100:00100000:1.0:1777051508.732140:0:24269:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426114688 00000100:00100000:0.0:1777051508.732195:0:46501:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426114816 00000100:00100000:0.0:1777051508.732207:0:46501:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426114816 00000100:00100000:1.0:1777051508.732274:0:24269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3432 00000100:00100000:0.0:1777051508.732292:0:46501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3433 00000100:00100000:1.0:1777051508.732300:0:24269:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942d20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+9:139486:x1863365426114688:12345-192.168.201.46@tcp:49:md5sum.0 00000100:00100000:0.0:1777051508.732323:0:46501:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fd63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+17:139487:x1863365426114816:12345-192.168.201.46@tcp:49:md5sum.0 00000100:00100000:1.0:1777051508.732474:0:24269:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942d20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+9:139486:x1863365426114688:12345-192.168.201.46@tcp:49:md5sum.0 Request processed in 175us (846us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051508.732475:0:46501:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fd63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+17:139487:x1863365426114816:12345-192.168.201.46@tcp:49:md5sum.0 Request processed in 155us (744us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051508.732503:0:24269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3432 00000100:00100000:0.0:1777051508.732520:0:46501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3433 00000100:00100000:0.0:1777051508.737045:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051508.737336:0:6582:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426115072 00000100:00100000:1.0:1777051508.737350:0:6582:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426115072 00000100:00100000:1.0:1777051508.737430:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3434 00000100:00100000:1.0:1777051508.737450:0:6582:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955ebce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+17:140295:x1863365426115072:12345-192.168.201.46@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1777051508.737646:0:6582:0:(mdd_object.c:4010:mdd_close()) Object [0x2000032e3:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00010000:00010000:1.0:1777051508.737793:0:6582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502dbe00/0x85f51a6b96717c78 lrc: 3/0,1 mode: --/PW res: [0x2000032e3:0xc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051508.737820:0:6582:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502dbe00/0x85f51a6b96717c78 lrc: 3/0,1 mode: PW/PW res: [0x2000032e3:0xc:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051508.737840:0:6582:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502dbe00/0x85f51a6b96717c78 lrc: 3/0,1 mode: PW/PW res: [0x2000032e3:0xc:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051508.737856:0:6582:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502dbe00/0x85f51a6b96717c78 lrc: 4/0,1 mode: PW/PW res: [0x2000032e3:0xc:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051508.737868:0:6582:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502dbe00/0x85f51a6b96717c78 lrc: 4/0,1 mode: PW/PW res: [0x2000032e3:0xc:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051508.737881:0:6582:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502dbe00/0x85f51a6b96717c78 lrc: 3/0,0 mode: PW/PW res: [0x2000032e3:0xc:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051508.737926:0:6582:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1777051508.738051:0:6582:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955ebce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+18:140295:x1863365426115072:12345-192.168.201.46@tcp:35:lhsmtool_posix.0 Request processed in 604us (1011us total) trans 34359738382 rc 0/0 00000100:00100000:1.0:1777051508.738066:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3434 00010000:00010000:3.0:1777051508.738164:0:38719:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777051508.738178:0:38719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502dbe00/0x85f51a6b96717c78 lrc: 2/0,0 mode: PW/PW res: [0x2000032e3:0xc:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051508.738190:0:38719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d9502dbe00 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:3.0:1777051508.738197:0:38719:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502dbe00/0x85f51a6b96717c78 lrc: 2/0,0 mode: PW/PW res: [0x2000032e3:0xc:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051508.738212:0:38719:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502dbe00/0x85f51a6b96717c78 lrc: 3/0,0 mode: PW/PW res: [0x2000032e3:0xc:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 6582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051508.738259:0:38719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e3:0xc:0x0].0x0 (ffff99da59dd4900) 00010000:00010000:3.0:1777051508.738267:0:38719:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1777051508.738277:0:38719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502dbe00/0x85f51a6b96717c78 lrc: 1/0,0 mode: --/PW res: [0x2000032e3:0xc:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 6582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051508.738290:0:38719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502dbe00/0x85f51a6b96717c78 lrc: 0/0,0 mode: --/PW res: [0x2000032e3:0xc:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 6582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051508.738321:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051508.738325:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051508.738328:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1777051508.742954:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051508.743057:0:55805:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426115200 00000100:00100000:0.0:1777051508.743070:0:55805:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426115200 00000100:00100000:0.0:1777051508.743152:0:55805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 8111 00000100:00100000:0.0:1777051508.743170:0:55805:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fd61c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c11b6966-0775-44d2-bdc6-c74c26eb2226+29:139487:x1863365426115200:12345-192.168.201.46@tcp:101:md5sum.0 00010000:00010000:0.0:1777051508.743191:0:55805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051508.743216:0:55805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002a7be716/0x85f51a6b96717c7f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x202:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6acc expref: -99 pid: 55805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051508.743254:0:55805:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777051508.743260:0:55805:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777051508.743275:0:55805:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002a7be716/0x85f51a6b96717c7f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x202:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->32767) gid 0 flags: 0x50000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6acc expref: 30 pid: 55805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051508.743326:0:55805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002a7be716/0x85f51a6b96717c7f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x202:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->32767) gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6acc expref: 30 pid: 55805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051508.743350:0:55805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99da4162e200, rc 0) 00000100:00100000:0.0:1777051508.743426:0:55805:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fd61c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c11b6966-0775-44d2-bdc6-c74c26eb2226+30:139487:x1863365426115200:12345-192.168.201.46@tcp:101:md5sum.0 Request processed in 258us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051508.743470:0:55805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 8111 00000100:00100000:0.0:1777051508.749557:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051508.749682:0:8470:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426115328 00000100:00100000:3.0:1777051508.749695:0:8470:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426115328 00000100:00100000:3.0:1777051508.750058:0:8470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 8112 00000100:00100000:3.0:1777051508.750078:0:8470:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955ebe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+30:2438:x1863365426115328:12345-192.168.201.46@tcp:101:md5sum.0 00010000:00010000:3.0:1777051508.750099:0:8470:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777051508.750120:0:8470:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009b1a3daa/0x85f51a6b96717c86 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x202:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6ad3 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051508.750153:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051508.750157:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051508.750169:0:8470:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009b1a3daa/0x85f51a6b96717c86 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x202:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6ad3 expref: 31 pid: 8470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051508.750199:0:8470:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009b1a3daa/0x85f51a6b96717c86 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x202:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6ad3 expref: 31 pid: 8470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051508.750222:0:8470:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99da7d5ce400, rc 0) 00000100:00100000:3.0:1777051508.750302:0:8470:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955ebe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+31:2438:x1863365426115328:12345-192.168.201.46@tcp:101:md5sum.0 Request processed in 227us (751us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051508.750319:0:8470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 8112 00000100:00100000:1.0:1777051508.757434:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051508.757828:0:27887:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426115456 00000100:00100000:0.0:1777051508.757842:0:27887:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426115456 00000100:00100000:0.0:1777051508.757928:0:27887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 8113 00000100:00100000:0.0:1777051508.757948:0:27887:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fd60700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+50:139486:x1863365426115456:12345-192.168.201.46@tcp:101:md5sum.0 00010000:00010000:0.0:1777051508.757973:0:27887:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051508.757980:0:27887:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 22 locks, starting at 1 00010000:00010000:0.0:1777051508.758043:0:27887:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000066fb6b6d/0x85f51a6b9670f732 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x141:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b4580 expref: 50 pid: 8468 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051508.758134:0:27887:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001fa1d7cf/0x85f51a6b9670f72b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x13b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b4579 expref: 49 pid: 55805 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051508.758251:0:27887:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000032200c78/0x85f51a6b9670f5bf lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x13e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b4517 expref: 48 pid: 8471 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051508.758327:0:27887:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000047bca7e9/0x85f51a6b9670f5b8 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x13f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b4510 expref: 47 pid: 13320 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051508.758388:0:27887:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000035e5fc0d/0x85f51a6b9670f5a3 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x133:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b44fb expref: 46 pid: 55805 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051508.758455:0:27887:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003f046c69/0x85f51a6b9670f40d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x13c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b4484 expref: 45 pid: 13320 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051508.758505:0:27887:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fea11f45/0x85f51a6b9670f3f1 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x134:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b446f expref: 44 pid: 8628 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051508.758546:0:27887:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007bcb1fcc/0x85f51a6b9670f23f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x140:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b43f8 expref: 43 pid: 27887 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051508.758584:0:27887:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000ccea677/0x85f51a6b9670f22a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x130:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b43f1 expref: 42 pid: 8628 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051508.758644:0:27887:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dec93d7d/0x85f51a6b9670f223 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x135:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b43dc expref: 41 pid: 13320 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051508.758725:0:27887:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e7b9d13a/0x85f51a6b9670f0a9 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x137:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b4373 expref: 40 pid: 27884 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051508.758773:0:27887:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b5ae08f7/0x85f51a6b9670f071 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x13d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b435e expref: 39 pid: 8628 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051508.758823:0:27887:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a54d1133/0x85f51a6b9670f063 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x139:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b4357 expref: 38 pid: 55805 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051508.758867:0:27887:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f6dd8b48/0x85f51a6b9670eedb lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x132:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b42e0 expref: 37 pid: 13320 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051508.758906:0:27887:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000056ea3f06/0x85f51a6b9670ed61 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x13a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b4277 expref: 36 pid: 24468 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051508.758942:0:27887:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b64a41c0/0x85f51a6b9670ed4c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x138:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b4262 expref: 35 pid: 8468 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051508.758973:0:27887:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c14cd068/0x85f51a6b9670ebbd lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x131:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b41f9 expref: 34 pid: 8468 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051508.759018:0:27887:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000017e0ed9/0x85f51a6b9670ebb6 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x12f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b41eb expref: 33 pid: 13320 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051508.759057:0:27887:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000842d7fe8/0x85f51a6b9670eb9a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x12d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b41e4 expref: 32 pid: 8468 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051508.759099:0:27887:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fae2db00/0x85f51a6b9670eb93 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x136:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b41d6 expref: 31 pid: 27884 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051508.759164:0:27887:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001fd02d72/0x85f51a6b9670eb3f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x12e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b41ba expref: 30 pid: 8628 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051508.759192:0:27887:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1777051508.759249:0:27887:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d0d19e2b/0x85f51a6b96717c8d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x202:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6ada expref: -99 pid: 27887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051508.759283:0:27887:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777051508.759288:0:27887:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777051508.759302:0:27887:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d0d19e2b/0x85f51a6b96717c8d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x202:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->32767) gid 0 flags: 0x50000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6ada expref: 30 pid: 27887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051508.759327:0:27887:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d0d19e2b/0x85f51a6b96717c8d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x202:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->32767) gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6ada expref: 30 pid: 27887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051508.759347:0:27887:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99da4162fa00, rc 0) 00000100:00100000:0.0:1777051508.759445:0:27887:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fd60700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+30:139486:x1863365426115456:12345-192.168.201.46@tcp:101:md5sum.0 Request processed in 1502us (2019us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051508.759460:0:27887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 8113 00000100:00100000:1.0:1777051508.759534:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051508.759636:0:8476:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426115584 00000100:00100000:0.0:1777051508.759671:0:8476:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426115584 00002000:00100000:0.0:1777051508.759735:0:8476:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x202:0x0] (0->4095) req@ffff99da7fd60000 x1863365426115584/t0(0) o3->c11b6966-0775-44d2-bdc6-c74c26eb2226@192.168.201.46@tcp:469/0 lens 488/0 e 0 to 0 dl 1777051519 ref 1 fl New:/600/ffffffff rc 0/-1 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1777051508.759755:0:8476:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99da7fd60000 with x1863365426115584 ext(0->4095) 00002000:00010000:0.0:1777051508.759763:0:8476:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99da7fd60000 00000100:00100000:0.0:1777051508.759810:0:8476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 1793 00000100:00100000:0.0:1777051508.759826:0:8476:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fd60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+31:2436:x1863365426115584:12345-192.168.201.46@tcp:3:md5sum.0 00000100:00100000:0.0:1777051508.760104:0:8476:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fd60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+31:2436:x1863365426115584:12345-192.168.201.46@tcp:3:md5sum.0 Request processed in 280us (570us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051508.760119:0:8476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 1793 00002000:00100000:0.0:1777051508.760131:0:8476:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x202:0x0] (0->4095) req@ffff99da7fd60000 x1863365426115584/t0(0) o3->c11b6966-0775-44d2-bdc6-c74c26eb2226@192.168.201.46@tcp:469/0 lens 488/440 e 0 to 0 dl 1777051519 ref 1 fl Complete:/600/0 rc 0/0 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1777051508.760150:0:8476:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99da7fd60000 with x1863365426115584 ext(0->4095) 00002000:00010000:0.0:1777051508.760158:0:8476:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99da7fd60000 00000100:00100000:2.0:1777051508.766576:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051508.766706:0:46207:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426115712 00000100:00100000:1.0:1777051508.766718:0:46207:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426115712 00002000:00100000:1.0:1777051508.766762:0:46207:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x202:0x0] (0->4095) req@ffff99d955611880 x1863365426115712/t0(0) o3->2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp:469/0 lens 488/0 e 0 to 0 dl 1777051519 ref 1 fl New:/600/ffffffff rc 0/-1 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1777051508.766782:0:46207:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99d955611880 with x1863365426115712 ext(0->4095) 00002000:00010000:1.0:1777051508.766790:0:46207:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99d955611880 00000100:00100000:1.0:1777051508.766835:0:46207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 1794 00000100:00100000:1.0:1777051508.766849:0:46207:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955611880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+30:2436:x1863365426115712:12345-192.168.201.46@tcp:3:md5sum.0 00000100:00100000:1.0:1777051508.767063:0:46207:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955611880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+30:2436:x1863365426115712:12345-192.168.201.46@tcp:3:md5sum.0 Request processed in 202us (481us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051508.767077:0:46207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 1794 00002000:00100000:1.0:1777051508.767089:0:46207:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x202:0x0] (0->4095) req@ffff99d955611880 x1863365426115712/t0(0) o3->2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp:469/0 lens 488/440 e 0 to 0 dl 1777051519 ref 1 fl Complete:/600/0 rc 0/0 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1777051508.767107:0:46207:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99d955611880 with x1863365426115712 ext(0->4095) 00002000:00010000:1.0:1777051508.767113:0:46207:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99d955611880 00000100:00100000:1.0:1777051508.768741:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051508.769898:0:6583:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426115968 00000100:00100000:2.0:1777051508.769978:0:6583:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426115968 00000100:00100000:2.0:1777051508.770059:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3435 00000100:00100000:2.0:1777051508.770078:0:6583:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da6ff02c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+18:139487:x1863365426115968:12345-192.168.201.46@tcp:35:md5sum.0 00000100:00100000:2.0:1777051508.770811:0:6583:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da6ff02c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+19:139487:x1863365426115968:12345-192.168.201.46@tcp:35:md5sum.0 Request processed in 735us (2070us total) trans 34359738383 rc 0/0 00000100:00100000:2.0:1777051508.770828:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3435 00000100:00100000:2.0:1777051508.776112:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051508.776252:0:24269:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426116224 00000100:00100000:1.0:1777051508.776265:0:24269:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426116224 00000100:00100000:1.0:1777051508.776343:0:24269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3436 00000100:00100000:1.0:1777051508.776360:0:24269:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955613100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+9:139486:x1863365426116224:12345-192.168.201.46@tcp:35:md5sum.0 00000100:00100000:1.0:1777051508.776617:0:24269:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955613100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+10:139486:x1863365426116224:12345-192.168.201.46@tcp:35:md5sum.0 Request processed in 256us (509us total) trans 34359738384 rc 0/0 00000100:00100000:1.0:1777051508.776636:0:24269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3436 00010000:00010000:0.0:1777051508.889801:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1777051509.336850:0:109891:0:(llog.c:801:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:0.0:1777051509.336861:0:109891:0:(llog_cat.c:158:llog_cat_process_common()) processing log [0x1:0x2b:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1777051509.336921:0:109891:0:(llog.c:858:llog_process_thread()) stop processing plain [0x1:0x2b:0x0] index 12 count 6 00000040:00080000:0.0:1777051509.336930:0:109891:0:(llog.c:858:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00000100:00100000:0.0:1777051509.526518:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94e627b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3680:1863365452718976:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1777051509.526525:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955613480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452719104:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1777051509.526620:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051509.526697:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051509.526748:0:47388:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452718976 00000100:00100000:3.0:1777051509.526760:0:47388:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452718976 00000100:00100000:1.0:1777051509.526817:0:8473:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452719104 00000100:00080000:0.0:1777051509.526826:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1777051509.526826:0:8473:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452719104 00000100:00100000:3.0:1777051509.526845:0:47388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5720 00000100:00100000:3.0:1777051509.526862:0:47388:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955ebce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3680:x1863365452718976:12345-0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1777051509.526878:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:3.0:1777051509.526902:0:47388:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 499268288 pending 0 free 3860574208 avail 3629051904 00000100:00100000:1.0:1777051509.526911:0:8473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5721 00000100:00100000:1.0:1777051509.526928:0:8473:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955612300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3677:x1863365452719104:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1777051509.526960:0:8473:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 489208512 pending 0 free 3642707968 avail 3411185664 00000100:00100000:3.0:1777051509.526986:0:47388:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955ebce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3680:x1863365452718976:12345-0@lo:13:osp-pre-0-1.0 Request processed in 126us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051509.527000:0:47388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5720 00000100:00100000:1.0:1777051509.527056:0:8473:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955612300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3677:x1863365452719104:12345-0@lo:13:osp-pre-1-1.0 Request processed in 131us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051509.527061:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94e627b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3680:1863365452718976:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1777051509.527076:0:8473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5721 00000100:00100000:2.0:1777051509.527148:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955613480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452719104:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1777051509.910616:0:108751:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051510.935527:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051511.961566:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1777051512.086624:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f9fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452719232:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1777051512.087010:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051512.087105:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d943d91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3677:1863365452719616:0@lo:400:kworker.0 00000100:00100000:2.0:1777051512.087130:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d943d92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3678:1863365452719744:0@lo:400:kworker.0 00000100:00100000:1.0:1777051512.087168:0:46498:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452719232 00000100:00100000:1.0:1777051512.087179:0:46498:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452719232 00000100:00100000:3.0:1777051512.087179:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051512.087286:0:46498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8357 00000100:00100000:1.0:1777051512.087301:0:46498:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955613480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+7:3678:x1863365452719232:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1777051512.087346:0:46498:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4194304 pending 0 free 1441550336 avail 1295310848 00000100:00100000:3.0:1777051512.087372:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d943d93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452720128:0@lo:400:kworker.0 00000100:00100000:3.0:1777051512.087418:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051512.087437:0:46498:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955613480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+7:3678:x1863365452719232:12345-0@lo:41:osp-pre-0-1.0 Request processed in 136us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051512.087445:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d943d92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3677:1863365452720640:0@lo:400:kworker.0 00000100:00100000:1.0:1777051512.087454:0:46498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8357 00000100:00100000:3.0:1777051512.087473:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051512.087503:0:8471:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452720128 00000100:00100000:1.0:1777051512.087511:0:8471:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452720128 00000100:00100000:3.0:1777051512.087525:0:13320:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452720640 00000100:00100000:3.0:1777051512.087532:0:13320:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452720640 00000100:00100000:1.0:1777051512.087578:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10552 00000100:00100000:3.0:1777051512.087628:0:13320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10553 00000100:00100000:3.0:1777051512.087644:0:13320:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95612b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3677:x1863365452720640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051512.087704:0:13320:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95612b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3677:x1863365452720640:12345-0@lo:400:kworker.0 Request processed in 65us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051512.087716:0:13320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10553 00000100:00100000:1.0:1777051512.088058:0:8471:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d956128e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3677:x1863365452720128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051512.088063:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d943d92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3677:1863365452720640:0@lo:400:kworker.0 00000100:00100000:3.0:1777051512.088127:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051512.088145:0:8471:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d956128e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3677:x1863365452720128:12345-0@lo:400:kworker.0 Request processed in 554us (722us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051512.088157:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10552 00000100:00100000:0.0:1777051512.088252:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94e627b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3679:1863365452719360:0@lo:400:kworker.0 00000100:00100000:2.0:1777051512.088276:0:27882:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452719616 00000100:00100000:3.0:1777051512.088276:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d943d90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452720256:0@lo:400:kworker.0 00000100:00100000:2.0:1777051512.088287:0:27882:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452719616 00000100:00100000:0.0:1777051512.088327:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051512.088349:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051512.088366:0:27882:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452719744 00000100:00100000:2.0:1777051512.088373:0:27882:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452719744 00000100:00100000:1.0:1777051512.088402:0:109181:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452719360 00000100:00100000:0.0:1777051512.088410:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d943d91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3679:1863365452719872:0@lo:400:kworker.0 00000100:00100000:1.0:1777051512.088411:0:109181:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452719360 00000100:00100000:3.0:1777051512.088412:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d943d90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3678:1863365452720768:0@lo:400:kworker.0 00000100:00100000:2.0:1777051512.088428:0:27882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13514 00000100:00100000:2.0:1777051512.088465:0:27882:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d956129180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0000_UUID+5:3677:x1863365452719616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777051512.088473:0:109181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1777051512.088497:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051512.088498:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051512.088498:0:109181:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f3bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9351a01-5b0e-4470-97fd-58b9b4b312a2+23:3679:x1863365452719360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777051512.088562:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d943d91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3679:1863365452720384:0@lo:400:kworker.0 00000100:00100000:2.0:1777051512.088576:0:27882:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d956129180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0000_UUID+5:3677:x1863365452719616:12345-0@lo:400:kworker.0 Request processed in 132us (1394us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051512.088592:0:27882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13514 00000100:00100000:3.0:1777051512.088626:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f9fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452719232:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1777051512.088630:0:109181:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f3bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9351a01-5b0e-4470-97fd-58b9b4b312a2+23:3679:x1863365452719360:12345-0@lo:400:kworker.0 Request processed in 140us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051512.088650:0:27882:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452719872 00000100:00100000:0.0:1777051512.088653:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051512.088657:0:109181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1777051512.088660:0:27882:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452719872 00000100:00100000:0.0:1777051512.088698:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d943d91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3679:1863365452720896:0@lo:400:kworker.0 00000100:00100000:3.0:1777051512.088712:0:46497:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452720384 00000100:00100000:3.0:1777051512.088722:0:46497:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452720384 00000100:00100000:2.0:1777051512.088737:0:27882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13515 00000100:00100000:0.0:1777051512.088748:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051512.088762:0:27882:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d956129500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0001_UUID+5:3678:x1863365452719744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051512.089359:0:46497:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452720896 00000100:00100000:0.0:1777051512.089366:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94e627b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3679:1863365452719360:0@lo:400:kworker.0 00000100:00100000:3.0:1777051512.089369:0:46497:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452720896 00000100:00100000:1.0:1777051512.089375:0:46494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13516 00000100:00100000:1.0:1777051512.089392:0:46494:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0001-lwp-OST0001_UUID+5:3679:x1863365452719872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777051512.089397:0:3679:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:0.0:1777051512.089413:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d943d92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3679:1863365452719488:0@lo:400:kworker.0 00000100:00100000:2.0:1777051512.089422:0:27882:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d956129500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0001_UUID+5:3678:x1863365452719744:12345-0@lo:400:kworker.0 Request processed in 663us (1289us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051512.089439:0:46497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13517 00000100:00100000:2.0:1777051512.089454:0:27882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13515 00000100:00100000:3.0:1777051512.089465:0:46497:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:lustre-MDT0000-lwp-MDT0001_UUID+5:3679:x1863365452720384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777051512.089467:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051512.089467:0:46494:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0001-lwp-OST0001_UUID+5:3679:x1863365452719872:12345-0@lo:400:kworker.0 Request processed in 78us (984us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051512.089490:0:46494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13516 00000100:00100000:2.0:1777051512.089490:0:27882:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452719488 00000100:00100000:0.0:1777051512.089498:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d943d93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452720000:0@lo:400:kworker.0 00000100:00100000:2.0:1777051512.089501:0:27882:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452719488 00000100:00100000:1.0:1777051512.089531:0:46494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13518 00000100:00100000:1.0:1777051512.089549:0:46494:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000-lwp-MDT0000_UUID+5:3679:x1863365452720896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777051512.089560:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051512.089568:0:27882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13519 00000100:00100000:3.0:1777051512.089573:0:46497:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:lustre-MDT0000-lwp-MDT0001_UUID+5:3679:x1863365452720384:12345-0@lo:400:kworker.0 Request processed in 118us (925us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051512.089591:0:27882:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0000_UUID+5:3679:x1863365452719488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051512.089614:0:46497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13517 00000100:00100000:0.0:1777051512.089630:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d943d91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452720512:0@lo:400:kworker.0 00000100:00100000:1.0:1777051512.089644:0:46494:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000-lwp-MDT0000_UUID+5:3679:x1863365452720896:12345-0@lo:400:kworker.0 Request processed in 100us (902us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051512.089655:0:46494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13518 00000100:00100000:3.0:1777051512.089693:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d943d91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3677:1863365452719616:0@lo:400:kworker.0 00000100:00100000:0.0:1777051512.089702:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051512.089710:0:27882:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0000_UUID+5:3679:x1863365452719488:12345-0@lo:400:kworker.0 Request processed in 124us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051512.089725:0:27882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13519 00000100:00100000:3.0:1777051512.089727:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d943d93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452720128:0@lo:400:kworker.0 00000100:00100000:0.0:1777051512.089750:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7fd63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452721024:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1777051512.089751:0:6584:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452720000 00000100:00100000:1.0:1777051512.089759:0:6584:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452720000 00000100:00100000:0.0:1777051512.089790:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051512.089811:0:6584:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452720512 00000100:00100000:1.0:1777051512.089816:0:6584:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452720512 00000100:00100000:2.0:1777051512.089848:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d943d92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3678:1863365452719744:0@lo:400:kworker.0 00000100:00100000:1.0:1777051512.089853:0:6584:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452721024 00000100:00100000:0.0:1777051512.089855:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d943d91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3679:1863365452719872:0@lo:400:kworker.0 00000100:00100000:1.0:1777051512.089862:0:6584:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452721024 00000100:00100000:0.0:1777051512.089882:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d943d91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3679:1863365452720384:0@lo:400:kworker.0 00000100:00100000:3.0:1777051512.089894:0:27884:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452720256 00000100:00100000:3.0:1777051512.089904:0:27884:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452720256 00000100:00100000:0.0:1777051512.089910:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d943d91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3679:1863365452720896:0@lo:400:kworker.0 00000100:00100000:1.0:1777051512.089913:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8358 00000100:00100000:1.0:1777051512.089927:0:6584:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94e627b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:3679:x1863365452720000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777051512.089946:0:24468:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452720768 00000100:00100000:2.0:1777051512.089955:0:24468:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452720768 00000100:00100000:0.0:1777051512.089964:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d943d92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3679:1863365452719488:0@lo:400:kworker.0 00000100:00100000:3.0:1777051512.089979:0:27884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10554 00000100:00100000:0.0:1777051512.089989:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d943d93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452720000:0@lo:400:kworker.0 00000100:00100000:1.0:1777051512.089989:0:6584:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94e627b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:3679:x1863365452720000:12345-0@lo:400:kworker.0 Request processed in 63us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051512.090003:0:27884:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d956129c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3678:x1863365452720256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777051512.090004:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8358 00000100:00100000:1.0:1777051512.090037:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8359 00000100:00100000:0.0:1777051512.090049:0:46500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8360 00000100:00100000:1.0:1777051512.090050:0:6584:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f97c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3679:x1863365452720512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777051512.090062:0:46500:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f97d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+6:3679:x1863365452721024:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1777051512.090090:0:46500:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4194304 pending 0 free 1446141952 avail 1299902464 00000100:00100000:3.0:1777051512.090106:0:27884:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d956129c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3678:x1863365452720256:12345-0@lo:400:kworker.0 Request processed in 111us (1758us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051512.090121:0:27884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10554 00000100:00100000:1.0:1777051512.090131:0:6584:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f97c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3679:x1863365452720512:12345-0@lo:400:kworker.0 Request processed in 80us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051512.090138:0:46500:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f97d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+6:3679:x1863365452721024:12345-0@lo:41:osp-pre-1-0.0 Request processed in 80us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051512.090144:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8359 00000100:00100000:0.0:1777051512.090152:0:46500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8360 00000100:00100000:3.0:1777051512.090158:0:27884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10555 00000100:00100000:3.0:1777051512.090174:0:27884:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d956128380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+6:3678:x1863365452720768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777051512.090250:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d943d91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452720512:0@lo:400:kworker.0 00000100:00100000:3.0:1777051512.090295:0:27884:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d956128380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+6:3678:x1863365452720768:12345-0@lo:400:kworker.0 Request processed in 121us (1810us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051512.090308:0:27884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10555 00000100:00080000:3.0:1777051512.090345:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1777051512.090351:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1777051512.090354:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1777051512.090358:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1777051512.091068:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7fd63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452721024:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1777051512.091087:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d943d90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452720256:0@lo:400:kworker.0 00000100:00100000:3.0:1777051512.091111:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d943d90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3678:1863365452720768:0@lo:400:kworker.0 00000100:00100000:1.0:1777051512.599463:0:3678:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1777051512.599523:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7fd62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3678:1863365452721152:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1777051512.599655:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051512.600507:0:8472:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452721152 00000100:00100000:2.0:1777051512.600519:0:8472:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452721152 00000100:00100000:2.0:1777051512.600823:0:8472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5722 00000100:00100000:2.0:1777051512.600842:0:8472:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fd61180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3678:x1863365452721152:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1777051512.600897:0:8472:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 489208512 pending 0 free 3642707968 avail 3411185664 00000100:00100000:2.0:1777051512.600976:0:8472:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fd61180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3678:x1863365452721152:12345-0@lo:13:osp-pre-1-0.0 Request processed in 138us (1323us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051512.600992:0:8472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5722 00000100:00100000:2.0:1777051512.601065:0:3677:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1777051512.601084:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7fd62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3677:1863365452721280:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1777051512.601448:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051512.601509:0:10113:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452721280 00000100:00100000:2.0:1777051512.601517:0:10113:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452721280 00000100:00100000:2.0:1777051512.601577:0:10113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5723 00000100:00100000:2.0:1777051512.601626:0:10113:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955612680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3677:x1863365452721280:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1777051512.601661:0:10113:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 499268288 pending 0 free 3860574208 avail 3629051904 00000100:00100000:2.0:1777051512.601746:0:10113:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955612680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3677:x1863365452721280:12345-0@lo:13:osp-pre-0-0.0 Request processed in 156us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051512.601758:0:10113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5723 00000100:00100000:1.0:1777051512.602330:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7fd62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3677:1863365452721280:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1777051512.602746:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7fd62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3678:1863365452721152:0@lo:13:osp-pre-1-0.0 00000040:00080000:2.0:1777051512.727126:0:104226:0:(llog.c:801:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1777051512.727135:0:104226:0:(llog_cat.c:158:llog_cat_process_common()) processing log [0x1:0x12:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1777051512.727165:0:104226:0:(llog.c:858:llog_process_thread()) stop processing plain [0x1:0x12:0x0] index 11 count 3 00000040:00080000:2.0:1777051512.727178:0:104226:0:(llog.c:858:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:3.0:1777051512.983246:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1777051513.762626:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051513.762698:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051513.763092:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051513.763300:0:109180:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426116352 00000100:00100000:2.0:1777051513.763309:0:27887:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426116864 00000100:00100000:3.0:1777051513.763320:0:109180:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426116352 00000100:00100000:2.0:1777051513.763324:0:27887:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426116864 00000100:00100000:2.0:1777051513.763425:0:27887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10556 00000100:00100000:2.0:1777051513.763444:0:27887:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fd60380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c11b6966-0775-44d2-bdc6-c74c26eb2226+31:2437:x1863365426116864:12345-192.168.201.46@tcp:400:kworker.0 00000100:00080000:1.0:1777051513.763518:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1777051513.763541:0:46497:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426116608 00000100:00100000:0.0:1777051513.763554:0:46497:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426116608 00000100:00100000:2.0:1777051513.763564:0:27887:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fd60380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c11b6966-0775-44d2-bdc6-c74c26eb2226+31:2437:x1863365426116864:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 122us (470us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051513.763616:0:27887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10556 00000100:00080000:2.0:1777051513.763741:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1777051513.763780:0:46497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13520 00000100:00100000:0.0:1777051513.763803:0:46497:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fd62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:c11b6966-0775-44d2-bdc6-c74c26eb2226+9:2437:x1863365426116608:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:0.0:1777051513.763884:0:46497:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fd62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:c11b6966-0775-44d2-bdc6-c74c26eb2226+9:2437:x1863365426116608:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 91us (1186us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051513.763896:0:46497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13520 00000100:00100000:0.0:1777051513.766530:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051513.766563:0:109186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 87 00000100:00100000:1.0:1777051513.766616:0:109186:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f3bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:29c4352d-3260-4734-909d-9ea5de9e7fa4+12:2437:x1863365426116352:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:1.0:1777051513.766676:0:109186:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f3bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:29c4352d-3260-4734-909d-9ea5de9e7fa4+12:2437:x1863365426116352:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 72us (4065us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051513.766689:0:109186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 87 00000100:00100000:2.0:1777051513.767214:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051513.767342:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051513.767416:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051513.767455:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051513.767503:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051513.767546:0:10328:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426116480 00000100:00100000:2.0:1777051513.767555:0:10328:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426116480 00000100:00100000:1.0:1777051513.767647:0:27882:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426117120 00000100:00100000:1.0:1777051513.767660:0:27882:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426117120 00000100:00100000:2.0:1777051513.768004:0:10328:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426116992 00000100:00100000:2.0:1777051513.768014:0:10328:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426116992 00000100:00100000:1.0:1777051513.768071:0:27882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13521 00000100:00100000:1.0:1777051513.768095:0:27882:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f97f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+19:2436:x1863365426116480:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:2.0:1777051513.768100:0:10328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13522 00000100:00100000:2.0:1777051513.768132:0:10328:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955611f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+54:2437:x1863365426117120:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:0.0:1777051513.768235:0:8468:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426116736 00000100:00100000:0.0:1777051513.768248:0:8468:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426116736 00000100:00100000:1.0:1777051513.768269:0:27882:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f97f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+19:2436:x1863365426116480:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 106us (1672us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051513.768281:0:10328:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955611f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+54:2437:x1863365426117120:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 153us (1066us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051513.768299:0:27882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13521 00000100:00100000:0.0:1777051513.768322:0:8468:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426117376 00000100:00100000:2.0:1777051513.768324:0:10328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13522 00000100:00100000:0.0:1777051513.768333:0:8468:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426117376 00000100:00100000:1.0:1777051513.768348:0:27882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13523 00000100:00100000:1.0:1777051513.768372:0:27882:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7c9a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+10:2436:x1863365426116992:12345-192.168.201.46@tcp:400:kworker.0 00000100:00080000:2.0:1777051513.768400:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1777051513.768406:0:8468:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426117248 00000100:00080000:2.0:1777051513.768412:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1777051513.768415:0:8468:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426117248 00000100:00080000:2.0:1777051513.768422:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1777051513.768433:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1777051513.768440:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1777051513.768452:0:27882:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7c9a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+10:2436:x1863365426116992:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 84us (991us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051513.768468:0:27884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10557 00000100:00100000:1.0:1777051513.768477:0:27882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13523 00000100:00100000:3.0:1777051513.768506:0:27884:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942d20700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+30:2436:x1863365426116736:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:2.0:1777051513.768524:0:8470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10558 00000100:00100000:0.0:1777051513.768552:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10559 00000100:00100000:2.0:1777051513.768555:0:8470:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7c9a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+30:2437:x1863365426117376:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:0.0:1777051513.768619:0:8468:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7c9a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+32:2436:x1863365426117248:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:3.0:1777051513.768653:0:27884:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942d20700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+30:2436:x1863365426116736:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 159us (1308us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051513.768670:0:27884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10557 00000100:00100000:2.0:1777051513.768684:0:8470:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7c9a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+30:2437:x1863365426117376:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 138us (1262us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051513.768705:0:8470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10558 00000100:00100000:0.0:1777051513.768960:0:8468:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7c9a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+32:2436:x1863365426117248:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 133us (1199us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051513.768977:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10559 00000040:00080000:3.0:1777051513.879631:0:109205:0:(llog.c:801:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:3.0:1777051513.879640:0:109205:0:(llog_cat.c:158:llog_cat_process_common()) processing log [0x1:0x2b:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1777051513.879823:0:109205:0:(llog.c:858:llog_process_thread()) stop processing plain [0x1:0x2b:0x0] index 12 count 3 00000040:00080000:3.0:1777051513.879835:0:109205:0:(llog.c:858:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00000001:00080000:2.0:1777051513.885465:0:109175:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 34359738384 is committed 00000001:00080000:2.0:1777051513.885502:0:109175:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 34359738383 is committed 00000020:00080000:2.0:1777051513.885524:0:109175:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff99d95ded6480 refcount 2 committed 0 result 0 batchid 30064771259 00000020:00080000:2.0:1777051513.885533:0:109175:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff99d9418ec300 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff99d95ded6240 00000020:00080000:2.0:1777051513.885540:0:109175:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff99d9418ec600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff99da43e78400 00010000:00010000:0.0:1777051513.885556:0:3664:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502da600/0x85f51a6b96717c4e lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e3:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051513.885613:0:3664:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502da600/0x85f51a6b96717c4e lrc: 2/0,0 mode: TXN/TXN res: [0x2000032e3:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051513.885627:0:3664:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502da600/0x85f51a6b96717c4e lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e3:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051513.885639:0:3664:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d9502da600 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:0.0:1777051513.885647:0:3664:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502da600/0x85f51a6b96717c4e lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e3:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051513.885660:0:3664:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502da600/0x85f51a6b96717c4e lrc: 4/0,0 mode: TXN/TXN res: [0x2000032e3:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051513.885686:0:3664:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e3:0xc:0x0].0x0 (ffff99da59dd4900) 00010000:00010000:0.0:1777051513.885693:0:3664:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777051513.885701:0:3664:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502da600/0x85f51a6b96717c4e lrc: 2/0,0 mode: --/TXN res: [0x2000032e3:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051513.885713:0:3664:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502da600/0x85f51a6b96717c4e lrc: 0/0,0 mode: --/TXN res: [0x2000032e3:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1777051513.885776:0:109209:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 30064771259 committed batchid 25769803782 00000020:00080000:0.0:1777051513.885874:0:109209:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 25769803782 00010000:00010000:0.0:1777051514.007015:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1777051514.256545:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051514.256698:0:6579:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426117504 00000100:00100000:2.0:1777051514.256713:0:6579:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426117504 00000100:00100000:2.0:1777051514.256802:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112457 00000100:00100000:2.0:1777051514.256820:0:6579:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f97ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+9:139448:x1863365426117504:12345-192.168.201.46@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1777051514.256979:0:6579:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f97ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+9:139448:x1863365426117504:12345-192.168.201.46@tcp:60:lhsmtool_posix.0 Request processed in 147us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051514.256998:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112457 00000100:00100000:1.0:1777051514.260299:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051514.260410:0:46494:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426117632 00000100:00100000:2.0:1777051514.260420:0:46494:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426117632 00000100:00100000:2.0:1777051514.260496:0:46494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112458 00000100:00100000:2.0:1777051514.260511:0:46494:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fd63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c11b6966-0775-44d2-bdc6-c74c26eb2226+9:139448:x1863365426117632:12345-192.168.201.46@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1777051514.260655:0:46494:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fd63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c11b6966-0775-44d2-bdc6-c74c26eb2226+9:139448:x1863365426117632:12345-192.168.201.46@tcp:60:lhsmtool_posix.0 Request processed in 145us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051514.260674:0:46494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112458 00000100:00100000:1.0:1777051514.267110:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051514.267273:0:46501:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426117888 00000100:00100000:3.0:1777051514.267285:0:46501:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426117888 00000100:00100000:3.0:1777051514.267368:0:46501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3437 00000100:00100000:3.0:1777051514.267384:0:46501:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fd61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+9:139448:x1863365426117888:12345-192.168.201.46@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1777051514.267696:0:46501:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fd61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+10:139448:x1863365426117888:12345-192.168.201.46@tcp:35:lhsmtool_posix.0 Request processed in 313us (590us total) trans 34359738385 rc 0/0 00000100:00100000:3.0:1777051514.267711:0:46501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3437 00000100:00100000:1.0:1777051514.646953:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7c9a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452721408:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1777051514.647067:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051514.647325:0:8472:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452721408 00000100:00100000:2.0:1777051514.647343:0:8472:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452721408 00000100:00080000:0.0:1777051514.647469:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1777051514.647473:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d956129880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3680:1863365452721536:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1777051514.647489:0:8472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5724 00000100:00100000:2.0:1777051514.647516:0:8472:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fd62680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3679:x1863365452721408:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1777051514.647549:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:2.0:1777051514.647598:0:8472:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 489208512 pending 0 free 3642707968 avail 3411185664 00000100:00100000:0.0:1777051514.647687:0:10113:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452721536 00000100:00100000:0.0:1777051514.647699:0:10113:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452721536 00000100:00100000:2.0:1777051514.647758:0:8472:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fd62680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3679:x1863365452721408:12345-0@lo:13:osp-pre-1-1.0 Request processed in 250us (689us total) trans 0 rc 0/0 00000100:00080000:3.0:1777051514.647767:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1777051514.647776:0:8472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5724 00000100:00100000:0.0:1777051514.647802:0:10113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5725 00000100:00100000:0.0:1777051514.647820:0:10113:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95612a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3680:x1863365452721536:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1777051514.647847:0:10113:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 499268288 pending 0 free 3860574208 avail 3629051904 00000100:00100000:0.0:1777051514.647925:0:10113:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95612a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3680:x1863365452721536:12345-0@lo:13:osp-pre-0-1.0 Request processed in 109us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051514.647938:0:10113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5725 00000100:00100000:2.0:1777051514.648032:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d956129880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3680:1863365452721536:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1777051514.648637:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7c9a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452721408:0@lo:13:osp-pre-1-1.0 00000001:00080000:0.0:1777051514.651368:0:9540:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0001: transno 4294968379 is committed 00000001:00080000:0.0:1777051514.651383:0:9540:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0001: transno 4294968378 is committed 00010000:00010000:0.0:1777051515.030807:0:108751:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1777051515.931928:0:110088:0:(debug.c:645:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-hsm test 408: Verify fiemap on release file ==== 13:25:14 (1777051514) 00010000:00010000:2.0:1777051516.055047:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1777051516.323838:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051516.323970:0:10328:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426118016 00000100:00100000:2.0:1777051516.323984:0:10328:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426118016 00000100:00080000:3.0:1777051516.324100:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1777051516.324111:0:10328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112459 00000100:00100000:2.0:1777051516.324133:0:10328:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fd62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+10:140919:x1863365426118016:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1777051516.324513:0:10328:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051516.324570:0:10328:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69a400/0x85f51a6b96717c94 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6ae1 expref: -99 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051516.324659:0:10328:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69ac00/0x85f51a6b96717c9b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051516.324681:0:10328:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69ac00/0x85f51a6b96717c9b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051516.324700:0:10328:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69ac00/0x85f51a6b96717c9b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051516.324722:0:10328:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69b000/0x85f51a6b96717ca2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051516.324730:0:10328:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69b000/0x85f51a6b96717ca2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051516.324737:0:10328:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69b000/0x85f51a6b96717ca2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051516.324823:0:10328:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69be00/0x85f51a6b96717ca9 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051516.324837:0:10328:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69be00/0x85f51a6b96717ca9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051516.324850:0:10328:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69be00/0x85f51a6b96717ca9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1777051516.324900:0:10328:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1777051516.324906:0:10328:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1777051516.324935:0:10328:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69be00/0x85f51a6b96717ca9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051516.324952:0:10328:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69ac00/0x85f51a6b96717c9b lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051516.324963:0:10328:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69ac00/0x85f51a6b96717c9b lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051516.324975:0:10328:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69ac00/0x85f51a6b96717c9b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051516.324991:0:10328:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69ac00/0x85f51a6b96717c9b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051516.324998:0:10328:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94f69ac00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:2.0:1777051516.325002:0:10328:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69ac00/0x85f51a6b96717c9b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051516.325010:0:10328:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69ac00/0x85f51a6b96717c9b lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051516.325023:0:10328:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d9413d0800) 00010000:00010000:2.0:1777051516.325027:0:10328:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777051516.325032:0:10328:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69ac00/0x85f51a6b96717c9b lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051516.325039:0:10328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69ac00/0x85f51a6b96717c9b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051516.325053:0:10328:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69b000/0x85f51a6b96717ca2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051516.325059:0:10328:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69b000/0x85f51a6b96717ca2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051516.325066:0:10328:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69b000/0x85f51a6b96717ca2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051516.325071:0:10328:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94f69b000 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:2.0:1777051516.325404:0:10328:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69b000/0x85f51a6b96717ca2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051516.325428:0:10328:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69b000/0x85f51a6b96717ca2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051516.325444:0:10328:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff99da59dd4200) 00010000:00010000:2.0:1777051516.325450:0:10328:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777051516.325457:0:10328:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69b000/0x85f51a6b96717ca2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051516.325468:0:10328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69b000/0x85f51a6b96717ca2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051516.325552:0:10328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69a400/0x85f51a6b96717c94 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6ae1 expref: 12 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051516.325576:0:10328:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69be00/0x85f51a6b96717ca9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6ae1 expref: 11 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051516.325589:0:10328:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff99da59dd4d00) 00010000:00010000:2.0:1777051516.325593:0:10328:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1777051516.325597:0:10328:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d94f69be00, rc 0) 00000100:00100000:2.0:1777051516.325683:0:10328:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fd62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+11:140919:x1863365426118016:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 Request processed in 1557us (1857us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051516.325695:0:10328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112459 00000100:00100000:1.0:1777051516.332048:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051516.332263:0:6580:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426118272 00000100:00100000:3.0:1777051516.332277:0:6580:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426118272 00000100:00100000:3.0:1777051516.332360:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112460 00000100:00100000:3.0:1777051516.332378:0:6580:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fd63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+11:140919:x1863365426118272:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1777051516.332402:0:6580:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777051516.332428:0:6580:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce800/0x85f51a6b96717cb0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6ae8 expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051516.332522:0:6580:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce200/0x85f51a6b96717cb7 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051516.332585:0:6580:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce200/0x85f51a6b96717cb7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051516.332601:0:6580:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce200/0x85f51a6b96717cb7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051516.332626:0:6580:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cfc00/0x85f51a6b96717cbe lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051516.332640:0:6580:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cfc00/0x85f51a6b96717cbe lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051516.332653:0:6580:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cfc00/0x85f51a6b96717cbe lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051516.333057:0:6580:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cf200/0x85f51a6b96717cc5 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051516.333072:0:6580:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cf200/0x85f51a6b96717cc5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051516.333084:0:6580:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cf200/0x85f51a6b96717cc5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1777051516.333100:0:6580:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:3.0:1777051516.333236:0:6580:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce200/0x85f51a6b96717cb7 lrc: 4/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051516.333251:0:6580:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce200/0x85f51a6b96717cb7 lrc: 4/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051516.333263:0:6580:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce200/0x85f51a6b96717cb7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051516.333275:0:6580:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce200/0x85f51a6b96717cb7 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051516.333285:0:6580:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da7d5ce200 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:3.0:1777051516.333291:0:6580:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce200/0x85f51a6b96717cb7 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051516.333303:0:6580:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce200/0x85f51a6b96717cb7 lrc: 5/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051516.333321:0:6580:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff99da59dd4d00) 00010000:00010000:3.0:1777051516.333326:0:6580:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777051516.333333:0:6580:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce200/0x85f51a6b96717cb7 lrc: 3/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051516.333344:0:6580:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce200/0x85f51a6b96717cb7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051516.333365:0:6580:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cfc00/0x85f51a6b96717cbe lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051516.333377:0:6580:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cfc00/0x85f51a6b96717cbe lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051516.333387:0:6580:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cfc00/0x85f51a6b96717cbe lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051516.333397:0:6580:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da7d5cfc00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:3.0:1777051516.333401:0:6580:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cfc00/0x85f51a6b96717cbe lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051516.333411:0:6580:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cfc00/0x85f51a6b96717cbe lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051516.333423:0:6580:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff99d9413d2000) 00010000:00010000:3.0:1777051516.333427:0:6580:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777051516.333432:0:6580:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cfc00/0x85f51a6b96717cbe lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051516.333441:0:6580:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cfc00/0x85f51a6b96717cbe lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051516.334655:0:6580:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce800/0x85f51a6b96717cb0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6ae8 expref: 14 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051516.334686:0:6580:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cf200/0x85f51a6b96717cc5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6ae8 expref: 13 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051516.334709:0:6580:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99d9413d2e00) 00010000:00010000:3.0:1777051516.334714:0:6580:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777051516.334718:0:6580:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99da7d5cf200, rc 0) 00000100:00100000:3.0:1777051516.334800:0:6580:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fd63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+13:140919:x1863365426118272:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 Request processed in 2426us (2758us total) trans 34359738386 rc 0/0 00000100:00100000:3.0:1777051516.334821:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112460 00000100:00100000:1.0:1777051516.340427:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051516.340566:0:27885:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426118400 00000100:00100000:2.0:1777051516.340577:0:27885:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426118400 00000100:00100000:2.0:1777051516.340966:0:27885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112461 00000100:00100000:2.0:1777051516.340984:0:27885:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fd63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c11b6966-0775-44d2-bdc6-c74c26eb2226+13:140919:x1863365426118400:12345-192.168.201.46@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1777051516.341114:0:27885:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fd63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c11b6966-0775-44d2-bdc6-c74c26eb2226+13:140919:x1863365426118400:12345-192.168.201.46@tcp:59:lhsmtool_posix.0 Request processed in 133us (695us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051516.341127:0:27885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112461 00000100:00100000:1.0:1777051516.345521:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051516.345662:0:6581:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426118528 00000100:00100000:0.0:1777051516.345672:0:6581:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426118528 00000100:00100000:0.0:1777051516.345754:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112462 00000100:00100000:0.0:1777051516.345772:0:6581:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da44494700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+9:140919:x1863365426118528:12345-192.168.201.46@tcp:59:lhsmtool_posix.0 00000100:00080000:3.0:1777051516.345781:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1777051516.345881:0:6581:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da44494700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+9:140919:x1863365426118528:12345-192.168.201.46@tcp:59:lhsmtool_posix.0 Request processed in 116us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051516.345889:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112462 00000100:00100000:1.0:1777051516.346662:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051516.346750:0:46494:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426118784 00000100:00100000:2.0:1777051516.346759:0:46494:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426118784 00000100:00100000:2.0:1777051516.346839:0:46494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112463 00000100:00100000:2.0:1777051516.346855:0:46494:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da44496680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+9:140920:x1863365426118784:12345-192.168.201.46@tcp:101:dd.0 00000100:00080000:3.0:1777051516.346857:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1777051516.346877:0:46494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051516.346881:0:46494:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1777051516.346909:0:46494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cec00/0x85f51a6b967179ed lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b69f3 expref: 9 pid: 109212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051516.346950:0:46494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d9413d0800) 00010000:00010000:2.0:1777051516.346957:0:46494:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1777051516.346975:0:46494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69a400/0x85f51a6b96717cd3 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6aef expref: -99 pid: 46494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051516.347088:0:46494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69b000/0x85f51a6b96717cda lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051516.347108:0:46494:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cea00/0x85f51a6b967179d8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b69c9 expref: 12 pid: 109212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051516.347123:0:46494:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69b000/0x85f51a6b96717cda lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051516.347487:0:46494:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cea00/0x85f51a6b967179d8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b69c9 expref: 12 pid: 109212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051516.347521:0:46494:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cea00/0x85f51a6b967179d8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b69c9 expref: 12 pid: 109212 timeout: 8245 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051516.347573:0:46494:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7c9a2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000_UUID:46494:1863365452721664:192.168.201.46@tcp:104: 00000100:00100000:2.0:1777051516.347682:0:46494:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d95ded6840 going to sleep for 11 seconds 00000100:00100000:2.0:1777051516.353883:0:46494:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7c9a2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000_UUID:46494:1863365452721664:192.168.201.46@tcp:104: 00010000:00010000:2.0:1777051516.353916:0:46494:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69b000/0x85f51a6b96717cda lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051516.354289:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051516.354376:0:6565:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426118912 00000100:00100000:2.0:1777051516.354383:0:6565:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426118912 00010000:00010000:2.0:1777051516.354415:0:6565:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cea00/0x85f51a6b967179d8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b69c9 expref: 13 pid: 109212 timeout: 8245 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051516.354472:0:6565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3976 00000100:00100000:2.0:1777051516.354486:0:6565:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da44495500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+13:2436:x1863365426118912:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1777051516.354503:0:6565:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777051516.354513:0:6565:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cea00/0x85f51a6b967179d8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b69c9 expref: 13 pid: 109212 timeout: 8245 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051516.354568:0:6565:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cea00/0x85f51a6b967179d8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b69c9 expref: 13 pid: 109212 timeout: 8245 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051516.354594:0:6565:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cea00/0x85f51a6b967179d8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b69c9 expref: 13 pid: 109212 timeout: 8245 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051516.354622:0:6565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d9413d0800) 00010000:00010000:2.0:1777051516.354629:0:6565:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69b000/0x85f51a6b96717cda lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051516.354642:0:6565:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69b000/0x85f51a6b96717cda lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051516.354654:0:6565:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69b000/0x85f51a6b96717cda lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051516.354701:0:6565:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1777051516.354785:0:6565:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da44495500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+12:2436:x1863365426118912:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 298us (498us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051516.354797:0:6565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3976 00010000:00010000:1.0:1777051516.354927:0:46494:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69b000/0x85f51a6b96717cda lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051516.354937:0:46494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69b000/0x85f51a6b96717cda lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051516.354960:0:46494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502db600/0x85f51a6b96717ce1 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x4e90570b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051516.354971:0:46494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502db600/0x85f51a6b96717ce1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x4e90570b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051516.354980:0:46494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502db600/0x85f51a6b96717ce1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x4e90570b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1777051516.355480:0:46494:0:(osp_internal.h:570:osp_update_last_fid()) Gap in objids: start=[0x280000401:0x1e7:0x0], count =27 00000004:00080000:1.0:1777051516.355492:0:46494:0:(osp_object.c:1640:osp_create()) Writing gap [0x280000401:0x1e7:0x0]+27 in llog 00000004:00080000:1.0:1777051516.355507:0:46494:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x202:0x0], index 0: 0 00010000:00010000:1.0:1777051516.356080:0:46494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502dac00/0x85f51a6b96717ce8 lrc: 3/1,0 mode: --/PR res: [0x2000032e2:0xc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051516.356095:0:46494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502dac00/0x85f51a6b96717ce8 lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051516.356108:0:46494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502dac00/0x85f51a6b96717ce8 lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051516.356155:0:46494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69b000/0x85f51a6b96717cda lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051516.356165:0:46494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69b000/0x85f51a6b96717cda lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051516.356598:0:46494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69b000/0x85f51a6b96717cda lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051516.356613:0:46494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94f69b000 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:1.0:1777051516.356620:0:46494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69b000/0x85f51a6b96717cda lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051516.356632:0:46494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69b000/0x85f51a6b96717cda lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051516.356647:0:46494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d9413d0800) 00010000:00010000:1.0:1777051516.356651:0:46494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777051516.356657:0:46494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69b000/0x85f51a6b96717cda lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051516.356667:0:46494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69b000/0x85f51a6b96717cda lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1777051516.356685:0:46494:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000016f69654 reply state 00000000354ff910 transno 34359738387 ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502db600/0x85f51a6b96717ce1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x4e90570b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051516.356701:0:46494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502db600/0x85f51a6b96717ce1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4e90570b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051516.356712:0:46494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x4e90570b (ffff99d94e592300) 00010000:00010000:1.0:1777051516.356715:0:46494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1777051516.356719:0:46494:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1777051516.356759:0:46494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69a400/0x85f51a6b96717cd3 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6aef expref: 11 pid: 46494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051516.357059:0:46494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502dac00/0x85f51a6b96717ce8 lrc: 3/0,0 mode: PR/PR res: [0x2000032e2:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6aef expref: 10 pid: 46494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051516.357071:0:46494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0xc:0x0].0x0 (ffff99d94e592800) 00010000:00010000:1.0:1777051516.357075:0:46494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1777051516.357079:0:46494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d9502dac00, rc 0) 00000100:00100000:1.0:1777051516.357141:0:46494:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da44496680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+11:140920:x1863365426118784:12345-192.168.201.46@tcp:101:dd.0 Request processed in 10289us (10481us total) trans 34359738387 rc 0/0 00000100:00100000:1.0:1777051516.357162:0:46494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112463 00000100:00100000:1.0:1777051516.364493:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051516.364615:0:24468:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426119040 00000100:00100000:2.0:1777051516.364626:0:24468:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426119040 00000100:00100000:2.0:1777051516.364716:0:24468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 8114 00000100:00100000:2.0:1777051516.364731:0:24468:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da44495880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+32:140920:x1863365426119040:12345-192.168.201.46@tcp:101:dd.0 00010000:00010000:2.0:1777051516.364751:0:24468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051516.364777:0:24468:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000061813a3d/0x85f51a6b96717cf6 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x202:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6af6 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1777051516.364810:0:24468:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x202:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1777051516.364843:0:24468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777051516.364846:0:24468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777051516.364859:0:24468:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000061813a3d/0x85f51a6b96717cf6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x202:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->65535) gid 0 flags: 0x50000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6af6 expref: 33 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051516.364891:0:24468:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000061813a3d/0x85f51a6b96717cf6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x202:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->65535) gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6af6 expref: 33 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051516.364911:0:24468:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d94f69ac00, rc 0) 00000100:00080000:3.0:1777051516.364943:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1777051516.364981:0:24468:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da44495880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+33:140920:x1863365426119040:12345-192.168.201.46@tcp:101:dd.0 Request processed in 252us (494us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051516.364993:0:24468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 8114 00000100:00100000:2.0:1777051516.379036:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051516.379169:0:27888:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426119168 00000100:00100000:1.0:1777051516.379183:0:27888:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426119168 00002000:00100000:1.0:1777051516.379277:0:27888:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x202:0x0] (0->65535) req@ffff99da7c9a2d80 x1863365426119168/t0(0) o4->2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp:477/0 lens 488/0 e 0 to 0 dl 1777051527 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1777051516.379295:0:27888:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99da7c9a2d80 with x1863365426119168 ext(0->65535) 00002000:00010000:1.0:1777051516.379305:0:27888:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99da7c9a2d80 00000100:00100000:1.0:1777051516.379349:0:27888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 1795 00000100:00100000:1.0:1777051516.379364:0:27888:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7c9a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+33:2437:x1863365426119168:12345-192.168.201.46@tcp:4:dd.0 00000100:00100000:1.0:1777051516.384088:0:27888:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7c9a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+35:2437:x1863365426119168:12345-192.168.201.46@tcp:4:dd.0 Request processed in 4719us (5054us total) trans 4294968375 rc 0/0 00000100:00100000:1.0:1777051516.384104:0:27888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 1795 00002000:00100000:1.0:1777051516.384118:0:27888:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x202:0x0] (0->65535) req@ffff99da7c9a2d80 x1863365426119168/t4294968375(0) o4->2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp:477/0 lens 488/448 e 0 to 0 dl 1777051527 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1777051516.384135:0:27888:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99da7c9a2d80 with x1863365426119168 ext(0->65535) 00002000:00010000:1.0:1777051516.384142:0:27888:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99da7c9a2d80 00000100:00100000:3.0:1777051516.388787:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051516.388874:0:21368:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426119296 00000100:00100000:0.0:1777051516.388886:0:21368:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426119296 00000100:00100000:0.0:1777051516.388969:0:21368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112464 00000100:00100000:0.0:1777051516.388985:0:21368:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95612a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+11:140920:x1863365426119296:12345-192.168.201.46@tcp:44:dd.0 00000001:00080000:2.0:1777051516.393189:0:109175:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 34359738387 is committed 00000001:00080000:2.0:1777051516.393252:0:109175:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 34359738386 is committed 00000020:00080000:2.0:1777051516.393265:0:109175:0:(update_trans.c:1333:distribute_txn_batchid_cb()) lustre-MDT0000: 30064771259 batchid updated 00010000:00010000:3.0:1777051516.393267:0:3663:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502db600/0x85f51a6b96717ce1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4e90570b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051516.393288:0:3663:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502db600/0x85f51a6b96717ce1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4e90570b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051516.393301:0:3663:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502db600/0x85f51a6b96717ce1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4e90570b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051516.393313:0:3663:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d9502db600 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:3.0:1777051516.393320:0:3663:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502db600/0x85f51a6b96717ce1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4e90570b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1777051516.393323:0:109209:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 30064771259 00010000:00010000:3.0:1777051516.393341:0:3663:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502db600/0x85f51a6b96717ce1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4e90570b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1777051516.393344:0:109209:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 30064771259 00010000:00010000:3.0:1777051516.393368:0:3663:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x4e90570b (ffff99d94e592300) 00010000:00010000:3.0:1777051516.393374:0:3663:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777051516.393381:0:3663:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502db600/0x85f51a6b96717ce1 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x4e90570b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051516.393391:0:3663:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502db600/0x85f51a6b96717ce1 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x4e90570b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051516.393462:0:21368:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95612a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+9:140920:x1863365426119296:12345-192.168.201.46@tcp:44:dd.0 Request processed in 4477us (4677us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051516.393475:0:21368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112464 00000100:00100000:3.0:1777051516.395942:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051516.396039:0:13320:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426119424 00000100:00100000:2.0:1777051516.396048:0:13320:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426119424 00000100:00100000:2.0:1777051516.396107:0:13320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 8115 00000100:00100000:2.0:1777051516.396120:0:13320:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d956128000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+35:2436:x1863365426119424:12345-192.168.201.46@tcp:16:dd.0 00000001:00080000:1.0:1777051516.398373:0:8464:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0000: transno 4294968375 is committed 00000100:00100000:2.0:1777051516.398566:0:13320:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d956128000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+33:2436:x1863365426119424:12345-192.168.201.46@tcp:16:dd.0 Request processed in 2444us (2624us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051516.398580:0:13320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 8115 00000100:00100000:2.0:1777051516.403616:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051516.403721:0:6582:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426119680 00000100:00100000:1.0:1777051516.403730:0:6582:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426119680 00000100:00100000:1.0:1777051516.403805:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3438 00000100:00100000:1.0:1777051516.403820:0:6582:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7c9a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+9:140920:x1863365426119680:12345-192.168.201.46@tcp:35:dd.0 00000100:00100000:1.0:1777051516.404193:0:6582:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7c9a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+10:140920:x1863365426119680:12345-192.168.201.46@tcp:35:dd.0 Request processed in 365us (569us total) trans 34359738388 rc 0/0 00000100:00100000:1.0:1777051516.404253:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3438 00000100:00100000:1.0:1777051516.425990:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051516.426100:0:27882:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426119808 00000100:00100000:2.0:1777051516.426114:0:27882:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426119808 00000100:00100000:2.0:1777051516.426242:0:27882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112465 00000100:00100000:2.0:1777051516.426262:0:27882:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da44494a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+10:140923:x1863365426119808:12345-192.168.201.46@tcp:101:lfs.0 00010000:00010000:2.0:1777051516.426296:0:27882:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051516.426325:0:27882:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69a000/0x85f51a6b96717cfd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6afd expref: -99 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051516.426406:0:27882:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69b200/0x85f51a6b96717d04 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051516.426428:0:27882:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69b200/0x85f51a6b96717d04 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051516.426443:0:27882:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69b200/0x85f51a6b96717d04 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1777051516.426498:0:27882:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 12288 00000004:00200000:2.0:1777051516.426503:0:27882:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1777051516.426558:0:27882:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69b200/0x85f51a6b96717d04 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051516.426596:0:27882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69a000/0x85f51a6b96717cfd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6afd expref: 12 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051516.426641:0:27882:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69b200/0x85f51a6b96717d04 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6afd expref: 11 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051516.426655:0:27882:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d9413d0800) 00010000:00010000:2.0:1777051516.426660:0:27882:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1777051516.426665:0:27882:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d94f69b200, rc 0) 00000100:00100000:2.0:1777051516.427094:0:27882:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da44494a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+11:140923:x1863365426119808:12345-192.168.201.46@tcp:101:lfs.0 Request processed in 835us (1112us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051516.427108:0:27882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112465 00000100:00100000:3.0:1777051516.432866:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051516.432963:0:8492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426119936 00000100:00100000:0.0:1777051516.432973:0:8492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426119936 00000100:00100000:0.0:1777051516.433035:0:8492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112466 00000100:00100000:0.0:1777051516.433048:0:8492:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d956128700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+11:140923:x1863365426119936:12345-192.168.201.46@tcp:34:lfs.0 00010000:00010000:0.0:1777051516.433108:0:8492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162e800/0x85f51a6b96717d0b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051516.433128:0:8492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162e800/0x85f51a6b96717d0b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051516.433142:0:8492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162e800/0x85f51a6b96717d0b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051516.433160:0:8492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162f800/0x85f51a6b96717d12 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x4e90570b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051516.433184:0:8492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162f800/0x85f51a6b96717d12 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4e90570b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051516.433243:0:8492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162f800/0x85f51a6b96717d12 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4e90570b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051516.433343:0:8492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162f200/0x85f51a6b96717d19 lrc: 3/1,0 mode: --/PR res: [0x2000032e2:0xc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051516.433356:0:8492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162f200/0x85f51a6b96717d19 lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051516.433374:0:8492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162f200/0x85f51a6b96717d19 lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1777051516.433412:0:8492:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000032e2:0xc:0x0]: returning size 65536 00000004:00200000:0.0:1777051516.433417:0:8492:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1777051516.433434:0:8492:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162f200/0x85f51a6b96717d19 lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051516.433451:0:8492:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162e800/0x85f51a6b96717d0b lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051516.433461:0:8492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162e800/0x85f51a6b96717d0b lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051516.433471:0:8492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162e800/0x85f51a6b96717d0b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051516.433480:0:8492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162e800/0x85f51a6b96717d0b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051516.433489:0:8492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da4162e800 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:0.0:1777051516.433495:0:8492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162e800/0x85f51a6b96717d0b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051516.433505:0:8492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162e800/0x85f51a6b96717d0b lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051516.433519:0:8492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d9413d0800) 00010000:00010000:0.0:1777051516.433546:0:8492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777051516.433552:0:8492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162e800/0x85f51a6b96717d0b lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051516.433568:0:8492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162e800/0x85f51a6b96717d0b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051516.433585:0:8492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162f800/0x85f51a6b96717d12 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4e90570b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051516.433594:0:8492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162f800/0x85f51a6b96717d12 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4e90570b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051516.433603:0:8492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162f800/0x85f51a6b96717d12 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4e90570b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051516.433611:0:8492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da4162f800 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:0.0:1777051516.433615:0:8492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162f800/0x85f51a6b96717d12 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4e90570b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051516.433623:0:8492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162f800/0x85f51a6b96717d12 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4e90570b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051516.433633:0:8492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x4e90570b (ffff99da45738600) 00010000:00010000:0.0:1777051516.433637:0:8492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777051516.433641:0:8492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162f800/0x85f51a6b96717d12 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x4e90570b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051516.433659:0:8492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162f800/0x85f51a6b96717d12 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x4e90570b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051516.433678:0:8492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162f200/0x85f51a6b96717d19 lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051516.433686:0:8492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162f200/0x85f51a6b96717d19 lrc: 2/0,0 mode: PR/PR res: [0x2000032e2:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051516.433695:0:8492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162f200/0x85f51a6b96717d19 lrc: 3/0,0 mode: PR/PR res: [0x2000032e2:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051516.433703:0:8492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da4162f200 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:0.0:1777051516.433707:0:8492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162f200/0x85f51a6b96717d19 lrc: 3/0,0 mode: PR/PR res: [0x2000032e2:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051516.433715:0:8492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162f200/0x85f51a6b96717d19 lrc: 4/0,0 mode: PR/PR res: [0x2000032e2:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051516.433725:0:8492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0xc:0x0].0x0 (ffff99d94e592800) 00010000:00010000:0.0:1777051516.433728:0:8492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777051516.433731:0:8492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162f200/0x85f51a6b96717d19 lrc: 2/0,0 mode: --/PR res: [0x2000032e2:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051516.434015:0:8492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162f200/0x85f51a6b96717d19 lrc: 0/0,0 mode: --/PR res: [0x2000032e2:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051516.434406:0:8492:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d956128700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+11:140923:x1863365426119936:12345-192.168.201.46@tcp:34:lfs.0 Request processed in 1356us (1543us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051516.434421:0:8492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112466 00000100:00100000:1.0:1777051516.458480:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051516.458617:0:6579:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426120192 00000100:00100000:2.0:1777051516.458632:0:6579:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426120192 00000100:00100000:2.0:1777051516.458732:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112467 00000100:00100000:2.0:1777051516.458749:0:6579:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da44494e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+11:140924:x1863365426120192:12345-192.168.201.46@tcp:101:dd.0 00010000:00010000:2.0:1777051516.458778:0:6579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051516.458783:0:6579:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1777051516.458820:0:6579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69b200/0x85f51a6b96717d04 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6afd expref: 11 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051516.458850:0:6579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d9413d0800) 00010000:00010000:2.0:1777051516.458858:0:6579:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1777051516.458876:0:6579:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69a000/0x85f51a6b96717d20 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6b04 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051516.459036:0:6579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69a800/0x85f51a6b96717d27 lrc: 3/0,1 mode: --/CW res: [0x2000032e2:0xc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051516.459059:0:6579:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502dac00/0x85f51a6b96717ce8 lrc: 2/0,0 mode: PR/PR res: [0x2000032e2:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6aef expref: 11 pid: 46494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051516.459074:0:6579:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69a800/0x85f51a6b96717d27 lrc: 4/0,1 mode: --/CW res: [0x2000032e2:0xc:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051516.459124:0:6579:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502dac00/0x85f51a6b96717ce8 lrc: 3/0,0 mode: PR/PR res: [0x2000032e2:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6aef expref: 11 pid: 46494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051516.459148:0:6579:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502dac00/0x85f51a6b96717ce8 lrc: 4/0,0 mode: PR/PR res: [0x2000032e2:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6aef expref: 11 pid: 46494 timeout: 8245 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051516.459192:0:6579:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7c9a3480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6579:1863365452721792:192.168.201.46@tcp:104: 00000100:00100000:2.0:1777051516.459385:0:6579:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d95ded6840 going to sleep for 11 seconds 00000100:00100000:2.0:1777051516.463207:0:6579:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7c9a3480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6579:1863365452721792:192.168.201.46@tcp:104: 00010000:00010000:2.0:1777051516.463256:0:6579:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69a800/0x85f51a6b96717d27 lrc: 3/0,1 mode: --/CW res: [0x2000032e2:0xc:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051516.463732:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051516.464150:0:47597:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426120320 00000100:00100000:0.0:1777051516.464159:0:47597:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426120320 00010000:00010000:0.0:1777051516.464242:0:47597:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502dac00/0x85f51a6b96717ce8 lrc: 4/0,0 mode: PR/PR res: [0x2000032e2:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6aef expref: 12 pid: 46494 timeout: 8245 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051516.464293:0:47597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3977 00000100:00100000:0.0:1777051516.464310:0:47597:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da44494000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+12:2437:x1863365426120320:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1777051516.464327:0:47597:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777051516.464339:0:47597:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502dac00/0x85f51a6b96717ce8 lrc: 4/0,0 mode: PR/PR res: [0x2000032e2:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6aef expref: 12 pid: 46494 timeout: 8245 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051516.464360:0:47597:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502dac00/0x85f51a6b96717ce8 lrc: 3/0,0 mode: PR/PR res: [0x2000032e2:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6aef expref: 12 pid: 46494 timeout: 8245 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051516.464396:0:47597:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502dac00/0x85f51a6b96717ce8 lrc: 0/0,0 mode: --/PR res: [0x2000032e2:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6aef expref: 12 pid: 46494 timeout: 8245 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051516.464418:0:47597:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0xc:0x0].0x0 (ffff99d94e592800) 00010000:00010000:0.0:1777051516.464426:0:47597:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69a800/0x85f51a6b96717d27 lrc: 3/0,1 mode: --/CW res: [0x2000032e2:0xc:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051516.464441:0:47597:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69a800/0x85f51a6b96717d27 lrc: 3/0,1 mode: CW/CW res: [0x2000032e2:0xc:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051516.464454:0:47597:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69a800/0x85f51a6b96717d27 lrc: 4/0,1 mode: CW/CW res: [0x2000032e2:0xc:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051516.464497:0:47597:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1777051516.464588:0:47597:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da44494000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+11:2437:x1863365426120320:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 281us (856us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051516.464601:0:47597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3977 00010000:00010000:2.0:1777051516.464862:0:6579:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69a800/0x85f51a6b96717d27 lrc: 3/0,1 mode: CW/CW res: [0x2000032e2:0xc:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051516.464878:0:6579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69a800/0x85f51a6b96717d27 lrc: 3/0,1 mode: CW/CW res: [0x2000032e2:0xc:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1777051516.464903:0:6579:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000032e2:0xc:0x0]: returning size 65536 00010000:00010000:2.0:1777051516.465128:0:6579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69a000/0x85f51a6b96717d20 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6b04 expref: 12 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051516.465157:0:6579:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69a800/0x85f51a6b96717d27 lrc: 3/0,0 mode: CW/CW res: [0x2000032e2:0xc:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6b04 expref: 11 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051516.465171:0:6579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0xc:0x0].0x0 (ffff99d94e592800) 00010000:00010000:2.0:1777051516.465176:0:6579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1777051516.465182:0:6579:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d94f69a800, rc 0) 00000100:00100000:2.0:1777051516.465290:0:6579:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da44494e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+11:140924:x1863365426120192:12345-192.168.201.46@tcp:101:dd.0 Request processed in 6541us (6815us total) trans 34359738389 rc 0/0 00000100:00100000:2.0:1777051516.465303:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112467 00000100:00100000:1.0:1777051516.470311:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051516.470401:0:46497:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426120448 00000100:00100000:0.0:1777051516.470410:0:46497:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426120448 00000100:00100000:0.0:1777051516.470466:0:46497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112468 00000100:00100000:0.0:1777051516.470480:0:46497:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da44495180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+11:140924:x1863365426120448:12345-192.168.201.46@tcp:101:dd.0 00010000:00010000:0.0:1777051516.470506:0:46497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051516.470563:0:46497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162f200/0x85f51a6b96717d35 lrc: 2/0,0 mode: --/PR res: [0x2000032e2:0xc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6b0b expref: -99 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051516.470605:0:46497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162f800/0x85f51a6b96717d3c lrc: 3/1,0 mode: --/PR res: [0x2000032e2:0xc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051516.470623:0:46497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162f800/0x85f51a6b96717d3c lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0xc:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051516.470639:0:46497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162f800/0x85f51a6b96717d3c lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0xc:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051516.470788:0:46497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162f200/0x85f51a6b96717d35 lrc: 0/0,0 mode: --/PR res: [0x2000032e2:0xc:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6b0b expref: 13 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051516.470813:0:46497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162f800/0x85f51a6b96717d3c lrc: 3/0,0 mode: PR/PR res: [0x2000032e2:0xc:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6b0b expref: 12 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051516.470826:0:46497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0xc:0x0].0x0 (ffff99d94e592800) 00010000:00010000:0.0:1777051516.470831:0:46497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1777051516.470836:0:46497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99da4162f800, rc 0) 00000100:00100000:0.0:1777051516.470894:0:46497:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da44495180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+12:140924:x1863365426120448:12345-192.168.201.46@tcp:101:dd.0 Request processed in 416us (588us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051516.470907:0:46497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112468 00000100:00100000:1.0:1777051516.473995:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051516.474099:0:10328:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426120704 00000100:00100000:2.0:1777051516.474108:0:10328:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426120704 00000100:00100000:1.0:1777051516.474618:0:21368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112469 00000100:00100000:1.0:1777051516.474651:0:21368:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d950267100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+12:140924:x1863365426120704:12345-192.168.201.46@tcp:36:dd.0 00010000:00010000:1.0:1777051516.474887:0:21368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502da000/0x85f51a6b96717d43 lrc: 3/0,1 mode: --/PW res: [0x2000032e2:0xc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051516.474908:0:21368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502da000/0x85f51a6b96717d43 lrc: 3/0,1 mode: PW/PW res: [0x2000032e2:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051516.474924:0:21368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502da000/0x85f51a6b96717d43 lrc: 3/0,1 mode: PW/PW res: [0x2000032e2:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1777051516.474989:0:21368:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 34359738390 00000004:00010000:1.0:1777051516.475022:0:21368:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000a2569526 reply state 00000000df564ea0 transno 34359738391 ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502da000/0x85f51a6b96717d43 lrc: 3/0,1 mode: PW/PW res: [0x2000032e2:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051516.475043:0:21368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502da000/0x85f51a6b96717d43 lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e2:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051516.475054:0:21368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0xc:0x0].0x0 (ffff99d94e592800) 00010000:00010000:1.0:1777051516.475059:0:21368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1777051516.475063:0:21368:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1777051516.475166:0:21368:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d950267100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+15:140924:x1863365426120704:12345-192.168.201.46@tcp:36:dd.0 Request processed in 535us (1173us total) trans 34359738391 rc 0/0 00000100:00100000:1.0:1777051516.475179:0:21368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112469 00000020:00080000:1.0:1777051516.475186:0:21368:0:(tgt_main.c:783:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1777051516.481157:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051516.481312:0:6580:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426120832 00000100:00100000:3.0:1777051516.481323:0:6580:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426120832 00000100:00100000:3.0:1777051516.481393:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112470 00000100:00100000:3.0:1777051516.481418:0:6580:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d950266680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+15:140924:x1863365426120832:12345-192.168.201.46@tcp:101:dd.0 00010000:00010000:3.0:1777051516.481443:0:6580:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777051516.481466:0:6580:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce800/0x85f51a6b96717d4a lrc: 2/0,0 mode: --/CR res: [0x2000032e2:0xc:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6b12 expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051516.481555:0:6580:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce800/0x85f51a6b96717d4a lrc: 3/0,0 mode: CR/CR res: [0x2000032e2:0xc:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6b12 expref: 16 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051516.481578:0:6580:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce800/0x85f51a6b96717d4a lrc: 3/0,0 mode: CR/CR res: [0x2000032e2:0xc:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6b12 expref: 16 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051516.481605:0:6580:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0xc:0x0].0x0 (ffff99d94e592800) 00010000:00010000:3.0:1777051516.481610:0:6580:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1777051516.481615:0:6580:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99da7d5ce800, rc 0) 00000100:00100000:3.0:1777051516.481778:0:6580:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d950266680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+16:140924:x1863365426120832:12345-192.168.201.46@tcp:101:dd.0 Request processed in 370us (626us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051516.481791:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112470 00000100:00100000:2.0:1777051516.490411:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051516.490598:0:55658:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426120960 00000100:00100000:0.0:1777051516.490610:0:55658:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426120960 00002000:00010000:0.0:1777051516.490667:0:55658:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/514 (196608->18446744073709551615) 00002000:00100000:0.0:1777051516.490682:0:55658:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99da7c9a3480 with x1863365426120960 ext(196608->18446744073709551615) 00002000:00010000:0.0:1777051516.490697:0:55658:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99da7c9a3480. 00000100:00100000:0.0:1777051516.490738:0:55658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 1796 00000100:00100000:0.0:1777051516.490754:0:55658:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7c9a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+33:2436:x1863365426120960:12345-192.168.201.46@tcp:10:dd.0 00002000:00010000:0.0:1777051516.490995:0:55658:0:(ofd_lvb.c:305:ofd_lvbo_update()) res: [0x280000401:0x202:0x0] updating lvb size from disk: 0 -> 196608 00002000:00010000:0.0:1777051516.491002:0:55658:0:(ofd_lvb.c:312:ofd_lvbo_update()) res: [0x280000401:0x202:0x0] updating lvb mtime from disk: 0 -> 1777051516 00002000:00010000:0.0:1777051516.491006:0:55658:0:(ofd_lvb.c:318:ofd_lvbo_update()) res: [0x280000401:0x202:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1777051516.491010:0:55658:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x280000401:0x202:0x0] updating lvb ctime from disk: 0 -> 1777051516 00002000:00010000:0.0:1777051516.491015:0:55658:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000401:0x202:0x0] updating lvb blocks from disk: 0 -> 128 00000100:00100000:0.0:1777051516.491088:0:55658:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7c9a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+34:2436:x1863365426120960:12345-192.168.201.46@tcp:10:dd.0 Request processed in 335us (684us total) trans 4294968376 rc 0/0 00000100:00100000:0.0:1777051516.491103:0:55658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 1796 00002000:00010000:0.0:1777051516.491109:0:55658:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/514 (196608->18446744073709551615) 00002000:00100000:0.0:1777051516.491114:0:55658:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99da7c9a3480 with x1863365426120960 ext(196608->18446744073709551615) 00002000:00010000:0.0:1777051516.491122:0:55658:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99da7c9a3480. 00000100:00100000:1.0:1777051516.507465:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051516.507604:0:43492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426121088 00000100:00100000:2.0:1777051516.507615:0:43492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426121088 00002000:00100000:2.0:1777051516.507669:0:43492:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x202:0x0] (196608->262143) req@ffff99d950265c00 x1863365426121088/t0(0) o4->2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp:477/0 lens 488/0 e 0 to 0 dl 1777051527 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1777051516.507687:0:43492:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99d950265c00 with x1863365426121088 ext(196608->262143) 00002000:00010000:2.0:1777051516.507696:0:43492:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99d950265c00 00000100:00100000:2.0:1777051516.507752:0:43492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 1797 00000100:00100000:2.0:1777051516.507768:0:43492:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d950265c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+34:2437:x1863365426121088:12345-192.168.201.46@tcp:4:dd.0 00000100:00100000:3.0:1777051516.514018:0:43492:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d950265c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+36:2437:x1863365426121088:12345-192.168.201.46@tcp:4:dd.0 Request processed in 6244us (6556us total) trans 4294968377 rc 0/0 00000100:00100000:3.0:1777051516.514036:0:43492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 1797 00002000:00100000:3.0:1777051516.514051:0:43492:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x202:0x0] (196608->262143) req@ffff99d950265c00 x1863365426121088/t4294968377(0) o4->2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp:477/0 lens 488/448 e 0 to 0 dl 1777051527 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1777051516.514067:0:43492:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99d950265c00 with x1863365426121088 ext(196608->262143) 00002000:00010000:3.0:1777051516.514074:0:43492:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99d950265c00 00000100:00100000:2.0:1777051516.518713:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051516.518820:0:27885:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426121216 00000100:00100000:1.0:1777051516.518831:0:27885:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426121216 00000100:00100000:1.0:1777051516.518905:0:27885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112471 00000100:00100000:1.0:1777051516.518918:0:27885:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7c9a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+16:140924:x1863365426121216:12345-192.168.201.46@tcp:44:dd.0 00000100:00100000:1.0:1777051516.519072:0:27885:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7c9a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+16:140924:x1863365426121216:12345-192.168.201.46@tcp:44:dd.0 Request processed in 155us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051516.519085:0:27885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112471 00000100:00100000:1.0:1777051516.524318:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051516.524433:0:8628:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426121344 00000100:00100000:2.0:1777051516.524443:0:8628:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426121344 00000100:00100000:2.0:1777051516.524516:0:8628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 8116 00000100:00100000:2.0:1777051516.524567:0:8628:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d950266a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+36:2436:x1863365426121344:12345-192.168.201.46@tcp:16:dd.0 00000001:00080000:1.0:1777051516.527563:0:8464:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0000: transno 4294968377 is committed 00000100:00100000:2.0:1777051516.527752:0:8628:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d950266a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+33:2436:x1863365426121344:12345-192.168.201.46@tcp:16:dd.0 Request processed in 3187us (3435us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051516.527775:0:8628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 8116 00000100:00100000:3.0:1777051516.551021:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051516.551145:0:6581:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426121472 00000100:00100000:0.0:1777051516.551157:0:6581:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426121472 00000100:00100000:0.0:1777051516.551275:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112472 00000100:00100000:0.0:1777051516.551292:0:6581:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95612b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+16:140925:x1863365426121472:12345-192.168.201.46@tcp:101:stat.0 00010000:00010000:0.0:1777051516.551320:0:6581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051516.551349:0:6581:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162f200/0x85f51a6b96717d51 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6b19 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051516.551432:0:6581:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162e800/0x85f51a6b96717d58 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051516.551452:0:6581:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162e800/0x85f51a6b96717d58 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051516.551469:0:6581:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162e800/0x85f51a6b96717d58 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1777051516.551561:0:6581:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 12288 00000004:00200000:0.0:1777051516.551568:0:6581:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1777051516.551618:0:6581:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162e800/0x85f51a6b96717d58 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051516.551653:0:6581:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162f200/0x85f51a6b96717d51 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6b19 expref: 18 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051516.551976:0:6581:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162e800/0x85f51a6b96717d58 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6b19 expref: 17 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051516.551991:0:6581:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d9413d0800) 00010000:00010000:0.0:1777051516.551996:0:6581:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1777051516.552001:0:6581:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99da4162e800, rc 0) 00000100:00100000:0.0:1777051516.552366:0:6581:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95612b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+17:140925:x1863365426121472:12345-192.168.201.46@tcp:101:stat.0 Request processed in 1078us (1354us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051516.552379:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112472 00000100:00100000:1.0:1777051516.558063:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051516.558160:0:46494:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426121600 00000100:00100000:2.0:1777051516.558170:0:46494:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426121600 00000100:00100000:2.0:1777051516.558272:0:46494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112473 00000100:00100000:2.0:1777051516.558286:0:46494:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d950267480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+17:140925:x1863365426121600:12345-192.168.201.46@tcp:101:stat.0 00010000:00010000:2.0:1777051516.558304:0:46494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051516.558325:0:46494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69b200/0x85f51a6b96717d5f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6b20 expref: -99 pid: 46494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051516.558388:0:46494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69bc00/0x85f51a6b96717d66 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051516.558401:0:46494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69bc00/0x85f51a6b96717d66 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051516.558411:0:46494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69bc00/0x85f51a6b96717d66 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051516.558424:0:46494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69b600/0x85f51a6b96717d6d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x4e90570b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051516.558431:0:46494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69b600/0x85f51a6b96717d6d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4e90570b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051516.558438:0:46494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69b600/0x85f51a6b96717d6d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4e90570b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051516.558519:0:46494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69a000/0x85f51a6b96717d74 lrc: 3/1,0 mode: --/PR res: [0x2000032e2:0xc:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051516.558564:0:46494:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69a800/0x85f51a6b96717d27 lrc: 2/0,0 mode: CW/CW res: [0x2000032e2:0xc:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6b04 expref: 18 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051516.558578:0:46494:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69a000/0x85f51a6b96717d74 lrc: 4/1,0 mode: --/PR res: [0x2000032e2:0xc:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051516.558623:0:46494:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69a800/0x85f51a6b96717d27 lrc: 3/0,0 mode: CW/CW res: [0x2000032e2:0xc:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6b04 expref: 18 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051516.558645:0:46494:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69a800/0x85f51a6b96717d27 lrc: 4/0,0 mode: CW/CW res: [0x2000032e2:0xc:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6b04 expref: 18 pid: 6579 timeout: 8245 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051516.558665:0:46494:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7c9a0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000_UUID:46494:1863365452721920:192.168.201.46@tcp:104: 00000100:00100000:2.0:1777051516.559481:0:46494:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d95ded6300 going to sleep for 11 seconds 00000100:00100000:2.0:1777051516.561670:0:46494:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7c9a0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000_UUID:46494:1863365452721920:192.168.201.46@tcp:104: 00010000:00010000:2.0:1777051516.561703:0:46494:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69a000/0x85f51a6b96717d74 lrc: 3/1,0 mode: --/PR res: [0x2000032e2:0xc:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051516.562784:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051516.563155:0:46501:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426121856 00000100:00100000:3.0:1777051516.563166:0:46501:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426121856 00000100:00100000:3.0:1777051516.563293:0:46501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3439 00000100:00100000:3.0:1777051516.563313:0:46501:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d950265880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+19:6253:x1863365426121856:12345-192.168.201.46@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1777051516.563709:0:46501:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d950265880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+20:6253:x1863365426121856:12345-192.168.201.46@tcp:35:ldlm_bl.0 Request processed in 401us (925us total) trans 34359738392 rc 0/0 00000100:00100000:3.0:1777051516.563729:0:46501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3439 00000100:00100000:1.0:1777051516.570504:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051516.570660:0:24467:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426121984 00000100:00100000:0.0:1777051516.570671:0:24467:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426121984 00010000:00010000:0.0:1777051516.570710:0:24467:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69a800/0x85f51a6b96717d27 lrc: 4/0,0 mode: CW/CW res: [0x2000032e2:0xc:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6b04 expref: 20 pid: 6579 timeout: 8245 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051516.570764:0:24467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3978 00000100:00100000:0.0:1777051516.570779:0:24467:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da58811c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+20:2437:x1863365426121984:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1777051516.570798:0:24467:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777051516.570809:0:24467:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69a800/0x85f51a6b96717d27 lrc: 4/0,0 mode: CW/CW res: [0x2000032e2:0xc:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6b04 expref: 20 pid: 6579 timeout: 8245 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051516.570841:0:24467:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69a800/0x85f51a6b96717d27 lrc: 3/0,0 mode: CW/CW res: [0x2000032e2:0xc:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6b04 expref: 20 pid: 6579 timeout: 8245 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051516.570872:0:24467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69a800/0x85f51a6b96717d27 lrc: 0/0,0 mode: --/CW res: [0x2000032e2:0xc:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6b04 expref: 20 pid: 6579 timeout: 8245 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051516.570893:0:24467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0xc:0x0].0x0 (ffff99d94e592800) 00010000:00010000:0.0:1777051516.570901:0:24467:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69a000/0x85f51a6b96717d74 lrc: 3/1,0 mode: --/PR res: [0x2000032e2:0xc:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051516.570916:0:24467:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69a000/0x85f51a6b96717d74 lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0xc:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051516.570928:0:24467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69a000/0x85f51a6b96717d74 lrc: 4/1,0 mode: PR/PR res: [0x2000032e2:0xc:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051516.570980:0:24467:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1777051516.571042:0:24467:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da58811c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+19:2437:x1863365426121984:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 265us (539us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051516.571054:0:24467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3978 00010000:00010000:2.0:1777051516.571646:0:46494:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69a000/0x85f51a6b96717d74 lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0xc:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051516.571661:0:46494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69a000/0x85f51a6b96717d74 lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0xc:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1777051516.571716:0:46494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000032e2:0xc:0x0]: returning size 262144 00000004:00200000:2.0:1777051516.571723:0:46494:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1777051516.571753:0:46494:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69a000/0x85f51a6b96717d74 lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0xc:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051516.572221:0:46494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69a000/0x85f51a6b96717d74 lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051516.572240:0:46494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69bc00/0x85f51a6b96717d66 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051516.572251:0:46494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69bc00/0x85f51a6b96717d66 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051516.572261:0:46494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69bc00/0x85f51a6b96717d66 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051516.572271:0:46494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94f69bc00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:2.0:1777051516.572277:0:46494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69bc00/0x85f51a6b96717d66 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051516.572287:0:46494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69bc00/0x85f51a6b96717d66 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051516.572303:0:46494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d9413d0800) 00010000:00010000:2.0:1777051516.572308:0:46494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777051516.572314:0:46494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69bc00/0x85f51a6b96717d66 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051516.572324:0:46494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69bc00/0x85f51a6b96717d66 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051516.572342:0:46494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69b600/0x85f51a6b96717d6d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4e90570b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051516.572353:0:46494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69b600/0x85f51a6b96717d6d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4e90570b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051516.572406:0:46494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69b600/0x85f51a6b96717d6d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4e90570b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051516.572417:0:46494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94f69b600 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:2.0:1777051516.572422:0:46494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69b600/0x85f51a6b96717d6d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4e90570b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051516.572431:0:46494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69b600/0x85f51a6b96717d6d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4e90570b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051516.572443:0:46494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x4e90570b (ffff99d9502e3700) 00010000:00010000:2.0:1777051516.572447:0:46494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777051516.572453:0:46494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69b600/0x85f51a6b96717d6d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x4e90570b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051516.572461:0:46494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69b600/0x85f51a6b96717d6d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x4e90570b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051516.572548:0:46494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69b200/0x85f51a6b96717d5f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6b20 expref: 19 pid: 46494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051516.572571:0:46494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69a000/0x85f51a6b96717d74 lrc: 3/0,0 mode: PR/PR res: [0x2000032e2:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6b20 expref: 18 pid: 46494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051516.572583:0:46494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0xc:0x0].0x0 (ffff99d94e592800) 00010000:00010000:2.0:1777051516.572587:0:46494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1777051516.572591:0:46494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d94f69a000, rc 0) 00000100:00100000:2.0:1777051516.572669:0:46494:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d950267480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+18:140925:x1863365426121600:12345-192.168.201.46@tcp:101:stat.0 Request processed in 14384us (14885us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051516.572681:0:46494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112473 00000100:00100000:1.0:1777051516.652866:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051516.653003:0:10328:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426122240 00000100:00100000:2.0:1777051516.653017:0:10328:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426122240 00000100:00100000:2.0:1777051516.653097:0:10328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112474 00000100:00100000:2.0:1777051516.653110:0:10328:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d950264380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+18:140931:x1863365426122240:12345-192.168.201.46@tcp:58:lfs.0 00000040:00080000:2.0:1777051516.654684:0:10328:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1777051516.654741:0:10328:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].7, 64 off8640 00000040:00080000:2.0:1777051516.654932:0:10328:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x31:0x0].1, 136 off8328 00000100:00100000:2.0:1777051516.655065:0:10328:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d950264380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+18:140931:x1863365426122240:12345-192.168.201.46@tcp:58:lfs.0 Request processed in 1951us (2208us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051516.655082:0:10328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112474 00000040:00080000:1.0:1777051516.822549:0:104226:0:(llog.c:801:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1777051516.822562:0:104226:0:(llog_cat.c:158:llog_cat_process_common()) processing log [0x1:0x12:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1777051516.824414:0:104226:0:(llog.c:858:llog_process_thread()) stop processing plain [0x1:0x12:0x0] index 64768 count 3 00000040:00080000:1.0:1777051516.824433:0:104226:0:(llog.c:858:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000040:00080000:2.0:1777051516.950416:0:109205:0:(llog.c:801:llog_process_thread()) index: 6, lh_last_idx: 7 synced_idx: 0 lgh_last_idx: 7 00000040:00080000:2.0:1777051516.950427:0:109205:0:(llog_cat.c:158:llog_cat_process_common()) processing log [0x1:0x2b:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1777051516.951626:0:109205:0:(llog.c:858:llog_process_thread()) stop processing plain [0x1:0x2b:0x0] index 64768 count 3 00000040:00080000:2.0:1777051516.951651:0:109205:0:(llog.c:801:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:2.0:1777051516.951656:0:109205:0:(llog_cat.c:158:llog_cat_process_common()) processing log [0x1:0x31:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1777051516.951685:0:109205:0:(llog.c:858:llog_process_thread()) stop processing plain [0x1:0x31:0x0] index 2 count 2 00000040:00080000:2.0:1777051516.951691:0:109205:0:(llog.c:858:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 3 00000100:00100000:2.0:1777051516.952004:0:109205:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7c9a0e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:109205:1863365452722048:192.168.201.46@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1777051516.952128:0:109205:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d95ded6c00 going to sleep for 11 seconds 00000100:00100000:2.0:1777051516.955867:0:109205:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7c9a0e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:109205:1863365452722048:192.168.201.46@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1777051516.956743:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051516.957421:0:27882:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426122368 00000100:00100000:2.0:1777051516.957431:0:27882:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426122368 00000100:00100000:2.0:1777051516.957510:0:27882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112475 00000100:00100000:2.0:1777051516.957559:0:27882:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d950265500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+10:140941:x1863365426122368:12345-192.168.201.46@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1777051516.957597:0:27882:0:(mdt_handler.c:7958:mdt_fid2path()) path get [0x2000032e2:0xc:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1777051516.958019:0:27882:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d950265500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+10:140941:x1863365426122368:12345-192.168.201.46@tcp:53:lhsmtool_posix.0 Request processed in 464us (1277us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051516.958035:0:27882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112475 00000100:00100000:1.0:1777051516.962425:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051516.962565:0:8492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426122624 00000100:00100000:0.0:1777051516.962575:0:8492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426122624 00000100:00100000:0.0:1777051516.962644:0:8492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112476 00000100:00100000:0.0:1777051516.962659:0:8492:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d950264000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+10:140941:x1863365426122624:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1777051516.962678:0:8492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051516.962708:0:8492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162f200/0x85f51a6b96717d7b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6b27 expref: -99 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051516.962860:0:8492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162f000/0x85f51a6b96717d82 lrc: 3/1,0 mode: --/PR res: [0x2000032e2:0xc:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051516.962878:0:8492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162f000/0x85f51a6b96717d82 lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051516.962894:0:8492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162f000/0x85f51a6b96717d82 lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1777051516.962907:0:8492:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000032e2:0xc:0x0]: returning size 262144 00010000:00010000:0.0:1777051516.963030:0:8492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162f200/0x85f51a6b96717d7b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6b27 expref: 13 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051516.963058:0:8492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162f000/0x85f51a6b96717d82 lrc: 3/0,0 mode: PR/PR res: [0x2000032e2:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6b27 expref: 12 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051516.963072:0:8492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0xc:0x0].0x0 (ffff99d94e592800) 00010000:00010000:0.0:1777051516.963077:0:8492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1777051516.963082:0:8492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99da4162f000, rc 0) 00000100:00100000:0.0:1777051516.965032:0:8492:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d950264000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+12:140941:x1863365426122624:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 Request processed in 2372us (2607us total) trans 34359738393 rc 0/0 00000100:00100000:0.0:1777051516.965048:0:8492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112476 00000100:00100000:1.0:1777051516.971633:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051516.972057:0:27884:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426122752 00000100:00100000:3.0:1777051516.972068:0:27884:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426122752 00000100:00100000:3.0:1777051516.972171:0:27884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 8117 00000100:00100000:3.0:1777051516.972189:0:27884:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d950267800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+30:2437:x1863365426122752:12345-192.168.201.46@tcp:1:lhsmtool_posix.0 00000100:00080000:0.0:1777051516.972249:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1777051516.972285:0:27884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a87371ea/0x85f51a6b96717d90 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x202:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 27884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051516.972309:0:27884:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000061813a3d/0x85f51a6b96717cf6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x202:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->65535) gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6af6 expref: 32 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051516.972318:0:27884:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1777051516.972322:0:27884:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1777051516.972326:0:27884:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a87371ea/0x85f51a6b96717d90 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x202:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 27884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051516.972375:0:27884:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000061813a3d/0x85f51a6b96717cf6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x202:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->65535) gid 0 flags: 0x50000000000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6af6 expref: 32 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051516.972392:0:27884:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000061813a3d/0x85f51a6b96717cf6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x202:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->65535) gid 0 flags: 0x70000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6af6 expref: 32 pid: 24468 timeout: 8246 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051516.972408:0:27884:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d956129880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:27884:1863365452722176:192.168.201.46@tcp:104: 00000100:00100000:3.0:1777051516.972487:0:27884:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d958f6d3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1777051516.974503:0:27884:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d956129880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:27884:1863365452722176:192.168.201.46@tcp:104: 00010000:00010000:3.0:1777051516.974567:0:27884:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a87371ea/0x85f51a6b96717d90 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x202:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 27884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051516.979262:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051516.979370:0:6566:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426122880 00000100:00100000:3.0:1777051516.979379:0:6566:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426122880 00010000:00010000:3.0:1777051516.979417:0:6566:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000061813a3d/0x85f51a6b96717cf6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x202:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->65535) gid 0 flags: 0x60000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6af6 expref: 33 pid: 24468 timeout: 8246 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051516.979670:0:6566:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3979 00000100:00100000:3.0:1777051516.979687:0:6566:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d950267b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+33:2437:x1863365426122880:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1777051516.979707:0:6566:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1777051516.979730:0:6566:0:(ofd_lvb.c:305:ofd_lvbo_update()) res: [0x280000401:0x202:0x0] updating lvb size from disk: 196608 -> 262144 00002000:00010000:3.0:1777051516.979737:0:6566:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000401:0x202:0x0] updating lvb blocks from disk: 128 -> 256 00010000:00010000:3.0:1777051516.979748:0:6566:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000061813a3d/0x85f51a6b96717cf6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x202:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->65535) gid 0 flags: 0x60000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6af6 expref: 33 pid: 24468 timeout: 8246 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051516.979773:0:6566:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000061813a3d/0x85f51a6b96717cf6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x202:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->65535) gid 0 flags: 0x50000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6af6 expref: 33 pid: 24468 timeout: 8246 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051516.979808:0:6566:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000061813a3d/0x85f51a6b96717cf6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x202:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->65535) gid 0 flags: 0x44801400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6af6 expref: 33 pid: 24468 timeout: 8246 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051516.979828:0:6566:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051516.979831:0:6566:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051516.979837:0:6566:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a87371ea/0x85f51a6b96717d90 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x202:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 27884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051516.979853:0:6566:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a87371ea/0x85f51a6b96717d90 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x202:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 27884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051516.979901:0:6566:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1777051516.979984:0:6566:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d950267b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+32:2437:x1863365426122880:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 299us (723us total) trans 0 rc 0/0 00010000:00010000:0.0:1777051516.979996:0:27884:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a87371ea/0x85f51a6b96717d90 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x202:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 27884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051516.979996:0:6566:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3979 00010000:00010000:0.0:1777051516.980023:0:27884:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a87371ea/0x85f51a6b96717d90 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x202:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 27884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051516.980059:0:27884:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a87371ea/0x85f51a6b96717d90 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x202:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 27884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051516.980070:0:27884:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a87371ea/0x85f51a6b96717d90 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x202:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 27884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051516.980081:0:27884:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a87371ea/0x85f51a6b96717d90 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x202:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 27884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051516.980090:0:27884:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da7d5cfc00 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:0.0:1777051516.980095:0:27884:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a87371ea/0x85f51a6b96717d90 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x202:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 27884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051516.980449:0:27884:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a87371ea/0x85f51a6b96717d90 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x202:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 27884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051516.980480:0:27884:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a87371ea/0x85f51a6b96717d90 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x202:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 27884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051516.980495:0:27884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a87371ea/0x85f51a6b96717d90 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x202:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 27884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051516.980653:0:27884:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d950267800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+30:2437:x1863365426122752:12345-192.168.201.46@tcp:1:lhsmtool_posix.0 Request processed in 8449us (9005us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051516.980681:0:27884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 8117 00000100:00100000:1.0:1777051516.984700:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051516.984796:0:6579:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426123136 00000100:00100000:2.0:1777051516.984805:0:6579:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426123136 00000100:00100000:2.0:1777051516.984870:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112477 00000100:00100000:2.0:1777051516.984886:0:6579:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d950264a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+12:140941:x1863365426123136:12345-192.168.201.46@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1777051516.985008:0:6579:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d950264a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+12:140941:x1863365426123136:12345-192.168.201.46@tcp:57:lhsmtool_posix.0 Request processed in 123us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051516.985021:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112477 00000100:00100000:1.0:1777051516.989970:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051516.990381:0:8468:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426123264 00000100:00100000:0.0:1777051516.990390:0:8468:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426123264 00000100:00100000:2.0:1777051516.991129:0:27887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 8118 00000100:00100000:2.0:1777051516.991148:0:27887:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d950264700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c11b6966-0775-44d2-bdc6-c74c26eb2226+30:2437:x1863365426123264:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1777051516.991167:0:27887:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051516.991189:0:27887:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000083a6315f/0x85f51a6b96717d97 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x202:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6b2e expref: -99 pid: 27887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1777051516.991253:0:27887:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x202:0x0] initial LVB size: 262144, mtime: 0x69eba77c, atime: 0x0, ctime: 0x69eba77c, blocks: 0x100 00010000:00010000:2.0:1777051516.991275:0:27887:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777051516.991279:0:27887:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777051516.991289:0:27887:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000083a6315f/0x85f51a6b96717d97 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x202:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6b2e expref: 31 pid: 27887 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051516.991314:0:27887:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000083a6315f/0x85f51a6b96717d97 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x202:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6b2e expref: 31 pid: 27887 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051516.991335:0:27887:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d94f69b200, rc 0) 00000100:00100000:2.0:1777051516.991398:0:27887:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d950264700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c11b6966-0775-44d2-bdc6-c74c26eb2226+31:2437:x1863365426123264:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 Request processed in 256us (1432us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051516.991411:0:27887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 8118 00000100:00100000:1.0:1777051516.998025:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051516.998127:0:46497:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426123520 00000100:00100000:0.0:1777051516.998135:0:46497:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426123520 00000100:00100000:0.0:1777051516.998237:0:46497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112478 00000100:00100000:0.0:1777051516.998255:0:46497:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f659500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:c11b6966-0775-44d2-bdc6-c74c26eb2226+12:140941:x1863365426123520:12345-192.168.201.46@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1777051516.998348:0:46497:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f659500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:c11b6966-0775-44d2-bdc6-c74c26eb2226+12:140941:x1863365426123520:12345-192.168.201.46@tcp:57:lhsmtool_posix.0 Request processed in 97us (626us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051516.998361:0:46497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112478 00000100:00100000:1.0:1777051517.017715:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051517.017856:0:43515:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426123648 00000100:00100000:3.0:1777051517.017871:0:43515:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426123648 00002000:00100000:3.0:1777051517.017937:0:43515:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x202:0x0] (0->262143) req@ffff99d95f65bb80 x1863365426123648/t0(0) o3->c11b6966-0775-44d2-bdc6-c74c26eb2226@192.168.201.46@tcp:478/0 lens 488/0 e 0 to 0 dl 1777051528 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1777051517.017973:0:43515:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99d95f65bb80 with x1863365426123648 ext(0->262143) 00002000:00010000:3.0:1777051517.017988:0:43515:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99d95f65bb80 00000100:00100000:3.0:1777051517.018047:0:43515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 1798 00000100:00100000:3.0:1777051517.018064:0:43515:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f65bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+31:2437:x1863365426123648:12345-192.168.201.46@tcp:3:lhsmtool_posix.0 00000100:00100000:3.0:1777051517.025144:0:43515:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f65bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+31:2437:x1863365426123648:12345-192.168.201.46@tcp:3:lhsmtool_posix.0 Request processed in 7075us (7431us total) trans 0 rc 262144/262144 00000100:00100000:3.0:1777051517.025162:0:43515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 1798 00002000:00100000:3.0:1777051517.025179:0:43515:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x202:0x0] (0->262143) req@ffff99d95f65bb80 x1863365426123648/t0(0) o3->c11b6966-0775-44d2-bdc6-c74c26eb2226@192.168.201.46@tcp:478/0 lens 488/440 e 0 to 0 dl 1777051528 ref 1 fl Complete:/600/0 rc 262144/262144 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1777051517.025253:0:43515:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99d95f65bb80 with x1863365426123648 ext(0->262143) 00002000:00010000:3.0:1777051517.025262:0:43515:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99d95f65bb80 00000100:00100000:0.0:1777051517.049343:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051517.049429:0:21368:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426123776 00000100:00100000:1.0:1777051517.049444:0:21368:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426123776 00000100:00100000:1.0:1777051517.049554:0:21368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112479 00000100:00100000:1.0:1777051517.049573:0:21368:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942d20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+12:140941:x1863365426123776:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1777051517.049607:0:21368:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777051517.049636:0:21368:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502da600/0x85f51a6b96717d9e lrc: 2/0,0 mode: --/PR res: [0x2000032e2:0xc:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6b35 expref: -99 pid: 21368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051517.049688:0:21368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502db200/0x85f51a6b96717da5 lrc: 3/1,0 mode: --/PR res: [0x2000032e2:0xc:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051517.049709:0:21368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502db200/0x85f51a6b96717da5 lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0xc:0x0].0x0 bits 0x20/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051517.049728:0:21368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502db200/0x85f51a6b96717da5 lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0xc:0x0].0x0 bits 0x20/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051517.050137:0:21368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502da600/0x85f51a6b96717d9e lrc: 0/0,0 mode: --/PR res: [0x2000032e2:0xc:0x0].0x0 bits 0x20/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6b35 expref: 14 pid: 21368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051517.050162:0:21368:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502db200/0x85f51a6b96717da5 lrc: 3/0,0 mode: PR/PR res: [0x2000032e2:0xc:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6b35 expref: 13 pid: 21368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051517.050175:0:21368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0xc:0x0].0x0 (ffff99d94e592800) 00010000:00010000:1.0:1777051517.050180:0:21368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1777051517.050185:0:21368:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d9502db200, rc 0) 00000100:00100000:1.0:1777051517.050261:0:21368:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942d20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+13:140941:x1863365426123776:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 Request processed in 692us (924us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051517.050274:0:21368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112479 00000100:00100000:1.0:1777051517.055781:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051517.055943:0:27882:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426123904 00000100:00100000:2.0:1777051517.055952:0:27882:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426123904 00000100:00100000:2.0:1777051517.056012:0:27882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112480 00000100:00100000:2.0:1777051517.056029:0:27882:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f658380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+13:140941:x1863365426123904:12345-192.168.201.46@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1777051517.056071:0:27882:0:(mdt_handler.c:7958:mdt_fid2path()) path get [0x2000032e2:0xc:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1777051517.056189:0:27882:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f658380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+13:140941:x1863365426123904:12345-192.168.201.46@tcp:53:lhsmtool_posix.0 Request processed in 164us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051517.056340:0:27882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112480 00000100:00100000:2.0:1777051517.059372:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051517.059440:0:24468:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426124032 00000100:00100000:0.0:1777051517.059449:0:24468:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426124032 00000100:00100000:0.0:1777051517.059503:0:24468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 8119 00000100:00100000:0.0:1777051517.059539:0:24468:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7c9a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+31:2436:x1863365426124032:12345-192.168.201.46@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1777051517.059580:0:24468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000bc6f84ac/0x85f51a6b96717dac lrc: 3/1,0 mode: --/PR res: [0x280000401:0x202:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051517.059602:0:24468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777051517.059605:0:24468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777051517.059611:0:24468:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bc6f84ac/0x85f51a6b96717dac lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x202:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051517.059630:0:24468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bc6f84ac/0x85f51a6b96717dac lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x202:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051517.059675:0:24468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000bc6f84ac/0x85f51a6b96717dac lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x202:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051517.059689:0:24468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bc6f84ac/0x85f51a6b96717dac lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x202:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051517.059981:0:24468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bc6f84ac/0x85f51a6b96717dac lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x202:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051517.059993:0:24468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da4162f400 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:0.0:1777051517.059998:0:24468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bc6f84ac/0x85f51a6b96717dac lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x202:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051517.060012:0:24468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bc6f84ac/0x85f51a6b96717dac lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x202:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051517.060032:0:24468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bc6f84ac/0x85f51a6b96717dac lrc: 2/0,0 mode: --/PR res: [0x280000401:0x202:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051517.060044:0:24468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bc6f84ac/0x85f51a6b96717dac lrc: 0/0,0 mode: --/PR res: [0x280000401:0x202:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051517.060117:0:24468:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7c9a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+31:2436:x1863365426124032:12345-192.168.201.46@tcp:1:lhsmtool_posix.0 Request processed in 603us (744us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051517.060134:0:24468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 8119 00000100:00100000:0.0:1777051517.062604:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051517.062713:0:27885:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426124288 00000100:00100000:1.0:1777051517.062723:0:27885:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426124288 00000100:00100000:1.0:1777051517.062783:0:27885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112481 00000100:00100000:1.0:1777051517.062806:0:27885:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94e624e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c11b6966-0775-44d2-bdc6-c74c26eb2226+13:140941:x1863365426124288:12345-192.168.201.46@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1777051517.062876:0:27885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502daa00/0x85f51a6b96717db3 lrc: 3/0,1 mode: --/PW res: [0x2000032e2:0xc:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051517.062912:0:27885:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162f800/0x85f51a6b96717d3c lrc: 2/0,0 mode: PR/PR res: [0x2000032e2:0xc:0x0].0x0 bits 0x20/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6b0b expref: 17 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051517.062926:0:27885:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502db200/0x85f51a6b96717da5 lrc: 2/0,0 mode: PR/PR res: [0x2000032e2:0xc:0x0].0x0 bits 0x20/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6b35 expref: 13 pid: 21368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051517.062938:0:27885:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502daa00/0x85f51a6b96717db3 lrc: 5/0,1 mode: --/PW res: [0x2000032e2:0xc:0x0].0x0 bits 0x20/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051517.063002:0:27885:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502db200/0x85f51a6b96717da5 lrc: 3/0,0 mode: PR/PR res: [0x2000032e2:0xc:0x0].0x0 bits 0x20/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6b35 expref: 13 pid: 21368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051517.063022:0:27885:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502db200/0x85f51a6b96717da5 lrc: 4/0,0 mode: PR/PR res: [0x2000032e2:0xc:0x0].0x0 bits 0x20/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6b35 expref: 13 pid: 21368 timeout: 8246 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051517.063042:0:27885:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95f65ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000_UUID:27885:1863365452722304:192.168.201.46@tcp:104: 00010000:00010000:1.0:1777051517.063131:0:27885:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162f800/0x85f51a6b96717d3c lrc: 3/0,0 mode: PR/PR res: [0x2000032e2:0xc:0x0].0x0 bits 0x20/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6b0b expref: 17 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051517.063142:0:27885:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162f800/0x85f51a6b96717d3c lrc: 4/0,0 mode: PR/PR res: [0x2000032e2:0xc:0x0].0x0 bits 0x20/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6b0b expref: 17 pid: 46497 timeout: 8246 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051517.063154:0:27885:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95f65b480 pname:cluuid:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000_UUID:27885:1863365452722432:192.168.201.46@tcp:104: 00000100:00100000:1.0:1777051517.063196:0:27885:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d9591d5780 going to sleep for 11 seconds 00000100:00100000:3.0:1777051517.066107:0:27885:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95f65ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000_UUID:27885:1863365452722304:192.168.201.46@tcp:104: 00000100:00100000:3.0:1777051517.067396:0:27885:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95f65b480 pname:cluuid:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000_UUID:27885:1863365452722432:192.168.201.46@tcp:104: 00010000:00010000:3.0:1777051517.067433:0:27885:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502daa00/0x85f51a6b96717db3 lrc: 3/0,1 mode: --/PW res: [0x2000032e2:0xc:0x0].0x0 bits 0x20/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051517.067739:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051517.068066:0:6565:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426124416 00000100:00100000:2.0:1777051517.068075:0:6565:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426124416 00010000:00010000:2.0:1777051517.068110:0:6565:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502db200/0x85f51a6b96717da5 lrc: 4/0,0 mode: PR/PR res: [0x2000032e2:0xc:0x0].0x0 bits 0x20/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6b35 expref: 14 pid: 21368 timeout: 8246 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051517.068155:0:6565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3980 00000100:00100000:2.0:1777051517.068169:0:6565:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d9533bea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+14:2436:x1863365426124416:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1777051517.068184:0:6565:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777051517.068194:0:6565:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502db200/0x85f51a6b96717da5 lrc: 4/0,0 mode: PR/PR res: [0x2000032e2:0xc:0x0].0x0 bits 0x20/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6b35 expref: 14 pid: 21368 timeout: 8246 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051517.068213:0:6565:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502db200/0x85f51a6b96717da5 lrc: 3/0,0 mode: PR/PR res: [0x2000032e2:0xc:0x0].0x0 bits 0x20/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6b35 expref: 14 pid: 21368 timeout: 8246 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051517.068241:0:6565:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502db200/0x85f51a6b96717da5 lrc: 0/0,0 mode: --/PR res: [0x2000032e2:0xc:0x0].0x0 bits 0x20/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6b35 expref: 14 pid: 21368 timeout: 8246 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051517.068261:0:6565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0xc:0x0].0x0 (ffff99d94e592800) 00010000:00010000:2.0:1777051517.068269:0:6565:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502daa00/0x85f51a6b96717db3 lrc: 3/0,1 mode: --/PW res: [0x2000032e2:0xc:0x0].0x0 bits 0x20/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051517.068280:0:6565:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1777051517.068375:0:6565:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d9533bea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+13:2436:x1863365426124416:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 208us (638us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051517.068388:0:6565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3980 00000100:00100000:1.0:1777051517.068463:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051517.068559:0:47597:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426124544 00000100:00100000:2.0:1777051517.068567:0:47597:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426124544 00010000:00010000:2.0:1777051517.068596:0:47597:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162f800/0x85f51a6b96717d3c lrc: 4/0,0 mode: PR/PR res: [0x2000032e2:0xc:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6b0b expref: 18 pid: 46497 timeout: 8246 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051517.068653:0:47597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3981 00000100:00100000:2.0:1777051517.068664:0:47597:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f658e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+18:2436:x1863365426124544:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1777051517.068676:0:47597:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777051517.068682:0:47597:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162f800/0x85f51a6b96717d3c lrc: 4/0,0 mode: PR/PR res: [0x2000032e2:0xc:0x0].0x0 bits 0x20/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6b0b expref: 18 pid: 46497 timeout: 8246 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051517.068695:0:47597:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162f800/0x85f51a6b96717d3c lrc: 3/0,0 mode: PR/PR res: [0x2000032e2:0xc:0x0].0x0 bits 0x20/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6b0b expref: 18 pid: 46497 timeout: 8246 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051517.068712:0:47597:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162f800/0x85f51a6b96717d3c lrc: 0/0,0 mode: --/PR res: [0x2000032e2:0xc:0x0].0x0 bits 0x20/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6b0b expref: 18 pid: 46497 timeout: 8246 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051517.068725:0:47597:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0xc:0x0].0x0 (ffff99d94e592800) 00010000:00010000:2.0:1777051517.068729:0:47597:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502daa00/0x85f51a6b96717db3 lrc: 3/0,1 mode: --/PW res: [0x2000032e2:0xc:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051517.068738:0:47597:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502daa00/0x85f51a6b96717db3 lrc: 3/0,1 mode: PW/PW res: [0x2000032e2:0xc:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051517.068745:0:47597:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502daa00/0x85f51a6b96717db3 lrc: 4/0,1 mode: PW/PW res: [0x2000032e2:0xc:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051517.068770:0:47597:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1777051517.068806:0:47597:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f658e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+17:2436:x1863365426124544:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 143us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051517.068821:0:47597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3981 00010000:00010000:1.0:1777051517.068823:0:27885:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502daa00/0x85f51a6b96717db3 lrc: 3/0,1 mode: PW/PW res: [0x2000032e2:0xc:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051517.068840:0:27885:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502daa00/0x85f51a6b96717db3 lrc: 3/0,1 mode: PW/PW res: [0x2000032e2:0xc:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051517.069031:0:27885:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502daa00/0x85f51a6b96717db3 lrc: 3/0,1 mode: PW/PW res: [0x2000032e2:0xc:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051517.069047:0:27885:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502daa00/0x85f51a6b96717db3 lrc: 2/0,0 mode: PW/PW res: [0x2000032e2:0xc:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051517.069059:0:27885:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502daa00/0x85f51a6b96717db3 lrc: 3/0,0 mode: PW/PW res: [0x2000032e2:0xc:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051517.069071:0:27885:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d9502daa00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:1.0:1777051517.069077:0:27885:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502daa00/0x85f51a6b96717db3 lrc: 3/0,0 mode: PW/PW res: [0x2000032e2:0xc:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051517.069089:0:27885:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502daa00/0x85f51a6b96717db3 lrc: 4/0,0 mode: PW/PW res: [0x2000032e2:0xc:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051517.069106:0:27885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0xc:0x0].0x0 (ffff99d94e592800) 00010000:00010000:1.0:1777051517.069111:0:27885:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1777051517.069116:0:27885:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502daa00/0x85f51a6b96717db3 lrc: 2/0,0 mode: --/PW res: [0x2000032e2:0xc:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051517.069125:0:27885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502daa00/0x85f51a6b96717db3 lrc: 0/0,0 mode: --/PW res: [0x2000032e2:0xc:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051517.069332:0:27885:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94e624e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c11b6966-0775-44d2-bdc6-c74c26eb2226+13:140941:x1863365426124288:12345-192.168.201.46@tcp:57:lhsmtool_posix.0 Request processed in 6527us (6727us total) trans 34359738394 rc 0/0 00000100:00100000:1.0:1777051517.069346:0:27885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112481 00000040:00080000:2.0:1777051517.069374:0:109205:0:(llog.c:801:llog_process_thread()) index: 6, lh_last_idx: 7 synced_idx: 0 lgh_last_idx: 7 00000040:00080000:2.0:1777051517.069384:0:109205:0:(llog_cat.c:158:llog_cat_process_common()) processing log [0x1:0x2b:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1777051517.070754:0:109205:0:(llog.c:858:llog_process_thread()) stop processing plain [0x1:0x2b:0x0] index 64768 count 3 00000040:00080000:2.0:1777051517.070784:0:109205:0:(llog.c:801:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:2.0:1777051517.070789:0:109205:0:(llog_cat.c:158:llog_cat_process_common()) processing log [0x1:0x31:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1777051517.070815:0:109205:0:(llog.c:858:llog_process_thread()) stop processing plain [0x1:0x31:0x0] index 2 count 2 00000040:00080000:2.0:1777051517.070824:0:109205:0:(llog.c:858:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 3 00000100:00100000:0.0:1777051517.073217:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051517.073398:0:24269:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426124800 00000100:00100000:1.0:1777051517.073407:0:24269:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426124800 00000100:00100000:1.0:1777051517.073468:0:24269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3440 00000100:00100000:1.0:1777051517.073479:0:24269:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da44495500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+13:140941:x1863365426124800:12345-192.168.201.46@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1777051517.073703:0:24269:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da44495500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+14:140941:x1863365426124800:12345-192.168.201.46@tcp:35:lhsmtool_posix.0 Request processed in 223us (487us total) trans 34359738395 rc 0/0 00000100:00100000:1.0:1777051517.073715:0:24269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3440 00010000:00010000:1.0:1777051517.080249:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1777051517.207562:0:3678:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1777051517.207593:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95f659880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3678:1863365452722688:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1777051517.207703:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051517.207835:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da44494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452722560:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1777051517.207877:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051517.207989:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7c9a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3678:1863365452722816:0@lo:400:kworker.0 00000100:00100000:0.0:1777051517.208055:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051517.208116:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7c9a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3678:1863365452723328:0@lo:400:kworker.0 00000100:00100000:0.0:1777051517.208168:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051517.208176:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7c9a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3680:1863365452723072:0@lo:400:kworker.0 00000100:00100000:0.0:1777051517.208210:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94f42e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3678:1863365452723840:0@lo:400:kworker.0 00000100:00100000:2.0:1777051517.208247:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051517.208283:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7c9a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3680:1863365452723584:0@lo:400:kworker.0 00000100:00100000:0.0:1777051517.208335:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051517.208348:0:109184:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452722816 00000100:00100000:2.0:1777051517.208362:0:109184:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452722816 00000100:00100000:0.0:1777051517.208386:0:3678:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1777051517.208402:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7c9a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3678:1863365452723200:0@lo:400:kworker.0 00000100:00100000:0.0:1777051517.208448:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051517.208481:0:109184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1777051517.208491:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94f42dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3678:1863365452723712:0@lo:400:kworker.0 00000100:00100000:2.0:1777051517.208501:0:109184:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f3bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f9351a01-5b0e-4470-97fd-58b9b4b312a2+23:3678:x1863365452722816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777051517.208573:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051517.208643:0:109184:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f3bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f9351a01-5b0e-4470-97fd-58b9b4b312a2+23:3678:x1863365452722816:12345-0@lo:400:kworker.0 Request processed in 144us (584us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051517.208657:0:109184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1777051517.208681:0:6584:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452722688 00000100:00100000:1.0:1777051517.208692:0:6584:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452722688 00000100:00100000:3.0:1777051517.208694:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7c9a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3679:1863365452722944:0@lo:400:kworker.0 00000100:00100000:2.0:1777051517.208715:0:6579:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452723328 00000100:00100000:2.0:1777051517.208723:0:6579:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452723328 00000100:00100000:3.0:1777051517.208760:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051517.208761:0:6584:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452722560 00000100:00100000:1.0:1777051517.208771:0:6584:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452722560 00000100:00100000:3.0:1777051517.208808:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7c9a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452723456:0@lo:400:kworker.0 00000100:00100000:2.0:1777051517.208817:0:6579:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452723072 00000100:00100000:1.0:1777051517.208822:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8361 00000100:00100000:2.0:1777051517.208825:0:6579:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452723072 00000100:00100000:2.0:1777051517.209494:0:6579:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452723200 00000100:00100000:2.0:1777051517.209502:0:6579:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452723200 00000100:00100000:1.0:1777051517.209571:0:6584:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94ed2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3678:x1863365452722688:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1777051517.209578:0:6579:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452723712 00000100:00100000:2.0:1777051517.209586:0:6579:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452723712 00000004:00000024:1.0:1777051517.209623:0:6584:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4194304 pending 0 free 1446141952 avail 1299902464 00000100:00100000:2.0:1777051517.209625:0:6579:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452722944 00000100:00100000:2.0:1777051517.209635:0:6579:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452722944 00000100:00100000:2.0:1777051517.209675:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13524 00000100:00100000:2.0:1777051517.209690:0:6579:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f169880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3678:x1863365452723328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777051517.209709:0:6584:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94ed2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3678:x1863365452722688:12345-0@lo:41:osp-pre-1-0.0 Request processed in 871us (2003us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051517.209713:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051517.209730:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8361 00000100:00100000:3.0:1777051517.209768:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94f42c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452723968:0@lo:400:kworker.0 00000100:00100000:2.0:1777051517.209770:0:6579:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f169880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3678:x1863365452723328:12345-0@lo:400:kworker.0 Request processed in 78us (1600us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051517.209774:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8362 00000100:00100000:2.0:1777051517.209793:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13524 00000100:00100000:1.0:1777051517.209800:0:6584:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d944071f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:3678:x1863365452722560:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1777051517.209822:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051517.209831:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13525 00000004:00000024:1.0:1777051517.209835:0:6584:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4194304 pending 0 free 1441533952 avail 1295294464 00000100:00100000:2.0:1777051517.209847:0:6579:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f42f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3680:x1863365452723072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051517.209897:0:10328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13526 00000100:00100000:1.0:1777051517.209910:0:6584:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d944071f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:3678:x1863365452722560:12345-0@lo:41:osp-pre-0-1.0 Request processed in 115us (2029us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051517.209915:0:10328:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f16a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3678:x1863365452723200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777051517.209927:0:6579:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f42f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3680:x1863365452723072:12345-0@lo:400:kworker.0 Request processed in 84us (1677us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051517.209937:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8362 00000100:00100000:2.0:1777051517.209947:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13525 00000100:00100000:3.0:1777051517.209978:0:10328:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f16a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3678:x1863365452723200:12345-0@lo:400:kworker.0 Request processed in 71us (1533us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051517.209982:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13527 00000100:00100000:3.0:1777051517.209991:0:10328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13526 00000100:00100000:2.0:1777051517.209993:0:6579:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f16ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3678:x1863365452723712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777051517.210011:0:21368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13528 00000100:00100000:1.0:1777051517.210031:0:21368:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d956129880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3679:x1863365452722944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777051517.210047:0:6579:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f16ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3678:x1863365452723712:12345-0@lo:400:kworker.0 Request processed in 51us (1473us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051517.210058:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13527 00000100:00100000:2.0:1777051517.210403:0:13320:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452723840 00000100:00100000:2.0:1777051517.210413:0:13320:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452723840 00000100:00100000:0.0:1777051517.210466:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7c9a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3678:1863365452723200:0@lo:400:kworker.0 00000100:00100000:2.0:1777051517.210471:0:13320:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452723456 00000100:00100000:2.0:1777051517.210480:0:13320:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452723456 00000100:00100000:0.0:1777051517.210495:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94f42dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3678:1863365452723712:0@lo:400:kworker.0 00000100:00100000:0.0:1777051517.210543:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7c9a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3678:1863365452723328:0@lo:400:kworker.0 00000100:00100000:2.0:1777051517.210558:0:13320:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452723968 00000100:00100000:2.0:1777051517.210567:0:13320:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452723968 00000100:00100000:0.0:1777051517.210568:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7c9a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3678:1863365452722816:0@lo:400:kworker.0 00000100:00100000:0.0:1777051517.210604:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95f659880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3678:1863365452722688:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1777051517.210628:0:13320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10560 00000100:00100000:0.0:1777051517.210639:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da44494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452722560:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1777051517.210649:0:13320:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f168700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3678:x1863365452723840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777051517.210727:0:27884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10561 00000100:00100000:2.0:1777051517.210741:0:13320:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f168700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3678:x1863365452723840:12345-0@lo:400:kworker.0 Request processed in 98us (2404us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051517.210746:0:27884:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d943d90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3679:x1863365452723456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777051517.210770:0:13320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10560 00000100:00100000:2.0:1777051517.210804:0:13320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10562 00000100:00100000:2.0:1777051517.210818:0:13320:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d943d90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3679:x1863365452723968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777051517.210858:0:21368:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d956129880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3679:x1863365452722944:12345-0@lo:400:kworker.0 Request processed in 831us (2098us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051517.210872:0:21368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13528 00000100:00100000:0.0:1777051517.211052:0:27884:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d943d90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3679:x1863365452723456:12345-0@lo:400:kworker.0 Request processed in 310us (1881us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051517.211064:0:27884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10561 00000100:00100000:0.0:1777051517.211115:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94f42e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3678:1863365452723840:0@lo:400:kworker.0 00000100:00100000:2.0:1777051517.211173:0:13320:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d943d90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3679:x1863365452723968:12345-0@lo:400:kworker.0 Request processed in 355us (1348us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051517.211535:0:13320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10562 00000100:00080000:0.0:1777051517.211600:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1777051517.211610:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1777051517.211614:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1777051517.211617:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1777051517.211646:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051517.211692:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94f42d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3680:1863365452724096:0@lo:400:kworker.0 00000100:00100000:2.0:1777051517.211719:0:27887:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452723584 00000100:00100000:2.0:1777051517.212053:0:27887:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452723584 00000100:00100000:0.0:1777051517.212054:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051517.212134:0:27887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10563 00000100:00100000:0.0:1777051517.212143:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7c9a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3680:1863365452723072:0@lo:400:kworker.0 00000100:00100000:2.0:1777051517.212154:0:27887:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da44494000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3680:x1863365452723584:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1777051517.212266:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1777051517.212292:0:27887:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da44494000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3680:x1863365452723584:12345-0@lo:400:kworker.0 Request processed in 143us (643us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051517.212304:0:27887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10563 00000100:00100000:1.0:1777051517.212351:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7c9a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3679:1863365452722944:0@lo:400:kworker.0 00000100:00100000:2.0:1777051517.212370:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7c9a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3680:1863365452723584:0@lo:400:kworker.0 00000100:00100000:1.0:1777051517.212386:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7c9a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452723456:0@lo:400:kworker.0 00000100:00100000:1.0:1777051517.212411:0:3679:0:(client.c:3101:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968379 gen 2 00000004:00080000:1.0:1777051517.212419:0:3679:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 4294968379 committed transno 4294968379 00000100:00100000:1.0:1777051517.212445:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94f42c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452723968:0@lo:400:kworker.0 00000100:00100000:3.0:1777051517.212630:0:10328:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452724096 00000100:00100000:3.0:1777051517.212638:0:10328:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452724096 00000100:00100000:3.0:1777051517.212986:0:10328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13529 00000100:00100000:3.0:1777051517.213001:0:10328:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7c9a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3680:x1863365452724096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051517.213088:0:10328:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7c9a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3680:x1863365452724096:12345-0@lo:400:kworker.0 Request processed in 89us (1034us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051517.213099:0:10328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13529 00000100:00100000:2.0:1777051517.214050:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94f42d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3680:1863365452724096:0@lo:400:kworker.0 00000040:00080000:1.0:1777051517.397754:0:110137:0:(llog.c:801:llog_process_thread()) index: 6, lh_last_idx: 7 synced_idx: 0 lgh_last_idx: 7 00000040:00080000:1.0:1777051517.397764:0:110137:0:(llog_cat.c:158:llog_cat_process_common()) processing log [0x1:0x2b:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1777051517.397797:0:110137:0:(llog.c:858:llog_process_thread()) stop processing plain [0x1:0x2b:0x0] index 12 count 3 00000040:00080000:1.0:1777051517.397809:0:110137:0:(llog.c:801:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:1.0:1777051517.397812:0:110137:0:(llog_cat.c:158:llog_cat_process_common()) processing log [0x1:0x31:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1777051517.397834:0:110137:0:(llog.c:858:llog_process_thread()) stop processing plain [0x1:0x31:0x0] index 2 count 2 00000040:00080000:1.0:1777051517.397840:0:110137:0:(llog.c:858:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 3 00000100:00100000:0.0:1777051517.441047:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051517.441108:0:24468:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426124928 00000100:00100000:0.0:1777051517.441122:0:24468:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426124928 00000100:00100000:0.0:1777051517.441230:0:24468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 8120 00000100:00100000:0.0:1777051517.441250:0:24468:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7c9a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+32:2439:x1863365426124928:12345-192.168.201.46@tcp:101:lfs.0 00010000:00010000:0.0:1777051517.441274:0:24468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051517.441334:0:24468:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bc6f84ac/0x85f51a6b96717dba lrc: 2/0,0 mode: --/PR res: [0x280000401:0x202:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6b3c expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051517.441364:0:24468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777051517.441367:0:24468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777051517.441378:0:24468:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bc6f84ac/0x85f51a6b96717dba lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x202:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6b3c expref: 33 pid: 24468 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051517.441399:0:24468:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000bc6f84ac/0x85f51a6b96717dba lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x202:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6b3c expref: 33 pid: 24468 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051517.441415:0:24468:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99da4162f400, rc 0) 00000100:00100000:0.0:1777051517.441482:0:24468:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7c9a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+33:2439:x1863365426124928:12345-192.168.201.46@tcp:101:lfs.0 Request processed in 240us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051517.441491:0:24468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 8120 00000100:00100000:0.0:1777051517.451706:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051517.451788:0:6579:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426125184 00000100:00100000:1.0:1777051517.451801:0:6579:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426125184 00000100:00100000:1.0:1777051517.451879:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112482 00000100:00100000:1.0:1777051517.451896:0:6579:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7c9a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+17:140942:x1863365426125184:12345-192.168.201.46@tcp:101:lfs.0 00010000:00010000:1.0:1777051517.451925:0:6579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777051517.451969:0:6579:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502da800/0x85f51a6b96717dc1 lrc: 2/0,0 mode: --/CR res: [0x2000032e2:0xc:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6b43 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051517.452121:0:6579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502daa00/0x85f51a6b96717dc8 lrc: 3/0,1 mode: --/PW res: [0x2000032e2:0xc:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051517.452145:0:6579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502daa00/0x85f51a6b96717dc8 lrc: 3/0,1 mode: PW/PW res: [0x2000032e2:0xc:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051517.452163:0:6579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502daa00/0x85f51a6b96717dc8 lrc: 3/0,1 mode: PW/PW res: [0x2000032e2:0xc:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1777051517.452200:0:6579:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000032e2:0xc:0x0]: returning size 262144 00010000:00010000:1.0:1777051517.452674:0:6579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502da800/0x85f51a6b96717dc1 lrc: 0/0,0 mode: --/CR res: [0x2000032e2:0xc:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6b43 expref: 20 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051517.452701:0:6579:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502daa00/0x85f51a6b96717dc8 lrc: 3/0,0 mode: PW/PW res: [0x2000032e2:0xc:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6b43 expref: 19 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051517.452714:0:6579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0xc:0x0].0x0 (ffff99d94e592800) 00010000:00010000:1.0:1777051517.452719:0:6579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1777051517.452725:0:6579:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d9502daa00, rc 0) 00000100:00100000:1.0:1777051517.452804:0:6579:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7c9a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+19:140942:x1863365426125184:12345-192.168.201.46@tcp:101:lfs.0 Request processed in 911us (1103us total) trans 34359738396 rc 0/0 00000100:00100000:1.0:1777051517.452816:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112482 00000100:00100000:1.0:1777051517.457401:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051517.457606:0:27884:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426125312 00000100:00100000:2.0:1777051517.457619:0:27884:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426125312 00000100:00100000:2.0:1777051517.457691:0:27884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 8121 00000100:00100000:2.0:1777051517.457710:0:27884:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f658000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+33:2436:x1863365426125312:12345-192.168.201.46@tcp:1:lfs.0 00010000:00010000:2.0:1777051517.457761:0:27884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004f962098/0x85f51a6b96717dd6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x202:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 27884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051517.457790:0:27884:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000083a6315f/0x85f51a6b96717d97 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x202:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6b2e expref: 30 pid: 27887 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051517.457807:0:27884:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000bc6f84ac/0x85f51a6b96717dba lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x202:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6b3c expref: 33 pid: 24468 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051517.457819:0:27884:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777051517.457823:0:27884:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777051517.457829:0:27884:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004f962098/0x85f51a6b96717dd6 lrc: 5/0,1 mode: --/PW res: [0x280000401:0x202:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 27884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051517.457875:0:27884:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000bc6f84ac/0x85f51a6b96717dba lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x202:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6b3c expref: 33 pid: 24468 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051517.457902:0:27884:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000bc6f84ac/0x85f51a6b96717dba lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x202:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6b3c expref: 33 pid: 24468 timeout: 8246 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051517.457925:0:27884:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94f42d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:27884:1863365452724224:192.168.201.46@tcp:104: 00010000:00010000:2.0:1777051517.458053:0:27884:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000083a6315f/0x85f51a6b96717d97 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x202:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6b2e expref: 30 pid: 27887 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051517.458071:0:27884:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000083a6315f/0x85f51a6b96717d97 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x202:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6b2e expref: 30 pid: 27887 timeout: 8246 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051517.458088:0:27884:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94f42ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:27884:1863365452724352:192.168.201.46@tcp:104: 00000100:00100000:2.0:1777051517.458128:0:27884:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da7b3a4a80 going to sleep for 11 seconds 00000100:00100000:1.0:1777051517.463377:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051517.463480:0:24467:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426125440 00000100:00100000:3.0:1777051517.463491:0:24467:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426125440 00010000:00010000:3.0:1777051517.463562:0:24467:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000bc6f84ac/0x85f51a6b96717dba lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x202:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6b3c expref: 34 pid: 24468 timeout: 8246 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051517.463622:0:24467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3982 00000100:00100000:3.0:1777051517.463639:0:24467:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f659c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+34:2436:x1863365426125440:12345-192.168.201.46@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1777051517.463646:0:27884:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94f42d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:27884:1863365452724224:192.168.201.46@tcp:104: 00010000:00010000:3.0:1777051517.463660:0:24467:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1777051517.463675:0:27884:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94f42ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:27884:1863365452724352:192.168.201.46@tcp:104: 00010000:00010000:3.0:1777051517.463689:0:24467:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000bc6f84ac/0x85f51a6b96717dba lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x202:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6b3c expref: 34 pid: 24468 timeout: 8246 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051517.463712:0:24467:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000bc6f84ac/0x85f51a6b96717dba lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x202:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6b3c expref: 34 pid: 24468 timeout: 8246 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051517.463733:0:27884:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004f962098/0x85f51a6b96717dd6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x202:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 27884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051517.463747:0:24467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bc6f84ac/0x85f51a6b96717dba lrc: 0/0,0 mode: --/PR res: [0x280000401:0x202:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6b3c expref: 34 pid: 24468 timeout: 8246 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051517.463779:0:24467:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1777051517.463854:0:24467:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f659c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+33:2436:x1863365426125440:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 218us (483us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051517.463866:0:24467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3982 00000100:00100000:1.0:1777051517.473488:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051517.473597:0:6566:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426125568 00000100:00100000:3.0:1777051517.473609:0:6566:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426125568 00010000:00010000:3.0:1777051517.473655:0:6566:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000083a6315f/0x85f51a6b96717d97 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x202:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6b2e expref: 31 pid: 27887 timeout: 8246 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051517.473712:0:6566:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3983 00000100:00100000:3.0:1777051517.473727:0:6566:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f65b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+31:2437:x1863365426125568:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1777051517.473747:0:6566:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777051517.473771:0:6566:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000083a6315f/0x85f51a6b96717d97 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x202:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6b2e expref: 31 pid: 27887 timeout: 8246 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051517.473793:0:6566:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000083a6315f/0x85f51a6b96717d97 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x202:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6b2e expref: 31 pid: 27887 timeout: 8246 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051517.474119:0:6566:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000083a6315f/0x85f51a6b96717d97 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x202:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6b2e expref: 31 pid: 27887 timeout: 8246 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051517.474140:0:6566:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051517.474143:0:6566:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051517.474150:0:6566:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004f962098/0x85f51a6b96717dd6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x202:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 27884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051517.474166:0:6566:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004f962098/0x85f51a6b96717dd6 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x202:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 27884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051517.474257:0:6566:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1777051517.474316:0:6566:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f65b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+30:2437:x1863365426125568:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 592us (834us total) trans 0 rc 0/0 00010000:00010000:0.0:1777051517.474318:0:27884:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004f962098/0x85f51a6b96717dd6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x202:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 27884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051517.474335:0:6566:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3983 00010000:00010000:0.0:1777051517.474345:0:27884:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004f962098/0x85f51a6b96717dd6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x202:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 27884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051517.474378:0:27884:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004f962098/0x85f51a6b96717dd6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x202:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 27884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051517.474390:0:27884:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004f962098/0x85f51a6b96717dd6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x202:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 27884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051517.474412:0:27884:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004f962098/0x85f51a6b96717dd6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x202:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 27884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051517.474422:0:27884:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94f69aa00 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:0.0:1777051517.474429:0:27884:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004f962098/0x85f51a6b96717dd6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x202:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 27884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051517.474440:0:27884:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004f962098/0x85f51a6b96717dd6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x202:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 27884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051517.474460:0:27884:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004f962098/0x85f51a6b96717dd6 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x202:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 27884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051517.474472:0:27884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004f962098/0x85f51a6b96717dd6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x202:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 27884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051517.474591:0:27884:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f658000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+32:2436:x1863365426125312:12345-192.168.201.46@tcp:1:lfs.0 Request processed in 16886us (17194us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051517.474604:0:27884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 8121 00000100:00100000:1.0:1777051517.478676:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051517.478765:0:6583:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426125824 00000100:00100000:3.0:1777051517.478775:0:6583:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426125824 00000100:00100000:3.0:1777051517.478840:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3441 00000100:00100000:3.0:1777051517.478854:0:6583:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da6ff02850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+19:140942:x1863365426125824:12345-192.168.201.46@tcp:35:lfs.0 00000004:00010000:3.0:1777051517.478934:0:6583:0:(mdt_open.c:1994:mdt_hsm_release()) ### [0x2000032e2:0xc:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502daa00/0x85f51a6b96717dc8 lrc: 3/0,0 mode: PW/PW res: [0x2000032e2:0xc:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6b43 expref: 19 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1777051517.479157:0:6583:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 34359738397 00000001:00080000:3.0:1777051517.479607:0:6583:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 34359738398 00010000:00010000:3.0:1777051517.479709:0:6583:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cfc00/0x85f51a6b96717ddd lrc: 3/0,1 mode: --/EX res: [0x2000032e2:0xc:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6583 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051517.480244:0:6583:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69a000/0x85f51a6b96717d74 lrc: 2/0,0 mode: PR/PR res: [0x2000032e2:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6b20 expref: 22 pid: 46494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051517.480259:0:6583:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162f000/0x85f51a6b96717d82 lrc: 2/0,0 mode: PR/PR res: [0x2000032e2:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6b27 expref: 13 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051517.480272:0:6583:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce800/0x85f51a6b96717d4a lrc: 2/0,0 mode: CR/CR res: [0x2000032e2:0xc:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6b12 expref: 22 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051517.480287:0:6583:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cfc00/0x85f51a6b96717ddd lrc: 6/0,1 mode: --/EX res: [0x2000032e2:0xc:0x0].0x0 bits 0x28/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6583 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051517.480337:0:6583:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce800/0x85f51a6b96717d4a lrc: 3/0,0 mode: CR/CR res: [0x2000032e2:0xc:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6b12 expref: 22 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051517.480362:0:6583:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce800/0x85f51a6b96717d4a lrc: 4/0,0 mode: CR/CR res: [0x2000032e2:0xc:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6b12 expref: 22 pid: 6580 timeout: 8246 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051517.480385:0:6583:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d943d91880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6583:1863365452724480:192.168.201.46@tcp:104: 00010000:00010000:3.0:1777051517.480575:0:6583:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162f000/0x85f51a6b96717d82 lrc: 3/0,0 mode: PR/PR res: [0x2000032e2:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6b27 expref: 13 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051517.480592:0:6583:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162f000/0x85f51a6b96717d82 lrc: 4/0,0 mode: PR/PR res: [0x2000032e2:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6b27 expref: 13 pid: 8492 timeout: 8246 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051517.480610:0:6583:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d943d93480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6583:1863365452724608:192.168.201.46@tcp:104: 00010000:00010000:3.0:1777051517.480667:0:6583:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69a000/0x85f51a6b96717d74 lrc: 3/0,0 mode: PR/PR res: [0x2000032e2:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6b20 expref: 22 pid: 46494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051517.480683:0:6583:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69a000/0x85f51a6b96717d74 lrc: 4/0,0 mode: PR/PR res: [0x2000032e2:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6b20 expref: 22 pid: 46494 timeout: 8246 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051517.480700:0:6583:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d943d92300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6583:1863365452724736:192.168.201.46@tcp:104: 00000100:00100000:3.0:1777051517.480742:0:6583:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d958f6d6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1777051517.488145:0:6583:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d943d91880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6583:1863365452724480:192.168.201.46@tcp:104: 00000100:00100000:0.0:1777051517.488174:0:6583:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d943d93480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6583:1863365452724608:192.168.201.46@tcp:104: 00000100:00100000:2.0:1777051517.488192:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051517.488194:0:6583:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d943d92300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6583:1863365452724736:192.168.201.46@tcp:104: 00010000:00010000:0.0:1777051517.488270:0:6583:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cfc00/0x85f51a6b96717ddd lrc: 3/0,1 mode: --/EX res: [0x2000032e2:0xc:0x0].0x0 bits 0x28/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6583 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051517.488294:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051517.488337:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051517.488392:0:6565:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426125952 00000100:00100000:2.0:1777051517.488401:0:6565:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426125952 00010000:00010000:2.0:1777051517.488446:0:6565:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce800/0x85f51a6b96717d4a lrc: 4/0,0 mode: CR/CR res: [0x2000032e2:0xc:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6b12 expref: 23 pid: 6580 timeout: 8246 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051517.488487:0:6565:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426126080 00000100:00100000:2.0:1777051517.488492:0:6565:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426126080 00010000:00010000:2.0:1777051517.488544:0:6565:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69a000/0x85f51a6b96717d74 lrc: 4/0,0 mode: PR/PR res: [0x2000032e2:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6b20 expref: 24 pid: 46494 timeout: 8246 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051517.488563:0:47597:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426126208 00000100:00100000:0.0:1777051517.488572:0:47597:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426126208 00000100:00100000:2.0:1777051517.488596:0:6565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3984 00010000:00010000:0.0:1777051517.488609:0:47597:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162f000/0x85f51a6b96717d82 lrc: 4/0,0 mode: PR/PR res: [0x2000032e2:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6b27 expref: 14 pid: 8492 timeout: 8246 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051517.488618:0:6565:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f42ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+24:2436:x1863365426125952:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1777051517.488646:0:6565:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777051517.488658:0:6565:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce800/0x85f51a6b96717d4a lrc: 4/0,0 mode: CR/CR res: [0x2000032e2:0xc:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6b12 expref: 24 pid: 6580 timeout: 8246 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051517.488665:0:47597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3985 00000100:00100000:0.0:1777051517.488684:0:47597:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da42f56450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+24:2437:x1863365426126080:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1777051517.488694:0:6565:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce800/0x85f51a6b96717d4a lrc: 3/0,0 mode: CR/CR res: [0x2000032e2:0xc:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6b12 expref: 24 pid: 6580 timeout: 8246 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051517.488703:0:47597:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777051517.488717:0:47597:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69a000/0x85f51a6b96717d74 lrc: 4/0,0 mode: PR/PR res: [0x2000032e2:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6b20 expref: 24 pid: 46494 timeout: 8246 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051517.488738:0:47597:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69a000/0x85f51a6b96717d74 lrc: 3/0,0 mode: PR/PR res: [0x2000032e2:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6b20 expref: 24 pid: 46494 timeout: 8246 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051517.488738:0:6565:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce800/0x85f51a6b96717d4a lrc: 0/0,0 mode: --/CR res: [0x2000032e2:0xc:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6b12 expref: 24 pid: 6580 timeout: 8246 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051517.488791:0:47597:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69a000/0x85f51a6b96717d74 lrc: 0/0,0 mode: --/PR res: [0x2000032e2:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6b20 expref: 23 pid: 46494 timeout: 8246 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051517.488791:0:6565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0xc:0x0].0x0 (ffff99d94e592800) 00010000:00010000:2.0:1777051517.488806:0:6565:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cfc00/0x85f51a6b96717ddd lrc: 3/0,1 mode: --/EX res: [0x2000032e2:0xc:0x0].0x0 bits 0x28/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6583 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051517.488822:0:6565:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cfc00/0x85f51a6b96717ddd lrc: 3/0,1 mode: --/EX res: [0x2000032e2:0xc:0x0].0x0 bits 0x28/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6583 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051517.489034:0:47827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3986 00000100:00100000:1.0:1777051517.489052:0:47827:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f42d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+14:2438:x1863365426126208:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1777051517.489069:0:47827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1777051517.489078:0:47827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162f000/0x85f51a6b96717d82 lrc: 4/0,0 mode: PR/PR res: [0x2000032e2:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6b27 expref: 14 pid: 8492 timeout: 8246 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051517.489133:0:6565:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1777051517.489135:0:47597:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0xc:0x0].0x0 (ffff99d94e592800) 00010000:00010000:0.0:1777051517.489145:0:47597:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cfc00/0x85f51a6b96717ddd lrc: 3/0,1 mode: --/EX res: [0x2000032e2:0xc:0x0].0x0 bits 0x28/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6583 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051517.489157:0:47597:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cfc00/0x85f51a6b96717ddd lrc: 3/0,1 mode: --/EX res: [0x2000032e2:0xc:0x0].0x0 bits 0x28/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6583 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051517.489167:0:47597:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1777051517.489202:0:6565:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f42ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+22:2436:x1863365426125952:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 591us (1013us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051517.489217:0:47597:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da42f56450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+22:2437:x1863365426126080:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 532us (920us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051517.489218:0:6565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3984 00000100:00100000:0.0:1777051517.489243:0:47597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3985 00010000:00010000:1.0:1777051517.489644:0:47827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162f000/0x85f51a6b96717d82 lrc: 3/0,0 mode: PR/PR res: [0x2000032e2:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6b27 expref: 14 pid: 8492 timeout: 8246 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051517.489670:0:47827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162f000/0x85f51a6b96717d82 lrc: 0/0,0 mode: --/PR res: [0x2000032e2:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6b27 expref: 14 pid: 8492 timeout: 8246 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051517.489688:0:47827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0xc:0x0].0x0 (ffff99d94e592800) 00010000:00010000:1.0:1777051517.489695:0:47827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cfc00/0x85f51a6b96717ddd lrc: 3/0,1 mode: --/EX res: [0x2000032e2:0xc:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6583 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051517.489707:0:47827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cfc00/0x85f51a6b96717ddd lrc: 3/0,1 mode: EX/EX res: [0x2000032e2:0xc:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6583 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051517.489719:0:47827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cfc00/0x85f51a6b96717ddd lrc: 4/0,1 mode: EX/EX res: [0x2000032e2:0xc:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6583 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051517.489795:0:47827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1777051517.489852:0:6583:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cfc00/0x85f51a6b96717ddd lrc: 3/0,1 mode: EX/EX res: [0x2000032e2:0xc:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6583 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051517.489861:0:47827:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f42d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+13:2438:x1863365426126208:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 805us (1513us total) trans 0 rc 0/0 00010000:00010000:0.0:1777051517.489867:0:6583:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cfc00/0x85f51a6b96717ddd lrc: 3/0,1 mode: EX/EX res: [0x2000032e2:0xc:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6583 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051517.489884:0:47827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3986 00000001:00080000:0.0:1777051517.490003:0:6583:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 34359738399 00000001:00080000:0.0:1777051517.490760:0:6583:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 34359738400 00000100:00100000:0.0:1777051517.491276:0:6583:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7c9a3800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6583:1863365452724864:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1777051517.491336:0:6583:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051517.491384:0:6583:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d959bbef00 going to sleep for 11 seconds 00000100:00100000:2.0:1777051517.491424:0:46498:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452724864 00000100:00100000:2.0:1777051517.491432:0:46498:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452724864 00000100:00100000:2.0:1777051517.491483:0:46498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8363 00000100:00100000:2.0:1777051517.491494:0:46498:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7c9a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:6583:x1863365452724864:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1777051517.491628:0:46498:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7c9a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:6583:x1863365452724864:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 134us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051517.491638:0:46498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8363 00000100:00100000:3.0:1777051517.492023:0:6583:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7c9a3800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6583:1863365452724864:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1777051517.492550:0:6583:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 34359738401 00000100:00100000:3.0:1777051517.492610:0:6583:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d943d91500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6583:1863365452724992:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1777051517.492659:0:6583:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051517.492698:0:6583:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d958f6d3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1777051517.492733:0:6584:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452724992 00000100:00100000:2.0:1777051517.492741:0:6584:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452724992 00000100:00100000:2.0:1777051517.492800:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8364 00000100:00100000:2.0:1777051517.492810:0:6584:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d943d91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6583:x1863365452724992:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1777051517.492968:0:6584:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d943d91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6583:x1863365452724992:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 158us (310us total) trans 4294968378 rc 0/0 00000100:00100000:2.0:1777051517.492980:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8364 00000100:00100000:0.0:1777051517.493028:0:6583:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d943d91500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6583:1863365452724992:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1777051517.493081:0:6583:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 34359738402 00010000:00010000:0.0:1777051517.493121:0:6583:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cfc00/0x85f51a6b96717ddd lrc: 3/0,1 mode: EX/EX res: [0x2000032e2:0xc:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6583 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051517.493136:0:6583:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cfc00/0x85f51a6b96717ddd lrc: 2/0,0 mode: EX/EX res: [0x2000032e2:0xc:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6583 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051517.493147:0:6583:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cfc00/0x85f51a6b96717ddd lrc: 3/0,0 mode: EX/EX res: [0x2000032e2:0xc:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6583 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051517.493175:0:6583:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da7d5cfc00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:0.0:1777051517.493182:0:6583:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cfc00/0x85f51a6b96717ddd lrc: 3/0,0 mode: EX/EX res: [0x2000032e2:0xc:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6583 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051517.493193:0:6583:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cfc00/0x85f51a6b96717ddd lrc: 4/0,0 mode: EX/EX res: [0x2000032e2:0xc:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6583 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051517.493219:0:6583:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0xc:0x0].0x0 (ffff99d94e592800) 00010000:00010000:0.0:1777051517.493224:0:6583:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1777051517.493231:0:6583:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cfc00/0x85f51a6b96717ddd lrc: 2/0,0 mode: --/EX res: [0x2000032e2:0xc:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6583 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051517.493242:0:6583:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cfc00/0x85f51a6b96717ddd lrc: 0/0,0 mode: --/EX res: [0x2000032e2:0xc:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6583 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1777051517.493352:0:6583:0:(mdd_object.c:4010:mdd_close()) Object [0x2000032e2:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1777051517.493438:0:6583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2d:0x0].2, 64 off8320 00000004:00080000:0.0:1777051517.493533:0:6583:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 8146686306481ns, next at 8147686254836ns, rc = 0 00000001:00080000:0.0:1777051517.493546:0:6583:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 34359738403 00010000:00010000:0.0:1777051517.493594:0:6583:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0xc:0x0].0x0 (ffff99d94e592800) 00010000:00010000:0.0:1777051517.493600:0:6583:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1777051517.493610:0:6583:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502daa00/0x85f51a6b96717dc8 lrc: 0/0,0 mode: --/PW res: [0x2000032e2:0xc:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6b43 expref: 25 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051517.494028:0:6583:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da6ff02850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+24:140942:x1863365426125824:12345-192.168.201.46@tcp:35:lfs.0 Request processed in 15174us (15352us total) trans 34359738404 rc 0/0 00000100:00100000:0.0:1777051517.494043:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3441 00000020:00080000:0.0:1777051517.494050:0:6583:0:(tgt_main.c:783:tgt_ses_key_exit()) total 8 transactions per RPC 00000100:00100000:2.0:1777051517.510391:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051517.510502:0:46497:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426126464 00000100:00100000:0.0:1777051517.510544:0:46497:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426126464 00000100:00100000:0.0:1777051517.510623:0:46497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112483 00000100:00100000:0.0:1777051517.510639:0:46497:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f42df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+24:140943:x1863365426126464:12345-192.168.201.46@tcp:101:checkfiemap.0 00010000:00010000:0.0:1777051517.510671:0:46497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051517.510700:0:46497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162f000/0x85f51a6b96717de4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6b4a expref: -99 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051517.510801:0:46497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162f800/0x85f51a6b96717deb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051517.510824:0:46497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162f800/0x85f51a6b96717deb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051517.510842:0:46497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162f800/0x85f51a6b96717deb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051517.510866:0:46497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162f400/0x85f51a6b96717df2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x4e90570b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051517.510880:0:46497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162f400/0x85f51a6b96717df2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4e90570b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051517.510895:0:46497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162f400/0x85f51a6b96717df2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4e90570b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051517.511041:0:46497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162f200/0x85f51a6b96717df9 lrc: 3/1,0 mode: --/PR res: [0x2000032e2:0xc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051517.511057:0:46497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162f200/0x85f51a6b96717df9 lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051517.511071:0:46497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162f200/0x85f51a6b96717df9 lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1777051517.511086:0:46497:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000032e2:0xc:0x0]: returning size 262144 00010000:00010000:0.0:1777051517.511236:0:46497:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162f800/0x85f51a6b96717deb lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051517.511257:0:46497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162f800/0x85f51a6b96717deb lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051517.511269:0:46497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162f800/0x85f51a6b96717deb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051517.511281:0:46497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162f800/0x85f51a6b96717deb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051517.511292:0:46497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da4162f800 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:0.0:1777051517.511299:0:46497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162f800/0x85f51a6b96717deb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051517.511312:0:46497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162f800/0x85f51a6b96717deb lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051517.511334:0:46497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d9413d0800) 00010000:00010000:0.0:1777051517.511341:0:46497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777051517.511348:0:46497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162f800/0x85f51a6b96717deb lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051517.511360:0:46497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162f800/0x85f51a6b96717deb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051517.511381:0:46497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162f400/0x85f51a6b96717df2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4e90570b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051517.511392:0:46497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162f400/0x85f51a6b96717df2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4e90570b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051517.511402:0:46497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162f400/0x85f51a6b96717df2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4e90570b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051517.511414:0:46497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da4162f400 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:0.0:1777051517.511420:0:46497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162f400/0x85f51a6b96717df2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4e90570b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051517.511431:0:46497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162f400/0x85f51a6b96717df2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4e90570b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051517.511446:0:46497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x4e90570b (ffff99da45738600) 00010000:00010000:0.0:1777051517.511451:0:46497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777051517.511456:0:46497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162f400/0x85f51a6b96717df2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x4e90570b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051517.511466:0:46497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162f400/0x85f51a6b96717df2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x4e90570b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051517.511590:0:46497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162f000/0x85f51a6b96717de4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6b4a expref: 27 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051517.511623:0:46497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162f200/0x85f51a6b96717df9 lrc: 3/0,0 mode: PR/PR res: [0x2000032e2:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6b4a expref: 26 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051517.511636:0:46497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0xc:0x0].0x0 (ffff99d94e592800) 00010000:00010000:0.0:1777051517.511641:0:46497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1777051517.511645:0:46497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99da4162f200, rc 0) 00000100:00100000:0.0:1777051517.511737:0:46497:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f42df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+26:140943:x1863365426126464:12345-192.168.201.46@tcp:101:checkfiemap.0 Request processed in 1100us (1357us total) trans 34359738405 rc 0/0 00000100:00100000:0.0:1777051517.511751:0:46497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112483 00000100:00100000:3.0:1777051517.719089:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95f65b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3677:1863365452725120:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1777051517.719218:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051517.719286:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7c9a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3678:1863365452725248:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1777051517.719378:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051517.719452:0:10113:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452725120 00000100:00100000:3.0:1777051517.719466:0:10113:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452725120 00000100:00100000:3.0:1777051517.719604:0:10113:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452725248 00000100:00100000:3.0:1777051517.719618:0:10113:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452725248 00000100:00100000:2.0:1777051517.719699:0:47388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5726 00000100:00100000:2.0:1777051517.719725:0:47388:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da57e95050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3677:x1863365452725120:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1777051517.719783:0:47388:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 489208512 pending 0 free 3642707968 avail 3411185664 00000100:00100000:2.0:1777051517.719893:0:47388:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da57e95050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3677:x1863365452725120:12345-0@lo:13:osp-pre-1-0.0 Request processed in 176us (674us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051517.719988:0:10113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5727 00000100:00100000:3.0:1777051517.720225:0:10113:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f42e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3678:x1863365452725248:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1777051517.720258:0:10113:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 515963584 pending 0 free 3860574208 avail 3628871680 00000100:00100000:3.0:1777051517.720346:0:10113:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f42e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3678:x1863365452725248:12345-0@lo:13:osp-pre-0-0.0 Request processed in 130us (971us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051517.720366:0:10113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5727 00000100:00100000:2.0:1777051517.720403:0:47388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5726 00000100:00100000:3.0:1777051517.720591:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95f65b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3677:1863365452725120:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1777051517.721729:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7c9a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3678:1863365452725248:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1777051518.103043:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777051518.882430:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051518.882571:0:109182:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426126592 00000100:00100000:2.0:1777051518.882586:0:109182:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426126592 00000100:00100000:2.0:1777051518.882707:0:109182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 89 00000100:00100000:2.0:1777051518.882725:0:109182:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7d978850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29c4352d-3260-4734-909d-9ea5de9e7fa4+12:2436:x1863365426126592:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:2.0:1777051518.883128:0:109182:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7d978850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29c4352d-3260-4734-909d-9ea5de9e7fa4+12:2436:x1863365426126592:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 405us (709us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051518.883142:0:109182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 89 00000100:00100000:1.0:1777051518.886789:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051518.886856:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051518.886930:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051518.886956:0:13320:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426127104 00000100:00100000:3.0:1777051518.886967:0:13320:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426127104 00000100:00100000:1.0:1777051518.887000:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051518.887043:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051518.887081:0:8492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426126848 00000100:00100000:0.0:1777051518.887094:0:8492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426126848 00000100:00100000:1.0:1777051518.887101:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051518.887152:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051518.887172:0:8492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426127360 00000100:00100000:0.0:1777051518.887180:0:8492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426127360 00000100:00100000:0.0:1777051518.887558:0:8492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426126720 00000100:00100000:0.0:1777051518.887566:0:8492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426126720 00000100:00100000:0.0:1777051518.887595:0:8492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426127232 00000100:00100000:0.0:1777051518.887600:0:8492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426127232 00000100:00100000:0.0:1777051518.887636:0:8492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13530 00000100:00100000:0.0:1777051518.887650:0:8492:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f65a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+9:2436:x1863365426126848:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:2.0:1777051518.888061:0:27885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13531 00000100:00100000:2.0:1777051518.888078:0:27885:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f65aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+54:2436:x1863365426127360:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:1.0:1777051518.888531:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051518.888561:0:8492:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f65a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+9:2436:x1863365426126848:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 906us (1769us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051518.888578:0:8492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13530 00000100:00100000:0.0:1777051518.888611:0:8492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13532 00000100:00100000:0.0:1777051518.888626:0:8492:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f659f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+13:2436:x1863365426126720:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:0.0:1777051518.888686:0:8492:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f659f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+13:2436:x1863365426126720:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 63us (1643us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051518.888697:0:8492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13532 00000100:00100000:0.0:1777051518.888720:0:8492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13533 00000100:00100000:0.0:1777051518.889056:0:8492:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f658e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+26:2436:x1863365426127232:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:0.0:1777051518.889117:0:8492:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f658e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+26:2436:x1863365426127232:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 386us (1966us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051518.889131:0:8492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13533 00000100:00080000:0.0:1777051518.889173:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1777051518.889182:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1777051518.889188:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1777051518.889236:0:8471:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426127616 00000100:00100000:1.0:1777051518.889247:0:8471:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426127616 00000100:00080000:0.0:1777051518.889298:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1777051518.889341:0:8468:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426126976 00000100:00100000:0.0:1777051518.889350:0:8468:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426126976 00000100:00100000:2.0:1777051518.889412:0:27885:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f65aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+54:2436:x1863365426127360:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 1324us (2482us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051518.889426:0:27885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13531 00000100:00100000:3.0:1777051518.889739:0:13320:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426127488 00000100:00100000:3.0:1777051518.889749:0:13320:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426127488 00000100:00100000:2.0:1777051518.889762:0:8470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10564 00000100:00100000:2.0:1777051518.889781:0:8470:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f658a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+30:2436:x1863365426127104:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:1.0:1777051518.890157:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10565 00000100:00100000:1.0:1777051518.890172:0:8471:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f658700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+30:2436:x1863365426127616:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:1.0:1777051518.890482:0:8471:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f658700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+30:2436:x1863365426127616:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 311us (3481us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051518.890528:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10565 00000100:00080000:1.0:1777051518.890611:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1777051518.891028:0:8470:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f658a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+30:2436:x1863365426127104:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 1250us (4169us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051518.891042:0:8470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10564 00000100:00100000:0.0:1777051518.891149:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10566 00000100:00100000:0.0:1777051518.891167:0:8468:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f65b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+30:2436:x1863365426126976:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:0.0:1777051518.891226:0:8468:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f65b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+30:2436:x1863365426126976:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 64us (4129us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051518.891240:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10566 00000100:00100000:3.0:1777051518.892567:0:13320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10567 00000100:00100000:3.0:1777051518.892584:0:13320:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f659c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+32:2436:x1863365426127488:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:3.0:1777051518.892660:0:13320:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f659c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+32:2436:x1863365426127488:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 79us (4130us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051518.892674:0:13320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10567 00010000:00010000:0.0:1777051519.127189:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1777051519.766861:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d943d91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452725376:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1777051519.766868:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94f42c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3680:1863365452725504:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1777051519.767362:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051519.767510:0:10113:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452725376 00000100:00100000:3.0:1777051519.767524:0:10113:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452725376 00000100:00100000:0.0:1777051519.767551:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1777051519.767583:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1777051519.767625:0:47388:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452725504 00000100:00100000:1.0:1777051519.767636:0:47388:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452725504 00000100:00100000:3.0:1777051519.767649:0:10113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5728 00000100:00100000:3.0:1777051519.767673:0:10113:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f65b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3679:x1863365452725376:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1777051519.767716:0:10113:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 515963584 pending 0 free 3860443136 avail 3628920832 00000100:00100000:1.0:1777051519.767718:0:47388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5729 00000100:00100000:1.0:1777051519.767741:0:47388:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7c9a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3680:x1863365452725504:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1777051519.767776:0:47388:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 489208512 pending 0 free 3642707968 avail 3411185664 00000100:00100000:3.0:1777051519.767807:0:10113:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f65b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3679:x1863365452725376:12345-0@lo:13:osp-pre-0-1.0 Request processed in 143us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051519.767821:0:10113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5728 00000100:00100000:1.0:1777051519.767860:0:47388:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7c9a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3680:x1863365452725504:12345-0@lo:13:osp-pre-1-1.0 Request processed in 124us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051519.767875:0:47388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5729 00000100:00100000:3.0:1777051519.767908:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d943d91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452725376:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1777051519.768117:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1777051519.768175:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94f42c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3680:1863365452725504:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1777051520.150700:0:108751:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051521.176581:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1777051521.821140:0:109175:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 34359738405 is committed 00000004:00080000:2.0:1777051521.821475:0:109175:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000020:00080000:2.0:1777051521.821505:0:109175:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff99d958f6de40 refcount 2 committed 0 result 0 batchid 30064771260 00000020:00080000:2.0:1777051521.821512:0:109175:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff99da5fb7bc00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff99d958f6df00 00000020:00080000:2.0:1777051521.821518:0:109175:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff99da5fb7b200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff99d957e7d800 00000001:00080000:2.0:1777051521.821544:0:109175:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 34359738395 is committed 00010000:00010000:0.0:1777051521.821672:0:3664:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502da000/0x85f51a6b96717d43 lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e2:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051521.821689:0:3664:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502da000/0x85f51a6b96717d43 lrc: 2/0,0 mode: TXN/TXN res: [0x2000032e2:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051521.821700:0:3664:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502da000/0x85f51a6b96717d43 lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e2:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051521.821709:0:3664:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d9502da000 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:0.0:1777051521.821715:0:3664:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502da000/0x85f51a6b96717d43 lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e2:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051521.821727:0:3664:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502da000/0x85f51a6b96717d43 lrc: 4/0,0 mode: TXN/TXN res: [0x2000032e2:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051521.821749:0:3664:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0xc:0x0].0x0 (ffff99d94e592800) 00010000:00010000:0.0:1777051521.821753:0:3664:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777051521.821759:0:3664:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502da000/0x85f51a6b96717d43 lrc: 2/0,0 mode: --/TXN res: [0x2000032e2:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051521.821775:0:3664:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502da000/0x85f51a6b96717d43 lrc: 0/0,0 mode: --/TXN res: [0x2000032e2:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051521.822060:0:3678:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1777051521.822088:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d943d91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3678:1863365452725632:0@lo:6:osp-syn-0-0.0 00000020:00080000:1.0:1777051521.822101:0:109209:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 30064771260 committed batchid 30064771259 00000020:00080000:1.0:1777051521.822182:0:109209:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 30064771259 00000100:00100000:0.0:1777051521.822191:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051521.822334:0:27884:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452725632 00000100:00100000:3.0:1777051521.822347:0:27884:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452725632 00000100:00080000:2.0:1777051521.822470:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1777051521.822478:0:27884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8122 00000100:00100000:3.0:1777051521.822499:0:27884:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7c9a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+6:3678:x1863365452725632:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1777051521.822538:0:27884:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:514 count 1 00002000:00010000:3.0:1777051521.822577:0:27884:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x202:0x0] initial LVB size: 262144, mtime: 0x69eba77c, atime: 0x0, ctime: 0x69eba77c, blocks: 0x100 00010000:00010000:3.0:1777051521.822588:0:27884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000039e4571d/0x85f51a6b96717e07 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x202:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 27884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051521.822609:0:27884:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051521.822612:0:27884:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051521.822619:0:27884:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000039e4571d/0x85f51a6b96717e07 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x202:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 27884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051521.822650:0:27884:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000039e4571d/0x85f51a6b96717e07 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x202:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 27884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051521.822688:0:27884:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000039e4571d/0x85f51a6b96717e07 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x202:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 27884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051521.822701:0:27884:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000039e4571d/0x85f51a6b96717e07 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x202:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 27884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051521.822738:0:27884:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1777051521.822927:0:27884:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7c9a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+7:3678:x1863365452725632:12345-0@lo:6:osp-syn-0-0.0 Request processed in 433us (741us total) trans 4294968379 rc 0/0 00000100:00100000:3.0:1777051521.822940:0:27884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8122 00010000:00010000:1.0:1777051521.823424:0:6567:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777051521.823463:0:6567:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000039e4571d/0x85f51a6b96717e07 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x202:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 27884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051521.823479:0:6567:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da7d5cea00 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:1.0:1777051521.823486:0:6567:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000039e4571d/0x85f51a6b96717e07 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x202:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 27884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051521.823501:0:6567:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000039e4571d/0x85f51a6b96717e07 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x202:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 27884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051521.823526:0:6567:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000039e4571d/0x85f51a6b96717e07 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x202:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 27884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051521.823540:0:6567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000039e4571d/0x85f51a6b96717e07 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x202:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 27884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051521.823568:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051521.823571:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051521.823574:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1777051521.823621:0:3678:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99d943d91c00/2, rc 0, transno 4294968379 00000100:00100000:0.0:1777051521.823633:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d943d91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3678:1863365452725632:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1777051522.198627:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1777051522.326495:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7c9a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452725760:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1777051522.326506:0:3680:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1777051522.326530:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95f659880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3680:1863365452725888:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1777051522.326604:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051522.326698:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051522.326727:0:46500:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452725760 00000100:00100000:0.0:1777051522.326738:0:46500:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452725760 00000100:00100000:1.0:1777051522.326763:0:11727:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452725888 00000100:00100000:1.0:1777051522.326772:0:11727:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452725888 00000100:00100000:0.0:1777051522.326809:0:46500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8365 00000100:00100000:0.0:1777051522.326826:0:46500:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7c9a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+7:3678:x1863365452725760:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1777051522.326834:0:11727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8366 00000100:00100000:1.0:1777051522.326853:0:11727:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f65b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3680:x1863365452725888:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1777051522.326875:0:46500:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4194304 pending 0 free 1441533952 avail 1295294464 00000004:00000024:1.0:1777051522.326887:0:11727:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4194304 pending 0 free 1446141952 avail 1299902464 00000100:00100000:0.0:1777051522.326952:0:46500:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7c9a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+7:3678:x1863365452725760:12345-0@lo:41:osp-pre-0-1.0 Request processed in 130us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051522.326966:0:46500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8365 00000100:00100000:1.0:1777051522.326972:0:11727:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f65b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3680:x1863365452725888:12345-0@lo:41:osp-pre-1-0.0 Request processed in 121us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051522.326986:0:11727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8366 00000100:00100000:0.0:1777051522.327037:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7c9a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452725760:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1777051522.327041:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94f42d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3680:1863365452726016:0@lo:400:kworker.0 00000100:00100000:1.0:1777051522.327095:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051522.327155:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95f659880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3680:1863365452725888:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1777051522.329597:0:109180:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452726016 00000100:00100000:0.0:1777051522.329606:0:109180:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452726016 00000100:00100000:1.0:1777051522.329646:0:3680:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1777051522.329662:0:109180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1777051522.329673:0:109180:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7d97bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9351a01-5b0e-4470-97fd-58b9b4b312a2+23:3680:x1863365452726016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777051522.330042:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94f42ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3680:1863365452726400:0@lo:400:kworker.0 00000100:00100000:0.0:1777051522.330048:0:109180:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7d97bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9351a01-5b0e-4470-97fd-58b9b4b312a2+23:3680:x1863365452726016:12345-0@lo:400:kworker.0 Request processed in 372us (2950us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051522.330070:0:109180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1777051522.330110:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051522.330126:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94f42fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3678:1863365452726272:0@lo:400:kworker.0 00000100:00100000:2.0:1777051522.330143:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94f42e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3679:1863365452726912:0@lo:400:kworker.0 00000100:00100000:1.0:1777051522.330165:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94f42d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3680:1863365452726016:0@lo:400:kworker.0 00000100:00100000:0.0:1777051522.330181:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051522.330219:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94f42d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3677:1863365452726144:0@lo:400:kworker.0 00000100:00100000:1.0:1777051522.330225:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94f42c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3680:1863365452726528:0@lo:400:kworker.0 00000100:00100000:0.0:1777051522.331075:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94f42c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452726784:0@lo:400:kworker.0 00000100:00100000:2.0:1777051522.331092:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051522.331129:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051522.331138:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94f42ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452726656:0@lo:400:kworker.0 00000100:00100000:2.0:1777051522.331178:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051522.331190:0:46497:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452726400 00000100:00100000:2.0:1777051522.331229:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955506a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3677:1863365452727168:0@lo:400:kworker.0 00000100:00100000:0.0:1777051522.331233:0:46497:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452726400 00000100:00100000:2.0:1777051522.331257:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051522.331298:0:46497:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452726272 00000100:00100000:0.0:1777051522.331304:0:46497:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452726272 00000100:00100000:2.0:1777051522.331314:0:8492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452726144 00000100:00100000:2.0:1777051522.331322:0:8492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452726144 00000100:00100000:0.0:1777051522.331341:0:46497:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452727168 00000100:00100000:0.0:1777051522.331349:0:46497:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452727168 00000100:00100000:1.0:1777051522.331363:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051522.331385:0:8492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452726528 00000100:00100000:2.0:1777051522.331392:0:8492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452726528 00000100:00100000:1.0:1777051522.331413:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94f42dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3680:1863365452727040:0@lo:400:kworker.0 00000100:00100000:0.0:1777051522.331414:0:46497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13534 00000100:00100000:0.0:1777051522.331456:0:46497:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f659880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:lustre-MDT0000-lwp-OST0001_UUID+5:3680:x1863365452726400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777051522.331480:0:8492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13535 00000100:00100000:1.0:1777051522.331501:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051522.331501:0:8492:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7c9a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3678:x1863365452726272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777051522.331527:0:46497:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f659880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:lustre-MDT0000-lwp-OST0001_UUID+5:3680:x1863365452726400:12345-0@lo:400:kworker.0 Request processed in 96us (1417us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051522.331539:0:46497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13534 00000100:00100000:1.0:1777051522.331565:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94f42ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3680:1863365452726400:0@lo:400:kworker.0 00000100:00100000:0.0:1777051522.331571:0:46497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13536 00000100:00100000:0.0:1777051522.331592:0:46497:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94ed2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:lustre-MDT0000-lwp-OST0000_UUID+5:3677:x1863365452726144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777051522.331592:0:8492:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7c9a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3678:x1863365452726272:12345-0@lo:400:kworker.0 Request processed in 95us (1409us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051522.331612:0:8492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13535 00000100:00100000:1.0:1777051522.331627:0:21368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13537 00000100:00100000:1.0:1777051522.331644:0:21368:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3677:x1863365452727168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777051522.331651:0:8492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13538 00000100:00100000:0.0:1777051522.331662:0:46497:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94ed2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:lustre-MDT0000-lwp-OST0000_UUID+5:3677:x1863365452726144:12345-0@lo:400:kworker.0 Request processed in 76us (572us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051522.331672:0:8492:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f65ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3680:x1863365452726528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777051522.331681:0:46497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13536 00000100:00100000:1.0:1777051522.331699:0:21368:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3677:x1863365452727168:12345-0@lo:400:kworker.0 Request processed in 60us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051522.331709:0:21368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13537 00000100:00100000:1.0:1777051522.331752:0:55805:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452726784 00000100:00100000:1.0:1777051522.331760:0:55805:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452726784 00000100:00100000:2.0:1777051522.331760:0:8492:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f65ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3680:x1863365452726528:12345-0@lo:400:kworker.0 Request processed in 91us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051522.331775:0:8492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13538 00000100:00100000:0.0:1777051522.331790:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94f42c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3680:1863365452726528:0@lo:400:kworker.0 00000100:00100000:1.0:1777051522.331836:0:55805:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452726656 00000100:00100000:2.0:1777051522.331836:0:27887:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452727040 00000100:00100000:1.0:1777051522.331843:0:55805:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452726656 00000100:00100000:2.0:1777051522.331847:0:27887:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452727040 00000100:00080000:0.0:1777051522.331875:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1777051522.331885:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1777051522.331891:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1777051522.331896:0:55805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10568 00000100:00080000:0.0:1777051522.331899:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1777051522.331912:0:27887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10569 00000100:00100000:1.0:1777051522.331914:0:55805:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7c9a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3678:x1863365452726784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777051522.331929:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10570 00000100:00100000:2.0:1777051522.331934:0:27887:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da4384fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3677:x1863365452726656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777051522.331950:0:8468:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f42d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3680:x1863365452727040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777051522.331982:0:55805:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7c9a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3678:x1863365452726784:12345-0@lo:400:kworker.0 Request processed in 74us (854us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051522.331994:0:55805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10568 00000100:00100000:2.0:1777051522.332020:0:27887:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da4384fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3677:x1863365452726656:12345-0@lo:400:kworker.0 Request processed in 92us (836us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051522.332036:0:27887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10569 00000100:00100000:0.0:1777051522.332037:0:8468:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f42d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3680:x1863365452727040:12345-0@lo:400:kworker.0 Request processed in 90us (538us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051522.332052:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10570 00000100:00100000:1.0:1777051522.332075:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94f42dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3680:1863365452727040:0@lo:400:kworker.0 00000100:00100000:2.0:1777051522.332128:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94f42d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3677:1863365452726144:0@lo:400:kworker.0 00000100:00100000:0.0:1777051522.332139:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94f42fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3678:1863365452726272:0@lo:400:kworker.0 00000100:00100000:2.0:1777051522.332154:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94f42ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452726656:0@lo:400:kworker.0 00000100:00100000:0.0:1777051522.332166:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94f42c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452726784:0@lo:400:kworker.0 00000100:00100000:2.0:1777051522.332181:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955506a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3677:1863365452727168:0@lo:400:kworker.0 00000100:00100000:3.0:1777051522.332425:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051522.332571:0:46497:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452726912 00000100:00100000:0.0:1777051522.332579:0:46497:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452726912 00000100:00100000:1.0:1777051522.332767:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13539 00000100:00100000:1.0:1777051522.332781:0:6580:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d943d92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3679:x1863365452726912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777051522.332846:0:6580:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d943d92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3679:x1863365452726912:12345-0@lo:400:kworker.0 Request processed in 67us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051522.332855:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13539 00000100:00100000:3.0:1777051522.332905:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94f42e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3679:1863365452726912:0@lo:400:kworker.0 00000100:00100000:0.0:1777051522.654067:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051522.654251:0:6582:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426127872 00000100:00100000:2.0:1777051522.654269:0:6582:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426127872 00000100:00080000:0.0:1777051522.654455:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1777051522.654576:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3442 00000100:00100000:2.0:1777051522.654598:0:6582:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955612d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+10:140943:x1863365426127872:12345-192.168.201.46@tcp:35:checkfiemap.0 00000100:00100000:2.0:1777051522.654920:0:6582:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955612d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+11:140943:x1863365426127872:12345-192.168.201.46@tcp:35:checkfiemap.0 Request processed in 326us (865us total) trans 34359738406 rc 0/0 00000100:00100000:2.0:1777051522.654937:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3442 00000100:00100000:0.0:1777051522.839641:0:3680:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1777051522.839678:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955612a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3680:1863365452727424:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1777051522.839776:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051522.840673:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d943d93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3678:1863365452727296:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1777051522.840751:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051522.841789:0:10113:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452727424 00000100:00100000:3.0:1777051522.841803:0:10113:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452727424 00000100:00100000:3.0:1777051522.841883:0:10113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5730 00000100:00100000:3.0:1777051522.841900:0:10113:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955612300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3680:x1863365452727424:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1777051522.841939:0:10113:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 515963584 pending 0 free 3860574208 avail 3629051904 00000100:00100000:3.0:1777051522.842022:0:10113:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955612300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3680:x1863365452727424:12345-0@lo:13:osp-pre-0-0.0 Request processed in 125us (2246us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051522.842037:0:10113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5730 00000100:00100000:3.0:1777051522.842066:0:10113:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452727296 00000100:00100000:3.0:1777051522.842072:0:10113:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452727296 00000100:00100000:3.0:1777051522.842125:0:10113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5731 00000100:00100000:3.0:1777051522.842139:0:10113:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3678:x1863365452727296:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1777051522.842166:0:10113:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 489208512 pending 0 free 3642707968 avail 3411185664 00000100:00100000:3.0:1777051522.842298:0:10113:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3678:x1863365452727296:12345-0@lo:13:osp-pre-1-0.0 Request processed in 159us (1545us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051522.842315:0:10113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5731 00000100:00100000:2.0:1777051522.842372:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d943d93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3678:1863365452727296:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1777051522.842638:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955612a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3680:1863365452727424:0@lo:13:osp-pre-0-0.0 00000001:00080000:0.0:1777051522.844575:0:8464:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0000: transno 4294968379 is committed 00000040:00080000:1.0:1777051522.967064:0:104226:0:(llog.c:801:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1777051522.967078:0:104226:0:(llog_cat.c:158:llog_cat_process_common()) processing log [0x1:0x12:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1777051522.967295:0:104226:0:(llog.c:858:llog_process_thread()) stop processing plain [0x1:0x12:0x0] index 10 count 1 00000040:00080000:1.0:1777051522.967310:0:104226:0:(llog.c:858:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:0.0:1777051523.222491:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1777051523.223089:0:109205:0:(llog.c:801:llog_process_thread()) index: 6, lh_last_idx: 7 synced_idx: 0 lgh_last_idx: 7 00000040:00080000:3.0:1777051523.223101:0:109205:0:(llog_cat.c:158:llog_cat_process_common()) processing log [0x1:0x2b:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1777051523.223142:0:109205:0:(llog.c:858:llog_process_thread()) stop processing plain [0x1:0x2b:0x0] index 12 count 3 00000040:00080000:3.0:1777051523.223162:0:109205:0:(llog.c:801:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:3.0:1777051523.223166:0:109205:0:(llog_cat.c:158:llog_cat_process_common()) processing log [0x1:0x31:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1777051523.223189:0:109205:0:(llog.c:858:llog_process_thread()) stop processing plain [0x1:0x31:0x0] index 2 count 2 00000040:00080000:3.0:1777051523.223230:0:109205:0:(llog.c:858:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 3 00000100:00100000:2.0:1777051524.011808:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051524.011897:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051524.011926:0:109181:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426128000 00000100:00100000:1.0:1777051524.011944:0:109181:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426128000 00000100:00100000:2.0:1777051524.012018:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051524.012023:0:6581:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426128256 00000100:00100000:3.0:1777051524.012038:0:6581:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426128256 00000100:00100000:1.0:1777051524.012040:0:109181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 91 00000100:00100000:1.0:1777051524.012066:0:109181:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7d979450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29c4352d-3260-4734-909d-9ea5de9e7fa4+12:2439:x1863365426128000:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:2.0:1777051524.012105:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051524.012192:0:109181:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7d979450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29c4352d-3260-4734-909d-9ea5de9e7fa4+12:2439:x1863365426128000:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 130us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051524.012199:0:6581:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426128768 00000100:00100000:3.0:1777051524.012213:0:6581:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426128768 00000100:00100000:2.0:1777051524.012214:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051524.012224:0:109181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 91 00000100:00100000:3.0:1777051524.012337:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13540 00000100:00100000:1.0:1777051524.012354:0:21368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13541 00000100:00100000:3.0:1777051524.012365:0:6581:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+9:2439:x1863365426128256:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:1.0:1777051524.012524:0:21368:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f97ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+54:2439:x1863365426128768:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:3.0:1777051524.012584:0:6581:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+9:2439:x1863365426128256:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 151us (608us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051524.012585:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051524.012603:0:21368:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f97ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+54:2439:x1863365426128768:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 102us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051524.012692:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051524.013655:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051524.013733:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051524.013789:0:46494:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426128128 00000100:00100000:2.0:1777051524.013799:0:46494:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426128128 00000100:00100000:3.0:1777051524.014363:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13540 00000100:00100000:1.0:1777051524.014385:0:21368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13541 00000100:00100000:3.0:1777051524.014442:0:6581:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426128640 00000100:00100000:3.0:1777051524.014453:0:6581:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426128640 00000100:00100000:1.0:1777051524.014478:0:21368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13542 00000100:00100000:1.0:1777051524.014503:0:21368:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f299f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+10:2439:x1863365426128128:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:2.0:1777051524.014522:0:8471:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426128512 00000100:00100000:2.0:1777051524.014535:0:8471:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426128512 00000100:00100000:3.0:1777051524.014552:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13543 00000100:00100000:3.0:1777051524.014578:0:6581:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f29b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+11:2439:x1863365426128640:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:1.0:1777051524.014594:0:21368:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f299f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+10:2439:x1863365426128128:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 97us (2018us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051524.014613:0:21368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13542 00000100:00100000:2.0:1777051524.014619:0:8471:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426129024 00000100:00100000:2.0:1777051524.014630:0:8471:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426129024 00000100:00100000:2.0:1777051524.014694:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10571 00000100:00100000:2.0:1777051524.014716:0:8471:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955506a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+30:2439:x1863365426128512:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:2.0:1777051524.014813:0:8471:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955506a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+30:2439:x1863365426128512:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 102us (2798us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051524.014832:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10571 00000100:00100000:2.0:1777051524.014862:0:8471:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426128384 00000100:00100000:2.0:1777051524.014869:0:8471:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426128384 00000100:00100000:2.0:1777051524.014925:0:8471:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426128896 00000100:00100000:2.0:1777051524.014933:0:8471:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426128896 00000100:00100000:1.0:1777051524.014965:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10572 00000100:00100000:1.0:1777051524.014986:0:8468:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f97ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+30:2439:x1863365426129024:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:2.0:1777051524.015049:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10573 00000100:00100000:1.0:1777051524.015053:0:8468:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f97ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+30:2439:x1863365426129024:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 70us (2846us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051524.015071:0:27887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10574 00000100:00100000:2.0:1777051524.015080:0:8471:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f298e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+30:2439:x1863365426128384:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:1.0:1777051524.015088:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10572 00000100:00100000:0.0:1777051524.015098:0:27887:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f298a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+32:2439:x1863365426128896:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:0.0:1777051524.015573:0:27887:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f298a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+32:2439:x1863365426128896:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 481us (1837us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051524.015589:0:27887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10574 00000100:00100000:3.0:1777051524.016108:0:6581:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f29b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+11:2439:x1863365426128640:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 1535us (2450us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051524.016129:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13543 00000100:00080000:3.0:1777051524.016243:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1777051524.016253:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1777051524.016260:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1777051524.016267:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1777051524.016455:0:8471:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f298e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+30:2439:x1863365426128384:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 112us (2489us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051524.016473:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10573 00010000:00010000:0.0:1777051524.246582:0:108751:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1777051524.886640:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955612a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3680:1863365452727552:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1777051524.886735:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051524.887156:0:8472:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452727552 00000100:00100000:3.0:1777051524.887170:0:8472:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452727552 00000100:00100000:3.0:1777051524.887807:0:8472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5732 00000100:00100000:3.0:1777051524.887825:0:8472:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955612680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3680:x1863365452727552:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1777051524.887865:0:8472:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 515963584 pending 0 free 3860574208 avail 3629051904 00000100:00100000:2.0:1777051524.888277:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f299180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452727680:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1777051524.888957:0:8472:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955612680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3680:x1863365452727552:12345-0@lo:13:osp-pre-0-1.0 Request processed in 1132us (2219us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051524.888972:0:8472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5732 00000100:00100000:0.0:1777051524.888982:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955612a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3680:1863365452727552:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1777051524.889002:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1777051524.889017:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1777051524.889101:0:47388:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452727680 00000100:00100000:3.0:1777051524.889111:0:47388:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452727680 00000100:00080000:2.0:1777051524.889178:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1777051524.889275:0:47388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5733 00000100:00100000:3.0:1777051524.889319:0:47388:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f299880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3677:x1863365452727680:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1777051524.889353:0:47388:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 489208512 pending 0 free 3642707968 avail 3411185664 00000100:00100000:3.0:1777051524.889456:0:47388:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f299880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3677:x1863365452727680:12345-0@lo:13:osp-pre-1-1.0 Request processed in 143us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051524.889475:0:47388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5733 00000100:00100000:2.0:1777051524.890902:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f299180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452727680:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1777051525.270667:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051526.297062:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051527.319098:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1777051527.402648:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051527.403207:0:6565:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426129152 00000100:00100000:2.0:1777051527.403221:0:6565:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426129152 00000100:00080000:0.0:1777051527.403312:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1777051527.403374:0:6565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13752 00000100:00100000:2.0:1777051527.403394:0:6565:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f42dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+32:2438:x1863365426129152:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1777051527.403416:0:6565:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 16 locks, starting at 0 00010000:00010000:2.0:1777051527.403468:0:6565:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a7af5138/0x85f51a6b96711b3c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x14f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5214 expref: 32 pid: 24468 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051527.403513:0:6565:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000954f6c79/0x85f51a6b96711aa9 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x14e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b51c0 expref: 31 pid: 8471 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051527.403548:0:6565:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002c14164a/0x85f51a6b96711975 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x14d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b515e expref: 30 pid: 27887 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051527.403587:0:6565:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006cbc74e6/0x85f51a6b96711921 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x14c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5134 expref: 29 pid: 24468 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051527.403649:0:6565:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009bfa4d50/0x85f51a6b96711d26 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x152:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5310 expref: 28 pid: 8471 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051527.403680:0:6565:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aa23818e/0x85f51a6b96711ca1 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x151:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b52ae expref: 27 pid: 55805 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051527.403709:0:6565:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f06027bb/0x85f51a6b96711c31 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x150:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b527d expref: 26 pid: 27887 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051527.403741:0:6565:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f927145d/0x85f51a6b96710c7f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x14a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b4cd4 expref: 25 pid: 8470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051527.403773:0:6565:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003ec80555/0x85f51a6b96710c2b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x149:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b4caa expref: 24 pid: 27887 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051527.403806:0:6565:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000089c2ad71/0x85f51a6b96710b59 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x148:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b4c41 expref: 23 pid: 8471 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051527.403834:0:6565:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000030b780ce/0x85f51a6b96710b05 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x147:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b4c17 expref: 22 pid: 13320 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051527.403864:0:6565:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008c5239c2/0x85f51a6b96710a72 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x146:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b4bbc expref: 21 pid: 13320 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051527.403892:0:6565:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001a9de4f4/0x85f51a6b9671093e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x145:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b4b5a expref: 20 pid: 27884 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051527.403929:0:6565:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f8c46b71/0x85f51a6b967108ea lrc: 0/0,0 mode: --/PR res: [0x280000401:0x144:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b4b30 expref: 19 pid: 8468 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051527.404032:0:6565:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f8a8e8f4/0x85f51a6b96710842 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x143:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b4ac7 expref: 18 pid: 8471 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051527.404084:0:6565:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008f6634e0/0x85f51a6b9670ff3c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x142:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b47b7 expref: 17 pid: 8470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051527.404103:0:6565:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1777051527.404261:0:6565:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f42dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+16:2438:x1863365426129152:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 868us (1619us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051527.404279:0:6565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13752 00000100:00100000:1.0:1777051527.446671:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f299180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3679:1863365452727936:0@lo:400:kworker.0 00000100:00100000:1.0:1777051527.446768:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051527.446817:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f298000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3677:1863365452728192:0@lo:400:kworker.0 00000100:00100000:1.0:1777051527.446859:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f299500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3679:1863365452728448:0@lo:400:kworker.0 00000100:00100000:2.0:1777051527.446886:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051527.446928:0:109186:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452727936 00000100:00100000:1.0:1777051527.446940:0:109186:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452727936 00000100:00100000:2.0:1777051527.446962:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f29a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452728704:0@lo:400:kworker.0 00000100:00100000:2.0:1777051527.447040:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051527.447048:0:109186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1777051527.447068:0:109186:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7d97b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f9351a01-5b0e-4470-97fd-58b9b4b312a2+23:3679:x1863365452727936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777051527.447086:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da444a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3677:1863365452729216:0@lo:400:kworker.0 00000100:00100000:2.0:1777051527.447146:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051527.447161:0:109186:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7d97b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f9351a01-5b0e-4470-97fd-58b9b4b312a2+23:3679:x1863365452727936:12345-0@lo:400:kworker.0 Request processed in 96us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051527.447177:0:109186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1777051527.447182:0:3677:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:2.0:1777051527.447236:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94f42ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3677:1863365452727808:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1777051527.447292:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051527.447318:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f29a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3680:1863365452728064:0@lo:400:kworker.0 00000100:00100000:2.0:1777051527.447332:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f29ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3677:1863365452728320:0@lo:400:kworker.0 00000100:00100000:2.0:1777051527.447394:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051527.447442:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f29bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452728832:0@lo:400:kworker.0 00000100:00100000:2.0:1777051527.447487:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051527.447518:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051527.447554:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f298380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3680:1863365452728576:0@lo:400:kworker.0 00000100:00100000:1.0:1777051527.447583:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051527.447605:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f299c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3680:1863365452729088:0@lo:400:kworker.0 00000100:00100000:1.0:1777051527.447634:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051527.447695:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da444a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3677:1863365452729344:0@lo:400:kworker.0 00000100:00100000:1.0:1777051527.447711:0:46500:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452727808 00000100:00100000:1.0:1777051527.447718:0:46500:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452727808 00000100:00100000:2.0:1777051527.447748:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051527.447766:0:46500:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452728576 00000100:00100000:1.0:1777051527.447771:0:46500:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452728576 00000100:00100000:1.0:1777051527.447809:0:46500:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452729088 00000100:00100000:1.0:1777051527.447815:0:46500:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452729088 00000100:00100000:1.0:1777051527.447863:0:46500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8367 00000100:00100000:1.0:1777051527.447879:0:46500:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da444a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+6:3677:x1863365452727808:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1777051527.447887:0:6580:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452728192 00000100:00100000:2.0:1777051527.447895:0:6580:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452728192 00000004:00000024:1.0:1777051527.447919:0:46500:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4194304 pending 0 free 1446141952 avail 1299902464 00000100:00100000:2.0:1777051527.447959:0:6580:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452728320 00000100:00100000:2.0:1777051527.447967:0:6580:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452728320 00000100:00100000:1.0:1777051527.447999:0:46500:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da444a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+6:3677:x1863365452727808:12345-0@lo:41:osp-pre-1-0.0 Request processed in 122us (705us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051527.448011:0:6580:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452728064 00000100:00100000:1.0:1777051527.448014:0:46500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8367 00000100:00100000:2.0:1777051527.448019:0:6580:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452728064 00000100:00100000:1.0:1777051527.448050:0:46500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8368 00000100:00100000:1.0:1777051527.448066:0:46500:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f42ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+7:3680:x1863365452728576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777051527.448085:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13544 00000100:00100000:2.0:1777051527.448104:0:6580:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da444a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3677:x1863365452728192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777051527.448148:0:46500:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f42ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+7:3680:x1863365452728576:12345-0@lo:400:kworker.0 Request processed in 82us (557us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051527.448162:0:46500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8368 00000100:00100000:2.0:1777051527.448183:0:6580:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da444a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3677:x1863365452728192:12345-0@lo:400:kworker.0 Request processed in 83us (1296us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051527.448200:0:46500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8369 00000100:00100000:2.0:1777051527.448200:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13544 00000100:00100000:1.0:1777051527.448229:0:46500:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f42d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+5:3680:x1863365452729088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777051527.448242:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13545 00000100:00100000:1.0:1777051527.448298:0:46500:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f42d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+5:3680:x1863365452729088:12345-0@lo:400:kworker.0 Request processed in 76us (658us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051527.448299:0:6580:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da444a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3677:x1863365452728320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777051527.448409:0:6580:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da444a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3677:x1863365452728320:12345-0@lo:400:kworker.0 Request processed in 118us (1013us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051527.448422:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13545 00000100:00100000:2.0:1777051527.448450:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13546 00000100:00100000:2.0:1777051527.448465:0:6580:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f42e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3680:x1863365452728064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777051527.448517:0:46500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8369 00000100:00100000:2.0:1777051527.448543:0:6580:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f42e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3680:x1863365452728064:12345-0@lo:400:kworker.0 Request processed in 80us (1024us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051527.448558:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13546 00000100:00100000:1.0:1777051527.448622:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f29a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3680:1863365452728064:0@lo:400:kworker.0 00000100:00100000:1.0:1777051527.448648:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f298380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3680:1863365452728576:0@lo:400:kworker.0 00000100:00100000:3.0:1777051527.448656:0:55805:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452728704 00000100:00100000:3.0:1777051527.448667:0:55805:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452728704 00000100:00100000:1.0:1777051527.448679:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f299c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3680:1863365452729088:0@lo:400:kworker.0 00000100:00100000:3.0:1777051527.448744:0:55805:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452729216 00000100:00100000:3.0:1777051527.448752:0:55805:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452729216 00000100:00100000:1.0:1777051527.448776:0:27887:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452728832 00000100:00100000:1.0:1777051527.448785:0:27887:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452728832 00000100:00100000:3.0:1777051527.448809:0:55805:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452729344 00000100:00100000:3.0:1777051527.448817:0:55805:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452729344 00000100:00100000:1.0:1777051527.448865:0:27887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10575 00000100:00100000:3.0:1777051527.448888:0:55805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10576 00000100:00100000:1.0:1777051527.448892:0:27887:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da444a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3677:x1863365452728704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051527.448905:0:55805:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da444a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3677:x1863365452729216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777051527.449020:0:27887:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da444a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3677:x1863365452728704:12345-0@lo:400:kworker.0 Request processed in 137us (1976us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051527.449022:0:55805:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da444a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3677:x1863365452729216:12345-0@lo:400:kworker.0 Request processed in 120us (1873us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051527.449041:0:27887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10575 00000100:00100000:1.0:1777051527.449085:0:27887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10577 00000100:00100000:3.0:1777051527.449101:0:55805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10576 00000100:00100000:1.0:1777051527.449110:0:27887:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da444a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3677:x1863365452728832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051527.449149:0:55805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10578 00000100:00100000:3.0:1777051527.449169:0:55805:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da444a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3677:x1863365452729344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777051527.449260:0:27887:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da444a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3677:x1863365452728832:12345-0@lo:400:kworker.0 Request processed in 100us (1707us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051527.449275:0:27887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10577 00000100:00100000:3.0:1777051527.449283:0:55805:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da444a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3677:x1863365452729344:12345-0@lo:400:kworker.0 Request processed in 118us (1532us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051527.449297:0:55805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10578 00000100:00100000:1.0:1777051527.449407:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94f42c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3680:1863365452729600:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1777051527.449460:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051527.449492:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051527.449544:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f298700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3679:1863365452728960:0@lo:400:kworker.0 00000100:00100000:3.0:1777051527.449550:0:46500:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452729600 00000100:00100000:3.0:1777051527.449557:0:46500:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452729600 00000100:00080000:1.0:1777051527.449559:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1777051527.449569:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1777051527.449576:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1777051527.449583:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1777051527.449595:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051527.449608:0:46500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8370 00000100:00100000:3.0:1777051527.449624:0:46500:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f42fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+7:3680:x1863365452729600:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1777051527.449639:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da444a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3679:1863365452729472:0@lo:400:kworker.0 00000100:00100000:1.0:1777051527.449656:0:10328:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452728448 00000004:00000024:3.0:1777051527.449656:0:46500:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4194304 pending 0 free 1441533952 avail 1295294464 00000100:00100000:1.0:1777051527.449669:0:10328:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452728448 00000100:00100000:2.0:1777051527.449679:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051527.449725:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f299180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3679:1863365452727936:0@lo:400:kworker.0 00000100:00100000:3.0:1777051527.449727:0:46500:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f42fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+7:3680:x1863365452729600:12345-0@lo:41:osp-pre-0-1.0 Request processed in 108us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051527.449741:0:46500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8370 00000100:00100000:1.0:1777051527.449756:0:10328:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452728960 00000100:00100000:1.0:1777051527.449765:0:10328:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452728960 00000100:00100000:3.0:1777051527.449784:0:6581:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452729472 00000100:00100000:3.0:1777051527.449793:0:6581:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452729472 00000100:00100000:2.0:1777051527.449805:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94f42ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3677:1863365452727808:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1777051527.449821:0:10328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13547 00000100:00100000:2.0:1777051527.449830:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f29ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3677:1863365452728320:0@lo:400:kworker.0 00000100:00100000:1.0:1777051527.449843:0:10328:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da444a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3679:x1863365452728448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777051527.449854:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f29bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452728832:0@lo:400:kworker.0 00000100:00100000:3.0:1777051527.449868:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13548 00000100:00100000:2.0:1777051527.449873:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da444a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3677:1863365452729344:0@lo:400:kworker.0 00000100:00100000:3.0:1777051527.449883:0:6581:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da444a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3679:x1863365452728960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777051527.449891:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f298000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3677:1863365452728192:0@lo:400:kworker.0 00000100:00100000:2.0:1777051527.449913:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f29a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452728704:0@lo:400:kworker.0 00000100:00100000:2.0:1777051527.449933:0:3677:0:(client.c:3101:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968379 gen 2 00000004:00080000:2.0:1777051527.449940:0:3677:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 4294968378 committed transno 4294968379 00000100:00100000:1.0:1777051527.449945:0:10328:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da444a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3679:x1863365452728448:12345-0@lo:400:kworker.0 Request processed in 107us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051527.449960:0:6581:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da444a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3679:x1863365452728960:12345-0@lo:400:kworker.0 Request processed in 77us (363us total) trans 0 rc 0/0 00000004:00080000:2.0:1777051527.449963:0:3677:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff99d943d91c00, transno 4294968379 00000100:00100000:1.0:1777051527.449971:0:10328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13547 00000100:00100000:3.0:1777051527.449987:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13548 00000100:00100000:1.0:1777051527.450015:0:10328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13549 00000100:00100000:2.0:1777051527.450035:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da444a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3677:1863365452729216:0@lo:400:kworker.0 00000100:00100000:1.0:1777051527.450038:0:10328:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da444a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3679:x1863365452729472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777051527.450114:0:10328:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da444a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3679:x1863365452729472:12345-0@lo:400:kworker.0 Request processed in 86us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051527.450129:0:10328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13549 00000100:00100000:2.0:1777051527.450169:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94f42c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3680:1863365452729600:0@lo:41:osp-pre-0-1.0 00000100:00080000:1.0:1777051527.450172:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1777051527.450296:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f299500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3679:1863365452728448:0@lo:400:kworker.0 00000100:00100000:1.0:1777051527.450319:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f298700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3679:1863365452728960:0@lo:400:kworker.0 00000100:00100000:1.0:1777051527.450378:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da444a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3679:1863365452729472:0@lo:400:kworker.0 00000001:00080000:3.0:1777051527.452981:0:109175:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 34359738406 is committed 00000020:00080000:3.0:1777051527.452998:0:109175:0:(update_trans.c:1333:distribute_txn_batchid_cb()) lustre-MDT0000: 30064771260 batchid updated 00000020:00080000:1.0:1777051527.453151:0:109209:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 30064771260 00000020:00080000:1.0:1777051527.453169:0:109209:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 30064771260 00000100:00100000:2.0:1777051527.958816:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d943d91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3677:1863365452729728:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1777051527.958909:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051527.959014:0:8473:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452729728 00000100:00100000:1.0:1777051527.959027:0:8473:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452729728 00000100:00100000:1.0:1777051527.959115:0:8473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5734 00000100:00100000:1.0:1777051527.959136:0:8473:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da444a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3677:x1863365452729728:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1777051527.959181:0:8473:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 489208512 pending 0 free 3642707968 avail 3411185664 00000100:00100000:3.0:1777051527.959655:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d943d91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3678:1863365452729856:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1777051527.959669:0:8473:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da444a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3677:x1863365452729728:12345-0@lo:13:osp-pre-1-0.0 Request processed in 535us (754us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051527.959685:0:8473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5734 00000100:00100000:3.0:1777051527.959723:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051527.959794:0:10113:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452729856 00000100:00100000:3.0:1777051527.959803:0:10113:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452729856 00000100:00100000:3.0:1777051527.959859:0:10113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5735 00000100:00100000:3.0:1777051527.959874:0:10113:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d943d92a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3678:x1863365452729856:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1777051527.959907:0:10113:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 515963584 pending 0 free 3860574208 avail 3629051904 00000100:00100000:3.0:1777051527.959984:0:10113:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d943d92a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3678:x1863365452729856:12345-0@lo:13:osp-pre-0-0.0 Request processed in 112us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051527.959996:0:10113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5735 00000100:00100000:1.0:1777051527.960497:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d943d91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3678:1863365452729856:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1777051527.960712:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d943d91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3677:1863365452729728:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1777051528.125103:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051528.125282:0:46494:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426129280 00000100:00100000:2.0:1777051528.125298:0:46494:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426129280 00000100:00080000:1.0:1777051528.125398:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1777051528.125574:0:46494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112484 00000100:00100000:2.0:1777051528.125595:0:46494:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f42c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c11b6966-0775-44d2-bdc6-c74c26eb2226+10:140919:x1863365426129280:12345-192.168.201.46@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1777051528.125742:0:46494:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f42c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c11b6966-0775-44d2-bdc6-c74c26eb2226+10:140919:x1863365426129280:12345-192.168.201.46@tcp:60:lhsmtool_posix.0 Request processed in 152us (649us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051528.125758:0:46494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112484 00000100:00100000:1.0:1777051528.131550:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051528.131744:0:27885:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426129408 00000100:00100000:2.0:1777051528.131754:0:27885:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426129408 00000100:00100000:2.0:1777051528.131948:0:27885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112485 00000100:00100000:2.0:1777051528.131966:0:27885:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f42c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c11b6966-0775-44d2-bdc6-c74c26eb2226+9:140919:x1863365426129408:12345-192.168.201.46@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1777051528.132090:0:27885:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f42c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c11b6966-0775-44d2-bdc6-c74c26eb2226+9:140919:x1863365426129408:12345-192.168.201.46@tcp:60:lhsmtool_posix.0 Request processed in 126us (544us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051528.132114:0:27885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112485 00000100:00080000:1.0:1777051528.135651:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1777051528.138427:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051528.138585:0:46501:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426129664 00000100:00100000:0.0:1777051528.138596:0:46501:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426129664 00000100:00100000:0.0:1777051528.138684:0:46501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3443 00000100:00100000:0.0:1777051528.138700:0:46501:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da444a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+10:140919:x1863365426129664:12345-192.168.201.46@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1777051528.139390:0:46501:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da444a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+11:140919:x1863365426129664:12345-192.168.201.46@tcp:35:lhsmtool_posix.0 Request processed in 690us (963us total) trans 34359738407 rc 0/0 00000100:00100000:0.0:1777051528.139405:0:46501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3443 00010000:00010000:0.0:1777051528.342587:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777051529.123973:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051529.124048:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051529.124485:0:8471:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426130048 00000100:00100000:3.0:1777051529.124492:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051529.124503:0:8471:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426130048 00000100:00100000:3.0:1777051529.124585:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051529.125559:0:6581:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426130304 00000100:00100000:0.0:1777051529.125571:0:6581:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426130304 00000100:00100000:2.0:1777051529.125747:0:109184:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426129792 00000100:00100000:2.0:1777051529.125757:0:109184:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426129792 00000100:00100000:2.0:1777051529.125824:0:109184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 93 00000100:00100000:2.0:1777051529.126557:0:109184:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7d979850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:29c4352d-3260-4734-909d-9ea5de9e7fa4+12:2439:x1863365426129792:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:1.0:1777051529.126561:0:8471:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426130560 00000100:00100000:1.0:1777051529.126577:0:8471:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426130560 00000100:00100000:3.0:1777051529.126586:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051529.126663:0:8471:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426129920 00000100:00100000:1.0:1777051529.126673:0:8471:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426129920 00000100:00100000:3.0:1777051529.126674:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051529.126702:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13550 00000100:00100000:2.0:1777051529.126705:0:109184:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7d979850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:29c4352d-3260-4734-909d-9ea5de9e7fa4+12:2439:x1863365426129792:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 853us (2731us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051529.126731:0:109184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 93 00000100:00100000:0.0:1777051529.126744:0:6581:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d943d91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+54:2439:x1863365426130304:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:1.0:1777051529.126785:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10579 00000100:00100000:1.0:1777051529.126813:0:8471:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d943d91c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+30:2439:x1863365426130048:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:0.0:1777051529.126840:0:6581:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d943d91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+54:2439:x1863365426130304:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 111us (2348us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051529.126859:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13550 00000100:00100000:2.0:1777051529.126887:0:55805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10580 00000100:00100000:0.0:1777051529.126907:0:6581:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426130176 00000100:00100000:0.0:1777051529.126919:0:6581:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426130176 00000100:00100000:2.0:1777051529.126920:0:55805:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da57c83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+30:2439:x1863365426130560:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:1.0:1777051529.126925:0:8471:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d943d91c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+30:2439:x1863365426130048:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 112us (2864us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051529.126956:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10579 00000100:00100000:0.0:1777051529.127016:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13551 00000100:00100000:1.0:1777051529.127020:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10581 00000100:00100000:2.0:1777051529.127051:0:55805:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da57c83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+30:2439:x1863365426130560:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 137us (2456us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051529.127053:0:6581:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d943d93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+10:2439:x1863365426130176:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:1.0:1777051529.127056:0:8471:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d943d91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+30:2439:x1863365426129920:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:2.0:1777051529.127091:0:55805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10580 00000100:00100000:0.0:1777051529.127147:0:6581:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d943d93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+10:2439:x1863365426130176:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 108us (477us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051529.127167:0:8471:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d943d91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+30:2439:x1863365426129920:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 120us (584us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051529.127172:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13551 00000100:00100000:1.0:1777051529.127250:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10581 00000100:00100000:3.0:1777051529.127251:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051529.127309:0:8471:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426130432 00000100:00100000:1.0:1777051529.127350:0:8471:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426130432 00000100:00100000:3.0:1777051529.127444:0:27887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10582 00000100:00100000:3.0:1777051529.127473:0:27887:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d943d92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+16:2439:x1863365426130432:12345-192.168.201.46@tcp:400:kworker.0 00000100:00080000:1.0:1777051529.127569:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1777051529.127569:0:27887:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d943d92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+16:2439:x1863365426130432:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 104us (323us total) trans 0 rc 0/0 00000100:00080000:1.0:1777051529.127585:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1777051529.127593:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1777051529.127626:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1777051529.131768:0:27887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10582 00010000:00010000:0.0:1777051529.366573:0:108751:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1777051530.006563:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d943d93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452729984:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1777051530.006654:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051530.006746:0:3679:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1777051530.006758:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955612a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452730112:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1777051530.006793:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051530.006870:0:8473:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452729984 00000100:00100000:1.0:1777051530.006883:0:8473:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452729984 00000100:00100000:1.0:1777051530.006975:0:8473:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452730112 00000100:00080000:2.0:1777051530.006980:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1777051530.006982:0:8473:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452730112 00000100:00080000:2.0:1777051530.007035:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1777051530.007050:0:8473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5736 00000100:00100000:1.0:1777051530.007067:0:8473:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da444a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3679:x1863365452729984:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1777051530.007106:0:8473:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 489208512 pending 0 free 3642707968 avail 3411185664 00000100:00100000:1.0:1777051530.007181:0:8473:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da444a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3679:x1863365452729984:12345-0@lo:13:osp-pre-1-1.0 Request processed in 119us (528us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051530.007194:0:8473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5736 00000100:00100000:1.0:1777051530.007228:0:8473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5737 00000100:00100000:1.0:1777051530.007244:0:8473:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da444a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3679:x1863365452730112:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1777051530.007285:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d943d93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452729984:0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1777051530.007342:0:8473:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 515963584 pending 0 free 3860574208 avail 3629051904 00000100:00100000:1.0:1777051530.007415:0:8473:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da444a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3679:x1863365452730112:12345-0@lo:13:osp-pre-0-1.0 Request processed in 174us (619us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051530.007430:0:8473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5737 00000100:00100000:2.0:1777051530.007471:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955612a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452730112:0@lo:13:osp-pre-0-1.0 00000001:02000400:0.0:1777051530.013189:0:110335:0:(debug.c:645:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-hsm test 409a: Coordinator should not stop when in use ========================================================== 13:25:28 (1777051528) 00000100:00100000:0.0:1777051530.117634:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051530.117789:0:8492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426130688 00000100:00100000:1.0:1777051530.117805:0:8492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426130688 00000100:00100000:1.0:1777051530.117911:0:8492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112486 00000100:00100000:1.0:1777051530.117931:0:8492:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955613100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+10:141727:x1863365426130688:12345-192.168.201.46@tcp:101:lfs.0 00010000:00010000:1.0:1777051530.117960:0:8492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777051530.117990:0:8492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502db400/0x85f51a6b96717e0e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6b51 expref: -99 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051530.118078:0:8492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502db200/0x85f51a6b96717e15 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051530.118425:0:8492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502db200/0x85f51a6b96717e15 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051530.118448:0:8492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502db200/0x85f51a6b96717e15 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051530.118473:0:8492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502da800/0x85f51a6b96717e1c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5d66f174 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051530.118487:0:8492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502da800/0x85f51a6b96717e1c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5d66f174 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051530.118501:0:8492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502da800/0x85f51a6b96717e1c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5d66f174 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051530.119137:0:8492:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502db200/0x85f51a6b96717e15 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051530.119153:0:8492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502db200/0x85f51a6b96717e15 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051530.119165:0:8492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502db200/0x85f51a6b96717e15 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051530.119177:0:8492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502db200/0x85f51a6b96717e15 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051530.119188:0:8492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d9502db200 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:1.0:1777051530.119193:0:8492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502db200/0x85f51a6b96717e15 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051530.119206:0:8492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502db200/0x85f51a6b96717e15 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051530.119226:0:8492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d9413d0800) 00010000:00010000:1.0:1777051530.119231:0:8492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777051530.119238:0:8492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502db200/0x85f51a6b96717e15 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051530.119248:0:8492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502db200/0x85f51a6b96717e15 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051530.119267:0:8492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502da800/0x85f51a6b96717e1c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5d66f174 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051530.119277:0:8492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502da800/0x85f51a6b96717e1c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5d66f174 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051530.119286:0:8492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502da800/0x85f51a6b96717e1c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5d66f174 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051530.119294:0:8492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d9502da800 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:1.0:1777051530.119298:0:8492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502da800/0x85f51a6b96717e1c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5d66f174 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051530.119337:0:8492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502da800/0x85f51a6b96717e1c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5d66f174 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051530.119378:0:8492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5d66f174 (ffff99d94e592a00) 00010000:00010000:1.0:1777051530.119383:0:8492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777051530.119388:0:8492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502da800/0x85f51a6b96717e1c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5d66f174 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051530.119399:0:8492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502da800/0x85f51a6b96717e1c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5d66f174 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051530.119455:0:8492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502db400/0x85f51a6b96717e0e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6b51 expref: 11 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051530.119473:0:8492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d9413d0800) 00010000:00010000:1.0:1777051530.119477:0:8492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777051530.119483:0:8492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502db400/0x85f51a6b96717e0e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6b51 expref: 11 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051530.119498:0:8492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d9502db400, rc 0) 00000100:00100000:1.0:1777051530.119580:0:8492:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955613100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+10:141727:x1863365426130688:12345-192.168.201.46@tcp:101:lfs.0 Request processed in 1653us (1957us total) trans 0 rc 301/301 00000100:00100000:1.0:1777051530.119595:0:8492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112486 00000100:00100000:2.0:1777051530.129091:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051530.129355:0:21368:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426130816 00000100:00100000:3.0:1777051530.129369:0:21368:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426130816 00000100:00080000:0.0:1777051530.129470:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1777051530.129483:0:21368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112487 00000100:00100000:3.0:1777051530.129502:0:21368:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da444a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+11:141727:x1863365426130816:12345-192.168.201.46@tcp:101:lfs.0 00010000:00010000:3.0:1777051530.129556:0:21368:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777051530.129586:0:21368:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cec00/0x85f51a6b96717e23 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6b58 expref: -99 pid: 21368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051530.129672:0:21368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce600/0x85f51a6b96717e2a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051530.129694:0:21368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce600/0x85f51a6b96717e2a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051530.129711:0:21368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce600/0x85f51a6b96717e2a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1777051530.129799:0:21368:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 12288 00000004:00200000:3.0:1777051530.129806:0:21368:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1777051530.129841:0:21368:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce600/0x85f51a6b96717e2a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051530.129880:0:21368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cec00/0x85f51a6b96717e23 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6b58 expref: 13 pid: 21368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051530.129906:0:21368:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce600/0x85f51a6b96717e2a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6b58 expref: 12 pid: 21368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051530.129919:0:21368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d9413d0800) 00010000:00010000:3.0:1777051530.129923:0:21368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1777051530.129929:0:21368:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99da7d5ce600, rc 0) 00000100:00100000:3.0:1777051530.130011:0:21368:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da444a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+12:141727:x1863365426130816:12345-192.168.201.46@tcp:101:lfs.0 Request processed in 513us (931us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051530.130024:0:21368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112487 00000100:00100000:0.0:1777051530.137658:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051530.137991:0:6579:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426131072 00000100:00100000:3.0:1777051530.138003:0:6579:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426131072 00000100:00100000:3.0:1777051530.138083:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112488 00000100:00100000:3.0:1777051530.138448:0:6579:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955612a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+10:141727:x1863365426131072:12345-192.168.201.46@tcp:36:lfs.0 00010000:00010000:3.0:1777051530.138521:0:6579:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777051530.138553:0:6579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162e800/0x85f51a6b96717d58 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6b19 expref: 10 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051530.138580:0:6579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d9413d0800) 00010000:00010000:3.0:1777051530.138587:0:6579:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1777051530.138680:0:6579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cec00/0x85f51a6b96717e31 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051530.138702:0:6579:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce600/0x85f51a6b96717e2a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6b58 expref: 11 pid: 21368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051530.138718:0:6579:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cec00/0x85f51a6b96717e31 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051530.138768:0:6579:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce600/0x85f51a6b96717e2a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6b58 expref: 11 pid: 21368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051530.138790:0:6579:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce600/0x85f51a6b96717e2a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6b58 expref: 11 pid: 21368 timeout: 8259 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051530.138814:0:6579:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d943d91880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6579:1863365452730240:192.168.201.46@tcp:104: 00000100:00100000:3.0:1777051530.138932:0:6579:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d941b0f000 going to sleep for 11 seconds 00000100:00100000:3.0:1777051530.143877:0:6579:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d943d91880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6579:1863365452730240:192.168.201.46@tcp:104: 00010000:00010000:3.0:1777051530.143912:0:6579:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cec00/0x85f51a6b96717e31 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051530.146711:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051530.147981:0:9550:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426131200 00000100:00100000:2.0:1777051530.147993:0:9550:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426131200 00010000:00010000:2.0:1777051530.148049:0:9550:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce600/0x85f51a6b96717e2a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6b58 expref: 12 pid: 21368 timeout: 8259 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051530.148203:0:9550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3987 00000100:00100000:2.0:1777051530.148225:0:9550:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fd61c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+12:2437:x1863365426131200:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1777051530.148247:0:9550:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777051530.148291:0:9550:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce600/0x85f51a6b96717e2a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6b58 expref: 12 pid: 21368 timeout: 8259 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051530.148346:0:9550:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce600/0x85f51a6b96717e2a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6b58 expref: 12 pid: 21368 timeout: 8259 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051530.148381:0:9550:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce600/0x85f51a6b96717e2a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6b58 expref: 12 pid: 21368 timeout: 8259 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051530.148430:0:9550:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d9413d0800) 00010000:00010000:2.0:1777051530.148439:0:9550:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cec00/0x85f51a6b96717e31 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051530.148456:0:9550:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cec00/0x85f51a6b96717e31 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051530.148472:0:9550:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cec00/0x85f51a6b96717e31 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051530.148523:0:9550:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1777051530.148583:0:6579:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cec00/0x85f51a6b96717e31 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051530.148599:0:9550:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fd61c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+11:2437:x1863365426131200:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 376us (1890us total) trans 0 rc 0/0 00010000:00010000:3.0:1777051530.148611:0:6579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cec00/0x85f51a6b96717e31 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051530.148623:0:9550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3987 00010000:00010000:3.0:1777051530.148660:0:6579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cf000/0x85f51a6b96717e38 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x5d66f174 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051530.148678:0:6579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cf000/0x85f51a6b96717e38 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x5d66f174 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051530.148696:0:6579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cf000/0x85f51a6b96717e38 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x5d66f174 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051530.150174:0:6579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce200/0x85f51a6b96717e3f lrc: 3/0,1 mode: --/PW res: [0x2000032e2:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051530.150193:0:6579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce200/0x85f51a6b96717e3f lrc: 3/0,1 mode: PW/PW res: [0x2000032e2:0xe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051530.150249:0:6579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce200/0x85f51a6b96717e3f lrc: 3/0,1 mode: PW/PW res: [0x2000032e2:0xe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777051530.150276:0:6579:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000146d261f reply state 00000000d87db443 transno 34359738408 ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce200/0x85f51a6b96717e3f lrc: 3/0,1 mode: PW/PW res: [0x2000032e2:0xe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051530.150295:0:6579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce200/0x85f51a6b96717e3f lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e2:0xe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051530.150342:0:6579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0xe:0x0].0x0 (ffff99d9413d2100) 00010000:00010000:3.0:1777051530.150348:0:6579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1777051530.150354:0:6579:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1777051530.150363:0:6579:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000032e2:0xe:0x0]: returning size 4096 00010000:00010000:3.0:1777051530.150375:0:6579:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cec00/0x85f51a6b96717e31 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051530.150390:0:6579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cec00/0x85f51a6b96717e31 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051530.150402:0:6579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cec00/0x85f51a6b96717e31 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051530.150415:0:6579:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cec00/0x85f51a6b96717e31 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051530.150428:0:6579:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da7d5cec00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:3.0:1777051530.150435:0:6579:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cec00/0x85f51a6b96717e31 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051530.150449:0:6579:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cec00/0x85f51a6b96717e31 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051530.150468:0:6579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d9413d0800) 00010000:00010000:3.0:1777051530.150474:0:6579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777051530.150481:0:6579:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cec00/0x85f51a6b96717e31 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051530.150493:0:6579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cec00/0x85f51a6b96717e31 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777051530.150514:0:6579:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000146d261f reply state 00000000d87db443 transno 34359738408 ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cf000/0x85f51a6b96717e38 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x5d66f174 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051530.150530:0:6579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cf000/0x85f51a6b96717e38 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5d66f174 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051530.150543:0:6579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5d66f174 (ffff99d9413d2d00) 00010000:00010000:3.0:1777051530.150548:0:6579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1777051530.150552:0:6579:0:(service.c:177:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1777051530.150645:0:6579:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955612a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+11:141727:x1863365426131072:12345-192.168.201.46@tcp:36:lfs.0 Request processed in 12546us (12988us total) trans 34359738408 rc 0/0 00000100:00100000:3.0:1777051530.150659:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112488 00000100:00100000:0.0:1777051530.203707:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051530.204059:0:46497:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426131328 00000100:00100000:3.0:1777051530.204073:0:46497:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426131328 00000100:00100000:3.0:1777051530.204155:0:46497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112489 00000100:00100000:3.0:1777051530.204170:0:46497:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fd60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:c11b6966-0775-44d2-bdc6-c74c26eb2226+11:141737:x1863365426131328:12345-192.168.201.46@tcp:101:mkdir.0 00010000:00010000:3.0:1777051530.204198:0:46497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777051530.204227:0:46497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cec00/0x85f51a6b96717e46 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6b5f expref: -99 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051530.204349:0:46497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce600/0x85f51a6b96717e4d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051530.204370:0:46497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce600/0x85f51a6b96717e4d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051530.204388:0:46497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce600/0x85f51a6b96717e4d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1777051530.204440:0:46497:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 12288 00000004:00200000:3.0:1777051530.204446:0:46497:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1777051530.204495:0:46497:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce600/0x85f51a6b96717e4d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051530.204531:0:46497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cec00/0x85f51a6b96717e46 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6b5f expref: 13 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051530.204555:0:46497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce600/0x85f51a6b96717e4d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6b5f expref: 12 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051530.204568:0:46497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d9413d0800) 00010000:00010000:3.0:1777051530.204572:0:46497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1777051530.204578:0:46497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99da7d5ce600, rc 0) 00000100:00100000:3.0:1777051530.204663:0:46497:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fd60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:c11b6966-0775-44d2-bdc6-c74c26eb2226+12:141737:x1863365426131328:12345-192.168.201.46@tcp:101:mkdir.0 Request processed in 495us (964us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051530.204740:0:46497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112489 00000100:00100000:1.0:1777051530.220512:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051530.220599:0:10328:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426131456 00000100:00100000:2.0:1777051530.220613:0:10328:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426131456 00000100:00100000:2.0:1777051530.220690:0:10328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112490 00000100:00100000:2.0:1777051530.220708:0:10328:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f42ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+12:2436:x1863365426131456:12345-192.168.201.46@tcp:41:mkdir.0 00000004:00000024:2.0:1777051530.221029:0:10328:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4194304 pending 0 free 1441529856 avail 1295290368 00000100:00100000:2.0:1777051530.221133:0:10328:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f42ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+12:2436:x1863365426131456:12345-192.168.201.46@tcp:41:mkdir.0 Request processed in 428us (627us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051530.221148:0:10328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112490 00000100:00100000:2.0:1777051530.227390:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051530.227445:0:27882:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426131712 00000100:00100000:2.0:1777051530.227455:0:27882:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426131712 00000100:00100000:2.0:1777051530.227523:0:27882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112491 00000100:00100000:2.0:1777051530.227541:0:27882:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da444a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+12:141737:x1863365426131712:12345-192.168.201.46@tcp:36:mkdir.0 00010000:00010000:2.0:1777051530.227608:0:27882:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777051530.227646:0:27882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce600/0x85f51a6b96717e4d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6b5f expref: 12 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051530.227674:0:27882:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d9413d0800) 00010000:00010000:2.0:1777051530.227682:0:27882:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1777051530.228470:0:27882:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da444a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+11:141737:x1863365426131712:12345-192.168.201.46@tcp:36:mkdir.0 Request processed in 933us (1086us total) trans 0 rc -17/-17 00000100:00100000:2.0:1777051530.228485:0:27882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112491 00000100:00100000:2.0:1777051530.236057:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051530.236156:0:46494:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426131840 00000100:00100000:3.0:1777051530.236171:0:46494:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426131840 00000100:00100000:3.0:1777051530.236259:0:46494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112492 00000100:00100000:3.0:1777051530.236273:0:46494:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da444a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c11b6966-0775-44d2-bdc6-c74c26eb2226+11:141737:x1863365426131840:12345-192.168.201.46@tcp:101:mkdir.0 00010000:00010000:3.0:1777051530.236298:0:46494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777051530.236355:0:46494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cec00/0x85f51a6b96717e54 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6b66 expref: -99 pid: 46494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051530.236755:0:46494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cf600/0x85f51a6b96717e5b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051530.236775:0:46494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cf600/0x85f51a6b96717e5b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051530.236799:0:46494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cf600/0x85f51a6b96717e5b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1777051530.236851:0:46494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 12288 00000004:00200000:3.0:1777051530.236856:0:46494:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1777051530.236883:0:46494:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cf600/0x85f51a6b96717e5b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051530.236915:0:46494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cec00/0x85f51a6b96717e54 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6b66 expref: 13 pid: 46494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051530.236939:0:46494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cf600/0x85f51a6b96717e5b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6b66 expref: 12 pid: 46494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051530.236953:0:46494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d9413d0800) 00010000:00010000:3.0:1777051530.236958:0:46494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1777051530.236962:0:46494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99da7d5cf600, rc 0) 00000100:00100000:3.0:1777051530.237067:0:46494:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da444a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c11b6966-0775-44d2-bdc6-c74c26eb2226+12:141737:x1863365426131840:12345-192.168.201.46@tcp:101:mkdir.0 Request processed in 796us (1020us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051530.237078:0:46494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112492 00000100:00100000:2.0:1777051530.252441:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051530.252803:0:27885:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426131968 00000100:00100000:3.0:1777051530.252817:0:27885:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426131968 00000100:00100000:3.0:1777051530.252908:0:27885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112493 00000100:00100000:3.0:1777051530.252926:0:27885:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da444a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c11b6966-0775-44d2-bdc6-c74c26eb2226+12:141737:x1863365426131968:12345-192.168.201.46@tcp:101:mkdir.0 00010000:00010000:3.0:1777051530.252952:0:27885:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777051530.252981:0:27885:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cec00/0x85f51a6b96717e62 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6b6d expref: -99 pid: 27885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051530.253406:0:27885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce000/0x85f51a6b96717e69 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051530.253433:0:27885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce000/0x85f51a6b96717e69 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051530.253454:0:27885:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce000/0x85f51a6b96717e69 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051530.253478:0:27885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cea00/0x85f51a6b96717e70 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5d66f174 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051530.253491:0:27885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cea00/0x85f51a6b96717e70 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5d66f174 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051530.253505:0:27885:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cea00/0x85f51a6b96717e70 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5d66f174 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051530.253609:0:27885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cfc00/0x85f51a6b96717e77 lrc: 3/1,0 mode: --/PR res: [0x2000032e2:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051530.253626:0:27885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cfc00/0x85f51a6b96717e77 lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0xe:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051530.253642:0:27885:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cfc00/0x85f51a6b96717e77 lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0xe:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1777051530.253691:0:27885:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000032e2:0xe:0x0]: returning size 4096 00000004:00200000:3.0:1777051530.253698:0:27885:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1777051530.254020:0:27885:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cfc00/0x85f51a6b96717e77 lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0xe:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051530.254047:0:27885:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce000/0x85f51a6b96717e69 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051530.254060:0:27885:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce000/0x85f51a6b96717e69 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051530.254071:0:27885:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce000/0x85f51a6b96717e69 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051530.254083:0:27885:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce000/0x85f51a6b96717e69 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051530.254094:0:27885:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da7d5ce000 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:3.0:1777051530.254101:0:27885:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce000/0x85f51a6b96717e69 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051530.254113:0:27885:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce000/0x85f51a6b96717e69 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051530.254133:0:27885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d9413d0800) 00010000:00010000:3.0:1777051530.254140:0:27885:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777051530.254147:0:27885:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce000/0x85f51a6b96717e69 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051530.254158:0:27885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce000/0x85f51a6b96717e69 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051530.254180:0:27885:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cea00/0x85f51a6b96717e70 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5d66f174 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051530.254191:0:27885:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cea00/0x85f51a6b96717e70 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5d66f174 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051530.254251:0:27885:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cea00/0x85f51a6b96717e70 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5d66f174 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051530.254262:0:27885:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da7d5cea00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:3.0:1777051530.254269:0:27885:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cea00/0x85f51a6b96717e70 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5d66f174 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051530.254280:0:27885:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cea00/0x85f51a6b96717e70 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5d66f174 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051530.254295:0:27885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5d66f174 (ffff99d9413d2d00) 00010000:00010000:3.0:1777051530.254330:0:27885:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777051530.254337:0:27885:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cea00/0x85f51a6b96717e70 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5d66f174 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051530.254349:0:27885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cea00/0x85f51a6b96717e70 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5d66f174 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051530.254393:0:27885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cec00/0x85f51a6b96717e62 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6b6d expref: 14 pid: 27885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051530.254419:0:27885:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cfc00/0x85f51a6b96717e77 lrc: 3/0,0 mode: PR/PR res: [0x2000032e2:0xe:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6b6d expref: 13 pid: 27885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051530.254433:0:27885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0xe:0x0].0x0 (ffff99d9413d2100) 00010000:00010000:3.0:1777051530.254437:0:27885:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1777051530.254442:0:27885:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99da7d5cfc00, rc 0) 00000100:00100000:3.0:1777051530.254537:0:27885:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da444a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c11b6966-0775-44d2-bdc6-c74c26eb2226+13:141737:x1863365426131968:12345-192.168.201.46@tcp:101:mkdir.0 Request processed in 1613us (2111us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051530.254557:0:27885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112493 00000100:00100000:2.0:1777051530.276900:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051530.277139:0:6581:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426132096 00000100:00100000:0.0:1777051530.277151:0:6581:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426132096 00000100:00100000:3.0:1777051530.277629:0:46497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112494 00000100:00100000:3.0:1777051530.277651:0:46497:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f658000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:c11b6966-0775-44d2-bdc6-c74c26eb2226+13:141739:x1863365426132096:12345-192.168.201.46@tcp:101:rm.0 00010000:00010000:3.0:1777051530.277680:0:46497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777051530.277710:0:46497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cec00/0x85f51a6b96717e7e lrc: 2/0,0 mode: --/CR res: [0x2000032e2:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6b74 expref: -99 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051530.277798:0:46497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cea00/0x85f51a6b96717e85 lrc: 3/1,0 mode: --/CR res: [0x2000032e2:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051530.277820:0:46497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cea00/0x85f51a6b96717e85 lrc: 3/1,0 mode: CR/CR res: [0x2000032e2:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051530.277838:0:46497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cea00/0x85f51a6b96717e85 lrc: 3/1,0 mode: CR/CR res: [0x2000032e2:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051530.277860:0:46497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce000/0x85f51a6b96717e8c lrc: 3/1,0 mode: --/PR res: [0x2000032e2:0xe:0x0].0x63a4dde3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051530.277873:0:46497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce000/0x85f51a6b96717e8c lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0xe:0x0].0x63a4dde3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051530.277884:0:46497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce000/0x85f51a6b96717e8c lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0xe:0x0].0x63a4dde3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051530.278154:0:46497:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cea00/0x85f51a6b96717e85 lrc: 4/1,0 mode: CR/CR res: [0x2000032e2:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051530.278169:0:46497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cea00/0x85f51a6b96717e85 lrc: 4/1,0 mode: CR/CR res: [0x2000032e2:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051530.278188:0:46497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cea00/0x85f51a6b96717e85 lrc: 3/0,0 mode: CR/CR res: [0x2000032e2:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051530.278200:0:46497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cea00/0x85f51a6b96717e85 lrc: 4/0,0 mode: CR/CR res: [0x2000032e2:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051530.278211:0:46497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da7d5cea00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:3.0:1777051530.278219:0:46497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cea00/0x85f51a6b96717e85 lrc: 4/0,0 mode: CR/CR res: [0x2000032e2:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051530.278230:0:46497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cea00/0x85f51a6b96717e85 lrc: 5/0,0 mode: CR/CR res: [0x2000032e2:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051530.278248:0:46497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0xe:0x0].0x0 (ffff99d9413d2100) 00010000:00010000:3.0:1777051530.278253:0:46497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777051530.278259:0:46497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cea00/0x85f51a6b96717e85 lrc: 3/0,0 mode: --/CR res: [0x2000032e2:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051530.278269:0:46497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cea00/0x85f51a6b96717e85 lrc: 0/0,0 mode: --/CR res: [0x2000032e2:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051530.278289:0:46497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce000/0x85f51a6b96717e8c lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0xe:0x0].0x63a4dde3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051530.278327:0:46497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce000/0x85f51a6b96717e8c lrc: 2/0,0 mode: PR/PR res: [0x2000032e2:0xe:0x0].0x63a4dde3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051530.278340:0:46497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce000/0x85f51a6b96717e8c lrc: 3/0,0 mode: PR/PR res: [0x2000032e2:0xe:0x0].0x63a4dde3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051530.278349:0:46497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da7d5ce000 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:3.0:1777051530.278354:0:46497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce000/0x85f51a6b96717e8c lrc: 3/0,0 mode: PR/PR res: [0x2000032e2:0xe:0x0].0x63a4dde3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051530.278365:0:46497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce000/0x85f51a6b96717e8c lrc: 4/0,0 mode: PR/PR res: [0x2000032e2:0xe:0x0].0x63a4dde3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051530.278377:0:46497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0xe:0x0].0x63a4dde3 (ffff99d9413d2600) 00010000:00010000:3.0:1777051530.278381:0:46497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777051530.278440:0:46497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce000/0x85f51a6b96717e8c lrc: 2/0,0 mode: --/PR res: [0x2000032e2:0xe:0x0].0x63a4dde3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051530.278452:0:46497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce000/0x85f51a6b96717e8c lrc: 0/0,0 mode: --/PR res: [0x2000032e2:0xe:0x0].0x63a4dde3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051530.278499:0:46497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cec00/0x85f51a6b96717e7e lrc: 1/0,0 mode: --/CR res: [0x2000032e2:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6b74 expref: 14 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051530.278516:0:46497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0xe:0x0].0x0 (ffff99d9413d2100) 00010000:00010000:3.0:1777051530.278520:0:46497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777051530.278527:0:46497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cec00/0x85f51a6b96717e7e lrc: 0/0,0 mode: --/CR res: [0x2000032e2:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6b74 expref: 14 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051530.278541:0:46497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99da7d5cec00, rc 0) 00000100:00100000:3.0:1777051530.278621:0:46497:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f658000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:c11b6966-0775-44d2-bdc6-c74c26eb2226+13:141739:x1863365426132096:12345-192.168.201.46@tcp:101:rm.0 Request processed in 977us (1733us total) trans 0 rc 301/301 00000100:00100000:3.0:1777051530.278635:0:46497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112494 00000100:00100000:0.0:1777051530.296464:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051530.297411:0:10328:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426132352 00000100:00100000:1.0:1777051530.297426:0:10328:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426132352 00000100:00100000:1.0:1777051530.297520:0:10328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112495 00000100:00100000:1.0:1777051530.297538:0:10328:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fd60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+13:141740:x1863365426132352:12345-192.168.201.46@tcp:101:dd.0 00010000:00010000:1.0:1777051530.297569:0:10328:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777051530.297575:0:10328:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1777051530.297613:0:10328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cfc00/0x85f51a6b96717e77 lrc: 0/0,0 mode: --/PR res: [0x2000032e2:0xe:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6b6d expref: 13 pid: 27885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051530.297642:0:10328:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0xe:0x0].0x0 (ffff99d9413d2100) 00010000:00010000:1.0:1777051530.297650:0:10328:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1777051530.297670:0:10328:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502db200/0x85f51a6b96717e93 lrc: 2/0,0 mode: --/CW res: [0x2000032e2:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6b7b expref: -99 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051530.298102:0:10328:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502daa00/0x85f51a6b96717e9a lrc: 3/0,1 mode: --/CW res: [0x2000032e2:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051530.298124:0:10328:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502daa00/0x85f51a6b96717e9a lrc: 3/0,1 mode: CW/CW res: [0x2000032e2:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051530.298139:0:10328:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502daa00/0x85f51a6b96717e9a lrc: 3/0,1 mode: CW/CW res: [0x2000032e2:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051530.298163:0:10328:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502da800/0x85f51a6b96717ea1 lrc: 3/0,1 mode: --/PW res: [0x2000032e2:0xe:0x0].0x63a4dde3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051530.298174:0:10328:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502da800/0x85f51a6b96717ea1 lrc: 3/0,1 mode: PW/PW res: [0x2000032e2:0xe:0x0].0x63a4dde3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051530.298185:0:10328:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502da800/0x85f51a6b96717ea1 lrc: 3/0,1 mode: PW/PW res: [0x2000032e2:0xe:0x0].0x63a4dde3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1777051530.299125:0:10328:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x203:0x0], index 1: 0 00010000:00010000:0.0:1777051530.299390:0:10328:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162f400/0x85f51a6b96717ea8 lrc: 3/1,0 mode: --/PR res: [0x2000032e3:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051530.299408:0:10328:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162f400/0x85f51a6b96717ea8 lrc: 3/1,0 mode: PR/PR res: [0x2000032e3:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051530.299425:0:10328:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162f400/0x85f51a6b96717ea8 lrc: 3/1,0 mode: PR/PR res: [0x2000032e3:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051530.299469:0:10328:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502daa00/0x85f51a6b96717e9a lrc: 4/0,1 mode: CW/CW res: [0x2000032e2:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051530.299481:0:10328:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502daa00/0x85f51a6b96717e9a lrc: 4/0,1 mode: CW/CW res: [0x2000032e2:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051530.299490:0:10328:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502daa00/0x85f51a6b96717e9a lrc: 3/0,0 mode: CW/CW res: [0x2000032e2:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051530.299500:0:10328:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502daa00/0x85f51a6b96717e9a lrc: 4/0,0 mode: CW/CW res: [0x2000032e2:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051530.299508:0:10328:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d9502daa00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:0.0:1777051530.299516:0:10328:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502daa00/0x85f51a6b96717e9a lrc: 4/0,0 mode: CW/CW res: [0x2000032e2:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051530.299528:0:10328:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502daa00/0x85f51a6b96717e9a lrc: 5/0,0 mode: CW/CW res: [0x2000032e2:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051530.299542:0:10328:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0xe:0x0].0x0 (ffff99d9413d2100) 00010000:00010000:0.0:1777051530.299546:0:10328:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777051530.299551:0:10328:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502daa00/0x85f51a6b96717e9a lrc: 3/0,0 mode: --/CW res: [0x2000032e2:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051530.299560:0:10328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502daa00/0x85f51a6b96717e9a lrc: 0/0,0 mode: --/CW res: [0x2000032e2:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1777051530.299580:0:10328:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000d94b02e1 reply state 00000000b1a7590f transno 34359738409 ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502da800/0x85f51a6b96717ea1 lrc: 3/0,1 mode: PW/PW res: [0x2000032e2:0xe:0x0].0x63a4dde3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051530.299597:0:10328:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502da800/0x85f51a6b96717ea1 lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e2:0xe:0x0].0x63a4dde3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051530.299606:0:10328:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0xe:0x0].0x63a4dde3 (ffff99d94e592a00) 00010000:00010000:0.0:1777051530.299610:0:10328:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1777051530.299613:0:10328:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1777051530.299650:0:10328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502db200/0x85f51a6b96717e93 lrc: 0/0,0 mode: --/CW res: [0x2000032e2:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6b7b expref: 15 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051530.299671:0:10328:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162f400/0x85f51a6b96717ea8 lrc: 3/0,0 mode: PR/PR res: [0x2000032e3:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6b7b expref: 14 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051530.299682:0:10328:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e3:0xe:0x0].0x0 (ffff99da45738f00) 00010000:00010000:0.0:1777051530.299686:0:10328:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1777051530.299690:0:10328:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99da4162f400, rc 0) 00000100:00100000:0.0:1777051530.299785:0:10328:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fd60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+15:141740:x1863365426132352:12345-192.168.201.46@tcp:101:dd.0 Request processed in 2251us (3328us total) trans 34359738409 rc 0/0 00000100:00100000:0.0:1777051530.299798:0:10328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112495 00000100:00100000:2.0:1777051530.305411:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051530.305513:0:24269:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426132608 00000100:00100000:1.0:1777051530.305538:0:24269:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426132608 00000100:00100000:1.0:1777051530.305628:0:24269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3444 00000100:00100000:1.0:1777051530.305645:0:24269:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f658700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+15:141740:x1863365426132608:12345-192.168.201.46@tcp:35:dd.0 00000100:00100000:1.0:1777051530.306009:0:24269:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f658700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+16:141740:x1863365426132608:12345-192.168.201.46@tcp:35:dd.0 Request processed in 367us (599us total) trans 34359738410 rc 0/0 00000100:00100000:1.0:1777051530.306024:0:24269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3444 00000100:00100000:2.0:1777051530.335671:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051530.335883:0:27882:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426132736 00000100:00100000:0.0:1777051530.335898:0:27882:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426132736 00000100:00100000:0.0:1777051530.336005:0:27882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112496 00000100:00100000:0.0:1777051530.336025:0:27882:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f658a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+16:141741:x1863365426132736:12345-192.168.201.46@tcp:101:lfs.0 00010000:00010000:0.0:1777051530.336060:0:27882:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051530.336092:0:27882:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162f000/0x85f51a6b96717eb6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6b82 expref: -99 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051530.336195:0:27882:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162e800/0x85f51a6b96717ebd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051530.336288:0:27882:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162e800/0x85f51a6b96717ebd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051530.336346:0:27882:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162e800/0x85f51a6b96717ebd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051530.336371:0:27882:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162fe00/0x85f51a6b96717ec4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5d66f174 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051530.336388:0:27882:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162fe00/0x85f51a6b96717ec4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5d66f174 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051530.336402:0:27882:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162fe00/0x85f51a6b96717ec4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5d66f174 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051530.336535:0:27882:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162f800/0x85f51a6b96717ecb lrc: 3/1,0 mode: --/PR res: [0x2000032e2:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051530.336554:0:27882:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162f800/0x85f51a6b96717ecb lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0xe:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051530.336569:0:27882:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162f800/0x85f51a6b96717ecb lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0xe:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1777051530.336620:0:27882:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000032e2:0xe:0x0]: returning size 4096 00000004:00200000:0.0:1777051530.336627:0:27882:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1777051530.336661:0:27882:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162f800/0x85f51a6b96717ecb lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0xe:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051530.336685:0:27882:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162e800/0x85f51a6b96717ebd lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051530.336699:0:27882:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162e800/0x85f51a6b96717ebd lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051530.336712:0:27882:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162e800/0x85f51a6b96717ebd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051530.336727:0:27882:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162e800/0x85f51a6b96717ebd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051530.336738:0:27882:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da4162e800 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:0.0:1777051530.336745:0:27882:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162e800/0x85f51a6b96717ebd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051530.336759:0:27882:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162e800/0x85f51a6b96717ebd lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051530.336779:0:27882:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d9413d0800) 00010000:00010000:0.0:1777051530.336786:0:27882:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777051530.336794:0:27882:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162e800/0x85f51a6b96717ebd lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051530.336807:0:27882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162e800/0x85f51a6b96717ebd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051530.336831:0:27882:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162fe00/0x85f51a6b96717ec4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5d66f174 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051530.336844:0:27882:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162fe00/0x85f51a6b96717ec4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5d66f174 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051530.336857:0:27882:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162fe00/0x85f51a6b96717ec4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5d66f174 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051530.336867:0:27882:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da4162fe00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:0.0:1777051530.336873:0:27882:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162fe00/0x85f51a6b96717ec4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5d66f174 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051530.336885:0:27882:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162fe00/0x85f51a6b96717ec4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5d66f174 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051530.336900:0:27882:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5d66f174 (ffff99d9413d2d00) 00010000:00010000:0.0:1777051530.336906:0:27882:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777051530.336912:0:27882:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162fe00/0x85f51a6b96717ec4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5d66f174 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051530.336925:0:27882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162fe00/0x85f51a6b96717ec4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5d66f174 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051530.336973:0:27882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162f000/0x85f51a6b96717eb6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6b82 expref: 18 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051530.337009:0:27882:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162f800/0x85f51a6b96717ecb lrc: 3/0,0 mode: PR/PR res: [0x2000032e2:0xe:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6b82 expref: 17 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051530.337025:0:27882:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0xe:0x0].0x0 (ffff99d9413d2100) 00010000:00010000:0.0:1777051530.337030:0:27882:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1777051530.337035:0:27882:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99da4162f800, rc 0) 00000100:00100000:0.0:1777051530.337494:0:27882:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f658a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+17:141741:x1863365426132736:12345-192.168.201.46@tcp:101:lfs.0 Request processed in 1098us (1462us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051530.337513:0:27882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112496 00010000:00010000:1.0:1777051530.391529:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1777051530.660723:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051530.663382:0:46494:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426132992 00000100:00100000:3.0:1777051530.663395:0:46494:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426132992 00000100:00100000:3.0:1777051530.663482:0:46494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112497 00000100:00100000:3.0:1777051530.663563:0:46494:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fd61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c11b6966-0775-44d2-bdc6-c74c26eb2226+17:141767:x1863365426132992:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1777051530.663591:0:46494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777051530.663619:0:46494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cec00/0x85f51a6b96717ed2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6b89 expref: -99 pid: 46494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051530.663731:0:46494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce000/0x85f51a6b96717ed9 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051530.663751:0:46494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce000/0x85f51a6b96717ed9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051530.663768:0:46494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce000/0x85f51a6b96717ed9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051530.663792:0:46494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cea00/0x85f51a6b96717ee0 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051530.664125:0:46494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cea00/0x85f51a6b96717ee0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051530.664138:0:46494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cea00/0x85f51a6b96717ee0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051530.664337:0:46494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce800/0x85f51a6b96717ee7 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051530.664364:0:46494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce800/0x85f51a6b96717ee7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051530.664377:0:46494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce800/0x85f51a6b96717ee7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1777051530.664391:0:46494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:3.0:1777051530.664489:0:46494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce000/0x85f51a6b96717ed9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051530.664501:0:46494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce000/0x85f51a6b96717ed9 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051530.664511:0:46494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce000/0x85f51a6b96717ed9 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051530.664521:0:46494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da7d5ce000 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:3.0:1777051530.664527:0:46494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce000/0x85f51a6b96717ed9 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051530.664539:0:46494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce000/0x85f51a6b96717ed9 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051530.664555:0:46494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff99da59dd4d00) 00010000:00010000:3.0:1777051530.664560:0:46494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777051530.664567:0:46494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce000/0x85f51a6b96717ed9 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051530.664577:0:46494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce000/0x85f51a6b96717ed9 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051530.664595:0:46494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cea00/0x85f51a6b96717ee0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051530.664605:0:46494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cea00/0x85f51a6b96717ee0 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051530.664614:0:46494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cea00/0x85f51a6b96717ee0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051530.664629:0:46494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da7d5cea00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:3.0:1777051530.664633:0:46494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cea00/0x85f51a6b96717ee0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051530.664642:0:46494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cea00/0x85f51a6b96717ee0 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051530.664654:0:46494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff99d9413d2600) 00010000:00010000:3.0:1777051530.664657:0:46494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777051530.664662:0:46494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cea00/0x85f51a6b96717ee0 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051530.664671:0:46494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cea00/0x85f51a6b96717ee0 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051530.665035:0:46494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cec00/0x85f51a6b96717ed2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6b89 expref: 20 pid: 46494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051530.665059:0:46494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce800/0x85f51a6b96717ee7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6b89 expref: 19 pid: 46494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051530.665071:0:46494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99d9413d2e00) 00010000:00010000:3.0:1777051530.665075:0:46494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777051530.665079:0:46494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99da7d5ce800, rc 0) 00000100:00100000:3.0:1777051530.665266:0:46494:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fd61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c11b6966-0775-44d2-bdc6-c74c26eb2226+19:141767:x1863365426132992:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 Request processed in 1707us (4553us total) trans 34359738411 rc 0/0 00000100:00100000:3.0:1777051530.665354:0:46494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112497 00000100:00100000:2.0:1777051530.671430:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051530.671949:0:6579:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426133120 00000100:00100000:0.0:1777051530.671963:0:6579:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426133120 00000100:00100000:0.0:1777051530.672047:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112498 00000100:00100000:0.0:1777051530.672060:0:6579:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f65b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+19:141767:x1863365426133120:12345-192.168.201.46@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1777051530.672179:0:6579:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f65b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+19:141767:x1863365426133120:12345-192.168.201.46@tcp:59:lhsmtool_posix.0 Request processed in 119us (753us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051530.672198:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112498 00000100:00100000:2.0:1777051530.672445:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051530.672561:0:6564:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426133248 00000100:00100000:1.0:1777051530.672570:0:6564:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426133248 00000100:00100000:1.0:1777051530.672645:0:6564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13753 00000100:00100000:1.0:1777051530.672661:0:6564:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f659c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+19:2439:x1863365426133248:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1777051530.672679:0:6564:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1777051530.672709:0:6564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce800/0x85f51a6b96717ee7 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6b89 expref: 19 pid: 46494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051530.673026:0:6564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99d9413d2e00) 00010000:00010000:1.0:1777051530.673035:0:6564:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1777051530.673091:0:6564:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f659c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+18:2439:x1863365426133248:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 433us (649us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051530.673104:0:6564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13753 00000100:00100000:2.0:1777051530.679757:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051530.680062:0:6581:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426133376 00000100:00100000:1.0:1777051530.680365:0:6581:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426133376 00000100:00100000:1.0:1777051530.680580:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112499 00000100:00100000:1.0:1777051530.680595:0:6581:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7c9a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+9:141767:x1863365426133376:12345-192.168.201.46@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1777051530.680727:0:6581:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7c9a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+9:141767:x1863365426133376:12345-192.168.201.46@tcp:59:lhsmtool_posix.0 Request processed in 118us (959us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051530.680739:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112499 00000100:00080000:0.0:1777051530.681438:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1777051530.690554:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051530.690673:0:6580:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426133504 00000100:00100000:2.0:1777051530.690684:0:6580:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426133504 00000100:00100000:2.0:1777051530.691085:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112500 00000100:00100000:2.0:1777051530.691101:0:6580:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fd62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+11:141768:x1863365426133504:12345-192.168.201.46@tcp:101:lfs.0 00010000:00010000:2.0:1777051530.691424:0:6580:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051530.691452:0:6580:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69aa00/0x85f51a6b96717ef5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6b90 expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051530.691532:0:6580:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69b200/0x85f51a6b96717efc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051530.691554:0:6580:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69b200/0x85f51a6b96717efc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051530.691567:0:6580:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69b200/0x85f51a6b96717efc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1777051530.691617:0:6580:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 12288 00000004:00200000:2.0:1777051530.691622:0:6580:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1777051530.691646:0:6580:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69b200/0x85f51a6b96717efc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051530.691688:0:6580:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69aa00/0x85f51a6b96717ef5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6b90 expref: 13 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051530.691714:0:6580:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69b200/0x85f51a6b96717efc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6b90 expref: 12 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051530.691727:0:6580:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d9413d0800) 00010000:00010000:2.0:1777051530.691731:0:6580:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1777051530.691737:0:6580:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d94f69b200, rc 0) 00000100:00100000:2.0:1777051530.692125:0:6580:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fd62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+12:141768:x1863365426133504:12345-192.168.201.46@tcp:101:lfs.0 Request processed in 1026us (1574us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051530.692138:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112500 00000100:00100000:3.0:1777051530.699864:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051530.700008:0:27882:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426133632 00000100:00100000:0.0:1777051530.700022:0:27882:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426133632 00000100:00100000:0.0:1777051530.700104:0:27882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112501 00000100:00100000:0.0:1777051530.700121:0:27882:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d943d91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+12:141768:x1863365426133632:12345-192.168.201.46@tcp:101:lfs.0 00010000:00010000:0.0:1777051530.700144:0:27882:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051530.700238:0:27882:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162f000/0x85f51a6b96717f03 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6b97 expref: -99 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051530.700353:0:27882:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162fe00/0x85f51a6b96717f0a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051530.700376:0:27882:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162fe00/0x85f51a6b96717f0a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051530.700393:0:27882:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162fe00/0x85f51a6b96717f0a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051530.700412:0:27882:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162e800/0x85f51a6b96717f11 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5d66f174 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051530.700425:0:27882:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162e800/0x85f51a6b96717f11 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5d66f174 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051530.700438:0:27882:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162e800/0x85f51a6b96717f11 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5d66f174 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051530.700551:0:27882:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710c00/0x85f51a6b96717f18 lrc: 3/1,0 mode: --/PR res: [0x2000032e2:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051530.700568:0:27882:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710c00/0x85f51a6b96717f18 lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0xe:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051530.700581:0:27882:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710c00/0x85f51a6b96717f18 lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0xe:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1777051530.700624:0:27882:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000032e2:0xe:0x0]: returning size 4096 00000004:00200000:0.0:1777051530.700654:0:27882:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1777051530.700684:0:27882:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710c00/0x85f51a6b96717f18 lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0xe:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051530.700711:0:27882:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162fe00/0x85f51a6b96717f0a lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051530.700723:0:27882:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162fe00/0x85f51a6b96717f0a lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051530.700734:0:27882:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162fe00/0x85f51a6b96717f0a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051530.700746:0:27882:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162fe00/0x85f51a6b96717f0a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051530.700756:0:27882:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da4162fe00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:0.0:1777051530.700762:0:27882:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162fe00/0x85f51a6b96717f0a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051530.700774:0:27882:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162fe00/0x85f51a6b96717f0a lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051530.700790:0:27882:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d9413d0800) 00010000:00010000:0.0:1777051530.700796:0:27882:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777051530.700803:0:27882:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162fe00/0x85f51a6b96717f0a lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051530.700814:0:27882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162fe00/0x85f51a6b96717f0a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051530.700833:0:27882:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162e800/0x85f51a6b96717f11 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5d66f174 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051530.700844:0:27882:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162e800/0x85f51a6b96717f11 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5d66f174 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051530.700855:0:27882:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162e800/0x85f51a6b96717f11 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5d66f174 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051530.700864:0:27882:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da4162e800 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:0.0:1777051530.700869:0:27882:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162e800/0x85f51a6b96717f11 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5d66f174 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051530.700879:0:27882:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162e800/0x85f51a6b96717f11 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5d66f174 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051530.700891:0:27882:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5d66f174 (ffff99d9413d2d00) 00010000:00010000:0.0:1777051530.700895:0:27882:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777051530.700900:0:27882:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162e800/0x85f51a6b96717f11 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5d66f174 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051530.700911:0:27882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162e800/0x85f51a6b96717f11 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5d66f174 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051530.700948:0:27882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162f000/0x85f51a6b96717f03 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6b97 expref: 14 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051530.700969:0:27882:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710c00/0x85f51a6b96717f18 lrc: 3/0,0 mode: PR/PR res: [0x2000032e2:0xe:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6b97 expref: 13 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051530.700981:0:27882:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0xe:0x0].0x0 (ffff99d9413d2100) 00010000:00010000:0.0:1777051530.700986:0:27882:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1777051530.700990:0:27882:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d950710c00, rc 0) 00000100:00100000:0.0:1777051530.701080:0:27882:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d943d91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+13:141768:x1863365426133632:12345-192.168.201.46@tcp:101:lfs.0 Request processed in 962us (1219us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051530.701099:0:27882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112501 00000100:00100000:3.0:1777051530.707987:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051530.708154:0:21368:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426133760 00000100:00100000:0.0:1777051530.708166:0:21368:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426133760 00000100:00100000:0.0:1777051530.708408:0:21368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112502 00000100:00100000:0.0:1777051530.708427:0:21368:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d943d93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+13:141768:x1863365426133760:12345-192.168.201.46@tcp:101:lfs.0 00010000:00010000:0.0:1777051530.708451:0:21368:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051530.708475:0:21368:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710800/0x85f51a6b96717f1f lrc: 2/0,0 mode: --/CR res: [0x2000032e2:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6b9e expref: -99 pid: 21368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051530.708548:0:21368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950711200/0x85f51a6b96717f26 lrc: 3/1,0 mode: --/CR res: [0x2000032e2:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051530.708569:0:21368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d950711200/0x85f51a6b96717f26 lrc: 3/1,0 mode: CR/CR res: [0x2000032e2:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051530.708584:0:21368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d950711200/0x85f51a6b96717f26 lrc: 3/1,0 mode: CR/CR res: [0x2000032e2:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051530.708603:0:21368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710000/0x85f51a6b96717f2d lrc: 3/1,0 mode: --/PR res: [0x2000032e2:0xe:0x0].0x63a4dde3 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051530.708615:0:21368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710000/0x85f51a6b96717f2d lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0xe:0x0].0x63a4dde3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051530.708628:0:21368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710000/0x85f51a6b96717f2d lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0xe:0x0].0x63a4dde3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051530.708712:0:21368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950711c00/0x85f51a6b96717f34 lrc: 3/1,0 mode: --/PR res: [0x2000032e3:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051530.708736:0:21368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d950711c00/0x85f51a6b96717f34 lrc: 3/1,0 mode: PR/PR res: [0x2000032e3:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051530.708750:0:21368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d950711c00/0x85f51a6b96717f34 lrc: 3/1,0 mode: PR/PR res: [0x2000032e3:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1777051530.709127:0:21368:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000032e3:0xe:0x0]: returning size 0 00000004:00200000:0.0:1777051530.709135:0:21368:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1777051530.709163:0:21368:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99d950711c00/0x85f51a6b96717f34 lrc: 3/1,0 mode: PR/PR res: [0x2000032e3:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051530.709182:0:21368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d950711c00/0x85f51a6b96717f34 lrc: 3/1,0 mode: PR/PR res: [0x2000032e3:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051530.709196:0:21368:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950711200/0x85f51a6b96717f26 lrc: 3/1,0 mode: CR/CR res: [0x2000032e2:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051530.709206:0:21368:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d950711200/0x85f51a6b96717f26 lrc: 2/0,0 mode: CR/CR res: [0x2000032e2:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051530.709217:0:21368:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d950711200/0x85f51a6b96717f26 lrc: 3/0,0 mode: CR/CR res: [0x2000032e2:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051530.709226:0:21368:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d950711200 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:0.0:1777051530.709232:0:21368:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d950711200/0x85f51a6b96717f26 lrc: 3/0,0 mode: CR/CR res: [0x2000032e2:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051530.709244:0:21368:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d950711200/0x85f51a6b96717f26 lrc: 4/0,0 mode: CR/CR res: [0x2000032e2:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051530.709261:0:21368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0xe:0x0].0x0 (ffff99d9413d2100) 00010000:00010000:0.0:1777051530.709266:0:21368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777051530.709272:0:21368:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d950711200/0x85f51a6b96717f26 lrc: 2/0,0 mode: --/CR res: [0x2000032e2:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051530.709283:0:21368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d950711200/0x85f51a6b96717f26 lrc: 0/0,0 mode: --/CR res: [0x2000032e2:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051530.709367:0:21368:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710000/0x85f51a6b96717f2d lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0xe:0x0].0x63a4dde3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051530.709378:0:21368:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710000/0x85f51a6b96717f2d lrc: 2/0,0 mode: PR/PR res: [0x2000032e2:0xe:0x0].0x63a4dde3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051530.709388:0:21368:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710000/0x85f51a6b96717f2d lrc: 3/0,0 mode: PR/PR res: [0x2000032e2:0xe:0x0].0x63a4dde3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051530.709396:0:21368:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d950710000 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:0.0:1777051530.709400:0:21368:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710000/0x85f51a6b96717f2d lrc: 3/0,0 mode: PR/PR res: [0x2000032e2:0xe:0x0].0x63a4dde3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051530.709411:0:21368:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710000/0x85f51a6b96717f2d lrc: 4/0,0 mode: PR/PR res: [0x2000032e2:0xe:0x0].0x63a4dde3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051530.709424:0:21368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0xe:0x0].0x63a4dde3 (ffff99d94e592a00) 00010000:00010000:0.0:1777051530.709429:0:21368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777051530.709434:0:21368:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710000/0x85f51a6b96717f2d lrc: 2/0,0 mode: --/PR res: [0x2000032e2:0xe:0x0].0x63a4dde3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051530.709443:0:21368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710000/0x85f51a6b96717f2d lrc: 0/0,0 mode: --/PR res: [0x2000032e2:0xe:0x0].0x63a4dde3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051530.709482:0:21368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710800/0x85f51a6b96717f1f lrc: 0/0,0 mode: --/CR res: [0x2000032e2:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6b9e expref: 15 pid: 21368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051530.709511:0:21368:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950711c00/0x85f51a6b96717f34 lrc: 3/0,0 mode: PR/PR res: [0x2000032e3:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6b9e expref: 14 pid: 21368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051530.709524:0:21368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e3:0xe:0x0].0x0 (ffff99da45738f00) 00010000:00010000:0.0:1777051530.709528:0:21368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1777051530.709532:0:21368:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d950711c00, rc 0) 00000100:00100000:0.0:1777051530.709616:0:21368:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d943d93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+14:141768:x1863365426133760:12345-192.168.201.46@tcp:101:lfs.0 Request processed in 1194us (1635us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051530.709630:0:21368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112502 00000100:00100000:2.0:1777051530.717885:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051530.718000:0:8468:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426133888 00000100:00100000:1.0:1777051530.718015:0:8468:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426133888 00000100:00100000:1.0:1777051530.718106:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 8123 00000100:00100000:1.0:1777051530.718122:0:8468:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7c9a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+30:2437:x1863365426133888:12345-192.168.201.46@tcp:101:lfs.0 00010000:00010000:1.0:1777051530.718142:0:8468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777051530.718164:0:8468:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000046b5e69f/0x85f51a6b96717f3b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x203:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6ba5 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1777051530.718240:0:8468:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x203:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777051530.718269:0:8468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051530.718274:0:8468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051530.718289:0:8468:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000046b5e69f/0x85f51a6b96717f3b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x203:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6ba5 expref: 31 pid: 8468 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051530.718351:0:8468:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000046b5e69f/0x85f51a6b96717f3b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x203:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6ba5 expref: 31 pid: 8468 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051530.718373:0:8468:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d9502db400, rc 0) 00000100:00100000:1.0:1777051530.718454:0:8468:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7c9a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+31:2437:x1863365426133888:12345-192.168.201.46@tcp:101:lfs.0 Request processed in 334us (578us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051530.718467:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 8123 00000100:00100000:2.0:1777051530.728616:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051530.729083:0:6579:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426134016 00000100:00100000:0.0:1777051530.729097:0:6579:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426134016 00000100:00100000:0.0:1777051530.729188:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112503 00000100:00100000:0.0:1777051530.729260:0:6579:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7c9a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+14:141768:x1863365426134016:12345-192.168.201.46@tcp:101:lfs.0 00010000:00010000:0.0:1777051530.729287:0:6579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051530.729346:0:6579:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710800/0x85f51a6b96717f42 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6bac expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051530.729437:0:6579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710000/0x85f51a6b96717f49 lrc: 3/1,0 mode: --/PR res: [0x2000032e2:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051530.729458:0:6579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710000/0x85f51a6b96717f49 lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0xe:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051530.729475:0:6579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710000/0x85f51a6b96717f49 lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0xe:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1777051530.729529:0:6579:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000032e2:0xe:0x0]: returning size 4096 00000004:00200000:0.0:1777051530.729536:0:6579:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1777051530.729565:0:6579:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710000/0x85f51a6b96717f49 lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0xe:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051530.729603:0:6579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710800/0x85f51a6b96717f42 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6bac expref: 16 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051530.729631:0:6579:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710000/0x85f51a6b96717f49 lrc: 3/0,0 mode: PR/PR res: [0x2000032e2:0xe:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6bac expref: 15 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051530.729644:0:6579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0xe:0x0].0x0 (ffff99d9413d2100) 00010000:00010000:0.0:1777051530.729650:0:6579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1777051530.729656:0:6579:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d950710000, rc 0) 00000100:00100000:0.0:1777051530.729746:0:6579:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7c9a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+15:141768:x1863365426134016:12345-192.168.201.46@tcp:101:lfs.0 Request processed in 544us (1138us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051530.729760:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112503 00000100:00100000:3.0:1777051530.738182:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051530.738321:0:46497:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426134272 00000100:00100000:0.0:1777051530.738335:0:46497:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426134272 00000100:00100000:1.0:1777051530.738475:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112504 00000100:00100000:1.0:1777051530.738496:0:6581:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d943d90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+15:141768:x1863365426134272:12345-192.168.201.46@tcp:58:lfs.0 00000040:00080000:1.0:1777051530.738741:0:6581:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x31:0x0].2, 136 off8464 00000100:00100000:1.0:1777051530.738868:0:6581:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d943d90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+15:141768:x1863365426134272:12345-192.168.201.46@tcp:58:lfs.0 Request processed in 377us (697us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051530.738882:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112504 00000040:00080000:1.0:1777051531.158476:0:104226:0:(llog.c:801:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1777051531.158487:0:104226:0:(llog_cat.c:158:llog_cat_process_common()) processing log [0x1:0x12:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1777051531.159356:0:104226:0:(llog.c:858:llog_process_thread()) stop processing plain [0x1:0x12:0x0] index 64768 count 1 00000040:00080000:1.0:1777051531.159373:0:104226:0:(llog.c:858:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:1.0:1777051531.414493:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1777051531.415012:0:109205:0:(llog.c:801:llog_process_thread()) index: 6, lh_last_idx: 7 synced_idx: 0 lgh_last_idx: 7 00000040:00080000:2.0:1777051531.415022:0:109205:0:(llog_cat.c:158:llog_cat_process_common()) processing log [0x1:0x2b:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1777051531.416967:0:109205:0:(llog.c:858:llog_process_thread()) stop processing plain [0x1:0x2b:0x0] index 64768 count 3 00000040:00080000:2.0:1777051531.416998:0:109205:0:(llog.c:801:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:2.0:1777051531.417002:0:109205:0:(llog_cat.c:158:llog_cat_process_common()) processing log [0x1:0x31:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1777051531.417047:0:109205:0:(llog.c:858:llog_process_thread()) stop processing plain [0x1:0x31:0x0] index 3 count 3 00000040:00080000:2.0:1777051531.417054:0:109205:0:(llog.c:858:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 3 00000100:00100000:2.0:1777051531.417478:0:109205:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7c9a3100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:109205:1863365452730368:192.168.201.46@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1777051531.417625:0:109205:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da4682b900 going to sleep for 11 seconds 00000100:00100000:1.0:1777051531.425420:0:109205:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7c9a3100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:109205:1863365452730368:192.168.201.46@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1777051531.426079:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051531.426332:0:10328:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426134400 00000100:00100000:0.0:1777051531.426349:0:10328:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426134400 00000100:00100000:0.0:1777051531.426441:0:10328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112505 00000100:00100000:0.0:1777051531.426457:0:10328:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d943d90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+18:141778:x1863365426134400:12345-192.168.201.46@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1777051531.426504:0:10328:0:(mdt_handler.c:7958:mdt_fid2path()) path get [0x2000032e3:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1777051531.426665:0:10328:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d943d90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+18:141778:x1863365426134400:12345-192.168.201.46@tcp:53:lhsmtool_posix.0 Request processed in 212us (589us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051531.426677:0:10328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112505 00000100:00100000:3.0:1777051531.433937:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051531.434043:0:8492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426134656 00000100:00100000:1.0:1777051531.434056:0:8492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426134656 00000100:00100000:1.0:1777051531.434145:0:8492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112506 00000100:00100000:1.0:1777051531.434182:0:8492:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d943d91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+18:141778:x1863365426134656:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1777051531.434495:0:8492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777051531.434524:0:8492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502da200/0x85f51a6b96717f50 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6bb3 expref: -99 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051531.434682:0:8492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502dbc00/0x85f51a6b96717f57 lrc: 3/1,0 mode: --/PR res: [0x2000032e3:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051531.434703:0:8492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502dbc00/0x85f51a6b96717f57 lrc: 3/1,0 mode: PR/PR res: [0x2000032e3:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051531.434721:0:8492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502dbc00/0x85f51a6b96717f57 lrc: 3/1,0 mode: PR/PR res: [0x2000032e3:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1777051531.434738:0:8492:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000032e3:0xe:0x0]: returning size 0 00010000:00010000:1.0:1777051531.434879:0:8492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502da200/0x85f51a6b96717f50 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6bb3 expref: 21 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051531.434905:0:8492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502dbc00/0x85f51a6b96717f57 lrc: 3/0,0 mode: PR/PR res: [0x2000032e3:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6bb3 expref: 20 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051531.434918:0:8492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e3:0xe:0x0].0x0 (ffff99da45738f00) 00010000:00010000:1.0:1777051531.434922:0:8492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1777051531.434927:0:8492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d9502dbc00, rc 0) 00000100:00100000:1.0:1777051531.435010:0:8492:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d943d91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+20:141778:x1863365426134656:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 Request processed in 852us (1082us total) trans 34359738412 rc 0/0 00000100:00100000:1.0:1777051531.435022:0:8492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112506 00000100:00100000:3.0:1777051531.443350:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051531.443421:0:6566:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426134784 00000100:00100000:1.0:1777051531.443434:0:6566:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426134784 00000100:00100000:1.0:1777051531.443525:0:6566:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13754 00000100:00100000:1.0:1777051531.443686:0:6566:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fd64000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+20:2439:x1863365426134784:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1777051531.443709:0:6566:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1777051531.443743:0:6566:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502dbc00/0x85f51a6b96717f57 lrc: 0/0,0 mode: --/PR res: [0x2000032e3:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6bb3 expref: 20 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051531.443769:0:6566:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e3:0xe:0x0].0x0 (ffff99da45738f00) 00010000:00010000:1.0:1777051531.443776:0:6566:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1777051531.443850:0:6566:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fd64000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+19:2439:x1863365426134784:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 172us (508us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051531.443863:0:6566:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13754 00000100:00100000:3.0:1777051531.444791:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051531.445098:0:8470:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426134912 00000100:00100000:1.0:1777051531.445107:0:8470:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426134912 00000100:00100000:1.0:1777051531.445474:0:8470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 8124 00000100:00100000:1.0:1777051531.445489:0:8470:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fd67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+30:2436:x1863365426134912:12345-192.168.201.46@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1777051531.445537:0:8470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000004360264f/0x85f51a6b96717f65 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x203:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051531.445559:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051531.445562:0:8470:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051531.445569:0:8470:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004360264f/0x85f51a6b96717f65 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x203:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051531.445591:0:8470:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004360264f/0x85f51a6b96717f65 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x203:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1777051531.445623:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1777051531.445631:0:8470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000004360264f/0x85f51a6b96717f65 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x203:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051531.445645:0:8470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004360264f/0x85f51a6b96717f65 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x203:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051531.445659:0:8470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004360264f/0x85f51a6b96717f65 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x203:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051531.445671:0:8470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d9502dac00 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:1.0:1777051531.445677:0:8470:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004360264f/0x85f51a6b96717f65 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x203:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051531.445692:0:8470:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004360264f/0x85f51a6b96717f65 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x203:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051531.445712:0:8470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004360264f/0x85f51a6b96717f65 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x203:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051531.445725:0:8470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004360264f/0x85f51a6b96717f65 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x203:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051531.446330:0:8470:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fd67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+30:2436:x1863365426134912:12345-192.168.201.46@tcp:1:lhsmtool_posix.0 Request processed in 842us (1539us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051531.446349:0:8470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 8124 00000100:00100000:2.0:1777051531.451734:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051531.451899:0:46494:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426135168 00000100:00100000:0.0:1777051531.451928:0:46494:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426135168 00000100:00100000:0.0:1777051531.452016:0:46494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112507 00000100:00100000:0.0:1777051531.452027:0:46494:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7c9a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c11b6966-0775-44d2-bdc6-c74c26eb2226+19:141778:x1863365426135168:12345-192.168.201.46@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1777051531.452215:0:46494:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7c9a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c11b6966-0775-44d2-bdc6-c74c26eb2226+19:141778:x1863365426135168:12345-192.168.201.46@tcp:57:lhsmtool_posix.0 Request processed in 189us (490us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051531.452227:0:46494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112507 00000100:00100000:1.0:1777051531.465219:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051531.465547:0:8471:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426135296 00000100:00100000:2.0:1777051531.465561:0:8471:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426135296 00000100:00100000:2.0:1777051531.465653:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 8125 00000100:00100000:2.0:1777051531.465670:0:8471:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f42d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+30:2436:x1863365426135296:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1777051531.465693:0:8471:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051531.465716:0:8471:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000061813a3d/0x85f51a6b96717f6c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x203:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6bba expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051531.465752:0:8471:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777051531.465757:0:8471:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777051531.466069:0:8471:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000061813a3d/0x85f51a6b96717f6c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x203:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6bba expref: 31 pid: 8471 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051531.466099:0:8471:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000061813a3d/0x85f51a6b96717f6c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x203:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6bba expref: 31 pid: 8471 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051531.466121:0:8471:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d94f69ac00, rc 0) 00000100:00100000:2.0:1777051531.466245:0:8471:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f42d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+31:2436:x1863365426135296:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 Request processed in 574us (1032us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051531.466262:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 8125 00000100:00100000:2.0:1777051531.470610:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051531.470729:0:6579:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426135552 00000100:00100000:0.0:1777051531.470743:0:6579:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426135552 00000100:00100000:0.0:1777051531.470821:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112508 00000100:00100000:0.0:1777051531.470832:0:6579:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7c9a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+19:141778:x1863365426135552:12345-192.168.201.46@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1777051531.471687:0:6579:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7c9a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+19:141778:x1863365426135552:12345-192.168.201.46@tcp:57:lhsmtool_posix.0 Request processed in 850us (1087us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051531.471701:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112508 00000100:00100000:0.0:1777051531.480010:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051531.480115:0:46497:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426135680 00000100:00100000:3.0:1777051531.480140:0:46497:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426135680 00000100:00100000:3.0:1777051531.480540:0:46497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112509 00000100:00100000:3.0:1777051531.480560:0:46497:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fd61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:c11b6966-0775-44d2-bdc6-c74c26eb2226+19:141778:x1863365426135680:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1777051531.480584:0:46497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777051531.480618:0:46497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cec00/0x85f51a6b96717f73 lrc: 2/0,0 mode: --/PR res: [0x2000032e3:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6bc1 expref: -99 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051531.480674:0:46497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cea00/0x85f51a6b96717f7a lrc: 3/1,0 mode: --/PR res: [0x2000032e3:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051531.480710:0:46497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cea00/0x85f51a6b96717f7a lrc: 3/1,0 mode: PR/PR res: [0x2000032e3:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051531.480729:0:46497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cea00/0x85f51a6b96717f7a lrc: 3/1,0 mode: PR/PR res: [0x2000032e3:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051531.481127:0:46497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cec00/0x85f51a6b96717f73 lrc: 0/0,0 mode: --/PR res: [0x2000032e3:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6bc1 expref: 21 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051531.481154:0:46497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cea00/0x85f51a6b96717f7a lrc: 3/0,0 mode: PR/PR res: [0x2000032e3:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6bc1 expref: 20 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051531.481175:0:46497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e3:0xe:0x0].0x0 (ffff99da45738f00) 00010000:00010000:3.0:1777051531.481179:0:46497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1777051531.481528:0:46497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99da7d5cea00, rc 0) 00000100:00100000:3.0:1777051531.481624:0:46497:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fd61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:c11b6966-0775-44d2-bdc6-c74c26eb2226+20:141778:x1863365426135680:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 Request processed in 1072us (1626us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051531.481634:0:46497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112509 00000100:00100000:1.0:1777051531.490268:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051531.490601:0:10328:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426135808 00000100:00100000:0.0:1777051531.490615:0:10328:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426135808 00000100:00100000:0.0:1777051531.490698:0:10328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112510 00000100:00100000:0.0:1777051531.490712:0:10328:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f298a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+20:141778:x1863365426135808:12345-192.168.201.46@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1777051531.490756:0:10328:0:(mdt_handler.c:7958:mdt_fid2path()) path get [0x2000032e3:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1777051531.490922:0:10328:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f298a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+20:141778:x1863365426135808:12345-192.168.201.46@tcp:53:lhsmtool_posix.0 Request processed in 211us (663us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051531.490935:0:10328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112510 00000100:00100000:0.0:1777051531.498946:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051531.499529:0:8628:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426135936 00000100:00100000:2.0:1777051531.499541:0:8628:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426135936 00000100:00100000:2.0:1777051531.499610:0:8628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 8126 00000100:00100000:2.0:1777051531.499625:0:8628:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da44495880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+31:2437:x1863365426135936:12345-192.168.201.46@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1777051531.499714:0:8628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e9a85948/0x85f51a6b96717f81 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x203:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051531.499740:0:8628:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777051531.499744:0:8628:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777051531.499752:0:8628:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e9a85948/0x85f51a6b96717f81 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x203:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051531.499773:0:8628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e9a85948/0x85f51a6b96717f81 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x203:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051531.499809:0:8628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e9a85948/0x85f51a6b96717f81 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x203:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051531.499823:0:8628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e9a85948/0x85f51a6b96717f81 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x203:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051531.499838:0:8628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e9a85948/0x85f51a6b96717f81 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x203:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051531.499849:0:8628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94f69bc00 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:2.0:1777051531.499856:0:8628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9a85948/0x85f51a6b96717f81 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x203:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051531.499871:0:8628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9a85948/0x85f51a6b96717f81 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x203:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051531.499893:0:8628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e9a85948/0x85f51a6b96717f81 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x203:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051531.499915:0:8628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e9a85948/0x85f51a6b96717f81 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x203:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051531.500041:0:8628:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da44495880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+31:2437:x1863365426135936:12345-192.168.201.46@tcp:1:lhsmtool_posix.0 Request processed in 416us (1100us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051531.500056:0:8628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 8126 00000100:00100000:3.0:1777051531.511753:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051531.512078:0:27882:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426136192 00000100:00100000:3.0:1777051531.512091:0:27882:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426136192 00000100:00100000:3.0:1777051531.512157:0:27882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112511 00000100:00100000:3.0:1777051531.512173:0:27882:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fd64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+20:141778:x1863365426136192:12345-192.168.201.46@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1777051531.512596:0:27882:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cec00/0x85f51a6b96717f88 lrc: 3/0,1 mode: --/PW res: [0x2000032e3:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051531.512622:0:27882:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cea00/0x85f51a6b96717f7a lrc: 2/0,0 mode: PR/PR res: [0x2000032e3:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6bc1 expref: 20 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051531.512637:0:27882:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cec00/0x85f51a6b96717f88 lrc: 4/0,1 mode: --/PW res: [0x2000032e3:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051531.512685:0:27882:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cea00/0x85f51a6b96717f7a lrc: 3/0,0 mode: PR/PR res: [0x2000032e3:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6bc1 expref: 20 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051531.512707:0:27882:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cea00/0x85f51a6b96717f7a lrc: 4/0,0 mode: PR/PR res: [0x2000032e3:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6bc1 expref: 20 pid: 46497 timeout: 8260 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051531.512738:0:27882:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7fd64380 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27882:1863365452730496:192.168.201.46@tcp:104: 00000100:00100000:3.0:1777051531.512834:0:27882:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d944ac0240 going to sleep for 11 seconds 00000100:00100000:3.0:1777051531.518530:0:27882:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7fd64380 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27882:1863365452730496:192.168.201.46@tcp:104: 00000100:00100000:1.0:1777051531.518546:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00010000:00010000:3.0:1777051531.518571:0:27882:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cec00/0x85f51a6b96717f88 lrc: 3/0,1 mode: --/PW res: [0x2000032e3:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1777051531.524701:0:110384:0:(llog.c:801:llog_process_thread()) index: 6, lh_last_idx: 7 synced_idx: 0 lgh_last_idx: 7 00000040:00080000:3.0:1777051531.524710:0:110384:0:(llog_cat.c:158:llog_cat_process_common()) processing log [0x1:0x2b:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1777051531.524762:0:110384:0:(llog.c:858:llog_process_thread()) stop processing plain [0x1:0x2b:0x0] index 12 count 3 00000040:00080000:3.0:1777051531.524776:0:110384:0:(llog.c:801:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:3.0:1777051531.524780:0:110384:0:(llog_cat.c:158:llog_cat_process_common()) processing log [0x1:0x31:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1777051531.525125:0:110384:0:(llog.c:858:llog_process_thread()) stop processing plain [0x1:0x31:0x0] index 3 count 3 00000040:00080000:3.0:1777051531.525132:0:110384:0:(llog.c:858:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 3 00000100:00100000:2.0:1777051531.525360:0:6565:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426136320 00000100:00100000:2.0:1777051531.525371:0:6565:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426136320 00010000:00010000:2.0:1777051531.525418:0:6565:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cea00/0x85f51a6b96717f7a lrc: 4/0,0 mode: PR/PR res: [0x2000032e3:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6bc1 expref: 21 pid: 46497 timeout: 8260 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051531.525477:0:6565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3988 00000100:00100000:2.0:1777051531.525491:0:6565:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da71c0b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+21:2437:x1863365426136320:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1777051531.525512:0:6565:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777051531.525523:0:6565:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cea00/0x85f51a6b96717f7a lrc: 4/0,0 mode: PR/PR res: [0x2000032e3:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6bc1 expref: 21 pid: 46497 timeout: 8260 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051531.525546:0:6565:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cea00/0x85f51a6b96717f7a lrc: 3/0,0 mode: PR/PR res: [0x2000032e3:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6bc1 expref: 21 pid: 46497 timeout: 8260 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051531.525578:0:6565:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cea00/0x85f51a6b96717f7a lrc: 0/0,0 mode: --/PR res: [0x2000032e3:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6bc1 expref: 21 pid: 46497 timeout: 8260 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051531.525601:0:6565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e3:0xe:0x0].0x0 (ffff99da45738f00) 00010000:00010000:2.0:1777051531.525609:0:6565:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cec00/0x85f51a6b96717f88 lrc: 3/0,1 mode: --/PW res: [0x2000032e3:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051531.525626:0:6565:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cec00/0x85f51a6b96717f88 lrc: 3/0,1 mode: PW/PW res: [0x2000032e3:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051531.525639:0:6565:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cec00/0x85f51a6b96717f88 lrc: 4/0,1 mode: PW/PW res: [0x2000032e3:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051531.525678:0:6565:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1777051531.526063:0:6565:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da71c0b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+20:2437:x1863365426136320:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 572us (7523us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051531.526078:0:6565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3988 00010000:00010000:2.0:1777051531.526182:0:27882:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cec00/0x85f51a6b96717f88 lrc: 3/0,1 mode: PW/PW res: [0x2000032e3:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051531.526195:0:27882:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cec00/0x85f51a6b96717f88 lrc: 3/0,1 mode: PW/PW res: [0x2000032e3:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051531.526449:0:27882:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cec00/0x85f51a6b96717f88 lrc: 3/0,1 mode: PW/PW res: [0x2000032e3:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051531.526462:0:27882:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cec00/0x85f51a6b96717f88 lrc: 2/0,0 mode: PW/PW res: [0x2000032e3:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051531.526473:0:27882:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cec00/0x85f51a6b96717f88 lrc: 3/0,0 mode: PW/PW res: [0x2000032e3:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051531.526483:0:27882:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da7d5cec00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:2.0:1777051531.526490:0:27882:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cec00/0x85f51a6b96717f88 lrc: 3/0,0 mode: PW/PW res: [0x2000032e3:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051531.526501:0:27882:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cec00/0x85f51a6b96717f88 lrc: 4/0,0 mode: PW/PW res: [0x2000032e3:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051531.526520:0:27882:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e3:0xe:0x0].0x0 (ffff99da45738f00) 00010000:00010000:2.0:1777051531.526525:0:27882:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1777051531.526531:0:27882:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cec00/0x85f51a6b96717f88 lrc: 2/0,0 mode: --/PW res: [0x2000032e3:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051531.526541:0:27882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cec00/0x85f51a6b96717f88 lrc: 0/0,0 mode: --/PW res: [0x2000032e3:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051531.526696:0:27882:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fd64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+20:141778:x1863365426136192:12345-192.168.201.46@tcp:57:lhsmtool_posix.0 Request processed in 14524us (14950us total) trans 34359738413 rc 0/0 00000100:00100000:2.0:1777051531.526712:0:27882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112511 00000040:00080000:1.0:1777051531.526767:0:109205:0:(llog.c:801:llog_process_thread()) index: 6, lh_last_idx: 7 synced_idx: 0 lgh_last_idx: 7 00000040:00080000:1.0:1777051531.526773:0:109205:0:(llog_cat.c:158:llog_cat_process_common()) processing log [0x1:0x2b:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1777051531.528106:0:109205:0:(llog.c:858:llog_process_thread()) stop processing plain [0x1:0x2b:0x0] index 64768 count 3 00000040:00080000:0.0:1777051531.528427:0:109205:0:(llog.c:801:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:0.0:1777051531.528434:0:109205:0:(llog_cat.c:158:llog_cat_process_common()) processing log [0x1:0x31:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1777051531.528465:0:109205:0:(llog.c:858:llog_process_thread()) stop processing plain [0x1:0x31:0x0] index 3 count 3 00000040:00080000:0.0:1777051531.528476:0:109205:0:(llog.c:858:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 3 00000100:00100000:1.0:1777051531.531621:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051531.531917:0:46501:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426136576 00000100:00100000:3.0:1777051531.531928:0:46501:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426136576 00000100:00100000:3.0:1777051531.531988:0:46501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3445 00000100:00100000:3.0:1777051531.532001:0:46501:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f298e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+20:141778:x1863365426136576:12345-192.168.201.46@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1777051531.532557:0:46501:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f298e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+21:141778:x1863365426136576:12345-192.168.201.46@tcp:35:lhsmtool_posix.0 Request processed in 555us (938us total) trans 34359738414 rc 0/0 00000100:00100000:3.0:1777051531.532567:0:46501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3445 00000040:00080000:1.0:1777051532.182753:0:104226:0:(llog.c:801:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1777051532.182767:0:104226:0:(llog_cat.c:158:llog_cat_process_common()) processing log [0x1:0x12:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1777051532.185121:0:104226:0:(llog.c:858:llog_process_thread()) stop processing plain [0x1:0x12:0x0] index 64768 count 1 00000040:00080000:1.0:1777051532.185144:0:104226:0:(llog.c:858:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:1.0:1777051532.440122:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1777051532.566548:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7c9a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3678:1863365452730752:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1777051532.566549:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f298700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452730624:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1777051532.566653:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051532.567045:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051532.567103:0:6585:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452730624 00000100:00100000:1.0:1777051532.567113:0:6585:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452730624 00000100:00100000:1.0:1777051532.567163:0:6585:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452730752 00000100:00100000:1.0:1777051532.567167:0:6585:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452730752 00000100:00100000:1.0:1777051532.567193:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8371 00000100:00100000:1.0:1777051532.567204:0:6585:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da44494000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3677:x1863365452730624:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1777051532.567243:0:6585:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4194304 pending 0 free 1441529856 avail 1295290368 00000100:00100000:2.0:1777051532.567371:0:47208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8372 00000100:00100000:2.0:1777051532.567391:0:47208:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f299500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+5:3678:x1863365452730752:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1777051532.567422:0:47208:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4194304 pending 0 free 1446141952 avail 1299902464 00000100:00100000:2.0:1777051532.567487:0:47208:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f299500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+5:3678:x1863365452730752:12345-0@lo:41:osp-pre-1-0.0 Request processed in 102us (460us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051532.567500:0:47208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8372 00000100:00100000:1.0:1777051532.567599:0:6585:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da44494000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3677:x1863365452730624:12345-0@lo:41:osp-pre-0-1.0 Request processed in 393us (945us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051532.567611:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8371 00000100:00100000:0.0:1777051532.567614:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f298700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452730624:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1777051532.567678:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7c9a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3678:1863365452730752:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1777051532.568497:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7fd65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3678:1863365452731264:0@lo:400:kworker.0 00000100:00100000:3.0:1777051532.568549:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051532.568579:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7fd65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3678:1863365452731776:0@lo:400:kworker.0 00000100:00100000:3.0:1777051532.568615:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051532.568656:0:3678:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1777051532.568662:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7fd65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3680:1863365452731008:0@lo:400:kworker.0 00000100:00100000:3.0:1777051532.568674:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7fd67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3678:1863365452731136:0@lo:400:kworker.0 00000100:00100000:2.0:1777051532.568799:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7fd64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3679:1863365452730880:0@lo:400:kworker.0 00000100:00100000:2.0:1777051532.568853:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051532.568894:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7fd66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3679:1863365452731392:0@lo:400:kworker.0 00000100:00100000:1.0:1777051532.568932:0:21368:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452731264 00000100:00100000:1.0:1777051532.568942:0:21368:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452731264 00000100:00100000:2.0:1777051532.568951:0:109182:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452730880 00000100:00100000:2.0:1777051532.568961:0:109182:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452730880 00000100:00100000:1.0:1777051532.569020:0:21368:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452731776 00000100:00100000:1.0:1777051532.569029:0:21368:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452731776 00000100:00100000:2.0:1777051532.569035:0:109182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1777051532.569052:0:109182:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7d97b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9351a01-5b0e-4470-97fd-58b9b4b312a2+23:3679:x1863365452730880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777051532.569081:0:21368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13552 00000100:00100000:1.0:1777051532.569098:0:21368:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d944e10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3678:x1863365452731264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777051532.569128:0:109182:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7d97b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9351a01-5b0e-4470-97fd-58b9b4b312a2+23:3679:x1863365452730880:12345-0@lo:400:kworker.0 Request processed in 79us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051532.569143:0:109182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1777051532.569485:0:21368:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d944e10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3678:x1863365452731264:12345-0@lo:400:kworker.0 Request processed in 81us (624us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051532.569498:0:21368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13552 00000100:00100000:1.0:1777051532.569526:0:21368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13553 00000100:00100000:1.0:1777051532.569539:0:21368:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d944e10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3678:x1863365452731776:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1777051532.569551:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1777051532.569558:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051532.571844:0:21368:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d944e10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3678:x1863365452731776:12345-0@lo:400:kworker.0 Request processed in 2304us (3224us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051532.571858:0:21368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13553 00000100:00100000:1.0:1777051532.571886:0:21368:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452731008 00000100:00100000:1.0:1777051532.571892:0:21368:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452731008 00000100:00100000:0.0:1777051532.571924:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7fd64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3680:1863365452731520:0@lo:400:kworker.0 00000100:00100000:1.0:1777051532.571961:0:21368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13554 00000100:00100000:1.0:1777051532.571975:0:21368:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da44495c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3680:x1863365452731008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777051532.571986:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051532.572035:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7fd67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3680:1863365452732032:0@lo:400:kworker.0 00000100:00100000:1.0:1777051532.572066:0:21368:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da44495c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3680:x1863365452731008:12345-0@lo:400:kworker.0 Request processed in 93us (3317us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051532.572081:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051532.572091:0:21368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13554 00000100:00100000:0.0:1777051532.572096:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051532.572122:0:21368:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452731136 00000100:00100000:1.0:1777051532.572130:0:21368:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452731136 00000100:00100000:3.0:1777051532.572146:0:27887:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452731520 00000100:00100000:3.0:1777051532.572156:0:27887:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452731520 00000100:00100000:0.0:1777051532.572177:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7fd65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3680:1863365452731008:0@lo:400:kworker.0 00000100:00100000:1.0:1777051532.572213:0:21368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13555 00000100:00100000:1.0:1777051532.572232:0:21368:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d944e11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3678:x1863365452731136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051532.572232:0:27887:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452732032 00000100:00100000:3.0:1777051532.572242:0:27887:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452732032 00000100:00100000:0.0:1777051532.572311:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051532.572332:0:27887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10583 00000100:00100000:3.0:1777051532.572350:0:27887:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da44495f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3680:x1863365452731520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777051532.572354:0:21368:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d944e11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3678:x1863365452731136:12345-0@lo:400:kworker.0 Request processed in 126us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051532.572365:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7fd65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452731904:0@lo:400:kworker.0 00000100:00100000:1.0:1777051532.572377:0:21368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13555 00000100:00100000:0.0:1777051532.572437:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051532.572443:0:21368:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452731392 00000100:00100000:1.0:1777051532.572452:0:21368:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452731392 00000100:00100000:3.0:1777051532.572457:0:27887:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da44495f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3680:x1863365452731520:12345-0@lo:400:kworker.0 Request processed in 110us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051532.572474:0:27887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10583 00000100:00100000:0.0:1777051532.572508:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7fd64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3679:1863365452730880:0@lo:400:kworker.0 00000100:00100000:1.0:1777051532.572518:0:21368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13556 00000100:00100000:1.0:1777051532.572536:0:21368:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da44495500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3679:x1863365452731392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051532.572546:0:27887:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452731904 00000100:00100000:3.0:1777051532.572556:0:27887:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452731904 00000100:00080000:0.0:1777051532.572594:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1777051532.572603:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1777051532.572609:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1777051532.572615:0:21368:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da44495500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3679:x1863365452731392:12345-0@lo:400:kworker.0 Request processed in 82us (303us total) trans 0 rc 0/0 00000100:00080000:0.0:1777051532.572617:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1777051532.572625:0:27887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10584 00000100:00100000:1.0:1777051532.572640:0:21368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13556 00000100:00100000:3.0:1777051532.572648:0:27887:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da44497800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3680:x1863365452732032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777051532.572672:0:8470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10585 00000100:00100000:0.0:1777051532.572692:0:8470:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fd65880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3679:x1863365452731904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777051532.572991:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7fd66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3679:1863365452731392:0@lo:400:kworker.0 00000100:00100000:3.0:1777051532.573353:0:27887:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da44497800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3680:x1863365452732032:12345-0@lo:400:kworker.0 Request processed in 694us (1243us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051532.573374:0:27887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10584 00000100:00100000:2.0:1777051532.573778:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7fd67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3678:1863365452731136:0@lo:400:kworker.0 00000100:00100000:1.0:1777051532.573789:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7fd64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3680:1863365452731520:0@lo:400:kworker.0 00000100:00100000:2.0:1777051532.573797:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7fd67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452731648:0@lo:400:kworker.0 00000100:00100000:1.0:1777051532.573820:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7fd67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3680:1863365452732032:0@lo:400:kworker.0 00000100:00100000:0.0:1777051532.573826:0:8470:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fd65880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3679:x1863365452731904:12345-0@lo:400:kworker.0 Request processed in 1137us (1389us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051532.573849:0:8470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10585 00000100:00100000:2.0:1777051532.573875:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051532.573907:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7fd65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452731904:0@lo:400:kworker.0 00000100:00100000:2.0:1777051532.573929:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7fd64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3678:1863365452732160:0@lo:400:kworker.0 00000100:00100000:1.0:1777051532.573944:0:8471:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452731648 00000100:00100000:1.0:1777051532.573953:0:8471:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452731648 00000100:00100000:2.0:1777051532.573979:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051532.574044:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10586 00000100:00080000:0.0:1777051532.574054:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1777051532.574061:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7fd65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3678:1863365452731264:0@lo:400:kworker.0 00000100:00100000:1.0:1777051532.574063:0:8471:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7c9a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3678:x1863365452731648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777051532.574102:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7fd65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3678:1863365452731776:0@lo:400:kworker.0 00000100:00100000:2.0:1777051532.574153:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7fd67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452731648:0@lo:400:kworker.0 00000100:00100000:1.0:1777051532.574156:0:8471:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7c9a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3678:x1863365452731648:12345-0@lo:400:kworker.0 Request processed in 96us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051532.574175:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10586 00000100:00100000:3.0:1777051532.574193:0:46494:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452732160 00000100:00100000:3.0:1777051532.574242:0:46494:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452732160 00000100:00100000:3.0:1777051532.574335:0:46494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13557 00000100:00100000:3.0:1777051532.574348:0:46494:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f42d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000-lwp-MDT0000_UUID+5:3678:x1863365452732160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051532.574418:0:46494:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f42d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000-lwp-MDT0000_UUID+5:3678:x1863365452732160:12345-0@lo:400:kworker.0 Request processed in 72us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051532.574430:0:46494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13557 00000100:00100000:0.0:1777051532.574564:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7fd64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3678:1863365452732160:0@lo:400:kworker.0 00000100:00100000:3.0:1777051533.078539:0:3677:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1777051533.078571:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d944e11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3677:1863365452732288:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1777051533.078658:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94f42dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452732416:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1777051533.078696:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051533.079066:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051533.079137:0:8473:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452732288 00000100:00100000:2.0:1777051533.079150:0:8473:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452732288 00000100:00100000:2.0:1777051533.079221:0:8473:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452732416 00000100:00100000:2.0:1777051533.079227:0:8473:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452732416 00000100:00100000:2.0:1777051533.079317:0:8473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5738 00000100:00100000:1.0:1777051533.079332:0:10113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5739 00000100:00100000:2.0:1777051533.079338:0:8473:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d944e12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3677:x1863365452732288:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1777051533.079357:0:10113:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f29a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3679:x1863365452732416:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1777051533.079383:0:8473:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 515963584 pending 0 free 3860574208 avail 3629051904 00002000:00000024:1.0:1777051533.079416:0:10113:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 489208512 pending 0 free 3642707968 avail 3411185664 00000100:00100000:2.0:1777051533.079476:0:8473:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d944e12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3677:x1863365452732288:12345-0@lo:13:osp-pre-0-0.0 Request processed in 143us (780us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051533.079490:0:8473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5738 00000100:00100000:1.0:1777051533.079517:0:10113:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f29a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3679:x1863365452732416:12345-0@lo:13:osp-pre-1-0.0 Request processed in 167us (449us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051533.079530:0:10113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5739 00000100:00100000:3.0:1777051533.079552:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d944e11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3677:1863365452732288:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1777051533.080155:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94f42dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452732416:0@lo:13:osp-pre-1-0.0 00000040:00080000:1.0:1777051533.286776:0:110435:0:(llog.c:801:llog_process_thread()) index: 6, lh_last_idx: 7 synced_idx: 0 lgh_last_idx: 7 00000040:00080000:1.0:1777051533.286789:0:110435:0:(llog_cat.c:158:llog_cat_process_common()) processing log [0x1:0x2b:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1777051533.286850:0:110435:0:(llog.c:858:llog_process_thread()) stop processing plain [0x1:0x2b:0x0] index 12 count 3 00000040:00080000:1.0:1777051533.286869:0:110435:0:(llog.c:801:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:1.0:1777051533.286874:0:110435:0:(llog_cat.c:158:llog_cat_process_common()) processing log [0x1:0x31:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1777051533.286915:0:110435:0:(llog.c:858:llog_process_thread()) stop processing plain [0x1:0x31:0x0] index 3 count 3 00000040:00080000:1.0:1777051533.286923:0:110435:0:(llog.c:858:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 3 00000100:00100000:3.0:1777051533.344795:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051533.344903:0:6579:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426136832 00000100:00100000:1.0:1777051533.344919:0:6579:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426136832 00000100:00080000:2.0:1777051533.345024:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1777051533.345055:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112512 00000100:00100000:1.0:1777051533.345074:0:6579:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d944e11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+15:141787:x1863365426136832:12345-192.168.201.46@tcp:101:lfs.0 00010000:00010000:1.0:1777051533.345106:0:6579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777051533.345156:0:6579:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502dba00/0x85f51a6b96717f8f lrc: 2/0,0 mode: --/CR res: [0x2000032e3:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6bc8 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051533.345350:0:6579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502dbe00/0x85f51a6b96717f96 lrc: 3/0,1 mode: --/PW res: [0x2000032e3:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051533.345393:0:6579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502dbe00/0x85f51a6b96717f96 lrc: 3/0,1 mode: PW/PW res: [0x2000032e3:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051533.345415:0:6579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502dbe00/0x85f51a6b96717f96 lrc: 3/0,1 mode: PW/PW res: [0x2000032e3:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1777051533.345434:0:6579:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000032e3:0xe:0x0]: returning size 0 00010000:00010000:1.0:1777051533.345596:0:6579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502dba00/0x85f51a6b96717f8f lrc: 0/0,0 mode: --/CR res: [0x2000032e3:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6bc8 expref: 18 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051533.345631:0:6579:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502dbe00/0x85f51a6b96717f96 lrc: 3/0,0 mode: PW/PW res: [0x2000032e3:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6bc8 expref: 17 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051533.345655:0:6579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e3:0xe:0x0].0x0 (ffff99da45738f00) 00010000:00010000:1.0:1777051533.345662:0:6579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1777051533.345720:0:6579:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d9502dbe00, rc 0) 00000100:00100000:1.0:1777051533.346137:0:6579:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d944e11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+17:141787:x1863365426136832:12345-192.168.201.46@tcp:101:lfs.0 Request processed in 1065us (1349us total) trans 34359738415 rc 0/0 00000100:00100000:1.0:1777051533.346150:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112512 00000100:00100000:0.0:1777051533.350399:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051533.350446:0:55805:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426136960 00000100:00100000:2.0:1777051533.350457:0:55805:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426136960 00000100:00080000:0.0:1777051533.350523:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1777051533.350561:0:55805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 8127 00000100:00100000:2.0:1777051533.350581:0:55805:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fd64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+31:2437:x1863365426136960:12345-192.168.201.46@tcp:1:lfs.0 00010000:00010000:2.0:1777051533.350631:0:55805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007b052300/0x85f51a6b96717fa4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x203:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051533.350660:0:55805:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000046b5e69f/0x85f51a6b96717f3b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x203:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6ba5 expref: 31 pid: 8468 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051533.350678:0:55805:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000061813a3d/0x85f51a6b96717f6c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x203:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6bba expref: 30 pid: 8471 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051533.350690:0:55805:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777051533.350693:0:55805:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777051533.350697:0:55805:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007b052300/0x85f51a6b96717fa4 lrc: 5/0,1 mode: --/PW res: [0x2c0000401:0x203:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 55805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051533.350740:0:55805:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000061813a3d/0x85f51a6b96717f6c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x203:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6bba expref: 30 pid: 8471 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051533.350756:0:55805:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000061813a3d/0x85f51a6b96717f6c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x203:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6bba expref: 30 pid: 8471 timeout: 8262 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051533.350773:0:55805:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94f42dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:55805:1863365452732544:192.168.201.46@tcp:104: 00010000:00010000:2.0:1777051533.350906:0:55805:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000046b5e69f/0x85f51a6b96717f3b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x203:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6ba5 expref: 31 pid: 8468 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051533.350924:0:55805:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000046b5e69f/0x85f51a6b96717f3b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x203:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6ba5 expref: 31 pid: 8468 timeout: 8262 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051533.350941:0:55805:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7fd61c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:55805:1863365452732672:192.168.201.46@tcp:104: 00000100:00100000:2.0:1777051533.351006:0:55805:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d95c67be40 going to sleep for 11 seconds 00000001:00080000:2.0:1777051533.352699:0:109175:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 34359738415 is committed 00000001:00080000:2.0:1777051533.352950:0:109175:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 34359738414 is committed 00010000:00010000:1.0:1777051533.353113:0:3664:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502da800/0x85f51a6b96717ea1 lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e2:0xe:0x0].0x63a4dde3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051533.353133:0:3664:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502da800/0x85f51a6b96717ea1 lrc: 2/0,0 mode: TXN/TXN res: [0x2000032e2:0xe:0x0].0x63a4dde3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051533.353156:0:3664:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502da800/0x85f51a6b96717ea1 lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e2:0xe:0x0].0x63a4dde3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051533.353167:0:3664:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d9502da800 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:1.0:1777051533.353175:0:3664:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502da800/0x85f51a6b96717ea1 lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e2:0xe:0x0].0x63a4dde3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051533.353189:0:3664:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502da800/0x85f51a6b96717ea1 lrc: 4/0,0 mode: TXN/TXN res: [0x2000032e2:0xe:0x0].0x63a4dde3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051533.353212:0:3664:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0xe:0x0].0x63a4dde3 (ffff99d94e592a00) 00010000:00010000:1.0:1777051533.353217:0:3664:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777051533.353224:0:3664:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502da800/0x85f51a6b96717ea1 lrc: 2/0,0 mode: --/TXN res: [0x2000032e2:0xe:0x0].0x63a4dde3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051533.353238:0:3664:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502da800/0x85f51a6b96717ea1 lrc: 0/0,0 mode: --/TXN res: [0x2000032e2:0xe:0x0].0x63a4dde3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051533.353324:0:3663:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cf000/0x85f51a6b96717e38 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5d66f174 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051533.353337:0:3663:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cf000/0x85f51a6b96717e38 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5d66f174 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051533.353344:0:3663:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cf000/0x85f51a6b96717e38 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5d66f174 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051533.353351:0:3663:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da7d5cf000 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:0.0:1777051533.353358:0:3663:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cf000/0x85f51a6b96717e38 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5d66f174 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051533.353366:0:3663:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cf000/0x85f51a6b96717e38 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5d66f174 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051533.353379:0:3663:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5d66f174 (ffff99d9413d2d00) 00010000:00010000:0.0:1777051533.353383:0:3663:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777051533.353387:0:3663:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cf000/0x85f51a6b96717e38 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x5d66f174 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051533.353394:0:3663:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cf000/0x85f51a6b96717e38 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x5d66f174 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051533.353420:0:3663:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce200/0x85f51a6b96717e3f lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e2:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051533.353427:0:3663:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce200/0x85f51a6b96717e3f lrc: 2/0,0 mode: TXN/TXN res: [0x2000032e2:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051533.353433:0:3663:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce200/0x85f51a6b96717e3f lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e2:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051533.353440:0:3663:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da7d5ce200 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:0.0:1777051533.353443:0:3663:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce200/0x85f51a6b96717e3f lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e2:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051533.353453:0:3663:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce200/0x85f51a6b96717e3f lrc: 4/0,0 mode: TXN/TXN res: [0x2000032e2:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051533.353468:0:3663:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0xe:0x0].0x0 (ffff99d9413d2100) 00010000:00010000:0.0:1777051533.353473:0:3663:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777051533.353477:0:3663:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce200/0x85f51a6b96717e3f lrc: 2/0,0 mode: --/TXN res: [0x2000032e2:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051533.353486:0:3663:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce200/0x85f51a6b96717e3f lrc: 0/0,0 mode: --/TXN res: [0x2000032e2:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051533.355531:0:55805:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94f42dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:55805:1863365452732544:192.168.201.46@tcp:104: 00000100:00100000:0.0:1777051533.355606:0:55805:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7fd61c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:55805:1863365452732672:192.168.201.46@tcp:104: 00010000:00010000:0.0:1777051533.355662:0:55805:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000007b052300/0x85f51a6b96717fa4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x203:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 55805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051533.355674:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051533.355749:0:9550:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426137088 00000100:00100000:1.0:1777051533.355769:0:9550:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426137088 00010000:00010000:1.0:1777051533.356151:0:9550:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000061813a3d/0x85f51a6b96717f6c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x203:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6bba expref: 31 pid: 8471 timeout: 8262 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051533.356493:0:9550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3989 00000100:00100000:1.0:1777051533.356508:0:9550:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f298000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+31:2436:x1863365426137088:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1777051533.356527:0:9550:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1777051533.356552:0:9550:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000061813a3d/0x85f51a6b96717f6c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x203:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6bba expref: 31 pid: 8471 timeout: 8262 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051533.356575:0:9550:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000061813a3d/0x85f51a6b96717f6c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x203:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6bba expref: 31 pid: 8471 timeout: 8262 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051533.356603:0:9550:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000061813a3d/0x85f51a6b96717f6c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x203:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6bba expref: 31 pid: 8471 timeout: 8262 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051533.356624:0:9550:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1777051533.356675:0:9550:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f298000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+30:2436:x1863365426137088:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 171us (1015us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051533.356688:0:9550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3989 00000100:00080000:0.0:1777051533.357605:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1777051533.357669:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051533.357972:0:47827:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426137216 00000100:00100000:2.0:1777051533.357985:0:47827:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426137216 00010000:00010000:2.0:1777051533.358033:0:47827:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000046b5e69f/0x85f51a6b96717f3b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x203:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6ba5 expref: 32 pid: 8468 timeout: 8262 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051533.358099:0:47827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3990 00000100:00100000:2.0:1777051533.358133:0:47827:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fd64380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+32:2436:x1863365426137216:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1777051533.358154:0:47827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777051533.358182:0:47827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000046b5e69f/0x85f51a6b96717f3b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x203:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6ba5 expref: 32 pid: 8468 timeout: 8262 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051533.358246:0:47827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000046b5e69f/0x85f51a6b96717f3b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x203:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6ba5 expref: 32 pid: 8468 timeout: 8262 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051533.358312:0:47827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000046b5e69f/0x85f51a6b96717f3b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x203:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6ba5 expref: 32 pid: 8468 timeout: 8262 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051533.358345:0:47827:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777051533.358350:0:47827:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777051533.358358:0:47827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007b052300/0x85f51a6b96717fa4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x203:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 55805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051533.358376:0:47827:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007b052300/0x85f51a6b96717fa4 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x203:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 55805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051533.358434:0:47827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1777051533.358515:0:55805:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000007b052300/0x85f51a6b96717fa4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x203:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 55805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051533.358515:0:47827:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fd64380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+31:2436:x1863365426137216:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 382us (846us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051533.358555:0:47827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3990 00010000:00010000:0.0:1777051533.358563:0:55805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007b052300/0x85f51a6b96717fa4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x203:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 55805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051533.358629:0:55805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007b052300/0x85f51a6b96717fa4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x203:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 55805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051533.358645:0:55805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007b052300/0x85f51a6b96717fa4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x203:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 55805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051533.358658:0:55805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007b052300/0x85f51a6b96717fa4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x203:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 55805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051533.358669:0:55805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94f69a400 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:0.0:1777051533.358675:0:55805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007b052300/0x85f51a6b96717fa4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x203:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 55805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051533.358687:0:55805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007b052300/0x85f51a6b96717fa4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x203:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 55805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051533.358711:0:55805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007b052300/0x85f51a6b96717fa4 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x203:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 55805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051533.358721:0:55805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007b052300/0x85f51a6b96717fa4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x203:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 55805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051533.359124:0:55805:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fd64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+30:2437:x1863365426136960:12345-192.168.201.46@tcp:1:lfs.0 Request processed in 8547us (8734us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051533.359138:0:55805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 8127 00000100:00100000:1.0:1777051533.365364:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051533.365510:0:24269:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426137472 00000100:00100000:2.0:1777051533.365524:0:24269:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426137472 00000100:00100000:2.0:1777051533.365610:0:24269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3446 00000100:00100000:2.0:1777051533.365630:0:24269:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da6ff03050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+14:141787:x1863365426137472:12345-192.168.201.46@tcp:35:lfs.0 00000004:00010000:2.0:1777051533.365713:0:24269:0:(mdt_open.c:1994:mdt_hsm_release()) ### [0x2000032e3:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502dbe00/0x85f51a6b96717f96 lrc: 3/0,0 mode: PW/PW res: [0x2000032e3:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6bc8 expref: 14 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1777051533.366001:0:24269:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 34359738416 00000001:00080000:2.0:1777051533.366618:0:24269:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 34359738417 00010000:00010000:2.0:1777051533.366681:0:24269:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69a000/0x85f51a6b96717fab lrc: 3/0,1 mode: --/EX res: [0x2000032e3:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051533.366705:0:24269:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162f400/0x85f51a6b96717ea8 lrc: 2/0,0 mode: PR/PR res: [0x2000032e3:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6b7b expref: 12 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051533.366720:0:24269:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99d950711c00/0x85f51a6b96717f34 lrc: 2/0,0 mode: PR/PR res: [0x2000032e3:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6b9e expref: 17 pid: 21368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051533.366736:0:24269:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69a000/0x85f51a6b96717fab lrc: 5/0,1 mode: --/EX res: [0x2000032e3:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051533.366787:0:24269:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99d950711c00/0x85f51a6b96717f34 lrc: 3/0,0 mode: PR/PR res: [0x2000032e3:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6b9e expref: 17 pid: 21368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051533.366811:0:24269:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950711c00/0x85f51a6b96717f34 lrc: 4/0,0 mode: PR/PR res: [0x2000032e3:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6b9e expref: 17 pid: 21368 timeout: 8262 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051533.366833:0:24269:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7fd61c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:24269:1863365452732800:192.168.201.46@tcp:104: 00010000:00010000:2.0:1777051533.366962:0:24269:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162f400/0x85f51a6b96717ea8 lrc: 3/0,0 mode: PR/PR res: [0x2000032e3:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6b7b expref: 12 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051533.366981:0:24269:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162f400/0x85f51a6b96717ea8 lrc: 4/0,0 mode: PR/PR res: [0x2000032e3:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6b7b expref: 12 pid: 10328 timeout: 8262 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051533.366999:0:24269:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95f659c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:24269:1863365452732928:192.168.201.46@tcp:104: 00000100:00100000:2.0:1777051533.367046:0:24269:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d95c67bf00 going to sleep for 11 seconds 00000100:00100000:2.0:1777051533.372529:0:24269:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7fd61c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:24269:1863365452732800:192.168.201.46@tcp:104: 00000100:00100000:2.0:1777051533.372586:0:24269:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95f659c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:24269:1863365452732928:192.168.201.46@tcp:104: 00010000:00010000:2.0:1777051533.372640:0:24269:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69a000/0x85f51a6b96717fab lrc: 3/0,1 mode: --/EX res: [0x2000032e3:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24269 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051533.372788:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051533.372834:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051533.372920:0:6565:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426137600 00000100:00100000:0.0:1777051533.372930:0:6565:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426137600 00010000:00010000:0.0:1777051533.372970:0:6565:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d950711c00/0x85f51a6b96717f34 lrc: 4/0,0 mode: PR/PR res: [0x2000032e3:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6b9e expref: 18 pid: 21368 timeout: 8262 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051533.373020:0:6566:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426137728 00000100:00100000:0.0:1777051533.373029:0:6565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3991 00000100:00100000:3.0:1777051533.373034:0:6566:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426137728 00000100:00100000:0.0:1777051533.373049:0:6565:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f29bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+18:2437:x1863365426137600:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1777051533.373072:0:6565:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777051533.373084:0:6565:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99d950711c00/0x85f51a6b96717f34 lrc: 4/0,0 mode: PR/PR res: [0x2000032e3:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6b9e expref: 18 pid: 21368 timeout: 8262 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051533.373098:0:6566:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162f400/0x85f51a6b96717ea8 lrc: 4/0,0 mode: PR/PR res: [0x2000032e3:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6b7b expref: 13 pid: 10328 timeout: 8262 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051533.373113:0:6565:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99d950711c00/0x85f51a6b96717f34 lrc: 3/0,0 mode: PR/PR res: [0x2000032e3:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6b9e expref: 18 pid: 21368 timeout: 8262 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051533.373151:0:6565:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d950711c00/0x85f51a6b96717f34 lrc: 0/0,0 mode: --/PR res: [0x2000032e3:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6b9e expref: 18 pid: 21368 timeout: 8262 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051533.373165:0:6566:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3992 00010000:00010000:0.0:1777051533.373185:0:6565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e3:0xe:0x0].0x0 (ffff99da45738f00) 00010000:00010000:0.0:1777051533.373198:0:6565:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69a000/0x85f51a6b96717fab lrc: 3/0,1 mode: --/EX res: [0x2000032e3:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24269 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051533.373210:0:6566:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f29ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+13:2436:x1863365426137728:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1777051533.373216:0:6565:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69a000/0x85f51a6b96717fab lrc: 3/0,1 mode: --/EX res: [0x2000032e3:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051533.373225:0:6565:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1777051533.373228:0:6566:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777051533.373314:0:6566:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162f400/0x85f51a6b96717ea8 lrc: 4/0,0 mode: PR/PR res: [0x2000032e3:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6b7b expref: 13 pid: 10328 timeout: 8262 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051533.373337:0:6566:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162f400/0x85f51a6b96717ea8 lrc: 3/0,0 mode: PR/PR res: [0x2000032e3:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6b7b expref: 13 pid: 10328 timeout: 8262 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051533.373364:0:6566:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162f400/0x85f51a6b96717ea8 lrc: 0/0,0 mode: --/PR res: [0x2000032e3:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6b7b expref: 13 pid: 10328 timeout: 8262 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051533.373387:0:6566:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e3:0xe:0x0].0x0 (ffff99da45738f00) 00000100:00100000:0.0:1777051533.373388:0:6565:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f29bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+17:2437:x1863365426137600:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 340us (597us total) trans 0 rc 0/0 00010000:00010000:3.0:1777051533.373400:0:6566:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69a000/0x85f51a6b96717fab lrc: 3/0,1 mode: --/EX res: [0x2000032e3:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24269 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051533.373412:0:6565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3991 00010000:00010000:3.0:1777051533.373424:0:6566:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69a000/0x85f51a6b96717fab lrc: 3/0,1 mode: EX/EX res: [0x2000032e3:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 24269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051533.373438:0:6566:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69a000/0x85f51a6b96717fab lrc: 4/0,1 mode: EX/EX res: [0x2000032e3:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 24269 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1777051533.373455:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1777051533.373481:0:6566:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1777051533.373524:0:24269:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69a000/0x85f51a6b96717fab lrc: 3/0,1 mode: EX/EX res: [0x2000032e3:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24269 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051533.373529:0:6566:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f29ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+12:2436:x1863365426137728:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 327us (692us total) trans 0 rc 0/0 00010000:00010000:2.0:1777051533.373555:0:24269:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69a000/0x85f51a6b96717fab lrc: 3/0,1 mode: EX/EX res: [0x2000032e3:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24269 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051533.373561:0:6566:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3992 00000001:00080000:2.0:1777051533.374027:0:24269:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 34359738418 00000001:00080000:2.0:1777051533.374565:0:24269:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 34359738419 00000001:00080000:2.0:1777051533.374645:0:24269:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 34359738420 00000100:00100000:2.0:1777051533.374760:0:24269:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95f659c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:24269:1863365452733056:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:2.0:1777051533.374824:0:24269:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051533.374868:0:24269:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d95c67b0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1777051533.375010:0:46500:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452733056 00000100:00100000:3.0:1777051533.375019:0:46500:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452733056 00000100:00100000:3.0:1777051533.375091:0:46500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8373 00000100:00100000:3.0:1777051533.375107:0:46500:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fd61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+5:24269:x1863365452733056:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:3.0:1777051533.375239:0:46500:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fd61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+5:24269:x1863365452733056:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 133us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051533.375319:0:46500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8373 00000100:00100000:0.0:1777051533.375630:0:24269:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95f659c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:24269:1863365452733056:0@lo:1000:mdt_rdpg00_002.0 00000001:00080000:0.0:1777051533.375699:0:24269:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 34359738421 00010000:00010000:0.0:1777051533.375744:0:24269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69a000/0x85f51a6b96717fab lrc: 3/0,1 mode: EX/EX res: [0x2000032e3:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051533.375758:0:24269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69a000/0x85f51a6b96717fab lrc: 2/0,0 mode: EX/EX res: [0x2000032e3:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051533.375769:0:24269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69a000/0x85f51a6b96717fab lrc: 3/0,0 mode: EX/EX res: [0x2000032e3:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051533.375781:0:24269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94f69a000 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:0.0:1777051533.375789:0:24269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69a000/0x85f51a6b96717fab lrc: 3/0,0 mode: EX/EX res: [0x2000032e3:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051533.375801:0:24269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69a000/0x85f51a6b96717fab lrc: 4/0,0 mode: EX/EX res: [0x2000032e3:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051533.375821:0:24269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e3:0xe:0x0].0x0 (ffff99da45738f00) 00010000:00010000:0.0:1777051533.375826:0:24269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1777051533.375834:0:24269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69a000/0x85f51a6b96717fab lrc: 2/0,0 mode: --/EX res: [0x2000032e3:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051533.375845:0:24269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69a000/0x85f51a6b96717fab lrc: 0/0,0 mode: --/EX res: [0x2000032e3:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24269 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1777051533.375995:0:24269:0:(mdd_object.c:4010:mdd_close()) Object [0x2000032e2:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1777051533.376097:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2f:0x0].2, 64 off8320 00000004:00080000:0.0:1777051533.376117:0:24269:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 8162568918269ns, next at 8163568914176ns, rc = 0 00000001:00080000:0.0:1777051533.376128:0:24269:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 34359738422 00010000:00010000:0.0:1777051533.376170:0:24269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e3:0xe:0x0].0x0 (ffff99da45738f00) 00010000:00010000:0.0:1777051533.376176:0:24269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1777051533.376186:0:24269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502dbe00/0x85f51a6b96717f96 lrc: 0/0,0 mode: --/PW res: [0x2000032e3:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6bc8 expref: 21 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051533.376404:0:24269:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da6ff03050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+20:141787:x1863365426137472:12345-192.168.201.46@tcp:35:lfs.0 Request processed in 10778us (11044us total) trans 34359738423 rc 0/0 00000100:00100000:0.0:1777051533.376420:0:24269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3446 00000020:00080000:0.0:1777051533.376427:0:24269:0:(tgt_main.c:783:tgt_ses_key_exit()) total 8 transactions per RPC 00010000:00010000:0.0:1777051533.465416:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1777051533.592784:0:109205:0:(llog.c:801:llog_process_thread()) index: 6, lh_last_idx: 7 synced_idx: 0 lgh_last_idx: 7 00000040:00080000:2.0:1777051533.592795:0:109205:0:(llog_cat.c:158:llog_cat_process_common()) processing log [0x1:0x2b:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1777051533.592952:0:109205:0:(llog.c:858:llog_process_thread()) stop processing plain [0x1:0x2b:0x0] index 12 count 2 00000040:00080000:2.0:1777051533.592967:0:109205:0:(llog.c:801:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:2.0:1777051533.592969:0:109205:0:(llog_cat.c:158:llog_cat_process_common()) processing log [0x1:0x31:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1777051533.592981:0:109205:0:(llog.c:858:llog_process_thread()) stop processing plain [0x1:0x31:0x0] index 3 count 3 00000040:00080000:2.0:1777051533.592984:0:109205:0:(llog.c:858:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 3 00000100:00100000:1.0:1777051534.244821:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051534.244930:0:6580:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426137984 00000100:00100000:3.0:1777051534.244946:0:6580:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426137984 00000100:00100000:3.0:1777051534.245045:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112513 00000100:00100000:3.0:1777051534.245063:0:6580:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f299180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+20:141796:x1863365426137984:12345-192.168.201.46@tcp:101:cat.0 00010000:00010000:3.0:1777051534.245610:0:6580:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777051534.245642:0:6580:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cec00/0x85f51a6b96717fb2 lrc: 2/0,0 mode: --/CR res: [0x2000032e2:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6bcf expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051534.245773:0:6580:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce000/0x85f51a6b96717fb9 lrc: 3/1,0 mode: --/CR res: [0x2000032e2:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051534.245796:0:6580:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce000/0x85f51a6b96717fb9 lrc: 3/1,0 mode: CR/CR res: [0x2000032e2:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051534.245823:0:6580:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce000/0x85f51a6b96717fb9 lrc: 3/1,0 mode: CR/CR res: [0x2000032e2:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051534.245846:0:6580:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cea00/0x85f51a6b96717fc0 lrc: 3/1,0 mode: --/PR res: [0x2000032e2:0xe:0x0].0x63a4dde3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051534.245859:0:6580:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cea00/0x85f51a6b96717fc0 lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0xe:0x0].0x63a4dde3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051534.245871:0:6580:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cea00/0x85f51a6b96717fc0 lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0xe:0x0].0x63a4dde3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051534.246020:0:6580:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce800/0x85f51a6b96717fc7 lrc: 3/1,0 mode: --/PR res: [0x2000032e3:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051534.246036:0:6580:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce800/0x85f51a6b96717fc7 lrc: 3/1,0 mode: PR/PR res: [0x2000032e3:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051534.246048:0:6580:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce800/0x85f51a6b96717fc7 lrc: 3/1,0 mode: PR/PR res: [0x2000032e3:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1777051534.246063:0:6580:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000032e3:0xe:0x0]: returning size 0 00010000:00010000:3.0:1777051534.246276:0:6580:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce000/0x85f51a6b96717fb9 lrc: 4/1,0 mode: CR/CR res: [0x2000032e2:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051534.246291:0:6580:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce000/0x85f51a6b96717fb9 lrc: 4/1,0 mode: CR/CR res: [0x2000032e2:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051534.246302:0:6580:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce000/0x85f51a6b96717fb9 lrc: 3/0,0 mode: CR/CR res: [0x2000032e2:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051534.246313:0:6580:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce000/0x85f51a6b96717fb9 lrc: 4/0,0 mode: CR/CR res: [0x2000032e2:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051534.246324:0:6580:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da7d5ce000 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:3.0:1777051534.246331:0:6580:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce000/0x85f51a6b96717fb9 lrc: 4/0,0 mode: CR/CR res: [0x2000032e2:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051534.246342:0:6580:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce000/0x85f51a6b96717fb9 lrc: 5/0,0 mode: CR/CR res: [0x2000032e2:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051534.246363:0:6580:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0xe:0x0].0x0 (ffff99d9413d2100) 00010000:00010000:3.0:1777051534.246368:0:6580:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777051534.246374:0:6580:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce000/0x85f51a6b96717fb9 lrc: 3/0,0 mode: --/CR res: [0x2000032e2:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051534.246384:0:6580:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce000/0x85f51a6b96717fb9 lrc: 0/0,0 mode: --/CR res: [0x2000032e2:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051534.246404:0:6580:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cea00/0x85f51a6b96717fc0 lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0xe:0x0].0x63a4dde3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051534.246414:0:6580:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cea00/0x85f51a6b96717fc0 lrc: 2/0,0 mode: PR/PR res: [0x2000032e2:0xe:0x0].0x63a4dde3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051534.246424:0:6580:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cea00/0x85f51a6b96717fc0 lrc: 3/0,0 mode: PR/PR res: [0x2000032e2:0xe:0x0].0x63a4dde3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051534.246433:0:6580:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da7d5cea00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:3.0:1777051534.246438:0:6580:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cea00/0x85f51a6b96717fc0 lrc: 3/0,0 mode: PR/PR res: [0x2000032e2:0xe:0x0].0x63a4dde3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051534.246447:0:6580:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cea00/0x85f51a6b96717fc0 lrc: 4/0,0 mode: PR/PR res: [0x2000032e2:0xe:0x0].0x63a4dde3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051534.246467:0:6580:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0xe:0x0].0x63a4dde3 (ffff99d9413d0000) 00010000:00010000:3.0:1777051534.246472:0:6580:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777051534.246476:0:6580:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cea00/0x85f51a6b96717fc0 lrc: 2/0,0 mode: --/PR res: [0x2000032e2:0xe:0x0].0x63a4dde3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051534.246486:0:6580:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cea00/0x85f51a6b96717fc0 lrc: 0/0,0 mode: --/PR res: [0x2000032e2:0xe:0x0].0x63a4dde3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051534.246567:0:6580:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cec00/0x85f51a6b96717fb2 lrc: 0/0,0 mode: --/CR res: [0x2000032e2:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6bcf expref: 23 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051534.246591:0:6580:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce800/0x85f51a6b96717fc7 lrc: 3/0,0 mode: PR/PR res: [0x2000032e3:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6bcf expref: 22 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051534.246604:0:6580:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e3:0xe:0x0].0x0 (ffff99d9413d0c00) 00010000:00010000:3.0:1777051534.246608:0:6580:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1777051534.246613:0:6580:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99da7d5ce800, rc 0) 00000100:00100000:3.0:1777051534.246705:0:6580:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f299180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+22:141796:x1863365426137984:12345-192.168.201.46@tcp:101:cat.0 Request processed in 1646us (1893us total) trans 34359738424 rc 0/0 00000100:00100000:3.0:1777051534.246718:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112513 00000100:00100000:2.0:1777051534.256017:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051534.256091:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051534.256134:0:109180:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426138112 00000100:00100000:1.0:1777051534.256150:0:109180:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426138112 00000100:00100000:2.0:1777051534.256186:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051534.256321:0:109180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 95 00000100:00100000:2.0:1777051534.256334:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051534.256367:0:109180:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7d97b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29c4352d-3260-4734-909d-9ea5de9e7fa4+12:2437:x1863365426138112:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:2.0:1777051534.256394:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051534.256473:0:109180:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7d97b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29c4352d-3260-4734-909d-9ea5de9e7fa4+12:2437:x1863365426138112:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 133us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051534.256490:0:109180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 95 00000100:00100000:3.0:1777051534.256551:0:27882:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426138368 00000100:00100000:3.0:1777051534.256562:0:27882:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426138368 00000100:00100000:1.0:1777051534.256567:0:8468:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426138624 00000100:00100000:1.0:1777051534.256577:0:8468:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426138624 00000100:00100000:1.0:1777051534.256640:0:8468:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426139136 00000100:00100000:1.0:1777051534.256649:0:8468:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426139136 00000100:00100000:3.0:1777051534.256661:0:27882:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426138880 00000100:00100000:3.0:1777051534.256670:0:27882:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426138880 00000100:00100000:1.0:1777051534.256717:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10587 00000100:00100000:1.0:1777051534.256740:0:8468:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955507b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+30:2437:x1863365426138624:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:3.0:1777051534.256754:0:27882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13558 00000100:00100000:3.0:1777051534.256777:0:27882:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da4384fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+9:2437:x1863365426138368:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:1.0:1777051534.258115:0:8468:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955507b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+30:2437:x1863365426138624:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 1380us (1929us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051534.258138:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10587 00000100:00100000:2.0:1777051534.258139:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051534.258178:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10588 00000100:00100000:1.0:1777051534.258195:0:8468:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f97ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+30:2437:x1863365426139136:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:1.0:1777051534.259681:0:8468:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f97ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+30:2437:x1863365426139136:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 1485us (3284us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051534.259701:0:27882:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da4384fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+9:2437:x1863365426138368:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 2924us (3604us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051534.259717:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10588 00000100:00100000:2.0:1777051534.259719:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051534.259727:0:27882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13558 00000100:00100000:1.0:1777051534.259767:0:8468:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426138496 00000100:00100000:3.0:1777051534.259774:0:27882:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426138240 00000100:00100000:1.0:1777051534.259778:0:8468:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426138496 00000100:00100000:3.0:1777051534.259784:0:27882:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426138240 00000100:00100000:2.0:1777051534.259830:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051534.259862:0:27882:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426138752 00000100:00100000:3.0:1777051534.259869:0:27882:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426138752 00000100:00100000:1.0:1777051534.259875:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10589 00000100:00100000:1.0:1777051534.259896:0:8468:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7cd9df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+30:2437:x1863365426138496:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:3.0:1777051534.259938:0:27882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13559 00000100:00100000:3.0:1777051534.259960:0:27882:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955506a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+54:2437:x1863365426138880:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:1.0:1777051534.259973:0:8468:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7cd9df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+30:2437:x1863365426138496:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 79us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051534.259992:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051534.260002:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10589 00000100:00100000:1.0:1777051534.260038:0:8468:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426139008 00000100:00100000:3.0:1777051534.260042:0:27882:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955506a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+54:2437:x1863365426138880:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 84us (3706us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051534.260049:0:8468:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426139008 00000100:00100000:3.0:1777051534.260065:0:27882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13559 00000100:00100000:3.0:1777051534.260105:0:27882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13560 00000100:00100000:3.0:1777051534.260124:0:27882:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7cd9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+12:2437:x1863365426138240:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:1.0:1777051534.260136:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10590 00000100:00100000:1.0:1777051534.260159:0:8468:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7cd9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+16:2437:x1863365426139008:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:3.0:1777051534.260189:0:27882:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7cd9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+12:2437:x1863365426138240:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 67us (2057us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051534.260282:0:27882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13560 00000100:00100000:2.0:1777051534.260295:0:10328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13561 00000100:00100000:1.0:1777051534.260314:0:8468:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7cd9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+16:2437:x1863365426139008:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 159us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051534.260318:0:10328:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7cd9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+22:2437:x1863365426138752:12345-192.168.201.46@tcp:400:kworker.0 00000100:00080000:3.0:1777051534.260331:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1777051534.260343:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1777051534.260344:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10590 00000100:00100000:2.0:1777051534.260713:0:10328:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7cd9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+22:2437:x1863365426138752:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 402us (886us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051534.260735:0:10328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13561 00000100:00100000:2.0:1777051534.264023:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051534.264129:0:6564:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426139392 00000100:00100000:1.0:1777051534.264138:0:6564:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426139392 00000100:00100000:1.0:1777051534.264277:0:6564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13755 00000100:00100000:1.0:1777051534.264297:0:6564:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7cd9f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+22:141796:x1863365426139392:12345-192.168.201.46@tcp:103:cat.0 00010000:00010000:1.0:1777051534.264320:0:6564:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1777051534.264358:0:6564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce800/0x85f51a6b96717fc7 lrc: 0/0,0 mode: --/PR res: [0x2000032e3:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6bcf expref: 22 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051534.264388:0:6564:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e3:0xe:0x0].0x0 (ffff99d9413d0c00) 00010000:00010000:1.0:1777051534.264404:0:6564:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1777051534.264466:0:6564:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7cd9f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+21:141796:x1863365426139392:12345-192.168.201.46@tcp:103:cat.0 Request processed in 175us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051534.264480:0:6564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13755 00000100:00100000:0.0:1777051534.268158:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051534.268372:0:21368:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426139520 00000100:00100000:1.0:1777051534.268384:0:21368:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426139520 00000100:00100000:1.0:1777051534.268473:0:21368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112514 00000100:00100000:1.0:1777051534.268492:0:21368:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fd67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+21:141796:x1863365426139520:12345-192.168.201.46@tcp:58:cat.0 00010000:00010000:1.0:1777051534.268633:0:21368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502dba00/0x85f51a6b96717fd5 lrc: 3/0,1 mode: --/EX res: [0x2000032e3:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051534.268659:0:21368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502dba00/0x85f51a6b96717fd5 lrc: 3/0,1 mode: EX/EX res: [0x2000032e3:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051534.268680:0:21368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502dba00/0x85f51a6b96717fd5 lrc: 3/0,1 mode: EX/EX res: [0x2000032e3:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00020000:1.0:1777051534.268698:0:21368:0:(mdt_hsm_cdt_client.c:366:mdt_hsm_register_hal()) cfs_fail_timeout id 164 sleeping for 5000ms 00010000:00010000:0.0:1777051534.486806:0:108751:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1777051535.126678:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7fd65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452733312:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1777051535.126784:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051535.126913:0:8472:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452733312 00000100:00100000:0.0:1777051535.126927:0:8472:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452733312 00000100:00100000:0.0:1777051535.127035:0:8472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5740 00000100:00100000:0.0:1777051535.127057:0:8472:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fd65500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3677:x1863365452733312:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1777051535.127114:0:8472:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 515963584 pending 0 free 3860574208 avail 3629051904 00000100:00100000:0.0:1777051535.127189:0:8472:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fd65500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3677:x1863365452733312:12345-0@lo:13:osp-pre-0-1.0 Request processed in 139us (405us total) trans 0 rc 0/0 00000100:00080000:1.0:1777051535.127504:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1777051535.127833:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7fd65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452733312:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1777051535.127858:0:8472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5740 00000100:00100000:1.0:1777051535.128028:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d944e13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3680:1863365452733184:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1777051535.128105:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051535.128282:0:8473:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452733184 00000100:00100000:3.0:1777051535.128292:0:8473:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452733184 00000100:00080000:1.0:1777051535.128375:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1777051535.128392:0:8473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5741 00000100:00100000:3.0:1777051535.128407:0:8473:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f299c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3680:x1863365452733184:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1777051535.128436:0:8473:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 489208512 pending 0 free 3642707968 avail 3411185664 00000100:00100000:3.0:1777051535.128512:0:8473:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f299c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3680:x1863365452733184:12345-0@lo:13:osp-pre-1-1.0 Request processed in 107us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051535.128524:0:8473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5741 00000100:00100000:1.0:1777051535.128616:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d944e13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3680:1863365452733184:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1777051535.510727:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051536.534549:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051537.558710:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1777051537.687274:0:3677:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1777051537.687323:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f298380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452733440:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1777051537.687422:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051537.687743:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f298e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3680:1863365452733696:0@lo:400:kworker.0 00000100:00100000:0.0:1777051537.688259:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95aecc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3678:1863365452733952:0@lo:400:kworker.0 00000100:00100000:1.0:1777051537.688260:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f298700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3677:1863365452733824:0@lo:400:kworker.0 00000100:00100000:0.0:1777051537.688342:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051537.688387:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051537.688396:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d9418f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452734464:0@lo:400:kworker.0 00000100:00100000:1.0:1777051537.688442:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d9418f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452734336:0@lo:400:kworker.0 00000100:00100000:0.0:1777051537.688461:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051537.688514:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d9418f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3678:1863365452734976:0@lo:400:kworker.0 00000100:00100000:1.0:1777051537.688516:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051537.688577:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051537.688580:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d9418f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3677:1863365452734848:0@lo:400:kworker.0 00000100:00100000:0.0:1777051537.688659:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7cd9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452733568:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1777051537.688659:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051537.688673:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051537.688750:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051537.690034:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95aecc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3680:1863365452734208:0@lo:400:kworker.0 00000100:00100000:1.0:1777051537.690089:0:27887:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452734464 00000100:00100000:1.0:1777051537.690104:0:27887:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452734464 00000100:00100000:2.0:1777051537.690115:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051537.690160:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d9418f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3680:1863365452734720:0@lo:400:kworker.0 00000100:00100000:1.0:1777051537.690264:0:27887:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452734336 00000100:00100000:1.0:1777051537.690273:0:27887:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452734336 00000100:00100000:1.0:1777051537.690316:0:27887:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452734976 00000100:00100000:1.0:1777051537.690323:0:27887:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452734976 00000100:00100000:1.0:1777051537.690360:0:27887:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452734848 00000100:00100000:1.0:1777051537.690367:0:27887:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452734848 00000100:00100000:1.0:1777051537.690409:0:27887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10591 00000100:00100000:1.0:1777051537.690424:0:27887:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fd65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3678:x1863365452734464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777051537.690513:0:27887:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fd65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3678:x1863365452734464:12345-0@lo:400:kworker.0 Request processed in 90us (2055us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051537.690528:0:27887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10591 00000100:00100000:1.0:1777051537.690565:0:27887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10592 00000100:00100000:1.0:1777051537.690583:0:27887:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d9418f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3677:x1863365452734336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777051537.690660:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95aecc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3679:1863365452734080:0@lo:400:kworker.0 00000100:00100000:1.0:1777051537.690672:0:27887:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d9418f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3677:x1863365452734336:12345-0@lo:400:kworker.0 Request processed in 89us (2156us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051537.690691:0:27887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10592 00000100:00100000:1.0:1777051537.690732:0:27887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10593 00000100:00100000:0.0:1777051537.690735:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051537.690735:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051537.690757:0:27887:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fd67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3678:x1863365452734976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777051537.690781:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d9418f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3679:1863365452734592:0@lo:400:kworker.0 00000100:00100000:0.0:1777051537.690858:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051537.690867:0:27887:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fd67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3678:x1863365452734976:12345-0@lo:400:kworker.0 Request processed in 112us (2286us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051537.690882:0:27887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10593 00000100:00100000:0.0:1777051537.690908:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d9418f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3679:1863365452735104:0@lo:400:kworker.0 00000100:00100000:1.0:1777051537.690919:0:27887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10594 00000100:00100000:1.0:1777051537.690940:0:27887:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d9418f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3677:x1863365452734848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777051537.690963:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051537.691054:0:6579:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452733952 00000100:00100000:0.0:1777051537.691064:0:6579:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452733952 00000100:00100000:0.0:1777051537.691137:0:6579:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452733824 00000100:00100000:0.0:1777051537.691145:0:6579:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452733824 00000100:00100000:0.0:1777051537.691247:0:6579:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452734208 00000100:00100000:0.0:1777051537.691255:0:6579:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452734208 00000100:00100000:0.0:1777051537.691303:0:6579:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452734080 00000100:00100000:1.0:1777051537.691309:0:27887:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d9418f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3677:x1863365452734848:12345-0@lo:400:kworker.0 Request processed in 362us (2644us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051537.691310:0:6579:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452734080 00000100:00100000:1.0:1777051537.691331:0:27887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10594 00000100:00100000:0.0:1777051537.691339:0:6579:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452734592 00000100:00100000:0.0:1777051537.691345:0:6579:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452734592 00000100:00100000:0.0:1777051537.691372:0:6579:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452735104 00000100:00100000:0.0:1777051537.691377:0:6579:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452735104 00000100:00100000:1.0:1777051537.691407:0:8492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13562 00000100:00100000:0.0:1777051537.691422:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13563 00000100:00100000:0.0:1777051537.691446:0:6579:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d9418f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3677:x1863365452733824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777051537.691470:0:8492:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fd67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3678:x1863365452733952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777051537.691511:0:6579:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d9418f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3677:x1863365452733824:12345-0@lo:400:kworker.0 Request processed in 73us (3126us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051537.691523:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13563 00000100:00100000:0.0:1777051537.691551:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13564 00000100:00100000:0.0:1777051537.691564:0:6579:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7cd9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3680:x1863365452734208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051537.691574:0:47208:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452733440 00000100:00100000:3.0:1777051537.691586:0:47208:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452733440 00000100:00100000:0.0:1777051537.691621:0:6579:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7cd9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3680:x1863365452734208:12345-0@lo:400:kworker.0 Request processed in 57us (1509us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051537.691633:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13564 00000100:00100000:2.0:1777051537.691657:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95aecc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3680:1863365452734208:0@lo:400:kworker.0 00000100:00100000:0.0:1777051537.691667:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13565 00000100:00100000:3.0:1777051537.691669:0:47208:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452733568 00000100:00100000:3.0:1777051537.691677:0:47208:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452733568 00000100:00100000:0.0:1777051537.691685:0:6579:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fd66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3679:x1863365452734080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051537.691727:0:47208:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452734720 00000100:00100000:3.0:1777051537.691736:0:47208:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452734720 00000100:00100000:2.0:1777051537.692053:0:46498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8374 00000100:00100000:0.0:1777051537.692055:0:6579:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fd66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3679:x1863365452734080:12345-0@lo:400:kworker.0 Request processed in 377us (1331us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051537.692068:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13565 00000100:00100000:2.0:1777051537.692070:0:46498:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f29a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+7:3677:x1863365452733440:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1777051537.692092:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13566 00000100:00100000:0.0:1777051537.692101:0:6579:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fd65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3679:x1863365452734592:12345-0@lo:400:kworker.0 00000004:00000024:2.0:1777051537.692110:0:46498:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4194304 pending 0 free 1441529856 avail 1295290368 00000100:00100000:0.0:1777051537.692152:0:6579:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fd65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3679:x1863365452734592:12345-0@lo:400:kworker.0 Request processed in 50us (1297us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051537.692156:0:46498:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f29a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+7:3677:x1863365452733440:12345-0@lo:41:osp-pre-0-1.0 Request processed in 92us (4737us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051537.692164:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13566 00000100:00100000:2.0:1777051537.692168:0:46498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8374 00000100:00100000:2.0:1777051537.692522:0:46498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8375 00000100:00100000:2.0:1777051537.692537:0:46498:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fd64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+6:3679:x1863365452733568:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1777051537.692572:0:46498:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4194304 pending 0 free 1446141952 avail 1299902464 00000100:00100000:1.0:1777051537.692592:0:8492:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fd67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3678:x1863365452733952:12345-0@lo:400:kworker.0 Request processed in 1167us (4247us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051537.692606:0:8492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13562 00000100:00100000:1.0:1777051537.692645:0:8492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13567 00000100:00100000:2.0:1777051537.692651:0:46498:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fd64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+6:3679:x1863365452733568:12345-0@lo:41:osp-pre-1-0.0 Request processed in 113us (3898us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051537.692670:0:8492:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955612d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3679:x1863365452735104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777051537.692670:0:46498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8375 00000100:00100000:1.0:1777051537.692744:0:8492:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955612d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3679:x1863365452735104:12345-0@lo:400:kworker.0 Request processed in 82us (1783us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051537.692757:0:8492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13567 00000100:00100000:2.0:1777051537.692776:0:109181:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452733696 00000100:00100000:2.0:1777051537.692786:0:109181:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452733696 00000100:00080000:1.0:1777051537.693135:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1777051537.693487:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1777051537.693493:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1777051537.693497:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1777051537.693546:0:109181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1777051537.693563:0:109181:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7d97ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9351a01-5b0e-4470-97fd-58b9b4b312a2+23:3680:x1863365452733696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777051537.693650:0:109181:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7d97ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9351a01-5b0e-4470-97fd-58b9b4b312a2+23:3680:x1863365452733696:12345-0@lo:400:kworker.0 Request processed in 89us (4978us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051537.693655:0:47208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8376 00000100:00100000:2.0:1777051537.693675:0:109181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1777051537.693683:0:47208:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7cd9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+5:3680:x1863365452734720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777051537.693778:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d9418f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3680:1863365452734720:0@lo:400:kworker.0 00000100:00100000:2.0:1777051537.695345:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f298e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3680:1863365452733696:0@lo:400:kworker.0 00000100:00100000:3.0:1777051537.695370:0:47208:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7cd9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_005:lustre-MDT0000-mdtlov_UUID+5:3680:x1863365452734720:12345-0@lo:400:kworker.0 Request processed in 1691us (4641us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051537.695401:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7cd9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452733568:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1777051537.695434:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95aecc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3679:1863365452734080:0@lo:400:kworker.0 00000100:00100000:3.0:1777051537.695434:0:47208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8376 00000100:00100000:0.0:1777051537.695510:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d9418f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3679:1863365452734592:0@lo:400:kworker.0 00000100:00100000:0.0:1777051537.695543:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d9418f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3679:1863365452735104:0@lo:400:kworker.0 00000100:00100000:3.0:1777051537.695570:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f298700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3677:1863365452733824:0@lo:400:kworker.0 00000100:00100000:2.0:1777051537.695834:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d9418f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452734336:0@lo:400:kworker.0 00000100:00100000:2.0:1777051537.695855:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d9418f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3677:1863365452734848:0@lo:400:kworker.0 00000100:00100000:2.0:1777051537.695879:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f298380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452733440:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1777051537.696042:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95aecc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3678:1863365452733952:0@lo:400:kworker.0 00000100:00100000:1.0:1777051537.696063:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d9418f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452734464:0@lo:400:kworker.0 00000100:00100000:1.0:1777051537.696074:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d9418f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3678:1863365452734976:0@lo:400:kworker.0 00000100:00100000:0.0:1777051538.199047:0:3679:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1777051538.199083:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da444a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452735232:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1777051538.199268:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051538.199293:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7cd9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3677:1863365452735360:0@lo:13:osp-pre-1-0.0 00000004:00080000:2.0:1777051538.199302:0:109196:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 8167392101014ns, next at 8168392095854ns, rc = 0 00000100:00100000:3.0:1777051538.199373:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051538.199569:0:47388:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452735232 00000100:00100000:1.0:1777051538.199582:0:47388:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452735232 00000100:00100000:1.0:1777051538.199657:0:47388:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452735360 00000100:00100000:1.0:1777051538.199663:0:47388:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452735360 00000100:00100000:1.0:1777051538.199726:0:47388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5742 00000100:00100000:3.0:1777051538.199743:0:8473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5743 00000100:00100000:1.0:1777051538.199749:0:47388:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f658700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3679:x1863365452735232:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1777051538.199772:0:8473:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d944e11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3677:x1863365452735360:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1777051538.200141:0:47388:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 515963584 pending 0 free 3860574208 avail 3629051904 00002000:00000024:3.0:1777051538.200146:0:8473:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 489208512 pending 0 free 3642707968 avail 3411185664 00000100:00100000:1.0:1777051538.200320:0:47388:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f658700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3679:x1863365452735232:12345-0@lo:13:osp-pre-0-0.0 Request processed in 576us (1056us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051538.200338:0:47388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5742 00000100:00100000:3.0:1777051538.200550:0:8473:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d944e11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3677:x1863365452735360:12345-0@lo:13:osp-pre-1-0.0 Request processed in 787us (1177us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051538.200562:0:8473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5743 00000100:00100000:3.0:1777051538.200631:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7cd9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3677:1863365452735360:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1777051538.200979:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da444a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452735232:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1777051538.582661:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1777051538.720791:0:109175:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000001:00080000:2.0:1777051538.721015:0:109175:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 34359738424 is committed 00000004:00080000:2.0:1777051538.721041:0:109175:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000100:00100000:1.0:1777051538.721881:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d944e13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3678:1863365452735488:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1777051538.721988:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051538.722254:0:8471:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452735488 00000100:00100000:3.0:1777051538.722268:0:8471:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452735488 00000100:00100000:3.0:1777051538.722372:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8128 00000100:00100000:3.0:1777051538.722407:0:8471:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d9418f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3678:x1863365452735488:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1777051538.722461:0:8471:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:515 count 1 00002000:00010000:3.0:1777051538.722515:0:8471:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x203:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777051538.722531:0:8471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a87371ea/0x85f51a6b96717fdc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x203:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051538.722566:0:8471:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051538.722570:0:8471:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051538.722580:0:8471:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a87371ea/0x85f51a6b96717fdc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x203:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051538.722611:0:8471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a87371ea/0x85f51a6b96717fdc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x203:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051538.722636:0:8471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a87371ea/0x85f51a6b96717fdc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x203:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051538.722653:0:8471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a87371ea/0x85f51a6b96717fdc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x203:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051538.723554:0:8471:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1777051538.724570:0:8471:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d9418f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3678:x1863365452735488:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2165us (2578us total) trans 4294968380 rc 0/0 00000100:00100000:3.0:1777051538.724587:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8128 00010000:00010000:1.0:1777051538.724768:0:108751:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777051538.724782:0:108751:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a87371ea/0x85f51a6b96717fdc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x203:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051538.724805:0:108751:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da7d5cfc00 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:1.0:1777051538.724813:0:108751:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a87371ea/0x85f51a6b96717fdc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x203:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051538.724831:0:108751:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a87371ea/0x85f51a6b96717fdc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x203:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051538.724864:0:108751:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a87371ea/0x85f51a6b96717fdc lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x203:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051538.724885:0:108751:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a87371ea/0x85f51a6b96717fdc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x203:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051538.724920:0:108751:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051538.724929:0:108751:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051538.724933:0:108751:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1777051538.724989:0:3678:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99d944e13480/2, rc 0, transno 4294968380 00000100:00100000:1.0:1777051538.725001:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d944e13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3678:1863365452735488:0@lo:6:osp-syn-1-0.0 00000001:00020000:0.0:1777051539.286678:0:21368:0:(mdt_hsm_cdt_client.c:366:mdt_hsm_register_hal()) cfs_fail_timeout id 164 awake 00000040:00080000:0.0:1777051539.297137:0:21368:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x31:0x0].3, 136 off8600 00010000:00010000:2.0:1777051539.297760:0:109205:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502dba00/0x85f51a6b96717fd5 lrc: 3/0,1 mode: EX/EX res: [0x2000032e3:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051539.298068:0:109205:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502dba00/0x85f51a6b96717fd5 lrc: 2/0,0 mode: EX/EX res: [0x2000032e3:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051539.298081:0:109205:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502dba00/0x85f51a6b96717fd5 lrc: 3/0,0 mode: EX/EX res: [0x2000032e3:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051539.298090:0:109205:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d9502dba00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:2.0:1777051539.298097:0:109205:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502dba00/0x85f51a6b96717fd5 lrc: 3/0,0 mode: EX/EX res: [0x2000032e3:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051539.298110:0:109205:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502dba00/0x85f51a6b96717fd5 lrc: 4/0,0 mode: EX/EX res: [0x2000032e3:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051539.298137:0:109205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e3:0xe:0x0].0x0 (ffff99d94e592a00) 00010000:00010000:2.0:1777051539.298142:0:109205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1777051539.298148:0:109205:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502dba00/0x85f51a6b96717fd5 lrc: 2/0,0 mode: --/EX res: [0x2000032e3:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051539.298185:0:109205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502dba00/0x85f51a6b96717fd5 lrc: 0/0,0 mode: --/EX res: [0x2000032e3:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051539.298297:0:21368:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fd67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+12:141796:x1863365426139520:12345-192.168.201.46@tcp:58:cat.0 Request processed in 5029805us (5030137us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051539.298318:0:21368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112514 00000100:00100000:0.0:1777051539.303056:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051539.303996:0:10328:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426139648 00000100:00100000:2.0:1777051539.304008:0:10328:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426139648 00000100:00100000:2.0:1777051539.304089:0:10328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112515 00000100:00100000:2.0:1777051539.304104:0:10328:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f659c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+12:141796:x1863365426139648:12345-192.168.201.46@tcp:101:cat.0 00010000:00010000:2.0:1777051539.304127:0:10328:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051539.304186:0:10328:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69a800/0x85f51a6b96717fe3 lrc: 2/0,0 mode: --/CR res: [0x2000032e3:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6bd6 expref: -99 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051539.304285:0:10328:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69a800/0x85f51a6b96717fe3 lrc: 3/0,0 mode: CR/CR res: [0x2000032e3:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6bd6 expref: 13 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051539.304303:0:10328:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69a800/0x85f51a6b96717fe3 lrc: 3/0,0 mode: CR/CR res: [0x2000032e3:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6bd6 expref: 13 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051539.304321:0:10328:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e3:0xe:0x0].0x0 (ffff99da59dd4700) 00010000:00010000:2.0:1777051539.304324:0:10328:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1777051539.304328:0:10328:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d94f69a800, rc 0) 00000100:00100000:2.0:1777051539.304379:0:10328:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f659c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+13:141796:x1863365426139648:12345-192.168.201.46@tcp:101:cat.0 Request processed in 280us (1326us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051539.304483:0:10328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112515 00000100:00080000:1.0:1777051539.305649:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1777051539.311480:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051539.311656:0:6583:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426139904 00000100:00100000:0.0:1777051539.311669:0:6583:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426139904 00000100:00100000:0.0:1777051539.312056:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3447 00000100:00100000:0.0:1777051539.312075:0:6583:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7cd9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+13:141796:x1863365426139904:12345-192.168.201.46@tcp:35:cat.0 00000100:00100000:2.0:1777051539.312765:0:6583:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7cd9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+14:141796:x1863365426139904:12345-192.168.201.46@tcp:35:cat.0 Request processed in 693us (1290us total) trans 34359738425 rc 0/0 00000100:00100000:2.0:1777051539.312780:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3447 00000100:00100000:3.0:1777051539.365937:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051539.366002:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051539.366043:0:109186:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426140032 00000100:00100000:3.0:1777051539.366055:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051539.366060:0:109186:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426140032 00000100:00100000:3.0:1777051539.366451:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051539.366479:0:109186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 97 00000100:00100000:2.0:1777051539.366501:0:109186:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7d97a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:29c4352d-3260-4734-909d-9ea5de9e7fa4+12:2438:x1863365426140032:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:1.0:1777051539.366508:0:27887:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426140544 00000100:00100000:3.0:1777051539.366510:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051539.366521:0:27887:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426140544 00000100:00100000:3.0:1777051539.366561:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051539.366600:0:27887:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426140800 00000100:00100000:1.0:1777051539.366607:0:27887:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426140800 00000100:00100000:1.0:1777051539.366649:0:27887:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426140416 00000100:00100000:1.0:1777051539.366655:0:27887:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426140416 00000100:00100000:2.0:1777051539.366669:0:109186:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7d97a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:29c4352d-3260-4734-909d-9ea5de9e7fa4+12:2438:x1863365426140032:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 169us (733us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051539.366669:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051539.366688:0:109186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 97 00000100:00100000:1.0:1777051539.366985:0:27887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10595 00000100:00100000:1.0:1777051539.367006:0:27887:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d944e10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c11b6966-0775-44d2-bdc6-c74c26eb2226+30:2438:x1863365426140544:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:1.0:1777051539.367068:0:27887:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d944e10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c11b6966-0775-44d2-bdc6-c74c26eb2226+30:2438:x1863365426140544:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 70us (1017us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051539.367081:0:27887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10595 00000100:00100000:1.0:1777051539.367110:0:27887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10596 00000100:00100000:1.0:1777051539.367124:0:27887:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d944e11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+16:2438:x1863365426140800:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:3.0:1777051539.367149:0:46494:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426140288 00000100:00100000:3.0:1777051539.367183:0:46494:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426140288 00000100:00100000:1.0:1777051539.367260:0:27887:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d944e11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+16:2438:x1863365426140800:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 137us (810us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051539.367273:0:27887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10596 00000100:00100000:3.0:1777051539.367280:0:46494:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426140160 00000100:00100000:3.0:1777051539.367287:0:46494:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426140160 00000100:00100000:1.0:1777051539.367307:0:27887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10597 00000100:00100000:1.0:1777051539.367324:0:27887:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d944e10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c11b6966-0775-44d2-bdc6-c74c26eb2226+30:2438:x1863365426140416:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:3.0:1777051539.367342:0:46494:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426140672 00000100:00100000:3.0:1777051539.367349:0:46494:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426140672 00000100:00100000:1.0:1777051539.367374:0:27887:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d944e10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c11b6966-0775-44d2-bdc6-c74c26eb2226+30:2438:x1863365426140416:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 54us (812us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051539.367385:0:27887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10597 00000100:00100000:3.0:1777051539.367408:0:46494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13568 00000100:00100000:3.0:1777051539.367427:0:46494:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d944e13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c11b6966-0775-44d2-bdc6-c74c26eb2226+9:2438:x1863365426140288:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:1.0:1777051539.367437:0:8492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13569 00000100:00100000:1.0:1777051539.367455:0:8492:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d944e11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+12:2438:x1863365426140160:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:3.0:1777051539.367497:0:46494:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d944e13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c11b6966-0775-44d2-bdc6-c74c26eb2226+9:2438:x1863365426140288:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 75us (1492us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051539.367515:0:46494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13568 00000100:00100000:1.0:1777051539.367521:0:8492:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d944e11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+12:2438:x1863365426140160:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 62us (1009us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051539.367534:0:8492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13569 00000100:00100000:1.0:1777051539.367559:0:8492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13570 00000100:00100000:1.0:1777051539.367571:0:8492:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d944e13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+54:2438:x1863365426140672:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:1.0:1777051539.367608:0:8492:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d944e13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+54:2438:x1863365426140672:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 39us (950us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051539.367620:0:8492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13570 00000100:00080000:1.0:1777051539.367654:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1777051539.367662:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1777051539.367669:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1777051539.367677:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1777051539.367677:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051539.367711:0:55805:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426140928 00000100:00100000:1.0:1777051539.367719:0:55805:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426140928 00000100:00100000:1.0:1777051539.367778:0:55805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10598 00000100:00100000:1.0:1777051539.367791:0:55805:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7cd9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+30:2438:x1863365426140928:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:1.0:1777051539.367844:0:55805:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7cd9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+30:2438:x1863365426140928:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 53us (174us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051539.367858:0:55805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10598 00000100:00080000:1.0:1777051539.367936:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1777051539.607018:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1777051540.249273:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5fbef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3680:1863365452735744:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1777051540.249339:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d9418f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452735616:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1777051540.249378:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051540.249442:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051540.249887:0:10113:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452735744 00000100:00100000:1.0:1777051540.249901:0:10113:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452735744 00000100:00100000:1.0:1777051540.249989:0:10113:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452735616 00000100:00100000:1.0:1777051540.249997:0:10113:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452735616 00000100:00080000:2.0:1777051540.249997:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1777051540.250062:0:10113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5744 00000100:00080000:2.0:1777051540.250064:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1777051540.250102:0:8473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5745 00000100:00100000:1.0:1777051540.250106:0:10113:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d9418f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3680:x1863365452735744:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1777051540.250128:0:8473:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7cd9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3679:x1863365452735616:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1777051540.250218:0:10113:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 489208512 pending 0 free 3642707968 avail 3411185664 00002000:00000024:3.0:1777051540.250262:0:8473:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 515963584 pending 0 free 3860574208 avail 3629051904 00000100:00100000:1.0:1777051540.250309:0:10113:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d9418f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3680:x1863365452735744:12345-0@lo:13:osp-pre-1-1.0 Request processed in 228us (932us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051540.250325:0:10113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5744 00000100:00100000:2.0:1777051540.250371:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5fbef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3680:1863365452735744:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1777051540.251307:0:8473:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7cd9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3679:x1863365452735616:12345-0@lo:13:osp-pre-0-1.0 Request processed in 1186us (1865us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051540.251323:0:8473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5745 00000100:00100000:1.0:1777051540.251328:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d9418f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452735616:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1777051540.630747:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777051541.654701:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777051542.679342:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1777051542.806430:0:3678:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1777051542.806463:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7cd9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452735872:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1777051542.806562:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051542.808367:0:46498:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452735872 00000100:00100000:0.0:1777051542.808379:0:46498:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452735872 00000100:00100000:0.0:1777051542.808450:0:46498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8377 00000100:00100000:0.0:1777051542.808466:0:46498:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7cd9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+7:3678:x1863365452735872:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1777051542.808516:0:46498:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4194304 pending 0 free 1441529856 avail 1295290368 00000100:00100000:0.0:1777051542.808597:0:46498:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7cd9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+7:3678:x1863365452735872:12345-0@lo:41:osp-pre-0-1.0 Request processed in 133us (2035us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051542.808612:0:46498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8377 00000100:00100000:0.0:1777051542.808656:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94f42dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3679:1863365452736128:0@lo:400:kworker.0 00000100:00100000:0.0:1777051542.808710:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051542.808748:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d950266d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452736640:0@lo:400:kworker.0 00000100:00100000:0.0:1777051542.808790:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051542.808817:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d9533bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452737152:0@lo:400:kworker.0 00000100:00100000:0.0:1777051542.808850:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051542.808887:0:3679:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1777051542.808900:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d950266a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3679:1863365452736256:0@lo:400:kworker.0 00000100:00100000:0.0:1777051542.808944:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051542.808947:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d950267800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3677:1863365452736384:0@lo:400:kworker.0 00000100:00100000:0.0:1777051542.808984:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d950265880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452736768:0@lo:400:kworker.0 00000100:00100000:3.0:1777051542.809026:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051542.809050:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051542.809080:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d950267b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3677:1863365452736896:0@lo:400:kworker.0 00000100:00100000:0.0:1777051542.809133:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d9533bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452737280:0@lo:400:kworker.0 00000100:00100000:3.0:1777051542.809167:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051542.809242:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051542.809250:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d9533bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3677:1863365452737408:0@lo:400:kworker.0 00000100:00100000:3.0:1777051542.809314:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051542.809317:0:6581:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452736128 00000100:00100000:0.0:1777051542.809326:0:6581:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452736128 00000100:00100000:3.0:1777051542.809360:0:3677:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1777051542.809379:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da444a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3677:1863365452736000:0@lo:400:kworker.0 00000100:00100000:0.0:1777051542.809402:0:6581:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452736256 00000100:00100000:0.0:1777051542.809410:0:6581:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452736256 00000100:00100000:3.0:1777051542.809440:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051542.809473:0:6581:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452736384 00000100:00100000:0.0:1777051542.809482:0:6581:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452736384 00000100:00100000:3.0:1777051542.809506:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d950264700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3677:1863365452736512:0@lo:400:kworker.0 00000100:00100000:0.0:1777051542.809543:0:6581:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452736896 00000100:00100000:0.0:1777051542.809551:0:6581:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452736896 00000100:00100000:3.0:1777051542.809564:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051542.809607:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d9533bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3677:1863365452737024:0@lo:400:kworker.0 00000100:00100000:1.0:1777051542.809610:0:55805:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452736640 00000100:00100000:1.0:1777051542.809623:0:55805:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452736640 00000100:00100000:3.0:1777051542.809647:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051542.810076:0:8471:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452737152 00000100:00100000:1.0:1777051542.810079:0:55805:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452736768 00000100:00100000:3.0:1777051542.810090:0:8471:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452737152 00000100:00100000:1.0:1777051542.810093:0:55805:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452736768 00000100:00100000:2.0:1777051542.810461:0:6584:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452737024 00000100:00100000:2.0:1777051542.810472:0:6584:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452737024 00000100:00100000:3.0:1777051542.810505:0:8471:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452737280 00000100:00100000:3.0:1777051542.810517:0:8471:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452737280 00000100:00100000:2.0:1777051542.810556:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8378 00000100:00100000:1.0:1777051542.810565:0:55805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10599 00000100:00100000:2.0:1777051542.810582:0:6584:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5fbec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3677:x1863365452737024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777051542.810595:0:55805:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d950888380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3679:x1863365452736640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051542.810596:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10600 00000100:00100000:3.0:1777051542.810624:0:8471:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d950888a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3679:x1863365452737152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777051542.810695:0:6584:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5fbec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3677:x1863365452737024:12345-0@lo:400:kworker.0 Request processed in 117us (1045us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051542.810710:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8378 00000100:00100000:1.0:1777051542.810732:0:55805:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d950888380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3679:x1863365452736640:12345-0@lo:400:kworker.0 Request processed in 149us (1937us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051542.810751:0:8471:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d950888a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3679:x1863365452737152:12345-0@lo:400:kworker.0 Request processed in 130us (1893us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051542.810752:0:55805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10599 00000100:00100000:3.0:1777051542.810774:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10600 00000100:00100000:1.0:1777051542.810800:0:55805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10601 00000100:00100000:3.0:1777051542.810820:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10602 00000100:00100000:1.0:1777051542.810826:0:55805:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95088aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3679:x1863365452736768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777051542.810827:0:6581:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452737408 00000100:00100000:0.0:1777051542.810840:0:6581:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452737408 00000100:00100000:3.0:1777051542.810848:0:8471:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95088ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3679:x1863365452737280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777051542.810897:0:6581:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452736512 00000100:00100000:0.0:1777051542.810907:0:6581:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452736512 00000100:00100000:1.0:1777051542.810923:0:55805:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95088aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3679:x1863365452736768:12345-0@lo:400:kworker.0 Request processed in 105us (1872us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051542.810940:0:55805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10601 00000100:00100000:3.0:1777051542.810948:0:8471:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95088ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3679:x1863365452737280:12345-0@lo:400:kworker.0 Request processed in 106us (1742us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051542.810957:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13571 00000100:00100000:3.0:1777051542.810973:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10602 00000100:00100000:0.0:1777051542.810981:0:6581:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d9533bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3679:x1863365452736128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777051542.811001:0:21368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13572 00000100:00100000:1.0:1777051542.811024:0:21368:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95088b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3679:x1863365452736256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051542.811037:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13573 00000100:00100000:3.0:1777051542.811060:0:6580:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5fbed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3677:x1863365452736384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777051542.811072:0:6581:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d9533bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3679:x1863365452736128:12345-0@lo:400:kworker.0 Request processed in 93us (2358us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051542.811094:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13571 00000100:00100000:0.0:1777051542.811497:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13574 00000100:00100000:3.0:1777051542.811507:0:6580:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5fbed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3677:x1863365452736384:12345-0@lo:400:kworker.0 Request processed in 452us (2480us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051542.811522:0:6581:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5fbee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3677:x1863365452736896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051542.811527:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13573 00000100:00100000:3.0:1777051542.811571:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13575 00000100:00100000:3.0:1777051542.811591:0:6580:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5fbef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3677:x1863365452737408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777051542.811612:0:6581:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5fbee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3677:x1863365452736896:12345-0@lo:400:kworker.0 Request processed in 94us (2443us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051542.811627:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13574 00000100:00100000:0.0:1777051542.811665:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13576 00000100:00100000:3.0:1777051542.811675:0:6580:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5fbef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3677:x1863365452737408:12345-0@lo:400:kworker.0 Request processed in 84us (2358us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051542.811691:0:6581:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5fbec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3677:x1863365452736512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051542.811700:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13575 00000100:00100000:0.0:1777051542.811774:0:6581:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5fbec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3677:x1863365452736512:12345-0@lo:400:kworker.0 Request processed in 89us (2209us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051542.811787:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13576 00000100:00100000:3.0:1777051542.811837:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d950264700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3677:1863365452736512:0@lo:400:kworker.0 00000100:00100000:0.0:1777051542.811843:0:109184:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452736000 00000100:00100000:0.0:1777051542.811853:0:109184:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452736000 00000100:00100000:3.0:1777051542.811865:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d9533bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3677:1863365452737024:0@lo:400:kworker.0 00000100:00100000:3.0:1777051542.811893:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d950267800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3677:1863365452736384:0@lo:400:kworker.0 00000100:00100000:3.0:1777051542.811920:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d950267b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3677:1863365452736896:0@lo:400:kworker.0 00000100:00100000:0.0:1777051542.811924:0:109184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1777051542.811945:0:109184:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7d979c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f9351a01-5b0e-4470-97fd-58b9b4b312a2+23:3677:x1863365452736000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051542.811950:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d9533bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3677:1863365452737408:0@lo:400:kworker.0 00000100:00100000:3.0:1777051542.812013:0:3677:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1777051542.812026:0:109184:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7d979c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f9351a01-5b0e-4470-97fd-58b9b4b312a2+23:3677:x1863365452736000:12345-0@lo:400:kworker.0 Request processed in 83us (2585us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051542.812035:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7cd9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3677:1863365452737536:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1777051542.812048:0:109184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00080000:2.0:1777051542.812177:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1777051542.812184:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1777051542.812189:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1777051542.812193:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1777051542.812242:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7cd9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452735872:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1777051542.813474:0:21368:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95088b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3679:x1863365452736256:12345-0@lo:400:kworker.0 Request processed in 2456us (4528us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051542.813487:0:21368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13572 00000100:00100000:3.0:1777051542.813615:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051542.813676:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da444a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3677:1863365452736000:0@lo:400:kworker.0 00000100:00100000:3.0:1777051542.813754:0:46500:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452737536 00000100:00100000:3.0:1777051542.814083:0:46500:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452737536 00000100:00100000:3.0:1777051542.814166:0:46500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8379 00000100:00100000:3.0:1777051542.814181:0:46500:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5fbeed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+5:3677:x1863365452737536:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1777051542.814243:0:46500:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4194304 pending 0 free 1446141952 avail 1299902464 00000100:00100000:3.0:1777051542.814318:0:46500:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5fbeed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+5:3677:x1863365452737536:12345-0@lo:41:osp-pre-1-0.0 Request processed in 138us (705us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051542.814331:0:46500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8379 00000100:00100000:3.0:1777051542.814391:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7cd9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3677:1863365452737536:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1777051542.814642:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d950266a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3679:1863365452736256:0@lo:400:kworker.0 00000100:00100000:1.0:1777051542.814667:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d950265880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452736768:0@lo:400:kworker.0 00000100:00100000:1.0:1777051542.814686:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d9533bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452737280:0@lo:400:kworker.0 00000100:00100000:1.0:1777051542.814703:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94f42dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3679:1863365452736128:0@lo:400:kworker.0 00000100:00100000:1.0:1777051542.814720:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d950266d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452736640:0@lo:400:kworker.0 00000100:00100000:1.0:1777051542.814741:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d9533bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452737152:0@lo:400:kworker.0 00000100:00100000:1.0:1777051543.320466:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d950889500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452737664:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1777051543.320562:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051543.321077:0:10113:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452737664 00000100:00100000:3.0:1777051543.321116:0:10113:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452737664 00000100:00100000:3.0:1777051543.321191:0:10113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5746 00000100:00100000:2.0:1777051543.321209:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7cd9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3680:1863365452737792:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1777051543.321254:0:10113:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d9418f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3679:x1863365452737664:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1777051543.321266:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:3.0:1777051543.321305:0:10113:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 515963584 pending 0 free 3860574208 avail 3629051904 00000100:00100000:3.0:1777051543.321376:0:10113:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d9418f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3679:x1863365452737664:12345-0@lo:13:osp-pre-0-0.0 Request processed in 146us (812us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051543.321389:0:10113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5746 00000100:00100000:3.0:1777051543.321415:0:10113:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452737792 00000100:00100000:3.0:1777051543.321421:0:10113:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452737792 00000100:00100000:3.0:1777051543.321477:0:10113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5747 00000100:00100000:3.0:1777051543.321489:0:10113:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7cd9d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3680:x1863365452737792:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1777051543.321502:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d950889500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452737664:0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1777051543.321519:0:10113:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 489208512 pending 0 free 3642707968 avail 3411185664 00000100:00100000:3.0:1777051543.321586:0:10113:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7cd9d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3680:x1863365452737792:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051543.321599:0:10113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5747 00000100:00100000:2.0:1777051543.321680:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7cd9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3680:1863365452737792:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1777051543.702537:0:108751:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777051544.484788:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051544.484868:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051544.485070:0:109182:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426141056 00000100:00100000:2.0:1777051544.485115:0:109182:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426141056 00000100:00100000:3.0:1777051544.485652:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051544.485674:0:109182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 99 00000100:00100000:2.0:1777051544.485698:0:109182:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7d978050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29c4352d-3260-4734-909d-9ea5de9e7fa4+12:2436:x1863365426141056:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:3.0:1777051544.485763:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051544.485810:0:109182:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7d978050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29c4352d-3260-4734-909d-9ea5de9e7fa4+12:2436:x1863365426141056:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 117us (1031us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051544.485830:0:109182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 99 00000100:00100000:2.0:1777051544.485966:0:46494:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426141184 00000100:00100000:2.0:1777051544.485975:0:46494:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426141184 00000100:00100000:3.0:1777051544.485995:0:24468:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426141440 00000100:00100000:3.0:1777051544.486006:0:24468:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426141440 00000100:00100000:2.0:1777051544.486064:0:46494:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426141312 00000100:00100000:2.0:1777051544.486455:0:46494:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426141312 00000100:00100000:2.0:1777051544.486526:0:46494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13577 00000100:00100000:0.0:1777051544.486544:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13578 00000100:00100000:2.0:1777051544.486546:0:46494:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5fbefb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c11b6966-0775-44d2-bdc6-c74c26eb2226+12:2437:x1863365426141184:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:0.0:1777051544.486572:0:6581:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5fbed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+9:2436:x1863365426141312:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:0.0:1777051544.486653:0:6581:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5fbed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+9:2436:x1863365426141312:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 90us (1009us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051544.486665:0:46494:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5fbefb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c11b6966-0775-44d2-bdc6-c74c26eb2226+12:2437:x1863365426141184:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 120us (1794us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051544.486677:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13578 00000100:00100000:2.0:1777051544.486693:0:46494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13577 00000100:00080000:2.0:1777051544.486743:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1777051544.486749:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1777051544.486797:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051544.486866:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051544.486910:0:8492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426141696 00000100:00100000:0.0:1777051544.486920:0:8492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426141696 00000100:00100000:0.0:1777051544.487001:0:8492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13579 00000100:00100000:0.0:1777051544.487019:0:8492:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f298380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+14:2437:x1863365426141696:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:2.0:1777051544.487034:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051544.487097:0:24468:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426141568 00000100:00100000:3.0:1777051544.487107:0:24468:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426141568 00000100:00100000:0.0:1777051544.488202:0:8492:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f298380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+14:2437:x1863365426141696:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 1183us (1330us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051544.488222:0:8492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13579 00000100:00100000:2.0:1777051544.488225:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051544.488720:0:8492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426141824 00000100:00100000:0.0:1777051544.488730:0:8492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426141824 00000100:00100000:0.0:1777051544.488791:0:8492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13580 00000100:00100000:0.0:1777051544.488807:0:8492:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f298700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+54:2436:x1863365426141824:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:2.0:1777051544.488830:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051544.489189:0:8492:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f298700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+54:2436:x1863365426141824:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 382us (2157us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051544.489205:0:8492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13580 00000100:00100000:3.0:1777051544.489207:0:24468:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426141952 00000100:00100000:3.0:1777051544.489218:0:24468:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426141952 00000100:00080000:0.0:1777051544.489290:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1777051544.489299:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1777051544.489305:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1777051544.489314:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1777051544.489319:0:24468:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426142080 00000100:00100000:3.0:1777051544.489326:0:24468:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426142080 00000100:00100000:3.0:1777051544.489378:0:24468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10603 00000100:00100000:3.0:1777051544.489392:0:24468:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5fbec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+30:2437:x1863365426141440:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:3.0:1777051544.489459:0:24468:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5fbec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+30:2437:x1863365426141440:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 69us (3735us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051544.489472:0:24468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10603 00000100:00100000:3.0:1777051544.489495:0:24468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10604 00000100:00100000:3.0:1777051544.489509:0:24468:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7cd9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+30:2436:x1863365426141568:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:3.0:1777051544.489555:0:24468:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7cd9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+30:2436:x1863365426141568:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 49us (2759us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051544.490528:0:24468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10604 00000100:00100000:3.0:1777051544.490561:0:24468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10605 00000100:00100000:3.0:1777051544.490576:0:24468:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f298e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+16:2437:x1863365426141952:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:3.0:1777051544.490630:0:24468:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f298e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+16:2437:x1863365426141952:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 56us (2413us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051544.490642:0:24468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10605 00000100:00100000:3.0:1777051544.490668:0:24468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10606 00000100:00100000:3.0:1777051544.490682:0:24468:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95aecc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+30:2436:x1863365426142080:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:3.0:1777051544.491504:0:24468:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95aecc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+30:2436:x1863365426142080:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 822us (2676us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051544.491518:0:24468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10606 00000100:00080000:3.0:1777051544.491701:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000040:00080000:2.0:1777051544.645261:0:110872:0:(llog.c:801:llog_process_thread()) index: 6, lh_last_idx: 7 synced_idx: 0 lgh_last_idx: 7 00000040:00080000:2.0:1777051544.645273:0:110872:0:(llog_cat.c:158:llog_cat_process_common()) processing log [0x1:0x2b:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1777051544.645315:0:110872:0:(llog.c:858:llog_process_thread()) stop processing plain [0x1:0x2b:0x0] index 12 count 2 00000040:00080000:2.0:1777051544.645331:0:110872:0:(llog.c:801:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:2.0:1777051544.645335:0:110872:0:(llog_cat.c:158:llog_cat_process_common()) processing log [0x1:0x31:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1777051544.645430:0:110872:0:(llog.c:858:llog_process_thread()) stop processing plain [0x1:0x31:0x0] index 4 count 4 00000040:00080000:2.0:1777051544.645439:0:110872:0:(llog.c:858:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 3 00010000:00010000:2.0:1777051544.726726:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1777051544.867410:0:9540:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0001: transno 4294968380 is committed 00000001:00080000:2.0:1777051544.867656:0:109175:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 34359738425 is committed 00000100:00100000:2.0:1777051545.366544:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95aecc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452737920:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1777051545.366643:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051545.371765:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95088bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452738048:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1777051545.378377:0:47388:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452737920 00000100:00100000:2.0:1777051545.378381:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051545.378394:0:47388:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452737920 00000100:00080000:3.0:1777051545.378452:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1777051545.378453:0:8472:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452738048 00000100:00100000:2.0:1777051545.378464:0:8472:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452738048 00000100:00100000:2.0:1777051545.378547:0:8472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5748 00000100:00100000:3.0:1777051545.378563:0:47388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5749 00000100:00100000:2.0:1777051545.378573:0:8472:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95aecc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3677:x1863365452737920:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1777051545.378593:0:47388:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7e24f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3678:x1863365452738048:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1777051545.378621:0:8472:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 489208512 pending 0 free 3642707968 avail 3411185664 00002000:00000024:3.0:1777051545.378631:0:47388:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 515963584 pending 0 free 3860574208 avail 3629051904 00000100:00100000:2.0:1777051545.378729:0:8472:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95aecc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3677:x1863365452737920:12345-0@lo:13:osp-pre-1-1.0 Request processed in 165us (12084us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051545.378745:0:47388:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7e24f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3678:x1863365452738048:12345-0@lo:13:osp-pre-0-1.0 Request processed in 158us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051545.378766:0:8472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5748 00000100:00080000:2.0:1777051545.379123:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1777051545.379338:0:47388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5749 00000100:00100000:3.0:1777051545.379574:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95aecc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452737920:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1777051545.381892:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95088bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452738048:0@lo:13:osp-pre-0-1.0 00000040:00080000:3.0:1777051545.515331:0:110924:0:(llog.c:801:llog_process_thread()) index: 6, lh_last_idx: 7 synced_idx: 0 lgh_last_idx: 7 00000040:00080000:3.0:1777051545.515341:0:110924:0:(llog_cat.c:158:llog_cat_process_common()) processing log [0x1:0x2b:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1777051545.515370:0:110924:0:(llog.c:858:llog_process_thread()) stop processing plain [0x1:0x2b:0x0] index 12 count 2 00000040:00080000:3.0:1777051545.515383:0:110924:0:(llog.c:801:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:3.0:1777051545.515387:0:110924:0:(llog_cat.c:158:llog_cat_process_common()) processing log [0x1:0x31:0x0] at index 7 of catalog [0xa:0x7:0x0] 00010000:00010000:3.0:1777051545.515441:0:110924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cea00/0x85f51a6b96717fea lrc: 3/0,1 mode: --/EX res: [0x2000032e3:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 110924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051545.515470:0:110924:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69a800/0x85f51a6b96717fe3 lrc: 2/0,0 mode: CR/CR res: [0x2000032e3:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6bd6 expref: 12 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051545.515484:0:110924:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cea00/0x85f51a6b96717fea lrc: 4/0,1 mode: --/EX res: [0x2000032e3:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 110924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051545.515536:0:110924:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69a800/0x85f51a6b96717fe3 lrc: 3/0,0 mode: CR/CR res: [0x2000032e3:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6bd6 expref: 12 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051545.515560:0:110924:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69a800/0x85f51a6b96717fe3 lrc: 4/0,0 mode: CR/CR res: [0x2000032e3:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6bd6 expref: 12 pid: 10328 timeout: 8274 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051545.515582:0:110924:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5fbed880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:110924:1863365452738176:192.168.201.46@tcp:104: 00000100:00100000:3.0:1777051545.515726:0:110924:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d959f179c0 going to sleep for 11 seconds 00000100:00100000:1.0:1777051545.522812:0:110924:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5fbed880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:110924:1863365452738176:192.168.201.46@tcp:104: 00010000:00010000:1.0:1777051545.522854:0:110924:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cea00/0x85f51a6b96717fea lrc: 3/0,1 mode: --/EX res: [0x2000032e3:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 110924 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051545.524669:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051545.524923:0:9550:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426142208 00000100:00100000:2.0:1777051545.524934:0:9550:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426142208 00010000:00010000:2.0:1777051545.524982:0:9550:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69a800/0x85f51a6b96717fe3 lrc: 4/0,0 mode: CR/CR res: [0x2000032e3:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6bd6 expref: 13 pid: 10328 timeout: 8274 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051545.525034:0:9550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3993 00000100:00100000:2.0:1777051545.525050:0:9550:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d9418f5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+13:2437:x1863365426142208:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1777051545.525102:0:9550:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777051545.525114:0:9550:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69a800/0x85f51a6b96717fe3 lrc: 4/0,0 mode: CR/CR res: [0x2000032e3:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6bd6 expref: 13 pid: 10328 timeout: 8274 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051545.525135:0:9550:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69a800/0x85f51a6b96717fe3 lrc: 3/0,0 mode: CR/CR res: [0x2000032e3:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6bd6 expref: 13 pid: 10328 timeout: 8274 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051545.525183:0:9550:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69a800/0x85f51a6b96717fe3 lrc: 0/0,0 mode: --/CR res: [0x2000032e3:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6bd6 expref: 13 pid: 10328 timeout: 8274 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051545.525232:0:9550:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e3:0xe:0x0].0x0 (ffff99da59dd4700) 00010000:00010000:2.0:1777051545.525241:0:9550:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cea00/0x85f51a6b96717fea lrc: 3/0,1 mode: --/EX res: [0x2000032e3:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 110924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051545.525256:0:9550:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cea00/0x85f51a6b96717fea lrc: 3/0,1 mode: EX/EX res: [0x2000032e3:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 110924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051545.525276:0:9550:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cea00/0x85f51a6b96717fea lrc: 4/0,1 mode: EX/EX res: [0x2000032e3:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 110924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051545.525328:0:9550:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1777051545.525390:0:9550:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d9418f5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+12:2437:x1863365426142208:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 341us (724us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051545.525404:0:9550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3993 00010000:00010000:1.0:1777051545.525592:0:110924:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cea00/0x85f51a6b96717fea lrc: 3/0,1 mode: EX/EX res: [0x2000032e3:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 110924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051545.525608:0:110924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cea00/0x85f51a6b96717fea lrc: 3/0,1 mode: EX/EX res: [0x2000032e3:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 110924 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1777051545.525935:0:110924:0:(llog.c:858:llog_process_thread()) stop processing plain [0x1:0x31:0x0] index 4 count 4 00000040:00080000:1.0:1777051545.525950:0:110924:0:(llog.c:858:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 3 00010000:00010000:2.0:1777051545.750475:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1777051546.323837:0:110973:0:(llog.c:801:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1777051546.323848:0:110973:0:(llog_cat.c:158:llog_cat_process_common()) processing log [0x1:0x12:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1777051546.326623:0:110973:0:(llog.c:858:llog_process_thread()) stop processing plain [0x1:0x12:0x0] index 64768 count 1 00000040:00080000:2.0:1777051546.326642:0:110973:0:(llog.c:858:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000040:00080000:1.0:1777051546.582459:0:110924:0:(llog.c:801:llog_process_thread()) index: 6, lh_last_idx: 7 synced_idx: 0 lgh_last_idx: 7 00000040:00080000:1.0:1777051546.582469:0:110924:0:(llog_cat.c:158:llog_cat_process_common()) processing log [0x1:0x2b:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1777051546.582503:0:110924:0:(llog.c:858:llog_process_thread()) stop processing plain [0x1:0x2b:0x0] index 12 count 2 00000040:00080000:1.0:1777051546.582520:0:110924:0:(llog.c:801:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:1.0:1777051546.582524:0:110924:0:(llog_cat.c:158:llog_cat_process_common()) processing log [0x1:0x31:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1777051546.582551:0:110924:0:(llog.c:858:llog_process_thread()) stop processing plain [0x1:0x31:0x0] index 4 count 4 00000040:00080000:1.0:1777051546.582563:0:110924:0:(llog.c:858:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 3 00010000:00010000:0.0:1777051546.774507:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1777051547.359952:0:110973:0:(llog.c:801:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1777051547.359966:0:110973:0:(llog_cat.c:158:llog_cat_process_common()) processing log [0x1:0x12:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1777051547.366677:0:110973:0:(llog.c:858:llog_process_thread()) stop processing plain [0x1:0x12:0x0] index 64768 count 1 00000040:00080000:0.0:1777051547.366707:0:110973:0:(llog.c:858:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1777051547.493407:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051547.493506:0:6566:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426142336 00000100:00100000:1.0:1777051547.493522:0:6566:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426142336 00000100:00080000:3.0:1777051547.493636:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1777051547.493654:0:6566:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13756 00000100:00100000:1.0:1777051547.493670:0:6566:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da71c0b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+30:2438:x1863365426142336:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1777051547.493690:0:6566:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 16 locks, starting at 0 00010000:00010000:1.0:1777051547.493736:0:6566:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006681d484/0x85f51a6b96712a07 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x154:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5785 expref: 30 pid: 8471 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051547.493769:0:6566:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fc75bccb/0x85f51a6b967121fd lrc: 0/0,0 mode: --/PR res: [0x280000401:0x152:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b54a6 expref: 29 pid: 27887 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051547.493800:0:6566:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d3f3d8b1/0x85f51a6b96712139 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x151:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5467 expref: 28 pid: 13320 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051547.493835:0:6566:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002118ac56/0x85f51a6b96712140 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x150:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5460 expref: 27 pid: 27884 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051547.493868:0:6566:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000abccd2ff/0x85f51a6b9671207c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x14f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5421 expref: 26 pid: 27884 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051547.493910:0:6566:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b176dcce/0x85f51a6b96711fbf lrc: 0/0,0 mode: --/PR res: [0x280000401:0x14d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b53e2 expref: 25 pid: 8470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051547.493941:0:6566:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000078617f4c/0x85f51a6b96711fc6 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x14e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b53e9 expref: 24 pid: 13320 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051547.493974:0:6566:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002bf392ca/0x85f51a6b96711f02 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x14c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b53a3 expref: 23 pid: 13320 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051547.494003:0:6566:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000036d3c9a5/0x85f51a6b9671114f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x14a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b4e5c expref: 22 pid: 27884 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051547.494070:0:6566:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000850325ca/0x85f51a6b967110ca lrc: 0/0,0 mode: --/PR res: [0x280000401:0x149:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b4e2b expref: 21 pid: 8628 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051547.494110:0:6566:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d73099c4/0x85f51a6b96711014 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x148:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b4df3 expref: 20 pid: 8471 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051547.494146:0:6566:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cac5c0d/0x85f51a6b9671101b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x147:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b4dfa expref: 19 pid: 27884 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051547.494191:0:6566:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f6a7905a/0x85f51a6b96710f57 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x146:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b4db4 expref: 18 pid: 8470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051547.494239:0:6566:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d2ebaa66/0x85f51a6b96710ea1 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x144:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b4d7c expref: 17 pid: 13320 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051547.494295:0:6566:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001bcf3c31/0x85f51a6b96710e9a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x145:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b4d75 expref: 16 pid: 55805 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051547.494336:0:6566:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ee4577a/0x85f51a6b967100fc lrc: 0/0,0 mode: --/PR res: [0x280000401:0x142:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b484a expref: 15 pid: 24468 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051547.494368:0:6566:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1777051547.494625:0:6566:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da71c0b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+14:2438:x1863365426142336:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 956us (1226us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051547.494640:0:6566:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13756 00010000:00010000:2.0:1777051547.799189:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1777051547.927013:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d950889500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3677:1863365452738560:0@lo:400:kworker.0 00000100:00100000:0.0:1777051547.927518:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051547.927652:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95088bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3680:1863365452738432:0@lo:400:kworker.0 00000100:00100000:2.0:1777051547.927755:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7fdf0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3678:1863365452738688:0@lo:400:kworker.0 00000100:00100000:1.0:1777051547.929336:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95088a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3679:1863365452738304:0@lo:400:kworker.0 00000100:00100000:0.0:1777051547.929406:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7fdf1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452739072:0@lo:400:kworker.0 00000100:00100000:1.0:1777051547.929435:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051547.929497:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051547.929510:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051547.929555:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7fdf3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3679:1863365452738816:0@lo:400:kworker.0 00000100:00100000:2.0:1777051547.929582:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7fdf0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3680:1863365452738944:0@lo:400:kworker.0 00000100:00100000:0.0:1777051547.929587:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7fdf1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3677:1863365452739584:0@lo:400:kworker.0 00000100:00100000:1.0:1777051547.929642:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051547.932188:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051547.932209:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7fdf2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3679:1863365452739328:0@lo:400:kworker.0 00000100:00100000:1.0:1777051547.932298:0:27885:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452738560 00000100:00100000:1.0:1777051547.932311:0:27885:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452738560 00000100:00100000:0.0:1777051547.932422:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7e24c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452740096:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1777051547.932435:0:27885:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452738432 00000100:00100000:1.0:1777051547.932445:0:27885:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452738432 00000100:00100000:2.0:1777051547.932506:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051547.932520:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051547.932521:0:27885:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452738816 00000100:00100000:1.0:1777051547.932536:0:27885:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452738816 00000100:00100000:2.0:1777051547.932589:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7fdf2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3680:1863365452739456:0@lo:400:kworker.0 00000100:00100000:1.0:1777051547.932606:0:27885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13581 00000100:00100000:1.0:1777051547.932633:0:27885:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da45f76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:lustre-MDT0001-lwp-OST0000_UUID+5:3677:x1863365452738560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777051547.932648:0:24468:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452739072 00000100:00100000:0.0:1777051547.932666:0:24468:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452739072 00000100:00100000:2.0:1777051547.932680:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051547.932749:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7e24ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3680:1863365452739968:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1777051547.932784:0:24468:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452739584 00000100:00100000:1.0:1777051547.932786:0:27885:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da45f76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:lustre-MDT0001-lwp-OST0000_UUID+5:3677:x1863365452738560:12345-0@lo:400:kworker.0 Request processed in 151us (5262us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051547.932797:0:24468:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452739584 00000100:00100000:1.0:1777051547.932807:0:27885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13581 00000100:00100000:2.0:1777051547.932833:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051547.932867:0:27885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13582 00000100:00100000:1.0:1777051547.932890:0:27885:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7e24d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000-lwp-OST0000_UUID+5:3680:x1863365452738432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777051547.932903:0:24468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10607 00000100:00100000:0.0:1777051547.932936:0:24468:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da45f77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3677:x1863365452739072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777051547.932956:0:46494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13583 00000100:00100000:2.0:1777051547.932984:0:46494:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d9418f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0001-lwp-OST0001_UUID+5:3679:x1863365452738816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777051547.933004:0:27885:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7e24d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000-lwp-OST0000_UUID+5:3680:x1863365452738432:12345-0@lo:400:kworker.0 Request processed in 122us (3518us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051547.933050:0:27885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13582 00000100:00100000:0.0:1777051547.933101:0:24468:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da45f77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3677:x1863365452739072:12345-0@lo:400:kworker.0 Request processed in 174us (3594us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051547.933122:0:24468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10607 00000100:00100000:0.0:1777051547.933165:0:24468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10608 00000100:00100000:1.0:1777051547.933176:0:109186:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452738304 00000100:00100000:0.0:1777051547.933186:0:24468:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da45f76680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3677:x1863365452739584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777051547.933190:0:109186:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452738304 00000100:00100000:0.0:1777051547.933328:0:24468:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da45f76680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3677:x1863365452739584:12345-0@lo:400:kworker.0 Request processed in 143us (1138us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051547.933341:0:109186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1777051547.933355:0:24468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10608 00000100:00100000:1.0:1777051547.933369:0:109186:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7d97a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f9351a01-5b0e-4470-97fd-58b9b4b312a2+23:3679:x1863365452738304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777051547.933417:0:46498:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452738944 00000100:00100000:2.0:1777051547.933426:0:46494:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d9418f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0001-lwp-OST0001_UUID+5:3679:x1863365452738816:12345-0@lo:400:kworker.0 Request processed in 165us (3498us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051547.933429:0:46498:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452738944 00000100:00100000:1.0:1777051547.933456:0:109186:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7d97a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f9351a01-5b0e-4470-97fd-58b9b4b312a2+23:3679:x1863365452738304:12345-0@lo:400:kworker.0 Request processed in 92us (4019us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051547.933459:0:46494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13583 00000100:00100000:1.0:1777051547.933473:0:109186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1777051547.933506:0:46498:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452740096 00000100:00100000:0.0:1777051547.933517:0:46498:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452740096 00000100:00100000:0.0:1777051547.933578:0:46498:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452739456 00000100:00080000:1.0:1777051547.933585:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1777051547.933586:0:46498:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452739456 00000100:00080000:1.0:1777051547.933599:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1777051547.933602:0:6585:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452739968 00000100:00080000:1.0:1777051547.933606:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1777051547.933621:0:6585:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452739968 00000100:00100000:0.0:1777051547.933647:0:46498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8380 00000100:00100000:0.0:1777051547.933677:0:46498:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da6ff7dc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+8:3680:x1863365452738944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777051547.933701:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051547.933711:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8381 00000100:00100000:2.0:1777051547.933743:0:6585:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da45f77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:3677:x1863365452740096:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1777051547.934174:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da45f77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3679:1863365452739840:0@lo:400:kworker.0 00000004:00000024:2.0:1777051547.934491:0:6585:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4194304 pending 0 free 1441529856 avail 1295290368 00000100:00100000:1.0:1777051547.936458:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051547.936519:0:46498:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da6ff7dc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+8:3680:x1863365452738944:12345-0@lo:400:kworker.0 Request processed in 2848us (4069us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051547.936524:0:6585:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da45f77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:3677:x1863365452740096:12345-0@lo:41:osp-pre-0-1.0 Request processed in 2790us (4009us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051547.936556:0:46498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8380 00000100:00100000:2.0:1777051547.936574:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8381 00000100:00100000:1.0:1777051547.936581:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95088a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3679:1863365452738304:0@lo:400:kworker.0 00000100:00100000:1.0:1777051547.936626:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7fdf3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3679:1863365452738816:0@lo:400:kworker.0 00000100:00100000:2.0:1777051547.936704:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8382 00000100:00100000:2.0:1777051547.936729:0:6585:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7e24d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3680:x1863365452739456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777051547.936840:0:6585:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7e24d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3680:x1863365452739456:12345-0@lo:400:kworker.0 Request processed in 118us (4164us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051547.936857:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8382 00000100:00100000:2.0:1777051547.936928:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8383 00000100:00100000:2.0:1777051547.936952:0:6585:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7e24c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3680:x1863365452739968:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1777051547.936997:0:6585:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4194304 pending 0 free 1446141952 avail 1299902464 00000100:00100000:1.0:1777051547.937119:0:8492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452739328 00000100:00100000:2.0:1777051547.937132:0:6585:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7e24c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3680:x1863365452739968:12345-0@lo:41:osp-pre-1-0.0 Request processed in 183us (4302us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051547.937135:0:8492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452739328 00000100:00100000:2.0:1777051547.937157:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8383 00000100:00100000:1.0:1777051547.937230:0:8492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452739840 00000100:00100000:1.0:1777051547.937243:0:8492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452739840 00000100:00100000:2.0:1777051547.937308:0:27882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13584 00000100:00100000:1.0:1777051547.937332:0:8492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13585 00000100:00100000:2.0:1777051547.937337:0:27882:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d9418f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0001_UUID+5:3679:x1863365452739328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777051547.937360:0:8492:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d9418f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3679:x1863365452739840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777051547.937463:0:27882:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d9418f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0001_UUID+5:3679:x1863365452739328:12345-0@lo:400:kworker.0 Request processed in 137us (3767us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051547.937482:0:27882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13584 00000100:00100000:1.0:1777051547.937534:0:8492:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d9418f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3679:x1863365452739840:12345-0@lo:400:kworker.0 Request processed in 127us (1030us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051547.937561:0:8492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13585 00000100:00100000:2.0:1777051547.937562:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051547.937617:0:8492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452738688 00000100:00100000:1.0:1777051547.937627:0:8492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452738688 00000100:00100000:2.0:1777051547.937634:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7fdf1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452739200:0@lo:400:kworker.0 00000100:00100000:2.0:1777051547.937706:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051547.937754:0:8492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13586 00000100:00100000:1.0:1777051547.937772:0:8492:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7e24e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3678:x1863365452738688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051547.937774:0:8470:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452739200 00000100:00100000:2.0:1777051547.937785:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7fdf2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3678:1863365452739712:0@lo:400:kworker.0 00000100:00100000:3.0:1777051547.937786:0:8470:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452739200 00000100:00100000:3.0:1777051547.937875:0:8470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10609 00000100:00100000:2.0:1777051547.937886:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051547.937896:0:8492:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7e24e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3678:x1863365452738688:12345-0@lo:400:kworker.0 Request processed in 123us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051547.937908:0:8470:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7e24d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3678:x1863365452739200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777051547.937927:0:8492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13586 00000100:00100000:2.0:1777051547.937992:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7fdf0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3678:1863365452738688:0@lo:400:kworker.0 00000100:00100000:1.0:1777051547.938009:0:27887:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452739712 00000100:00100000:1.0:1777051547.938054:0:27887:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452739712 00000100:00100000:2.0:1777051547.938126:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95088bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3680:1863365452738432:0@lo:400:kworker.0 00000100:00100000:3.0:1777051547.938127:0:8470:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7e24d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3678:x1863365452739200:12345-0@lo:400:kworker.0 Request processed in 226us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051547.938143:0:27887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10610 00000100:00100000:3.0:1777051547.938162:0:8470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10609 00000100:00100000:2.0:1777051547.938176:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7fdf0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3680:1863365452738944:0@lo:400:kworker.0 00000100:00100000:1.0:1777051547.938177:0:27887:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7e24ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3678:x1863365452739712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777051547.938279:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7fdf2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3680:1863365452739456:0@lo:400:kworker.0 00000100:00100000:2.0:1777051547.938323:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7e24ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3680:1863365452739968:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1777051547.938337:0:27887:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7e24ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3678:x1863365452739712:12345-0@lo:400:kworker.0 Request processed in 167us (456us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051547.938354:0:27887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10610 00000100:00080000:1.0:1777051547.938425:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1777051547.938434:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1777051547.938436:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7fdf1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452739200:0@lo:400:kworker.0 00000100:00100000:2.0:1777051547.938481:0:3678:0:(client.c:3101:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968380 gen 2 00000004:00080000:2.0:1777051547.938496:0:3678:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff99d944e13480, transno 4294968380 00000100:00100000:2.0:1777051547.938543:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7fdf2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3678:1863365452739712:0@lo:400:kworker.0 00000100:00100000:1.0:1777051547.938546:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7e24c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452740096:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1777051547.938593:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d950889500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3677:1863365452738560:0@lo:400:kworker.0 00000100:00100000:1.0:1777051547.938625:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7fdf1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452739072:0@lo:400:kworker.0 00000100:00100000:1.0:1777051547.938647:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7fdf1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3677:1863365452739584:0@lo:400:kworker.0 00000100:00100000:1.0:1777051547.939151:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7fdf2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3679:1863365452739328:0@lo:400:kworker.0 00000100:00100000:1.0:1777051547.939566:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da45f77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3679:1863365452739840:0@lo:400:kworker.0 00000100:00100000:3.0:1777051548.402966:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051548.403103:0:46494:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426142464 00000100:00100000:0.0:1777051548.403116:0:46494:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426142464 00000100:00100000:0.0:1777051548.403228:0:46494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112516 00000100:00080000:1.0:1777051548.403234:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1777051548.403252:0:46494:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5fbeea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c11b6966-0775-44d2-bdc6-c74c26eb2226+12:141767:x1863365426142464:12345-192.168.201.46@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1777051548.403382:0:46494:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5fbeea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c11b6966-0775-44d2-bdc6-c74c26eb2226+12:141767:x1863365426142464:12345-192.168.201.46@tcp:60:lhsmtool_posix.0 Request processed in 139us (427us total) trans 0 rc -2/-2 00000100:00100000:0.0:1777051548.403396:0:46494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112516 00000100:00100000:0.0:1777051548.408467:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051548.408669:0:6580:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426142592 00000100:00100000:1.0:1777051548.408678:0:6580:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426142592 00000100:00080000:0.0:1777051548.408750:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1777051548.408766:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112517 00000100:00100000:1.0:1777051548.408783:0:6580:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da45f75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+9:141767:x1863365426142592:12345-192.168.201.46@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1777051548.408887:0:6580:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da45f75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+9:141767:x1863365426142592:12345-192.168.201.46@tcp:60:lhsmtool_posix.0 Request processed in 107us (424us total) trans 0 rc -2/-2 00000100:00100000:1.0:1777051548.408899:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112517 00000100:00100000:0.0:1777051548.413615:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051548.414083:0:24269:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426142848 00000100:00100000:2.0:1777051548.414094:0:24269:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426142848 00000100:00100000:2.0:1777051548.414168:0:24269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3448 00000100:00100000:2.0:1777051548.414182:0:24269:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da45f74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+12:141767:x1863365426142848:12345-192.168.201.46@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1777051548.414441:0:24269:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da45f74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+13:141767:x1863365426142848:12345-192.168.201.46@tcp:35:lhsmtool_posix.0 Request processed in 260us (831us total) trans 34359738426 rc 0/0 00000100:00100000:2.0:1777051548.414453:0:24269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3448 00000100:00100000:3.0:1777051548.439400:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d9418f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3678:1863365452740224:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1777051548.439500:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051548.444243:0:8472:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452740224 00000100:00100000:2.0:1777051548.444261:0:8472:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452740224 00000100:00100000:2.0:1777051548.444331:0:8472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5750 00000100:00100000:2.0:1777051548.444346:0:8472:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5fbedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3678:x1863365452740224:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1777051548.444389:0:8472:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 515963584 pending 0 free 3860574208 avail 3629051904 00000100:00100000:2.0:1777051548.444485:0:8472:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5fbedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3678:x1863365452740224:12345-0@lo:13:osp-pre-0-0.0 Request processed in 140us (4989us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051548.444499:0:8472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5750 00000100:00100000:2.0:1777051548.444576:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d9418f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3678:1863365452740224:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1777051548.445109:0:3680:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1777051548.445133:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5fbeca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3680:1863365452740352:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1777051548.445261:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051548.445333:0:10113:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452740352 00000100:00100000:2.0:1777051548.445342:0:10113:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452740352 00000100:00100000:2.0:1777051548.445409:0:10113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5751 00000100:00100000:2.0:1777051548.445426:0:10113:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7e24ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3680:x1863365452740352:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1777051548.445459:0:10113:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 489208512 pending 0 free 3642707968 avail 3411185664 00000100:00100000:2.0:1777051548.445526:0:10113:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7e24ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3680:x1863365452740352:12345-0@lo:13:osp-pre-1-0.0 Request processed in 104us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051548.445537:0:10113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5751 00000100:00100000:2.0:1777051548.445595:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5fbeca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3680:1863365452740352:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1777051548.823302:0:108751:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1777051548.921047:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051548.921162:0:27882:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426143104 00000100:00100000:2.0:1777051548.921177:0:27882:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426143104 00000100:00100000:2.0:1777051548.921309:0:27882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112518 00000100:00100000:2.0:1777051548.921324:0:27882:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da45f75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+13:141953:x1863365426143104:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1777051548.921354:0:27882:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051548.921382:0:27882:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69aa00/0x85f51a6b96717ff1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6bdd expref: -99 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051548.921472:0:27882:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69b000/0x85f51a6b96717ff8 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051548.921491:0:27882:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69b000/0x85f51a6b96717ff8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051548.921508:0:27882:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69b000/0x85f51a6b96717ff8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051548.921529:0:27882:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69a800/0x85f51a6b96717fff lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051548.921540:0:27882:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69a800/0x85f51a6b96717fff lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051548.921550:0:27882:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69a800/0x85f51a6b96717fff lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051548.921659:0:27882:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69a400/0x85f51a6b96718006 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051548.921673:0:27882:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69a400/0x85f51a6b96718006 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051548.921683:0:27882:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69a400/0x85f51a6b96718006 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1777051548.921695:0:27882:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:2.0:1777051548.921806:0:27882:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69b000/0x85f51a6b96717ff8 lrc: 4/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051548.921825:0:27882:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69b000/0x85f51a6b96717ff8 lrc: 4/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051548.921834:0:27882:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69b000/0x85f51a6b96717ff8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051548.921844:0:27882:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69b000/0x85f51a6b96717ff8 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051548.921853:0:27882:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94f69b000 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:2.0:1777051548.921858:0:27882:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69b000/0x85f51a6b96717ff8 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051548.921870:0:27882:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69b000/0x85f51a6b96717ff8 lrc: 5/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051548.921886:0:27882:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff99da59dd4d00) 00010000:00010000:2.0:1777051548.921890:0:27882:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777051548.921897:0:27882:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69b000/0x85f51a6b96717ff8 lrc: 3/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051548.921906:0:27882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69b000/0x85f51a6b96717ff8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051548.921927:0:27882:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69a800/0x85f51a6b96717fff lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051548.921936:0:27882:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69a800/0x85f51a6b96717fff lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051548.921945:0:27882:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69a800/0x85f51a6b96717fff lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051548.921953:0:27882:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94f69a800 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:2.0:1777051548.921958:0:27882:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69a800/0x85f51a6b96717fff lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051548.921966:0:27882:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69a800/0x85f51a6b96717fff lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051548.921977:0:27882:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff99da59dd4c00) 00010000:00010000:2.0:1777051548.921980:0:27882:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777051548.921984:0:27882:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69a800/0x85f51a6b96717fff lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051548.921993:0:27882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69a800/0x85f51a6b96717fff lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051548.922435:0:27882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69aa00/0x85f51a6b96717ff1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6bdd expref: 16 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051548.922457:0:27882:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69a400/0x85f51a6b96718006 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6bdd expref: 15 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051548.922467:0:27882:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99d9413d2e00) 00010000:00010000:2.0:1777051548.922470:0:27882:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777051548.922474:0:27882:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d94f69a400, rc 0) 00000100:00100000:2.0:1777051548.922557:0:27882:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da45f75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+15:141953:x1863365426143104:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 Request processed in 1235us (1551us total) trans 34359738427 rc 0/0 00000100:00100000:2.0:1777051548.922568:0:27882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112518 00000100:00100000:0.0:1777051548.930178:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051548.930669:0:21368:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426143232 00000100:00100000:1.0:1777051548.930681:0:21368:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426143232 00000100:00100000:1.0:1777051548.930775:0:21368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112519 00000100:00100000:1.0:1777051548.930790:0:21368:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da45f75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+15:141953:x1863365426143232:12345-192.168.201.46@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1777051548.930901:0:21368:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da45f75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+15:141953:x1863365426143232:12345-192.168.201.46@tcp:59:lhsmtool_posix.0 Request processed in 113us (729us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051548.930913:0:21368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112519 00000100:00100000:0.0:1777051548.933728:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051548.935800:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051548.935923:0:27885:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426143488 00000100:00100000:1.0:1777051548.935938:0:27885:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426143488 00000100:00100000:1.0:1777051548.936051:0:27885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112520 00000100:00100000:1.0:1777051548.936066:0:27885:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da45f76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c11b6966-0775-44d2-bdc6-c74c26eb2226+9:141953:x1863365426143488:12345-192.168.201.46@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1777051548.936372:0:47827:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426143360 00000100:00100000:2.0:1777051548.936381:0:47827:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426143360 00000100:00100000:2.0:1777051548.936461:0:47827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13757 00000100:00100000:2.0:1777051548.936475:0:47827:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da45f76d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+15:2436:x1863365426143360:12345-192.168.201.46@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1777051548.936484:0:27885:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da45f76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c11b6966-0775-44d2-bdc6-c74c26eb2226+9:141953:x1863365426143488:12345-192.168.201.46@tcp:59:lhsmtool_posix.0 Request processed in 417us (681us total) trans 0 rc 0/0 00010000:00010000:2.0:1777051548.936494:0:47827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1777051548.936507:0:27885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112520 00010000:00010000:2.0:1777051548.936525:0:47827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69a400/0x85f51a6b96718006 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6bdd expref: 15 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051548.936543:0:47827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99d9413d2e00) 00010000:00010000:2.0:1777051548.936548:0:47827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1777051548.936576:0:47827:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da45f76d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+14:2436:x1863365426143360:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 104us (2862us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051548.936585:0:47827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13757 00000040:00080000:1.0:1777051549.401692:0:110973:0:(llog.c:801:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1777051549.401704:0:110973:0:(llog_cat.c:158:llog_cat_process_common()) processing log [0x1:0x12:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1777051549.403628:0:110973:0:(llog.c:858:llog_process_thread()) stop processing plain [0x1:0x12:0x0] index 64768 count 1 00000040:00080000:1.0:1777051549.403645:0:110973:0:(llog.c:858:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1777051549.602062:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051549.602986:0:109181:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426143616 00000100:00100000:2.0:1777051549.603030:0:109181:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426143616 00000100:00100000:3.0:1777051549.603104:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051549.603492:0:109181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 101 00000100:00100000:2.0:1777051549.603513:0:109181:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7d97a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29c4352d-3260-4734-909d-9ea5de9e7fa4+12:2437:x1863365426143616:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:2.0:1777051549.603633:0:109181:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7d97a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29c4352d-3260-4734-909d-9ea5de9e7fa4+12:2437:x1863365426143616:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 125us (1579us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051549.603649:0:109181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 101 00000100:00100000:3.0:1777051549.603948:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051549.604058:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051549.604099:0:46494:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426143744 00000100:00100000:3.0:1777051549.604107:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051549.604111:0:46494:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426143744 00000100:00100000:3.0:1777051549.604154:0:24468:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426144000 00000100:00100000:3.0:1777051549.604164:0:24468:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426144000 00000100:00100000:2.0:1777051549.604167:0:46494:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426143872 00000100:00100000:2.0:1777051549.604174:0:46494:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426143872 00000100:00100000:2.0:1777051549.604536:0:46494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13587 00000100:00100000:2.0:1777051549.604551:0:46494:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5fbee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c11b6966-0775-44d2-bdc6-c74c26eb2226+14:2436:x1863365426143744:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:3.0:1777051549.604558:0:24468:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426144128 00000100:00100000:3.0:1777051549.604566:0:24468:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426144128 00000100:00100000:3.0:1777051549.604618:0:24468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10611 00000100:00100000:3.0:1777051549.604640:0:24468:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5fbec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+14:2436:x1863365426144000:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:3.0:1777051549.604694:0:24468:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5fbec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+14:2436:x1863365426144000:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 60us (636us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051549.604708:0:24468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10611 00000100:00100000:3.0:1777051549.604733:0:24468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10612 00000100:00100000:3.0:1777051549.604748:0:24468:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5fbeed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+30:2437:x1863365426144128:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:3.0:1777051549.605115:0:24468:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5fbeed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+30:2437:x1863365426144128:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 368us (1009us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051549.605129:0:24468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10612 00000100:00080000:3.0:1777051549.605164:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1777051549.605170:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1777051549.605224:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13588 00000100:00100000:3.0:1777051549.605243:0:6579:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5fbeca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+9:2437:x1863365426143872:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:3.0:1777051549.605292:0:6579:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5fbeca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+9:2437:x1863365426143872:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 56us (1350us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051549.605302:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13588 00000100:00100000:2.0:1777051549.605324:0:46494:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5fbee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c11b6966-0775-44d2-bdc6-c74c26eb2226+14:2436:x1863365426143744:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 77us (1525us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051549.605359:0:46494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13587 00000100:00100000:2.0:1777051549.607678:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051549.607732:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051549.607772:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051549.607812:0:8470:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426144640 00000100:00100000:2.0:1777051549.607820:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051549.607826:0:8470:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426144640 00000100:00100000:2.0:1777051549.607858:0:8492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426144384 00000100:00100000:2.0:1777051549.607867:0:8492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426144384 00000100:00100000:0.0:1777051549.607904:0:8470:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426144512 00000100:00100000:0.0:1777051549.607912:0:8470:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426144512 00000100:00100000:2.0:1777051549.607933:0:8492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426144256 00000100:00100000:2.0:1777051549.607941:0:8492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426144256 00000100:00100000:0.0:1777051549.607969:0:8470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10613 00000100:00100000:0.0:1777051549.607985:0:8470:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7e24df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+30:2437:x1863365426144640:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:2.0:1777051549.608027:0:8492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13589 00000100:00100000:2.0:1777051549.608044:0:8492:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7e24dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+54:2437:x1863365426144384:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:0.0:1777051549.608085:0:8470:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7e24df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+30:2437:x1863365426144640:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 102us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051549.608097:0:8470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10613 00000100:00100000:2.0:1777051549.608116:0:8492:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7e24dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+54:2437:x1863365426144384:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 72us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051549.608128:0:8470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10614 00000100:00100000:2.0:1777051549.608134:0:8492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13589 00000100:00100000:0.0:1777051549.608145:0:8470:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7e24ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+16:2436:x1863365426144512:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:2.0:1777051549.608166:0:8492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13590 00000100:00100000:2.0:1777051549.608180:0:8492:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7e24fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+12:2436:x1863365426144256:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:0.0:1777051549.608231:0:8470:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7e24ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+16:2436:x1863365426144512:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 88us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051549.608243:0:8470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10614 00000100:00100000:2.0:1777051549.608275:0:8492:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7e24fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+12:2436:x1863365426144256:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 95us (499us total) trans 0 rc 0/0 00000100:00080000:0.0:1777051549.608277:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1777051549.608285:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1777051549.608291:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1777051549.608295:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1777051549.608300:0:8492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13590 00000040:00080000:2.0:1777051549.654505:0:110924:0:(llog.c:801:llog_process_thread()) index: 6, lh_last_idx: 7 synced_idx: 0 lgh_last_idx: 7 00000040:00080000:2.0:1777051549.654517:0:110924:0:(llog_cat.c:158:llog_cat_process_common()) processing log [0x1:0x2b:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1777051549.654555:0:110924:0:(llog.c:858:llog_process_thread()) stop processing plain [0x1:0x2b:0x0] index 12 count 2 00000040:00080000:2.0:1777051549.654569:0:110924:0:(llog.c:801:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:2.0:1777051549.654572:0:110924:0:(llog_cat.c:158:llog_cat_process_common()) processing log [0x1:0x31:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1777051549.654602:0:110924:0:(llog.c:858:llog_process_thread()) stop processing plain [0x1:0x31:0x0] index 4 count 4 00000040:00080000:2.0:1777051549.654608:0:110924:0:(llog.c:858:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 3 00000100:00100000:2.0:1777051549.655091:0:110924:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7e24e300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:110924:1863365452740480:192.168.201.46@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1777051549.655550:0:110924:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da7d50cf00 going to sleep for 11 seconds 00000100:00100000:1.0:1777051549.663222:0:110924:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7e24e300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:110924:1863365452740480:192.168.201.46@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1777051549.663371:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051549.663423:0:27885:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426144768 00000100:00100000:1.0:1777051549.663435:0:27885:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426144768 00000100:00100000:1.0:1777051549.663513:0:27885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112521 00000100:00100000:1.0:1777051549.663530:0:27885:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5fbed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c11b6966-0775-44d2-bdc6-c74c26eb2226+14:141963:x1863365426144768:12345-192.168.201.46@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1777051549.663568:0:27885:0:(mdt_handler.c:7958:mdt_fid2path()) path get [0x2000032e3:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1777051549.663721:0:27885:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5fbed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c11b6966-0775-44d2-bdc6-c74c26eb2226+14:141963:x1863365426144768:12345-192.168.201.46@tcp:53:lhsmtool_posix.0 Request processed in 193us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051549.663734:0:27885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112521 00000100:00100000:2.0:1777051549.667199:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051549.667303:0:6579:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426144896 00000100:00100000:3.0:1777051549.667314:0:6579:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426144896 00000100:00100000:3.0:1777051549.667374:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112522 00000100:00100000:3.0:1777051549.667387:0:6579:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7e24f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+14:141963:x1863365426144896:12345-192.168.201.46@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1777051549.667470:0:6579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce000/0x85f51a6b96718014 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051549.667495:0:6579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce000/0x85f51a6b96718014 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051549.667513:0:6579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce000/0x85f51a6b96718014 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051549.667534:0:6579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cec00/0x85f51a6b9671801b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xf907efab bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051549.667552:0:6579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cec00/0x85f51a6b9671801b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xf907efab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051549.667562:0:6579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cec00/0x85f51a6b9671801b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xf907efab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051549.667598:0:6579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce600/0x85f51a6b96718022 lrc: 3/1,0 mode: --/PR res: [0x2000032e3:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051549.667613:0:6579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce600/0x85f51a6b96718022 lrc: 3/1,0 mode: PR/PR res: [0x2000032e3:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051549.667626:0:6579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce600/0x85f51a6b96718022 lrc: 3/1,0 mode: PR/PR res: [0x2000032e3:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1777051549.667679:0:6579:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000032e3:0xe:0x0]: returning size 0 00000004:00200000:3.0:1777051549.667687:0:6579:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1777051549.667737:0:6579:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce600/0x85f51a6b96718022 lrc: 3/1,0 mode: PR/PR res: [0x2000032e3:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051549.667756:0:6579:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce000/0x85f51a6b96718014 lrc: 4/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051549.667768:0:6579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce000/0x85f51a6b96718014 lrc: 4/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051549.667778:0:6579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce000/0x85f51a6b96718014 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051549.667789:0:6579:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce000/0x85f51a6b96718014 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051549.667805:0:6579:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da7d5ce000 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:3.0:1777051549.667811:0:6579:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce000/0x85f51a6b96718014 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051549.667822:0:6579:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce000/0x85f51a6b96718014 lrc: 5/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051549.667840:0:6579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99d9413d2e00) 00010000:00010000:3.0:1777051549.667844:0:6579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777051549.667852:0:6579:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce000/0x85f51a6b96718014 lrc: 3/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051549.667862:0:6579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce000/0x85f51a6b96718014 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051549.667882:0:6579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cec00/0x85f51a6b9671801b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xf907efab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051549.667891:0:6579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cec00/0x85f51a6b9671801b lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xf907efab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051549.667900:0:6579:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cec00/0x85f51a6b9671801b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xf907efab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051549.667909:0:6579:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da7d5cec00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:3.0:1777051549.667913:0:6579:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cec00/0x85f51a6b9671801b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xf907efab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051549.667924:0:6579:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cec00/0x85f51a6b9671801b lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xf907efab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051549.667943:0:6579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xf907efab (ffff99d9413d0700) 00010000:00010000:3.0:1777051549.667948:0:6579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777051549.667952:0:6579:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cec00/0x85f51a6b9671801b lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xf907efab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051549.667962:0:6579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cec00/0x85f51a6b9671801b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xf907efab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051549.668013:0:6579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce600/0x85f51a6b96718022 lrc: 3/1,0 mode: PR/PR res: [0x2000032e3:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051549.668024:0:6579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce600/0x85f51a6b96718022 lrc: 2/0,0 mode: PR/PR res: [0x2000032e3:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051549.668033:0:6579:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce600/0x85f51a6b96718022 lrc: 3/0,0 mode: PR/PR res: [0x2000032e3:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051549.668042:0:6579:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da7d5ce600 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:3.0:1777051549.668047:0:6579:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce600/0x85f51a6b96718022 lrc: 3/0,0 mode: PR/PR res: [0x2000032e3:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051549.668056:0:6579:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce600/0x85f51a6b96718022 lrc: 4/0,0 mode: PR/PR res: [0x2000032e3:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051549.668070:0:6579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e3:0xe:0x0].0x0 (ffff99da59dd4700) 00010000:00010000:3.0:1777051549.668074:0:6579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777051549.668079:0:6579:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce600/0x85f51a6b96718022 lrc: 2/0,0 mode: --/PR res: [0x2000032e3:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051549.668088:0:6579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce600/0x85f51a6b96718022 lrc: 0/0,0 mode: --/PR res: [0x2000032e3:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051549.668184:0:6579:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7e24f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+14:141963:x1863365426144896:12345-192.168.201.46@tcp:34:lhsmtool_posix.0 Request processed in 798us (990us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051549.668233:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112522 00000100:00100000:2.0:1777051549.673791:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051549.673862:0:6581:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426145152 00000100:00100000:3.0:1777051549.673873:0:6581:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426145152 00000100:00100000:3.0:1777051549.673945:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112523 00000100:00100000:3.0:1777051549.673961:0:6581:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7e24c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+14:141963:x1863365426145152:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1777051549.673983:0:6581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777051549.674037:0:6581:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cf800/0x85f51a6b96718029 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6be4 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051549.674154:0:6581:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cfc00/0x85f51a6b96718030 lrc: 3/1,0 mode: --/PR res: [0x2000032e3:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051549.674173:0:6581:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cfc00/0x85f51a6b96718030 lrc: 3/1,0 mode: PR/PR res: [0x2000032e3:0xe:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051549.674189:0:6581:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cfc00/0x85f51a6b96718030 lrc: 3/1,0 mode: PR/PR res: [0x2000032e3:0xe:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1777051549.674205:0:6581:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000032e3:0xe:0x0]: returning size 0 00010000:00010000:3.0:1777051549.674429:0:6581:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cfc00/0x85f51a6b96718030 lrc: 3/1,0 mode: PR/PR res: [0x2000032e3:0xe:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051549.674444:0:6581:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cfc00/0x85f51a6b96718030 lrc: 2/0,0 mode: PR/PR res: [0x2000032e3:0xe:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051549.674456:0:6581:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cfc00/0x85f51a6b96718030 lrc: 3/0,0 mode: PR/PR res: [0x2000032e3:0xe:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051549.674472:0:6581:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da7d5cfc00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:3.0:1777051549.674477:0:6581:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cfc00/0x85f51a6b96718030 lrc: 3/0,0 mode: PR/PR res: [0x2000032e3:0xe:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051549.674484:0:6581:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cfc00/0x85f51a6b96718030 lrc: 4/0,0 mode: PR/PR res: [0x2000032e3:0xe:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051549.674498:0:6581:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e3:0xe:0x0].0x0 (ffff99da59dd4700) 00010000:00010000:3.0:1777051549.674502:0:6581:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1777051549.674506:0:6581:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cfc00/0x85f51a6b96718030 lrc: 2/0,0 mode: --/PR res: [0x2000032e3:0xe:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051549.674513:0:6581:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cfc00/0x85f51a6b96718030 lrc: 0/0,0 mode: --/PR res: [0x2000032e3:0xe:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051549.674560:0:6581:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cf800/0x85f51a6b96718029 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6be4 expref: 16 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051549.674577:0:6581:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99d9413d2e00) 00010000:00010000:3.0:1777051549.674581:0:6581:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1777051549.674589:0:6581:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cf800/0x85f51a6b96718029 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6be4 expref: 16 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051549.674607:0:6581:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99da7d5cf800, rc 0) 00000100:00100000:3.0:1777051549.674674:0:6581:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7e24c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+15:141963:x1863365426145152:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 Request processed in 716us (887us total) trans 34359738428 rc 301/301 00000100:00100000:3.0:1777051549.674686:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112523 00000100:00100000:3.0:1777051549.680367:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051549.680715:0:8492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426145280 00000100:00100000:1.0:1777051549.680727:0:8492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426145280 00000100:00100000:1.0:1777051549.680792:0:8492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112524 00000100:00100000:1.0:1777051549.680805:0:8492:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5fbef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+15:141963:x1863365426145280:12345-192.168.201.46@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1777051549.680842:0:8492:0:(mdt_handler.c:7958:mdt_fid2path()) path get [0x2000032e3:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1777051549.681012:0:8492:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5fbef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+15:141963:x1863365426145280:12345-192.168.201.46@tcp:53:lhsmtool_posix.0 Request processed in 181us (623us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051549.681028:0:8492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112524 00000100:00100000:2.0:1777051549.688291:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051549.688403:0:46497:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426145536 00000100:00100000:3.0:1777051549.688415:0:46497:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426145536 00000100:00100000:3.0:1777051549.688512:0:46497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112525 00000100:00100000:3.0:1777051549.688527:0:46497:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7e24e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:c11b6966-0775-44d2-bdc6-c74c26eb2226+15:141963:x1863365426145536:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1777051549.688833:0:46497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777051549.688861:0:46497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cf800/0x85f51a6b9671803e lrc: 2/0,0 mode: --/CW res: [0x2000032e2:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6beb expref: -99 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051549.692082:0:46497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cfc00/0x85f51a6b96718045 lrc: 3/1,0 mode: --/PR res: [0x2000032e3:0xf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051549.692108:0:46497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cfc00/0x85f51a6b96718045 lrc: 3/1,0 mode: PR/PR res: [0x2000032e3:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051549.692126:0:46497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cfc00/0x85f51a6b96718045 lrc: 3/1,0 mode: PR/PR res: [0x2000032e3:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1777051549.692145:0:46497:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000032e3:0xf:0x0]: returning size 0 00010000:00010000:3.0:1777051549.692252:0:46497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cf800/0x85f51a6b9671803e lrc: 0/0,0 mode: --/CW res: [0x2000032e2:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6beb expref: 18 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051549.692280:0:46497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cfc00/0x85f51a6b96718045 lrc: 3/0,0 mode: PR/PR res: [0x2000032e3:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6beb expref: 17 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051549.692293:0:46497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e3:0xf:0x0].0x0 (ffff99d9413d0700) 00010000:00010000:3.0:1777051549.692297:0:46497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1777051549.692301:0:46497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99da7d5cfc00, rc 0) 00000100:00100000:3.0:1777051549.692374:0:46497:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7e24e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:c11b6966-0775-44d2-bdc6-c74c26eb2226+17:141963:x1863365426145536:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 Request processed in 3850us (4090us total) trans 34359738429 rc 0/0 00000100:00100000:3.0:1777051549.692393:0:46497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112525 00000100:00100000:0.0:1777051549.698579:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051549.698634:0:10328:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426145792 00000100:00100000:2.0:1777051549.698646:0:10328:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426145792 00000100:00100000:2.0:1777051549.698727:0:10328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112526 00000100:00100000:2.0:1777051549.698744:0:10328:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da45f75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+17:141963:x1863365426145792:12345-192.168.201.46@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1777051549.698803:0:10328:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777051549.698833:0:10328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cfc00/0x85f51a6b96718045 lrc: 0/0,0 mode: --/PR res: [0x2000032e3:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6beb expref: 17 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051549.698857:0:10328:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e3:0xf:0x0].0x0 (ffff99d9413d0700) 00010000:00010000:2.0:1777051549.698871:0:10328:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1777051549.698898:0:10328:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69ae00/0x85f51a6b96718053 lrc: 3/0,1 mode: --/CW res: [0x2000032e2:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051549.698920:0:10328:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710000/0x85f51a6b96717f49 lrc: 2/0,0 mode: PR/PR res: [0x2000032e2:0xe:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6bac expref: 11 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051549.698932:0:10328:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69ae00/0x85f51a6b96718053 lrc: 4/0,1 mode: --/CW res: [0x2000032e2:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051549.698978:0:10328:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710000/0x85f51a6b96717f49 lrc: 3/0,0 mode: PR/PR res: [0x2000032e2:0xe:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6bac expref: 11 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051549.699032:0:10328:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710000/0x85f51a6b96717f49 lrc: 4/0,0 mode: PR/PR res: [0x2000032e2:0xe:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6bac expref: 11 pid: 6579 timeout: 8278 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051549.699062:0:10328:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7e24c700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10328:1863365452740608:192.168.201.46@tcp:104: 00000100:00100000:2.0:1777051549.699172:0:10328:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da7d50c480 going to sleep for 11 seconds 00000040:00080000:2.0:1777051549.701509:0:111118:0:(llog.c:801:llog_process_thread()) index: 6, lh_last_idx: 7 synced_idx: 0 lgh_last_idx: 7 00000040:00080000:2.0:1777051549.701517:0:111118:0:(llog_cat.c:158:llog_cat_process_common()) processing log [0x1:0x2b:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1777051549.701553:0:111118:0:(llog.c:858:llog_process_thread()) stop processing plain [0x1:0x2b:0x0] index 12 count 2 00000040:00080000:2.0:1777051549.701568:0:111118:0:(llog.c:801:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:2.0:1777051549.701572:0:111118:0:(llog_cat.c:158:llog_cat_process_common()) processing log [0x1:0x31:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1777051549.701607:0:111118:0:(llog.c:858:llog_process_thread()) stop processing plain [0x1:0x31:0x0] index 4 count 4 00000040:00080000:2.0:1777051549.701613:0:111118:0:(llog.c:858:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 3 00000100:00100000:3.0:1777051549.704581:0:10328:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7e24c700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10328:1863365452740608:192.168.201.46@tcp:104: 00010000:00010000:3.0:1777051549.704610:0:10328:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69ae00/0x85f51a6b96718053 lrc: 3/0,1 mode: --/CW res: [0x2000032e2:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051549.706372:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051549.706565:0:24467:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426145920 00000100:00100000:3.0:1777051549.706587:0:24467:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426145920 00010000:00010000:3.0:1777051549.706648:0:24467:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710000/0x85f51a6b96717f49 lrc: 4/0,0 mode: PR/PR res: [0x2000032e2:0xe:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6bac expref: 12 pid: 6579 timeout: 8278 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051549.706720:0:24467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3994 00000100:00100000:3.0:1777051549.706737:0:24467:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da45f77480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+12:2436:x1863365426145920:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1777051549.706775:0:24467:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777051549.706786:0:24467:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710000/0x85f51a6b96717f49 lrc: 4/0,0 mode: PR/PR res: [0x2000032e2:0xe:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6bac expref: 12 pid: 6579 timeout: 8278 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051549.706807:0:24467:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710000/0x85f51a6b96717f49 lrc: 3/0,0 mode: PR/PR res: [0x2000032e2:0xe:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6bac expref: 12 pid: 6579 timeout: 8278 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051549.706836:0:24467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710000/0x85f51a6b96717f49 lrc: 0/0,0 mode: --/PR res: [0x2000032e2:0xe:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6bac expref: 12 pid: 6579 timeout: 8278 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051549.706859:0:24467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0xe:0x0].0x0 (ffff99d9413d2100) 00010000:00010000:3.0:1777051549.706866:0:24467:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69ae00/0x85f51a6b96718053 lrc: 3/0,1 mode: --/CW res: [0x2000032e2:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051549.706892:0:24467:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69ae00/0x85f51a6b96718053 lrc: 3/0,1 mode: CW/CW res: [0x2000032e2:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051549.706905:0:24467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69ae00/0x85f51a6b96718053 lrc: 4/0,1 mode: CW/CW res: [0x2000032e2:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051549.706963:0:24467:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1777051549.707038:0:10328:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69ae00/0x85f51a6b96718053 lrc: 3/0,1 mode: CW/CW res: [0x2000032e2:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051549.707053:0:10328:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69ae00/0x85f51a6b96718053 lrc: 3/0,1 mode: CW/CW res: [0x2000032e2:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051549.707076:0:24467:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da45f77480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+11:2436:x1863365426145920:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 341us (705us total) trans 0 rc 0/0 00010000:00010000:2.0:1777051549.707085:0:10328:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69b400/0x85f51a6b9671805a lrc: 3/0,1 mode: --/PW res: [0x2000032e2:0xe:0x0].0x68f8e2b0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051549.707091:0:24467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3994 00010000:00010000:2.0:1777051549.707591:0:10328:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69b400/0x85f51a6b9671805a lrc: 3/0,1 mode: PW/PW res: [0x2000032e2:0xe:0x0].0x68f8e2b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051549.707606:0:10328:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69b400/0x85f51a6b9671805a lrc: 3/0,1 mode: PW/PW res: [0x2000032e2:0xe:0x0].0x68f8e2b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051549.707737:0:10328:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69ae00/0x85f51a6b96718053 lrc: 4/0,1 mode: CW/CW res: [0x2000032e2:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051549.707747:0:10328:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69ae00/0x85f51a6b96718053 lrc: 4/0,1 mode: CW/CW res: [0x2000032e2:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051549.707759:0:10328:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69ae00/0x85f51a6b96718053 lrc: 3/0,0 mode: CW/CW res: [0x2000032e2:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051549.707767:0:10328:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69ae00/0x85f51a6b96718053 lrc: 4/0,0 mode: CW/CW res: [0x2000032e2:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051549.707773:0:10328:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94f69ae00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:2.0:1777051549.707777:0:10328:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69ae00/0x85f51a6b96718053 lrc: 4/0,0 mode: CW/CW res: [0x2000032e2:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051549.707785:0:10328:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69ae00/0x85f51a6b96718053 lrc: 5/0,0 mode: CW/CW res: [0x2000032e2:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051549.707794:0:10328:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0xe:0x0].0x0 (ffff99d9413d2100) 00010000:00010000:2.0:1777051549.707797:0:10328:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777051549.707801:0:10328:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69ae00/0x85f51a6b96718053 lrc: 3/0,0 mode: --/CW res: [0x2000032e2:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051549.707825:0:10328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69ae00/0x85f51a6b96718053 lrc: 0/0,0 mode: --/CW res: [0x2000032e2:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051549.707837:0:10328:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69b400/0x85f51a6b9671805a lrc: 3/0,1 mode: PW/PW res: [0x2000032e2:0xe:0x0].0x68f8e2b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051549.707843:0:10328:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69b400/0x85f51a6b9671805a lrc: 2/0,0 mode: PW/PW res: [0x2000032e2:0xe:0x0].0x68f8e2b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051549.707850:0:10328:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69b400/0x85f51a6b9671805a lrc: 3/0,0 mode: PW/PW res: [0x2000032e2:0xe:0x0].0x68f8e2b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051549.707856:0:10328:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94f69b400 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:2.0:1777051549.707860:0:10328:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69b400/0x85f51a6b9671805a lrc: 3/0,0 mode: PW/PW res: [0x2000032e2:0xe:0x0].0x68f8e2b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051549.707866:0:10328:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69b400/0x85f51a6b9671805a lrc: 4/0,0 mode: PW/PW res: [0x2000032e2:0xe:0x0].0x68f8e2b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051549.707873:0:10328:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0xe:0x0].0x68f8e2b0 (ffff99da59dd4400) 00010000:00010000:2.0:1777051549.707876:0:10328:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777051549.707879:0:10328:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69b400/0x85f51a6b9671805a lrc: 2/0,0 mode: --/PW res: [0x2000032e2:0xe:0x0].0x68f8e2b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051549.707884:0:10328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69b400/0x85f51a6b9671805a lrc: 0/0,0 mode: --/PW res: [0x2000032e2:0xe:0x0].0x68f8e2b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051549.708032:0:10328:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da45f75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+16:141963:x1863365426145792:12345-192.168.201.46@tcp:36:lhsmtool_posix.0 Request processed in 9289us (9460us total) trans 0 rc -2/-2 00000100:00100000:2.0:1777051549.708045:0:10328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112526 00000100:00100000:2.0:1777051549.714125:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051549.714251:0:46494:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426146048 00000100:00100000:3.0:1777051549.714263:0:46494:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426146048 00000100:00100000:3.0:1777051549.714334:0:46494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112527 00000100:00100000:3.0:1777051549.714350:0:46494:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7e24c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c11b6966-0775-44d2-bdc6-c74c26eb2226+16:141963:x1863365426146048:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1777051549.714376:0:46494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777051549.714405:0:46494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cf800/0x85f51a6b96718061 lrc: 2/0,0 mode: --/PR res: [0x2000032e3:0xf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6bf2 expref: -99 pid: 46494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051549.714452:0:46494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce600/0x85f51a6b96718068 lrc: 3/1,0 mode: --/PR res: [0x2000032e3:0xf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051549.714471:0:46494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce600/0x85f51a6b96718068 lrc: 3/1,0 mode: PR/PR res: [0x2000032e3:0xf:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051549.714488:0:46494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce600/0x85f51a6b96718068 lrc: 3/1,0 mode: PR/PR res: [0x2000032e3:0xf:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051549.714623:0:46494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cf800/0x85f51a6b96718061 lrc: 0/0,0 mode: --/PR res: [0x2000032e3:0xf:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6bf2 expref: 18 pid: 46494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051549.714654:0:46494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce600/0x85f51a6b96718068 lrc: 3/0,0 mode: PR/PR res: [0x2000032e3:0xf:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6bf2 expref: 17 pid: 46494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051549.714669:0:46494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e3:0xf:0x0].0x0 (ffff99d9413d0400) 00010000:00010000:3.0:1777051549.714674:0:46494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1777051549.714680:0:46494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99da7d5ce600, rc 0) 00000100:00100000:3.0:1777051549.715093:0:46494:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7e24c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c11b6966-0775-44d2-bdc6-c74c26eb2226+17:141963:x1863365426146048:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 Request processed in 744us (970us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051549.715107:0:46494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112527 00000100:00100000:0.0:1777051549.719102:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051549.719187:0:6580:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426146304 00000100:00100000:1.0:1777051549.719197:0:6580:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426146304 00000100:00100000:1.0:1777051549.719262:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112528 00000100:00100000:1.0:1777051549.719279:0:6580:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955505f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+17:141963:x1863365426146304:12345-192.168.201.46@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1777051549.719358:0:6580:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502da400/0x85f51a6b9671806f lrc: 3/0,1 mode: --/PW res: [0x2000032e3:0xf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051549.719379:0:6580:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502da400/0x85f51a6b9671806f lrc: 3/0,1 mode: PW/PW res: [0x2000032e3:0xf:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051549.719395:0:6580:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502da400/0x85f51a6b9671806f lrc: 3/0,1 mode: PW/PW res: [0x2000032e3:0xf:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1777051549.719565:0:6580:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000004ffc66dc reply state 00000000d2fbd217 transno 34359738430 ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502da400/0x85f51a6b9671806f lrc: 3/0,1 mode: PW/PW res: [0x2000032e3:0xf:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051549.719584:0:6580:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502da400/0x85f51a6b9671806f lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e3:0xf:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051549.719595:0:6580:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e3:0xf:0x0].0x0 (ffff99d9413d0400) 00010000:00010000:1.0:1777051549.719599:0:6580:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1777051549.719603:0:6580:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1777051549.719838:0:6580:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955505f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+19:141963:x1863365426146304:12345-192.168.201.46@tcp:36:lhsmtool_posix.0 Request processed in 562us (756us total) trans 34359738430 rc 0/0 00000100:00100000:1.0:1777051549.719851:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112528 00000100:00100000:0.0:1777051549.724957:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051549.725233:0:21368:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426146432 00000100:00100000:1.0:1777051549.725245:0:21368:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426146432 00000100:00100000:1.0:1777051549.725319:0:21368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112529 00000100:00100000:1.0:1777051549.725334:0:21368:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955507480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+19:141963:x1863365426146432:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1777051549.725361:0:21368:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777051549.725395:0:21368:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502dae00/0x85f51a6b96718076 lrc: 2/0,0 mode: --/CR res: [0x2000032e3:0xf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6bf9 expref: -99 pid: 21368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051549.725472:0:21368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502dae00/0x85f51a6b96718076 lrc: 3/0,0 mode: CR/CR res: [0x2000032e3:0xf:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6bf9 expref: 20 pid: 21368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051549.725516:0:21368:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502dae00/0x85f51a6b96718076 lrc: 3/0,0 mode: CR/CR res: [0x2000032e3:0xf:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6bf9 expref: 20 pid: 21368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051549.725532:0:21368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e3:0xf:0x0].0x0 (ffff99d9413d0400) 00010000:00010000:1.0:1777051549.725536:0:21368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1777051549.725542:0:21368:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d9502dae00, rc 0) 00000100:00100000:1.0:1777051549.725599:0:21368:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955507480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+20:141963:x1863365426146432:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 Request processed in 268us (656us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051549.725611:0:21368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112529 00000100:00100000:0.0:1777051549.729560:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051549.729613:0:6583:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426146560 00000100:00100000:0.0:1777051549.729622:0:6583:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426146560 00000100:00100000:0.0:1777051549.729687:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3449 00000100:00100000:0.0:1777051549.729701:0:6583:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955506300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+20:141963:x1863365426146560:12345-192.168.201.46@tcp:49:lhsmtool_posix.0 00000100:00100000:0.0:1777051549.729836:0:6583:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955506300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+20:141963:x1863365426146560:12345-192.168.201.46@tcp:49:lhsmtool_posix.0 Request processed in 137us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051549.729852:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3449 00000100:00100000:0.0:1777051549.735461:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051549.737059:0:46501:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426146816 00000100:00100000:3.0:1777051549.737072:0:46501:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426146816 00000100:00100000:3.0:1777051549.737141:0:46501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3450 00000100:00100000:3.0:1777051549.737154:0:46501:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+20:141963:x1863365426146816:12345-192.168.201.46@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1777051549.737674:0:46501:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+21:141963:x1863365426146816:12345-192.168.201.46@tcp:35:lhsmtool_posix.0 Request processed in 520us (2220us total) trans 34359738431 rc 0/0 00000100:00100000:3.0:1777051549.737687:0:46501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3450 00000100:00100000:3.0:1777051549.743594:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051549.745119:0:27882:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426147072 00000100:00100000:0.0:1777051549.745131:0:27882:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426147072 00000100:00100000:0.0:1777051549.745260:0:27882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112530 00000100:00100000:0.0:1777051549.745274:0:27882:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d944e13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+21:141963:x1863365426147072:12345-192.168.201.46@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1777051549.745412:0:27882:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d944e13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+21:141963:x1863365426147072:12345-192.168.201.46@tcp:57:lhsmtool_posix.0 Request processed in 140us (1822us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051549.745425:0:27882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112530 00000100:00100000:2.0:1777051549.749956:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051549.750057:0:27885:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426147328 00000100:00100000:1.0:1777051549.750065:0:27885:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426147328 00000100:00100000:1.0:1777051549.750111:0:27885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112531 00000100:00100000:1.0:1777051549.750119:0:27885:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f865f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c11b6966-0775-44d2-bdc6-c74c26eb2226+21:141963:x1863365426147328:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1777051549.750134:0:27885:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777051549.750155:0:27885:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502da800/0x85f51a6b9671807d lrc: 2/0,0 mode: --/CR res: [0x2000032e2:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6c00 expref: -99 pid: 27885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051549.750299:0:27885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502dbe00/0x85f51a6b96718084 lrc: 3/0,1 mode: --/EX res: [0x2000032e3:0xf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051549.750320:0:27885:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502dae00/0x85f51a6b96718076 lrc: 2/0,0 mode: CR/CR res: [0x2000032e3:0xf:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6bf9 expref: 22 pid: 21368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051549.750340:0:27885:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502dbe00/0x85f51a6b96718084 lrc: 4/0,1 mode: --/EX res: [0x2000032e3:0xf:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051549.750381:0:27885:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502dae00/0x85f51a6b96718076 lrc: 3/0,0 mode: CR/CR res: [0x2000032e3:0xf:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6bf9 expref: 22 pid: 21368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051549.750400:0:27885:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502dae00/0x85f51a6b96718076 lrc: 4/0,0 mode: CR/CR res: [0x2000032e3:0xf:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6bf9 expref: 22 pid: 21368 timeout: 8278 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051549.750418:0:27885:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d9418f5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000_UUID:27885:1863365452740736:192.168.201.46@tcp:104: 00000100:00100000:1.0:1777051549.750510:0:27885:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d958800540 going to sleep for 11 seconds 00000100:00100000:3.0:1777051549.754748:0:27885:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d9418f5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000_UUID:27885:1863365452740736:192.168.201.46@tcp:104: 00010000:00010000:3.0:1777051549.754783:0:27885:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502dbe00/0x85f51a6b96718084 lrc: 3/0,1 mode: --/EX res: [0x2000032e3:0xf:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051549.758346:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051549.758435:0:9550:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426147456 00000100:00100000:3.0:1777051549.758448:0:9550:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426147456 00010000:00010000:3.0:1777051549.758498:0:9550:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502dae00/0x85f51a6b96718076 lrc: 4/0,0 mode: CR/CR res: [0x2000032e3:0xf:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6bf9 expref: 23 pid: 21368 timeout: 8278 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051549.758573:0:9550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3995 00000100:00100000:3.0:1777051549.758590:0:9550:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f867100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+23:2436:x1863365426147456:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1777051549.758611:0:9550:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777051549.758622:0:9550:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502dae00/0x85f51a6b96718076 lrc: 4/0,0 mode: CR/CR res: [0x2000032e3:0xf:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6bf9 expref: 23 pid: 21368 timeout: 8278 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051549.758666:0:9550:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502dae00/0x85f51a6b96718076 lrc: 3/0,0 mode: CR/CR res: [0x2000032e3:0xf:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6bf9 expref: 23 pid: 21368 timeout: 8278 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051549.758698:0:9550:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502dae00/0x85f51a6b96718076 lrc: 0/0,0 mode: --/CR res: [0x2000032e3:0xf:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6bf9 expref: 23 pid: 21368 timeout: 8278 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051549.758719:0:9550:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e3:0xf:0x0].0x0 (ffff99d9413d0400) 00010000:00010000:3.0:1777051549.758726:0:9550:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502dbe00/0x85f51a6b96718084 lrc: 3/0,1 mode: --/EX res: [0x2000032e3:0xf:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051549.758741:0:9550:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502dbe00/0x85f51a6b96718084 lrc: 3/0,1 mode: EX/EX res: [0x2000032e3:0xf:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051549.758754:0:9550:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502dbe00/0x85f51a6b96718084 lrc: 4/0,1 mode: EX/EX res: [0x2000032e3:0xf:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051549.758801:0:9550:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1777051549.759369:0:9550:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f867100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+22:2436:x1863365426147456:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 779us (1028us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051549.759383:0:9550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3995 00010000:00010000:2.0:1777051549.761668:0:27885:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502dbe00/0x85f51a6b96718084 lrc: 3/0,1 mode: EX/EX res: [0x2000032e3:0xf:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051549.761686:0:27885:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502dbe00/0x85f51a6b96718084 lrc: 3/0,1 mode: EX/EX res: [0x2000032e3:0xf:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1777051549.761714:0:27885:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000032e3:0xf:0x0]: returning size 0 00000004:00080000:2.0:1777051549.761911:0:27885:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x203:0x0], index 0: 0 00010000:00010000:2.0:1777051549.762032:0:27885:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502dbe00/0x85f51a6b96718084 lrc: 3/0,1 mode: EX/EX res: [0x2000032e3:0xf:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051549.762406:0:27885:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502dbe00/0x85f51a6b96718084 lrc: 2/0,0 mode: EX/EX res: [0x2000032e3:0xf:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051549.762417:0:27885:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502dbe00/0x85f51a6b96718084 lrc: 3/0,0 mode: EX/EX res: [0x2000032e3:0xf:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051549.762426:0:27885:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d9502dbe00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:2.0:1777051549.762432:0:27885:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502dbe00/0x85f51a6b96718084 lrc: 3/0,0 mode: EX/EX res: [0x2000032e3:0xf:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051549.762445:0:27885:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502dbe00/0x85f51a6b96718084 lrc: 4/0,0 mode: EX/EX res: [0x2000032e3:0xf:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051549.762462:0:27885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e3:0xf:0x0].0x0 (ffff99d9413d0400) 00010000:00010000:2.0:1777051549.762466:0:27885:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1777051549.762472:0:27885:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502dbe00/0x85f51a6b96718084 lrc: 2/0,0 mode: --/EX res: [0x2000032e3:0xf:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051549.762483:0:27885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502dbe00/0x85f51a6b96718084 lrc: 0/0,0 mode: --/EX res: [0x2000032e3:0xf:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051549.762555:0:27885:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502da800/0x85f51a6b9671807d lrc: 1/0,0 mode: --/CR res: [0x2000032e2:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6c00 expref: 22 pid: 27885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051549.762575:0:27885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0xe:0x0].0x0 (ffff99d9413d2100) 00010000:00010000:2.0:1777051549.762579:0:27885:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1777051549.762586:0:27885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502da800/0x85f51a6b9671807d lrc: 0/0,0 mode: --/CR res: [0x2000032e2:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6c00 expref: 22 pid: 27885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051549.762606:0:27885:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d9502da800, rc 0) 00000100:00100000:2.0:1777051549.762677:0:27885:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f865f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c11b6966-0775-44d2-bdc6-c74c26eb2226+21:141963:x1863365426147328:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 Request processed in 12553us (12723us total) trans 34359738432 rc 301/301 00000100:00100000:2.0:1777051549.762692:0:27885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112531 00000100:00100000:2.0:1777051549.771137:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051549.771467:0:6582:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426147712 00000100:00100000:3.0:1777051549.771481:0:6582:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426147712 00000100:00100000:2.0:1777051549.771600:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3451 00000100:00100000:2.0:1777051549.771652:0:6582:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f865500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+21:141963:x1863365426147712:12345-192.168.201.46@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1777051549.772020:0:6582:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f865500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+22:141963:x1863365426147712:12345-192.168.201.46@tcp:35:lhsmtool_posix.0 Request processed in 345us (862us total) trans 34359738433 rc 0/0 00000100:00100000:2.0:1777051549.772035:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3451 00000100:00100000:2.0:1777051549.777044:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051549.777148:0:6579:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426147840 00000100:00100000:0.0:1777051549.777160:0:6579:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426147840 00000100:00100000:0.0:1777051549.777225:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112532 00000100:00100000:0.0:1777051549.777240:0:6579:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f867800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+22:141963:x1863365426147840:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1777051549.777265:0:6579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051549.777291:0:6579:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710600/0x85f51a6b96718092 lrc: 2/0,0 mode: --/CR res: [0x2000032e3:0xf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6c07 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051549.777412:0:6579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950711200/0x85f51a6b96718099 lrc: 3/1,0 mode: --/PR res: [0x2000032e3:0xf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051549.777434:0:6579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d950711200/0x85f51a6b96718099 lrc: 3/1,0 mode: PR/PR res: [0x2000032e3:0xf:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051549.777452:0:6579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d950711200/0x85f51a6b96718099 lrc: 3/1,0 mode: PR/PR res: [0x2000032e3:0xf:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1777051549.777501:0:6579:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000032e3:0xf:0x0]: returning size 0 00000004:00200000:0.0:1777051549.777508:0:6579:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1777051549.777532:0:6579:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99d950711200/0x85f51a6b96718099 lrc: 3/1,0 mode: PR/PR res: [0x2000032e3:0xf:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051549.777569:0:6579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710600/0x85f51a6b96718092 lrc: 0/0,0 mode: --/CR res: [0x2000032e3:0xf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6c07 expref: 24 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051549.777593:0:6579:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950711200/0x85f51a6b96718099 lrc: 3/0,0 mode: PR/PR res: [0x2000032e3:0xf:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6c07 expref: 23 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051549.777609:0:6579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e3:0xf:0x0].0x0 (ffff99d9413d0400) 00010000:00010000:0.0:1777051549.777614:0:6579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1777051549.777619:0:6579:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d950711200, rc 0) 00000100:00100000:0.0:1777051549.777695:0:6579:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f867800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+23:141963:x1863365426147840:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 Request processed in 456us (657us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051549.777708:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112532 00000100:00100000:3.0:1777051549.783864:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051549.783958:0:8628:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426147968 00000100:00100000:0.0:1777051549.783969:0:8628:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426147968 00000100:00100000:0.0:1777051549.784067:0:8628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 8129 00000100:00100000:0.0:1777051549.784102:0:8628:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95aecca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+14:2436:x1863365426147968:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1777051549.784122:0:8628:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051549.784148:0:8628:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f24c345c/0x85f51a6b967180a0 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x203:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6c0e expref: -99 pid: 8628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1777051549.784456:0:8628:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x203:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1777051549.784479:0:8628:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777051549.784484:0:8628:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777051549.784496:0:8628:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f24c345c/0x85f51a6b967180a0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x203:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6c0e expref: 15 pid: 8628 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051549.784521:0:8628:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f24c345c/0x85f51a6b967180a0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x203:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6c0e expref: 15 pid: 8628 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051549.784539:0:8628:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d950711000, rc 0) 00000100:00100000:0.0:1777051549.784612:0:8628:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95aecca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+15:2436:x1863365426147968:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 Request processed in 533us (753us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051549.784624:0:8628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 8129 00000100:00100000:2.0:1777051549.791490:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051549.791538:0:6581:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426148224 00000100:00100000:3.0:1777051549.791550:0:6581:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426148224 00000100:00100000:3.0:1777051549.791639:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112533 00000100:00100000:3.0:1777051549.791656:0:6581:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f864000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+23:141963:x1863365426148224:12345-192.168.201.46@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1777051549.792087:0:6581:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f864000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+23:141963:x1863365426148224:12345-192.168.201.46@tcp:57:lhsmtool_posix.0 Request processed in 434us (603us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051549.792101:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112533 00000100:00100000:2.0:1777051549.795530:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051549.796388:0:8492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426148352 00000100:00100000:3.0:1777051549.796399:0:8492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426148352 00000100:00100000:3.0:1777051549.796482:0:8492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112534 00000100:00100000:3.0:1777051549.796499:0:8492:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f864e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+23:141963:x1863365426148352:12345-192.168.201.46@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1777051549.801779:0:109175:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 34359738433 is committed 00010000:00010000:0.0:1777051549.801863:0:3663:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502da400/0x85f51a6b9671806f lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e3:0xf:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051549.801883:0:3663:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502da400/0x85f51a6b9671806f lrc: 2/0,0 mode: TXN/TXN res: [0x2000032e3:0xf:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051549.801897:0:3663:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502da400/0x85f51a6b9671806f lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e3:0xf:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051549.801910:0:3663:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d9502da400 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:0.0:1777051549.801917:0:3663:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502da400/0x85f51a6b9671806f lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e3:0xf:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051549.801929:0:3663:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502da400/0x85f51a6b9671806f lrc: 4/0,0 mode: TXN/TXN res: [0x2000032e3:0xf:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051549.801950:0:3663:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e3:0xf:0x0].0x0 (ffff99d9413d0400) 00010000:00010000:0.0:1777051549.801956:0:3663:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1777051549.801961:0:3663:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502da400/0x85f51a6b9671806f lrc: 2/0,0 mode: --/TXN res: [0x2000032e3:0xf:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051549.801972:0:3663:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502da400/0x85f51a6b9671806f lrc: 0/0,0 mode: --/TXN res: [0x2000032e3:0xf:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051549.802110:0:8492:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f864e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+14:141963:x1863365426148352:12345-192.168.201.46@tcp:44:lhsmtool_posix.0 Request processed in 5608us (6576us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051549.802127:0:8492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112534 00000100:00100000:3.0:1777051549.812440:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051549.812532:0:8468:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426148480 00000100:00100000:1.0:1777051549.812546:0:8468:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426148480 00000100:00100000:1.0:1777051549.812653:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 8130 00000100:00100000:1.0:1777051549.812671:0:8468:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95aecf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+15:2436:x1863365426148480:12345-192.168.201.46@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1777051549.813145:0:8468:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95aecf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+15:2436:x1863365426148480:12345-192.168.201.46@tcp:16:lhsmtool_posix.0 Request processed in 476us (712us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051549.813159:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 8130 00000100:00100000:2.0:1777051549.819055:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051549.819120:0:46497:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426148736 00000100:00100000:1.0:1777051549.819134:0:46497:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426148736 00000100:00100000:1.0:1777051549.819251:0:46497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112535 00000100:00100000:1.0:1777051549.819268:0:46497:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f867b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:c11b6966-0775-44d2-bdc6-c74c26eb2226+14:141963:x1863365426148736:12345-192.168.201.46@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1777051549.819337:0:46497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1777051549.819379:0:46497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d950711200/0x85f51a6b96718099 lrc: 0/0,0 mode: --/PR res: [0x2000032e3:0xf:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6c07 expref: 14 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051549.819420:0:46497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e3:0xf:0x0].0x0 (ffff99d9413d0400) 00010000:00010000:1.0:1777051549.819429:0:46497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1777051549.819469:0:46497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502db600/0x85f51a6b967180a7 lrc: 3/0,1 mode: --/PW res: [0x2000032e3:0xf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051549.819489:0:46497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502db600/0x85f51a6b967180a7 lrc: 3/0,1 mode: PW/PW res: [0x2000032e3:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051549.819508:0:46497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502db600/0x85f51a6b967180a7 lrc: 3/0,1 mode: PW/PW res: [0x2000032e3:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1777051549.819679:0:46497:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000004b05c0b3 reply state 000000008524e5e1 transno 34359738434 ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502db600/0x85f51a6b967180a7 lrc: 3/0,1 mode: PW/PW res: [0x2000032e3:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051549.820015:0:46497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502db600/0x85f51a6b967180a7 lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e3:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051549.820033:0:46497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e3:0xf:0x0].0x0 (ffff99d9413d0400) 00010000:00010000:1.0:1777051549.820037:0:46497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1777051549.820043:0:46497:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1777051549.820178:0:46497:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f867b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:c11b6966-0775-44d2-bdc6-c74c26eb2226+15:141963:x1863365426148736:12345-192.168.201.46@tcp:36:lhsmtool_posix.0 Request processed in 912us (1127us total) trans 34359738434 rc 0/0 00000100:00100000:1.0:1777051549.820474:0:46497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112535 00000100:00100000:3.0:1777051549.826546:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051549.826649:0:10328:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426148864 00000100:00100000:0.0:1777051549.826662:0:10328:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426148864 00000100:00100000:0.0:1777051549.826734:0:10328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112536 00000100:00100000:0.0:1777051549.826746:0:10328:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95aecce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+15:141963:x1863365426148864:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1777051549.826771:0:10328:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051549.826796:0:10328:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710600/0x85f51a6b967180ae lrc: 2/0,0 mode: --/CR res: [0x2000032e3:0xf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6c15 expref: -99 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051549.826862:0:10328:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710600/0x85f51a6b967180ae lrc: 3/0,0 mode: CR/CR res: [0x2000032e3:0xf:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6c15 expref: 16 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051549.826885:0:10328:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710600/0x85f51a6b967180ae lrc: 3/0,0 mode: CR/CR res: [0x2000032e3:0xf:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6c15 expref: 16 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051549.826913:0:10328:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e3:0xf:0x0].0x0 (ffff99d9413d0400) 00010000:00010000:0.0:1777051549.826917:0:10328:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1777051549.826921:0:10328:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d950710600, rc 0) 00000100:00100000:0.0:1777051549.827015:0:10328:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95aecce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+16:141963:x1863365426148864:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 Request processed in 242us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051549.827031:0:10328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112536 00000100:00100000:1.0:1777051549.833196:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051549.833371:0:8471:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426148992 00000100:00100000:2.0:1777051549.833385:0:8471:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426148992 00000100:00100000:2.0:1777051549.833478:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 8131 00000100:00100000:2.0:1777051549.833494:0:8471:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d9418f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+15:2437:x1863365426148992:12345-192.168.201.46@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1777051549.835115:0:8471:0:(ofd_lvb.c:305:ofd_lvbo_update()) res: [0x280000401:0x203:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1777051549.835122:0:8471:0:(ofd_lvb.c:312:ofd_lvbo_update()) res: [0x280000401:0x203:0x0] updating lvb mtime from disk: 0 -> 1777051530 00002000:00010000:2.0:1777051549.835126:0:8471:0:(ofd_lvb.c:318:ofd_lvbo_update()) res: [0x280000401:0x203:0x0] updating lvb atime from disk: 0 -> 1777051530 00002000:00010000:2.0:1777051549.835130:0:8471:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x280000401:0x203:0x0] updating lvb ctime from disk: 0 -> 1777051530 00002000:00010000:2.0:1777051549.835142:0:8471:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000401:0x203:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1777051549.835225:0:8471:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d9418f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+16:2437:x1863365426148992:12345-192.168.201.46@tcp:2:lhsmtool_posix.0 Request processed in 1730us (2032us total) trans 4294968380 rc 0/0 00000100:00100000:2.0:1777051549.835281:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 8131 00000100:00100000:1.0:1777051549.840906:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051549.841026:0:27887:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426149120 00000100:00100000:0.0:1777051549.841038:0:27887:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426149120 00000100:00100000:0.0:1777051549.841116:0:27887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 8132 00000100:00100000:0.0:1777051549.841132:0:27887:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d9418f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c11b6966-0775-44d2-bdc6-c74c26eb2226+16:2436:x1863365426149120:12345-192.168.201.46@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1777051549.841231:0:27887:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e7b9d13a/0x85f51a6b967180b5 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x203:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 27887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051549.841254:0:27887:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777051549.841258:0:27887:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777051549.841267:0:27887:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e7b9d13a/0x85f51a6b967180b5 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x203:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 27887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051549.841291:0:27887:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e7b9d13a/0x85f51a6b967180b5 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x203:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 27887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051549.841324:0:27887:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e7b9d13a/0x85f51a6b967180b5 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x203:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 27887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051549.841340:0:27887:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e7b9d13a/0x85f51a6b967180b5 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x203:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 27887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051549.841354:0:27887:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e7b9d13a/0x85f51a6b967180b5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x203:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 27887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051549.841365:0:27887:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d950710800 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:0.0:1777051549.841372:0:27887:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e7b9d13a/0x85f51a6b967180b5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x203:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 27887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051549.841385:0:27887:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e7b9d13a/0x85f51a6b967180b5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x203:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 27887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051549.841407:0:27887:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e7b9d13a/0x85f51a6b967180b5 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x203:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 27887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051549.841421:0:27887:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e7b9d13a/0x85f51a6b967180b5 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x203:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 27887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051549.841517:0:27887:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d9418f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c11b6966-0775-44d2-bdc6-c74c26eb2226+16:2436:x1863365426149120:12345-192.168.201.46@tcp:1:lhsmtool_posix.0 Request processed in 387us (615us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051549.841536:0:27887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 8132 00010000:00010000:1.0:1777051549.846642:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777051549.847606:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051549.848082:0:46494:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426149376 00000100:00100000:1.0:1777051549.848093:0:46494:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426149376 00000100:00100000:1.0:1777051549.848157:0:46494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112537 00000100:00100000:1.0:1777051549.848175:0:46494:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95aecf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c11b6966-0775-44d2-bdc6-c74c26eb2226+16:141963:x1863365426149376:12345-192.168.201.46@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1777051549.848568:0:46494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502da800/0x85f51a6b967180bc lrc: 3/0,1 mode: --/PW res: [0x2000032e3:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051549.848592:0:46494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502da800/0x85f51a6b967180bc lrc: 3/0,1 mode: PW/PW res: [0x2000032e3:0xe:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051549.848608:0:46494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502da800/0x85f51a6b967180bc lrc: 3/0,1 mode: PW/PW res: [0x2000032e3:0xe:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051549.848785:0:46494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502dbe00/0x85f51a6b967180c3 lrc: 3/0,1 mode: --/EX res: [0x2000032e3:0xf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051549.848805:0:46494:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710600/0x85f51a6b967180ae lrc: 2/0,0 mode: CR/CR res: [0x2000032e3:0xf:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6c15 expref: 17 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051549.848820:0:46494:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502dbe00/0x85f51a6b967180c3 lrc: 4/0,1 mode: --/EX res: [0x2000032e3:0xf:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051549.848865:0:46494:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710600/0x85f51a6b967180ae lrc: 3/0,0 mode: CR/CR res: [0x2000032e3:0xf:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6c15 expref: 17 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051549.848887:0:46494:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710600/0x85f51a6b967180ae lrc: 4/0,0 mode: CR/CR res: [0x2000032e3:0xf:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6c15 expref: 17 pid: 10328 timeout: 8279 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051549.848908:0:46494:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7fdf2300 pname:cluuid:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000_UUID:46494:1863365452740864:192.168.201.46@tcp:104: 00000100:00100000:1.0:1777051549.849026:0:46494:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d958800540 going to sleep for 11 seconds 00000100:00100000:1.0:1777051549.853510:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051549.854140:0:6566:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426149504 00000100:00100000:3.0:1777051549.854152:0:6566:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426149504 00000100:00100000:1.0:1777051549.854197:0:46494:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7fdf2300 pname:cluuid:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000_UUID:46494:1863365452740864:192.168.201.46@tcp:104: 00010000:00010000:3.0:1777051549.854200:0:6566:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710600/0x85f51a6b967180ae lrc: 4/0,0 mode: CR/CR res: [0x2000032e3:0xf:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6c15 expref: 18 pid: 10328 timeout: 8279 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051549.854238:0:46494:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502dbe00/0x85f51a6b967180c3 lrc: 3/0,1 mode: --/EX res: [0x2000032e3:0xf:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051549.854267:0:6566:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3996 00000100:00100000:3.0:1777051549.854285:0:6566:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fdf0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+18:2436:x1863365426149504:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1777051549.854306:0:6566:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777051549.854317:0:6566:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710600/0x85f51a6b967180ae lrc: 4/0,0 mode: CR/CR res: [0x2000032e3:0xf:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6c15 expref: 18 pid: 10328 timeout: 8279 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051549.854348:0:6566:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710600/0x85f51a6b967180ae lrc: 3/0,0 mode: CR/CR res: [0x2000032e3:0xf:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6c15 expref: 18 pid: 10328 timeout: 8279 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051549.854408:0:6566:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710600/0x85f51a6b967180ae lrc: 0/0,0 mode: --/CR res: [0x2000032e3:0xf:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6c15 expref: 18 pid: 10328 timeout: 8279 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051549.854433:0:6566:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e3:0xf:0x0].0x0 (ffff99d9413d0400) 00010000:00010000:3.0:1777051549.854442:0:6566:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502dbe00/0x85f51a6b967180c3 lrc: 3/0,1 mode: --/EX res: [0x2000032e3:0xf:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051549.854495:0:6566:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502dbe00/0x85f51a6b967180c3 lrc: 3/0,1 mode: EX/EX res: [0x2000032e3:0xf:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051549.854508:0:6566:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502dbe00/0x85f51a6b967180c3 lrc: 4/0,1 mode: EX/EX res: [0x2000032e3:0xf:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051549.854557:0:6566:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1777051549.854636:0:6566:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fdf0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+17:2436:x1863365426149504:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 353us (1133us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051549.854650:0:6566:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3996 00010000:00010000:1.0:1777051549.855064:0:46494:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502dbe00/0x85f51a6b967180c3 lrc: 3/0,1 mode: EX/EX res: [0x2000032e3:0xf:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051549.855079:0:46494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502dbe00/0x85f51a6b967180c3 lrc: 3/0,1 mode: EX/EX res: [0x2000032e3:0xf:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1777051549.855227:0:46494:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 34359738435 00000001:00080000:1.0:1777051549.855384:0:46494:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 34359738436 00000001:00080000:1.0:1777051549.855437:0:46494:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 34359738437 00000100:00100000:1.0:1777051549.855534:0:46494:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7fdf2300 pname:cluuid:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000-mdtlov_UUID:46494:1863365452740992:0@lo:1000:mdt00_008.0 00000100:00100000:1.0:1777051549.855660:0:46494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051549.855705:0:46494:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d958800600 going to sleep for 11 seconds 00000100:00100000:3.0:1777051549.855758:0:6585:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452740992 00000100:00100000:3.0:1777051549.855769:0:6585:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452740992 00000100:00100000:3.0:1777051549.855883:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8384 00000100:00100000:3.0:1777051549.855901:0:6585:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fdf2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:46494:x1863365452740992:12345-0@lo:1000:mdt00_008.0 00000100:00100000:3.0:1777051549.856090:0:6585:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fdf2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:46494:x1863365452740992:12345-0@lo:1000:mdt00_008.0 Request processed in 194us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051549.856107:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8384 00000100:00080000:0.0:1777051549.856235:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1777051549.858138:0:46494:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7fdf2300 pname:cluuid:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000-mdtlov_UUID:46494:1863365452740992:0@lo:1000:mdt00_008.0 00000001:00080000:1.0:1777051549.858581:0:46494:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 34359738438 00000100:00100000:1.0:1777051549.858659:0:46494:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7fdf2300 pname:cluuid:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000-mdtlov_UUID:46494:1863365452741120:0@lo:1000:mdt00_008.0 00000100:00100000:1.0:1777051549.858711:0:46494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051549.858749:0:46494:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d958800c00 going to sleep for 11 seconds 00000100:00100000:0.0:1777051549.858793:0:6584:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452741120 00000100:00100000:0.0:1777051549.858803:0:6584:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452741120 00000100:00100000:0.0:1777051549.859689:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8385 00000100:00100000:0.0:1777051549.859704:0:6584:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fdf1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:46494:x1863365452741120:12345-0@lo:1000:mdt00_008.0 00000100:00100000:0.0:1777051549.859967:0:6584:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fdf1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:46494:x1863365452741120:12345-0@lo:1000:mdt00_008.0 Request processed in 265us (1254us total) trans 4294968381 rc 0/0 00000100:00100000:0.0:1777051549.859982:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8385 00000100:00100000:1.0:1777051549.860070:0:46494:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7fdf2300 pname:cluuid:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000-mdtlov_UUID:46494:1863365452741120:0@lo:1000:mdt00_008.0 00000001:00080000:1.0:1777051549.860487:0:46494:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 34359738439 00010000:00010000:1.0:1777051549.860541:0:46494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502dbe00/0x85f51a6b967180c3 lrc: 3/0,1 mode: EX/EX res: [0x2000032e3:0xf:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051549.860559:0:46494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502dbe00/0x85f51a6b967180c3 lrc: 2/0,0 mode: EX/EX res: [0x2000032e3:0xf:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051549.860572:0:46494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502dbe00/0x85f51a6b967180c3 lrc: 3/0,0 mode: EX/EX res: [0x2000032e3:0xf:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051549.860583:0:46494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d9502dbe00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:1.0:1777051549.860591:0:46494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502dbe00/0x85f51a6b967180c3 lrc: 3/0,0 mode: EX/EX res: [0x2000032e3:0xf:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051549.860605:0:46494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502dbe00/0x85f51a6b967180c3 lrc: 4/0,0 mode: EX/EX res: [0x2000032e3:0xf:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051549.861124:0:46494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e3:0xf:0x0].0x0 (ffff99d9413d0400) 00010000:00010000:1.0:1777051549.861132:0:46494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1777051549.861140:0:46494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502dbe00/0x85f51a6b967180c3 lrc: 2/0,0 mode: --/EX res: [0x2000032e3:0xf:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051549.861151:0:46494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502dbe00/0x85f51a6b967180c3 lrc: 0/0,0 mode: --/EX res: [0x2000032e3:0xf:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051549.861197:0:46494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cea00/0x85f51a6b96717fea lrc: 3/0,1 mode: EX/EX res: [0x2000032e3:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 110924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051549.861208:0:46494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cea00/0x85f51a6b96717fea lrc: 2/0,0 mode: EX/EX res: [0x2000032e3:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 110924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051549.861217:0:46494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cea00/0x85f51a6b96717fea lrc: 3/0,0 mode: EX/EX res: [0x2000032e3:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 110924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051549.861227:0:46494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da7d5cea00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:1.0:1777051549.861233:0:46494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cea00/0x85f51a6b96717fea lrc: 3/0,0 mode: EX/EX res: [0x2000032e3:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 110924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051549.861244:0:46494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cea00/0x85f51a6b96717fea lrc: 4/0,0 mode: EX/EX res: [0x2000032e3:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 110924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051549.861266:0:46494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e3:0xe:0x0].0x0 (ffff99da59dd4700) 00010000:00010000:1.0:1777051549.861270:0:46494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1777051549.861275:0:46494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cea00/0x85f51a6b96717fea lrc: 2/0,0 mode: --/EX res: [0x2000032e3:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 110924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051549.861285:0:46494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cea00/0x85f51a6b96717fea lrc: 0/0,0 mode: --/EX res: [0x2000032e3:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 110924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051549.861318:0:46494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502dae00/0x85f51a6b967180ca lrc: 3/0,1 mode: --/EX res: [0x2000032e3:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051549.861336:0:46494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502dae00/0x85f51a6b967180ca lrc: 3/0,1 mode: EX/EX res: [0x2000032e3:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051549.861349:0:46494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502dae00/0x85f51a6b967180ca lrc: 3/0,1 mode: EX/EX res: [0x2000032e3:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051549.861360:0:46494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502dae00/0x85f51a6b967180ca lrc: 3/0,1 mode: EX/EX res: [0x2000032e3:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051549.861370:0:46494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502dae00/0x85f51a6b967180ca lrc: 2/0,0 mode: EX/EX res: [0x2000032e3:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051549.861380:0:46494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502dae00/0x85f51a6b967180ca lrc: 3/0,0 mode: EX/EX res: [0x2000032e3:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051549.861389:0:46494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d9502dae00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:1.0:1777051549.861394:0:46494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502dae00/0x85f51a6b967180ca lrc: 3/0,0 mode: EX/EX res: [0x2000032e3:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051549.861405:0:46494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502dae00/0x85f51a6b967180ca lrc: 4/0,0 mode: EX/EX res: [0x2000032e3:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051549.861421:0:46494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e3:0xe:0x0].0x0 (ffff99da59dd4700) 00010000:00010000:1.0:1777051549.861425:0:46494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777051549.861430:0:46494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502dae00/0x85f51a6b967180ca lrc: 2/0,0 mode: --/EX res: [0x2000032e3:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051549.861440:0:46494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502dae00/0x85f51a6b967180ca lrc: 0/0,0 mode: --/EX res: [0x2000032e3:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051549.861456:0:46494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502da800/0x85f51a6b967180bc lrc: 3/0,1 mode: PW/PW res: [0x2000032e3:0xe:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051549.861467:0:46494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502da800/0x85f51a6b967180bc lrc: 2/0,0 mode: PW/PW res: [0x2000032e3:0xe:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051549.861478:0:46494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502da800/0x85f51a6b967180bc lrc: 3/0,0 mode: PW/PW res: [0x2000032e3:0xe:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051549.861488:0:46494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d9502da800 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:1.0:1777051549.861494:0:46494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502da800/0x85f51a6b967180bc lrc: 3/0,0 mode: PW/PW res: [0x2000032e3:0xe:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051549.861507:0:46494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502da800/0x85f51a6b967180bc lrc: 4/0,0 mode: PW/PW res: [0x2000032e3:0xe:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051549.861524:0:46494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e3:0xe:0x0].0x0 (ffff99da59dd4700) 00010000:00010000:1.0:1777051549.861530:0:46494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1777051549.861535:0:46494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502da800/0x85f51a6b967180bc lrc: 2/0,0 mode: --/PW res: [0x2000032e3:0xe:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051549.861545:0:46494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502da800/0x85f51a6b967180bc lrc: 0/0,0 mode: --/PW res: [0x2000032e3:0xe:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 46494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051549.861790:0:46494:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95aecf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c11b6966-0775-44d2-bdc6-c74c26eb2226+21:141963:x1863365426149376:12345-192.168.201.46@tcp:57:lhsmtool_posix.0 Request processed in 13616us (14187us total) trans 34359738440 rc 0/0 00000100:00100000:1.0:1777051549.861807:0:46494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112537 00000020:00080000:1.0:1777051549.861815:0:46494:0:(tgt_main.c:783:tgt_ses_key_exit()) total 6 transactions per RPC 00000040:00080000:0.0:1777051549.861852:0:110924:0:(llog.c:801:llog_process_thread()) index: 6, lh_last_idx: 7 synced_idx: 0 lgh_last_idx: 7 00000040:00080000:0.0:1777051549.861861:0:110924:0:(llog_cat.c:158:llog_cat_process_common()) processing log [0x1:0x2b:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1777051549.861899:0:110924:0:(llog.c:858:llog_process_thread()) stop processing plain [0x1:0x2b:0x0] index 12 count 2 00000040:00080000:0.0:1777051549.861916:0:110924:0:(llog.c:801:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:0.0:1777051549.861921:0:110924:0:(llog_cat.c:158:llog_cat_process_common()) processing log [0x1:0x31:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1777051549.861941:0:110924:0:(llog.c:858:llog_process_thread()) stop processing plain [0x1:0x31:0x0] index 4 count 4 00000040:00080000:0.0:1777051549.861948:0:110924:0:(llog.c:858:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 3 00000100:00100000:2.0:1777051549.871047:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051549.871131:0:24269:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426149760 00000100:00100000:2.0:1777051549.871141:0:24269:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426149760 00000100:00100000:2.0:1777051549.871255:0:24269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3452 00000100:00100000:2.0:1777051549.871271:0:24269:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da708dd450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+21:141963:x1863365426149760:12345-192.168.201.46@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1777051549.871519:0:24269:0:(mdd_object.c:4010:mdd_close()) Object [0x2000032e3:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00010000:00010000:2.0:1777051549.871661:0:24269:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69b800/0x85f51a6b967180d1 lrc: 3/0,1 mode: --/PW res: [0x2000032e3:0xf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051549.871697:0:24269:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69b800/0x85f51a6b967180d1 lrc: 3/0,1 mode: PW/PW res: [0x2000032e3:0xf:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 24269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051549.871717:0:24269:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69b800/0x85f51a6b967180d1 lrc: 3/0,1 mode: PW/PW res: [0x2000032e3:0xf:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 24269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051549.871742:0:24269:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69b800/0x85f51a6b967180d1 lrc: 4/0,1 mode: PW/PW res: [0x2000032e3:0xf:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 24269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051549.871755:0:24269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69b800/0x85f51a6b967180d1 lrc: 4/0,1 mode: PW/PW res: [0x2000032e3:0xf:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 24269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051549.871767:0:24269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69b800/0x85f51a6b967180d1 lrc: 3/0,0 mode: PW/PW res: [0x2000032e3:0xf:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 24269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051549.871804:0:24269:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1777051549.872259:0:24269:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da708dd450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+22:141963:x1863365426149760:12345-192.168.201.46@tcp:35:lhsmtool_posix.0 Request processed in 989us (1217us total) trans 34359738441 rc 0/0 00000100:00100000:2.0:1777051549.872274:0:24269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3452 00010000:00010000:1.0:1777051549.872622:0:6567:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777051549.872632:0:6567:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69b800/0x85f51a6b967180d1 lrc: 2/0,0 mode: PW/PW res: [0x2000032e3:0xf:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 24269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051549.872642:0:6567:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94f69b800 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:1.0:1777051549.872647:0:6567:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69b800/0x85f51a6b967180d1 lrc: 2/0,0 mode: PW/PW res: [0x2000032e3:0xf:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 24269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051549.872656:0:6567:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69b800/0x85f51a6b967180d1 lrc: 3/0,0 mode: PW/PW res: [0x2000032e3:0xf:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 24269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051549.872672:0:6567:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e3:0xf:0x0].0x0 (ffff99d9413d0400) 00010000:00010000:1.0:1777051549.872678:0:6567:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1777051549.872684:0:6567:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69b800/0x85f51a6b967180d1 lrc: 1/0,0 mode: --/PW res: [0x2000032e3:0xf:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 24269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051549.872695:0:6567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69b800/0x85f51a6b967180d1 lrc: 0/0,0 mode: --/PW res: [0x2000032e3:0xf:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 24269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051549.872716:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051549.872720:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051549.872724:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1777051550.488267:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f9ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3680:1863365452741248:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1777051550.488426:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051550.488438:0:3678:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1777051550.488467:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95aece300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452741376:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1777051550.488550:0:8472:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452741248 00000100:00100000:1.0:1777051550.488563:0:8472:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452741248 00000100:00080000:0.0:1777051550.488648:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1777051550.488687:0:8472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5752 00000100:00100000:1.0:1777051550.488706:0:8472:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f865500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3680:x1863365452741248:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1777051550.489397:0:8472:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 515963584 pending 0 free 3860574208 avail 3629051904 00000100:00100000:3.0:1777051550.490484:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051550.490585:0:10113:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452741376 00000100:00100000:2.0:1777051550.490596:0:10113:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452741376 00000100:00100000:2.0:1777051550.490694:0:10113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5753 00000100:00100000:1.0:1777051550.490708:0:8472:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f865500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3680:x1863365452741248:12345-0@lo:13:osp-pre-0-1.0 Request processed in 2001us (2279us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051550.490717:0:10113:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95aecd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3678:x1863365452741376:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1777051550.490736:0:8472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5752 00002000:00000024:2.0:1777051550.490760:0:10113:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 489208512 pending 0 free 3642707968 avail 3411185664 00000100:00080000:3.0:1777051550.491518:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1777051550.491536:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f9ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3680:1863365452741248:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1777051550.491557:0:10113:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95aecd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3678:x1863365452741376:12345-0@lo:13:osp-pre-1-1.0 Request processed in 844us (1069us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051550.491573:0:10113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5753 00000100:00100000:1.0:1777051550.491702:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95aece300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452741376:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1777051550.870718:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1777051551.612147:0:111170:0:(llog.c:801:llog_process_thread()) index: 6, lh_last_idx: 7 synced_idx: 0 lgh_last_idx: 7 00000040:00080000:2.0:1777051551.612159:0:111170:0:(llog_cat.c:158:llog_cat_process_common()) processing log [0x1:0x2b:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1777051551.612200:0:111170:0:(llog.c:858:llog_process_thread()) stop processing plain [0x1:0x2b:0x0] index 12 count 2 00000040:00080000:2.0:1777051551.612220:0:111170:0:(llog.c:801:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:2.0:1777051551.612226:0:111170:0:(llog_cat.c:158:llog_cat_process_common()) processing log [0x1:0x31:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1777051551.612266:0:111170:0:(llog.c:858:llog_process_thread()) stop processing plain [0x1:0x31:0x0] index 4 count 4 00000040:00080000:2.0:1777051551.612316:0:111170:0:(llog.c:858:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 3 00000100:00100000:2.0:1777051551.671042:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051551.672019:0:6580:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426150016 00000100:00100000:0.0:1777051551.672036:0:6580:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426150016 00000100:00080000:3.0:1777051551.672155:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1777051551.672171:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112538 00000100:00100000:0.0:1777051551.672194:0:6580:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f867480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+11:141972:x1863365426150016:12345-192.168.201.46@tcp:101:cat.0 00010000:00010000:0.0:1777051551.672281:0:6580:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051551.672318:0:6580:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710800/0x85f51a6b967180d8 lrc: 2/0,0 mode: --/CR res: [0x2000032e2:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6c1c expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051551.672443:0:6580:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710000/0x85f51a6b967180df lrc: 3/1,0 mode: --/CR res: [0x2000032e2:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051551.672471:0:6580:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710000/0x85f51a6b967180df lrc: 3/1,0 mode: CR/CR res: [0x2000032e2:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051551.672494:0:6580:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710000/0x85f51a6b967180df lrc: 3/1,0 mode: CR/CR res: [0x2000032e2:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051551.672522:0:6580:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950711c00/0x85f51a6b967180e6 lrc: 3/1,0 mode: --/PR res: [0x2000032e2:0xe:0x0].0x63a4dde3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051551.672538:0:6580:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d950711c00/0x85f51a6b967180e6 lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0xe:0x0].0x63a4dde3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051551.672555:0:6580:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d950711c00/0x85f51a6b967180e6 lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0xe:0x0].0x63a4dde3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051551.672721:0:6580:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710600/0x85f51a6b967180ed lrc: 3/1,0 mode: --/PR res: [0x2000032e3:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051551.672742:0:6580:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710600/0x85f51a6b967180ed lrc: 3/1,0 mode: PR/PR res: [0x2000032e3:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051551.672759:0:6580:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710600/0x85f51a6b967180ed lrc: 3/1,0 mode: PR/PR res: [0x2000032e3:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1777051551.672778:0:6580:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000032e3:0xe:0x0]: returning size 0 00010000:00010000:0.0:1777051551.672894:0:6580:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710000/0x85f51a6b967180df lrc: 4/1,0 mode: CR/CR res: [0x2000032e2:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051551.672911:0:6580:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710000/0x85f51a6b967180df lrc: 4/1,0 mode: CR/CR res: [0x2000032e2:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051551.672926:0:6580:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710000/0x85f51a6b967180df lrc: 3/0,0 mode: CR/CR res: [0x2000032e2:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051551.672942:0:6580:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710000/0x85f51a6b967180df lrc: 4/0,0 mode: CR/CR res: [0x2000032e2:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051551.672955:0:6580:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d950710000 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:0.0:1777051551.673004:0:6580:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710000/0x85f51a6b967180df lrc: 4/0,0 mode: CR/CR res: [0x2000032e2:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051551.673021:0:6580:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710000/0x85f51a6b967180df lrc: 5/0,0 mode: CR/CR res: [0x2000032e2:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051551.673043:0:6580:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0xe:0x0].0x0 (ffff99d9413d2100) 00010000:00010000:0.0:1777051551.673050:0:6580:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777051551.673060:0:6580:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710000/0x85f51a6b967180df lrc: 3/0,0 mode: --/CR res: [0x2000032e2:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051551.673075:0:6580:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710000/0x85f51a6b967180df lrc: 0/0,0 mode: --/CR res: [0x2000032e2:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051551.673100:0:6580:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950711c00/0x85f51a6b967180e6 lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0xe:0x0].0x63a4dde3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051551.673114:0:6580:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d950711c00/0x85f51a6b967180e6 lrc: 2/0,0 mode: PR/PR res: [0x2000032e2:0xe:0x0].0x63a4dde3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051551.673128:0:6580:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d950711c00/0x85f51a6b967180e6 lrc: 3/0,0 mode: PR/PR res: [0x2000032e2:0xe:0x0].0x63a4dde3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051551.673141:0:6580:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d950711c00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:0.0:1777051551.673148:0:6580:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d950711c00/0x85f51a6b967180e6 lrc: 3/0,0 mode: PR/PR res: [0x2000032e2:0xe:0x0].0x63a4dde3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051551.673162:0:6580:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d950711c00/0x85f51a6b967180e6 lrc: 4/0,0 mode: PR/PR res: [0x2000032e2:0xe:0x0].0x63a4dde3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051551.673176:0:6580:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0xe:0x0].0x63a4dde3 (ffff99da44f97f00) 00010000:00010000:0.0:1777051551.673182:0:6580:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777051551.673188:0:6580:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d950711c00/0x85f51a6b967180e6 lrc: 2/0,0 mode: --/PR res: [0x2000032e2:0xe:0x0].0x63a4dde3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051551.673235:0:6580:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d950711c00/0x85f51a6b967180e6 lrc: 0/0,0 mode: --/PR res: [0x2000032e2:0xe:0x0].0x63a4dde3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051551.673317:0:6580:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710800/0x85f51a6b967180d8 lrc: 0/0,0 mode: --/CR res: [0x2000032e2:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6c1c expref: 14 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051551.673348:0:6580:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710600/0x85f51a6b967180ed lrc: 3/0,0 mode: PR/PR res: [0x2000032e3:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6c1c expref: 13 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051551.673365:0:6580:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e3:0xe:0x0].0x0 (ffff99da44f97800) 00010000:00010000:0.0:1777051551.673371:0:6580:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1777051551.673376:0:6580:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d950710600, rc 0) 00000100:00100000:0.0:1777051551.673468:0:6580:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f867480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+13:141972:x1863365426150016:12345-192.168.201.46@tcp:101:cat.0 Request processed in 1278us (2438us total) trans 34359738442 rc 0/0 00000100:00100000:0.0:1777051551.673486:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112538 00000100:00100000:1.0:1777051551.684084:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051551.684249:0:55805:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426150144 00000100:00100000:3.0:1777051551.684266:0:55805:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426150144 00000100:00080000:0.0:1777051551.684343:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1777051551.684416:0:55805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 8133 00000100:00100000:3.0:1777051551.684448:0:55805:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fdf1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+16:2439:x1863365426150144:12345-192.168.201.46@tcp:101:cat.0 00010000:00010000:3.0:1777051551.684492:0:55805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777051551.684522:0:55805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005a90df20/0x85f51a6b967180fb lrc: 2/0,0 mode: --/PR res: [0x280000401:0x203:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6c23 expref: -99 pid: 55805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051551.684563:0:55805:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051551.684568:0:55805:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051551.684583:0:55805:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005a90df20/0x85f51a6b967180fb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x203:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6c23 expref: 17 pid: 55805 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051551.684616:0:55805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005a90df20/0x85f51a6b967180fb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x203:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6c23 expref: 17 pid: 55805 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051551.684668:0:55805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99da7d5cec00, rc 0) 00000100:00100000:3.0:1777051551.684756:0:55805:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fdf1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+17:2439:x1863365426150144:12345-192.168.201.46@tcp:101:cat.0 Request processed in 323us (681us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051551.684770:0:55805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 8133 00000100:00100000:1.0:1777051551.701749:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051551.702028:0:20161:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426150272 00000100:00100000:2.0:1777051551.702044:0:20161:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426150272 00002000:00100000:2.0:1777051551.702129:0:20161:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x203:0x0] (0->4095) req@ffff99da7fdf2680 x1863365426150272/t0(0) o3->2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp:512/0 lens 488/0 e 0 to 0 dl 1777051562 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1777051551.702157:0:20161:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99da7fdf2680 with x1863365426150272 ext(0->4095) 00002000:00010000:2.0:1777051551.702168:0:20161:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99da7fdf2680 00000100:00100000:2.0:1777051551.702254:0:20161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 1799 00000100:00100000:2.0:1777051551.702285:0:20161:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fdf2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+17:2438:x1863365426150272:12345-192.168.201.46@tcp:3:cat.0 00000100:00100000:2.0:1777051551.703168:0:20161:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fdf2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+17:2438:x1863365426150272:12345-192.168.201.46@tcp:3:cat.0 Request processed in 888us (1424us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051551.703194:0:20161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 1799 00002000:00100000:2.0:1777051551.703211:0:20161:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x203:0x0] (0->4095) req@ffff99da7fdf2680 x1863365426150272/t0(0) o3->2dd4696c-edce-4cd1-86d2-dbd2ff957fa1@192.168.201.46@tcp:512/0 lens 488/440 e 0 to 0 dl 1777051562 ref 1 fl Complete:/600/0 rc 0/0 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1777051551.703236:0:20161:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff99da7fdf2680 with x1863365426150272 ext(0->4095) 00002000:00010000:2.0:1777051551.703245:0:20161:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99da7fdf2680 00000100:00100000:0.0:1777051551.711704:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051551.711921:0:6583:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426150528 00000100:00100000:3.0:1777051551.711936:0:6583:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426150528 00000100:00100000:3.0:1777051551.712181:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3453 00000100:00100000:3.0:1777051551.712207:0:6583:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+13:141972:x1863365426150528:12345-192.168.201.46@tcp:35:cat.0 00000100:00100000:3.0:1777051551.712664:0:6583:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+14:141972:x1863365426150528:12345-192.168.201.46@tcp:35:cat.0 Request processed in 457us (966us total) trans 34359738443 rc 0/0 00000100:00100000:3.0:1777051551.712681:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3453 00010000:00010000:3.0:1777051551.898133:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777051552.919651:0:108751:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1777051553.046507:0:3677:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1777051553.046542:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95f866a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3677:1863365452741504:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1777051553.046730:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051553.047231:0:11727:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452741504 00000100:00100000:0.0:1777051553.047245:0:11727:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452741504 00000100:00100000:0.0:1777051553.047341:0:11727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8386 00000100:00100000:2.0:1777051553.047358:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95f866d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452741632:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1777051553.047364:0:11727:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f864380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3677:x1863365452741504:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1777051553.047417:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00000024:0.0:1777051553.047421:0:11727:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4194304 pending 0 free 1446141952 avail 1299902464 00000100:00100000:2.0:1777051553.047494:0:6585:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452741632 00000100:00100000:2.0:1777051553.047503:0:6585:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452741632 00000100:00100000:0.0:1777051553.047523:0:11727:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f864380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3677:x1863365452741504:12345-0@lo:41:osp-pre-1-0.0 Request processed in 163us (791us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051553.047538:0:11727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8386 00000100:00100000:2.0:1777051553.047557:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8387 00000100:00100000:2.0:1777051553.047573:0:6585:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f865180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3679:x1863365452741632:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1777051553.047606:0:6585:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4194304 pending 0 free 1441529856 avail 1295290368 00000100:00100000:2.0:1777051553.047701:0:6585:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f865180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3679:x1863365452741632:12345-0@lo:41:osp-pre-0-1.0 Request processed in 131us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051553.047714:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8387 00000100:00100000:2.0:1777051553.047758:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da4384d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3677:1863365452741888:0@lo:400:kworker.0 00000100:00100000:2.0:1777051553.047802:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051553.047862:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95f866a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3677:1863365452741504:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1777051553.047923:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95f866d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452741632:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1777051553.047980:0:3679:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1777051553.047992:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f9fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3679:1863365452741760:0@lo:400:kworker.0 00000100:00100000:2.0:1777051553.048066:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051553.048159:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955610000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3678:1863365452742016:0@lo:400:kworker.0 00000100:00100000:2.0:1777051553.048163:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955613800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3679:1863365452742144:0@lo:400:kworker.0 00000100:00100000:0.0:1777051553.048233:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051553.048272:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955613480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3680:1863365452742272:0@lo:400:kworker.0 00000100:00100000:0.0:1777051553.048314:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95f97fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452742528:0@lo:400:kworker.0 00000100:00100000:2.0:1777051553.048335:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051553.048377:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051553.048386:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95f97d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3680:1863365452742784:0@lo:400:kworker.0 00000100:00100000:0.0:1777051553.048428:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94ed2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3678:1863365452743040:0@lo:400:kworker.0 00000100:00100000:2.0:1777051553.048443:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051553.048511:0:21368:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452741888 00000100:00100000:0.0:1777051553.048519:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051553.048520:0:21368:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452741888 00000100:00100000:0.0:1777051553.048558:0:3678:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1777051553.048570:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95f97df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452742400:0@lo:400:kworker.0 00000100:00100000:2.0:1777051553.048598:0:21368:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452742016 00000100:00100000:2.0:1777051553.048606:0:21368:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452742016 00000100:00100000:0.0:1777051553.048616:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051553.048659:0:21368:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452742272 00000100:00100000:0.0:1777051553.048665:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94ed2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3678:1863365452742912:0@lo:400:kworker.0 00000100:00100000:2.0:1777051553.048667:0:21368:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452742272 00000100:00100000:3.0:1777051553.048707:0:8468:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452742528 00000100:00100000:3.0:1777051553.048716:0:8468:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452742528 00000100:00100000:2.0:1777051553.048717:0:21368:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452743040 00000100:00100000:0.0:1777051553.048723:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051553.048724:0:21368:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452743040 00000100:00100000:2.0:1777051553.048770:0:21368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13591 00000100:00100000:2.0:1777051553.048783:0:21368:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f864a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3677:x1863365452741888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777051553.048849:0:21368:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f864a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3677:x1863365452741888:12345-0@lo:400:kworker.0 Request processed in 67us (1045us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051553.048862:0:21368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13591 00000100:00100000:2.0:1777051553.048887:0:21368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13592 00000100:00100000:2.0:1777051553.048900:0:21368:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94ed2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3678:x1863365452742016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051553.048998:0:8468:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452742784 00000100:00100000:2.0:1777051553.049000:0:21368:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94ed2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3678:x1863365452742016:12345-0@lo:400:kworker.0 Request processed in 100us (767us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051553.049008:0:8468:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452742784 00000100:00100000:2.0:1777051553.049019:0:21368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13592 00000100:00100000:0.0:1777051553.049051:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955610000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3678:1863365452742016:0@lo:400:kworker.0 00000100:00100000:2.0:1777051553.049061:0:21368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13593 00000100:00100000:2.0:1777051553.049082:0:21368:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f866d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3680:x1863365452742272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051553.049085:0:8468:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452742400 00000100:00100000:3.0:1777051553.049095:0:8468:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452742400 00000100:00100000:0.0:1777051553.049124:0:8492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13594 00000100:00100000:0.0:1777051553.049146:0:8492:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94ed2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3678:x1863365452743040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051553.049174:0:8468:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452742912 00000100:00100000:2.0:1777051553.049177:0:21368:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f866d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3680:x1863365452742272:12345-0@lo:400:kworker.0 Request processed in 100us (841us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051553.049184:0:8468:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452742912 00000100:00100000:0.0:1777051553.049237:0:8492:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94ed2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3678:x1863365452743040:12345-0@lo:400:kworker.0 Request processed in 97us (716us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051553.049249:0:21368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13593 00000100:00100000:3.0:1777051553.049252:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10615 00000100:00100000:3.0:1777051553.049274:0:8468:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94ed2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3678:x1863365452742528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777051553.049284:0:8492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13594 00000100:00080000:2.0:1777051553.049302:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1777051553.049312:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1777051553.049319:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1777051553.049325:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1777051553.049347:0:8628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10616 00000100:00100000:0.0:1777051553.049365:0:8628:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f866a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3680:x1863365452742784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777051553.049373:0:27884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10617 00000100:00100000:3.0:1777051553.049396:0:8468:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94ed2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3678:x1863365452742528:12345-0@lo:400:kworker.0 Request processed in 122us (1016us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051553.049397:0:27884:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d944070e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3678:x1863365452742400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051553.049425:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10615 00000100:00100000:3.0:1777051553.049452:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10618 00000100:00100000:3.0:1777051553.049465:0:8468:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d944071f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3678:x1863365452742912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777051553.049506:0:27884:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d944070e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3678:x1863365452742400:12345-0@lo:400:kworker.0 Request processed in 116us (891us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051553.049522:0:27884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10617 00000100:00100000:3.0:1777051553.049544:0:8468:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d944071f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3678:x1863365452742912:12345-0@lo:400:kworker.0 Request processed in 79us (825us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051553.049561:0:8628:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f866a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3680:x1863365452742784:12345-0@lo:400:kworker.0 Request processed in 195us (1116us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051553.049561:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10618 00000100:00100000:0.0:1777051553.049576:0:8628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10616 00000100:00100000:2.0:1777051553.049626:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955613480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3680:1863365452742272:0@lo:400:kworker.0 00000100:00100000:3.0:1777051553.049654:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051553.049660:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95f97d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3680:1863365452742784:0@lo:400:kworker.0 00000100:00100000:3.0:1777051553.049714:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95f97c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3679:1863365452742656:0@lo:400:kworker.0 00000100:00100000:2.0:1777051553.049717:0:6581:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452742144 00000100:00100000:2.0:1777051553.049728:0:6581:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452742144 00000100:00100000:3.0:1777051553.049777:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051553.049834:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95f97df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452742400:0@lo:400:kworker.0 00000100:00100000:3.0:1777051553.049861:0:109180:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452741760 00000100:00100000:0.0:1777051553.049863:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94ed2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3678:1863365452742912:0@lo:400:kworker.0 00000100:00100000:3.0:1777051553.049871:0:109180:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452741760 00000100:00100000:0.0:1777051553.049888:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95f97fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452742528:0@lo:400:kworker.0 00000100:00100000:0.0:1777051553.049915:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94ed2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3678:1863365452743040:0@lo:400:kworker.0 00000100:00100000:3.0:1777051553.049965:0:109180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1777051553.049983:0:109180:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7d978450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9351a01-5b0e-4470-97fd-58b9b4b312a2+23:3679:x1863365452741760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051553.050056:0:109180:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7d978450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9351a01-5b0e-4470-97fd-58b9b4b312a2+23:3679:x1863365452741760:12345-0@lo:400:kworker.0 Request processed in 79us (1991us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051553.050067:0:109180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1777051553.050172:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da4384d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3677:1863365452741888:0@lo:400:kworker.0 00000100:00100000:2.0:1777051553.050189:0:6581:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452742656 00000100:00100000:2.0:1777051553.050200:0:6581:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452742656 00000100:00100000:2.0:1777051553.050261:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13595 00000100:00100000:2.0:1777051553.050276:0:6581:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95aecea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3679:x1863365452742144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777051553.050344:0:6581:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95aecea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3679:x1863365452742144:12345-0@lo:400:kworker.0 Request processed in 70us (694us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051553.050356:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13595 00000100:00100000:2.0:1777051553.050387:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13596 00000100:00100000:3.0:1777051553.050394:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955613800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3679:1863365452742144:0@lo:400:kworker.0 00000100:00100000:2.0:1777051553.050403:0:6581:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95aeced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3679:x1863365452742656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051553.050412:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f9fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3679:1863365452741760:0@lo:400:kworker.0 00000100:00080000:3.0:1777051553.050478:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1777051553.050487:0:6581:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95aeced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3679:x1863365452742656:12345-0@lo:400:kworker.0 Request processed in 87us (710us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051553.050500:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13596 00000100:00100000:3.0:1777051553.050508:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95f97c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3679:1863365452742656:0@lo:400:kworker.0 00000100:00100000:0.0:1777051553.558912:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95aecc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452743168:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1777051553.559044:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051553.559119:0:3679:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1777051553.559135:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7fdf1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452743296:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1777051553.559494:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051553.559561:0:8472:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452743168 00000100:00100000:1.0:1777051553.559574:0:8472:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452743168 00000100:00100000:2.0:1777051553.559597:0:8473:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452743296 00000100:00100000:2.0:1777051553.559609:0:8473:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452743296 00000100:00100000:1.0:1777051553.559662:0:8472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5754 00000100:00100000:1.0:1777051553.559679:0:8472:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94ed2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3679:x1863365452743168:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1777051553.559717:0:8472:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 489208512 pending 0 free 3642707968 avail 3411185664 00000100:00100000:1.0:1777051553.559802:0:8472:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94ed2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3679:x1863365452743168:12345-0@lo:13:osp-pre-1-0.0 Request processed in 127us (761us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051553.560261:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95aecc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452743168:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1777051553.560842:0:8473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5755 00000100:00100000:2.0:1777051553.560858:0:8473:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94ed2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3679:x1863365452743296:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1777051553.560887:0:8473:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 515963584 pending 0 free 3860574208 avail 3629051904 00000100:00100000:2.0:1777051553.560983:0:8473:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94ed2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3679:x1863365452743296:12345-0@lo:13:osp-pre-0-0.0 Request processed in 128us (1493us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051553.560998:0:8473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5755 00000100:00100000:3.0:1777051553.561045:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7fdf1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452743296:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1777051553.562977:0:8472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5754 00010000:00010000:1.0:1777051553.942796:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1777051554.724184:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051554.724261:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051554.724311:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051554.724314:0:27885:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426150912 00000100:00100000:3.0:1777051554.724329:0:27885:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426150912 00000100:00100000:1.0:1777051554.724361:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051554.724399:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051554.724412:0:27885:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426151424 00000100:00100000:3.0:1777051554.724418:0:27885:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426151424 00000100:00100000:1.0:1777051554.724437:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051554.724467:0:27885:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426150784 00000100:00100000:1.0:1777051554.724474:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051554.724475:0:27885:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426150784 00000100:00100000:1.0:1777051554.724507:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051554.724547:0:27885:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426151296 00000100:00100000:3.0:1777051554.724552:0:27885:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426151296 00000100:00100000:3.0:1777051554.724599:0:27885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13597 00000100:00100000:3.0:1777051554.724614:0:27885:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fdf2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c11b6966-0775-44d2-bdc6-c74c26eb2226+9:2439:x1863365426150912:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:3.0:1777051554.724704:0:27885:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fdf2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c11b6966-0775-44d2-bdc6-c74c26eb2226+9:2439:x1863365426150912:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 94us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051554.724720:0:27885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13597 00000100:00100000:3.0:1777051554.724747:0:27885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13598 00000100:00100000:3.0:1777051554.724759:0:27885:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fdf0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+54:2439:x1863365426151424:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:3.0:1777051554.724801:0:27885:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fdf0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+54:2439:x1863365426151424:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 46us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051554.724810:0:27885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13598 00000100:00100000:3.0:1777051554.724838:0:27885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13599 00000100:00100000:3.0:1777051554.724849:0:27885:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fdf1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c11b6966-0775-44d2-bdc6-c74c26eb2226+22:2439:x1863365426150784:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:1.0:1777051554.724888:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051554.724898:0:27885:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fdf1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c11b6966-0775-44d2-bdc6-c74c26eb2226+22:2439:x1863365426150784:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 50us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051554.724935:0:27885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13599 00000100:00100000:3.0:1777051554.724953:0:27885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13600 00000100:00100000:3.0:1777051554.724963:0:27885:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95088bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+14:2439:x1863365426151296:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:3.0:1777051554.725015:0:27885:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95088bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+14:2439:x1863365426151296:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 43us (500us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051554.725025:0:27885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13600 00000100:00080000:3.0:1777051554.725050:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1777051554.725055:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1777051554.725110:0:55805:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426151168 00000100:00100000:1.0:1777051554.725146:0:55805:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426151168 00000100:00100000:1.0:1777051554.725224:0:55805:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426151680 00000100:00100000:1.0:1777051554.725229:0:55805:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426151680 00000100:00100000:1.0:1777051554.725261:0:55805:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426151040 00000100:00100000:1.0:1777051554.725266:0:55805:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426151040 00000100:00100000:1.0:1777051554.725305:0:55805:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426151552 00000100:00100000:1.0:1777051554.725310:0:55805:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426151552 00000100:00100000:1.0:1777051554.725337:0:55805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10619 00000100:00100000:1.0:1777051554.725347:0:55805:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fdf0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c11b6966-0775-44d2-bdc6-c74c26eb2226+30:2439:x1863365426151168:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:1.0:1777051554.725401:0:55805:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fdf0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c11b6966-0775-44d2-bdc6-c74c26eb2226+30:2439:x1863365426151168:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 54us (1089us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051554.725412:0:55805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10619 00000100:00100000:1.0:1777051554.725440:0:55805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10620 00000100:00100000:1.0:1777051554.725451:0:55805:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fdf3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+30:2439:x1863365426151680:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:1.0:1777051554.725485:0:55805:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fdf3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+30:2439:x1863365426151680:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 39us (1089us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051554.725493:0:55805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10620 00000100:00100000:1.0:1777051554.725510:0:55805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10621 00000100:00100000:1.0:1777051554.725521:0:55805:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d950889500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c11b6966-0775-44d2-bdc6-c74c26eb2226+16:2439:x1863365426151040:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:1.0:1777051554.725557:0:55805:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d950889500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c11b6966-0775-44d2-bdc6-c74c26eb2226+16:2439:x1863365426151040:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 39us (1087us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051554.725566:0:55805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10621 00000100:00100000:1.0:1777051554.725582:0:55805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10622 00000100:00100000:1.0:1777051554.725590:0:55805:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95088a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+17:2439:x1863365426151552:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:1.0:1777051554.725620:0:55805:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95088a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+17:2439:x1863365426151552:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 30us (735us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051554.725640:0:55805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10622 00000100:00100000:3.0:1777051554.726962:0:109184:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426150656 00000100:00100000:3.0:1777051554.726968:0:109184:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426150656 00000100:00100000:3.0:1777051554.727003:0:109184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 103 00000100:00100000:3.0:1777051554.727013:0:109184:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fac5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:29c4352d-3260-4734-909d-9ea5de9e7fa4+12:2439:x1863365426150656:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:3.0:1777051554.727060:0:109184:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fac5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:29c4352d-3260-4734-909d-9ea5de9e7fa4+12:2439:x1863365426150656:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 47us (2885us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051554.727070:0:109184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 103 00000100:00080000:3.0:1777051554.727115:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1777051554.727122:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1777051554.967073:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1777051555.607361:0:3678:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1777051555.607399:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95aecc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452743424:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1777051555.607501:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051555.607514:0:3677:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1777051555.607541:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95aece300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452743552:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1777051555.607618:0:10113:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452743424 00000100:00100000:3.0:1777051555.607632:0:10113:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452743424 00000100:00080000:0.0:1777051555.607701:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1777051555.607719:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051555.607736:0:10113:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452743552 00000100:00100000:3.0:1777051555.607745:0:10113:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452743552 00000100:00100000:0.0:1777051555.607787:0:8473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5756 00000100:00100000:0.0:1777051555.607811:0:8473:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955613800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3678:x1863365452743424:12345-0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1777051555.607834:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1777051555.607849:0:10113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5757 00002000:00000024:0.0:1777051555.607858:0:8473:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 489208512 pending 0 free 3642707968 avail 3411185664 00000100:00100000:3.0:1777051555.607873:0:10113:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f97c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3677:x1863365452743552:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1777051555.607953:0:10113:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 515963584 pending 0 free 3860574208 avail 3629051904 00000100:00100000:0.0:1777051555.608025:0:8473:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955613800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3678:x1863365452743424:12345-0@lo:13:osp-pre-1-1.0 Request processed in 214us (517us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051555.608042:0:8473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5756 00000100:00100000:3.0:1777051555.608049:0:10113:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f97c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3677:x1863365452743552:12345-0@lo:13:osp-pre-0-1.0 Request processed in 180us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051555.608068:0:10113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5757 00000100:00100000:0.0:1777051555.608176:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95aece300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452743552:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1777051555.608177:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95aecc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452743424:0@lo:13:osp-pre-1-1.0 00000001:00080000:1.0:1777051555.612500:0:8464:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0000: transno 4294968381 is committed 00000001:00080000:1.0:1777051555.612515:0:8464:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0000: transno 4294968380 is committed 00000001:00080000:0.0:1777051555.614723:0:109175:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 34359738443 is committed 00000001:00080000:0.0:1777051555.614755:0:109175:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 34359738441 is committed 00000020:00080000:0.0:1777051555.614770:0:109175:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff99da4682b600 refcount 2 committed 0 result 0 batchid 30064771261 00000020:00080000:0.0:1777051555.614776:0:109175:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff99da7fc8f900 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff99da4682b540 00000020:00080000:0.0:1777051555.614781:0:109175:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff99da7fc8f400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff99d943cb3c00 00010000:00010000:1.0:1777051555.614863:0:3664:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502db600/0x85f51a6b967180a7 lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e3:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1777051555.614870:0:109209:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 30064771261 committed batchid 30064771260 00010000:00010000:1.0:1777051555.614922:0:3664:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502db600/0x85f51a6b967180a7 lrc: 2/0,0 mode: TXN/TXN res: [0x2000032e3:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051555.614939:0:3664:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502db600/0x85f51a6b967180a7 lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e3:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051555.614953:0:3664:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d9502db600 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:1.0:1777051555.614961:0:3664:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502db600/0x85f51a6b967180a7 lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e3:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051555.614975:0:3664:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502db600/0x85f51a6b967180a7 lrc: 4/0,0 mode: TXN/TXN res: [0x2000032e3:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051555.615002:0:3664:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e3:0xf:0x0].0x0 (ffff99d9413d0400) 00010000:00010000:1.0:1777051555.615008:0:3664:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000020:00080000:2.0:1777051555.615014:0:109209:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 30064771260 00010000:00010000:1.0:1777051555.615017:0:3664:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502db600/0x85f51a6b967180a7 lrc: 2/0,0 mode: --/TXN res: [0x2000032e3:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051555.615034:0:3664:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502db600/0x85f51a6b967180a7 lrc: 0/0,0 mode: --/TXN res: [0x2000032e3:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051555.990441:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1777051556.375189:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051556.376178:0:8492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426151808 00000100:00100000:2.0:1777051556.376191:0:8492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426151808 00000100:00080000:0.0:1777051556.376329:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1777051556.376339:0:8492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112539 00000100:00100000:2.0:1777051556.376359:0:8492:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fd64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+13:141953:x1863365426151808:12345-192.168.201.46@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1777051556.376499:0:8492:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fd64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+13:141953:x1863365426151808:12345-192.168.201.46@tcp:60:lhsmtool_posix.0 Request processed in 146us (1321us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051556.376512:0:8492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112539 00000100:00100000:3.0:1777051556.379682:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051556.379786:0:27885:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426151936 00000100:00100000:2.0:1777051556.379795:0:27885:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426151936 00000100:00100000:2.0:1777051556.379870:0:27885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112540 00000100:00100000:2.0:1777051556.379915:0:27885:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95aece300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c11b6966-0775-44d2-bdc6-c74c26eb2226+9:141953:x1863365426151936:12345-192.168.201.46@tcp:60:lhsmtool_posix.0 00000100:00080000:0.0:1777051556.379937:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1777051556.380011:0:27885:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95aece300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c11b6966-0775-44d2-bdc6-c74c26eb2226+9:141953:x1863365426151936:12345-192.168.201.46@tcp:60:lhsmtool_posix.0 Request processed in 128us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051556.380024:0:27885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112540 00000100:00100000:1.0:1777051556.384400:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051556.384584:0:24269:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426152192 00000100:00100000:2.0:1777051556.384592:0:24269:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426152192 00000100:00100000:2.0:1777051556.384683:0:24269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3454 00000100:00100000:2.0:1777051556.384697:0:24269:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fd64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+13:141953:x1863365426152192:12345-192.168.201.46@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1777051556.384985:0:24269:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fd64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+14:141953:x1863365426152192:12345-192.168.201.46@tcp:35:lhsmtool_posix.0 Request processed in 287us (587us total) trans 34359738444 rc 0/0 00000100:00100000:2.0:1777051556.385005:0:24269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3454 00010000:00010000:3.0:1777051557.014580:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1777051557.014736:0:110924:0:(llog.c:801:llog_process_thread()) index: 6, lh_last_idx: 7 synced_idx: 0 lgh_last_idx: 7 00000040:00080000:2.0:1777051557.014747:0:110924:0:(llog_cat.c:158:llog_cat_process_common()) processing log [0x1:0x2b:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1777051557.015483:0:110924:0:(llog.c:858:llog_process_thread()) stop processing plain [0x1:0x2b:0x0] index 12 count 2 00000040:00080000:2.0:1777051557.015507:0:110924:0:(llog.c:801:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:2.0:1777051557.015512:0:110924:0:(llog_cat.c:158:llog_cat_process_common()) processing log [0x1:0x31:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1777051557.015537:0:110924:0:(llog.c:858:llog_process_thread()) stop processing plain [0x1:0x31:0x0] index 4 count 4 00000040:00080000:2.0:1777051557.015545:0:110924:0:(llog.c:858:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 3 00000040:00080000:3.0:1777051557.590631:0:110973:0:(llog.c:801:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1777051557.590642:0:110973:0:(llog_cat.c:158:llog_cat_process_common()) processing log [0x1:0x12:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1777051557.591825:0:110973:0:(llog.c:858:llog_process_thread()) stop processing plain [0x1:0x12:0x0] index 64768 count 1 00000040:00080000:3.0:1777051557.591839:0:110973:0:(llog.c:858:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:0.0:1777051558.038618:0:108751:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1777051558.167500:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95f97fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452743680:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1777051558.167602:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051558.167624:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f299500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3677:1863365452743936:0@lo:400:kworker.0 00000100:00100000:0.0:1777051558.167707:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051558.167711:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f298000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3679:1863365452744192:0@lo:400:kworker.0 00000100:00100000:0.0:1777051558.167778:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f29ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3677:1863365452744448:0@lo:400:kworker.0 00000100:00100000:2.0:1777051558.167783:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051558.167842:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051558.167879:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7cd9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452744704:0@lo:400:kworker.0 00000100:00100000:0.0:1777051558.167912:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7cd9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3677:1863365452744960:0@lo:400:kworker.0 00000100:00100000:2.0:1777051558.167933:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051558.167991:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051558.168008:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7cd9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452745216:0@lo:400:kworker.0 00000100:00100000:0.0:1777051558.168035:0:3677:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1777051558.168051:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f29a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3677:1863365452744064:0@lo:400:kworker.0 00000100:00100000:2.0:1777051558.168067:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051558.168114:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051558.168116:0:3679:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:2.0:1777051558.168132:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d955613480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452743808:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1777051558.168452:0:6579:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452744192 00000100:00100000:1.0:1777051558.168456:0:6580:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452744448 00000100:00100000:3.0:1777051558.168465:0:6579:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452744192 00000100:00100000:2.0:1777051558.168468:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051558.168470:0:6580:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452744448 00000100:00100000:2.0:1777051558.168512:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f29bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3679:1863365452744320:0@lo:400:kworker.0 00000100:00100000:3.0:1777051558.168553:0:6579:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452744064 00000100:00100000:2.0:1777051558.168559:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051558.168562:0:6579:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452744064 00000100:00100000:2.0:1777051558.168596:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7cd9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3679:1863365452744832:0@lo:400:kworker.0 00000100:00100000:3.0:1777051558.168608:0:6579:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452744320 00000100:00100000:3.0:1777051558.168615:0:6579:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452744320 00000100:00100000:2.0:1777051558.168643:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051558.168670:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7cd9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452744576:0@lo:400:kworker.0 00000100:00100000:3.0:1777051558.168684:0:6579:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452744832 00000100:00100000:3.0:1777051558.168691:0:6579:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452744832 00000100:00100000:2.0:1777051558.168711:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7cd9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3679:1863365452745344:0@lo:400:kworker.0 00000100:00100000:0.0:1777051558.168748:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051558.168755:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13601 00000100:00100000:3.0:1777051558.168769:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13602 00000100:00100000:2.0:1777051558.168773:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051558.168778:0:6580:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f97d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3679:x1863365452744192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777051558.168798:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7cd9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3677:1863365452745088:0@lo:400:kworker.0 00000100:00100000:3.0:1777051558.168799:0:6579:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d943d91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3677:x1863365452744064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777051558.168847:0:46500:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452743680 00000100:00100000:2.0:1777051558.168883:0:46500:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452743680 00000100:00100000:0.0:1777051558.168926:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051558.168928:0:6580:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f97d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3679:x1863365452744192:12345-0@lo:400:kworker.0 Request processed in 152us (1143us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051558.168942:0:6579:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d943d91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3677:x1863365452744064:12345-0@lo:400:kworker.0 Request processed in 151us (828us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051558.168951:0:46500:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452744960 00000100:00100000:1.0:1777051558.168953:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13601 00000100:00100000:2.0:1777051558.168961:0:46500:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452744960 00000100:00100000:3.0:1777051558.168969:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13602 00000100:00100000:1.0:1777051558.169001:0:6580:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452745344 00000100:00100000:0.0:1777051558.169003:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f29a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3677:1863365452744064:0@lo:400:kworker.0 00000100:00100000:1.0:1777051558.169011:0:6580:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452745344 00000100:00100000:2.0:1777051558.169014:0:46500:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452743808 00000100:00100000:3.0:1777051558.169016:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13603 00000100:00100000:2.0:1777051558.169024:0:46500:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452743808 00000100:00100000:3.0:1777051558.169039:0:6579:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95faead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3679:x1863365452744320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777051558.169065:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13604 00000100:00100000:1.0:1777051558.169083:0:6580:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955610000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3677:x1863365452744448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777051558.169088:0:46500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8388 00000100:00100000:0.0:1777051558.169105:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8389 00000100:00100000:3.0:1777051558.169114:0:6579:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95faead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3679:x1863365452744320:12345-0@lo:400:kworker.0 Request processed in 78us (551us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051558.169117:0:46500:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f97df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+7:3679:x1863365452743680:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1777051558.169131:0:6584:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d943d93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3677:x1863365452744960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051558.169145:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13603 00000004:00000024:2.0:1777051558.169175:0:46500:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4194304 pending 0 free 1441529856 avail 1295290368 00000100:00100000:1.0:1777051558.169184:0:6580:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955610000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3677:x1863365452744448:12345-0@lo:400:kworker.0 Request processed in 102us (1337us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051558.169186:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13605 00000100:00100000:1.0:1777051558.169243:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13604 00000100:00100000:3.0:1777051558.169252:0:6579:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95faeb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3679:x1863365452744832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777051558.169276:0:6584:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d943d93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3677:x1863365452744960:12345-0@lo:400:kworker.0 Request processed in 151us (1285us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051558.169287:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13606 00000100:00100000:0.0:1777051558.169295:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8389 00000100:00100000:2.0:1777051558.169307:0:46500:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f97df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+7:3679:x1863365452743680:12345-0@lo:41:osp-pre-0-1.0 Request processed in 197us (1705us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051558.169308:0:6580:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95fae9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3679:x1863365452745344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051558.169329:0:6579:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95faeb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3679:x1863365452744832:12345-0@lo:400:kworker.0 Request processed in 81us (686us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051558.169337:0:46500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8388 00000100:00100000:0.0:1777051558.169355:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8390 00000100:00100000:3.0:1777051558.169355:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13605 00000100:00100000:0.0:1777051558.169382:0:6584:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95faeaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3679:x1863365452743808:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1777051558.169392:0:109182:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452743936 00000100:00100000:2.0:1777051558.169401:0:109182:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452743936 00000100:00080000:3.0:1777051558.169411:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00000024:0.0:1777051558.169417:0:6584:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4194304 pending 0 free 1446141952 avail 1299902464 00000100:00080000:3.0:1777051558.169422:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1777051558.169445:0:6580:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95fae9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3679:x1863365452745344:12345-0@lo:400:kworker.0 Request processed in 86us (619us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051558.169457:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13606 00000100:00100000:2.0:1777051558.169467:0:109182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1777051558.169488:0:6584:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95faeaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3679:x1863365452743808:12345-0@lo:41:osp-pre-1-0.0 Request processed in 110us (1019us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051558.169490:0:109182:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fac4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9351a01-5b0e-4470-97fd-58b9b4b312a2+23:3677:x1863365452743936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777051558.169505:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8390 00000100:00100000:1.0:1777051558.169517:0:8628:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452744704 00000100:00100000:1.0:1777051558.169525:0:8628:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452744704 00000100:00100000:2.0:1777051558.169571:0:109182:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fac4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9351a01-5b0e-4470-97fd-58b9b4b312a2+23:3677:x1863365452743936:12345-0@lo:400:kworker.0 Request processed in 89us (1865us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051558.169573:0:8470:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452745216 00000100:00100000:0.0:1777051558.169582:0:8470:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452745216 00000100:00100000:2.0:1777051558.169590:0:109182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1777051558.169600:0:8628:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452744576 00000100:00100000:1.0:1777051558.169607:0:8628:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452744576 00000100:00100000:0.0:1777051558.169648:0:8470:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452745088 00000100:00100000:0.0:1777051558.169654:0:8470:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452745088 00000100:00100000:3.0:1777051558.169677:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10623 00000100:00100000:1.0:1777051558.169689:0:8628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10624 00000100:00100000:3.0:1777051558.169699:0:8468:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da45f74000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3679:x1863365452744704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777051558.169702:0:24468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10625 00000100:00100000:1.0:1777051558.169710:0:8628:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d955506300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3679:x1863365452745216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777051558.169728:0:24468:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7c9a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3677:x1863365452744576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777051558.169751:0:8470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10626 00000100:00100000:0.0:1777051558.169768:0:8470:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7c9a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3677:x1863365452745088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051558.169809:0:8468:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da45f74000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3679:x1863365452744704:12345-0@lo:400:kworker.0 Request processed in 115us (1870us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051558.169827:0:8628:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d955506300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3679:x1863365452745216:12345-0@lo:400:kworker.0 Request processed in 123us (1758us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051558.169827:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10623 00000100:00100000:2.0:1777051558.169839:0:24468:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7c9a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3677:x1863365452744576:12345-0@lo:400:kworker.0 Request processed in 113us (1090us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051558.169876:0:8470:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7c9a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3677:x1863365452745088:12345-0@lo:400:kworker.0 Request processed in 82us (927us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051558.169884:0:8628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10624 00000100:00100000:2.0:1777051558.169900:0:24468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10625 00000100:00100000:0.0:1777051558.169911:0:8470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10626 00000100:00080000:1.0:1777051558.169964:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1777051558.169973:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1777051558.169982:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7cd9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452744576:0@lo:400:kworker.0 00000100:00100000:0.0:1777051558.170012:0:3677:0:(client.c:3101:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968381 gen 2 00000004:00080000:0.0:1777051558.170021:0:3677:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 4294968381 committed transno 4294968381 00000100:00100000:0.0:1777051558.170051:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7cd9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3677:1863365452745088:0@lo:400:kworker.0 00000100:00100000:0.0:1777051558.170075:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f29ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3677:1863365452744448:0@lo:400:kworker.0 00000100:00100000:0.0:1777051558.170098:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7cd9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3677:1863365452744960:0@lo:400:kworker.0 00000100:00100000:0.0:1777051558.170119:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f299500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3677:1863365452743936:0@lo:400:kworker.0 00000100:00100000:2.0:1777051558.170299:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d955613480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452743808:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1777051558.170320:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f29bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3679:1863365452744320:0@lo:400:kworker.0 00000100:00100000:2.0:1777051558.170334:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7cd9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3679:1863365452744832:0@lo:400:kworker.0 00000100:00100000:2.0:1777051558.170349:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7cd9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3679:1863365452745344:0@lo:400:kworker.0 00000100:00100000:2.0:1777051558.170366:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7cd9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452745216:0@lo:400:kworker.0 00000100:00100000:2.0:1777051558.170385:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f298000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3679:1863365452744192:0@lo:400:kworker.0 00000100:00100000:2.0:1777051558.170407:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7cd9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452744704:0@lo:400:kworker.0 00000100:00100000:2.0:1777051558.170430:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95f97fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452743680:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1777051558.678419:0:3678:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1777051558.678468:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95faebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3678:1863365452745600:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1777051558.678553:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051558.678611:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95aecc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3678:1863365452745472:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1777051558.678621:0:47388:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452745600 00000100:00100000:2.0:1777051558.678631:0:47388:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452745600 00000100:00100000:3.0:1777051558.678671:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051558.678704:0:47388:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452745472 00000100:00100000:2.0:1777051558.678711:0:47388:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452745472 00000100:00100000:0.0:1777051558.678749:0:8472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5758 00000100:00100000:2.0:1777051558.678763:0:47388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5759 00000100:00100000:0.0:1777051558.678771:0:8472:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3678:x1863365452745600:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1777051558.678780:0:47388:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da4384d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3678:x1863365452745472:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1777051558.678814:0:47388:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 515963584 pending 0 free 3860574208 avail 3629051904 00002000:00000024:0.0:1777051558.678815:0:8472:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 489208512 pending 0 free 3642707968 avail 3411185664 00000100:00100000:0.0:1777051558.678943:0:8472:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3678:x1863365452745600:12345-0@lo:13:osp-pre-1-0.0 Request processed in 178us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051558.678947:0:47388:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da4384d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3678:x1863365452745472:12345-0@lo:13:osp-pre-0-0.0 Request processed in 171us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051558.678965:0:8472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5758 00000100:00100000:2.0:1777051558.678975:0:47388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5759 00000100:00100000:3.0:1777051558.679018:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95faebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3678:1863365452745600:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1777051558.679046:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95aecc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3678:1863365452745472:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1777051559.063258:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1777051559.847026:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051559.847102:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051559.847185:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051559.847323:0:109186:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426152320 00000100:00100000:2.0:1777051559.847330:0:8471:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426152832 00000100:00100000:2.0:1777051559.847351:0:8471:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426152832 00000100:00100000:3.0:1777051559.847357:0:109186:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426152320 00000100:00100000:1.0:1777051559.847392:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051559.847464:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051559.847475:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10627 00000100:00100000:3.0:1777051559.847496:0:109186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 105 00000100:00100000:2.0:1777051559.847508:0:8471:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7cd9ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+30:2438:x1863365426152832:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:3.0:1777051559.847526:0:109186:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942db3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:29c4352d-3260-4734-909d-9ea5de9e7fa4+12:2438:x1863365426152320:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:1.0:1777051559.847547:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051559.847646:0:8471:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7cd9ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+30:2438:x1863365426152832:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 156us (460us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051559.847658:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10627 00000100:00100000:2.0:1777051559.847692:0:8471:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426153344 00000100:00100000:2.0:1777051559.847699:0:8471:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426153344 00000100:00100000:0.0:1777051559.847737:0:6579:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426152576 00000100:00100000:0.0:1777051559.847753:0:6579:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426152576 00000100:00100000:2.0:1777051559.847760:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10628 00000100:00100000:2.0:1777051559.847774:0:8471:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7cd9f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+30:2438:x1863365426153344:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:0.0:1777051559.848483:0:6579:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426153088 00000100:00100000:0.0:1777051559.848496:0:6579:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426153088 00000100:00100000:2.0:1777051559.848553:0:8471:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7cd9f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+30:2438:x1863365426153344:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 772us (1081us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051559.848560:0:6579:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426152448 00000100:00100000:1.0:1777051559.848566:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051559.848577:0:6579:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426152448 00000100:00100000:2.0:1777051559.848589:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10628 00000100:00100000:2.0:1777051559.848628:0:8471:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426152704 00000100:00100000:2.0:1777051559.848637:0:8471:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426152704 00000100:00100000:0.0:1777051559.848661:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13607 00000100:00100000:0.0:1777051559.848686:0:6579:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7cd9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+9:2438:x1863365426152576:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:2.0:1777051559.848713:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10629 00000100:00100000:2.0:1777051559.848741:0:8471:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da57c81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+15:2439:x1863365426152704:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:1.0:1777051559.848752:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051559.849184:0:8471:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da57c81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+15:2439:x1863365426152704:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 447us (630us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051559.849187:0:6579:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7cd9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+9:2438:x1863365426152576:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 498us (2072us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051559.849243:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10629 00000100:00100000:0.0:1777051559.849273:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13607 00000100:00100000:0.0:1777051559.849338:0:6579:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426152960 00000100:00100000:0.0:1777051559.849350:0:6579:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426152960 00000100:00100000:0.0:1777051559.849448:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13608 00000100:00100000:0.0:1777051559.849478:0:6579:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7cd9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+54:2438:x1863365426153088:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:0.0:1777051559.849586:0:6579:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7cd9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+54:2438:x1863365426153088:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 119us (2194us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051559.849607:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051559.849607:0:109186:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942db3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:29c4352d-3260-4734-909d-9ea5de9e7fa4+12:2438:x1863365426152320:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 2080us (2580us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051559.849630:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13608 00000100:00100000:3.0:1777051559.849646:0:109186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 105 00000100:00100000:0.0:1777051559.849701:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13609 00000100:00100000:0.0:1777051559.849727:0:6579:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7cd9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+14:2439:x1863365426152448:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:2.0:1777051559.849752:0:8471:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426153216 00000100:00100000:2.0:1777051559.849763:0:8471:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426153216 00000100:00080000:1.0:1777051559.849786:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1777051559.849789:0:10328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13610 00000100:00080000:1.0:1777051559.849803:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1777051559.849813:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1777051559.849819:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1777051559.849859:0:10328:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7cd9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+12:2439:x1863365426152960:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:2.0:1777051559.849864:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10630 00000100:00100000:0.0:1777051559.849883:0:6579:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7cd9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+14:2439:x1863365426152448:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 155us (2338us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051559.849894:0:8471:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7cd9e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+17:2439:x1863365426153216:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:0.0:1777051559.849920:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13609 00000100:00100000:2.0:1777051559.849990:0:8471:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7cd9e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+17:2439:x1863365426153216:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 99us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051559.850004:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10630 00000100:00100000:3.0:1777051559.850069:0:10328:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7cd9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+12:2439:x1863365426152960:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 175us (1249us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051559.850088:0:10328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13610 00010000:00010000:1.0:1777051560.086883:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1777051560.726920:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7c9a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452745728:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1777051560.727023:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051560.727171:0:8473:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452745728 00000100:00100000:2.0:1777051560.727184:0:8473:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452745728 00000100:00100000:2.0:1777051560.727597:0:8473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5760 00000100:00100000:2.0:1777051560.727617:0:8473:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95fae8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3679:x1863365452745728:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1777051560.727664:0:8473:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 515963584 pending 0 free 3860574208 avail 3629051904 00000100:00100000:2.0:1777051560.727740:0:8473:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95fae8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3679:x1863365452745728:12345-0@lo:13:osp-pre-0-1.0 Request processed in 129us (720us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051560.728108:0:8473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5760 00000100:00080000:1.0:1777051560.730153:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1777051560.730272:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7c9a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3680:1863365452745856:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1777051560.730349:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051560.730476:0:8472:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452745856 00000100:00100000:0.0:1777051560.730487:0:8472:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452745856 00000100:00100000:0.0:1777051560.730575:0:8472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5761 00000100:00100000:0.0:1777051560.730594:0:8472:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7c9a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3680:x1863365452745856:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1777051560.730631:0:8472:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 489208512 pending 0 free 3642707968 avail 3411185664 00000100:00100000:0.0:1777051560.730713:0:8472:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7c9a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3680:x1863365452745856:12345-0@lo:13:osp-pre-1-1.0 Request processed in 123us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051560.730728:0:8472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5761 00000100:00100000:2.0:1777051560.731447:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7c9a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452745728:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1777051560.732329:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7c9a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3680:1863365452745856:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1777051560.732765:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1777051561.110684:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1777051561.151241:0:111560:0:(debug.c:645:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-hsm test 409b: getattr released file with CDT stopped after remount ========================================================== 13:25:59 (1777051559) 00000100:00100000:0.0:1777051561.223657:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051561.223738:0:21368:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426153472 00000100:00100000:3.0:1777051561.223752:0:21368:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426153472 00000100:00080000:0.0:1777051561.223869:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1777051561.223899:0:21368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112541 00000100:00100000:3.0:1777051561.223917:0:21368:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7c9a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+12:142600:x1863365426153472:12345-192.168.201.46@tcp:101:lfs.0 00010000:00010000:3.0:1777051561.223944:0:21368:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777051561.223972:0:21368:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cf800/0x85f51a6b96718102 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6c2a expref: -99 pid: 21368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051561.224057:0:21368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce000/0x85f51a6b96718109 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051561.224087:0:21368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce000/0x85f51a6b96718109 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051561.224455:0:21368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce000/0x85f51a6b96718109 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051561.224487:0:21368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce800/0x85f51a6b96718110 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe83fd7d1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051561.224501:0:21368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce800/0x85f51a6b96718110 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe83fd7d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051561.224514:0:21368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce800/0x85f51a6b96718110 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe83fd7d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051561.224582:0:21368:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce000/0x85f51a6b96718109 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051561.224595:0:21368:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce000/0x85f51a6b96718109 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051561.224608:0:21368:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce000/0x85f51a6b96718109 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051561.224619:0:21368:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da7d5ce000 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:3.0:1777051561.224626:0:21368:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce000/0x85f51a6b96718109 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051561.224637:0:21368:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce000/0x85f51a6b96718109 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051561.224655:0:21368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d9413d0800) 00010000:00010000:3.0:1777051561.224662:0:21368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777051561.224669:0:21368:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce000/0x85f51a6b96718109 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051561.224682:0:21368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce000/0x85f51a6b96718109 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051561.224700:0:21368:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce800/0x85f51a6b96718110 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe83fd7d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051561.224711:0:21368:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce800/0x85f51a6b96718110 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe83fd7d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051561.224721:0:21368:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce800/0x85f51a6b96718110 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe83fd7d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051561.224729:0:21368:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da7d5ce800 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:3.0:1777051561.224734:0:21368:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce800/0x85f51a6b96718110 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe83fd7d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051561.224745:0:21368:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce800/0x85f51a6b96718110 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe83fd7d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051561.224758:0:21368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xe83fd7d1 (ffff99d9413d0000) 00010000:00010000:3.0:1777051561.224764:0:21368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777051561.224768:0:21368:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce800/0x85f51a6b96718110 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe83fd7d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051561.224779:0:21368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce800/0x85f51a6b96718110 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe83fd7d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051561.224860:0:21368:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cf800/0x85f51a6b96718102 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6c2a expref: 13 pid: 21368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051561.224881:0:21368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d9413d0800) 00010000:00010000:3.0:1777051561.224885:0:21368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777051561.224893:0:21368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cf800/0x85f51a6b96718102 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6c2a expref: 13 pid: 21368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051561.224910:0:21368:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99da7d5cf800, rc 0) 00000100:00100000:3.0:1777051561.225006:0:21368:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7c9a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+12:142600:x1863365426153472:12345-192.168.201.46@tcp:101:lfs.0 Request processed in 1091us (1356us total) trans 0 rc 301/301 00000100:00100000:3.0:1777051561.225021:0:21368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112541 00000100:00100000:0.0:1777051561.248982:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051561.249105:0:27882:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426153728 00000100:00100000:1.0:1777051561.249121:0:27882:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426153728 00000100:00100000:1.0:1777051561.249242:0:27882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112542 00000100:00100000:1.0:1777051561.249264:0:27882:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7c9a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+12:142600:x1863365426153728:12345-192.168.201.46@tcp:36:lfs.0 00010000:00010000:1.0:1777051561.249343:0:27882:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1777051561.249384:0:27882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69b200/0x85f51a6b96717efc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6b90 expref: 12 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051561.249417:0:27882:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d9413d0800) 00010000:00010000:1.0:1777051561.249426:0:27882:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1777051561.249519:0:27882:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502db400/0x85f51a6b96718117 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051561.249544:0:27882:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cf600/0x85f51a6b96717e5b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6b66 expref: 13 pid: 46494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051561.249562:0:27882:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502db400/0x85f51a6b96718117 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051561.249613:0:27882:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cf600/0x85f51a6b96717e5b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6b66 expref: 13 pid: 46494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051561.249668:0:27882:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cf600/0x85f51a6b96717e5b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6b66 expref: 13 pid: 46494 timeout: 8290 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051561.249707:0:27882:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7cd9df80 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27882:1863365452745984:192.168.201.46@tcp:104: 00000100:00100000:1.0:1777051561.249874:0:27882:0:(client.c:2691:ptlrpc_set_wait()) set ffff99da7d50ccc0 going to sleep for 11 seconds 00000100:00100000:2.0:1777051561.258467:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051561.258474:0:27882:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7cd9df80 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27882:1863365452745984:192.168.201.46@tcp:104: 00010000:00010000:0.0:1777051561.258519:0:27882:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502db400/0x85f51a6b96718117 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051561.258572:0:6565:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426153856 00000100:00100000:0.0:1777051561.258582:0:6565:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426153856 00010000:00010000:0.0:1777051561.258663:0:6565:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cf600/0x85f51a6b96717e5b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6b66 expref: 14 pid: 46494 timeout: 8290 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1777051561.258678:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1777051561.258736:0:6565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3997 00000100:00100000:0.0:1777051561.258757:0:6565:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95fae9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+14:2437:x1863365426153856:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1777051561.258778:0:6565:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777051561.258791:0:6565:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cf600/0x85f51a6b96717e5b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6b66 expref: 14 pid: 46494 timeout: 8290 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051561.258848:0:6565:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cf600/0x85f51a6b96717e5b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6b66 expref: 14 pid: 46494 timeout: 8290 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051561.258877:0:6565:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cf600/0x85f51a6b96717e5b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6b66 expref: 14 pid: 46494 timeout: 8290 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051561.258901:0:6565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d9413d0800) 00010000:00010000:0.0:1777051561.258908:0:6565:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502db400/0x85f51a6b96718117 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051561.258923:0:6565:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502db400/0x85f51a6b96718117 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051561.258936:0:6565:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502db400/0x85f51a6b96718117 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051561.258985:0:6565:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1777051561.259047:0:27882:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502db400/0x85f51a6b96718117 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051561.259061:0:27882:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502db400/0x85f51a6b96718117 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051561.259089:0:27882:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69a000/0x85f51a6b9671811e lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xe83fd7d1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051561.259102:0:6565:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95fae9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+13:2437:x1863365426153856:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 344us (634us total) trans 0 rc 0/0 00010000:00010000:2.0:1777051561.259108:0:27882:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69a000/0x85f51a6b9671811e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe83fd7d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051561.259135:0:27882:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69a000/0x85f51a6b9671811e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe83fd7d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051561.259146:0:6565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3997 00010000:00010000:2.0:1777051561.260078:0:27882:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69b000/0x85f51a6b96718125 lrc: 3/0,1 mode: --/PW res: [0x2000032e2:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051561.260098:0:27882:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69b000/0x85f51a6b96718125 lrc: 3/0,1 mode: PW/PW res: [0x2000032e2:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051561.260113:0:27882:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69b000/0x85f51a6b96718125 lrc: 3/0,1 mode: PW/PW res: [0x2000032e2:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1777051561.260138:0:27882:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000ab1aed07 reply state 00000000902b1f1f transno 34359738445 ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69b000/0x85f51a6b96718125 lrc: 3/0,1 mode: PW/PW res: [0x2000032e2:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051561.260486:0:27882:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69b000/0x85f51a6b96718125 lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e2:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051561.260503:0:27882:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0x10:0x0].0x0 (ffff99da45fd2800) 00010000:00010000:2.0:1777051561.260509:0:27882:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1777051561.260515:0:27882:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1777051561.260524:0:27882:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000032e2:0x10:0x0]: returning size 4096 00010000:00010000:2.0:1777051561.260539:0:27882:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502db400/0x85f51a6b96718117 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051561.260553:0:27882:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502db400/0x85f51a6b96718117 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051561.260566:0:27882:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502db400/0x85f51a6b96718117 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051561.260580:0:27882:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502db400/0x85f51a6b96718117 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051561.260590:0:27882:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d9502db400 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:2.0:1777051561.260598:0:27882:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502db400/0x85f51a6b96718117 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051561.260612:0:27882:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502db400/0x85f51a6b96718117 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051561.260627:0:27882:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d9413d0800) 00010000:00010000:2.0:1777051561.260631:0:27882:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777051561.260636:0:27882:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502db400/0x85f51a6b96718117 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051561.260645:0:27882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502db400/0x85f51a6b96718117 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1777051561.260663:0:27882:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000ab1aed07 reply state 00000000902b1f1f transno 34359738445 ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69a000/0x85f51a6b9671811e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe83fd7d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051561.260675:0:27882:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69a000/0x85f51a6b9671811e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe83fd7d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051561.260683:0:27882:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xe83fd7d1 (ffff99da45fd2200) 00010000:00010000:2.0:1777051561.260687:0:27882:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1777051561.260689:0:27882:0:(service.c:177:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1777051561.261089:0:27882:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7c9a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+13:142600:x1863365426153728:12345-192.168.201.46@tcp:36:lfs.0 Request processed in 11828us (12113us total) trans 34359738445 rc 0/0 00000100:00100000:2.0:1777051561.261103:0:27882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112542 00000001:00080000:1.0:1777051561.269396:0:109175:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 34359738445 is committed 00000001:00080000:1.0:1777051561.269421:0:109175:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 34359738444 is committed 00000020:00080000:1.0:1777051561.269432:0:109175:0:(update_trans.c:1333:distribute_txn_batchid_cb()) lustre-MDT0000: 30064771261 batchid updated 00010000:00010000:3.0:1777051561.269491:0:3663:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69a000/0x85f51a6b9671811e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe83fd7d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1777051561.269502:0:109209:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 30064771261 00010000:00010000:3.0:1777051561.269521:0:3663:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69a000/0x85f51a6b9671811e lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe83fd7d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1777051561.269526:0:109209:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 30064771261 00010000:00010000:3.0:1777051561.269543:0:3663:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69a000/0x85f51a6b9671811e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe83fd7d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051561.269555:0:3663:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94f69a000 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:3.0:1777051561.269563:0:3663:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69a000/0x85f51a6b9671811e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe83fd7d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051561.269577:0:3663:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69a000/0x85f51a6b9671811e lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe83fd7d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051561.269601:0:3663:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xe83fd7d1 (ffff99da45fd2200) 00010000:00010000:3.0:1777051561.269607:0:3663:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777051561.269615:0:3663:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69a000/0x85f51a6b9671811e lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xe83fd7d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051561.269628:0:3663:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69a000/0x85f51a6b9671811e lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xe83fd7d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051561.269660:0:3663:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69b000/0x85f51a6b96718125 lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e2:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051561.269671:0:3663:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69b000/0x85f51a6b96718125 lrc: 2/0,0 mode: TXN/TXN res: [0x2000032e2:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051561.269683:0:3663:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69b000/0x85f51a6b96718125 lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e2:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051561.269692:0:3663:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94f69b000 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:3.0:1777051561.269698:0:3663:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69b000/0x85f51a6b96718125 lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e2:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051561.269708:0:3663:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69b000/0x85f51a6b96718125 lrc: 4/0,0 mode: TXN/TXN res: [0x2000032e2:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051561.269724:0:3663:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0x10:0x0].0x0 (ffff99da45fd2800) 00010000:00010000:3.0:1777051561.269729:0:3663:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777051561.269734:0:3663:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69b000/0x85f51a6b96718125 lrc: 2/0,0 mode: --/TXN res: [0x2000032e2:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051561.269745:0:3663:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69b000/0x85f51a6b96718125 lrc: 0/0,0 mode: --/TXN res: [0x2000032e2:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051561.316739:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051561.316864:0:6579:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426153984 00000100:00100000:3.0:1777051561.316883:0:6579:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426153984 00000100:00100000:3.0:1777051561.316984:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112543 00000100:00100000:3.0:1777051561.317002:0:6579:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95fae9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+12:142610:x1863365426153984:12345-192.168.201.46@tcp:101:mkdir.0 00010000:00010000:3.0:1777051561.317032:0:6579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777051561.317061:0:6579:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cf800/0x85f51a6b9671812c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6c31 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051561.317159:0:6579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce800/0x85f51a6b96718133 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051561.317178:0:6579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce800/0x85f51a6b96718133 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051561.317192:0:6579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce800/0x85f51a6b96718133 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1777051561.317298:0:6579:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 12288 00000004:00200000:3.0:1777051561.317304:0:6579:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1777051561.317328:0:6579:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce800/0x85f51a6b96718133 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051561.317357:0:6579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cf800/0x85f51a6b9671812c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6c31 expref: 14 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051561.317377:0:6579:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce800/0x85f51a6b96718133 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6c31 expref: 13 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051561.317388:0:6579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d9413d0800) 00010000:00010000:3.0:1777051561.317391:0:6579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1777051561.317396:0:6579:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99da7d5ce800, rc 0) 00000100:00100000:3.0:1777051561.317489:0:6579:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95fae9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+13:142610:x1863365426153984:12345-192.168.201.46@tcp:101:mkdir.0 Request processed in 493us (766us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051561.317498:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112543 00000100:00100000:2.0:1777051561.324637:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051561.324720:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051561.324723:0:46494:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426154112 00000100:00100000:3.0:1777051561.324736:0:46494:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426154112 00000100:00080000:2.0:1777051561.325138:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1777051561.325168:0:46494:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426154368 00000100:00100000:3.0:1777051561.325178:0:46494:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426154368 00000100:00100000:2.0:1777051561.325415:0:10328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112544 00000100:00100000:2.0:1777051561.325441:0:10328:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95fae9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+10:2436:x1863365426154112:12345-192.168.201.46@tcp:41:mkdir.0 00000100:00100000:3.0:1777051561.325461:0:46494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112545 00000100:00100000:3.0:1777051561.325482:0:46494:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95fae9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c11b6966-0775-44d2-bdc6-c74c26eb2226+10:142610:x1863365426154368:12345-192.168.201.46@tcp:36:mkdir.0 00000004:00000024:2.0:1777051561.325488:0:10328:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4194304 pending 0 free 1446141952 avail 1299902464 00000100:00100000:2.0:1777051561.325576:0:10328:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95fae9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+10:2436:x1863365426154112:12345-192.168.201.46@tcp:41:mkdir.0 Request processed in 143us (943us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051561.325595:0:10328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112544 00000100:00100000:3.0:1777051561.325600:0:46494:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d95aecc380 pname:cluuid:pid:xid:nid:opc:job mdt00_008:lustre-MDT0001-mdtlov_UUID:46494:1863365452746112:0@lo:1000:mdt00_008.0 00000100:00100000:3.0:1777051561.325658:0:46494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051561.325697:0:46494:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d94e77e3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1777051561.325750:0:46500:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452746112 00000100:00100000:3.0:1777051561.325757:0:46500:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452746112 00000100:00100000:3.0:1777051561.325872:0:46500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8391 00000100:00100000:3.0:1777051561.325888:0:46500:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95aecca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+7:46494:x1863365452746112:12345-0@lo:1000:mdt00_008.0 00000100:00100000:3.0:1777051561.326349:0:46500:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95aecca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+7:46494:x1863365452746112:12345-0@lo:1000:mdt00_008.0 Request processed in 417us (639us total) trans 0 rc 1/1 00000100:00100000:3.0:1777051561.326367:0:46500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8391 00000100:00100000:2.0:1777051561.326374:0:46494:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d95aecc380 pname:cluuid:pid:xid:nid:opc:job mdt00_008:lustre-MDT0001-mdtlov_UUID:46494:1863365452746112:0@lo:1000:mdt00_008.0 00000100:00100000:2.0:1777051561.326495:0:46494:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95fae9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c11b6966-0775-44d2-bdc6-c74c26eb2226+9:142610:x1863365426154368:12345-192.168.201.46@tcp:36:mkdir.0 Request processed in 1019us (1777us total) trans 0 rc -17/-17 00000100:00100000:2.0:1777051561.326506:0:46494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112545 00000100:00100000:2.0:1777051561.329923:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051561.330054:0:27885:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426154496 00000100:00100000:3.0:1777051561.330067:0:27885:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426154496 00000100:00100000:3.0:1777051561.330155:0:27885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112546 00000100:00100000:3.0:1777051561.330174:0:27885:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95fae8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c11b6966-0775-44d2-bdc6-c74c26eb2226+13:142610:x1863365426154496:12345-192.168.201.46@tcp:101:mkdir.0 00010000:00010000:3.0:1777051561.330196:0:27885:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777051561.330309:0:27885:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cf800/0x85f51a6b9671813a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6c38 expref: -99 pid: 27885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051561.330395:0:27885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce000/0x85f51a6b96718141 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051561.330420:0:27885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce000/0x85f51a6b96718141 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051561.330444:0:27885:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce000/0x85f51a6b96718141 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051561.330475:0:27885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce200/0x85f51a6b96718148 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe83fd7d1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051561.330493:0:27885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce200/0x85f51a6b96718148 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe83fd7d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051561.330510:0:27885:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce200/0x85f51a6b96718148 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe83fd7d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051561.331053:0:27885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cf000/0x85f51a6b9671814f lrc: 3/1,0 mode: --/PR res: [0x2000032e2:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051561.331074:0:27885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cf000/0x85f51a6b9671814f lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0x10:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051561.331091:0:27885:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cf000/0x85f51a6b9671814f lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0x10:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1777051561.331508:0:27885:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000032e2:0x10:0x0]: returning size 4096 00000004:00200000:3.0:1777051561.331518:0:27885:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1777051561.331555:0:27885:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cf000/0x85f51a6b9671814f lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0x10:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051561.331621:0:27885:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce000/0x85f51a6b96718141 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051561.331639:0:27885:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce000/0x85f51a6b96718141 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051561.331662:0:27885:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce000/0x85f51a6b96718141 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051561.331678:0:27885:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce000/0x85f51a6b96718141 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051561.331692:0:27885:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da7d5ce000 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:3.0:1777051561.331701:0:27885:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce000/0x85f51a6b96718141 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051561.331717:0:27885:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce000/0x85f51a6b96718141 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051561.331741:0:27885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d9413d0800) 00010000:00010000:3.0:1777051561.331748:0:27885:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777051561.331756:0:27885:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce000/0x85f51a6b96718141 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051561.331769:0:27885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce000/0x85f51a6b96718141 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051561.332105:0:27885:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce200/0x85f51a6b96718148 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe83fd7d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051561.332120:0:27885:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce200/0x85f51a6b96718148 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe83fd7d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051561.332441:0:27885:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce200/0x85f51a6b96718148 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe83fd7d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051561.332454:0:27885:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da7d5ce200 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:3.0:1777051561.332462:0:27885:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce200/0x85f51a6b96718148 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe83fd7d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051561.332476:0:27885:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce200/0x85f51a6b96718148 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe83fd7d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051561.332494:0:27885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xe83fd7d1 (ffff99d9413d0000) 00010000:00010000:3.0:1777051561.332500:0:27885:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777051561.332506:0:27885:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce200/0x85f51a6b96718148 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe83fd7d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051561.332519:0:27885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce200/0x85f51a6b96718148 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe83fd7d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051561.332597:0:27885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cf800/0x85f51a6b9671813a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6c38 expref: 15 pid: 27885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051561.332640:0:27885:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cf000/0x85f51a6b9671814f lrc: 3/0,0 mode: PR/PR res: [0x2000032e2:0x10:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6c38 expref: 14 pid: 27885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051561.332656:0:27885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0x10:0x0].0x0 (ffff99d9413d0e00) 00010000:00010000:3.0:1777051561.332662:0:27885:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1777051561.332668:0:27885:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99da7d5cf000, rc 0) 00000100:00100000:3.0:1777051561.332761:0:27885:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95fae8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c11b6966-0775-44d2-bdc6-c74c26eb2226+14:142610:x1863365426154496:12345-192.168.201.46@tcp:101:mkdir.0 Request processed in 2587us (2839us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051561.332782:0:27885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112546 00000100:00100000:2.0:1777051561.356546:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051561.359830:0:46497:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426154624 00000100:00100000:3.0:1777051561.359846:0:46497:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426154624 00000100:00100000:3.0:1777051561.359965:0:46497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112547 00000100:00100000:3.0:1777051561.359985:0:46497:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95faeb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:c11b6966-0775-44d2-bdc6-c74c26eb2226+14:142612:x1863365426154624:12345-192.168.201.46@tcp:101:rm.0 00010000:00010000:3.0:1777051561.360016:0:46497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777051561.360055:0:46497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cf600/0x85f51a6b96718156 lrc: 2/0,0 mode: --/CR res: [0x2000032e2:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6c3f expref: -99 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051561.360153:0:46497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cf800/0x85f51a6b9671815d lrc: 3/1,0 mode: --/CR res: [0x2000032e2:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051561.360178:0:46497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cf800/0x85f51a6b9671815d lrc: 3/1,0 mode: CR/CR res: [0x2000032e2:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051561.360229:0:46497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cf800/0x85f51a6b9671815d lrc: 3/1,0 mode: CR/CR res: [0x2000032e2:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051561.360258:0:46497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce200/0x85f51a6b96718164 lrc: 3/1,0 mode: --/PR res: [0x2000032e2:0x10:0x0].0x524cbed4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051561.360273:0:46497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce200/0x85f51a6b96718164 lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0x10:0x0].0x524cbed4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051561.360289:0:46497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce200/0x85f51a6b96718164 lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0x10:0x0].0x524cbed4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051561.360342:0:46497:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cf800/0x85f51a6b9671815d lrc: 4/1,0 mode: CR/CR res: [0x2000032e2:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051561.360355:0:46497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cf800/0x85f51a6b9671815d lrc: 4/1,0 mode: CR/CR res: [0x2000032e2:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051561.360368:0:46497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cf800/0x85f51a6b9671815d lrc: 3/0,0 mode: CR/CR res: [0x2000032e2:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051561.360381:0:46497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cf800/0x85f51a6b9671815d lrc: 4/0,0 mode: CR/CR res: [0x2000032e2:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051561.360394:0:46497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da7d5cf800 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:3.0:1777051561.360401:0:46497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cf800/0x85f51a6b9671815d lrc: 4/0,0 mode: CR/CR res: [0x2000032e2:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051561.360414:0:46497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cf800/0x85f51a6b9671815d lrc: 5/0,0 mode: CR/CR res: [0x2000032e2:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051561.360433:0:46497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0x10:0x0].0x0 (ffff99d9413d0e00) 00010000:00010000:3.0:1777051561.360439:0:46497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777051561.360446:0:46497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cf800/0x85f51a6b9671815d lrc: 3/0,0 mode: --/CR res: [0x2000032e2:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051561.360458:0:46497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cf800/0x85f51a6b9671815d lrc: 0/0,0 mode: --/CR res: [0x2000032e2:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051561.360478:0:46497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce200/0x85f51a6b96718164 lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0x10:0x0].0x524cbed4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051561.360489:0:46497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce200/0x85f51a6b96718164 lrc: 2/0,0 mode: PR/PR res: [0x2000032e2:0x10:0x0].0x524cbed4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051561.360500:0:46497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce200/0x85f51a6b96718164 lrc: 3/0,0 mode: PR/PR res: [0x2000032e2:0x10:0x0].0x524cbed4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051561.360510:0:46497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da7d5ce200 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:3.0:1777051561.360515:0:46497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce200/0x85f51a6b96718164 lrc: 3/0,0 mode: PR/PR res: [0x2000032e2:0x10:0x0].0x524cbed4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051561.360525:0:46497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce200/0x85f51a6b96718164 lrc: 4/0,0 mode: PR/PR res: [0x2000032e2:0x10:0x0].0x524cbed4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051561.360545:0:46497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0x10:0x0].0x524cbed4 (ffff99d9413d0000) 00010000:00010000:3.0:1777051561.360550:0:46497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777051561.360555:0:46497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce200/0x85f51a6b96718164 lrc: 2/0,0 mode: --/PR res: [0x2000032e2:0x10:0x0].0x524cbed4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051561.360566:0:46497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce200/0x85f51a6b96718164 lrc: 0/0,0 mode: --/PR res: [0x2000032e2:0x10:0x0].0x524cbed4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051561.360618:0:46497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cf600/0x85f51a6b96718156 lrc: 1/0,0 mode: --/CR res: [0x2000032e2:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6c3f expref: 15 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051561.360637:0:46497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0x10:0x0].0x0 (ffff99d9413d0e00) 00010000:00010000:3.0:1777051561.360641:0:46497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777051561.360648:0:46497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cf600/0x85f51a6b96718156 lrc: 0/0,0 mode: --/CR res: [0x2000032e2:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6c3f expref: 15 pid: 46497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051561.360665:0:46497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99da7d5cf600, rc 0) 00000100:00100000:3.0:1777051561.360764:0:46497:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95faeb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:c11b6966-0775-44d2-bdc6-c74c26eb2226+14:142612:x1863365426154624:12345-192.168.201.46@tcp:101:rm.0 Request processed in 783us (4228us total) trans 0 rc 301/301 00000100:00100000:3.0:1777051561.360779:0:46497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112547 00000100:00100000:3.0:1777051561.377458:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051561.377573:0:6580:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426154880 00000100:00100000:0.0:1777051561.377589:0:6580:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426154880 00000100:00100000:0.0:1777051561.377680:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112548 00000100:00100000:0.0:1777051561.377699:0:6580:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95aecf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+14:142613:x1863365426154880:12345-192.168.201.46@tcp:101:dd.0 00010000:00010000:0.0:1777051561.377728:0:6580:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051561.377734:0:6580:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1777051561.377772:0:6580:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cf000/0x85f51a6b9671814f lrc: 0/0,0 mode: --/PR res: [0x2000032e2:0x10:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6c38 expref: 14 pid: 27885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051561.377830:0:6580:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0x10:0x0].0x0 (ffff99d9413d0e00) 00010000:00010000:0.0:1777051561.377853:0:6580:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1777051561.377877:0:6580:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d950711c00/0x85f51a6b9671816b lrc: 2/0,0 mode: --/CW res: [0x2000032e2:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6c46 expref: -99 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051561.378037:0:6580:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710800/0x85f51a6b96718172 lrc: 3/0,1 mode: --/CW res: [0x2000032e2:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051561.378058:0:6580:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710800/0x85f51a6b96718172 lrc: 3/0,1 mode: CW/CW res: [0x2000032e2:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051561.378075:0:6580:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710800/0x85f51a6b96718172 lrc: 3/0,1 mode: CW/CW res: [0x2000032e2:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051561.378097:0:6580:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710000/0x85f51a6b96718179 lrc: 3/0,1 mode: --/PW res: [0x2000032e2:0x10:0x0].0x524cbed4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051561.378108:0:6580:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710000/0x85f51a6b96718179 lrc: 3/0,1 mode: PW/PW res: [0x2000032e2:0x10:0x0].0x524cbed4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051561.378126:0:6580:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710000/0x85f51a6b96718179 lrc: 3/0,1 mode: PW/PW res: [0x2000032e2:0x10:0x0].0x524cbed4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1777051561.378617:0:6580:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x204:0x0], index 1: 0 00010000:00010000:0.0:1777051561.379108:0:6580:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950711200/0x85f51a6b96718180 lrc: 3/1,0 mode: --/PR res: [0x2000032e3:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051561.379127:0:6580:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d950711200/0x85f51a6b96718180 lrc: 3/1,0 mode: PR/PR res: [0x2000032e3:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051561.379141:0:6580:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d950711200/0x85f51a6b96718180 lrc: 3/1,0 mode: PR/PR res: [0x2000032e3:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051561.379247:0:6580:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710800/0x85f51a6b96718172 lrc: 4/0,1 mode: CW/CW res: [0x2000032e2:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051561.379264:0:6580:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710800/0x85f51a6b96718172 lrc: 4/0,1 mode: CW/CW res: [0x2000032e2:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051561.379275:0:6580:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710800/0x85f51a6b96718172 lrc: 3/0,0 mode: CW/CW res: [0x2000032e2:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051561.379287:0:6580:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710800/0x85f51a6b96718172 lrc: 4/0,0 mode: CW/CW res: [0x2000032e2:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051561.379299:0:6580:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d950710800 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:0.0:1777051561.379306:0:6580:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710800/0x85f51a6b96718172 lrc: 4/0,0 mode: CW/CW res: [0x2000032e2:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051561.379319:0:6580:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710800/0x85f51a6b96718172 lrc: 5/0,0 mode: CW/CW res: [0x2000032e2:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051561.379342:0:6580:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0x10:0x0].0x0 (ffff99da45738600) 00010000:00010000:0.0:1777051561.379348:0:6580:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777051561.379354:0:6580:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710800/0x85f51a6b96718172 lrc: 3/0,0 mode: --/CW res: [0x2000032e2:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051561.379366:0:6580:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710800/0x85f51a6b96718172 lrc: 0/0,0 mode: --/CW res: [0x2000032e2:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1777051561.379386:0:6580:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000976eb329 reply state 000000007013ec4e transno 34359738446 ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710000/0x85f51a6b96718179 lrc: 3/0,1 mode: PW/PW res: [0x2000032e2:0x10:0x0].0x524cbed4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051561.379405:0:6580:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710000/0x85f51a6b96718179 lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e2:0x10:0x0].0x524cbed4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051561.379418:0:6580:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0x10:0x0].0x524cbed4 (ffff99da45738100) 00010000:00010000:0.0:1777051561.379423:0:6580:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1777051561.379427:0:6580:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1777051561.379470:0:6580:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d950711c00/0x85f51a6b9671816b lrc: 0/0,0 mode: --/CW res: [0x2000032e2:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6c46 expref: 16 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051561.379500:0:6580:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950711200/0x85f51a6b96718180 lrc: 3/0,0 mode: PR/PR res: [0x2000032e3:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6c46 expref: 15 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051561.379515:0:6580:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e3:0x10:0x0].0x0 (ffff99da45738f00) 00010000:00010000:0.0:1777051561.379519:0:6580:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1777051561.379524:0:6580:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d950711200, rc 0) 00000100:00100000:0.0:1777051561.379612:0:6580:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95aecf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+16:142613:x1863365426154880:12345-192.168.201.46@tcp:101:dd.0 Request processed in 1916us (2162us total) trans 34359738446 rc 0/0 00000100:00100000:0.0:1777051561.379627:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112548 00000100:00100000:0.0:1777051561.387133:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051561.387228:0:6582:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426155136 00000100:00100000:2.0:1777051561.387240:0:6582:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426155136 00000100:00100000:2.0:1777051561.387315:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3455 00000100:00100000:2.0:1777051561.387330:0:6582:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7c9a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+16:142613:x1863365426155136:12345-192.168.201.46@tcp:35:dd.0 00000100:00100000:2.0:1777051561.387726:0:6582:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7c9a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+17:142613:x1863365426155136:12345-192.168.201.46@tcp:35:dd.0 Request processed in 397us (597us total) trans 34359738447 rc 0/0 00000100:00100000:2.0:1777051561.387740:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3455 00000100:00100000:2.0:1777051561.409623:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051561.409712:0:10328:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426155264 00000100:00100000:3.0:1777051561.409724:0:10328:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426155264 00000100:00100000:3.0:1777051561.410119:0:10328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112549 00000100:00100000:3.0:1777051561.410144:0:10328:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95fae8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+17:142614:x1863365426155264:12345-192.168.201.46@tcp:101:lfs.0 00010000:00010000:3.0:1777051561.410175:0:10328:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777051561.410256:0:10328:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cf600/0x85f51a6b9671818e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6c4d expref: -99 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051561.410341:0:10328:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce200/0x85f51a6b96718195 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051561.410362:0:10328:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce200/0x85f51a6b96718195 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051561.410378:0:10328:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce200/0x85f51a6b96718195 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051561.410400:0:10328:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cf800/0x85f51a6b9671819c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe83fd7d1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051561.410413:0:10328:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cf800/0x85f51a6b9671819c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe83fd7d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051561.410425:0:10328:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cf800/0x85f51a6b9671819c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe83fd7d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051561.410527:0:10328:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce000/0x85f51a6b967181a3 lrc: 3/1,0 mode: --/PR res: [0x2000032e2:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051561.410538:0:10328:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce000/0x85f51a6b967181a3 lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0x10:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051561.410546:0:10328:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce000/0x85f51a6b967181a3 lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0x10:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1777051561.410579:0:10328:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000032e2:0x10:0x0]: returning size 4096 00000004:00200000:3.0:1777051561.410582:0:10328:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1777051561.410603:0:10328:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce000/0x85f51a6b967181a3 lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0x10:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051561.410621:0:10328:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce200/0x85f51a6b96718195 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051561.410628:0:10328:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce200/0x85f51a6b96718195 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051561.410635:0:10328:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce200/0x85f51a6b96718195 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051561.410642:0:10328:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce200/0x85f51a6b96718195 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051561.410648:0:10328:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da7d5ce200 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:3.0:1777051561.410652:0:10328:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce200/0x85f51a6b96718195 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051561.410660:0:10328:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce200/0x85f51a6b96718195 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051561.410670:0:10328:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d9413d0800) 00010000:00010000:3.0:1777051561.410673:0:10328:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777051561.410678:0:10328:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce200/0x85f51a6b96718195 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051561.410684:0:10328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce200/0x85f51a6b96718195 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051561.410700:0:10328:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cf800/0x85f51a6b9671819c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe83fd7d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051561.410711:0:10328:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cf800/0x85f51a6b9671819c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe83fd7d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051561.410722:0:10328:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cf800/0x85f51a6b9671819c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe83fd7d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051561.410731:0:10328:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da7d5cf800 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:3.0:1777051561.410735:0:10328:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cf800/0x85f51a6b9671819c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe83fd7d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051561.410745:0:10328:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cf800/0x85f51a6b9671819c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe83fd7d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051561.410756:0:10328:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xe83fd7d1 (ffff99d9413d0000) 00010000:00010000:3.0:1777051561.410760:0:10328:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777051561.410764:0:10328:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cf800/0x85f51a6b9671819c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe83fd7d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051561.410773:0:10328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cf800/0x85f51a6b9671819c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe83fd7d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051561.410860:0:10328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cf600/0x85f51a6b9671818e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6c4d expref: 19 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051561.410883:0:10328:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce000/0x85f51a6b967181a3 lrc: 3/0,0 mode: PR/PR res: [0x2000032e2:0x10:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6c4d expref: 18 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051561.410895:0:10328:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0x10:0x0].0x0 (ffff99d9413d0b00) 00010000:00010000:3.0:1777051561.410898:0:10328:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1777051561.410902:0:10328:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99da7d5ce000, rc 0) 00000100:00100000:3.0:1777051561.410994:0:10328:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95fae8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+18:142614:x1863365426155264:12345-192.168.201.46@tcp:101:lfs.0 Request processed in 855us (1379us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051561.411009:0:10328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112549 00000100:00100000:3.0:1777051561.642327:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051561.642436:0:8492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426155520 00000100:00100000:1.0:1777051561.642451:0:8492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426155520 00000100:00100000:1.0:1777051561.642563:0:8492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112550 00000100:00100000:1.0:1777051561.642582:0:8492:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95aecc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+18:142640:x1863365426155520:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1777051561.642612:0:8492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777051561.642645:0:8492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502da400/0x85f51a6b967181aa lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6c54 expref: -99 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051561.642778:0:8492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502db400/0x85f51a6b967181b1 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051561.642834:0:8492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502db400/0x85f51a6b967181b1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051561.642857:0:8492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502db400/0x85f51a6b967181b1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051561.642885:0:8492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502da800/0x85f51a6b967181b8 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051561.642900:0:8492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502da800/0x85f51a6b967181b8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051561.642913:0:8492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502da800/0x85f51a6b967181b8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051561.643046:0:8492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502dae00/0x85f51a6b967181bf lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051561.643063:0:8492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502dae00/0x85f51a6b967181bf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051561.643077:0:8492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502dae00/0x85f51a6b967181bf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1777051561.643095:0:8492:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:1.0:1777051561.643207:0:8492:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502db400/0x85f51a6b967181b1 lrc: 4/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051561.643223:0:8492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502db400/0x85f51a6b967181b1 lrc: 4/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051561.643235:0:8492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502db400/0x85f51a6b967181b1 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051561.643248:0:8492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502db400/0x85f51a6b967181b1 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051561.643260:0:8492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d9502db400 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:1.0:1777051561.643267:0:8492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502db400/0x85f51a6b967181b1 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051561.643340:0:8492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502db400/0x85f51a6b967181b1 lrc: 5/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051561.643361:0:8492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff99da59dd4d00) 00010000:00010000:1.0:1777051561.643367:0:8492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777051561.643376:0:8492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502db400/0x85f51a6b967181b1 lrc: 3/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051561.643389:0:8492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502db400/0x85f51a6b967181b1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051561.643414:0:8492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502da800/0x85f51a6b967181b8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051561.643426:0:8492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502da800/0x85f51a6b967181b8 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051561.643437:0:8492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502da800/0x85f51a6b967181b8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051561.643448:0:8492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d9502da800 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:1.0:1777051561.643454:0:8492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502da800/0x85f51a6b967181b8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051561.643474:0:8492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502da800/0x85f51a6b967181b8 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051561.643487:0:8492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff99d94e592400) 00010000:00010000:1.0:1777051561.643492:0:8492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777051561.643497:0:8492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502da800/0x85f51a6b967181b8 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051561.643509:0:8492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502da800/0x85f51a6b967181b8 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051561.644291:0:8492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502da400/0x85f51a6b967181aa lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6c54 expref: 21 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051561.644319:0:8492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502dae00/0x85f51a6b967181bf lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6c54 expref: 20 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051561.644333:0:8492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99d9413d2e00) 00010000:00010000:1.0:1777051561.644337:0:8492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777051561.644342:0:8492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d9502dae00, rc 0) 00000100:00100000:1.0:1777051561.644438:0:8492:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95aecc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+20:142640:x1863365426155520:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 Request processed in 1861us (2123us total) trans 34359738448 rc 0/0 00000100:00100000:1.0:1777051561.644454:0:8492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112550 00000100:00100000:0.0:1777051561.650914:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051561.651623:0:21368:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426155648 00000100:00100000:2.0:1777051561.651635:0:21368:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426155648 00000100:00100000:3.0:1777051561.651648:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051561.651718:0:21368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112551 00000100:00100000:2.0:1777051561.651737:0:21368:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fdf1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+20:142640:x1863365426155648:12345-192.168.201.46@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1777051561.651830:0:47597:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426155776 00000100:00100000:0.0:1777051561.651848:0:47597:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426155776 00000100:00100000:2.0:1777051561.651892:0:21368:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fdf1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+21:142640:x1863365426155648:12345-192.168.201.46@tcp:59:lhsmtool_posix.0 Request processed in 156us (981us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051561.651906:0:21368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112551 00000100:00100000:0.0:1777051561.651967:0:47597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13758 00000100:00100000:0.0:1777051561.651989:0:47597:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95aecc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+20:2439:x1863365426155776:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1777051561.652022:0:47597:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777051561.652098:0:47597:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502dae00/0x85f51a6b967181bf lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6c54 expref: 20 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051561.652138:0:47597:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99d9413d2e00) 00010000:00010000:0.0:1777051561.652148:0:47597:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1777051561.652323:0:47597:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95aecc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+19:2439:x1863365426155776:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 336us (690us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051561.652340:0:47597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13758 00000100:00100000:3.0:1777051561.655778:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051561.655926:0:27882:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426155904 00000100:00100000:0.0:1777051561.655938:0:27882:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426155904 00000100:00100000:0.0:1777051561.656027:0:27882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112552 00000100:00100000:0.0:1777051561.656096:0:27882:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da444a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+9:142640:x1863365426155904:12345-192.168.201.46@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1777051561.656599:0:27882:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da444a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+9:142640:x1863365426155904:12345-192.168.201.46@tcp:59:lhsmtool_posix.0 Request processed in 528us (850us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051561.656614:0:27882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112552 00000100:00100000:1.0:1777051561.674851:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051561.675118:0:6579:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426156032 00000100:00100000:3.0:1777051561.675152:0:6579:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426156032 00000100:00100000:3.0:1777051561.675316:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112553 00000100:00100000:3.0:1777051561.675338:0:6579:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7cd9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+11:142641:x1863365426156032:12345-192.168.201.46@tcp:101:lfs.0 00010000:00010000:3.0:1777051561.675387:0:6579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777051561.675429:0:6579:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cf600/0x85f51a6b967181cd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6c5b expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051561.675554:0:6579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cf800/0x85f51a6b967181d4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051561.675582:0:6579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cf800/0x85f51a6b967181d4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051561.675605:0:6579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cf800/0x85f51a6b967181d4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1777051561.675688:0:6579:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 12288 00000004:00200000:3.0:1777051561.675696:0:6579:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1777051561.676033:0:6579:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cf800/0x85f51a6b967181d4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051561.676078:0:6579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cf600/0x85f51a6b967181cd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6c5b expref: 13 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051561.676123:0:6579:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cf800/0x85f51a6b967181d4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6c5b expref: 12 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051561.676138:0:6579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d9413d0800) 00010000:00010000:3.0:1777051561.676144:0:6579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1777051561.676151:0:6579:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99da7d5cf800, rc 0) 00000100:00100000:3.0:1777051561.676343:0:6579:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7cd9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+12:142641:x1863365426156032:12345-192.168.201.46@tcp:101:lfs.0 Request processed in 1010us (1502us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051561.676358:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112553 00000040:00080000:1.0:1777051561.686519:0:110973:0:(llog.c:801:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1777051561.686529:0:110973:0:(llog_cat.c:158:llog_cat_process_common()) processing log [0x1:0x12:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1777051561.687778:0:110973:0:(llog.c:858:llog_process_thread()) stop processing plain [0x1:0x12:0x0] index 64768 count 1 00000040:00080000:1.0:1777051561.687822:0:110973:0:(llog.c:858:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1777051561.689641:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051561.690066:0:6581:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426156160 00000100:00100000:1.0:1777051561.690083:0:6581:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426156160 00000100:00100000:1.0:1777051561.690546:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112554 00000100:00100000:1.0:1777051561.690567:0:6581:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95faebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+12:142641:x1863365426156160:12345-192.168.201.46@tcp:101:lfs.0 00010000:00010000:1.0:1777051561.690604:0:6581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777051561.690640:0:6581:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502db400/0x85f51a6b967181db lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6c62 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051561.690746:0:6581:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502dbe00/0x85f51a6b967181e2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051561.690771:0:6581:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502dbe00/0x85f51a6b967181e2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051561.690820:0:6581:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502dbe00/0x85f51a6b967181e2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051561.690857:0:6581:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502da200/0x85f51a6b967181e9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe83fd7d1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051561.690873:0:6581:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502da200/0x85f51a6b967181e9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe83fd7d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051561.690888:0:6581:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502da200/0x85f51a6b967181e9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe83fd7d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051561.691041:0:6581:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502dbc00/0x85f51a6b967181f0 lrc: 3/1,0 mode: --/PR res: [0x2000032e2:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051561.691077:0:6581:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502dbc00/0x85f51a6b967181f0 lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0x10:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051561.691100:0:6581:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502dbc00/0x85f51a6b967181f0 lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0x10:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1777051561.691516:0:6581:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000032e2:0x10:0x0]: returning size 4096 00000004:00200000:1.0:1777051561.691524:0:6581:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1777051561.691563:0:6581:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502dbc00/0x85f51a6b967181f0 lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0x10:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051561.691583:0:6581:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502dbe00/0x85f51a6b967181e2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051561.691594:0:6581:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502dbe00/0x85f51a6b967181e2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051561.691605:0:6581:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502dbe00/0x85f51a6b967181e2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051561.691617:0:6581:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d9502dbe00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:1.0:1777051561.691625:0:6581:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502dbe00/0x85f51a6b967181e2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051561.691648:0:6581:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502dbe00/0x85f51a6b967181e2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051561.691669:0:6581:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99d9413d0800) 00010000:00010000:1.0:1777051561.691674:0:6581:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777051561.691682:0:6581:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502dbe00/0x85f51a6b967181e2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051561.691693:0:6581:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502dbe00/0x85f51a6b967181e2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051561.691724:0:6581:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502da200/0x85f51a6b967181e9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe83fd7d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051561.691735:0:6581:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502da200/0x85f51a6b967181e9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe83fd7d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051561.691746:0:6581:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502da200/0x85f51a6b967181e9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe83fd7d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051561.691755:0:6581:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d9502da200 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:1.0:1777051561.691760:0:6581:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502da200/0x85f51a6b967181e9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe83fd7d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051561.691783:0:6581:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502da200/0x85f51a6b967181e9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe83fd7d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051561.691822:0:6581:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xe83fd7d1 (ffff99d94e592400) 00010000:00010000:1.0:1777051561.691827:0:6581:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777051561.691832:0:6581:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502da200/0x85f51a6b967181e9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe83fd7d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051561.691842:0:6581:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502da200/0x85f51a6b967181e9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe83fd7d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051561.691894:0:6581:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502db400/0x85f51a6b967181db lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6c62 expref: 14 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051561.691917:0:6581:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502dbc00/0x85f51a6b967181f0 lrc: 3/0,0 mode: PR/PR res: [0x2000032e2:0x10:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6c62 expref: 13 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051561.691939:0:6581:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0x10:0x0].0x0 (ffff99d9413d0b00) 00010000:00010000:1.0:1777051561.691943:0:6581:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1777051561.691948:0:6581:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d9502dbc00, rc 0) 00000100:00100000:1.0:1777051561.692051:0:6581:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95faebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+13:142641:x1863365426156160:12345-192.168.201.46@tcp:101:lfs.0 Request processed in 1488us (2422us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051561.692065:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112554 00000100:00100000:2.0:1777051561.696784:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051561.699976:0:8492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426156288 00000100:00100000:1.0:1777051561.699992:0:8492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426156288 00000100:00100000:1.0:1777051561.700072:0:8492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112555 00000100:00100000:1.0:1777051561.700088:0:8492:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d943d91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+13:142641:x1863365426156288:12345-192.168.201.46@tcp:101:lfs.0 00010000:00010000:1.0:1777051561.700120:0:8492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777051561.700148:0:8492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502db400/0x85f51a6b967181f7 lrc: 2/0,0 mode: --/CR res: [0x2000032e2:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6c69 expref: -99 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051561.700288:0:8492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502da200/0x85f51a6b967181fe lrc: 3/1,0 mode: --/CR res: [0x2000032e2:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051561.700311:0:8492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502da200/0x85f51a6b967181fe lrc: 3/1,0 mode: CR/CR res: [0x2000032e2:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051561.700331:0:8492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502da200/0x85f51a6b967181fe lrc: 3/1,0 mode: CR/CR res: [0x2000032e2:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051561.700348:0:8492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502dbe00/0x85f51a6b96718205 lrc: 3/1,0 mode: --/PR res: [0x2000032e2:0x10:0x0].0x524cbed4 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051561.700362:0:8492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502dbe00/0x85f51a6b96718205 lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0x10:0x0].0x524cbed4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051561.700374:0:8492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502dbe00/0x85f51a6b96718205 lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0x10:0x0].0x524cbed4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051561.700484:0:8492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502dac00/0x85f51a6b9671820c lrc: 3/1,0 mode: --/PR res: [0x2000032e3:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051561.700498:0:8492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502dac00/0x85f51a6b9671820c lrc: 3/1,0 mode: PR/PR res: [0x2000032e3:0x10:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051561.700513:0:8492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502dac00/0x85f51a6b9671820c lrc: 3/1,0 mode: PR/PR res: [0x2000032e3:0x10:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1777051561.700569:0:8492:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000032e3:0x10:0x0]: returning size 0 00000004:00200000:1.0:1777051561.700574:0:8492:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1777051561.700599:0:8492:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502dac00/0x85f51a6b9671820c lrc: 3/1,0 mode: PR/PR res: [0x2000032e3:0x10:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051561.700615:0:8492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502dac00/0x85f51a6b9671820c lrc: 3/1,0 mode: PR/PR res: [0x2000032e3:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051561.700625:0:8492:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502da200/0x85f51a6b967181fe lrc: 4/1,0 mode: CR/CR res: [0x2000032e2:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051561.700633:0:8492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502da200/0x85f51a6b967181fe lrc: 4/1,0 mode: CR/CR res: [0x2000032e2:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051561.700641:0:8492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502da200/0x85f51a6b967181fe lrc: 3/0,0 mode: CR/CR res: [0x2000032e2:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051561.700648:0:8492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502da200/0x85f51a6b967181fe lrc: 4/0,0 mode: CR/CR res: [0x2000032e2:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051561.700660:0:8492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d9502da200 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:1.0:1777051561.700666:0:8492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502da200/0x85f51a6b967181fe lrc: 4/0,0 mode: CR/CR res: [0x2000032e2:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051561.700674:0:8492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502da200/0x85f51a6b967181fe lrc: 5/0,0 mode: CR/CR res: [0x2000032e2:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051561.700685:0:8492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0x10:0x0].0x0 (ffff99d9413d0b00) 00010000:00010000:1.0:1777051561.700689:0:8492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777051561.700694:0:8492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502da200/0x85f51a6b967181fe lrc: 3/0,0 mode: --/CR res: [0x2000032e2:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051561.700700:0:8492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502da200/0x85f51a6b967181fe lrc: 0/0,0 mode: --/CR res: [0x2000032e2:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051561.700714:0:8492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502dbe00/0x85f51a6b96718205 lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0x10:0x0].0x524cbed4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051561.700721:0:8492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502dbe00/0x85f51a6b96718205 lrc: 2/0,0 mode: PR/PR res: [0x2000032e2:0x10:0x0].0x524cbed4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051561.700728:0:8492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502dbe00/0x85f51a6b96718205 lrc: 3/0,0 mode: PR/PR res: [0x2000032e2:0x10:0x0].0x524cbed4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051561.700733:0:8492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d9502dbe00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:1.0:1777051561.700736:0:8492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502dbe00/0x85f51a6b96718205 lrc: 3/0,0 mode: PR/PR res: [0x2000032e2:0x10:0x0].0x524cbed4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051561.700741:0:8492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502dbe00/0x85f51a6b96718205 lrc: 4/0,0 mode: PR/PR res: [0x2000032e2:0x10:0x0].0x524cbed4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051561.700754:0:8492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0x10:0x0].0x524cbed4 (ffff99da45738100) 00010000:00010000:1.0:1777051561.700757:0:8492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777051561.700760:0:8492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502dbe00/0x85f51a6b96718205 lrc: 2/0,0 mode: --/PR res: [0x2000032e2:0x10:0x0].0x524cbed4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051561.700766:0:8492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502dbe00/0x85f51a6b96718205 lrc: 0/0,0 mode: --/PR res: [0x2000032e2:0x10:0x0].0x524cbed4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051561.701086:0:8492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502db400/0x85f51a6b967181f7 lrc: 0/0,0 mode: --/CR res: [0x2000032e2:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6c69 expref: 15 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051561.701117:0:8492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502dac00/0x85f51a6b9671820c lrc: 3/0,0 mode: PR/PR res: [0x2000032e3:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6c69 expref: 14 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051561.701128:0:8492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e3:0x10:0x0].0x0 (ffff99da45738f00) 00010000:00010000:1.0:1777051561.701132:0:8492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1777051561.701137:0:8492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d9502dac00, rc 0) 00000100:00100000:1.0:1777051561.701275:0:8492:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d943d91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+14:142641:x1863365426156288:12345-192.168.201.46@tcp:101:lfs.0 Request processed in 1189us (4499us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051561.701290:0:8492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112555 00000100:00100000:0.0:1777051561.711137:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051561.711569:0:13320:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426156416 00000100:00100000:1.0:1777051561.711586:0:13320:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426156416 00000100:00100000:1.0:1777051561.711699:0:13320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 8134 00000100:00100000:1.0:1777051561.711718:0:13320:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fdf0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+30:2436:x1863365426156416:12345-192.168.201.46@tcp:101:lfs.0 00010000:00010000:1.0:1777051561.711747:0:13320:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777051561.711780:0:13320:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000046b5e69f/0x85f51a6b96718213 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x204:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6c70 expref: -99 pid: 13320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1777051561.711879:0:13320:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x204:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777051561.711912:0:13320:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777051561.711918:0:13320:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00000100:00080000:2.0:1777051561.711934:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1777051561.711936:0:13320:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000046b5e69f/0x85f51a6b96718213 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x204:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6c70 expref: 31 pid: 13320 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051561.711973:0:13320:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000046b5e69f/0x85f51a6b96718213 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x204:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6c70 expref: 31 pid: 13320 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051561.711999:0:13320:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d9502db400, rc 0) 00000100:00100000:1.0:1777051561.712097:0:13320:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fdf0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+31:2436:x1863365426156416:12345-192.168.201.46@tcp:101:lfs.0 Request processed in 385us (972us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051561.712111:0:13320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 8134 00000100:00100000:2.0:1777051561.719383:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051561.719517:0:21368:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426156544 00000100:00100000:3.0:1777051561.719531:0:21368:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426156544 00000100:00100000:3.0:1777051561.719627:0:21368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112556 00000100:00100000:3.0:1777051561.719645:0:21368:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d943d92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+14:142641:x1863365426156544:12345-192.168.201.46@tcp:101:lfs.0 00010000:00010000:3.0:1777051561.719675:0:21368:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777051561.719706:0:21368:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cf600/0x85f51a6b9671821a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6c77 expref: -99 pid: 21368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051561.720167:0:21368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce200/0x85f51a6b96718221 lrc: 3/1,0 mode: --/PR res: [0x2000032e2:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051561.720192:0:21368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce200/0x85f51a6b96718221 lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0x10:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051561.720272:0:21368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce200/0x85f51a6b96718221 lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0x10:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1777051561.720480:0:21368:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000032e2:0x10:0x0]: returning size 4096 00000004:00200000:2.0:1777051561.720489:0:21368:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1777051561.720529:0:21368:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce200/0x85f51a6b96718221 lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0x10:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051561.720578:0:21368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cf600/0x85f51a6b9671821a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6c77 expref: 16 pid: 21368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051561.720609:0:21368:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5ce200/0x85f51a6b96718221 lrc: 3/0,0 mode: PR/PR res: [0x2000032e2:0x10:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6c77 expref: 15 pid: 21368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051561.720624:0:21368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0x10:0x0].0x0 (ffff99d9413d0b00) 00010000:00010000:2.0:1777051561.720629:0:21368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1777051561.720636:0:21368:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99da7d5ce200, rc 0) 00000100:00100000:2.0:1777051561.721017:0:21368:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d943d92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+15:142641:x1863365426156544:12345-192.168.201.46@tcp:101:lfs.0 Request processed in 1374us (1642us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051561.721038:0:21368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112556 00000100:00100000:2.0:1777051561.733546:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051561.733645:0:46497:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426156800 00000100:00100000:3.0:1777051561.733664:0:46497:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426156800 00000100:00100000:3.0:1777051561.733769:0:46497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112557 00000100:00100000:3.0:1777051561.733789:0:46497:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fd67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+15:142641:x1863365426156800:12345-192.168.201.46@tcp:58:lfs.0 00000040:00080000:3.0:1777051561.734530:0:46497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x31:0x0].4, 136 off8736 00000100:00100000:3.0:1777051561.734695:0:46497:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fd67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+15:142641:x1863365426156800:12345-192.168.201.46@tcp:58:lfs.0 Request processed in 912us (1160us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051561.734708:0:46497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112557 00010000:00010000:0.0:1777051562.141374:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1777051562.141560:0:110924:0:(llog.c:801:llog_process_thread()) index: 6, lh_last_idx: 7 synced_idx: 0 lgh_last_idx: 7 00000040:00080000:2.0:1777051562.141567:0:110924:0:(llog_cat.c:158:llog_cat_process_common()) processing log [0x1:0x2b:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1777051562.141596:0:110924:0:(llog.c:858:llog_process_thread()) stop processing plain [0x1:0x2b:0x0] index 12 count 2 00000040:00080000:2.0:1777051562.141608:0:110924:0:(llog.c:801:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:2.0:1777051562.141610:0:110924:0:(llog_cat.c:158:llog_cat_process_common()) processing log [0x1:0x31:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1777051562.141630:0:110924:0:(llog.c:858:llog_process_thread()) stop processing plain [0x1:0x31:0x0] index 5 count 5 00000040:00080000:2.0:1777051562.141634:0:110924:0:(llog.c:858:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 3 00000100:00100000:2.0:1777051562.141910:0:110924:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7fd65880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:110924:1863365452746240:192.168.201.46@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1777051562.142121:0:110924:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d94e5666c0 going to sleep for 11 seconds 00000100:00100000:0.0:1777051562.147360:0:110924:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7fd65880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:110924:1863365452746240:192.168.201.46@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1777051562.149668:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051562.150694:0:6580:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426156928 00000100:00100000:0.0:1777051562.150706:0:6580:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426156928 00000100:00100000:0.0:1777051562.150919:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112558 00000100:00100000:0.0:1777051562.150939:0:6580:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fd64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+19:142651:x1863365426156928:12345-192.168.201.46@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1777051562.150980:0:6580:0:(mdt_handler.c:7958:mdt_fid2path()) path get [0x2000032e3:0x10:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1777051562.151127:0:6580:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fd64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c11b6966-0775-44d2-bdc6-c74c26eb2226+19:142651:x1863365426156928:12345-192.168.201.46@tcp:53:lhsmtool_posix.0 Request processed in 192us (1462us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051562.151142:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112558 00000100:00100000:2.0:1777051562.157324:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051562.158058:0:10328:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426157184 00000100:00100000:3.0:1777051562.158071:0:10328:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426157184 00000100:00100000:3.0:1777051562.158163:0:10328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112559 00000100:00100000:3.0:1777051562.158180:0:10328:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fd65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+19:142651:x1863365426157184:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1777051562.158203:0:10328:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777051562.158231:0:10328:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cea00/0x85f51a6b96718228 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6c7e expref: -99 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051562.158383:0:10328:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cfc00/0x85f51a6b9671822f lrc: 3/1,0 mode: --/PR res: [0x2000032e3:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051562.158404:0:10328:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cfc00/0x85f51a6b9671822f lrc: 3/1,0 mode: PR/PR res: [0x2000032e3:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051562.158418:0:10328:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cfc00/0x85f51a6b9671822f lrc: 3/1,0 mode: PR/PR res: [0x2000032e3:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10328 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1777051562.158432:0:10328:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000032e3:0x10:0x0]: returning size 0 00010000:00010000:3.0:1777051562.158559:0:10328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cea00/0x85f51a6b96718228 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6c7e expref: 22 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051562.158586:0:10328:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cfc00/0x85f51a6b9671822f lrc: 3/0,0 mode: PR/PR res: [0x2000032e3:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6c7e expref: 21 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051562.158601:0:10328:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e3:0x10:0x0].0x0 (ffff99da45738f00) 00010000:00010000:3.0:1777051562.158605:0:10328:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1777051562.158611:0:10328:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99da7d5cfc00, rc 0) 00000100:00100000:3.0:1777051562.158724:0:10328:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fd65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+21:142651:x1863365426157184:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 Request processed in 545us (1404us total) trans 34359738449 rc 0/0 00000100:00100000:3.0:1777051562.158738:0:10328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112559 00000100:00100000:3.0:1777051562.164480:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051562.166755:0:8471:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426157440 00000100:00100000:2.0:1777051562.166768:0:8471:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426157440 00000100:00100000:2.0:1777051562.166908:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 8135 00000100:00100000:2.0:1777051562.166926:0:8471:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da444a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+30:2436:x1863365426157440:12345-192.168.201.46@tcp:1:lhsmtool_posix.0 00000100:00080000:3.0:1777051562.166955:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1777051562.166981:0:8471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000002118ac56/0x85f51a6b9671823d lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x204:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051562.167006:0:8471:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777051562.167010:0:8471:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777051562.167019:0:8471:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002118ac56/0x85f51a6b9671823d lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x204:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051562.167041:0:8471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002118ac56/0x85f51a6b9671823d lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x204:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051562.167087:0:8471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000002118ac56/0x85f51a6b9671823d lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x204:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051562.167102:0:8471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002118ac56/0x85f51a6b9671823d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x204:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051562.167116:0:8471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002118ac56/0x85f51a6b9671823d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x204:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051562.167130:0:8471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94f69ae00 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:2.0:1777051562.167138:0:8471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002118ac56/0x85f51a6b9671823d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x204:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051562.167154:0:8471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002118ac56/0x85f51a6b9671823d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x204:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051562.167483:0:8471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002118ac56/0x85f51a6b9671823d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x204:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051562.167498:0:8471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002118ac56/0x85f51a6b9671823d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x204:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051562.167620:0:8471:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da444a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+30:2436:x1863365426157440:12345-192.168.201.46@tcp:1:lhsmtool_posix.0 Request processed in 697us (3145us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051562.167640:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 8135 00000100:00100000:2.0:1777051562.168653:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051562.168757:0:6566:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426157312 00000100:00100000:3.0:1777051562.169360:0:6566:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426157312 00000100:00100000:3.0:1777051562.169428:0:6566:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13759 00000100:00100000:3.0:1777051562.169440:0:6566:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da71c08450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+21:2437:x1863365426157312:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1777051562.169453:0:6566:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777051562.169476:0:6566:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da7d5cfc00/0x85f51a6b9671822f lrc: 0/0,0 mode: --/PR res: [0x2000032e3:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6c7e expref: 21 pid: 10328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051562.169497:0:6566:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e3:0x10:0x0].0x0 (ffff99da45738f00) 00010000:00010000:3.0:1777051562.169502:0:6566:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1777051562.169539:0:6566:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da71c08450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+20:2437:x1863365426157312:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 103us (893us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051562.169548:0:6566:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13759 00000100:00100000:3.0:1777051562.173673:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051562.173757:0:46494:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426157696 00000100:00100000:1.0:1777051562.173768:0:46494:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426157696 00000100:00100000:1.0:1777051562.173862:0:46494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112560 00000100:00100000:1.0:1777051562.173896:0:46494:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95fae9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c11b6966-0775-44d2-bdc6-c74c26eb2226+20:142651:x1863365426157696:12345-192.168.201.46@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1777051562.174032:0:46494:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95fae9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:c11b6966-0775-44d2-bdc6-c74c26eb2226+20:142651:x1863365426157696:12345-192.168.201.46@tcp:57:lhsmtool_posix.0 Request processed in 139us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051562.174051:0:46494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112560 00000100:00100000:3.0:1777051562.178784:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051562.178933:0:24468:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426157824 00000100:00100000:0.0:1777051562.178944:0:24468:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426157824 00000100:00100000:0.0:1777051562.179033:0:24468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 8136 00000100:00100000:0.0:1777051562.179545:0:24468:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95aecc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+30:2437:x1863365426157824:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1777051562.180759:0:24468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051562.181103:0:24468:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000047bca7e9/0x85f51a6b96718244 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x204:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6c85 expref: -99 pid: 24468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051562.181145:0:24468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777051562.181149:0:24468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777051562.181162:0:24468:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000047bca7e9/0x85f51a6b96718244 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x204:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6c85 expref: 31 pid: 24468 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051562.181191:0:24468:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000047bca7e9/0x85f51a6b96718244 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x204:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6c85 expref: 31 pid: 24468 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051562.181265:0:24468:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d950711c00, rc 0) 00000100:00100000:0.0:1777051562.181335:0:24468:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95aecc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+31:2437:x1863365426157824:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 Request processed in 2279us (2557us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051562.181353:0:24468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 8136 00000100:00100000:2.0:1777051562.188581:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051562.188722:0:27885:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426158080 00000100:00100000:3.0:1777051562.188735:0:27885:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426158080 00000100:00100000:3.0:1777051562.188844:0:27885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112561 00000100:00100000:3.0:1777051562.188861:0:27885:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fd67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c11b6966-0775-44d2-bdc6-c74c26eb2226+20:142651:x1863365426158080:12345-192.168.201.46@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1777051562.189001:0:27885:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fd67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c11b6966-0775-44d2-bdc6-c74c26eb2226+20:142651:x1863365426158080:12345-192.168.201.46@tcp:57:lhsmtool_posix.0 Request processed in 144us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051562.189014:0:27885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112561 00000100:00100000:3.0:1777051562.194741:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051562.194875:0:27882:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426158208 00000100:00100000:0.0:1777051562.194886:0:27882:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426158208 00000100:00100000:0.0:1777051562.194975:0:27882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112562 00000100:00100000:0.0:1777051562.194994:0:27882:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d9533bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+20:142651:x1863365426158208:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1777051562.195016:0:27882:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777051562.195045:0:27882:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710800/0x85f51a6b9671824b lrc: 2/0,0 mode: --/PR res: [0x2000032e3:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6c8c expref: -99 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051562.195096:0:27882:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162f400/0x85f51a6b96718252 lrc: 3/1,0 mode: --/PR res: [0x2000032e3:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051562.195117:0:27882:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162f400/0x85f51a6b96718252 lrc: 3/1,0 mode: PR/PR res: [0x2000032e3:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051562.195136:0:27882:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162f400/0x85f51a6b96718252 lrc: 3/1,0 mode: PR/PR res: [0x2000032e3:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 27882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051562.195532:0:27882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710800/0x85f51a6b9671824b lrc: 0/0,0 mode: --/PR res: [0x2000032e3:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6c8c expref: 22 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051562.195567:0:27882:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162f400/0x85f51a6b96718252 lrc: 3/0,0 mode: PR/PR res: [0x2000032e3:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6c8c expref: 21 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051562.195582:0:27882:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e3:0x10:0x0].0x0 (ffff99da45738f00) 00010000:00010000:0.0:1777051562.195587:0:27882:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1777051562.195593:0:27882:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99da4162f400, rc 0) 00000100:00100000:0.0:1777051562.195680:0:27882:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d9533bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c11b6966-0775-44d2-bdc6-c74c26eb2226+21:142651:x1863365426158208:12345-192.168.201.46@tcp:101:lhsmtool_posix.0 Request processed in 690us (947us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051562.195695:0:27882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112562 00000100:00100000:0.0:1777051562.202509:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051562.202570:0:6579:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426158336 00000100:00100000:0.0:1777051562.202579:0:6579:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426158336 00000100:00100000:0.0:1777051562.202650:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112563 00000100:00100000:0.0:1777051562.202670:0:6579:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fdf3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+21:142651:x1863365426158336:12345-192.168.201.46@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1777051562.202704:0:6579:0:(mdt_handler.c:7958:mdt_fid2path()) path get [0x2000032e3:0x10:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1777051562.202869:0:6579:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fdf3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+21:142651:x1863365426158336:12345-192.168.201.46@tcp:53:lhsmtool_posix.0 Request processed in 203us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051562.202883:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112563 00000100:00100000:3.0:1777051562.216714:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051562.217120:0:55805:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426158464 00000100:00100000:2.0:1777051562.217137:0:55805:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426158464 00000100:00100000:2.0:1777051562.217293:0:55805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 8137 00000100:00100000:2.0:1777051562.217316:0:55805:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d9533bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c11b6966-0775-44d2-bdc6-c74c26eb2226+31:2436:x1863365426158464:12345-192.168.201.46@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1777051562.217395:0:55805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000002118ac56/0x85f51a6b96718259 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x204:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 55805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051562.217426:0:55805:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777051562.217429:0:55805:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777051562.217439:0:55805:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002118ac56/0x85f51a6b96718259 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x204:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 55805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051562.217463:0:55805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002118ac56/0x85f51a6b96718259 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x204:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 55805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051562.217505:0:55805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000002118ac56/0x85f51a6b96718259 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x204:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 55805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051562.217520:0:55805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002118ac56/0x85f51a6b96718259 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x204:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 55805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051562.217534:0:55805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002118ac56/0x85f51a6b96718259 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x204:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 55805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051562.217555:0:55805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94f69ae00 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:2.0:1777051562.217561:0:55805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002118ac56/0x85f51a6b96718259 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x204:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 55805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051562.217574:0:55805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002118ac56/0x85f51a6b96718259 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x204:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 55805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051562.217595:0:55805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002118ac56/0x85f51a6b96718259 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x204:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 55805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051562.217608:0:55805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002118ac56/0x85f51a6b96718259 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x204:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 55805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051562.217732:0:55805:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d9533bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c11b6966-0775-44d2-bdc6-c74c26eb2226+31:2436:x1863365426158464:12345-192.168.201.46@tcp:1:lhsmtool_posix.0 Request processed in 424us (1033us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051562.217744:0:55805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 8137 00000100:00100000:0.0:1777051562.221620:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051562.222038:0:6581:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426158720 00000100:00100000:2.0:1777051562.222049:0:6581:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426158720 00000100:00100000:2.0:1777051562.222124:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112564 00000100:00100000:2.0:1777051562.222140:0:6581:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fdf2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+21:142651:x1863365426158720:12345-192.168.201.46@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1777051562.222569:0:6581:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69b400/0x85f51a6b96718260 lrc: 3/0,1 mode: --/PW res: [0x2000032e3:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051562.222595:0:6581:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162f400/0x85f51a6b96718252 lrc: 2/0,0 mode: PR/PR res: [0x2000032e3:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6c8c expref: 21 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051562.222619:0:6581:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69b400/0x85f51a6b96718260 lrc: 4/0,1 mode: --/PW res: [0x2000032e3:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051562.222680:0:6581:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162f400/0x85f51a6b96718252 lrc: 3/0,0 mode: PR/PR res: [0x2000032e3:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6c8c expref: 21 pid: 27882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051562.222706:0:6581:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162f400/0x85f51a6b96718252 lrc: 4/0,0 mode: PR/PR res: [0x2000032e3:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6c8c expref: 21 pid: 27882 timeout: 8291 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051562.222730:0:6581:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7fd65880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6581:1863365452746368:192.168.201.46@tcp:104: 00000100:00100000:2.0:1777051562.222864:0:6581:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d94e566540 going to sleep for 11 seconds 00000100:00100000:2.0:1777051562.227070:0:6581:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7fd65880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6581:1863365452746368:192.168.201.46@tcp:104: 00010000:00010000:2.0:1777051562.227130:0:6581:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69b400/0x85f51a6b96718260 lrc: 3/0,1 mode: --/PW res: [0x2000032e3:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051562.227265:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051562.227375:0:6564:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426158848 00000100:00100000:3.0:1777051562.227389:0:6564:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426158848 00010000:00010000:3.0:1777051562.227448:0:6564:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162f400/0x85f51a6b96718252 lrc: 4/0,0 mode: PR/PR res: [0x2000032e3:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6c8c expref: 22 pid: 27882 timeout: 8291 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051562.227614:0:24467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3998 00000100:00100000:0.0:1777051562.227647:0:24467:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fdf0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+22:2436:x1863365426158848:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1777051562.227678:0:24467:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777051562.227694:0:24467:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162f400/0x85f51a6b96718252 lrc: 4/0,0 mode: PR/PR res: [0x2000032e3:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6c8c expref: 22 pid: 27882 timeout: 8291 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051562.227721:0:24467:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162f400/0x85f51a6b96718252 lrc: 3/0,0 mode: PR/PR res: [0x2000032e3:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6c8c expref: 22 pid: 27882 timeout: 8291 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051562.227758:0:24467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162f400/0x85f51a6b96718252 lrc: 0/0,0 mode: --/PR res: [0x2000032e3:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6c8c expref: 22 pid: 27882 timeout: 8291 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051562.227783:0:24467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e3:0x10:0x0].0x0 (ffff99da45738f00) 00010000:00010000:0.0:1777051562.228101:0:24467:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69b400/0x85f51a6b96718260 lrc: 3/0,1 mode: --/PW res: [0x2000032e3:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051562.228118:0:24467:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69b400/0x85f51a6b96718260 lrc: 3/0,1 mode: PW/PW res: [0x2000032e3:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051562.228130:0:24467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69b400/0x85f51a6b96718260 lrc: 4/0,1 mode: PW/PW res: [0x2000032e3:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051562.228180:0:24467:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1777051562.228237:0:6581:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69b400/0x85f51a6b96718260 lrc: 3/0,1 mode: PW/PW res: [0x2000032e3:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051562.228254:0:6581:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69b400/0x85f51a6b96718260 lrc: 3/0,1 mode: PW/PW res: [0x2000032e3:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051562.228338:0:24467:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fdf0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+21:2436:x1863365426158848:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 704us (1075us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051562.228357:0:24467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3998 00010000:00010000:2.0:1777051562.228482:0:6581:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69b400/0x85f51a6b96718260 lrc: 3/0,1 mode: PW/PW res: [0x2000032e3:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051562.228496:0:6581:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69b400/0x85f51a6b96718260 lrc: 2/0,0 mode: PW/PW res: [0x2000032e3:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051562.228509:0:6581:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69b400/0x85f51a6b96718260 lrc: 3/0,0 mode: PW/PW res: [0x2000032e3:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051562.228522:0:6581:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94f69b400 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:2.0:1777051562.228530:0:6581:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69b400/0x85f51a6b96718260 lrc: 3/0,0 mode: PW/PW res: [0x2000032e3:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051562.228542:0:6581:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69b400/0x85f51a6b96718260 lrc: 4/0,0 mode: PW/PW res: [0x2000032e3:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051562.228583:0:6581:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e3:0x10:0x0].0x0 (ffff99da45738f00) 00010000:00010000:2.0:1777051562.228590:0:6581:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1777051562.228597:0:6581:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69b400/0x85f51a6b96718260 lrc: 2/0,0 mode: --/PW res: [0x2000032e3:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051562.228608:0:6581:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69b400/0x85f51a6b96718260 lrc: 0/0,0 mode: --/PW res: [0x2000032e3:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6581 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051562.229047:0:6581:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fdf2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c11b6966-0775-44d2-bdc6-c74c26eb2226+21:142651:x1863365426158720:12345-192.168.201.46@tcp:57:lhsmtool_posix.0 Request processed in 6910us (7857us total) trans 34359738450 rc 0/0 00000100:00100000:2.0:1777051562.229062:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112564 00000040:00080000:0.0:1777051562.230464:0:110924:0:(llog.c:801:llog_process_thread()) index: 6, lh_last_idx: 7 synced_idx: 0 lgh_last_idx: 7 00000040:00080000:0.0:1777051562.230471:0:110924:0:(llog_cat.c:158:llog_cat_process_common()) processing log [0x1:0x2b:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1777051562.230509:0:110924:0:(llog.c:858:llog_process_thread()) stop processing plain [0x1:0x2b:0x0] index 12 count 2 00000040:00080000:0.0:1777051562.230527:0:110924:0:(llog.c:801:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:0.0:1777051562.230531:0:110924:0:(llog_cat.c:158:llog_cat_process_common()) processing log [0x1:0x31:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1777051562.230907:0:110924:0:(llog.c:858:llog_process_thread()) stop processing plain [0x1:0x31:0x0] index 5 count 5 00000040:00080000:0.0:1777051562.230919:0:110924:0:(llog.c:858:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 3 00000100:00100000:0.0:1777051562.234439:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051562.234838:0:46501:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426159104 00000100:00100000:1.0:1777051562.234850:0:46501:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426159104 00000100:00100000:1.0:1777051562.234928:0:46501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3456 00000100:00100000:1.0:1777051562.234945:0:46501:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f298e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+21:142651:x1863365426159104:12345-192.168.201.46@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1777051562.235471:0:46501:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f298e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+22:142651:x1863365426159104:12345-192.168.201.46@tcp:35:lhsmtool_posix.0 Request processed in 529us (1033us total) trans 34359738451 rc 0/0 00000100:00100000:1.0:1777051562.235486:0:46501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3456 00000040:00080000:2.0:1777051562.593774:0:111609:0:(llog.c:801:llog_process_thread()) index: 6, lh_last_idx: 7 synced_idx: 0 lgh_last_idx: 7 00000040:00080000:2.0:1777051562.593820:0:111609:0:(llog_cat.c:158:llog_cat_process_common()) processing log [0x1:0x2b:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1777051562.593871:0:111609:0:(llog.c:858:llog_process_thread()) stop processing plain [0x1:0x2b:0x0] index 12 count 2 00000040:00080000:2.0:1777051562.593892:0:111609:0:(llog.c:801:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:2.0:1777051562.593897:0:111609:0:(llog_cat.c:158:llog_cat_process_common()) processing log [0x1:0x31:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1777051562.593948:0:111609:0:(llog.c:858:llog_process_thread()) stop processing plain [0x1:0x31:0x0] index 5 count 5 00000040:00080000:2.0:1777051562.593955:0:111609:0:(llog.c:858:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 3 00000100:00100000:0.0:1777051562.673330:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051562.673598:0:6565:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426159232 00000100:00100000:1.0:1777051562.673614:0:6565:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426159232 00000100:00100000:1.0:1777051562.674100:0:6565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13760 00000100:00100000:1.0:1777051562.674125:0:6565:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f298000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+31:2438:x1863365426159232:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1777051562.674152:0:6565:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 16 locks, starting at 0 00010000:00010000:1.0:1777051562.674263:0:6565:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c750a114/0x85f51a6b96712abd lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x156:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b57d2 expref: 31 pid: 8468 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051562.674316:0:6565:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e48335f7/0x85f51a6b96712a69 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x155:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b57a8 expref: 30 pid: 8628 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051562.674350:0:6565:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005cb041ec/0x85f51a6b96711b12 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x14f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b51ff expref: 29 pid: 8471 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051562.674379:0:6565:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000adf70a1/0x85f51a6b9671199f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x14e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5173 expref: 28 pid: 27884 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051562.674414:0:6565:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002e576528/0x85f51a6b9671194b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x14d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5149 expref: 27 pid: 8470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051562.674488:0:6565:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ed8ac474/0x85f51a6b96711d88 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x14c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b533a expref: 26 pid: 27884 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051562.674524:0:6565:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009c6d869a/0x85f51a6b96711d65 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x153:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b532c expref: 25 pid: 24468 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051562.674553:0:6565:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008d6d4967/0x85f51a6b96711c77 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x151:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5299 expref: 24 pid: 13320 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051562.674583:0:6565:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005ceed186/0x85f51a6b96711b66 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x150:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b5229 expref: 23 pid: 8470 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051562.674615:0:6565:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000009b6129d/0x85f51a6b96710c55 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x14a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b4cbf expref: 22 pid: 13320 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051562.674645:0:6565:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000be333ea/0x85f51a6b96710bec lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x149:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b4c8e expref: 21 pid: 8468 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051562.674675:0:6565:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ef3251f8/0x85f51a6b96710b2f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x148:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b4c2c expref: 20 pid: 55805 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051562.674709:0:6565:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000db0da6fe/0x85f51a6b96710adb lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x147:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b4c02 expref: 19 pid: 27887 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051562.674744:0:6565:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000077aa40c2/0x85f51a6b96710968 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x146:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b4b6f expref: 18 pid: 55805 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051562.674824:0:6565:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007ebf8a0d/0x85f51a6b96710914 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x145:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b4b45 expref: 17 pid: 8471 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051562.674859:0:6565:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bcd765a5/0x85f51a6b967108c0 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x144:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b4b1b expref: 16 pid: 13320 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051562.674886:0:6565:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1777051562.674974:0:6565:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f298000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+15:2438:x1863365426159232:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 857us (1654us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051562.674992:0:6565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13760 00000100:00100000:0.0:1777051562.677063:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:1.0:1777051562.677177:0:8492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426159488 00000100:00100000:1.0:1777051562.677189:0:8492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426159488 00000100:00100000:1.0:1777051562.677274:0:8492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112565 00000100:00100000:1.0:1777051562.677292:0:8492:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f29bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+15:142653:x1863365426159488:12345-192.168.201.46@tcp:101:lfs.0 00010000:00010000:1.0:1777051562.677330:0:8492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777051562.677362:0:8492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502db200/0x85f51a6b96718267 lrc: 2/0,0 mode: --/CR res: [0x2000032e3:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6c93 expref: -99 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051562.677523:0:8492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502dba00/0x85f51a6b9671826e lrc: 3/0,1 mode: --/PW res: [0x2000032e3:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051562.677550:0:8492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502dba00/0x85f51a6b9671826e lrc: 3/0,1 mode: PW/PW res: [0x2000032e3:0x10:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051562.677571:0:8492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502dba00/0x85f51a6b9671826e lrc: 3/0,1 mode: PW/PW res: [0x2000032e3:0x10:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1777051562.677605:0:8492:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000032e3:0x10:0x0]: returning size 0 00010000:00010000:1.0:1777051562.677774:0:8492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502db200/0x85f51a6b96718267 lrc: 0/0,0 mode: --/CR res: [0x2000032e3:0x10:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6c93 expref: 18 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051562.678242:0:8492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502dba00/0x85f51a6b9671826e lrc: 3/0,0 mode: PW/PW res: [0x2000032e3:0x10:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6c93 expref: 17 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051562.678261:0:8492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e3:0x10:0x0].0x0 (ffff99da45738f00) 00010000:00010000:1.0:1777051562.678268:0:8492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1777051562.678276:0:8492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d9502dba00, rc 0) 00000100:00100000:1.0:1777051562.678355:0:8492:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f29bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+17:142653:x1863365426159488:12345-192.168.201.46@tcp:101:lfs.0 Request processed in 1064us (1299us total) trans 34359738452 rc 0/0 00000100:00100000:1.0:1777051562.678374:0:8492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112565 00000100:00100000:1.0:1777051562.691774:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051562.693172:0:8468:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426159616 00000100:00100000:3.0:1777051562.693189:0:8468:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426159616 00000100:00100000:3.0:1777051562.693326:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 8138 00000100:00100000:3.0:1777051562.693344:0:8468:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7cd9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+15:2437:x1863365426159616:12345-192.168.201.46@tcp:1:lfs.0 00010000:00010000:3.0:1777051562.693420:0:8468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a87371ea/0x85f51a6b9671827c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x204:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051562.693459:0:8468:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000046b5e69f/0x85f51a6b96718213 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x204:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6c70 expref: 15 pid: 13320 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051562.693479:0:8468:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000047bca7e9/0x85f51a6b96718244 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x204:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6c85 expref: 30 pid: 24468 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051562.693493:0:8468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051562.693497:0:8468:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051562.693504:0:8468:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a87371ea/0x85f51a6b9671827c lrc: 5/0,1 mode: --/PW res: [0x2c0000401:0x204:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051562.693564:0:8468:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000047bca7e9/0x85f51a6b96718244 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x204:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6c85 expref: 30 pid: 24468 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051562.693592:0:8468:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000047bca7e9/0x85f51a6b96718244 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x204:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6c85 expref: 30 pid: 24468 timeout: 8291 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051562.693620:0:8468:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d9533bed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8468:1863365452746496:192.168.201.46@tcp:104: 00010000:00010000:3.0:1777051562.694147:0:8468:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000046b5e69f/0x85f51a6b96718213 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x204:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6c70 expref: 15 pid: 13320 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051562.694173:0:8468:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000046b5e69f/0x85f51a6b96718213 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x204:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6c70 expref: 15 pid: 13320 timeout: 8291 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051562.694242:0:8468:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d9533bc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8468:1863365452746624:192.168.201.46@tcp:104: 00000100:00100000:3.0:1777051562.694327:0:8468:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d941b53c00 going to sleep for 11 seconds 00000100:00100000:3.0:1777051562.704539:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051562.705937:0:47597:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426159744 00000100:00100000:0.0:1777051562.705951:0:47597:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426159744 00010000:00010000:0.0:1777051562.706008:0:47597:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000047bca7e9/0x85f51a6b96718244 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x204:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6c85 expref: 31 pid: 24468 timeout: 8291 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051562.706075:0:47597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3999 00000100:00100000:0.0:1777051562.706097:0:47597:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d9533bf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+31:2439:x1863365426159744:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1777051562.706123:0:47597:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777051562.706155:0:47597:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000047bca7e9/0x85f51a6b96718244 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x204:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6c85 expref: 31 pid: 24468 timeout: 8291 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051562.706184:0:47597:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000047bca7e9/0x85f51a6b96718244 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x204:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6c85 expref: 31 pid: 24468 timeout: 8291 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051562.706264:0:47597:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1777051562.706354:0:47597:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d9533bf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c11b6966-0775-44d2-bdc6-c74c26eb2226+31:2439:x1863365426159744:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 259us (1823us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051562.706370:0:47597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3999 00000100:00100000:0.0:1777051562.706464:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051562.706584:0:47827:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426159872 00000100:00100000:3.0:1777051562.706596:0:47827:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426159872 00010000:00010000:3.0:1777051562.706646:0:47827:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000046b5e69f/0x85f51a6b96718213 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x204:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6c70 expref: 16 pid: 13320 timeout: 8291 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051562.706684:0:8468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000047bca7e9/0x85f51a6b96718244 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x204:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6c85 expref: 30 pid: 24468 timeout: 8291 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051562.706709:0:47827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 4000 00000100:00100000:0.0:1777051562.706719:0:8468:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d9533bed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8468:1863365452746496:192.168.201.46@tcp:104: 00000100:00100000:3.0:1777051562.706736:0:47827:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f299500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+16:2436:x1863365426159872:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1777051562.706755:0:47827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1777051562.706759:0:8468:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d9533bc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8468:1863365452746624:192.168.201.46@tcp:104: 00010000:00010000:3.0:1777051562.706813:0:47827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000046b5e69f/0x85f51a6b96718213 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x204:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6c70 expref: 16 pid: 13320 timeout: 8291 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051562.706835:0:8468:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a87371ea/0x85f51a6b9671827c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x204:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051562.706844:0:47827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000046b5e69f/0x85f51a6b96718213 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x204:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6c70 expref: 16 pid: 13320 timeout: 8291 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051562.706907:0:47827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000046b5e69f/0x85f51a6b96718213 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x204:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6c70 expref: 16 pid: 13320 timeout: 8291 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051562.710322:0:47827:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051562.710330:0:47827:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051562.710341:0:47827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a87371ea/0x85f51a6b9671827c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x204:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051562.710364:0:47827:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a87371ea/0x85f51a6b9671827c lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x204:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051562.710413:0:47827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1777051562.710493:0:47827:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f299500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+15:2436:x1863365426159872:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 3759us (4022us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051562.710512:0:47827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 4000 00010000:00010000:0.0:1777051562.712392:0:8468:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a87371ea/0x85f51a6b9671827c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x204:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051562.712417:0:8468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a87371ea/0x85f51a6b9671827c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x204:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051562.712477:0:8468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a87371ea/0x85f51a6b9671827c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x204:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051562.712496:0:8468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a87371ea/0x85f51a6b9671827c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x204:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051562.712515:0:8468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a87371ea/0x85f51a6b9671827c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x204:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051562.712531:0:8468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da7d5cfc00 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:0.0:1777051562.712539:0:8468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a87371ea/0x85f51a6b9671827c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x204:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051562.712558:0:8468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a87371ea/0x85f51a6b9671827c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x204:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051562.712586:0:8468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a87371ea/0x85f51a6b9671827c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x204:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051562.712602:0:8468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a87371ea/0x85f51a6b9671827c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x204:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051562.712728:0:8468:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7cd9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+14:2437:x1863365426159616:12345-192.168.201.46@tcp:1:lfs.0 Request processed in 19384us (20962us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051562.712758:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 8138 00000100:00100000:1.0:1777051562.728613:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051562.730241:0:6583:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426160128 00000100:00100000:0.0:1777051562.730259:0:6583:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426160128 00000100:00100000:0.0:1777051562.730371:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3457 00000100:00100000:0.0:1777051562.730392:0:6583:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da708df850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+17:142653:x1863365426160128:12345-192.168.201.46@tcp:35:lfs.0 00000004:00010000:0.0:1777051562.730507:0:6583:0:(mdt_open.c:1994:mdt_hsm_release()) ### [0x2000032e3:0x10:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502dba00/0x85f51a6b9671826e lrc: 3/0,0 mode: PW/PW res: [0x2000032e3:0x10:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6c93 expref: 17 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1777051562.731251:0:6583:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 34359738453 00000001:00080000:0.0:1777051562.731829:0:6583:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 34359738454 00010000:00010000:0.0:1777051562.731918:0:6583:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162f000/0x85f51a6b96718283 lrc: 3/0,1 mode: --/EX res: [0x2000032e3:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6583 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051562.731951:0:6583:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99d950711200/0x85f51a6b96718180 lrc: 2/0,0 mode: PR/PR res: [0x2000032e3:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6c46 expref: 21 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051562.731969:0:6583:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502dac00/0x85f51a6b9671820c lrc: 2/0,0 mode: PR/PR res: [0x2000032e3:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6c69 expref: 20 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051562.731991:0:6583:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162f000/0x85f51a6b96718283 lrc: 5/0,1 mode: --/EX res: [0x2000032e3:0x10:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6583 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051562.732055:0:6583:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502dac00/0x85f51a6b9671820c lrc: 3/0,0 mode: PR/PR res: [0x2000032e3:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6c69 expref: 20 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051562.732088:0:6583:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502dac00/0x85f51a6b9671820c lrc: 4/0,0 mode: PR/PR res: [0x2000032e3:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6c69 expref: 20 pid: 8492 timeout: 8291 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051562.732120:0:6583:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f29ad80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6583:1863365452746752:192.168.201.46@tcp:104: 00010000:00010000:0.0:1777051562.732680:0:6583:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99d950711200/0x85f51a6b96718180 lrc: 3/0,0 mode: PR/PR res: [0x2000032e3:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6c46 expref: 21 pid: 6580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051562.732711:0:6583:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950711200/0x85f51a6b96718180 lrc: 4/0,0 mode: PR/PR res: [0x2000032e3:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6c46 expref: 21 pid: 6580 timeout: 8291 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051562.732741:0:6583:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f29a680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6583:1863365452746880:192.168.201.46@tcp:104: 00000100:00100000:0.0:1777051562.732839:0:6583:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d958800c00 going to sleep for 11 seconds 00000100:00100000:3.0:1777051562.737265:0:6583:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f29ad80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6583:1863365452746752:192.168.201.46@tcp:104: 00000100:00100000:3.0:1777051562.737302:0:6583:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f29a680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6583:1863365452746880:192.168.201.46@tcp:104: 00010000:00010000:3.0:1777051562.737463:0:6583:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162f000/0x85f51a6b96718283 lrc: 3/0,1 mode: --/EX res: [0x2000032e3:0x10:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6583 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051562.739532:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051562.739664:0:24467:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426160256 00000100:00100000:0.0:1777051562.739677:0:24467:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426160256 00000100:00100000:1.0:1777051562.739724:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00010000:00010000:0.0:1777051562.739735:0:24467:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502dac00/0x85f51a6b9671820c lrc: 4/0,0 mode: PR/PR res: [0x2000032e3:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6c69 expref: 21 pid: 8492 timeout: 8291 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051562.739868:0:24467:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426160384 00000100:00100000:0.0:1777051562.739878:0:24467:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426160384 00000100:00100000:1.0:1777051562.739897:0:9550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 4001 00010000:00010000:0.0:1777051562.739919:0:24467:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d950711200/0x85f51a6b96718180 lrc: 4/0,0 mode: PR/PR res: [0x2000032e3:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6c46 expref: 22 pid: 6580 timeout: 8291 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051562.739933:0:9550:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7cd9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+21:2437:x1863365426160256:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1777051562.739966:0:9550:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1777051562.739999:0:9550:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502dac00/0x85f51a6b9671820c lrc: 4/0,0 mode: PR/PR res: [0x2000032e3:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6c69 expref: 21 pid: 8492 timeout: 8291 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051562.740011:0:24467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 4002 00000100:00100000:0.0:1777051562.740046:0:24467:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da71c08850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+22:2436:x1863365426160384:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1777051562.740052:0:9550:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502dac00/0x85f51a6b9671820c lrc: 3/0,0 mode: PR/PR res: [0x2000032e3:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6c69 expref: 21 pid: 8492 timeout: 8291 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051562.740074:0:24467:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777051562.740094:0:24467:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99d950711200/0x85f51a6b96718180 lrc: 4/0,0 mode: PR/PR res: [0x2000032e3:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6c46 expref: 22 pid: 6580 timeout: 8291 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051562.740120:0:9550:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502dac00/0x85f51a6b9671820c lrc: 0/0,0 mode: --/PR res: [0x2000032e3:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6c69 expref: 21 pid: 8492 timeout: 8291 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051562.740130:0:24467:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99d950711200/0x85f51a6b96718180 lrc: 3/0,0 mode: PR/PR res: [0x2000032e3:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6c46 expref: 22 pid: 6580 timeout: 8291 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051562.740155:0:9550:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e3:0x10:0x0].0x0 (ffff99da45738f00) 00010000:00010000:1.0:1777051562.740164:0:9550:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162f000/0x85f51a6b96718283 lrc: 3/0,1 mode: --/EX res: [0x2000032e3:0x10:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6583 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051562.740175:0:9550:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162f000/0x85f51a6b96718283 lrc: 3/0,1 mode: --/EX res: [0x2000032e3:0x10:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6583 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051562.740191:0:9550:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1777051562.740280:0:24467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d950711200/0x85f51a6b96718180 lrc: 0/0,0 mode: --/PR res: [0x2000032e3:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6c46 expref: 22 pid: 6580 timeout: 8291 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051562.740332:0:24467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e3:0x10:0x0].0x0 (ffff99da45738f00) 00000100:00100000:1.0:1777051562.740354:0:9550:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7cd9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+20:2437:x1863365426160256:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 429us (814us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051562.740372:0:9550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 4001 00010000:00010000:0.0:1777051562.740376:0:24467:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162f000/0x85f51a6b96718283 lrc: 3/0,1 mode: --/EX res: [0x2000032e3:0x10:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6583 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051562.740396:0:24467:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162f000/0x85f51a6b96718283 lrc: 3/0,1 mode: EX/EX res: [0x2000032e3:0x10:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6583 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051562.740414:0:24467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162f000/0x85f51a6b96718283 lrc: 4/0,1 mode: EX/EX res: [0x2000032e3:0x10:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6583 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051562.740491:0:24467:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1777051562.740578:0:24467:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da71c08850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+21:2436:x1863365426160384:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 542us (989us total) trans 0 rc 0/0 00010000:00010000:2.0:1777051562.740593:0:6583:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162f000/0x85f51a6b96718283 lrc: 3/0,1 mode: EX/EX res: [0x2000032e3:0x10:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6583 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051562.740596:0:24467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 4002 00010000:00010000:2.0:1777051562.740623:0:6583:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162f000/0x85f51a6b96718283 lrc: 3/0,1 mode: EX/EX res: [0x2000032e3:0x10:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6583 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1777051562.740863:0:6583:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 34359738455 00000001:00080000:2.0:1777051562.741058:0:6583:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 34359738456 00000001:00080000:2.0:1777051562.741116:0:6583:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 34359738457 00000100:00100000:2.0:1777051562.741294:0:6583:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7fd65880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6583:1863365452747008:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1777051562.741417:0:6583:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051562.741463:0:6583:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d94e566600 going to sleep for 11 seconds 00000100:00100000:1.0:1777051562.742656:0:11727:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452747008 00000100:00100000:1.0:1777051562.742669:0:11727:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452747008 00000100:00100000:1.0:1777051562.743247:0:11727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8392 00000100:00100000:1.0:1777051562.743272:0:11727:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d944e10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6583:x1863365452747008:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1777051562.743461:0:11727:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d944e10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6583:x1863365452747008:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 197us (2039us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051562.743481:0:11727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8392 00000100:00080000:2.0:1777051562.743567:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1777051562.743644:0:6583:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7fd65880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6583:1863365452747008:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1777051562.743727:0:6583:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 34359738458 00010000:00010000:2.0:1777051562.743772:0:6583:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162f000/0x85f51a6b96718283 lrc: 3/0,1 mode: EX/EX res: [0x2000032e3:0x10:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6583 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051562.743818:0:6583:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162f000/0x85f51a6b96718283 lrc: 2/0,0 mode: EX/EX res: [0x2000032e3:0x10:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6583 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051562.743830:0:6583:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162f000/0x85f51a6b96718283 lrc: 3/0,0 mode: EX/EX res: [0x2000032e3:0x10:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6583 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051562.743840:0:6583:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da4162f000 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:2.0:1777051562.743847:0:6583:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162f000/0x85f51a6b96718283 lrc: 3/0,0 mode: EX/EX res: [0x2000032e3:0x10:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6583 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051562.743858:0:6583:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162f000/0x85f51a6b96718283 lrc: 4/0,0 mode: EX/EX res: [0x2000032e3:0x10:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6583 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051562.743882:0:6583:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e3:0x10:0x0].0x0 (ffff99da45738f00) 00010000:00010000:2.0:1777051562.743887:0:6583:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1777051562.743894:0:6583:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162f000/0x85f51a6b96718283 lrc: 2/0,0 mode: --/EX res: [0x2000032e3:0x10:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6583 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051562.743911:0:6583:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99da4162f000/0x85f51a6b96718283 lrc: 0/0,0 mode: --/EX res: [0x2000032e3:0x10:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6583 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1777051562.744105:0:6583:0:(mdd_object.c:4010:mdd_close()) Object [0x2000032e2:0x11:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1777051562.744215:0:6583:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2f:0x0].3, 64 off8384 00000004:00080000:2.0:1777051562.744290:0:6583:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 8191937090978ns, next at 8192937085386ns, rc = 0 00000001:00080000:2.0:1777051562.744302:0:6583:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 34359738459 00010000:00010000:2.0:1777051562.744354:0:6583:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e3:0x10:0x0].0x0 (ffff99da45738f00) 00010000:00010000:2.0:1777051562.744360:0:6583:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1777051562.744374:0:6583:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d9502dba00/0x85f51a6b9671826e lrc: 0/0,0 mode: --/PW res: [0x2000032e3:0x10:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6c93 expref: 24 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051562.744542:0:6583:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da708df850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+23:142653:x1863365426160128:12345-192.168.201.46@tcp:35:lfs.0 Request processed in 14154us (15947us total) trans 34359738460 rc 0/0 00000100:00100000:2.0:1777051562.744562:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3457 00000020:00080000:2.0:1777051562.744574:0:6583:0:(tgt_main.c:783:tgt_ses_key_exit()) total 8 transactions per RPC 00000100:00100000:1.0:1777051562.802640:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051562.803037:0:21368:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426160640 00000100:00100000:2.0:1777051562.803055:0:21368:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426160640 00000100:00100000:2.0:1777051562.803182:0:21368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112566 00000100:00100000:2.0:1777051562.803600:0:21368:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7cd9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+23:142656:x1863365426160640:12345-192.168.201.46@tcp:101:lfs.0 00010000:00010000:2.0:1777051562.803687:0:21368:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051562.804155:0:21368:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69ae00/0x85f51a6b9671828a lrc: 2/0,0 mode: --/CR res: [0x2000032e2:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6c9a expref: -99 pid: 21368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051562.804337:0:21368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69bc00/0x85f51a6b96718291 lrc: 3/1,0 mode: --/CR res: [0x2000032e2:0x10:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051562.804377:0:21368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69bc00/0x85f51a6b96718291 lrc: 3/1,0 mode: CR/CR res: [0x2000032e2:0x10:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051562.804404:0:21368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69bc00/0x85f51a6b96718291 lrc: 3/1,0 mode: CR/CR res: [0x2000032e2:0x10:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051562.804428:0:21368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69b800/0x85f51a6b96718298 lrc: 3/1,0 mode: --/PR res: [0x2000032e2:0x10:0x0].0x524cbed4 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051562.804449:0:21368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69b800/0x85f51a6b96718298 lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0x10:0x0].0x524cbed4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051562.804466:0:21368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69b800/0x85f51a6b96718298 lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0x10:0x0].0x524cbed4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051562.804686:0:21368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69ac00/0x85f51a6b9671829f lrc: 3/1,0 mode: --/PR res: [0x2000032e3:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051562.804712:0:21368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69ac00/0x85f51a6b9671829f lrc: 3/1,0 mode: PR/PR res: [0x2000032e3:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051562.804730:0:21368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69ac00/0x85f51a6b9671829f lrc: 3/1,0 mode: PR/PR res: [0x2000032e3:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1777051562.804754:0:21368:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2000032e3:0x10:0x0]: returning size 0 00010000:00010000:2.0:1777051562.804931:0:21368:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69bc00/0x85f51a6b96718291 lrc: 3/1,0 mode: CR/CR res: [0x2000032e2:0x10:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051562.804954:0:21368:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69bc00/0x85f51a6b96718291 lrc: 2/0,0 mode: CR/CR res: [0x2000032e2:0x10:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051562.804968:0:21368:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69bc00/0x85f51a6b96718291 lrc: 3/0,0 mode: CR/CR res: [0x2000032e2:0x10:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051562.804987:0:21368:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94f69bc00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:2.0:1777051562.804995:0:21368:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69bc00/0x85f51a6b96718291 lrc: 3/0,0 mode: CR/CR res: [0x2000032e2:0x10:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051562.805010:0:21368:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69bc00/0x85f51a6b96718291 lrc: 4/0,0 mode: CR/CR res: [0x2000032e2:0x10:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051562.805039:0:21368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0x10:0x0].0x0 (ffff99d9413d0b00) 00010000:00010000:2.0:1777051562.805046:0:21368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777051562.805492:0:21368:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69bc00/0x85f51a6b96718291 lrc: 2/0,0 mode: --/CR res: [0x2000032e2:0x10:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051562.805512:0:21368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69bc00/0x85f51a6b96718291 lrc: 0/0,0 mode: --/CR res: [0x2000032e2:0x10:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051562.805549:0:21368:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69b800/0x85f51a6b96718298 lrc: 3/1,0 mode: PR/PR res: [0x2000032e2:0x10:0x0].0x524cbed4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051562.805563:0:21368:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69b800/0x85f51a6b96718298 lrc: 2/0,0 mode: PR/PR res: [0x2000032e2:0x10:0x0].0x524cbed4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051562.805582:0:21368:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69b800/0x85f51a6b96718298 lrc: 3/0,0 mode: PR/PR res: [0x2000032e2:0x10:0x0].0x524cbed4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051562.805595:0:21368:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94f69b800 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:2.0:1777051562.805601:0:21368:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69b800/0x85f51a6b96718298 lrc: 3/0,0 mode: PR/PR res: [0x2000032e2:0x10:0x0].0x524cbed4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051562.805621:0:21368:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69b800/0x85f51a6b96718298 lrc: 4/0,0 mode: PR/PR res: [0x2000032e2:0x10:0x0].0x524cbed4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051562.805656:0:21368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0x10:0x0].0x524cbed4 (ffff99da45738100) 00010000:00010000:2.0:1777051562.805662:0:21368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777051562.805670:0:21368:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69b800/0x85f51a6b96718298 lrc: 2/0,0 mode: --/PR res: [0x2000032e2:0x10:0x0].0x524cbed4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051562.805684:0:21368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69b800/0x85f51a6b96718298 lrc: 0/0,0 mode: --/PR res: [0x2000032e2:0x10:0x0].0x524cbed4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051562.807347:0:21368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69ae00/0x85f51a6b9671828a lrc: 0/0,0 mode: --/CR res: [0x2000032e2:0x10:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6c9a expref: 26 pid: 21368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051562.807390:0:21368:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69ac00/0x85f51a6b9671829f lrc: 3/0,0 mode: PR/PR res: [0x2000032e3:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6c9a expref: 25 pid: 21368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051562.807412:0:21368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e3:0x10:0x0].0x0 (ffff99da45fd2a00) 00010000:00010000:2.0:1777051562.807419:0:21368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1777051562.807425:0:21368:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d94f69ac00, rc 0) 00000100:00100000:2.0:1777051562.807598:0:21368:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7cd9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+25:142656:x1863365426160640:12345-192.168.201.46@tcp:101:lfs.0 Request processed in 4398us (4967us total) trans 34359738461 rc 0/0 00000100:00100000:2.0:1777051562.807621:0:21368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112566 00000100:00100000:1.0:1777051562.825676:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051562.827039:0:46497:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426160768 00000100:00100000:2.0:1777051562.827061:0:46497:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426160768 00000100:00100000:2.0:1777051562.827552:0:46497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112567 00000100:00100000:2.0:1777051562.827577:0:46497:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7cd9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+25:142656:x1863365426160768:12345-192.168.201.46@tcp:54:lfs.0 00010000:00010000:2.0:1777051562.827677:0:46497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69ae00/0x85f51a6b967182ad lrc: 3/1,0 mode: --/PR res: [0x2000032e3:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051562.827722:0:46497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69ae00/0x85f51a6b967182ad lrc: 3/1,0 mode: PR/PR res: [0x2000032e3:0x10:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051562.827751:0:46497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69ae00/0x85f51a6b967182ad lrc: 3/1,0 mode: PR/PR res: [0x2000032e3:0x10:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051562.827849:0:46497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69ae00/0x85f51a6b967182ad lrc: 3/1,0 mode: PR/PR res: [0x2000032e3:0x10:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051562.827872:0:46497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69ae00/0x85f51a6b967182ad lrc: 2/0,0 mode: PR/PR res: [0x2000032e3:0x10:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051562.827886:0:46497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69ae00/0x85f51a6b967182ad lrc: 3/0,0 mode: PR/PR res: [0x2000032e3:0x10:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051562.827905:0:46497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94f69ae00 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:2.0:1777051562.827913:0:46497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69ae00/0x85f51a6b967182ad lrc: 3/0,0 mode: PR/PR res: [0x2000032e3:0x10:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051562.827929:0:46497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69ae00/0x85f51a6b967182ad lrc: 4/0,0 mode: PR/PR res: [0x2000032e3:0x10:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051562.827955:0:46497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e3:0x10:0x0].0x0 (ffff99da45fd2a00) 00010000:00010000:2.0:1777051562.827961:0:46497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1777051562.827969:0:46497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69ae00/0x85f51a6b967182ad lrc: 2/0,0 mode: --/PR res: [0x2000032e3:0x10:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051562.827988:0:46497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d94f69ae00/0x85f51a6b967182ad lrc: 0/0,0 mode: --/PR res: [0x2000032e3:0x10:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 46497 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051562.828115:0:46497:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7cd9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+25:142656:x1863365426160768:12345-192.168.201.46@tcp:54:lfs.0 Request processed in 539us (2451us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051562.828134:0:46497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112567 00000100:00100000:1.0:1777051562.835403:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051562.835594:0:24269:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426161024 00000100:00100000:2.0:1777051562.835608:0:24269:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426161024 00000100:00100000:2.0:1777051562.835685:0:24269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3458 00000100:00100000:2.0:1777051562.835706:0:24269:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7cd9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+25:142656:x1863365426161024:12345-192.168.201.46@tcp:35:lfs.0 00000100:00100000:2.0:1777051562.836169:0:24269:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7cd9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+26:142656:x1863365426161024:12345-192.168.201.46@tcp:35:lfs.0 Request processed in 463us (768us total) trans 34359738462 rc 0/0 00000100:00100000:2.0:1777051562.836199:0:24269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3458 00000100:00100000:1.0:1777051563.106610:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:0.0:1777051563.106733:0:6579:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426161152 00000100:00100000:0.0:1777051563.106751:0:6579:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426161152 00000100:00080000:2.0:1777051563.106890:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1777051563.106905:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112568 00000100:00100000:0.0:1777051563.106926:0:6579:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7cd9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+21:142640:x1863365426161152:12345-192.168.201.46@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1777051563.107138:0:6579:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7cd9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+21:142640:x1863365426161152:12345-192.168.201.46@tcp:60:lhsmtool_posix.0 Request processed in 219us (539us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051563.107150:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112568 00000100:00100000:1.0:1777051563.112428:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051563.112532:0:10328:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426161280 00000100:00100000:3.0:1777051563.112543:0:10328:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426161280 00000100:00100000:3.0:1777051563.112642:0:10328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 112569 00000100:00080000:2.0:1777051563.112652:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1777051563.112660:0:10328:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f42d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+9:142640:x1863365426161280:12345-192.168.201.46@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1777051563.113088:0:10328:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f42d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c11b6966-0775-44d2-bdc6-c74c26eb2226+9:142640:x1863365426161280:12345-192.168.201.46@tcp:60:lhsmtool_posix.0 Request processed in 433us (666us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051563.113100:0:10328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 112569 00000100:00100000:1.0:1777051563.116597:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051563.116690:0:6582:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426161536 00000100:00100000:2.0:1777051563.116699:0:6582:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426161536 00000100:00100000:2.0:1777051563.117047:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 3459 00000100:00100000:2.0:1777051563.117062:0:6582:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f42ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+21:142640:x1863365426161536:12345-192.168.201.46@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1777051563.117435:0:6582:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f42ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+22:142640:x1863365426161536:12345-192.168.201.46@tcp:35:lhsmtool_posix.0 Request processed in 375us (839us total) trans 34359738463 rc 0/0 00000100:00100000:2.0:1777051563.117446:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 3459 00010000:00010000:0.0:1777051563.159025:0:108751:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1777051563.287289:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94f42fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3679:1863365452747520:0@lo:400:kworker.0 00000100:00100000:0.0:1777051563.287423:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051563.287454:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94f42dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3680:1863365452747648:0@lo:400:kworker.0 00000100:00100000:3.0:1777051563.287470:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f298000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3677:1863365452747136:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1777051563.287505:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94f51aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452748032:0@lo:400:kworker.0 00000100:00100000:1.0:1777051563.287534:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051563.288069:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94f42d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3678:1863365452747392:0@lo:400:kworker.0 00000100:00100000:1.0:1777051563.289191:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94f51b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3680:1863365452748160:0@lo:400:kworker.0 00000100:00100000:2.0:1777051563.289215:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051563.289260:0:46494:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452747520 00000100:00100000:0.0:1777051563.289276:0:46494:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452747520 00000100:00100000:1.0:1777051563.289277:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051563.289279:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051563.289300:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94f51b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3678:1863365452747904:0@lo:400:kworker.0 00000100:00100000:1.0:1777051563.289332:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94f518380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3680:1863365452748672:0@lo:400:kworker.0 00000100:00100000:0.0:1777051563.289391:0:46494:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452747648 00000100:00100000:3.0:1777051563.289397:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d944e11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452747264:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1777051563.289402:0:46494:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452747648 00000100:00100000:2.0:1777051563.289404:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051563.289411:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051563.289457:0:46494:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452747904 00000100:00100000:2.0:1777051563.289461:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94f519f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3678:1863365452748416:0@lo:400:kworker.0 00000100:00100000:0.0:1777051563.289465:0:46494:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452747904 00000100:00100000:1.0:1777051563.289489:0:13320:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452748160 00000100:00100000:1.0:1777051563.289496:0:13320:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452748160 00000100:00100000:0.0:1777051563.289550:0:46494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13611 00000100:00100000:1.0:1777051563.289562:0:13320:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452748672 00000100:00100000:1.0:1777051563.289571:0:13320:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452748672 00000100:00100000:2.0:1777051563.289572:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051563.289574:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051563.289579:0:46494:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f299500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000-lwp-OST0000_UUID+5:3679:x1863365452747520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777051563.289619:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94f519c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3678:1863365452748928:0@lo:400:kworker.0 00000100:00100000:1.0:1777051563.289629:0:13320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10631 00000100:00100000:1.0:1777051563.289645:0:13320:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f518700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3680:x1863365452748160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051563.289669:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94f519180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3677:1863365452747776:0@lo:400:kworker.0 00000100:00100000:0.0:1777051563.289704:0:46494:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f299500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000-lwp-OST0000_UUID+5:3679:x1863365452747520:12345-0@lo:400:kworker.0 Request processed in 133us (2280us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051563.289719:0:46494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13611 00000100:00100000:2.0:1777051563.289732:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051563.289801:0:46494:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452748416 00000100:00100000:3.0:1777051563.289809:0:27885:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452748928 00000100:00100000:0.0:1777051563.289811:0:46494:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452748416 00000100:00100000:1.0:1777051563.289823:0:13320:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f518700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3680:x1863365452748160:12345-0@lo:400:kworker.0 Request processed in 180us (563us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051563.289826:0:3678:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1777051563.289829:0:27885:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452748928 00000100:00100000:1.0:1777051563.289844:0:13320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10631 00000100:00100000:2.0:1777051563.289849:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94f518e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452748288:0@lo:400:kworker.0 00000100:00100000:0.0:1777051563.289872:0:46494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13612 00000100:00100000:0.0:1777051563.289894:0:46494:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f51b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0001-lwp-OST0000_UUID+5:3680:x1863365452747648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777051563.289894:0:13320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10632 00000100:00100000:1.0:1777051563.289919:0:13320:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f168700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3680:x1863365452748672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777051563.289920:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051563.289962:0:27885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13613 00000100:00100000:2.0:1777051563.289983:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94f51a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3678:1863365452748800:0@lo:400:kworker.0 00000100:00100000:0.0:1777051563.290000:0:46494:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f51b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0001-lwp-OST0000_UUID+5:3680:x1863365452747648:12345-0@lo:400:kworker.0 Request processed in 101us (2454us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051563.290003:0:27885:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d944e10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:lustre-MDT0001-lwp-OST0001_UUID+5:3678:x1863365452747904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777051563.290015:0:13320:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f168700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3680:x1863365452748672:12345-0@lo:400:kworker.0 Request processed in 96us (604us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051563.290030:0:46494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13612 00000100:00100000:2.0:1777051563.290046:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051563.290054:0:13320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10632 00000100:00100000:0.0:1777051563.290080:0:46494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13614 00000100:00100000:1.0:1777051563.290090:0:13320:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452748288 00000100:00100000:1.0:1777051563.290099:0:13320:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452748288 00000100:00100000:0.0:1777051563.290101:0:46494:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f9ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000-lwp-MDT0001_UUID+5:3678:x1863365452748416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777051563.290481:0:109181:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452747392 00000100:00100000:2.0:1777051563.290490:0:109181:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452747392 00000100:00100000:3.0:1777051563.290496:0:27885:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d944e10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:lustre-MDT0001-lwp-OST0001_UUID+5:3678:x1863365452747904:12345-0@lo:400:kworker.0 Request processed in 514us (1095us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051563.290518:0:27885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13613 00000100:00100000:1.0:1777051563.290529:0:13320:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452748800 00000100:00100000:1.0:1777051563.290538:0:13320:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452748800 00000100:00100000:0.0:1777051563.290558:0:46494:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f9ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000-lwp-MDT0001_UUID+5:3678:x1863365452748416:12345-0@lo:400:kworker.0 Request processed in 460us (1013us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051563.290575:0:46494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13614 00000100:00100000:2.0:1777051563.290581:0:109181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1777051563.290599:0:27885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13615 00000100:00100000:1.0:1777051563.290609:0:13320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10633 00000100:00100000:2.0:1777051563.290611:0:109181:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942db3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9351a01-5b0e-4470-97fd-58b9b4b312a2+23:3678:x1863365452747392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777051563.290630:0:13320:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fd64380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3678:x1863365452748288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051563.290639:0:27885:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7c9a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000-lwp-MDT0000_UUID+5:3678:x1863365452748928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777051563.290649:0:8470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10634 00000100:00100000:0.0:1777051563.290676:0:8470:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7fd65880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3678:x1863365452748800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777051563.290709:0:109181:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942db3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9351a01-5b0e-4470-97fd-58b9b4b312a2+23:3678:x1863365452747392:12345-0@lo:400:kworker.0 Request processed in 105us (1494us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051563.290724:0:109181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1777051563.290738:0:13320:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fd64380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3678:x1863365452748288:12345-0@lo:400:kworker.0 Request processed in 116us (821us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051563.290756:0:13320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10633 00000100:00100000:1.0:1777051563.291146:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94f42dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3680:1863365452747648:0@lo:400:kworker.0 00000100:00100000:2.0:1777051563.291166:0:6585:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452747136 00000100:00100000:1.0:1777051563.291169:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94f51b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3680:1863365452748160:0@lo:400:kworker.0 00000100:00100000:2.0:1777051563.291176:0:6585:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452747136 00000100:00100000:1.0:1777051563.291187:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94f518380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3680:1863365452748672:0@lo:400:kworker.0 00000100:00100000:2.0:1777051563.291268:0:6585:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452747264 00000100:00100000:2.0:1777051563.291273:0:6585:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452747264 00000100:00100000:2.0:1777051563.291311:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8393 00000100:00100000:2.0:1777051563.291328:0:6585:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d9533bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3677:x1863365452747136:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1777051563.291329:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00000024:2.0:1777051563.291374:0:6585:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4194304 pending 0 free 1446141952 avail 1299902464 00000100:00100000:3.0:1777051563.291441:0:27885:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7c9a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000-lwp-MDT0000_UUID+5:3678:x1863365452748928:12345-0@lo:400:kworker.0 Request processed in 816us (1706us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051563.291451:0:8470:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7fd65880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3678:x1863365452748800:12345-0@lo:400:kworker.0 Request processed in 777us (1409us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051563.291491:0:8470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10634 00000100:00100000:3.0:1777051563.291496:0:27885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13615 00000100:00100000:0.0:1777051563.291540:0:46498:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452748032 00000100:00100000:0.0:1777051563.291549:0:46498:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452748032 00000100:00100000:3.0:1777051563.291584:0:46500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8394 00000100:00100000:0.0:1777051563.291614:0:46498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8395 00000100:00100000:3.0:1777051563.291616:0:46500:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d9533bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+8:3677:x1863365452747264:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1777051563.291636:0:46498:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f16b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+8:3679:x1863365452748032:12345-0@lo:400:kworker.0 00000004:00000024:3.0:1777051563.291668:0:46500:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4194304 pending 0 free 1441525760 avail 1295286272 00000100:00100000:0.0:1777051563.291707:0:46498:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f16b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+8:3679:x1863365452748032:12345-0@lo:400:kworker.0 Request processed in 75us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051563.291719:0:46498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8395 00000100:00100000:3.0:1777051563.292055:0:46500:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d9533bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0001-mdtlov_UUID+7:3677:x1863365452747264:12345-0@lo:41:osp-pre-0-1.0 Request processed in 454us (2514us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051563.292068:0:46500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8394 00000100:00100000:1.0:1777051563.292387:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94f51aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452748032:0@lo:400:kworker.0 00000100:00100000:1.0:1777051563.292405:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94f51bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452748544:0@lo:400:kworker.0 00000100:00100000:3.0:1777051563.292436:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051563.292462:0:6585:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d9533bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3677:x1863365452747136:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1135us (3206us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051563.292477:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051563.292478:0:46497:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452747776 00000100:00100000:0.0:1777051563.292489:0:46497:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452747776 00000100:00100000:2.0:1777051563.292490:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8393 00000100:00100000:2.0:1777051563.292540:0:6585:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452748544 00000100:00100000:2.0:1777051563.292548:0:6585:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452748544 00000100:00100000:1.0:1777051563.292567:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94f42fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3679:1863365452747520:0@lo:400:kworker.0 00000100:00100000:0.0:1777051563.292580:0:46497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13616 00000100:00100000:3.0:1777051563.292593:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f298000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3677:1863365452747136:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1777051563.292604:0:46497:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d9533bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:lustre-MDT0000-lwp-OST0001_UUID+5:3677:x1863365452747776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777051563.292626:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8396 00000100:00100000:2.0:1777051563.292646:0:6585:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f16a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3679:x1863365452748544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051563.292664:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d944e11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452747264:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1777051563.292697:0:46497:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d9533bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:lustre-MDT0000-lwp-OST0001_UUID+5:3677:x1863365452747776:12345-0@lo:400:kworker.0 Request processed in 102us (273us total) trans 0 rc 0/0 00000100:00080000:1.0:1777051563.292707:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1777051563.292709:0:46497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13616 00000100:00080000:1.0:1777051563.292721:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1777051563.292730:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94f519180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3677:1863365452747776:0@lo:400:kworker.0 00000100:00080000:1.0:1777051563.292733:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1777051563.292757:0:6585:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f16a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3679:x1863365452748544:12345-0@lo:400:kworker.0 Request processed in 114us (284us total) trans 0 rc 0/0 00000100:00080000:1.0:1777051563.292762:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1777051563.292798:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8396 00000100:00100000:1.0:1777051563.292877:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94f51bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452748544:0@lo:400:kworker.0 00000100:00100000:0.0:1777051563.292903:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94f518e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452748288:0@lo:400:kworker.0 00000100:00100000:0.0:1777051563.292922:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94f51a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3678:1863365452748800:0@lo:400:kworker.0 00000100:00100000:0.0:1777051563.292946:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94f51b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3678:1863365452747904:0@lo:400:kworker.0 00000100:00100000:0.0:1777051563.292968:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94f519f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3678:1863365452748416:0@lo:400:kworker.0 00000100:00100000:0.0:1777051563.292987:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94f519c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3678:1863365452748928:0@lo:400:kworker.0 00000100:00100000:0.0:1777051563.292999:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94f42d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3678:1863365452747392:0@lo:400:kworker.0 00000100:00100000:1.0:1777051563.798511:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d9533bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452749056:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1777051563.798655:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051563.799068:0:8473:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452749056 00000100:00100000:3.0:1777051563.799085:0:8473:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452749056 00000100:00100000:3.0:1777051563.799198:0:8473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5762 00000100:00100000:3.0:1777051563.799221:0:8473:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f519c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3679:x1863365452749056:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1777051563.799272:0:8473:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 515963584 pending 0 free 3860574208 avail 3629051904 00000100:00100000:3.0:1777051563.799411:0:8473:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f519c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3679:x1863365452749056:12345-0@lo:13:osp-pre-0-0.0 Request processed in 196us (756us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051563.799428:0:8473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5762 00000100:00100000:1.0:1777051563.799504:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d9533bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452749056:0@lo:13:osp-pre-0-0.0 00000004:00080000:0.0:1777051563.800026:0:109196:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 8192992825738ns, next at 8193992821461ns, rc = 0 00000100:00100000:0.0:1777051563.800102:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f298000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3680:1863365452749184:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1777051563.800309:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051563.800400:0:8472:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452749184 00000100:00100000:0.0:1777051563.800415:0:8472:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452749184 00000100:00100000:0.0:1777051563.800507:0:8472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5763 00000100:00100000:0.0:1777051563.800527:0:8472:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f519f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3680:x1863365452749184:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1777051563.800569:0:8472:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 489208512 pending 0 free 3642707968 avail 3411185664 00000100:00100000:0.0:1777051563.800676:0:8472:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f519f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3680:x1863365452749184:12345-0@lo:13:osp-pre-1-0.0 Request processed in 153us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051563.800699:0:8472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5763 00000100:00100000:1.0:1777051563.800792:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f298000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3680:1863365452749184:0@lo:13:osp-pre-1-0.0 00000020:00000080:1.0:1777051564.173859:0:111659:0:(class_obd.c:319:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc1109ffb0 20000000:00000080:1.0:1777051564.173877:0:111659:0:(mgs_handler.c:1163:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff99da7c9f4c00 uarg=0000000000000000 20000000:01000000:1.0:1777051564.173937:0:111659:0:(mgs_llog.c:6175:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=shutdown' 20000000:01000000:1.0:1777051564.173946:0:111659:0:(mgs_llog.c:4637:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=shutdown' 20000000:01000000:1.0:1777051564.173954:0:111659:0:(mgs_llog.c:1366:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=shutdown del=0 00000040:00080000:1.0:1777051564.174663:0:111660:0:(llog.c:858:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 27 count 43 20000000:02000000:2.0:1777051564.174850:0:111659:0:(mgs_llog.c:4110:mgs_wlp_lcfg()) Modifying parameter lustre.mdt.lustre-MDT0000.hsm_control=shutdown in log params 00010000:00010000:3.0:1777051564.182506:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1777051564.195686:0:111659:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].44, 224 off16608 00000040:00080000:3.0:1777051564.195803:0:111659:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].45, 128 off16736 00000040:00080000:3.0:1777051564.195849:0:111659:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].46, 224 off16960 10000000:01000000:3.0:1777051564.195880:0:111659:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1777051564.195908:0:111659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99da7d5cf000/0x85f51a6b967182b4 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 111659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051564.195940:0:111659:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99da7d774c00/0x85f51a6b96717857 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b96717850 expref: 22 pid: 109182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051564.195956:0:111659:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99d950711600/0x85f51a6b967178d5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b967178ce expref: 22 pid: 109186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051564.195966:0:111659:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99d94ffbc600/0x85f51a6b967178ff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b967178f8 expref: 22 pid: 109180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051564.195974:0:111659:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99d953284c00/0x85f51a6b96717929 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b96717922 expref: 22 pid: 109180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051564.195985:0:111659:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99d94e6e7200/0x85f51a6b96717999 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6a5c expref: 11 pid: 109180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051564.195994:0:111659:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99da5f900600/0x85f51a6b967179ae lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6a71 expref: 11 pid: 109184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051564.196003:0:111659:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99da7d5cf000/0x85f51a6b967182b4 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 111659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051564.196055:0:111659:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99da5f900600/0x85f51a6b967179ae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6a71 expref: 11 pid: 109184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051564.196082:0:111659:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99da5f900600/0x85f51a6b967179ae lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6a71 expref: 11 pid: 109184 timeout: 8293 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051564.196109:0:111659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d9533bed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:111659:1863365452749312:192.168.201.46@tcp:104: 00010000:00010000:3.0:1777051564.196332:0:111659:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99d94e6e7200/0x85f51a6b96717999 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6a5c expref: 11 pid: 109180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051564.196345:0:111659:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99d94e6e7200/0x85f51a6b96717999 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6a5c expref: 11 pid: 109180 timeout: 8293 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051564.196358:0:111659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d944e11500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:111659:1863365452749440:192.168.201.46@tcp:104: 00010000:00010000:3.0:1777051564.196422:0:111659:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99d953284c00/0x85f51a6b96717929 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x85f51a6b96717922 expref: 22 pid: 109180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051564.196439:0:111659:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99d953284c00/0x85f51a6b96717929 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x85f51a6b96717922 expref: 22 pid: 109180 timeout: 8293 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051564.196460:0:111659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d950265f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:111659:1863365452749568:0@lo:104: 00000100:00100000:3.0:1777051564.196524:0:111659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1777051564.196581:0:111659:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99d94ffbc600/0x85f51a6b967178ff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x85f51a6b967178f8 expref: 22 pid: 109180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051564.196600:0:111659:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99d94ffbc600/0x85f51a6b967178ff lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x85f51a6b967178f8 expref: 22 pid: 109180 timeout: 8293 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051564.196618:0:111659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d950265880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:111659:1863365452749696:0@lo:104: 00000100:00100000:3.0:1777051564.196653:0:111659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1777051564.196695:0:111659:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99d950711600/0x85f51a6b967178d5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x85f51a6b967178ce expref: 22 pid: 109186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051564.196712:0:111659:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99d950711600/0x85f51a6b967178d5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x85f51a6b967178ce expref: 22 pid: 109186 timeout: 8293 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051564.196728:0:111659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d950267b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:111659:1863365452749824:0@lo:104: 00000100:00100000:3.0:1777051564.196801:0:111659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1777051564.196846:0:111659:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99da7d774c00/0x85f51a6b96717857 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x85f51a6b96717850 expref: 22 pid: 109182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051564.196865:0:111659:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99da7d774c00/0x85f51a6b96717857 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x85f51a6b96717850 expref: 22 pid: 109182 timeout: 8293 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051564.196885:0:111659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d950264700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:111659:1863365452749952:0@lo:104: 00000100:00100000:3.0:1777051564.196938:0:111659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051564.196985:0:111659:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d941b53b40 going to sleep for 11 seconds 00000100:00100000:0.0:1777051564.197743:0:6562:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452749568 00000100:00100000:0.0:1777051564.197784:0:6562:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452749568 00000100:00100000:0.0:1777051564.197840:0:6562:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452749696 00000100:00100000:0.0:1777051564.197846:0:6562:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452749696 00000100:00100000:0.0:1777051564.197865:0:6562:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452749824 00000100:00100000:0.0:1777051564.197870:0:6562:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452749824 00000100:00100000:0.0:1777051564.197886:0:6562:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452749952 00000100:00100000:0.0:1777051564.197890:0:6562:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452749952 00000100:00100000:0.0:1777051564.197915:0:6562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1777051564.197972:0:6562:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d950266d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f9351a01-5b0e-4470-97fd-58b9b4b312a2+6:111659:x1863365452749568:12345-0@lo:104: 00010000:00010000:0.0:1777051564.197997:0:6562:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.146@tcp lock: ffff99da7d775200/0x85f51a6b96717922 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x85f51a6b96717929 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051564.198143:0:6562:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1777051564.198156:0:6562:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d950266d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f9351a01-5b0e-4470-97fd-58b9b4b312a2+6:111659:x1863365452749568:12345-0@lo:104: Request processed in 209us (1633us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051564.198173:0:6562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1777051564.198251:0:6562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1777051564.198267:0:6562:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d950266a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f9351a01-5b0e-4470-97fd-58b9b4b312a2+5:111659:x1863365452749696:12345-0@lo:104: 00010000:00010000:0.0:1777051564.198284:0:6562:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.146@tcp lock: ffff99d94e6e7800/0x85f51a6b967178f8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x85f51a6b967178ff expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051564.198367:0:6562:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1777051564.198379:0:6562:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d950266a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f9351a01-5b0e-4470-97fd-58b9b4b312a2+5:111659:x1863365452749696:12345-0@lo:104: Request processed in 116us (1724us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051564.198395:0:6562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1777051564.198432:0:6562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00010000:00010000:1.0:1777051564.198442:0:6567:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:0.0:1777051564.198449:0:6562:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d950267800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f9351a01-5b0e-4470-97fd-58b9b4b312a2+4:111659:x1863365452749824:12345-0@lo:104: 00010000:00010000:1.0:1777051564.198458:0:6567:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.146@tcp lock: ffff99da7d775200/0x85f51a6b96717922 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x85f51a6b96717929 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051564.198470:0:6562:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.146@tcp lock: ffff99d94e6e6c00/0x85f51a6b967178ce lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x85f51a6b967178d5 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051564.198484:0:6567:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da7d775200 already unused, calling callback (ffffffffc1208c20) 10000000:00010000:1.0:1777051564.198498:0:6567:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.146@tcp lock: ffff99da7d775200/0x85f51a6b96717922 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x85f51a6b96717929 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051564.198519:0:6567:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.146@tcp lock: ffff99da7d775200/0x85f51a6b96717922 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x85f51a6b96717929 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1777051564.198535:0:6567:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.146@tcp lock: ffff99da7d775200/0x85f51a6b96717922 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x85f51a6b96717929 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1777051564.198549:0:6567:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1777051564.198554:0:6562:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1777051564.198569:0:6562:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d950267800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f9351a01-5b0e-4470-97fd-58b9b4b312a2+4:111659:x1863365452749824:12345-0@lo:104: Request processed in 124us (1767us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051564.198584:0:6562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00010000:00010000:1.0:1777051564.198603:0:6567:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.146@tcp lock: ffff99da7d775200/0x85f51a6b96717922 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x85f51a6b96717929 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051564.198618:0:6562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00010000:00010000:1.0:1777051564.198634:0:6567:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1777051564.198644:0:6562:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942d21c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f9351a01-5b0e-4470-97fd-58b9b4b312a2+3:111659:x1863365452749952:12345-0@lo:104: 00010000:00010000:0.0:1777051564.198667:0:6562:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.146@tcp lock: ffff99d950710200/0x85f51a6b96717850 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x85f51a6b96717857 expref: -99 pid: 109174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051564.198686:0:6567:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.146@tcp lock: ffff99da7d775200/0x85f51a6b96717922 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x85f51a6b96717929 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051564.198705:0:6567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.146@tcp lock: ffff99da7d775200/0x85f51a6b96717922 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x85f51a6b96717929 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051564.198734:0:6567:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1777051564.198744:0:6567:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.146@tcp lock: ffff99d94e6e7800/0x85f51a6b967178f8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x85f51a6b967178ff expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051564.198793:0:6562:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:1.0:1777051564.198812:0:6567:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94e6e7800 already unused, calling callback (ffffffffc1208c20) 00000100:00100000:0.0:1777051564.198814:0:6562:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942d21c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f9351a01-5b0e-4470-97fd-58b9b4b312a2+3:111659:x1863365452749952:12345-0@lo:104: Request processed in 175us (1874us total) trans 0 rc 0/0 10000000:00010000:1.0:1777051564.198826:0:6567:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.146@tcp lock: ffff99d94e6e7800/0x85f51a6b967178f8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x85f51a6b967178ff expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051564.198843:0:6562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00010000:00010000:1.0:1777051564.198864:0:6567:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.146@tcp lock: ffff99d94e6e7800/0x85f51a6b967178f8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x85f51a6b967178ff expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1777051564.198879:0:6567:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.146@tcp lock: ffff99d94e6e7800/0x85f51a6b967178f8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x85f51a6b967178ff expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1777051564.198892:0:6567:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1777051564.198899:0:38719:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1777051564.198914:0:38719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.146@tcp lock: ffff99d94e6e6c00/0x85f51a6b967178ce lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x85f51a6b967178d5 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051564.198932:0:6567:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.146@tcp lock: ffff99d94e6e7800/0x85f51a6b967178f8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x85f51a6b967178ff expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051564.198948:0:38719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d94e6e6c00 already unused, calling callback (ffffffffc1208c20) 00010000:00010000:1.0:1777051564.198959:0:6567:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 10000000:00010000:0.0:1777051564.198962:0:38719:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.146@tcp lock: ffff99d94e6e6c00/0x85f51a6b967178ce lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x85f51a6b967178d5 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051564.198979:0:6567:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.146@tcp lock: ffff99d94e6e7800/0x85f51a6b967178f8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x85f51a6b967178ff expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051564.198985:0:38719:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.146@tcp lock: ffff99d94e6e6c00/0x85f51a6b967178ce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x85f51a6b967178d5 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051564.199014:0:6567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.146@tcp lock: ffff99d94e6e7800/0x85f51a6b967178f8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x85f51a6b967178ff expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1777051564.199022:0:38719:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.146@tcp lock: ffff99d94e6e6c00/0x85f51a6b967178ce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x85f51a6b967178d5 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1777051564.199052:0:38719:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1777051564.199058:0:6567:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777051564.199068:0:6567:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.146@tcp lock: ffff99d950710200/0x85f51a6b96717850 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x85f51a6b96717857 expref: -99 pid: 109174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051564.199083:0:6567:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d950710200 already unused, calling callback (ffffffffc1208c20) 10000000:00010000:1.0:1777051564.199091:0:6567:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.146@tcp lock: ffff99d950710200/0x85f51a6b96717850 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x85f51a6b96717857 expref: -99 pid: 109174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051564.199094:0:38719:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.146@tcp lock: ffff99d94e6e6c00/0x85f51a6b967178ce lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x85f51a6b967178d5 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051564.199108:0:108751:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777051564.199138:0:38719:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1777051564.199138:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94f51a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3678:1863365452750208:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1777051564.199185:0:38719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.146@tcp lock: ffff99d94e6e6c00/0x85f51a6b967178ce lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x85f51a6b967178d5 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051564.199254:0:38719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.146@tcp lock: ffff99d94e6e6c00/0x85f51a6b967178ce lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x85f51a6b967178d5 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051564.199271:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1777051564.199295:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777051564.199303:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777051564.199311:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1777051564.199339:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f298e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3679:1863365452750336:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1777051564.199351:0:3678:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1777051564.199374:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94f51b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3678:1863365452750080:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1777051564.199405:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1777051564.199406:0:6567:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.146@tcp lock: ffff99d950710200/0x85f51a6b96717850 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x85f51a6b96717857 expref: -99 pid: 109174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1777051564.199467:0:6567:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.146@tcp lock: ffff99d950710200/0x85f51a6b96717850 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x85f51a6b96717857 expref: -99 pid: 109174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1777051564.199481:0:6567:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1777051564.199514:0:6567:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.146@tcp lock: ffff99d950710200/0x85f51a6b96717850 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x85f51a6b96717857 expref: -99 pid: 109174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051564.199527:0:6567:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1777051564.199541:0:6567:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.146@tcp lock: ffff99d950710200/0x85f51a6b96717850 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x85f51a6b96717857 expref: -99 pid: 109174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051564.199554:0:6567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.146@tcp lock: ffff99d950710200/0x85f51a6b96717850 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x85f51a6b96717857 expref: -99 pid: 109174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051564.199579:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051564.199583:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051564.199586:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1777051564.199648:0:6566:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452750208 00000100:00100000:1.0:1777051564.199657:0:6566:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452750208 00010000:00010000:1.0:1777051564.199694:0:6566:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99d94ffbc600/0x85f51a6b967178ff lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x85f51a6b967178f8 expref: 23 pid: 109180 timeout: 8293 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051564.199740:0:6566:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452750336 00000100:00100000:1.0:1777051564.199747:0:6566:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452750336 00010000:00010000:1.0:1777051564.199808:0:6566:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99d950711600/0x85f51a6b967178d5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x85f51a6b967178ce expref: 24 pid: 109186 timeout: 8293 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051564.199876:0:6566:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4003 00000100:00100000:0.0:1777051564.199898:0:3679:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1777051564.199902:0:6566:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5fbec000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f9351a01-5b0e-4470-97fd-58b9b4b312a2+24:3678:x1863365452750208:12345-0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1777051564.199905:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051564.199923:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94f518e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3679:1863365452750464:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1777051564.199923:0:111659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d950265f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:111659:1863365452749568:0@lo:104: 00010000:00010000:1.0:1777051564.199934:0:6566:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1777051564.199951:0:6566:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99d94ffbc600/0x85f51a6b967178ff lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x85f51a6b967178f8 expref: 24 pid: 109180 timeout: 8293 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051564.199958:0:111659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d950265880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:111659:1863365452749696:0@lo:104: 00010000:00010000:1.0:1777051564.199993:0:6566:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99d94ffbc600/0x85f51a6b967178ff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x85f51a6b967178f8 expref: 24 pid: 109180 timeout: 8293 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051564.199994:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777051564.200002:0:111659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d950267b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:111659:1863365452749824:0@lo:104: 00000100:00100000:0.0:1777051564.200030:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051564.200030:0:111659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d950264700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:111659:1863365452749952:0@lo:104: 00010000:00010000:1.0:1777051564.200056:0:6566:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d94ffbc600/0x85f51a6b967178ff lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x85f51a6b967178f8 expref: 24 pid: 109180 timeout: 8293 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051564.200078:0:6565:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452750080 00010000:00010000:1.0:1777051564.200088:0:6566:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1777051564.200092:0:6565:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452750080 00000100:00100000:0.0:1777051564.200110:0:6564:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452750464 00000100:00100000:0.0:1777051564.200122:0:6564:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452750464 00010000:00010000:2.0:1777051564.200143:0:6565:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99d953284c00/0x85f51a6b96717929 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x85f51a6b96717922 expref: 25 pid: 109180 timeout: 8293 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051564.200162:0:6564:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99da7d774c00/0x85f51a6b96717857 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x85f51a6b96717850 expref: 25 pid: 109182 timeout: 8293 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051564.200226:0:6565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4004 00000100:00100000:0.0:1777051564.200244:0:6564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4005 00000100:00100000:2.0:1777051564.200254:0:6565:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f29a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f9351a01-5b0e-4470-97fd-58b9b4b312a2+25:3679:x1863365452750336:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1777051564.200272:0:6566:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5fbec000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f9351a01-5b0e-4470-97fd-58b9b4b312a2+25:3678:x1863365452750208:12345-0@lo:103:ldlm_bl.0 Request processed in 310us (941us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051564.200273:0:6564:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5fbec700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f9351a01-5b0e-4470-97fd-58b9b4b312a2+25:3678:x1863365452750080:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1777051564.200282:0:6565:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777051564.200303:0:6565:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99d950711600/0x85f51a6b967178d5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x85f51a6b967178ce expref: 25 pid: 109186 timeout: 8293 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051564.200312:0:6564:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1777051564.200312:0:6566:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4003 00010000:00010000:0.0:1777051564.200329:0:6564:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99d953284c00/0x85f51a6b96717929 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x85f51a6b96717922 expref: 25 pid: 109180 timeout: 8293 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051564.200364:0:6566:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4006 00010000:00010000:2.0:1777051564.200369:0:6565:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99d950711600/0x85f51a6b967178d5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x85f51a6b967178ce expref: 24 pid: 109186 timeout: 8293 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051564.200385:0:6566:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f29ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f9351a01-5b0e-4470-97fd-58b9b4b312a2+24:3679:x1863365452750464:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1777051564.200412:0:6564:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99d953284c00/0x85f51a6b96717929 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x85f51a6b96717922 expref: 24 pid: 109180 timeout: 8293 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051564.200415:0:6566:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1777051564.200433:0:6566:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99da7d774c00/0x85f51a6b96717857 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x85f51a6b96717850 expref: 24 pid: 109182 timeout: 8293 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051564.200462:0:6565:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d950711600/0x85f51a6b967178d5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x85f51a6b967178ce expref: 24 pid: 109186 timeout: 8293 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051564.200474:0:6564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d953284c00/0x85f51a6b96717929 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x85f51a6b96717922 expref: 24 pid: 109180 timeout: 8293 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051564.200477:0:6566:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99da7d774c00/0x85f51a6b96717857 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x85f51a6b96717850 expref: 24 pid: 109182 timeout: 8293 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051564.200534:0:6564:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1777051564.200553:0:6566:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99da7d774c00/0x85f51a6b96717857 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x85f51a6b96717850 expref: 22 pid: 109182 timeout: 8293 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051564.200554:0:6565:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1777051564.200597:0:6566:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1777051564.200630:0:6564:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5fbec700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f9351a01-5b0e-4470-97fd-58b9b4b312a2+21:3678:x1863365452750080:12345-0@lo:103:ldlm_bl.0 Request processed in 361us (734us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051564.200648:0:6564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4005 00000100:00100000:1.0:1777051564.200695:0:6566:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f29ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f9351a01-5b0e-4470-97fd-58b9b4b312a2+20:3679:x1863365452750464:12345-0@lo:103:ldlm_bl.0 Request processed in 313us (668us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051564.200714:0:6566:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4006 00000100:00100000:0.0:1777051564.200728:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94f518e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3679:1863365452750464:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1777051564.200804:0:6565:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f29a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f9351a01-5b0e-4470-97fd-58b9b4b312a2+19:3679:x1863365452750336:12345-0@lo:103:ldlm_bl.0 Request processed in 561us (1400us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051564.200820:0:6565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4004 00000100:00100000:0.0:1777051564.200828:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f298e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3679:1863365452750336:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1777051564.200828:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94f51b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3678:1863365452750080:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1777051564.200880:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94f51a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3678:1863365452750208:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1777051564.202701:0:111659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d9533bed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:111659:1863365452749312:192.168.201.46@tcp:104: 00000100:00100000:3.0:1777051564.202720:0:111659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d944e11500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:111659:1863365452749440:192.168.201.46@tcp:104: 00010000:00010000:3.0:1777051564.202800:0:111659:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99da7d5cf000/0x85f51a6b967182b4 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 111659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051564.204519:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051564.204620:0:47827:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426161664 00000100:00100000:3.0:1777051564.204631:0:47827:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426161664 00010000:00010000:3.0:1777051564.204671:0:47827:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99da5f900600/0x85f51a6b967179ae lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6a71 expref: 12 pid: 109184 timeout: 8293 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051564.204730:0:47827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 4007 00000100:00100000:3.0:1777051564.204748:0:47827:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f51bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:29c4352d-3260-4734-909d-9ea5de9e7fa4+12:2437:x1863365426161664:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1777051564.204809:0:47827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777051564.205156:0:47827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99da5f900600/0x85f51a6b967179ae lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6a71 expref: 12 pid: 109184 timeout: 8293 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051564.205181:0:47827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99da5f900600/0x85f51a6b967179ae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6a71 expref: 12 pid: 109184 timeout: 8293 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051564.205243:0:47827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99da5f900600/0x85f51a6b967179ae lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6a71 expref: 12 pid: 109184 timeout: 8293 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051564.205270:0:47827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1777051564.205347:0:47827:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f51bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:29c4352d-3260-4734-909d-9ea5de9e7fa4+11:2437:x1863365426161664:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 599us (827us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051564.205365:0:47827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 4007 00000100:00100000:1.0:1777051564.206511:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051564.206877:0:24467:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426161792 00000100:00100000:3.0:1777051564.206888:0:24467:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426161792 00010000:00010000:3.0:1777051564.206917:0:24467:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99d94e6e7200/0x85f51a6b96717999 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6a5c expref: 11 pid: 109180 timeout: 8293 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051564.206985:0:24467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 4008 00000100:00100000:3.0:1777051564.207002:0:24467:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f519180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:29c4352d-3260-4734-909d-9ea5de9e7fa4+11:2438:x1863365426161792:12345-192.168.201.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1777051564.207020:0:24467:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777051564.207031:0:24467:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99d94e6e7200/0x85f51a6b96717999 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6a5c expref: 11 pid: 109180 timeout: 8293 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051564.207053:0:24467:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99d94e6e7200/0x85f51a6b96717999 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6a5c expref: 11 pid: 109180 timeout: 8293 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051564.207077:0:24467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99d94e6e7200/0x85f51a6b96717999 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6a5c expref: 11 pid: 109180 timeout: 8293 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051564.207100:0:24467:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99da7d5cf000/0x85f51a6b967182b4 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 111659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051564.207117:0:24467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99da7d5cf000/0x85f51a6b967182b4 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 111659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051564.207137:0:24467:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99da7d5cf000/0x85f51a6b967182b4 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 111659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051564.207147:0:24467:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99da7d5cf000/0x85f51a6b967182b4 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 111659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051564.207506:0:24467:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99da7d5cf000/0x85f51a6b967182b4 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 111659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051564.207528:0:24467:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99da7d5cf000/0x85f51a6b967182b4 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 111659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051564.207541:0:24467:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da7d5cf000 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:3.0:1777051564.207549:0:24467:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99da7d5cf000/0x85f51a6b967182b4 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 111659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051564.207564:0:24467:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99da7d5cf000/0x85f51a6b967182b4 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 111659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051564.207596:0:24467:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99da7d5cf000/0x85f51a6b967182b4 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 111659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051564.207615:0:24467:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1777051564.207673:0:24467:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f519180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:29c4352d-3260-4734-909d-9ea5de9e7fa4+10:2438:x1863365426161792:12345-192.168.201.46@tcp:103:ldlm_bl.0 Request processed in 672us (1164us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051564.207688:0:24467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 4008 00010000:00010000:1.0:1777051564.207924:0:111659:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99da7d5cf000/0x85f51a6b967182b4 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 111659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051564.207949:0:111659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99da7d5cf000/0x85f51a6b967182b4 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 111659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051564.207964:0:111659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99da7d5cf000/0x85f51a6b967182b4 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 111659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051564.964159:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051564.964229:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051564.964278:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051564.964337:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051564.964360:0:8492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426161920 00000100:00100000:3.0:1777051564.964377:0:8492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426161920 00000100:00100000:2.0:1777051564.964398:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051564.964462:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051564.964685:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051564.964735:0:8492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426162048 00000100:00100000:3.0:1777051564.964772:0:8492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426162048 00000100:00100000:2.0:1777051564.964783:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051564.964839:0:8492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426162560 00000100:00100000:3.0:1777051564.964846:0:8492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426162560 00000100:00100000:2.0:1777051564.964856:0:8468:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426162304 00000100:00100000:2.0:1777051564.964866:0:8468:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426162304 00000100:00100000:3.0:1777051564.964913:0:8492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426162432 00000100:00100000:3.0:1777051564.964922:0:8492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426162432 00000100:00100000:2.0:1777051564.964945:0:8468:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426162176 00000100:00100000:2.0:1777051564.964954:0:8468:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426162176 00000100:00100000:3.0:1777051564.964993:0:8492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13617 00000100:00100000:2.0:1777051564.965013:0:8468:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426162816 00000100:00100000:3.0:1777051564.965018:0:8492:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5fbeed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+22:2439:x1863365426161920:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:2.0:1777051564.965021:0:8468:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426162816 00000100:00100000:2.0:1777051564.965067:0:8468:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426162688 00000100:00100000:2.0:1777051564.965074:0:8468:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426162688 00000100:00100000:2.0:1777051564.965121:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10635 00000100:00100000:2.0:1777051564.965136:0:8468:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7e24ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+30:2438:x1863365426162304:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:3.0:1777051564.965151:0:8492:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5fbeed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+22:2439:x1863365426161920:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 136us (998us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051564.965166:0:8492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13617 00000100:00100000:3.0:1777051564.965200:0:8492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13618 00000100:00100000:3.0:1777051564.965216:0:8492:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7e24d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+9:2438:x1863365426162048:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:2.0:1777051564.965243:0:8468:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7e24ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+30:2438:x1863365426162304:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 107us (960us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051564.965258:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10635 00000100:00100000:3.0:1777051564.965274:0:8492:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7e24d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c11b6966-0775-44d2-bdc6-c74c26eb2226+9:2438:x1863365426162048:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 58us (1038us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051564.965288:0:8492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13618 00000100:00100000:2.0:1777051564.965302:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10636 00000100:00100000:2.0:1777051564.965321:0:8468:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7e24df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+15:2439:x1863365426162176:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:3.0:1777051564.965325:0:8492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13619 00000100:00100000:3.0:1777051564.965352:0:8492:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da7e24ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+54:2438:x1863365426162560:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:2.0:1777051564.965396:0:8468:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7e24df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c11b6966-0775-44d2-bdc6-c74c26eb2226+15:2439:x1863365426162176:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 79us (1058us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051564.965409:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10636 00000100:00100000:2.0:1777051564.965434:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10637 00000100:00100000:2.0:1777051564.965447:0:8468:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d9418f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+14:2438:x1863365426162816:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:2.0:1777051564.965490:0:8468:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d9418f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+14:2438:x1863365426162816:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 46us (809us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051564.965501:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10637 00000100:00100000:2.0:1777051564.965527:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 10638 00000100:00100000:2.0:1777051564.965540:0:8468:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d9418f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+17:2439:x1863365426162688:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:2.0:1777051564.965587:0:8468:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d9418f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+17:2439:x1863365426162688:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 48us (807us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051564.965599:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 10638 00000100:00100000:2.0:1777051564.965695:0:10328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 13620 00000100:00100000:3.0:1777051564.965708:0:8492:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da7e24ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+54:2438:x1863365426162560:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 354us (1301us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051564.965722:0:10328:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d9418f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+26:2439:x1863365426162432:12345-192.168.201.46@tcp:400:kworker.0 00000100:00100000:3.0:1777051564.965733:0:8492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13619 00000100:00100000:2.0:1777051564.965816:0:10328:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d9418f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2dd4696c-edce-4cd1-86d2-dbd2ff957fa1+26:2439:x1863365426162432:12345-192.168.201.46@tcp:400:kworker.0 Request processed in 102us (1354us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051564.965831:0:10328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 13620 00000100:00080000:1.0:1777051564.966468:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1777051564.966476:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1777051564.966480:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1777051564.966485:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1777051565.207720:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1777051565.218591:0:111708:0:(class_obd.c:319:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd0941d000 20000000:00000080:2.0:1777051565.218616:0:111708:0:(mgs_handler.c:1163:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff99d941c0c000 uarg=0000000000000000 20000000:01000000:2.0:1777051565.218679:0:111708:0:(mgs_llog.c:6175:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0001.hsm_control=shutdown' 20000000:01000000:2.0:1777051565.218688:0:111708:0:(mgs_llog.c:4637:mgs_write_log_param2()) next param 'mdt.lustre-MDT0001.hsm_control=shutdown' 20000000:01000000:2.0:1777051565.218696:0:111708:0:(mgs_llog.c:1366:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0001.hsm_control=shutdown del=0 00000040:00080000:2.0:1777051565.219808:0:111709:0:(llog.c:858:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 30 count 46 20000000:02000000:0.0:1777051565.220084:0:111708:0:(mgs_llog.c:4110:mgs_wlp_lcfg()) Modifying parameter lustre.mdt.lustre-MDT0001.hsm_control=shutdown in log params 00000040:00080000:0.0:1777051565.220843:0:111708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].47, 224 off17184 00000040:00080000:0.0:1777051565.220894:0:111708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].48, 128 off17312 00000040:00080000:0.0:1777051565.220926:0:111708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].49, 224 off17536 10000000:01000000:0.0:1777051565.220951:0:111708:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1777051565.220981:0:111708:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99da4162e800/0x85f51a6b967182bb lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 111708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051565.221009:0:111708:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99da4162e800/0x85f51a6b967182bb lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 111708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051565.221026:0:111708:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99da4162e800/0x85f51a6b967182bb lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 111708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051565.221038:0:111708:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99da4162e800/0x85f51a6b967182bb lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 111708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051565.221051:0:111708:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99da4162e800/0x85f51a6b967182bb lrc: 3/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 111708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051565.221065:0:111708:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99da4162e800/0x85f51a6b967182bb lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 111708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051565.221077:0:111708:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99da4162e800 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:0.0:1777051565.221085:0:111708:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99da4162e800/0x85f51a6b967182bb lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 111708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051565.221099:0:111708:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99da4162e800/0x85f51a6b967182bb lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 111708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051565.221122:0:111708:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99da4162e800/0x85f51a6b967182bb lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 111708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051565.221137:0:111708:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99da4162e800/0x85f51a6b967182bb lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 111708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051565.221150:0:111708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99da4162e800/0x85f51a6b967182bb lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 111708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1777051565.782429:0:6577:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1777051565.782439:0:6577:0:(mgc_request.c:1799:mgc_process_log()) Process log params-ffff99da7b5f9800 from 43 10000000:01000000:2.0:1777051565.782446:0:6577:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1777051565.782507:0:6577:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.146@tcp lock: ffff99d94f69a800/0x85f51a6b967182c2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051565.782524:0:6577:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.146@tcp lock: ffff99d94f69a800/0x85f51a6b967182c2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051565.782541:0:6577:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.146@tcp lock: ffff99d94f69a800/0x85f51a6b967182c2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051565.782574:0:6577:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d9418f6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452750592:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1777051565.782665:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051565.783010:0:6577:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d94483a300 going to sleep for 11 seconds 00000100:00100000:3.0:1777051565.783045:0:109180:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452750592 00000100:00100000:3.0:1777051565.783057:0:109180:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452750592 00000100:00100000:3.0:1777051565.783439:0:109180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1777051565.783457:0:109180:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942db0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9351a01-5b0e-4470-97fd-58b9b4b312a2+19:6577:x1863365452750592:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1777051565.783476:0:109180:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777051565.783495:0:109180:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99da7d5cea00/0x85f51a6b967182c9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x85f51a6b967182c2 expref: -99 pid: 109180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051565.783529:0:109180:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99da7d5cea00/0x85f51a6b967182c9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x85f51a6b967182c2 expref: 20 pid: 109180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051565.783545:0:109180:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99da7d5cea00/0x85f51a6b967182c9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b967182c2 expref: 20 pid: 109180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051565.783557:0:109180:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99da7d5cea00, rc 0) 00000100:00100000:3.0:1777051565.783623:0:109180:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942db0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9351a01-5b0e-4470-97fd-58b9b4b312a2+20:6577:x1863365452750592:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 172us (959us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051565.783634:0:109180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1777051565.783722:0:6577:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d9418f6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452750592:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1777051565.783769:0:6577:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.146@tcp lock: ffff99d94f69a800/0x85f51a6b967182c2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b967182c9 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051565.783783:0:6577:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.146@tcp lock: ffff99d94f69a800/0x85f51a6b967182c2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x85f51a6b967182c9 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051565.783868:0:6577:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d9418f6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452750720:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1777051565.783908:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051565.783950:0:6577:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d94483a300 going to sleep for 11 seconds 00000100:00100000:3.0:1777051565.786836:0:109184:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452750720 00000100:00100000:3.0:1777051565.786845:0:109184:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452750720 00000100:00100000:3.0:1777051565.786908:0:109184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1777051565.786920:0:109184:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d941b74050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f9351a01-5b0e-4470-97fd-58b9b4b312a2+20:6577:x1863365452750720:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1777051565.787127:0:109184:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d941b74050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f9351a01-5b0e-4470-97fd-58b9b4b312a2+20:6577:x1863365452750720:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 208us (3217us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051565.787137:0:109184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1777051565.787360:0:6577:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d9418f6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452750720:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1777051565.787408:0:6577:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f298e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452750848:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1777051565.787490:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051565.787546:0:6577:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d950450300 going to sleep for 11 seconds 00000100:00100000:2.0:1777051565.787554:0:109181:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452750848 00000100:00100000:2.0:1777051565.787563:0:109181:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452750848 00000100:00100000:2.0:1777051565.787618:0:109181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1777051565.787629:0:109181:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d941b75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9351a01-5b0e-4470-97fd-58b9b4b312a2+20:6577:x1863365452750848:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1777051565.787772:0:109181:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d941b75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9351a01-5b0e-4470-97fd-58b9b4b312a2+20:6577:x1863365452750848:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 143us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051565.787792:0:109181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1777051565.787842:0:6577:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f298e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452750848:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1777051565.789045:0:111722:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d94f51aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f9351a01-5b0e-4470-97fd-58b9b4b312a2:111722:1863365452750976:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1777051565.789375:0:111722:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051565.789431:0:111722:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d959f17f00 going to sleep for 11 seconds 00000100:00100000:3.0:1777051565.789543:0:109184:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452750976 00000100:00100000:3.0:1777051565.789551:0:109184:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452750976 00000100:00100000:3.0:1777051565.789602:0:109184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1777051565.789615:0:109184:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d941b77050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f9351a01-5b0e-4470-97fd-58b9b4b312a2+20:111722:x1863365452750976:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1777051565.789819:0:109184:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d941b77050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f9351a01-5b0e-4470-97fd-58b9b4b312a2+20:111722:x1863365452750976:12345-0@lo:502:llog_process_th.0 Request processed in 205us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051565.789831:0:109184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1777051565.789985:0:111722:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d94f51aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f9351a01-5b0e-4470-97fd-58b9b4b312a2:111722:1863365452750976:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1777051565.790018:0:111722:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1777051565.790031:0:111722:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1777051565.790035:0:111722:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1777051565.790045:0:111722:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff99da7b5f9800 00000020:00000080:2.0:1777051565.790050:0:111722:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1777051565.790134:0:111722:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1777051565.790140:0:111722:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1777051565.790142:0:111722:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1777051565.790147:0:111722:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1777051565.790151:0:111722:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1777051565.790153:0:111722:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1777051565.790159:0:111722:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff99da7b5f9800 00000020:00000080:2.0:1777051565.790163:0:111722:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1777051565.790258:0:111722:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d9418f5c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f9351a01-5b0e-4470-97fd-58b9b4b312a2:111722:1863365452751104:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1777051565.790315:0:111722:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051565.790365:0:111722:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d94483acc0 going to sleep for 11 seconds 00000100:00100000:0.0:1777051565.790403:0:109180:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452751104 00000100:00100000:0.0:1777051565.790412:0:109180:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452751104 00000100:00100000:0.0:1777051565.790464:0:109180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1777051565.790479:0:109180:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d941b77850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9351a01-5b0e-4470-97fd-58b9b4b312a2+20:111722:x1863365452751104:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1777051565.790617:0:109180:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d941b77850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9351a01-5b0e-4470-97fd-58b9b4b312a2+20:111722:x1863365452751104:12345-0@lo:502:llog_process_th.0 Request processed in 141us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051565.790630:0:109180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1777051565.794520:0:111722:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d9418f5c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f9351a01-5b0e-4470-97fd-58b9b4b312a2:111722:1863365452751104:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1777051565.794573:0:111722:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1777051565.794583:0:111722:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1777051565.794586:0:111722:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1777051565.794592:0:111722:0:(llog.c:858:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 50 count 49 00000020:01000000:2.0:1777051565.794862:0:6577:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 43-49 (rc=0) 10000000:01000000:2.0:1777051565.794901:0:6577:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.201.146@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1777051565.794915:0:6577:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff99d94f69a800/0x85f51a6b967182c2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b967182c9 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051565.794933:0:6577:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.146@tcp lock: ffff99d94f69a800/0x85f51a6b967182c2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b967182c9 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1777051565.794950:0:6577:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1777051565.794955:0:6577:0:(mgc_request.c:1799:mgc_process_log()) Process log params-ffff99da7dbcc000 from 43 10000000:01000000:2.0:1777051565.794959:0:6577:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1777051565.794998:0:6577:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.146@tcp lock: ffff99d94f69aa00/0x85f51a6b967182d0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051565.795012:0:6577:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.146@tcp lock: ffff99d94f69aa00/0x85f51a6b967182d0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051565.795028:0:6577:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.146@tcp lock: ffff99d94f69aa00/0x85f51a6b967182d0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051565.795057:0:6577:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d9418f5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452751232:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1777051565.795121:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051565.795169:0:6577:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d94483a900 going to sleep for 11 seconds 00000100:00100000:2.0:1777051565.795192:0:109182:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452751232 00000100:00100000:2.0:1777051565.795249:0:109182:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452751232 00000100:00100000:2.0:1777051565.795310:0:109182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1777051565.795325:0:109182:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d941b76c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9351a01-5b0e-4470-97fd-58b9b4b312a2+20:6577:x1863365452751232:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1777051565.795341:0:109182:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051565.795360:0:109182:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d94f69a400/0x85f51a6b967182d7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x85f51a6b967182d0 expref: -99 pid: 109182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051565.795393:0:109182:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d94f69a400/0x85f51a6b967182d7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x85f51a6b967182d0 expref: 21 pid: 109182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051565.795410:0:109182:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d94f69a400/0x85f51a6b967182d7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b967182d0 expref: 21 pid: 109182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051565.795422:0:109182:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d94f69a400, rc 0) 00000100:00100000:2.0:1777051565.795479:0:109182:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d941b76c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9351a01-5b0e-4470-97fd-58b9b4b312a2+21:6577:x1863365452751232:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 158us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051565.795533:0:109182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1777051565.795593:0:6577:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d9418f5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452751232:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1777051565.795612:0:6577:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.146@tcp lock: ffff99d94f69aa00/0x85f51a6b967182d0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b967182d7 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051565.795636:0:6577:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.146@tcp lock: ffff99d94f69aa00/0x85f51a6b967182d0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x85f51a6b967182d7 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051565.795986:0:6577:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d9418f5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452751360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1777051565.796033:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051565.796056:0:6577:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d94483a900 going to sleep for 11 seconds 00000100:00100000:2.0:1777051565.796087:0:109186:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452751360 00000100:00100000:2.0:1777051565.796093:0:109186:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452751360 00000100:00100000:2.0:1777051565.796137:0:109186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1777051565.796150:0:109186:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d941b74c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f9351a01-5b0e-4470-97fd-58b9b4b312a2+21:6577:x1863365452751360:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1777051565.796311:0:109186:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d941b74c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f9351a01-5b0e-4470-97fd-58b9b4b312a2+21:6577:x1863365452751360:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 162us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051565.796322:0:109186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1777051565.796393:0:6577:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d9418f5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452751360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1777051565.796442:0:6577:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d9418f5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452751488:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1777051565.796504:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051565.796534:0:6577:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d94483a900 going to sleep for 11 seconds 00000100:00100000:2.0:1777051565.796557:0:109181:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452751488 00000100:00100000:2.0:1777051565.796563:0:109181:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452751488 00000100:00100000:2.0:1777051565.796606:0:109181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1777051565.796620:0:109181:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d941b76050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9351a01-5b0e-4470-97fd-58b9b4b312a2+21:6577:x1863365452751488:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1777051565.796761:0:109181:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d941b76050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9351a01-5b0e-4470-97fd-58b9b4b312a2+21:6577:x1863365452751488:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 144us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051565.796771:0:109181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1777051565.796827:0:6577:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d9418f5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452751488:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1777051565.797044:0:111724:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d9418f5c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f9351a01-5b0e-4470-97fd-58b9b4b312a2:111724:1863365452751616:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1777051565.797097:0:111724:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051565.797129:0:109186:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452751616 00000100:00100000:2.0:1777051565.797135:0:109186:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452751616 00000100:00100000:2.0:1777051565.797474:0:109186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1777051565.797487:0:109186:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d941b75050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f9351a01-5b0e-4470-97fd-58b9b4b312a2+21:111724:x1863365452751616:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1777051565.797591:0:109186:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d941b75050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f9351a01-5b0e-4470-97fd-58b9b4b312a2+21:111724:x1863365452751616:12345-0@lo:502:llog_process_th.0 Request processed in 108us (492us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051565.797601:0:109186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1777051565.797651:0:111724:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d94483a240 going to sleep for 11 seconds 00000100:00100000:2.0:1777051565.797674:0:111724:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d9418f5c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f9351a01-5b0e-4470-97fd-58b9b4b312a2:111724:1863365452751616:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1777051565.797707:0:111724:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1777051565.797718:0:111724:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1777051565.797721:0:111724:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1777051565.799462:0:111724:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff99da7dbcc000 00000020:00000080:2.0:1777051565.799468:0:111724:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1777051565.799542:0:111724:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1777051565.799548:0:111724:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1777051565.799551:0:111724:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1777051565.799556:0:111724:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1777051565.799560:0:111724:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1777051565.799563:0:111724:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1777051565.799567:0:111724:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff99da7dbcc000 00000020:00000080:2.0:1777051565.799570:0:111724:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1777051565.799617:0:111724:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d9418f5c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f9351a01-5b0e-4470-97fd-58b9b4b312a2:111724:1863365452751744:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1777051565.799668:0:111724:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051565.799714:0:111724:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d94483a240 going to sleep for 11 seconds 00000100:00100000:1.0:1777051565.800060:0:109184:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452751744 00000100:00100000:1.0:1777051565.800070:0:109184:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452751744 00000100:00100000:1.0:1777051565.800124:0:109184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1777051565.800395:0:109184:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d941b77c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f9351a01-5b0e-4470-97fd-58b9b4b312a2+21:111724:x1863365452751744:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1777051565.800534:0:109184:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d941b77c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f9351a01-5b0e-4470-97fd-58b9b4b312a2+21:111724:x1863365452751744:12345-0@lo:502:llog_process_th.0 Request processed in 144us (865us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051565.800542:0:109184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1777051565.801189:0:111724:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d9418f5c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f9351a01-5b0e-4470-97fd-58b9b4b312a2:111724:1863365452751744:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1777051565.801260:0:111724:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1777051565.801267:0:111724:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1777051565.801269:0:111724:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1777051565.801274:0:111724:0:(llog.c:858:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 50 count 49 00000020:01000000:3.0:1777051565.801523:0:6577:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 43-49 (rc=0) 10000000:01000000:3.0:1777051565.801554:0:6577:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.201.146@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1777051565.801565:0:6577:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff99d94f69aa00/0x85f51a6b967182d0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b967182d7 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051565.801579:0:6577:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.146@tcp lock: ffff99d94f69aa00/0x85f51a6b967182d0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b967182d7 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1777051565.801592:0:6577:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1777051565.801595:0:6577:0:(mgc_request.c:1799:mgc_process_log()) Process log params-ffff99d941839800 from 43 10000000:01000000:3.0:1777051565.801599:0:6577:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1777051565.801626:0:6577:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.146@tcp lock: ffff99da7d5cf600/0x85f51a6b967182de lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051565.801638:0:6577:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.146@tcp lock: ffff99da7d5cf600/0x85f51a6b967182de lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051565.801652:0:6577:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.146@tcp lock: ffff99da7d5cf600/0x85f51a6b967182de lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051565.801675:0:6577:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d942d20700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452751872:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1777051565.801718:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051565.801836:0:6577:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d941b53c00 going to sleep for 11 seconds 00000100:00100000:2.0:1777051565.801891:0:109182:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452751872 00000100:00100000:2.0:1777051565.801898:0:109182:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452751872 00000100:00100000:2.0:1777051565.801947:0:109182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1777051565.801965:0:109182:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d941b76450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9351a01-5b0e-4470-97fd-58b9b4b312a2+21:6577:x1863365452751872:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1777051565.801977:0:109182:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051565.801991:0:109182:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d94f69bc00/0x85f51a6b967182e5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x85f51a6b967182de expref: -99 pid: 109182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051565.802017:0:109182:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d94f69bc00/0x85f51a6b967182e5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x85f51a6b967182de expref: 22 pid: 109182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051565.802031:0:109182:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d94f69bc00/0x85f51a6b967182e5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b967182de expref: 22 pid: 109182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051565.802043:0:109182:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d94f69bc00, rc 0) 00000100:00100000:2.0:1777051565.802110:0:109182:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d941b76450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9351a01-5b0e-4470-97fd-58b9b4b312a2+22:6577:x1863365452751872:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 145us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051565.802121:0:109182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1777051565.802535:0:6577:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d942d20700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452751872:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1777051565.802555:0:6577:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.146@tcp lock: ffff99da7d5cf600/0x85f51a6b967182de lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b967182e5 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051565.802569:0:6577:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.146@tcp lock: ffff99da7d5cf600/0x85f51a6b967182de lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x85f51a6b967182e5 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777051565.802656:0:6577:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d942d20700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452752000:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1777051565.802708:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051565.802767:0:6577:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d941b53c00 going to sleep for 11 seconds 00000100:00100000:2.0:1777051565.802850:0:109180:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452752000 00000100:00100000:2.0:1777051565.802858:0:109180:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452752000 00000100:00100000:2.0:1777051565.802908:0:109180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1777051565.802928:0:109180:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5cdbc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9351a01-5b0e-4470-97fd-58b9b4b312a2+22:6577:x1863365452752000:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1777051565.803033:0:109180:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5cdbc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9351a01-5b0e-4470-97fd-58b9b4b312a2+22:6577:x1863365452752000:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 106us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051565.803044:0:109180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1777051565.803292:0:6577:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d942d20700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452752000:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1777051565.803332:0:6577:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d942d20700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452752128:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1777051565.803413:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051565.803461:0:6577:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d941b53c00 going to sleep for 11 seconds 00000100:00100000:2.0:1777051565.803531:0:109181:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452752128 00000100:00100000:2.0:1777051565.803537:0:109181:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452752128 00000100:00100000:2.0:1777051565.803584:0:109181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1777051565.803596:0:109181:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5cdbd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9351a01-5b0e-4470-97fd-58b9b4b312a2+22:6577:x1863365452752128:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1777051565.803722:0:109181:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5cdbd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9351a01-5b0e-4470-97fd-58b9b4b312a2+22:6577:x1863365452752128:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 127us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051565.804085:0:109181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1777051565.804128:0:6577:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d942d20700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452752128:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1777051565.804859:0:111726:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d942d20700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f9351a01-5b0e-4470-97fd-58b9b4b312a2:111726:1863365452752256:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1777051565.804923:0:111726:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051565.805045:0:111726:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d941b53f00 going to sleep for 11 seconds 00000100:00100000:2.0:1777051565.805107:0:109182:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452752256 00000100:00100000:2.0:1777051565.805114:0:109182:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452752256 00000100:00100000:2.0:1777051565.805591:0:109182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1777051565.805606:0:109182:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5cdbcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9351a01-5b0e-4470-97fd-58b9b4b312a2+22:111726:x1863365452752256:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1777051565.806032:0:109182:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5cdbcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9351a01-5b0e-4470-97fd-58b9b4b312a2+22:111726:x1863365452752256:12345-0@lo:502:llog_process_th.0 Request processed in 428us (1108us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051565.806046:0:109182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1777051565.806175:0:111726:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d942d20700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f9351a01-5b0e-4470-97fd-58b9b4b312a2:111726:1863365452752256:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1777051565.806449:0:111726:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1777051565.806462:0:111726:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1777051565.806467:0:111726:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1777051565.806480:0:111726:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff99d941839800 00000020:00000080:3.0:1777051565.806485:0:111726:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1777051565.806581:0:111726:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1777051565.806588:0:111726:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1777051565.806592:0:111726:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1777051565.806600:0:111726:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1777051565.806605:0:111726:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1777051565.806609:0:111726:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1777051565.806617:0:111726:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff99d941839800 00000020:00000080:3.0:1777051565.806622:0:111726:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1777051565.806702:0:111726:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d942d20700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f9351a01-5b0e-4470-97fd-58b9b4b312a2:111726:1863365452752384:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1777051565.806867:0:111726:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051565.806909:0:111726:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d941b53f00 going to sleep for 11 seconds 00000100:00100000:2.0:1777051565.806980:0:109182:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452752384 00000100:00100000:2.0:1777051565.806987:0:109182:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452752384 00000100:00100000:2.0:1777051565.807036:0:109182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1777051565.807049:0:109182:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5cdbf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9351a01-5b0e-4470-97fd-58b9b4b312a2+22:111726:x1863365452752384:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1777051565.807480:0:109182:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5cdbf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9351a01-5b0e-4470-97fd-58b9b4b312a2+22:111726:x1863365452752384:12345-0@lo:502:llog_process_th.0 Request processed in 433us (612us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051565.807494:0:109182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1777051565.807511:0:111726:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d942d20700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f9351a01-5b0e-4470-97fd-58b9b4b312a2:111726:1863365452752384:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1777051565.807552:0:111726:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1777051565.807561:0:111726:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1777051565.807565:0:111726:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1777051565.807574:0:111726:0:(llog.c:858:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 50 count 49 00000020:01000000:2.0:1777051565.808375:0:6577:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 43-49 (rc=0) 10000000:01000000:2.0:1777051565.808428:0:6577:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.201.146@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1777051565.808441:0:6577:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff99da7d5cf600/0x85f51a6b967182de lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b967182e5 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051565.808457:0:6577:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.146@tcp lock: ffff99da7d5cf600/0x85f51a6b967182de lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b967182e5 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1777051565.808472:0:6577:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1777051565.808476:0:6577:0:(mgc_request.c:1799:mgc_process_log()) Process log params-ffff99da44f8d000 from 43 10000000:01000000:2.0:1777051565.808479:0:6577:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1777051565.808521:0:6577:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.146@tcp lock: ffff99d94f69b800/0x85f51a6b967182ec lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051565.808534:0:6577:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.146@tcp lock: ffff99d94f69b800/0x85f51a6b967182ec lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051565.808548:0:6577:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.146@tcp lock: ffff99d94f69b800/0x85f51a6b967182ec lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051565.808573:0:6577:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d9418f5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452752512:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1777051565.808631:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051565.808706:0:6577:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d94483ae40 going to sleep for 11 seconds 00000100:00100000:3.0:1777051565.809482:0:109181:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452752512 00000100:00100000:3.0:1777051565.809490:0:109181:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452752512 00000100:00100000:3.0:1777051565.809552:0:109181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1777051565.809565:0:109181:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5cdbe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9351a01-5b0e-4470-97fd-58b9b4b312a2+22:6577:x1863365452752512:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1777051565.809580:0:109181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777051565.809600:0:109181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99da7d5cf000/0x85f51a6b967182f3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x85f51a6b967182ec expref: -99 pid: 109181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051565.809649:0:109181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99da7d5cf000/0x85f51a6b967182f3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x85f51a6b967182ec expref: 23 pid: 109181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051565.809664:0:109181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99da7d5cf000/0x85f51a6b967182f3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x85f51a6b967182ec expref: 23 pid: 109181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051565.809677:0:109181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99da7d5cf000, rc 0) 00000100:00100000:3.0:1777051565.809757:0:109181:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5cdbe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9351a01-5b0e-4470-97fd-58b9b4b312a2+23:6577:x1863365452752512:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 195us (1128us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051565.809767:0:109181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1777051565.810115:0:6577:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d9418f5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452752512:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1777051565.810136:0:6577:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.146@tcp lock: ffff99d94f69b800/0x85f51a6b967182ec lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b967182f3 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051565.810150:0:6577:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.146@tcp lock: ffff99d94f69b800/0x85f51a6b967182ec lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x85f51a6b967182f3 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777051565.810221:0:6577:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d9418f5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452752640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1777051565.810267:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051565.810311:0:6577:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d94483ae40 going to sleep for 11 seconds 00000100:00100000:3.0:1777051565.811016:0:109182:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452752640 00000100:00100000:3.0:1777051565.811026:0:109182:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452752640 00000100:00100000:3.0:1777051565.811091:0:109182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1777051565.811105:0:109182:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5fcd7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9351a01-5b0e-4470-97fd-58b9b4b312a2+23:6577:x1863365452752640:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1777051565.811271:0:109182:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5fcd7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9351a01-5b0e-4470-97fd-58b9b4b312a2+23:6577:x1863365452752640:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 168us (1003us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051565.811284:0:109182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1777051565.811371:0:6577:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d9418f5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452752640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1777051565.811424:0:6577:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f298e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452752768:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1777051565.811516:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051565.811557:0:6577:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d950450600 going to sleep for 11 seconds 00000100:00100000:2.0:1777051565.811664:0:109180:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452752768 00000100:00100000:2.0:1777051565.811671:0:109180:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452752768 00000100:00100000:2.0:1777051565.811724:0:109180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1777051565.811759:0:109180:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5fcd7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9351a01-5b0e-4470-97fd-58b9b4b312a2+23:6577:x1863365452752768:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1777051565.811869:0:109180:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5fcd7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9351a01-5b0e-4470-97fd-58b9b4b312a2+23:6577:x1863365452752768:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 111us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051565.811880:0:109180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1777051565.811998:0:6577:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f298e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9351a01-5b0e-4470-97fd-58b9b4b312a2:6577:1863365452752768:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1777051565.812757:0:111727:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d942d21880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f9351a01-5b0e-4470-97fd-58b9b4b312a2:111727:1863365452752896:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1777051565.812818:0:111727:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051565.812867:0:111727:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d941b539c0 going to sleep for 11 seconds 00000100:00100000:2.0:1777051565.812910:0:109181:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452752896 00000100:00100000:2.0:1777051565.812919:0:109181:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452752896 00000100:00100000:2.0:1777051565.812975:0:109181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1777051565.812987:0:109181:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5fcd5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9351a01-5b0e-4470-97fd-58b9b4b312a2+23:111727:x1863365452752896:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1777051565.813152:0:109181:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5fcd5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9351a01-5b0e-4470-97fd-58b9b4b312a2+23:111727:x1863365452752896:12345-0@lo:502:llog_process_th.0 Request processed in 141us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051565.813165:0:109181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1777051565.813446:0:111727:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d942d21880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f9351a01-5b0e-4470-97fd-58b9b4b312a2:111727:1863365452752896:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1777051565.813484:0:111727:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1777051565.813496:0:111727:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1777051565.813500:0:111727:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1777051565.813512:0:111727:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff99da44f8d000 00000020:00000080:0.0:1777051565.813516:0:111727:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1777051565.813587:0:111727:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1777051565.813594:0:111727:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1777051565.813597:0:111727:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1777051565.813602:0:111727:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1777051565.813607:0:111727:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1777051565.813610:0:111727:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1777051565.813636:0:111727:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff99da44f8d000 00000020:00000080:0.0:1777051565.813641:0:111727:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1777051565.813699:0:111727:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f298e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f9351a01-5b0e-4470-97fd-58b9b4b312a2:111727:1863365452753024:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1777051565.813788:0:111727:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051565.813829:0:111727:0:(client.c:2691:ptlrpc_set_wait()) set ffff99d950450600 going to sleep for 11 seconds 00000100:00100000:2.0:1777051565.813870:0:109180:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452753024 00000100:00100000:2.0:1777051565.813879:0:109180:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452753024 00000100:00100000:2.0:1777051565.813927:0:109180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1777051565.813941:0:109180:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5fcd4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9351a01-5b0e-4470-97fd-58b9b4b312a2+23:111727:x1863365452753024:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1777051565.814061:0:109180:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5fcd4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9351a01-5b0e-4470-97fd-58b9b4b312a2+23:111727:x1863365452753024:12345-0@lo:502:llog_process_th.0 Request processed in 123us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051565.814069:0:109180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1777051565.814126:0:111727:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f298e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f9351a01-5b0e-4470-97fd-58b9b4b312a2:111727:1863365452753024:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1777051565.814178:0:111727:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1777051565.814186:0:111727:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1777051565.814190:0:111727:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1777051565.814198:0:111727:0:(llog.c:858:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 50 count 49 00000020:01000000:2.0:1777051565.814570:0:6577:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 43-49 (rc=0) 10000000:01000000:2.0:1777051565.814626:0:6577:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.201.146@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1777051565.814639:0:6577:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.146@tcp lock: ffff99d94f69b800/0x85f51a6b967182ec lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b967182f3 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051565.814655:0:6577:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.146@tcp lock: ffff99d94f69b800/0x85f51a6b967182ec lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x85f51a6b967182f3 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777051565.847168:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da5f298e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452753152:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1777051565.847283:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051565.847571:0:10113:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452753152 00000100:00100000:2.0:1777051565.847581:0:10113:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452753152 00000100:00100000:0.0:1777051565.847627:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d942d21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452753280:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1777051565.847649:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1777051565.847688:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051565.847779:0:8473:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452753280 00000100:00100000:3.0:1777051565.847794:0:8473:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452753280 00000100:00100000:2.0:1777051565.847878:0:10113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5764 00000100:00100000:2.0:1777051565.847894:0:10113:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f518380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3677:x1863365452753152:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1777051565.847941:0:10113:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 515963584 pending 0 free 3860574208 avail 3629051904 00000100:00100000:2.0:1777051565.848009:0:10113:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f518380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3677:x1863365452753152:12345-0@lo:13:osp-pre-0-1.0 Request processed in 117us (726us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051565.848021:0:10113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5764 00000100:00100000:2.0:1777051565.848052:0:10113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5765 00000100:00100000:2.0:1777051565.848064:0:10113:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f298000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3678:x1863365452753280:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1777051565.848089:0:10113:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 489208512 pending 0 free 3642707968 avail 3411185664 00000100:00080000:1.0:1777051565.848103:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1777051565.848150:0:10113:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f298000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3678:x1863365452753280:12345-0@lo:13:osp-pre-1-1.0 Request processed in 87us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051565.848161:0:10113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5765 00000100:00100000:1.0:1777051565.848168:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da5f298e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3677:1863365452753152:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1777051565.848561:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d942d21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452753280:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1777051566.049847:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051566.050129:0:109186:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426162944 00000100:00100000:2.0:1777051566.050143:0:109186:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426162944 00000100:00100000:2.0:1777051566.050299:0:109186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 127 00000100:00100000:2.0:1777051566.050315:0:109186:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5fcd5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:29c4352d-3260-4734-909d-9ea5de9e7fa4+10:6255:x1863365426162944:12345-192.168.201.46@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1777051566.050339:0:109186:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777051566.050590:0:109186:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99d94f69ae00/0x85f51a6b967182fa lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6ca1 expref: -99 pid: 109186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051566.050651:0:109186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99d94f69ae00/0x85f51a6b967182fa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6ca1 expref: 11 pid: 109186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051566.050670:0:109186:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99d94f69ae00/0x85f51a6b967182fa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6ca1 expref: 11 pid: 109186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777051566.050686:0:109186:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99d94f69ae00, rc 0) 00000100:00100000:2.0:1777051566.051128:0:109186:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5fcd5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:29c4352d-3260-4734-909d-9ea5de9e7fa4+11:6255:x1863365426162944:12345-192.168.201.46@tcp:101:ll_cfg_requeue.0 Request processed in 814us (1291us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051566.051141:0:109186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 127 00000100:00100000:2.0:1777051566.059132:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051566.059313:0:109181:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426163072 00000100:00100000:3.0:1777051566.059326:0:109181:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426163072 00000100:00100000:3.0:1777051566.059516:0:109181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 128 00000100:00100000:3.0:1777051566.059534:0:109181:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942d2ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29c4352d-3260-4734-909d-9ea5de9e7fa4+11:6255:x1863365426163072:12345-192.168.201.46@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1777051566.059753:0:109181:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942d2ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29c4352d-3260-4734-909d-9ea5de9e7fa4+11:6255:x1863365426163072:12345-192.168.201.46@tcp:501:ll_cfg_requeue.0 Request processed in 222us (649us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051566.059767:0:109181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 128 00000100:00100000:1.0:1777051566.063714:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051566.063847:0:109180:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426163200 00000100:00100000:2.0:1777051566.063859:0:109180:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426163200 00000100:00100000:2.0:1777051566.063947:0:109180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 129 00000100:00100000:2.0:1777051566.063963:0:109180:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da6145c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29c4352d-3260-4734-909d-9ea5de9e7fa4+11:6255:x1863365426163200:12345-192.168.201.46@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1777051566.064152:0:109180:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da6145c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29c4352d-3260-4734-909d-9ea5de9e7fa4+11:6255:x1863365426163200:12345-192.168.201.46@tcp:503:ll_cfg_requeue.0 Request processed in 189us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051566.064167:0:109180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 129 00000100:00100000:1.0:1777051566.071936:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051566.072090:0:109186:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426163328 00000100:00100000:2.0:1777051566.072110:0:109186:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426163328 00000100:00100000:2.0:1777051566.072191:0:109186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 130 00000100:00100000:2.0:1777051566.072556:0:109186:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da6145e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:29c4352d-3260-4734-909d-9ea5de9e7fa4+11:142699:x1863365426163328:12345-192.168.201.46@tcp:502:llog_process_th.0 00000100:00100000:2.0:1777051566.073078:0:109186:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da6145e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:29c4352d-3260-4734-909d-9ea5de9e7fa4+11:142699:x1863365426163328:12345-192.168.201.46@tcp:502:llog_process_th.0 Request processed in 832us (1149us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051566.073100:0:109186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 130 00000100:00100000:1.0:1777051566.077036:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051566.077147:0:109181:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426163456 00000100:00100000:3.0:1777051566.077157:0:109181:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426163456 00000100:00100000:3.0:1777051566.077260:0:109181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 131 00000100:00100000:3.0:1777051566.077275:0:109181:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942d29450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29c4352d-3260-4734-909d-9ea5de9e7fa4+11:142699:x1863365426163456:12345-192.168.201.46@tcp:502:llog_process_th.0 00000100:00100000:3.0:1777051566.077401:0:109181:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942d29450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29c4352d-3260-4734-909d-9ea5de9e7fa4+11:142699:x1863365426163456:12345-192.168.201.46@tcp:502:llog_process_th.0 Request processed in 130us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051566.077410:0:109181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 131 00000100:00100000:1.0:1777051566.081561:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051566.081665:0:109182:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426163584 00000100:00100000:3.0:1777051566.081675:0:109182:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426163584 00000100:00100000:3.0:1777051566.081768:0:109182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 132 00000100:00100000:3.0:1777051566.081784:0:109182:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942b84850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29c4352d-3260-4734-909d-9ea5de9e7fa4+11:6255:x1863365426163584:12345-192.168.201.46@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1777051566.081802:0:109182:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777051566.081841:0:109182:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99da7d5cfc00/0x85f51a6b96718301 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xbc5a5cb0f65b6ca8 expref: -99 pid: 109182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051566.082026:0:109182:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99da7d5cfc00/0x85f51a6b96718301 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6ca8 expref: 12 pid: 109182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051566.082053:0:109182:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99da7d5cfc00/0x85f51a6b96718301 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.46@tcp remote: 0xbc5a5cb0f65b6ca8 expref: 12 pid: 109182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051566.082066:0:109182:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99da7d5cfc00, rc 0) 00000100:00100000:3.0:1777051566.082128:0:109182:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942b84850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29c4352d-3260-4734-909d-9ea5de9e7fa4+12:6255:x1863365426163584:12345-192.168.201.46@tcp:101:ll_cfg_requeue.0 Request processed in 348us (571us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051566.082148:0:109182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 132 00000100:00100000:1.0:1777051566.086027:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051566.086625:0:109186:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426163712 00000100:00100000:2.0:1777051566.086636:0:109186:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426163712 00000100:00100000:2.0:1777051566.087122:0:109186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 133 00000100:00100000:2.0:1777051566.087139:0:109186:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942b84450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:29c4352d-3260-4734-909d-9ea5de9e7fa4+12:6255:x1863365426163712:12345-192.168.201.46@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1777051566.087604:0:109186:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942b84450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:29c4352d-3260-4734-909d-9ea5de9e7fa4+12:6255:x1863365426163712:12345-192.168.201.46@tcp:501:ll_cfg_requeue.0 Request processed in 468us (1582us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051566.087626:0:109186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 133 00000100:00100000:1.0:1777051566.094905:0:3672:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051566.095016:0:109180:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426163840 00000100:00100000:2.0:1777051566.095028:0:109180:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426163840 00000100:00100000:2.0:1777051566.095112:0:109180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 134 00000100:00100000:2.0:1777051566.095128:0:109180:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942b85050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29c4352d-3260-4734-909d-9ea5de9e7fa4+12:6255:x1863365426163840:12345-192.168.201.46@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1777051566.096223:0:109180:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942b85050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29c4352d-3260-4734-909d-9ea5de9e7fa4+12:6255:x1863365426163840:12345-192.168.201.46@tcp:503:ll_cfg_requeue.0 Request processed in 1095us (1323us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051566.096238:0:109180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 134 00000100:00100000:1.0:1777051566.100911:0:3670:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:3.0:1777051566.101001:0:109182:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426163968 00000100:00100000:3.0:1777051566.101010:0:109182:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426163968 00000100:00100000:3.0:1777051566.101072:0:109182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 135 00000100:00100000:3.0:1777051566.101083:0:109182:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da6145ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29c4352d-3260-4734-909d-9ea5de9e7fa4+12:142702:x1863365426163968:12345-192.168.201.46@tcp:502:llog_process_th.0 00000100:00100000:3.0:1777051566.101807:0:109182:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da6145ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29c4352d-3260-4734-909d-9ea5de9e7fa4+12:142702:x1863365426163968:12345-192.168.201.46@tcp:502:llog_process_th.0 Request processed in 715us (892us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051566.101823:0:109182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 135 00000100:00100000:1.0:1777051566.107668:0:3671:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.46@tcp (source: 12345-192.168.201.46@tcp) 00000100:00100000:2.0:1777051566.108086:0:109186:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365426164096 00000100:00100000:2.0:1777051566.108096:0:109186:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365426164096 00000100:00100000:2.0:1777051566.108189:0:109186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.46@tcp, seq: 136 00000100:00100000:2.0:1777051566.108249:0:109186:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d942b85850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:29c4352d-3260-4734-909d-9ea5de9e7fa4+12:142702:x1863365426164096:12345-192.168.201.46@tcp:502:llog_process_th.0 00000100:00100000:2.0:1777051566.108393:0:109186:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d942b85850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:29c4352d-3260-4734-909d-9ea5de9e7fa4+12:142702:x1863365426164096:12345-192.168.201.46@tcp:502:llog_process_th.0 Request processed in 149us (729us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051566.108407:0:109186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.46@tcp, seq: 136 00010000:00010000:2.0:1777051566.230493:0:108751:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1777051566.878466:0:109175:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000001:00080000:0.0:1777051566.878522:0:109175:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 34359738463 is committed 00000001:00080000:0.0:1777051566.878533:0:109175:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 34359738462 is committed 00000004:00080000:0.0:1777051566.878539:0:109175:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00010000:00010000:1.0:1777051566.878639:0:3664:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710000/0x85f51a6b96718179 lrc: 3/0,1 mode: TXN/TXN res: [0x2000032e2:0x10:0x0].0x524cbed4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051566.878667:0:3664:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710000/0x85f51a6b96718179 lrc: 2/0,0 mode: TXN/TXN res: [0x2000032e2:0x10:0x0].0x524cbed4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051566.878684:0:3664:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710000/0x85f51a6b96718179 lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e2:0x10:0x0].0x524cbed4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051566.878747:0:3664:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d950710000 already unused, calling callback (ffffffffc17724f0) 00010000:00010000:1.0:1777051566.878757:0:3664:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710000/0x85f51a6b96718179 lrc: 3/0,0 mode: TXN/TXN res: [0x2000032e2:0x10:0x0].0x524cbed4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051566.878773:0:3664:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710000/0x85f51a6b96718179 lrc: 4/0,0 mode: TXN/TXN res: [0x2000032e2:0x10:0x0].0x524cbed4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051566.878806:0:3664:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e2:0x10:0x0].0x524cbed4 (ffff99da45738100) 00010000:00010000:1.0:1777051566.878814:0:3664:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777051566.878824:0:3664:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710000/0x85f51a6b96718179 lrc: 2/0,0 mode: --/TXN res: [0x2000032e2:0x10:0x0].0x524cbed4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777051566.878839:0:3664:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99d950710000/0x85f51a6b96718179 lrc: 0/0,0 mode: --/TXN res: [0x2000032e2:0x10:0x0].0x524cbed4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6580 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777051566.878943:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d942d21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452753408:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1777051566.879047:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051566.879475:0:27884:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452753408 00000100:00100000:3.0:1777051566.879492:0:27884:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452753408 00000100:00080000:0.0:1777051566.879620:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1777051566.879635:0:27884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8139 00000100:00100000:3.0:1777051566.879660:0:27884:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da5f298e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3679:x1863365452753408:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1777051566.879704:0:27884:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:516 count 1 00002000:00010000:3.0:1777051566.879793:0:27884:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x204:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777051566.879810:0:27884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bcd765a5/0x85f51a6b96718308 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x204:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 27884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051566.879838:0:27884:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051566.879843:0:27884:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777051566.879851:0:27884:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bcd765a5/0x85f51a6b96718308 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x204:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 27884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051566.879880:0:27884:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bcd765a5/0x85f51a6b96718308 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x204:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 27884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051566.879899:0:27884:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bcd765a5/0x85f51a6b96718308 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x204:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 27884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051566.879914:0:27884:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bcd765a5/0x85f51a6b96718308 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x204:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 27884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777051566.879975:0:27884:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1777051566.880255:0:27884:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da5f298e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+6:3679:x1863365452753408:12345-0@lo:6:osp-syn-1-0.0 Request processed in 602us (1207us total) trans 4294968381 rc 0/0 00000100:00100000:3.0:1777051566.880272:0:27884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8139 00010000:00010000:0.0:1777051566.880417:0:38719:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1777051566.880429:0:38719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bcd765a5/0x85f51a6b96718308 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x204:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 27884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051566.880445:0:38719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99d950705800 already unused, calling callback (ffffffffc0bed2d0) 00010000:00010000:0.0:1777051566.880452:0:38719:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bcd765a5/0x85f51a6b96718308 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x204:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 27884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051566.880467:0:38719:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bcd765a5/0x85f51a6b96718308 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x204:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 27884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051566.880493:0:38719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bcd765a5/0x85f51a6b96718308 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x204:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 27884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051566.880504:0:38719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bcd765a5/0x85f51a6b96718308 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x204:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 27884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777051566.880526:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777051566.880528:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777051566.880530:0:38719:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1777051566.880657:0:3679:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99d942d21500/2, rc 0, transno 4294968381 00000100:00100000:1.0:1777051566.880670:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d942d21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452753408:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1777051567.255639:0:6567:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777051568.284775:0:6568:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1777051568.408540:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d942d21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3680:1863365452753536:0@lo:400:kworker.0 00000100:00100000:1.0:1777051568.408638:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051568.408777:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da7fdf0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3677:1863365452753664:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1777051568.408838:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051568.408951:0:109180:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452753536 00000100:00100000:0.0:1777051568.408963:0:109180:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452753536 00000100:00100000:2.0:1777051568.409012:0:46500:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452753664 00000100:00100000:2.0:1777051568.409023:0:46500:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452753664 00000100:00100000:0.0:1777051568.409045:0:109180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1777051568.409064:0:109180:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da6145f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9351a01-5b0e-4470-97fd-58b9b4b312a2+23:3680:x1863365452753536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777051568.409118:0:46500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8397 00000100:00100000:2.0:1777051568.409137:0:46500:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f65b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+5:3677:x1863365452753664:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1777051568.409175:0:46500:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4194304 pending 0 free 1446141952 avail 1299902464 00000100:00100000:2.0:1777051568.409281:0:46500:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f65b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_004:lustre-MDT0000-mdtlov_UUID+5:3677:x1863365452753664:12345-0@lo:41:osp-pre-1-0.0 Request processed in 147us (441us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051568.409290:0:46500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8397 00000100:00100000:0.0:1777051568.413220:0:109180:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da6145f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9351a01-5b0e-4470-97fd-58b9b4b312a2+23:3680:x1863365452753536:12345-0@lo:400:kworker.0 Request processed in 4138us (4561us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051568.413237:0:109180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1777051568.413557:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d9418f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452753792:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1777051568.413612:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051568.413763:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da7fdf0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3677:1863365452753664:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1777051568.413836:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d942d21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3679:1863365452753920:0@lo:400:kworker.0 00000100:00100000:2.0:1777051568.413847:0:46498:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452753792 00000100:00100000:2.0:1777051568.413858:0:46498:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452753792 00000100:00100000:0.0:1777051568.413895:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051568.413928:0:46498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8398 00000100:00100000:2.0:1777051568.413948:0:46498:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da44495880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+7:3678:x1863365452753792:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1777051568.413963:0:27882:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452753920 00000100:00100000:0.0:1777051568.413972:0:27882:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452753920 00000004:00000024:2.0:1777051568.413988:0:46498:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4194304 pending 0 free 1441509376 avail 1295269888 00000100:00100000:0.0:1777051568.414044:0:27882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13621 00000100:00100000:0.0:1777051568.414062:0:27882:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da44495f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0000_UUID+5:3679:x1863365452753920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777051568.414079:0:46498:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da44495880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+7:3678:x1863365452753792:12345-0@lo:41:osp-pre-0-1.0 Request processed in 135us (462us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051568.414093:0:46498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8398 00000100:00100000:0.0:1777051568.414143:0:27882:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da44495f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0000_UUID+5:3679:x1863365452753920:12345-0@lo:400:kworker.0 Request processed in 82us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051568.414155:0:27882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13621 00000100:00100000:2.0:1777051568.414175:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d9418f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3678:1863365452753792:0@lo:41:osp-pre-0-1.0 00000100:00080000:0.0:1777051568.414229:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1777051568.414280:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d942d21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3679:1863365452753920:0@lo:400:kworker.0 00000100:00100000:1.0:1777051568.416557:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d942d21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f9351a01-5b0e-4470-97fd-58b9b4b312a2:3680:1863365452753536:0@lo:400:kworker.0 00000100:00100000:1.0:1777051568.416881:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d942d20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3680:1863365452754048:0@lo:400:kworker.0 00000100:00100000:1.0:1777051568.416959:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051568.417005:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d942d21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3678:1863365452754304:0@lo:400:kworker.0 00000100:00100000:1.0:1777051568.417020:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d9533bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3680:1863365452754560:0@lo:400:kworker.0 00000100:00100000:3.0:1777051568.417058:0:8492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452754048 00000100:00100000:3.0:1777051568.417069:0:8492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452754048 00000100:00100000:2.0:1777051568.417130:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051568.417136:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d944e11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452754432:0@lo:400:kworker.0 00000100:00100000:1.0:1777051568.417139:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051568.417160:0:8492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452754304 00000100:00100000:3.0:1777051568.417168:0:8492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452754304 00000100:00100000:0.0:1777051568.417258:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051568.417265:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d950267b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3678:1863365452754816:0@lo:400:kworker.0 00000100:00100000:3.0:1777051568.417265:0:8492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13622 00000100:00100000:1.0:1777051568.417279:0:3680:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d950265f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3680:1863365452755072:0@lo:400:kworker.0 00000100:00100000:3.0:1777051568.417292:0:8492:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f51b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3680:x1863365452754048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777051568.417306:0:3679:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d950265880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452754944:0@lo:400:kworker.0 00000100:00100000:2.0:1777051568.417399:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777051568.417403:0:3680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051568.417406:0:24468:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452754560 00000100:00100000:3.0:1777051568.417413:0:8492:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f51b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3680:x1863365452754048:12345-0@lo:400:kworker.0 Request processed in 124us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051568.417416:0:24468:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452754560 00000100:00100000:3.0:1777051568.417429:0:8492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13622 00000100:00100000:3.0:1777051568.417458:0:8492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452755072 00000100:00100000:3.0:1777051568.417465:0:8492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452755072 00000100:00100000:0.0:1777051568.417486:0:24468:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452754432 00000100:00100000:0.0:1777051568.417492:0:24468:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452754432 00000100:00100000:2.0:1777051568.417495:0:3678:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1777051568.417522:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d942d20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3680:1863365452754048:0@lo:400:kworker.0 00000100:00100000:2.0:1777051568.417522:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d942d21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3678:1863365452754176:0@lo:400:kworker.0 00000100:00100000:3.0:1777051568.417522:0:8492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13623 00000100:00100000:0.0:1777051568.417533:0:24468:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452754816 00000100:00100000:0.0:1777051568.417545:0:24468:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452754816 00000100:00100000:3.0:1777051568.417545:0:8492:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d9418f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3678:x1863365452754304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777051568.417604:0:24468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10639 00000100:00100000:2.0:1777051568.417618:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051568.417628:0:24468:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f51aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3680:x1863365452754560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777051568.417629:0:8470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10640 00000100:00100000:3.0:1777051568.417635:0:8492:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d9418f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3678:x1863365452754304:12345-0@lo:400:kworker.0 Request processed in 90us (513us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051568.417649:0:8492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13623 00000100:00100000:1.0:1777051568.417664:0:8470:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da44497800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3679:x1863365452754432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777051568.417681:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d950264700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3678:1863365452754688:0@lo:400:kworker.0 00000100:00100000:3.0:1777051568.417681:0:8492:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452754176 00000100:00100000:3.0:1777051568.417717:0:8492:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452754176 00000100:00100000:0.0:1777051568.417751:0:24468:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f51aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3680:x1863365452754560:12345-0@lo:400:kworker.0 Request processed in 131us (625us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051568.417766:0:24468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10639 00000100:00100000:3.0:1777051568.417780:0:8492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13624 00000100:00100000:3.0:1777051568.417796:0:8492:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94f51a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3680:x1863365452755072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777051568.417798:0:24468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10641 00000100:00100000:2.0:1777051568.417813:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777051568.417823:0:24468:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d9418f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3678:x1863365452754816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777051568.417826:0:8470:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da44497800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3679:x1863365452754432:12345-0@lo:400:kworker.0 Request processed in 168us (561us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051568.417850:0:8470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10640 00000100:00100000:3.0:1777051568.417892:0:8492:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94f51a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3680:x1863365452755072:12345-0@lo:400:kworker.0 Request processed in 94us (496us total) trans 0 rc 0/0 00000100:00100000:0.0:1777051568.417909:0:24468:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d9418f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3678:x1863365452754816:12345-0@lo:400:kworker.0 Request processed in 97us (520us total) trans 0 rc 0/0 00000100:00100000:2.0:1777051568.417912:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d942d21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3678:1863365452754304:0@lo:400:kworker.0 00000100:00100000:3.0:1777051568.417912:0:8492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13624 00000100:00100000:1.0:1777051568.417917:0:27885:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452754688 00000100:00100000:0.0:1777051568.417930:0:24468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10641 00000100:00100000:1.0:1777051568.417932:0:27885:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452754688 00000100:00100000:3.0:1777051568.417958:0:8492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13625 00000100:00100000:2.0:1777051568.417964:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d950267b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3678:1863365452754816:0@lo:400:kworker.0 00000100:00100000:3.0:1777051568.417984:0:8492:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d94ed2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3678:x1863365452754176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777051568.418014:0:27885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13626 00000100:00100000:1.0:1777051568.418033:0:27885:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f867100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000-lwp-MDT0001_UUID+5:3678:x1863365452754688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777051568.418076:0:8492:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d94ed2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3678:x1863365452754176:12345-0@lo:400:kworker.0 Request processed in 99us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051568.418092:0:8492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13625 00000100:00080000:2.0:1777051568.418112:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1777051568.418124:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1777051568.418128:0:27885:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f867100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000-lwp-MDT0001_UUID+5:3678:x1863365452754688:12345-0@lo:400:kworker.0 Request processed in 96us (317us total) trans 0 rc 0/0 00000100:00080000:2.0:1777051568.418137:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1777051568.418143:0:3679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1777051568.418149:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1777051568.418165:0:27885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13626 00000100:00100000:3.0:1777051568.418177:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d942d21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3678:1863365452754176:0@lo:400:kworker.0 00000100:00100000:0.0:1777051568.418213:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d944e11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3679:1863365452754432:0@lo:400:kworker.0 00000100:00100000:3.0:1777051568.418253:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d950264700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3678:1863365452754688:0@lo:400:kworker.0 00000100:00100000:1.0:1777051568.418267:0:55805:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452754944 00000100:00100000:1.0:1777051568.418279:0:55805:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452754944 00000100:00100000:0.0:1777051568.418345:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d950265f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3680:1863365452755072:0@lo:400:kworker.0 00000100:00080000:2.0:1777051568.418352:0:6576:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1777051568.418378:0:55805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10642 00000100:00100000:0.0:1777051568.418387:0:3680:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d9533bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3680:1863365452754560:0@lo:400:kworker.0 00000100:00100000:1.0:1777051568.418400:0:55805:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99da44497b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:3679:x1863365452754944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777051568.418487:0:55805:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99da44497b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:3679:x1863365452754944:12345-0@lo:400:kworker.0 Request processed in 95us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1777051568.418502:0:55805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10642 00000100:00100000:0.0:1777051568.418529:0:3679:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d950265880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3679:1863365452754944:0@lo:400:kworker.0 00000100:00100000:2.0:1777051568.919534:0:3677:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99da44494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3677:1863365452755200:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1777051568.919626:0:3677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777051568.919789:0:3678:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff99d950264700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3678:1863365452755328:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1777051568.919840:0:3678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777051568.920015:0:8472:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452755200 00000100:00100000:3.0:1777051568.920026:0:8472:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452755200 00000100:00100000:3.0:1777051568.920097:0:8472:0:(service.c:2280:ptlrpc_server_handle_req_in()) unwrap req x1863365452755328 00000100:00100000:3.0:1777051568.920103:0:8472:0:(service.c:2345:ptlrpc_server_handle_req_in()) got req x1863365452755328 00000100:00100000:3.0:1777051568.920135:0:8472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5766 00000100:00100000:3.0:1777051568.920149:0:8472:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d95f866a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3677:x1863365452755200:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1777051568.920195:0:8472:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 489208512 pending 0 free 3642707968 avail 3411185664 00000100:00100000:3.0:1777051568.920317:0:8472:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d95f866a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3677:x1863365452755200:12345-0@lo:13:osp-pre-1-0.0 Request processed in 169us (690us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051568.920330:0:8472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5766 00000100:00100000:3.0:1777051568.920357:0:8472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5767 00000100:00100000:3.0:1777051568.920368:0:8472:0:(service.c:2531:ptlrpc_server_handle_request()) Handling RPC req@ffff99d944070e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3678:x1863365452755328:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1777051568.920392:0:8472:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 515963584 pending 0 free 3860574208 avail 3629051904 00000100:00100000:3.0:1777051568.920437:0:8472:0:(service.c:2589:ptlrpc_server_handle_request()) Handled RPC req@ffff99d944070e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3678:x1863365452755328:12345-0@lo:13:osp-pre-0-0.0 Request processed in 71us (597us total) trans 0 rc 0/0 00000100:00100000:3.0:1777051568.920449:0:8472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5767 00000100:00100000:2.0:1777051568.920607:0:3678:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99d950264700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3678:1863365452755328:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1777051568.920723:0:3677:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff99da44494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3677:1863365452755200:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1777051569.303103:0:13753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 73742 lines, 73742 kept, 0 dropped, 0 bad.